-- Logs begin at Tue 2022-10-11 19:00:54 UTC, end at Tue 2022-10-11 21:17:08 UTC. -- Oct 11 19:31:55.561538 n-d-860864-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 19:31:55.570477 n-d-860864-3 devstack@n-api.service[111113]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 19:31:55 2022] *** Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: nodename: n-d-860864-3 Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: machine: x86_64 Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: clock source: unix Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: pcre jit disabled Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: detected number of CPU cores: 4 Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: current working directory: / Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: detected binary path: /usr/bin/uwsgi-core Oct 11 19:31:55.572668 n-d-860864-3 devstack@n-api.service[111113]: your processes number limit is 47680 Oct 11 19:31:55.573278 n-d-860864-3 devstack@n-api.service[111113]: your memory page size is 4096 bytes Oct 11 19:31:55.573278 n-d-860864-3 devstack@n-api.service[111113]: detected max file descriptor number: 2048 Oct 11 19:31:55.573278 n-d-860864-3 devstack@n-api.service[111113]: lock engine: pthread robust mutexes Oct 11 19:31:55.573278 n-d-860864-3 devstack@n-api.service[111113]: thunder lock: enabled Oct 11 19:31:55.573278 n-d-860864-3 devstack@n-api.service[111113]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 19:31:55.573278 n-d-860864-3 devstack@n-api.service[111113]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 19:31:55.612343 n-d-860864-3 devstack@n-api.service[111113]: Python main interpreter initialized at 0x55c8215ee9c0 Oct 11 19:31:55.612343 n-d-860864-3 devstack@n-api.service[111113]: python threads support enabled Oct 11 19:31:55.612343 n-d-860864-3 devstack@n-api.service[111113]: your server socket listen backlog is limited to 100 connections Oct 11 19:31:55.612343 n-d-860864-3 devstack@n-api.service[111113]: your mercy for graceful operations on workers is 90 seconds Oct 11 19:31:55.612665 n-d-860864-3 devstack@n-api.service[111113]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 19:31:55.612734 n-d-860864-3 devstack@n-api.service[111113]: *** Operational MODE: preforking *** Oct 11 19:31:55.612988 n-d-860864-3 devstack@n-api.service[111113]: *** uWSGI is running in multiple interpreter mode *** Oct 11 19:31:55.612988 n-d-860864-3 devstack@n-api.service[111113]: spawned uWSGI master process (pid: 111113) Oct 11 19:31:55.613178 n-d-860864-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 11 19:31:55.613721 n-d-860864-3 devstack@n-api.service[111113]: spawned uWSGI worker 1 (pid: 111114, cores: 1) Oct 11 19:31:55.614046 n-d-860864-3 devstack@n-api.service[111113]: spawned uWSGI worker 2 (pid: 111115, cores: 1) Oct 11 19:31:55.614306 n-d-860864-3 devstack@n-api.service[111113]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 19:31:56.272280 n-d-860864-3 devstack@n-api.service[111115]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 19:31:56.280321 n-d-860864-3 devstack@n-api.service[111114]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 19:31:57.349214 n-d-860864-3 devstack@n-api.service[111114]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 19:31:57.349214 n-d-860864-3 devstack@n-api.service[111114]: from cryptography.utils import int_from_bytes Oct 11 19:31:57.349895 n-d-860864-3 devstack@n-api.service[111114]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 19:31:57.349895 n-d-860864-3 devstack@n-api.service[111114]: from cryptography.utils import int_from_bytes Oct 11 19:31:57.351557 n-d-860864-3 devstack@n-api.service[111115]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 19:31:57.351557 n-d-860864-3 devstack@n-api.service[111115]: from cryptography.utils import int_from_bytes Oct 11 19:31:57.351988 n-d-860864-3 devstack@n-api.service[111115]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 19:31:57.351988 n-d-860864-3 devstack@n-api.service[111115]: from cryptography.utils import int_from_bytes Oct 11 19:31:59.863818 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 19:31:59.864379 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 19:31:59.864589 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 19:31:59.864940 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 19:31:59.865325 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 19:31:59.865325 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 19:31:59.865484 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 19:31:59.865581 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.865721 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 19:31:59.865870 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.866084 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 19:31:59.866172 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.866341 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 19:31:59.866489 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.866753 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.866841 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.867081 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.867180 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.867404 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.867492 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.867727 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.867821 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.868049 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.868143 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.868307 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.868393 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.868617 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.868719 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.868937 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.869031 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.869254 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.869340 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.869529 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.870136 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.870376 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.870567 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.870718 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.870808 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.871020 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.871152 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.871339 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.871429 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.871641 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.871727 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.871979 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.872131 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.872284 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.873293 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.873434 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.873565 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.873693 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.873792 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.873874 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.873965 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.874044 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.874117 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.874211 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.874291 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.874375 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.874455 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.874610 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.874759 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.874927 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.875016 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.875237 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.875377 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.875555 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.875695 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.875861 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.876011 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.876181 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.876322 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.876489 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.876634 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.876874 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.877039 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.877203 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.877351 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.877491 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.877659 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.877804 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.877976 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.878213 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.878308 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.878552 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.878658 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.878856 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.878945 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.879178 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.879264 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.879498 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.879717 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.879806 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.879887 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.880114 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.880250 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.880421 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.880517 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.880728 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.880814 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.881044 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.881129 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.881345 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.881432 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.881645 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.881730 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.881893 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.881987 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.882199 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.882287 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.882517 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.882641 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.882854 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.882940 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.883103 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.883191 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.883406 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.883507 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.883655 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.883751 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.883968 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.884058 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.884283 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.884370 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.884573 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.884668 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.884821 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.884908 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.885136 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.885802 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.886021 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.886153 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.886324 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.886400 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.886654 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.886763 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.886963 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.887051 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.887268 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.887360 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.887575 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.887661 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.887884 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.887980 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.888188 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.888274 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.888496 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.888593 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.888810 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.888896 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.889122 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.889211 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.889437 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.889531 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.889743 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.889828 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.890063 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.890150 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.890378 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.890472 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.890709 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.890798 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.891018 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.891104 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.891334 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.891429 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.891640 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.891730 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.891943 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.892043 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.892248 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.892344 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.892562 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.892656 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.892867 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.892963 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.893179 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.893273 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.893423 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.893508 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.893721 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.893806 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.894023 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.894110 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.894337 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.894442 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.894659 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.894761 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.894963 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.895051 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.895264 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.895359 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.895561 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.895648 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.895865 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.895952 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.896167 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.896252 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.896476 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.896573 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.896768 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.896854 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.897068 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.897153 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.897369 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.897464 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.897670 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.897757 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.897973 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.898058 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.898272 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.898367 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.898595 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.898699 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.898902 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.898988 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.899211 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.899310 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.899512 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.899597 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.899815 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.899899 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.900115 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.900210 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.900417 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.900511 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.900730 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.900818 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.901086 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.901192 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.901396 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.901532 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.901706 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.901830 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.902028 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.902125 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.902335 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.902422 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.902668 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.902771 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.902995 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.903095 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.903311 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.903397 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.903619 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.903705 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.903919 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.904006 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.904221 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.904310 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.904526 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.904619 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.904828 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.904914 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.905130 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.905223 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.905429 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.905514 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.905727 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.905814 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.906024 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.906110 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.906326 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.906423 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.906649 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.906746 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.906948 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.907036 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.907244 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.907338 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.907548 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.907635 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.907854 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.907940 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.908153 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.908247 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.908450 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.908535 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.908747 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.908832 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.909057 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.909153 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.909368 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.909460 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.909677 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.909771 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.909984 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.910080 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.910300 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:31:59.910395 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.910662 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.910753 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.910988 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.911083 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.911303 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.911390 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.911612 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.911736 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.911923 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.912011 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.912245 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.912333 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.912564 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.912722 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.912864 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.912951 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.913169 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.913261 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.913482 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.913577 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.913794 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.913879 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.914105 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.914256 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.914418 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.914506 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.914753 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.914841 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.915069 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.915155 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.915376 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.915461 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.915691 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.915779 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.916006 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.916091 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.916319 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.916414 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.916684 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.916771 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.917064 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.917261 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.917449 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.917607 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.917744 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.917878 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.918071 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.918208 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.918390 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.918561 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.918724 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.918856 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.919035 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.919167 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.919343 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.919507 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.919680 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.919817 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.919991 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.920123 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.920303 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.920435 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.920616 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.920706 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.920926 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.921018 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.921246 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.921333 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.921556 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.921649 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.921862 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.921947 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.922171 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.922266 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.922487 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.922629 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.922817 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.922903 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.923139 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.923226 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.923450 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.923535 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.923763 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.923866 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.924073 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.924158 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.924383 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.924470 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.924700 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.924795 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.925010 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.925096 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.925319 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.925412 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.925626 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.925721 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.925928 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.926029 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.926230 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.926325 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.926548 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.926700 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.926864 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.927001 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.927163 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.927297 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.927465 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.927624 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.927759 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.927894 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.928066 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.928203 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.928372 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.928509 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.928680 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.928815 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.928988 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.929131 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.929346 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.929492 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.929627 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.929760 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.929894 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.930027 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.930196 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.930332 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.930467 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.930618 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.930803 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.930934 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.931113 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.931210 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.931419 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.931558 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.931722 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.931871 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.932029 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.932623 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.932971 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.933110 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.933248 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.933388 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.933548 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.933680 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.933858 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.934003 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.934167 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.934313 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.934485 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.934636 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.934815 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.934921 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.935133 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.935232 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.935444 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.935531 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.935753 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.935838 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.936082 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.936169 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.936404 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.936506 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.936707 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.936810 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.937023 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.937110 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.937344 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.937429 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.937658 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.937743 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.937961 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.938047 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.938270 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.938364 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.938595 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.938686 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.938900 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.938995 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.939200 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.939299 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.939505 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.939607 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.939812 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.939904 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.940116 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.940213 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.940420 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.940525 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.940716 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.940807 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.941015 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.941100 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.941319 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.941413 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.941626 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.941712 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.941925 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.942031 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.942226 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.942328 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.942543 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.942631 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.942864 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.942956 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.943170 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.943256 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.943472 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.943557 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.943780 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.943865 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.944121 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.944207 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.944427 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.944527 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.944742 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.944838 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.945053 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.945146 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.945359 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.945444 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.945667 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.945768 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.945976 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.946069 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.946283 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.946377 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.946622 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.946739 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.946936 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.947030 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.947244 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.947329 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.947551 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.947645 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.947917 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.948007 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.948227 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.948318 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.948545 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.948642 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.948848 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.948934 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.949161 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.949250 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.949468 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.949563 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.949788 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.949873 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.950093 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.950178 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.950417 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.950511 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.950747 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.950843 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.951061 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.951148 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.951370 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.951457 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.951681 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.951766 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.951992 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.952078 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.952302 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.952396 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.952621 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.952706 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.952929 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.953019 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.953244 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.953358 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.953550 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.953647 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.953870 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.953965 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.954175 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.954272 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.954490 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.954680 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.954839 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.954984 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.955123 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.955260 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.955428 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.955565 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.955757 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.955912 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.956049 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.956191 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.956363 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.956511 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.956681 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.956827 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.956990 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.957121 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.957298 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.957435 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.957606 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.957751 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.957902 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.958038 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.958199 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.958336 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.958589 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.958724 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.958859 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.958993 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.959133 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.959267 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.959411 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.959546 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.959717 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.959868 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.960030 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.960174 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.960322 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.960457 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.960681 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.960819 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.960955 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.961090 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.961236 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.961370 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.961505 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.961639 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.961814 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.961951 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.962100 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.962259 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.962414 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.962567 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.962757 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.962904 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.963062 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.963195 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.964181 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.964274 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.964492 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.964650 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.964799 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.964956 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.965091 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.965228 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.965369 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.965516 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.965699 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.965837 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.966006 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.966142 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.966307 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.966461 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.966628 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.966759 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.966969 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.967105 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.967274 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.967410 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.967577 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.967713 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.967882 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.968017 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.968189 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.968326 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.968504 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.968641 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.968812 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.968958 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.969105 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.969239 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.969416 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.969553 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.969724 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.969861 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.970034 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.970178 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.970341 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.970492 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.970669 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.970822 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.970976 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.971070 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.971283 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.971370 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.971589 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.971684 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.971890 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.971976 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.972197 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.972290 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.972508 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.972606 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.972826 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.973074 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.973178 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.973405 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.973502 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.973719 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.973814 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.974035 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.974286 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.974387 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.974645 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.974755 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.974967 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.975069 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.975288 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.975377 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.975634 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.975737 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.975938 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.976034 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.976248 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.976343 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.976555 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.976651 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.976860 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.976956 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.977170 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.977303 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.977473 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.977560 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.977777 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.977871 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.978081 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.978167 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.978387 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.978473 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.978717 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.978807 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.979585 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.979693 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.979919 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.980009 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.980226 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.980314 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.980537 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.980631 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.980838 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.980925 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.981150 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.981241 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.981452 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.981546 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.981768 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.981863 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.982073 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.982158 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.982373 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.982506 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.982705 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.982805 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.983004 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.983089 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.983328 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.983420 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.983638 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.983802 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.983941 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.984028 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.984248 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.984343 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.984591 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.984688 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.984897 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.984984 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.985201 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.985341 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.985524 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.985670 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.985814 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.985948 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.986116 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.986253 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.986417 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.986574 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.986749 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.986887 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.987055 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.987193 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.987337 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.987472 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.987651 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.987790 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.987958 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.988110 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.988268 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.988405 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.988570 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.988706 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.988871 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.989027 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.989173 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.989309 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.989463 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.989601 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.989776 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.989921 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.990081 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.990217 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.990382 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.990538 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.990709 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.990855 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.991014 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.991142 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.991312 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.991399 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.991611 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.991708 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.991914 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.992001 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.992213 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.992298 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.992528 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.992622 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.992829 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.992915 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.993129 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.993215 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.993431 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.993517 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.993736 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.993828 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.994043 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.994129 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.994343 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.994430 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.994695 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.994800 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.995076 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.995177 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.995300 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.995389 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.995601 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.995688 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.995908 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.996004 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.996208 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.996295 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.996509 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.996595 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.996809 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.996904 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.997120 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.997206 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.997440 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.997566 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.997721 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.997821 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.998027 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.998114 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.998326 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.998412 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.998721 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.998824 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.999025 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.999113 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.999328 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.999415 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.999629 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.999724 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:31:59.999929 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.000025 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.000228 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.000316 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.000530 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.000618 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.000832 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.000918 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.001139 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.001228 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.001443 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.001532 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.001743 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.001829 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.002045 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.002132 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.002347 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.002435 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.002685 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.002774 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.002994 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.003094 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.003302 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.003390 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.003614 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.003709 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.003934 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.004029 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.004250 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.004336 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.004561 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.004648 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.004874 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.004970 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.005185 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.005279 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.005488 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.005577 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.005801 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.005901 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.006110 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.006205 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.006418 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.006504 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.006745 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.006836 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.007045 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.007138 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.007364 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.007459 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.007673 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.007770 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.007975 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.008060 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.008281 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.008368 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.008597 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.008683 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.008908 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.009000 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.009208 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.009300 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.009514 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.009602 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.009821 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.009908 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.010125 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.010248 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.010456 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.010748 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.010840 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.010933 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.011085 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.011227 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.011397 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.011485 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.011705 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.011791 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.012012 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.012178 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.012323 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.012409 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.012649 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.012742 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.012932 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.013039 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.013239 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.013334 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.013543 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.013629 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.013850 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.013938 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.014157 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.014250 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.014459 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.014565 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.014789 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.014878 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.015089 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.015174 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.015396 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.015528 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.015699 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.015786 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.016008 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.016121 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.016315 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.016432 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.016626 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.016742 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.016931 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.017046 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.017354 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.017449 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.017662 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.017750 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.017972 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.018059 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.018280 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.018375 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.018603 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.018693 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.018917 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.019004 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.019236 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.019341 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.019551 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.019638 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.019856 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.019942 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.020194 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.020294 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.020495 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.020582 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.020804 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.020889 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.021124 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.021219 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.021426 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.021515 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.021726 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.021820 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.022028 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.022122 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.022351 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.022439 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.022677 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.022767 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.022982 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.023072 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.023290 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.023378 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.023617 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.023703 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.023924 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.024013 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.024245 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.024369 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.024664 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.024761 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.024970 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.025063 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.025277 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.025363 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.025596 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.025709 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.026447 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.026616 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.026862 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.026950 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.027190 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.027278 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.027512 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.027608 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.027837 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.027925 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.028145 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.028233 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.028459 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.028555 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.028769 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.028856 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.029069 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.029156 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.029391 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.029488 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.029707 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.029795 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.030016 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.030102 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.030322 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.030421 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.030676 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.030769 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.031002 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.031090 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.031320 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.031448 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.031643 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.031739 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.031975 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.032061 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.032280 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.032368 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.032581 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.032667 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.032894 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.032981 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.033196 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.033286 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.033498 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.033585 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.033815 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.033915 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.034118 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.034207 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.034427 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.034514 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.034760 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.034860 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.035067 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.035156 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.035369 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.035456 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.035670 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.035765 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.035980 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.036067 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.036279 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.036365 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.036582 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.036678 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.036886 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.036974 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.037201 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.037287 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.037501 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.037596 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.037809 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.037940 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.038127 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.038213 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.038435 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.038587 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.038761 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.038849 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.039063 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.039150 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.039365 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.039453 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.039680 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.039766 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.039987 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.040073 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.040292 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.040379 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.040598 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.040693 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.040929 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.041028 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.041236 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.041331 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.041662 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.041754 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.042011 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.042112 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.042345 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.042440 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.042683 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.042773 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.043022 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.043127 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.043352 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.043442 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.043655 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.043741 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.043963 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.044060 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.044276 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.044371 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.044581 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.044668 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.044888 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.044976 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.045190 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.045276 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.045498 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.045583 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.045806 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.045927 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.046107 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.046217 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.046412 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.046507 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.046744 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.046847 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.047049 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.047136 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.047356 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.047443 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.047661 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.047748 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.047967 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.048116 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.048290 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.048432 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.048571 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.048708 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.048884 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.049021 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.049187 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.049332 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.049483 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.049618 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.049782 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.049922 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.050123 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.050273 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.050410 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.050560 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.050767 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.050856 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.051082 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.051187 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.051397 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.051484 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.051713 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.051807 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.052026 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.052115 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.052340 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.052428 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.052651 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.052738 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.052965 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.053052 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.053278 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.053364 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.053597 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.053695 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.054564 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.054718 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.054839 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.054962 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.055071 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.055186 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.055304 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.055414 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.055414 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.055613 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.055720 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.055835 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.055972 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.056095 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.056284 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.056400 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.056595 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.056720 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.056907 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.057519 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.057714 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.057834 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.058089 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.058225 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.058365 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.058501 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.058715 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.058832 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.059051 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.059176 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.059370 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.059470 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.059685 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.059772 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.060000 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.060098 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.060314 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.060410 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.060668 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.060768 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.060985 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.061073 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.061290 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.061379 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.061607 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.061749 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.061919 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.062015 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.062231 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.062327 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.062565 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.062657 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.062880 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.062970 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.063194 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.063283 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.063512 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.063602 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.063821 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.063907 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.064130 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.064230 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.064442 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.064532 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.064754 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.064838 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.065065 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.065159 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.065380 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.065469 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.065695 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.065782 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.066006 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.066101 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.066316 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.066404 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.066658 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.066761 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.066985 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.067182 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.067302 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.067492 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.067618 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.067821 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.067934 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.068148 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.068465 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.068568 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.068777 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.068864 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.069093 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.069188 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.069437 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.069537 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.069718 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.069812 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.070019 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.070107 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.070327 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.070422 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.070661 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.070843 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.071004 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.071153 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.071299 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.071445 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.071590 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.071777 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.071955 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.072104 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.072250 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.072403 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.072559 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.072766 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.072978 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.073132 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.073306 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.073459 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.073649 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.073815 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.073963 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.074120 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.074389 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.074572 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.074728 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.074889 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.075038 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.075217 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.075371 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.076059 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.076211 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.076345 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.076512 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.076668 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.076806 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.076951 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.077094 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.077235 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.077370 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.077505 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.077640 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.077788 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.077930 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.078074 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.078208 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.078379 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.078578 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.078684 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.078776 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.078858 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.078938 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.079017 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.079097 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.079186 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.079267 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.079347 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.079478 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.079652 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.079782 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.079957 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.080093 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.080285 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.080396 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.080592 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.080688 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.080897 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.080985 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.081204 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.081291 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.081518 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.081615 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.081848 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.081938 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.082131 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.082220 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.082437 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.082561 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.082769 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.082855 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.083080 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.083167 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.083385 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.083481 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.083700 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.083789 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.084008 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.084096 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.084309 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.084396 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.084613 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.084708 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.084933 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.085027 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.085246 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.085334 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.085570 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.085688 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.085876 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.085975 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.086181 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.086270 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.086497 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.086614 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.086833 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.086939 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.087158 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.087371 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.087459 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.087705 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.087791 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.088028 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.088115 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.089231 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.089820 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.089975 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.089975 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.090248 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.090388 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.090541 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.090677 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.090782 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.090868 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.090958 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.091092 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.091182 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.091407 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.091494 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.091717 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.091806 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.092028 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.092124 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.092338 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.092426 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.092648 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.092737 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.092956 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.093043 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.093267 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.093356 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.093574 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.093666 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.093881 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.093969 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.094194 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.094294 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.094501 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.094656 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.094845 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.094935 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.095154 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.095251 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.095467 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.095594 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.095804 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.095894 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.096114 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.096211 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.096428 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.096516 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.096740 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.096835 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.097054 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.097143 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.097360 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.097446 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.097667 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.097755 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.097973 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.098062 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.098283 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.098370 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.098621 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.098713 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.098944 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.099033 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.099258 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.099358 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.099560 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.099647 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.099868 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.100185 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.100280 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.100517 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.100615 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.100833 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.100930 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.101141 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.101229 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.101452 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.101776 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.101871 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.102098 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.102188 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.102410 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.102557 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.102768 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.102874 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.103080 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.103168 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.103407 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.103502 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.103737 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.103826 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.104111 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.104240 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.104428 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.104516 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.104734 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.104823 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.105041 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.105129 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.105345 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.105432 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.105676 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.105777 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.105972 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.106070 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.106281 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.106382 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.106608 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.106701 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.106914 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.107001 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.107226 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.107327 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.107528 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.107622 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.107831 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.107919 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.108133 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.108230 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.108436 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.108524 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.108743 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.108828 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.109045 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.109141 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.109352 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.109451 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.109650 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.109743 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.109952 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.110089 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.110252 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.110338 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.110572 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.110662 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.110882 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.110971 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.111183 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.111269 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.111485 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.111572 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.111788 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.111876 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.112088 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.112174 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.112389 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.112476 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.112693 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.112789 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.112998 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.113086 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.113302 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.113408 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.113607 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.113695 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.113956 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.114051 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.114240 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.114338 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.114571 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.114663 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.114897 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.114997 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.115215 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.115316 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.115529 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.115616 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.115837 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.115935 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.116150 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.116239 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.116462 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.116548 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.116776 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.116863 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.117089 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.117178 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.117398 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.117484 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.117706 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.117794 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.118014 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.118103 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.118335 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.118421 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.118682 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.118770 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.118991 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.119080 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.119304 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.119404 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.120131 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.120244 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.120461 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.120675 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.120790 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.121003 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.121091 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.121322 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.121410 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.121652 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.121739 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.121968 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.122056 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.122281 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.122370 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.122619 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.122724 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.122939 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.123070 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.123253 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.123361 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.123571 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.123667 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.123884 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.123989 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.124196 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.124290 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.124512 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.124607 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.124826 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.124930 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.125139 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.125234 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.125460 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.125556 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.125780 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.125894 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.126096 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.126190 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.126417 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.126502 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.126767 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.126856 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.127081 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.127175 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.127407 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.127504 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.127734 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.127821 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.128050 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.128136 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.128364 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.128451 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.128669 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.128763 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.128912 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 19:32:00.129028 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.129345 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.129662 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.129970 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:32:00.130217 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 19:32:00.282097 n-d-860864-3 devstack@n-api.service[111114]: INFO dbcounter [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Registered counter for database nova_api Oct 11 19:32:00.282776 n-d-860864-3 devstack@n-api.service[111115]: INFO dbcounter [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Registered counter for database nova_api Oct 11 19:32:00.304206 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_db.sqlalchemy.engines [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:32:00.305821 n-d-860864-3 devstack@n-api.service[111115]: DEBUG oslo_db.sqlalchemy.engines [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111115) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:32:00.312095 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writer thread running {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:32:00.313019 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writer thread running {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:32:00.369482 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.context [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) {{(pid=111115) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 19:32:00.371999 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.context [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) {{(pid=111114) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 19:32:00.373942 n-d-860864-3 devstack@n-api.service[111115]: DEBUG oslo_concurrency.lockutils [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:32:00.374402 n-d-860864-3 devstack@n-api.service[111115]: DEBUG oslo_concurrency.lockutils [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:32:00.375886 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:32:00.376003 n-d-860864-3 devstack@n-api.service[111115]: DEBUG oslo_concurrency.lockutils [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:32:00.376364 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:32:00.376695 n-d-860864-3 devstack@n-api.service[111115]: DEBUG oslo_concurrency.lockutils [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:32:00.377142 n-d-860864-3 devstack@n-api.service[111115]: DEBUG oslo_concurrency.lockutils [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:32:00.377922 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:32:00.378689 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:32:00.379139 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:32:00.379250 n-d-860864-3 devstack@n-api.service[111115]: DEBUG oslo_concurrency.lockutils [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111115) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:32:00.381107 n-d-860864-3 devstack@n-api.service[111115]: INFO dbcounter [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Registered counter for database nova_cell0 Oct 11 19:32:00.381205 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:32:00.383153 n-d-860864-3 devstack@n-api.service[111114]: INFO dbcounter [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Registered counter for database nova_cell0 Oct 11 19:32:00.385086 n-d-860864-3 devstack@n-api.service[111115]: INFO dbcounter [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Registered counter for database nova_cell1 Oct 11 19:32:00.388087 n-d-860864-3 devstack@n-api.service[111114]: INFO dbcounter [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Registered counter for database nova_cell1 Oct 11 19:32:00.394516 n-d-860864-3 devstack@n-api.service[111115]: DEBUG oslo_db.sqlalchemy.engines [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111115) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:32:00.395320 n-d-860864-3 devstack@n-api.service[111115]: DEBUG oslo_db.sqlalchemy.engines [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111115) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:32:00.396050 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_db.sqlalchemy.engines [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:32:00.397921 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_db.sqlalchemy.engines [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:32:00.403035 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writer thread running {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:32:00.403324 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writer thread running {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:32:00.403663 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writer thread running {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:32:00.408730 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writer thread running {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:32:00.548671 n-d-860864-3 devstack@n-api.service[111115]: INFO dbcounter [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Registered counter for database nova_cell0 Oct 11 19:32:00.553476 n-d-860864-3 devstack@n-api.service[111114]: INFO dbcounter [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Registered counter for database nova_cell0 Oct 11 19:32:00.557968 n-d-860864-3 devstack@n-api.service[111115]: DEBUG oslo_db.sqlalchemy.engines [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111115) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:32:00.562652 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_db.sqlalchemy.engines [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:32:00.562890 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writer thread running {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:32:00.567552 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writer thread running {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:32:00.902074 n-d-860864-3 devstack@n-api.service[111115]: WARNING keystonemiddleware.auth_token [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 19:32:00.904740 n-d-860864-3 devstack@n-api.service[111114]: WARNING keystonemiddleware.auth_token [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 19:32:00.909325 n-d-860864-3 devstack@n-api.service[111115]: WARNING keystonemiddleware.auth_token [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 19:32:00.912295 n-d-860864-3 devstack@n-api.service[111114]: WARNING keystonemiddleware.auth_token [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 19:32:01.251598 n-d-860864-3 devstack@n-api.service[111115]: WARNING keystonemiddleware.auth_token [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 19:32:01.255057 n-d-860864-3 devstack@n-api.service[111114]: WARNING keystonemiddleware.auth_token [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 19:32:01.257507 n-d-860864-3 devstack@n-api.service[111115]: WARNING keystonemiddleware.auth_token [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 19:32:01.261472 n-d-860864-3 devstack@n-api.service[111114]: WARNING keystonemiddleware.auth_token [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 19:32:01.263412 n-d-860864-3 devstack@n-api.service[111115]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8215ee9c0 pid: 111115 (default app) Oct 11 19:32:01.265499 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:32:01.266688 n-d-860864-3 devstack@n-api.service[111114]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8215ee9c0 pid: 111114 (default app) Oct 11 19:32:01.266810 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-9ec2cb47-98c2-41a9-b5ac-33f80e59b14e None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 Oct 11 19:32:01.267107 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Tue Oct 11 19:32:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:22.066051 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:22.067747 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002534 Oct 11 19:33:22.068391 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:22.092008 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writing DB stats nova_api:SELECT=3 {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:33:22.092957 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writing DB stats nova_cell0:SELECT=3 {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:33:22.094030 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writing DB stats nova_cell1:SELECT=3 {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:33:22.094957 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:33:22.981201 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-4ec550da-bee5-4859-839e-56f19433b68b admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:23.013943 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-4ec550da-bee5-4859-839e-56f19433b68b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.932981 Oct 11 19:33:23.014647 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 2/3] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 11 19:33:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:33:25.643211 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:25.644680 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-030a4547-1e3f-4032-8390-e9904a63660e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Oct 11 19:33:25.645238 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 2/4] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:26.086242 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-9f74b24c-c648-4d6e-ac3b-b39aa5812e03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0}} {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:26.133950 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-9f74b24c-c648-4d6e-ac3b-b39aa5812e03 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.482792 Oct 11 19:33:26.134496 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 3/5] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 11 19:33:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:33:26.148346 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writing DB stats nova_api:SELECT=3 {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:33:26.149130 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writing DB stats nova_cell0:SELECT=3 {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:33:26.151071 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writing DB stats nova_cell1:SELECT=3 {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:33:26.151812 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:33:26.357046 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-01fe9b48-bed4-41d9-bad3-3954c105cc46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:26.428554 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-01fe9b48-bed4-41d9-bad3-3954c105cc46 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285573 Oct 11 19:33:26.429497 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 3/6] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 11 19:33:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:33:29.065647 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-9f74b24c-c648-4d6e-ac3b-b39aa5812e03 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:29.066827 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-9f74b24c-c648-4d6e-ac3b-b39aa5812e03 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Oct 11 19:33:29.067228 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 4/7] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:29.877759 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-4dcc4698-bd56-47cf-b858-75237cff8cb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:29.924487 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-4dcc4698-bd56-47cf-b858-75237cff8cb9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.848816 Oct 11 19:33:29.926061 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 4/8] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 11 19:33:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:33:29.938331 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-0cc9a3d4-c376-4377-8e27-f44c9eacf3e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:29.983700 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-0cc9a3d4-c376-4377-8e27-f44c9eacf3e5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049002 Oct 11 19:33:29.984722 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 5/9] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 11 19:33:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:33:32.775733 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-4dcc4698-bd56-47cf-b858-75237cff8cb9 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:32.777443 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-4dcc4698-bd56-47cf-b858-75237cff8cb9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 Oct 11 19:33:32.778493 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:33.232191 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-1bcd13ba-4f73-41c8-be01-a0c9092e0045 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0}} {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:33.294696 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-1bcd13ba-4f73-41c8-be01-a0c9092e0045 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506669 Oct 11 19:33:33.297747 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 6/11] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 11 19:33:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:33:33.309499 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-58e511cc-1007-4ea4-935f-855b1e769a07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:33.353052 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-58e511cc-1007-4ea4-935f-855b1e769a07 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045770 Oct 11 19:33:33.365691 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 6/12] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 11 19:33:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:33:36.029188 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-1bcd13ba-4f73-41c8-be01-a0c9092e0045 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:36.030187 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-1bcd13ba-4f73-41c8-be01-a0c9092e0045 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Oct 11 19:33:36.030903 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 7/13] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:36.498907 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-94ec9021-09e3-464d-87dc-86d89a85d1af admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "ram": 2048}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:36.521445 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-94ec9021-09e3-464d-87dc-86d89a85d1af admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483983 Oct 11 19:33:36.522103 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 7/14] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 11 19:33:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:33:36.534945 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-554b3901-f1d8-4ee7-91eb-16ec71285aa6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:36.569224 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-554b3901-f1d8-4ee7-91eb-16ec71285aa6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038191 Oct 11 19:33:36.571142 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 8/15] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 11 19:33:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:33:39.294838 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-94ec9021-09e3-464d-87dc-86d89a85d1af admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:39.296402 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-94ec9021-09e3-464d-87dc-86d89a85d1af admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002123 Oct 11 19:33:39.296963 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 8/16] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:39.745765 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-24f104d5-696c-4dae-a799-b823e45c7937 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "disk": 20}} {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:39.770496 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-24f104d5-696c-4dae-a799-b823e45c7937 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466352 Oct 11 19:33:39.784158 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-bf52628a-f08b-4866-8ac8-55dc686fefdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:39.789787 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 9/17] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 11 19:33:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:33:39.817559 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-bf52628a-f08b-4866-8ac8-55dc686fefdb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037461 Oct 11 19:33:39.831020 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 9/18] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 11 19:33:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:33:42.474545 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-24f104d5-696c-4dae-a799-b823e45c7937 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:42.475502 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-24f104d5-696c-4dae-a799-b823e45c7937 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 11 19:33:42.475901 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 10/19] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:42.929811 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-ee797b8e-3441-48f2-8d23-0b9d69352169 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:42.954844 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-ee797b8e-3441-48f2-8d23-0b9d69352169 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.472964 Oct 11 19:33:42.955474 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 10/20] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 11 19:33:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:33:45.631866 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-24f104d5-696c-4dae-a799-b823e45c7937 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:45.633019 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-24f104d5-696c-4dae-a799-b823e45c7937 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Oct 11 19:33:45.633509 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 11/21] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:33:46.053590 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-d914ca3f-07e0-4963-a39e-f77bcadc8d04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:46.079115 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-d914ca3f-07e0-4963-a39e-f77bcadc8d04 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.439058 Oct 11 19:33:46.079679 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 11/22] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 11 19:33:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:33:46.094101 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-3a9b26eb-d3e2-4925-9363-2c4ac448993c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:46.126385 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-3a9b26eb-d3e2-4925-9363-2c4ac448993c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037090 Oct 11 19:33:46.134979 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 12/23] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 11 19:33:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:33:49.138985 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-d914ca3f-07e0-4963-a39e-f77bcadc8d04 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:49.140007 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-d914ca3f-07e0-4963-a39e-f77bcadc8d04 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 11 19:33:49.140408 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:49.537795 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-d64535a7-e908-4e31-b759-229b0afc5d7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "name": "m1.small"}} {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:49.557320 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-d64535a7-e908-4e31-b759-229b0afc5d7c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.410207 Oct 11 19:33:49.557864 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 13/25] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 11 19:33:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:33:49.569985 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-b078f1ef-f0b7-400b-87b5-cba7c9dce108 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:49.594470 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-b078f1ef-f0b7-400b-87b5-cba7c9dce108 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028012 Oct 11 19:33:49.595009 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 13/26] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 11 19:33:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:33:52.255342 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-d64535a7-e908-4e31-b759-229b0afc5d7c admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:52.256456 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-d64535a7-e908-4e31-b759-229b0afc5d7c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Oct 11 19:33:52.256954 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 14/27] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:52.722366 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-60d48eb5-ac5d-42cf-a93c-49d18a9c041b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium"}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:52.742201 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-60d48eb5-ac5d-42cf-a93c-49d18a9c041b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.478107 Oct 11 19:33:52.742783 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 14/28] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 11 19:33:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:33:52.755273 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-d6eb6eca-7134-484d-9582-538d3b321cb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:52.760168 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:33:52.785639 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-d6eb6eca-7134-484d-9582-538d3b321cb0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034527 Oct 11 19:33:52.786339 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 15/29] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 11 19:33:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:33:55.442292 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-60d48eb5-ac5d-42cf-a93c-49d18a9c041b admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:55.443260 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-60d48eb5-ac5d-42cf-a93c-49d18a9c041b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 11 19:33:55.443662 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 15/30] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:55.884314 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-fe2a2bc6-2b35-457b-898d-462fa2f32a55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:55.907371 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-fe2a2bc6-2b35-457b-898d-462fa2f32a55 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.457341 Oct 11 19:33:55.908608 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 16/31] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 11 19:33:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:33:55.920372 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-6129e9e7-76c5-4e70-b99c-9028ac452122 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:55.946004 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-6129e9e7-76c5-4e70-b99c-9028ac452122 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029246 Oct 11 19:33:55.946793 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 16/32] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 11 19:33:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:33:58.643042 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-fe2a2bc6-2b35-457b-898d-462fa2f32a55 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:33:58.644001 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-fe2a2bc6-2b35-457b-898d-462fa2f32a55 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Oct 11 19:33:58.644410 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 17/33] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:33:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:33:59.104113 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-4649a042-cdad-40b2-98fd-249f6ca4d377 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:59.111361 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:33:59.129025 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-4649a042-cdad-40b2-98fd-249f6ca4d377 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.478212 Oct 11 19:33:59.129751 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 17/34] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 11 19:33:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:33:59.141943 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-77ea8eb4-e476-49c0-9604-76fdd089e3bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:33:59.170027 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-77ea8eb4-e476-49c0-9604-76fdd089e3bd admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031605 Oct 11 19:33:59.170791 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 18/35] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 11 19:33:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:34:20.244727 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-4649a042-cdad-40b2-98fd-249f6ca4d377 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:20.245761 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-4649a042-cdad-40b2-98fd-249f6ca4d377 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 11 19:34:20.246140 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 18/36] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:34:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:34:20.256721 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:34:20.633775 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-86964e8e-421c-4e70-8ee1-93193e067df5 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:20.652372 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-86964e8e-421c-4e70-8ee1-93193e067df5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400358 Oct 11 19:34:20.652910 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 19/37] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 11 19:34:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:34:21.957638 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-4649a042-cdad-40b2-98fd-249f6ca4d377 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:21.958721 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-4649a042-cdad-40b2-98fd-249f6ca4d377 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 11 19:34:21.959368 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 19/38] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 11 19:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:34:22.501266 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-d3776384-ac5f-4da8-8218-cac43cff8d09 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:22.507760 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.wsgi [None req-d3776384-ac5f-4da8-8218-cac43cff8d09 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-d3776384-ac5f-4da8-8218-cac43cff8d09 admin admin] Request method failure captured: Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: Accept: application/json Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: Accept-Encoding: gzip, deflate Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: Connection: keep-alive Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: Content-Length: 0 Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: Host: 10.222.0.27 Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: Openstack-Api-Version: compute 2.92 Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: Openstack-System-Scope: None Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: User-Agent: python-novaclient Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Auth-Token: gAAAAABjRcU9E2IoYzhNk2LEohNcCB83wo3JDILUZHX4ywOmdpfL9c1DiGq0JIoOHyDV9UE2BZVBzwhdQ5dWOtrAbhxMzOK0pQsjClF-FzKLy9NBA5aQbSek6D5druU29bvtDKtSslH1tJMvC9ofM4_D2mE32VYe1v853aBiBSQ929judvih17s Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Domain-Id: None Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Domain-Name: None Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Identity-Status: Confirmed Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Is-Admin-Project: True Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Domain-Id: default Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Domain-Name: Default Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Name: admin Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Role: member,admin,reader Oct 11 19:34:22.511028 n-d-860864-3 devstack@n-api.service[111115]: X-Roles: member,admin,reader Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b8a090efdc4072b6e83564e5ec9ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}] Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: X-Tenant: admin Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: X-Tenant-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: X-Tenant-Name: admin Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: X-User: admin Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: X-User-Domain-Id: default Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: X-User-Domain-Name: Default Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: X-User-Id: 6e2ce13e9cf84ad6940cfd50f2e10573 Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: X-User-Name: admin Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: method: > Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: exception: Flavor 42 could not be found. Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: action_args: {'id': '42'} Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:34:22.512646 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:22.513592 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:22.515119 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-d3776384-ac5f-4da8-8218-cac43cff8d09 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111115) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:34:22.516422 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-d3776384-ac5f-4da8-8218-cac43cff8d09 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.403109 Oct 11 19:34:22.516422 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 20/39] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 11 19:34:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:34:22.522405 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-d081d259-2d1a-4ad6-8f0c-09bd432dd837 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:22.545633 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-d081d259-2d1a-4ad6-8f0c-09bd432dd837 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026737 Oct 11 19:34:22.546170 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 20/40] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 11 19:34:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:34:22.559027 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-bede8c38-f9ae-4346-ab0c-d6405dc547d5 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:22.581764 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-bede8c38-f9ae-4346-ab0c-d6405dc547d5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027194 Oct 11 19:34:22.582300 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 21/41] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 11 19:34:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:34:22.591761 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-6a25e4c5-d019-47fd-ac8d-f4958ab5df2a admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:22.597161 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.wsgi [None req-6a25e4c5-d019-47fd-ac8d-f4958ab5df2a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-6a25e4c5-d019-47fd-ac8d-f4958ab5df2a admin admin] Request method failure captured: Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: Accept: application/json Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: Accept-Encoding: gzip, deflate Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: Connection: keep-alive Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: Content-Length: 0 Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: Host: 10.222.0.27 Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: Openstack-Api-Version: compute 2.92 Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: Openstack-System-Scope: None Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: User-Agent: python-novaclient Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Auth-Token: gAAAAABjRcU9E2IoYzhNk2LEohNcCB83wo3JDILUZHX4ywOmdpfL9c1DiGq0JIoOHyDV9UE2BZVBzwhdQ5dWOtrAbhxMzOK0pQsjClF-FzKLy9NBA5aQbSek6D5druU29bvtDKtSslH1tJMvC9ofM4_D2mE32VYe1v853aBiBSQ929judvih17s Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Domain-Id: None Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Domain-Name: None Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Identity-Status: Confirmed Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Is-Admin-Project: True Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Domain-Id: default Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Domain-Name: Default Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Name: admin Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Role: member,admin,reader Oct 11 19:34:22.600413 n-d-860864-3 devstack@n-api.service[111114]: X-Roles: member,admin,reader Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b8a090efdc4072b6e83564e5ec9ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}] Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: X-Tenant: admin Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: X-Tenant-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: X-Tenant-Name: admin Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: X-User: admin Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: X-User-Domain-Id: default Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: X-User-Domain-Name: Default Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: X-User-Id: 6e2ce13e9cf84ad6940cfd50f2e10573 Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: X-User-Name: admin Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: method: > Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: exception: Flavor 42 could not be found. Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: action_args: {'id': '42'} Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:34:22.601824 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:22.602664 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:22.603685 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-6a25e4c5-d019-47fd-ac8d-f4958ab5df2a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:34:22.604653 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-6a25e4c5-d019-47fd-ac8d-f4958ab5df2a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013599 Oct 11 19:34:22.604653 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 21/42] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 11 19:34:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:34:23.815188 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-bede8c38-f9ae-4346-ab0c-d6405dc547d5 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:23.816234 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-bede8c38-f9ae-4346-ab0c-d6405dc547d5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 11 19:34:23.816629 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 22/43] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 11 19:34:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:34:24.338059 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-0bad8449-c7ba-4804-a95c-a4fb711b6796 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:24.343080 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.wsgi [None req-0bad8449-c7ba-4804-a95c-a4fb711b6796 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-0bad8449-c7ba-4804-a95c-a4fb711b6796 admin admin] Request method failure captured: Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: Accept: application/json Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: Accept-Encoding: gzip, deflate Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: Connection: keep-alive Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: Content-Length: 0 Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: Host: 10.222.0.27 Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: Openstack-Api-Version: compute 2.92 Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: Openstack-System-Scope: None Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: User-Agent: python-novaclient Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Auth-Token: gAAAAABjRcU_V3lKDetRT2EuA2SNd_pIjcT0suGEI5QWTuxHujAkxG47LR26cOP4rQkotMKgqTNoLwC9YdesbvbWan5rWWW-x3nzBmL8Ew7Iazl14v297ljKsM2OYKdgvuLePHQfqdutOtNACDqDGgLL5LgoR1Aa7cLhqPevsWLipmmx3R-1EKw Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Domain-Id: None Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Domain-Name: None Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Identity-Status: Confirmed Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Is-Admin-Project: True Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Domain-Id: default Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Domain-Name: Default Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Name: admin Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Role: member,admin,reader Oct 11 19:34:24.344601 n-d-860864-3 devstack@n-api.service[111114]: X-Roles: member,admin,reader Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b8a090efdc4072b6e83564e5ec9ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}] Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: X-Tenant: admin Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: X-Tenant-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: X-Tenant-Name: admin Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: X-User: admin Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: X-User-Domain-Id: default Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: X-User-Domain-Name: Default Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: X-User-Id: 6e2ce13e9cf84ad6940cfd50f2e10573 Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: X-User-Name: admin Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: method: > Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: exception: Flavor 84 could not be found. Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: action_args: {'id': '84'} Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:34:24.346323 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:24.347262 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:24.348636 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-0bad8449-c7ba-4804-a95c-a4fb711b6796 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:34:24.349839 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-0bad8449-c7ba-4804-a95c-a4fb711b6796 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394199 Oct 11 19:34:24.349839 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 11 19:34:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:34:24.355854 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-f155a156-fffb-4bfc-8495-96d655ccbb03 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:24.370804 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-f155a156-fffb-4bfc-8495-96d655ccbb03 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018393 Oct 11 19:34:24.371447 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 23/45] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 11 19:34:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:34:24.381044 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-60d6a596-6cab-4421-9acc-d828b2f3a418 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:24.396554 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-60d6a596-6cab-4421-9acc-d828b2f3a418 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019504 Oct 11 19:34:24.397080 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 11 19:34:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:34:24.406263 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-d6ab6089-965a-4dd3-bbee-c3e1b2ebec6c admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:24.412035 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.wsgi [None req-d6ab6089-965a-4dd3-bbee-c3e1b2ebec6c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-d6ab6089-965a-4dd3-bbee-c3e1b2ebec6c admin admin] Request method failure captured: Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: Accept: application/json Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: Accept-Encoding: gzip, deflate Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: Connection: keep-alive Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: Content-Length: 0 Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: Host: 10.222.0.27 Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: Openstack-Api-Version: compute 2.92 Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: Openstack-System-Scope: None Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: User-Agent: python-novaclient Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Auth-Token: gAAAAABjRcU_V3lKDetRT2EuA2SNd_pIjcT0suGEI5QWTuxHujAkxG47LR26cOP4rQkotMKgqTNoLwC9YdesbvbWan5rWWW-x3nzBmL8Ew7Iazl14v297ljKsM2OYKdgvuLePHQfqdutOtNACDqDGgLL5LgoR1Aa7cLhqPevsWLipmmx3R-1EKw Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Domain-Id: None Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Domain-Name: None Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Identity-Status: Confirmed Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Is-Admin-Project: True Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Domain-Id: default Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Domain-Name: Default Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Name: admin Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Role: member,admin,reader Oct 11 19:34:24.413536 n-d-860864-3 devstack@n-api.service[111115]: X-Roles: member,admin,reader Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b8a090efdc4072b6e83564e5ec9ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}] Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: X-Tenant: admin Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: X-Tenant-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: X-Tenant-Name: admin Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: X-User: admin Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: X-User-Domain-Id: default Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: X-User-Domain-Name: Default Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: X-User-Id: 6e2ce13e9cf84ad6940cfd50f2e10573 Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: X-User-Name: admin Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: method: > Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: exception: Flavor 84 could not be found. Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: action_args: {'id': '84'} Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:34:24.415051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:24.416051 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:24.417376 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-d6ab6089-965a-4dd3-bbee-c3e1b2ebec6c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111115) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:34:24.418595 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-d6ab6089-965a-4dd3-bbee-c3e1b2ebec6c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012199 Oct 11 19:34:24.418595 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 24/47] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 11 19:34:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:34:25.629190 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-60d6a596-6cab-4421-9acc-d828b2f3a418 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:25.630202 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-60d6a596-6cab-4421-9acc-d828b2f3a418 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 11 19:34:25.630744 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 24/48] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 11 19:34:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:34:26.145145 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-21a988f3-ac5b-4a81-a0bf-2e32b8e29663 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:26.151056 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.wsgi [None req-21a988f3-ac5b-4a81-a0bf-2e32b8e29663 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-21a988f3-ac5b-4a81-a0bf-2e32b8e29663 admin admin] Request method failure captured: Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: Accept: application/json Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: Accept-Encoding: gzip, deflate Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: Connection: keep-alive Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: Content-Length: 0 Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: Host: 10.222.0.27 Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: Openstack-Api-Version: compute 2.92 Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: Openstack-System-Scope: None Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: User-Agent: python-novaclient Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Auth-Token: gAAAAABjRcVB5HG-SkDzeamCAw0O-00oWKukY879dH54zDClsnse56yzN2XhNoBS0-t4fPdPvoyXYjRfsaksnueLRWOXc_qOyIlCXHKXz9NgswhhDctF1LhZaUCSs3Fsj7q-zBrW_dKx8v6o5HrJmSuetnoRuTOVIR2wlMw8jMlV5ZoLc410TtM Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Domain-Id: None Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Domain-Name: None Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Identity-Status: Confirmed Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Is-Admin-Project: True Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Domain-Id: default Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Domain-Name: Default Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Project-Name: admin Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Role: member,admin,reader Oct 11 19:34:26.152553 n-d-860864-3 devstack@n-api.service[111115]: X-Roles: member,admin,reader Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b8a090efdc4072b6e83564e5ec9ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}] Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: X-Tenant: admin Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: X-Tenant-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: X-Tenant-Name: admin Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: X-User: admin Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: X-User-Domain-Id: default Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: X-User-Domain-Name: Default Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: X-User-Id: 6e2ce13e9cf84ad6940cfd50f2e10573 Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: X-User-Name: admin Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: method: > Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: exception: Flavor 451 could not be found. Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: action_args: {'id': '451'} Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:34:26.154095 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:26.155087 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: ERROR nova.api.openstack.wsgi Oct 11 19:34:26.156245 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-21a988f3-ac5b-4a81-a0bf-2e32b8e29663 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111115) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:34:26.157458 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-21a988f3-ac5b-4a81-a0bf-2e32b8e29663 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388463 Oct 11 19:34:26.157458 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 25/49] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 11 19:34:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:34:26.164338 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-9c2259da-5652-4c61-a341-97ebe8286728 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:26.179108 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-9c2259da-5652-4c61-a341-97ebe8286728 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018390 Oct 11 19:34:26.179635 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 25/50] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 11 19:34:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:34:26.188736 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:26.203245 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018014 Oct 11 19:34:26.203757 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 26/51] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 11 19:34:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:34:26.213608 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-4a9c26bc-b92d-4b77-b135-5c76cf21af0f admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:26.218515 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.wsgi [None req-4a9c26bc-b92d-4b77-b135-5c76cf21af0f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-4a9c26bc-b92d-4b77-b135-5c76cf21af0f admin admin] Request method failure captured: Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: Accept: application/json Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: Accept-Encoding: gzip, deflate Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: Connection: keep-alive Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: Content-Length: 0 Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: Host: 10.222.0.27 Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: Openstack-Api-Version: compute 2.92 Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: Openstack-System-Scope: None Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: User-Agent: python-novaclient Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Auth-Token: gAAAAABjRcVB5HG-SkDzeamCAw0O-00oWKukY879dH54zDClsnse56yzN2XhNoBS0-t4fPdPvoyXYjRfsaksnueLRWOXc_qOyIlCXHKXz9NgswhhDctF1LhZaUCSs3Fsj7q-zBrW_dKx8v6o5HrJmSuetnoRuTOVIR2wlMw8jMlV5ZoLc410TtM Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Domain-Id: None Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Domain-Name: None Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Identity-Status: Confirmed Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Is-Admin-Project: True Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Domain-Id: default Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Domain-Name: Default Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Project-Name: admin Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Role: member,admin,reader Oct 11 19:34:26.220054 n-d-860864-3 devstack@n-api.service[111114]: X-Roles: member,admin,reader Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1b8a090efdc4072b6e83564e5ec9ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1b8a090efdc4072b6e83564e5ec9ff4"}]}] Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: X-Tenant: admin Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: X-Tenant-Id: f1b8a090efdc4072b6e83564e5ec9ff4 Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: X-Tenant-Name: admin Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: X-User: admin Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: X-User-Domain-Id: default Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: X-User-Domain-Name: Default Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: X-User-Id: 6e2ce13e9cf84ad6940cfd50f2e10573 Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: X-User-Name: admin Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: method: > Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: exception: Flavor 451 could not be found. Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: action_args: {'id': '451'} Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:34:26.222396 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:26.227697 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: ERROR nova.api.openstack.wsgi Oct 11 19:34:26.228996 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-4a9c26bc-b92d-4b77-b135-5c76cf21af0f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:34:26.230232 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-4a9c26bc-b92d-4b77-b135-5c76cf21af0f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012026 Oct 11 19:34:26.230232 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 26/52] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 11 19:34:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:34:27.440047 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:27.441068 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Oct 11 19:34:27.441596 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 27/53] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 11 19:34:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:34:27.966502 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-d7c6ae5f-add3-4a3c-abae-588dcce26c8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:34:27.985519 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-d7c6ae5f-add3-4a3c-abae-588dcce26c8a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406082 Oct 11 19:34:27.986065 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 27/54] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 11 19:34:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:34:29.194207 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:29.195254 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 11 19:34:29.195649 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 28/55] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 11 19:34:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:34:29.714869 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-01aa9549-d1e1-46e9-9838-07ec69d92077 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:34:29.733023 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-01aa9549-d1e1-46e9-9838-07ec69d92077 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.399841 Oct 11 19:34:29.733569 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 28/56] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 11 19:34:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:34:30.938274 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:30.939338 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 11 19:34:30.940021 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 29/57] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 11 19:34:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:34:31.456147 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-4c8cd0fd-e8c3-4516-a75f-501973ca1717 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:34:31.478392 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-4c8cd0fd-e8c3-4516-a75f-501973ca1717 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402680 Oct 11 19:34:31.478967 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 29/58] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 11 19:34:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:34:32.697299 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:32.698312 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 11 19:34:32.698743 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 30/59] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 11 19:34:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:34:33.218081 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-304c8ca9-379a-408b-a174-1af128122892 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:34:33.236296 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-304c8ca9-379a-408b-a174-1af128122892 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.400161 Oct 11 19:34:33.237324 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 30/60] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 11 19:34:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 19:34:34.449851 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:34.450944 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 11 19:34:34.451344 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 31/61] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 11 19:34:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:34:34.973986 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-035bc4e5-2e9f-4922-996d-53069a6c39ff admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:34:34.994249 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-035bc4e5-2e9f-4922-996d-53069a6c39ff admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.406189 Oct 11 19:34:34.994816 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 31/62] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Oct 11 19:34:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:35:31.473816 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:35:31.474902 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-129ace6a-b8e9-4a44-a36a-b09e40ea4bda admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Oct 11 19:35:31.475307 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 32/63] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 11 19:35:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:35:31.485646 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:35:31.865736 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-e4959819-df5b-4e9c-b29f-616033827118 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:35:31.886825 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-e4959819-df5b-4e9c-b29f-616033827118 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405535 Oct 11 19:35:31.887362 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 32/64] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 11 19:35:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:35:31.909434 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writing DB stats nova_api:SELECT=14 {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:35:31.913132 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-7af02514-5b26-4fff-96fb-3b8050d1dd52 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:35:31.920482 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-7af02514-5b26-4fff-96fb-3b8050d1dd52 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012935 Oct 11 19:35:31.920999 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 33/65] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Oct 11 19:35:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:35:31.932949 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-7eecee9a-44b5-4d85-b58b-27ba8ddbfa21 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:35:31.940699 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-7eecee9a-44b5-4d85-b58b-27ba8ddbfa21 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011292 Oct 11 19:35:31.941214 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 33/66] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Oct 11 19:35:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:35:31.952310 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-699c9347-df05-4b7d-9446-7a5c01f8c712 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:35:31.960051 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-699c9347-df05-4b7d-9446-7a5c01f8c712 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011263 Oct 11 19:35:31.960573 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 34/67] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Oct 11 19:35:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:35:31.972462 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-dda5ee3f-358e-45fc-b055-4f3eee94323d admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:35:31.979514 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-dda5ee3f-358e-45fc-b055-4f3eee94323d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011161 Oct 11 19:35:31.980013 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 34/68] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Oct 11 19:35:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:40:35.434031 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-699c9347-df05-4b7d-9446-7a5c01f8c712 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:40:35.435094 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-699c9347-df05-4b7d-9446-7a5c01f8c712 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 11 19:40:35.435526 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 35/69] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 11 19:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:40:35.578613 n-d-860864-3 devstack@n-api.service[111114]: DEBUG dbcounter [-] [111114] Writing DB stats nova_api:SELECT=6 {{(pid=111114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:40:35.721926 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-918a7570-e8e1-4348-97b9-89a8db08eba2 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:40:35.726720 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-918a7570-e8e1-4348-97b9-89a8db08eba2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:40:35.727194 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-918a7570-e8e1-4348-97b9-89a8db08eba2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:40:35.727643 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-918a7570-e8e1-4348-97b9-89a8db08eba2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:40:35.728351 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-918a7570-e8e1-4348-97b9-89a8db08eba2 admin admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:40:35.728801 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-918a7570-e8e1-4348-97b9-89a8db08eba2 admin admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:40:35.729213 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-918a7570-e8e1-4348-97b9-89a8db08eba2 admin admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:40:35.768093 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-918a7570-e8e1-4348-97b9-89a8db08eba2 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.191283 Oct 11 19:40:35.768646 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 35/70] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 11 19:40:35 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:40:36.867966 n-d-860864-3 devstack@n-api.service[111115]: DEBUG nova.api.openstack.wsgi [None req-699c9347-df05-4b7d-9446-7a5c01f8c712 admin admin] Calling method '>' {{(pid=111115) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:40:36.868982 n-d-860864-3 devstack@n-api.service[111115]: INFO nova.api.openstack.requestlog [None req-699c9347-df05-4b7d-9446-7a5c01f8c712 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 11 19:40:36.869375 n-d-860864-3 devstack@n-api.service[111115]: [pid: 111115|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 11 19:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:40:37.061767 n-d-860864-3 devstack@n-api.service[111114]: DEBUG nova.api.openstack.wsgi [None req-424fa460-ba20-4fed-b50d-29822569d967 admin admin] Calling method '>' {{(pid=111114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:40:37.065936 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-424fa460-ba20-4fed-b50d-29822569d967 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:40:37.066434 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-424fa460-ba20-4fed-b50d-29822569d967 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:40:37.066885 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-424fa460-ba20-4fed-b50d-29822569d967 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:40:37.067797 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-424fa460-ba20-4fed-b50d-29822569d967 admin admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:40:37.068245 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-424fa460-ba20-4fed-b50d-29822569d967 admin admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:40:37.068658 n-d-860864-3 devstack@n-api.service[111114]: DEBUG oslo_concurrency.lockutils [None req-424fa460-ba20-4fed-b50d-29822569d967 admin admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:40:37.091957 n-d-860864-3 devstack@n-api.service[111114]: INFO nova.api.openstack.requestlog [None req-424fa460-ba20-4fed-b50d-29822569d967 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.083497 Oct 11 19:40:37.092511 n-d-860864-3 devstack@n-api.service[111114]: [pid: 111114|app: 0|req: 36/72] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 11 19:40:37 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:41:20.082559 n-d-860864-3 devstack@n-api.service[111113]: Tue Oct 11 19:41:20 2022 - graceful shutdown triggered... Oct 11 19:41:20.083129 n-d-860864-3 devstack@n-api.service[111114]: Gracefully killing worker 1 (pid: 111114)... Oct 11 19:41:20.083524 n-d-860864-3 devstack@n-api.service[111115]: Gracefully killing worker 2 (pid: 111115)... Oct 11 19:41:20.084180 n-d-860864-3 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 11 19:41:20.209497 n-d-860864-3 devstack@n-api.service[111115]: DEBUG dbcounter [-] [111115] Writing DB stats nova_api:SELECT=4 {{(pid=111115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:41:21.083277 n-d-860864-3 devstack@n-api.service[111113]: worker 1 buried after 1 seconds Oct 11 19:41:21.083729 n-d-860864-3 devstack@n-api.service[111113]: worker 2 buried after 1 seconds Oct 11 19:41:21.083729 n-d-860864-3 devstack@n-api.service[111113]: goodbye to uWSGI. Oct 11 19:41:21.084948 n-d-860864-3 systemd[1]: devstack@n-api.service: Succeeded. Oct 11 19:41:21.085771 n-d-860864-3 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 11 19:41:21.088532 n-d-860864-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 19:41:21.104516 n-d-860864-3 devstack@n-api.service[126945]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 19:41:21.113985 n-d-860864-3 devstack@n-api.service[126945]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 19:41:21 2022] *** Oct 11 19:41:21.113985 n-d-860864-3 devstack@n-api.service[126945]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 19:41:21.113985 n-d-860864-3 devstack@n-api.service[126945]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 19:41:21.113985 n-d-860864-3 devstack@n-api.service[126945]: nodename: n-d-860864-3 Oct 11 19:41:21.113985 n-d-860864-3 devstack@n-api.service[126945]: machine: x86_64 Oct 11 19:41:21.113985 n-d-860864-3 devstack@n-api.service[126945]: clock source: unix Oct 11 19:41:21.113985 n-d-860864-3 devstack@n-api.service[126945]: pcre jit disabled Oct 11 19:41:21.113985 n-d-860864-3 devstack@n-api.service[126945]: detected number of CPU cores: 4 Oct 11 19:41:21.113985 n-d-860864-3 devstack@n-api.service[126945]: current working directory: / Oct 11 19:41:21.113985 n-d-860864-3 devstack@n-api.service[126945]: detected binary path: /usr/bin/uwsgi-core Oct 11 19:41:21.114886 n-d-860864-3 devstack@n-api.service[126945]: your processes number limit is 47680 Oct 11 19:41:21.114886 n-d-860864-3 devstack@n-api.service[126945]: your memory page size is 4096 bytes Oct 11 19:41:21.114886 n-d-860864-3 devstack@n-api.service[126945]: detected max file descriptor number: 2048 Oct 11 19:41:21.114886 n-d-860864-3 devstack@n-api.service[126945]: lock engine: pthread robust mutexes Oct 11 19:41:21.114886 n-d-860864-3 devstack@n-api.service[126945]: thunder lock: enabled Oct 11 19:41:21.114886 n-d-860864-3 devstack@n-api.service[126945]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 19:41:21.114886 n-d-860864-3 devstack@n-api.service[126945]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 19:41:21.159407 n-d-860864-3 devstack@n-api.service[126945]: Python main interpreter initialized at 0x5615493769c0 Oct 11 19:41:21.159407 n-d-860864-3 devstack@n-api.service[126945]: python threads support enabled Oct 11 19:41:21.159407 n-d-860864-3 devstack@n-api.service[126945]: your server socket listen backlog is limited to 100 connections Oct 11 19:41:21.159407 n-d-860864-3 devstack@n-api.service[126945]: your mercy for graceful operations on workers is 90 seconds Oct 11 19:41:21.159844 n-d-860864-3 devstack@n-api.service[126945]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 19:41:21.159844 n-d-860864-3 devstack@n-api.service[126945]: *** Operational MODE: preforking *** Oct 11 19:41:21.160106 n-d-860864-3 devstack@n-api.service[126945]: *** uWSGI is running in multiple interpreter mode *** Oct 11 19:41:21.160106 n-d-860864-3 devstack@n-api.service[126945]: spawned uWSGI master process (pid: 126945) Oct 11 19:41:21.160316 n-d-860864-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 11 19:41:21.160950 n-d-860864-3 devstack@n-api.service[126945]: spawned uWSGI worker 1 (pid: 126955, cores: 1) Oct 11 19:41:21.161458 n-d-860864-3 devstack@n-api.service[126945]: spawned uWSGI worker 2 (pid: 126956, cores: 1) Oct 11 19:41:21.161749 n-d-860864-3 devstack@n-api.service[126945]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 19:41:21.825478 n-d-860864-3 devstack@n-api.service[126956]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 19:41:21.826871 n-d-860864-3 devstack@n-api.service[126955]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 19:41:22.998711 n-d-860864-3 devstack@n-api.service[126956]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 19:41:22.998711 n-d-860864-3 devstack@n-api.service[126956]: from cryptography.utils import int_from_bytes Oct 11 19:41:22.999420 n-d-860864-3 devstack@n-api.service[126956]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 19:41:22.999420 n-d-860864-3 devstack@n-api.service[126956]: from cryptography.utils import int_from_bytes Oct 11 19:41:23.000788 n-d-860864-3 devstack@n-api.service[126955]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 19:41:23.000788 n-d-860864-3 devstack@n-api.service[126955]: from cryptography.utils import int_from_bytes Oct 11 19:41:23.001216 n-d-860864-3 devstack@n-api.service[126955]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 19:41:23.001216 n-d-860864-3 devstack@n-api.service[126955]: from cryptography.utils import int_from_bytes Oct 11 19:41:25.442114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 19:41:25.442716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 19:41:25.442931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 19:41:25.443295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 19:41:25.443552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 19:41:25.443942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.444271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.444595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.444915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.445246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.445557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.445879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.446199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.446549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.446810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.447129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.447578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.447904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.448215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.448525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.448846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.449155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.449477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.449792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.450297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.450976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.451846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.452171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.452510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.452858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.453139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.453457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.453780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.454107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.454416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.454841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.455164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.455467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.455781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.456192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.456518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.456820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.457145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.457479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.457793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.458120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.458460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.458790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.459111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.459417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.459731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.460043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.460622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.460934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.461245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.461493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.461807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.462132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.462455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.462810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.463064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.463315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.463637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.463963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.464275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.464590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.464902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.465214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.465525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.465832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.466142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.466451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.466839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.467684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.468042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.468464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.468786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.469207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.469464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.469779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.470131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.470454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.470880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.471207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.471540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.471851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.472161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.472472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.472792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.473131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.473440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.473692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.473999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.474308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.474656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.474966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.475274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.475582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.475884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.476191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.476498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.476808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.477116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.477423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.477735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.478043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.478352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.478697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.479002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.479363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.479690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.479998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.480306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.480617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.480929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.481254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.481565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.481873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.482204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.482601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.483041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.483390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.483672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.483982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.484305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.484611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.484923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.485246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.485556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.485867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.486172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.486480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.486817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.487128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.487433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.487746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.488049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.488373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.488714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.489016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.489324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.489630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.489952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.490296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.490655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.491004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.491325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.491653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.491987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.492314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.492628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.492944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.493272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.494028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.494028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.494359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.494504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.494843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.495175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.495496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.495815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.496135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.496447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.496769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.497101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.497438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.497756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.498659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.499090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.499419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.499748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.500083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.500402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.500721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.501036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.501478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.501702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.502018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.502355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.502686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.503006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.503838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.503838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.504186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.504349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.504538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.504886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.505207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.505535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.505857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.506171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.506491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.506833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.507149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.507462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.507770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.508086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.508393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.508707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.509014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.509352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.509732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.509989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.510331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.510687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.511003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.511318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.511631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.511937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.512254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.512570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.512876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.513202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.513515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.514396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.515155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.515155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.515465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.515623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.515932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.516249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.516564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.516877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.517204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.517518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.517832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.518174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.518509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.518841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.519170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.519495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.519812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.520117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.520430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.520736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.521043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.521346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.521788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.521968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.522252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.522585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.522896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.523208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.523514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.523825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.524131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.524450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.524741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.525090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.525418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.525733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.526077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.526402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.526753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.527071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.527392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.527705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.528026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.528341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.528655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.528978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.529382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.530109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.530109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.530404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.530658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.530982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.531286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.531605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.531957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.532295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.532613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.532937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.533320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.533563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.533875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.534186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.534498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.534923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.535221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.535532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.535852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.536164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.536488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.536827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.537147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.537451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.537769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.538102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.538435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.538778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.539093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.539415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.539728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.540040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.540352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.540660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.540968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.541280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.541595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.541906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.542218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.542570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.542863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.543173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.543499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.543783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.544561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.544561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.544880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.545254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.545891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.545891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.546199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.546351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.546678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.546992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.547301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.547608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.547963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.548276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.548581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.548899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.549219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.549531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.549850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.550160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.550472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.550820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.551135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.551447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.551759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.552072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.552385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.552789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.553180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.553485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.553800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.554116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.554423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.554762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.555082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.555544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 19:41:25.556648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.556813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 19:41:25.556959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.556959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.557240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 19:41:25.557394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.557552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 19:41:25.557552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 19:41:25.558646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.558646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.558828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.559095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.559178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.559260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.559357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.559458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.559570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.559666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.559753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.559844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.559930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.560024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.560116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.560201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.560286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.560370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.560989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.561077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.561158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.561240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.561313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.561383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.561612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.561712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.561867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.562053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.562208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.562463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.562695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.563009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.563174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.563328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.563479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.563622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.563794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.564042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.564211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.564356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.564506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.564665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.564836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.564980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.565123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.565265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.565440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.565605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.565761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.565922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.566066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.566208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.566358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.566509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.566679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.566833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.566977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.567120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.567271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.567426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.567568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.567722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.567867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.568026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.568178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.568329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.568472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.568622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.568766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.568918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.569061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.569061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.569354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.569498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.569663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.569808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.569951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.570093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.570243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.570385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.570565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.570716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.570860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.571013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.571192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.571344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.571499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.571652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.571804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.571948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.572098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.572240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.572395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.572636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.572795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.572939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.573089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.573241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.573394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.573547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.573699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.573842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.573997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.574337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.574489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.574657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.574811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.574954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.575097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.575248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.575399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.575559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.575716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.575862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.576018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.576018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.577345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.577510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.577656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.577807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.577962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.578106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.578259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.578402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.578603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.578757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.578910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.579053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.579196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.579350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.579501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.579658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.579811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.579954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.580104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.580247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.580388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.580548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.580699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.580841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.580983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.581124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.581267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.581424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.581578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.581728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.581878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.582033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.582184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.582347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.582498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.582754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.582916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.583072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.583225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.583225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.583514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.583656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.583806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.583948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.584104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.584273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.584522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.584670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.584822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.584966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.585118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.585526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.585671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.585833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.585985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.586135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.586291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.586441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.586441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.586857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.586857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.587142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.587293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.587442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.587593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.587741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.587884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.588042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.588185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.588332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.588475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.588624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.588787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.588938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.589083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.589232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.589374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.589524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.589667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.589820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.589963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.590104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.590245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.590385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.590562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.590728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.590880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.591023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.591165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.591307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.591463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.591613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.591788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.592381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.592537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.592680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.592929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.593092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.593237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.593379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.593529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.593672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.593830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.593974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.594124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.594285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.594431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.594715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.594870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.595012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.595165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.595321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.595465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.595613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.595763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.595905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.596075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.596228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.596371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.596519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.596662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.596804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.596956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.597116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.597267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.597410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.597552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.597694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.597844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.597993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.598145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.598287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.598430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.598606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.598765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.598915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.599075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.599218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.599372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.599515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.599666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.599815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.599958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.600108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.600258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.600410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.600564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.600564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.600852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.600995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.601145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.601298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.601441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.601583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.601736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.601888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.602030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.602187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.602332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.602475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.602680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.602834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 19:41:25.603066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.603228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.603381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.603531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.603673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.603816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.604036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.604189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.604332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.604485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.604629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.604895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.605060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.605212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.605362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.605505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.605658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.605811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.605967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.606119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.606269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.606432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.606653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.606775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.606859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.606944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.607987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.608151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.608237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.608334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.608431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.608518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.608601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.608684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.608777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.608862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.608953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.609050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.609135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.609219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.609316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.609410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.609584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.609690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.609912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.610006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.610228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.610337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.610559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.610657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.610877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.610982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.611224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.611317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.611538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.611639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.611853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.611954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.612178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.612357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.612506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.612881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.613149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.613330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.613487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.613725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.613880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.614056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.614205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.614358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.614502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.614719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.614898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.615142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.615300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.615453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.615608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.615760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.615913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.616056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.616214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.616374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.616519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.616662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.616804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.616947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.617097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.617242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.617384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.617538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.617681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.617833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.617995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.618141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.618336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.618492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.618691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.618843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.619011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.619156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.619299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.619460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.619612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.619769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.619914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.620058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.620208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.620352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.620494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.620650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.620794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.620937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.621113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.621263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.621425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.621577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.621721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.621862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.622034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.622186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.622330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.622486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.622672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.622819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.623874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.624045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.624284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.624284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.624592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.624737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.624879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.625029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.625289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.625441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.625584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.625727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.625877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.626028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.626028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.626312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.626468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.626649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.626795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.626950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.627102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.627253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.627405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.627556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.627702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.627860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.627966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.628052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.628127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.628302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.628430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.628593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.628762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.628903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.629083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.629276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.629381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.629698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.630007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.630175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.630328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.630498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.630763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.630929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.631081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.631238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.631397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.631546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.631705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.631861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.632020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.632176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.632334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.632491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.632669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.632828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.632989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.633139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.633288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.633438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.633600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.633779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.634039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.634197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.634354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.634513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.634708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.634876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.635035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.635184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.635445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.635682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.635837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.635993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.636143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.636291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.636439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.636595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.636746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.636907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.637056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.637204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.637353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.637510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.637669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.637819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.637976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.638132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.638288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.638446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.638700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.639793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.639953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.640095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.640243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.640243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.640511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.640660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.640806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.640940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.641089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.641228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.641379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.641521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.641659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.641809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.641963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.642106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.642245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.642392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.642555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.642650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.642753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.642847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.642941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.643034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.643128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.643291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.643379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.643466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.643551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.643642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.643848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.643959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.644164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.644276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.644481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.644581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.644792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.644896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.645108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.645208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.645516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.645627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.645725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.645819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.646038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.646210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.646372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.646467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.646671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.646766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.646986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.647086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.647307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.647408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.647622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.647714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.647936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.648028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.648243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.648348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.648560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.648656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.648870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.648960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.649179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.649270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.649486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.649584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.649791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.649883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.650096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.650194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.650407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.650506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.650756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.650849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.651070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.651163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.651383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.651475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.651690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.651789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.652008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.652208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.652321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.652524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.652623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.652861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.652956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.653188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.653288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.653514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.653618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.653828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.653977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.654146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.654847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.654847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.655096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.655218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.655331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.655451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.655584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.655794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.655920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.656048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.656168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.656290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.656410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.656523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.656649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.656763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.656875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.657081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.657210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.657398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.657528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.657707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.657828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.658024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.658253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.658389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.658664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.658805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.659118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.659434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.659749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.660025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.660171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.660353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.660481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.660678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.660804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.661005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.661129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.661301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.661385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.661626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.661719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.661942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.662036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.662268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.662368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.662602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.662709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.662917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.663009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.663230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.663331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.663538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.663649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.663854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.663965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.664171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.664307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.664525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.664743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.664887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.665075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.665218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.665391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.665543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.665702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.665856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.666074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.666219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.666361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.666503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.666655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.666797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.666943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.667082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.667235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.667370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.667543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.667689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.667854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.667999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.668176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.668320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.668484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.668629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.668801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.668943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.669106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.669247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.669412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.669556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.669716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.669883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.670367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.670505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.670709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.670852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.671000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.671134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.671273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.671406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.671538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.671684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.671817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.671948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.672079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.672209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.672350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.672484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.672622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.672753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.672884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.673022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.673199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.673336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.673505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.673648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.673813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.674119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.674259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.674466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.674699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.674846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.674979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.675118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.675259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.675449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.675590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.675769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.675910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.676072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.676285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.676433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.676576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.676708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.676839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.676979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.677119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.677257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.677394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.677564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.677715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.677857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.677989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.678166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.678308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.678468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.678621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.678806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.678951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.679117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.679251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.679426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.679567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.679732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.679875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.680036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.680170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.680344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.680486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.680645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.680778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.680953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.681102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.681262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.681468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.681604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.681735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.681866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.682005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.682173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.682307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.682482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.682646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.682809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.682938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.683121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.683241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.683430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.683567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.683795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.683933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.684058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.684181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.684353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.684487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.684670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.684871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.685005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.685127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.685254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.685367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.686168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.686717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.686840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.686954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.687077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.687192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.687314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.687442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.687581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.687717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.687857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.687996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.688136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.688278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.688412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.688551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.688683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.688814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.688958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.689102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.689234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.689394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.689530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.689737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.689885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.690068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.690204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.690372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.690513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.690821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.691136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.691440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.691744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.692048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.692399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.692659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.692985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.693295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.693600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.693910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.694216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.694655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.694763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.694970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.695207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.695335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.695562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.695657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.695913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.696006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.696260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.696345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.696575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.696669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.696891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.697207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.697412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.697506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.697836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.697986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.698137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.698455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.698588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.698782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.699080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.699193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.699425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.699679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.699783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.700041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.700257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.700365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.700678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.700818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.701001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.701875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.702192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.702432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.702562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.702831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.703045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.703140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.703445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.703612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.703760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.704078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.704190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.704391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.704693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.704788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.705006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.705314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.705433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.705628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.705936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.706031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.706243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.706508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.706706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.706895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.707112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.707215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.707501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.707807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.707921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.708118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.708379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.708499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.708855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.708963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.709172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.709425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.709521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.709784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.710019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.710115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.710674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.710901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.711011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.711295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.711482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.711585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.711987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.712089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.712314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.712623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.712752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.712926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.713143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.713240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.713527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.713721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.713839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.714169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.714273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.714474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.714808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.714905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.715131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.715458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.715560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.715767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.716054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.716155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.716503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.716636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.716931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.717259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.717685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.717778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.718005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.718283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.718410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.718662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.718931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.719056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.719315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.719480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.719627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.719945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.720046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.720259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.720532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.720627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.720904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.721127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.721232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.721523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.721725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.721822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.722147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.722284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.722481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.722825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.722932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.723151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.723432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.723576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.723907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.724010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.724232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.724541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.724637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.724871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.725134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.725240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.725477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.725791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.725883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.726101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.726400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.726507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.726766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.727040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.727136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.727381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.727696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.727833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.728057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.728328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.728434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.728707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.728968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.729088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.729343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.729505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.729607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.729875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.730091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.730196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.730514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.730845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.731049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.731275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.731462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.731612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.731751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.731903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.732062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.732223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.732392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.732735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.733044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.733205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.733368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.733625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.733766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.734022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.734167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.734387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.734637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.734803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.735013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.735188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.735330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.735635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.735785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.735955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.736277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.736417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.736570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.736805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.736972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.737171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.737309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.737478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.737798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.737955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.738129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.738452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.738673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.738902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.739124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 19:41:25.739219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.739722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.740059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.740370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.740698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.741012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.741322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.742036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.742036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.742346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.742592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.742926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.743239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.743667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.743882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.744200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.744522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.744837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.745156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.745475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.745793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.746103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.746421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.746761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.747079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.747643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.748617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.748899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.749231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.749529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.749821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.750140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.750454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.750793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.751109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.751427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.751760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.752084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.752413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.752751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.753073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.753390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.753707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.754023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.754401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.754817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.755195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.755365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.755792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.756118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.756708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.756831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.757165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.757500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.757781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.758181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.758512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.758922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.759362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.759575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.759911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.760220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.760540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.760860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.761413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.761721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.762062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.762391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.762745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.763071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.763391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.764298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.764613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.765067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.765385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.765700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.766010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.766340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.766681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.766993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.767316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.767630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.768171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.768530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.768854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.769184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.769581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.769827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.770140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.770465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.770802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.771112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.771433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.771751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.772059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.772368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.772683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.772997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.773305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.773617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.773924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.774256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.774584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.774920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.775200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.775513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.775820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.776125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.776430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.776737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.777052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.777361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.777778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.778086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.778400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.778777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.779174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.779731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.780079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.780396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.780706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.781031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.781346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.781741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.781991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.782308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.782690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.783015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.783581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.783916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.784242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.784584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.784918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.785229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.785537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.785844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.786170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.786484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.786824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.787159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.787445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.787760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.788070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.788420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.788689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.789082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.789334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.789620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.789946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.790235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.790591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.790877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.791220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.791541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.791880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.792172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.792487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.792799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.793111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.793424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.793728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.794044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.794374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.794711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.795079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.795644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.795831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.796154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.796478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.796791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.797118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.797444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.797761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.798086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.798400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.798759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.799104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.799452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.799761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.800096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.800371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.800741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.800987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.801307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.801618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.801961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.802225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.802575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.802862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.803170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.803525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.803776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.804086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.804391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.804695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.804999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.805312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.805605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.805906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.806216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.806519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.806843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.807147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.807451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.807752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.808084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.808418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.808735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.809060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.809413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.809691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.810018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.810332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.811194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.811518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.811830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.812167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.812476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.812784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.813101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.813414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.813727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.814035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.814370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.814722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.815033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.815488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.815681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.816005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.816325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.816640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.816973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.817286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.817601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.817912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.818225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.818551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.818873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.819185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.819521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.819813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.820132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.820467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.820794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.821106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.821922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.821922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.822289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.822433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.822757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.823092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.823411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.823754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.824029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 19:41:25.824273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 19:41:25.826391 n-d-860864-3 devstack@n-api.service[126956]: INFO dbcounter [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Registered counter for database nova_api Oct 11 19:41:25.849354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_db.sqlalchemy.engines [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126956) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:41:25.856517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writer thread running {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:41:25.886669 n-d-860864-3 devstack@n-api.service[126955]: INFO dbcounter [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Registered counter for database nova_api Oct 11 19:41:25.908023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_db.sqlalchemy.engines [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:41:25.915096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writer thread running {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:41:25.915999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.context [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) {{(pid=126956) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 19:41:25.920104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:41:25.920728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:41:25.922156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:41:25.922913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:41:25.923383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:41:25.925400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:41:25.927451 n-d-860864-3 devstack@n-api.service[126956]: INFO dbcounter [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Registered counter for database nova_cell0 Oct 11 19:41:25.931586 n-d-860864-3 devstack@n-api.service[126956]: INFO dbcounter [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Registered counter for database nova_cell1 Oct 11 19:41:25.938857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_db.sqlalchemy.engines [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126956) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:41:25.940535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_db.sqlalchemy.engines [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126956) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:41:25.945284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writer thread running {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:41:25.971987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.context [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) {{(pid=126955) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 19:41:25.976087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:41:25.976566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:41:25.978127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:41:25.978886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:41:25.979338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:41:25.981375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:41:25.983537 n-d-860864-3 devstack@n-api.service[126955]: INFO dbcounter [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Registered counter for database nova_cell0 Oct 11 19:41:25.987912 n-d-860864-3 devstack@n-api.service[126955]: INFO dbcounter [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Registered counter for database nova_cell1 Oct 11 19:41:25.995152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_db.sqlalchemy.engines [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:41:25.996493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_db.sqlalchemy.engines [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:41:26.003801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writer thread running {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:41:26.004140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writer thread running {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:41:26.091820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writer thread running {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:41:26.101771 n-d-860864-3 devstack@n-api.service[126956]: INFO dbcounter [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Registered counter for database nova_cell0 Oct 11 19:41:26.109398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_db.sqlalchemy.engines [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126956) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:41:26.114106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writer thread running {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:41:26.154144 n-d-860864-3 devstack@n-api.service[126955]: INFO dbcounter [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Registered counter for database nova_cell0 Oct 11 19:41:26.162063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_db.sqlalchemy.engines [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 19:41:26.166960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writer thread running {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 19:41:26.438814 n-d-860864-3 devstack@n-api.service[126956]: WARNING keystonemiddleware.auth_token [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 19:41:26.446099 n-d-860864-3 devstack@n-api.service[126956]: WARNING keystonemiddleware.auth_token [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 19:41:26.488111 n-d-860864-3 devstack@n-api.service[126955]: WARNING keystonemiddleware.auth_token [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 19:41:26.495307 n-d-860864-3 devstack@n-api.service[126955]: WARNING keystonemiddleware.auth_token [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 19:41:26.791679 n-d-860864-3 devstack@n-api.service[126956]: WARNING keystonemiddleware.auth_token [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 19:41:26.798189 n-d-860864-3 devstack@n-api.service[126956]: WARNING keystonemiddleware.auth_token [None req-e10c2099-5ff4-4d3e-b171-e54458b2cd45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 19:41:26.803695 n-d-860864-3 devstack@n-api.service[126956]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5615493769c0 pid: 126956 (default app) Oct 11 19:41:26.838068 n-d-860864-3 devstack@n-api.service[126955]: WARNING keystonemiddleware.auth_token [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 19:41:26.844639 n-d-860864-3 devstack@n-api.service[126955]: WARNING keystonemiddleware.auth_token [None req-73f06503-741f-4c31-9539-e43fceaae47b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 19:41:26.850027 n-d-860864-3 devstack@n-api.service[126955]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5615493769c0 pid: 126955 (default app) Oct 11 19:42:07.597463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:07.598587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:07.599538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:07.600569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:08.350704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:08.352772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:08.355378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:08.358706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:09.410103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Calling method '.version_select at 0x7f83cdf8c4c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:09.421238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) {{(pid=126956) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 11 19:42:09.422174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:09.422837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:09.423449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:09.450962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:09.451768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:09.452351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:09.466646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:09.467374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:09.468011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:09.474961 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c8673a68-694b-4b87-912d-e364118716dd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.882673 Oct 11 19:42:09.476090 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1208 bytes} [Tue Oct 11 19:42:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:42:09.649792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-deaca9d7-139f-4252-941f-dfc2decba0eb tempest-AZAdminNegativeTestJSON-364812992 tempest-AZAdminNegativeTestJSON-364812992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:09.652406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-deaca9d7-139f-4252-941f-dfc2decba0eb tempest-AZAdminNegativeTestJSON-364812992 tempest-AZAdminNegativeTestJSON-364812992-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'e31831751940427c8733ba7373fdae39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39229098a41940f09ba7901d564cdd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-deaca9d7-139f-4252-941f-dfc2decba0eb tempest-AZAdminNegativeTestJSON-364812992 tempest-AZAdminNegativeTestJSON-364812992-project] Request method failure captured: Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccNaOQqxzo-P2p8SoVCUQ2tZUw_xYIaefA3yQyNtwROnvBn3RVkDop0PA66yeOFFadV5CC7HiAaG4u5lwUMxAVYCp42jSnmUAUyGpMvY4_L9rLmFCOquSI-KCnkfONuGZhawRnsmYBFnT5-jK2yrN15DaxiU1b0J2-az27ovnz5HzA Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 39229098a41940f09ba7901d564cdd29 Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AZAdminNegativeTestJSON-364812992 Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:42:09.655930 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/39229098a41940f09ba7901d564cdd29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_39229098a41940f09ba7901d564cdd29", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39229098a41940f09ba7901d564cdd29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39229098a41940f09ba7901d564cdd29"}]}] Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AZAdminNegativeTestJSON-364812992 Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 39229098a41940f09ba7901d564cdd29 Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-364812992 Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AZAdminNegativeTestJSON-364812992-project Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e31831751940427c8733ba7373fdae39 Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AZAdminNegativeTestJSON-364812992-project Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 19:42:09.657084 n-d-860864-3 devstack@n-api.service[126956]: action_args: {} Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:09.657824 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 19:42:09.658879 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:09.660615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-deaca9d7-139f-4252-941f-dfc2decba0eb tempest-AZAdminNegativeTestJSON-364812992 tempest-AZAdminNegativeTestJSON-364812992-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:09.661585 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-deaca9d7-139f-4252-941f-dfc2decba0eb tempest-AZAdminNegativeTestJSON-364812992 tempest-AZAdminNegativeTestJSON-364812992-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.184336 Oct 11 19:42:09.662601 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2/2] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 11 19:42:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 186 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:09.758179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-475ae13b-3877-49ca-9b74-252a6589b412 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:09.767835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475ae13b-3877-49ca-9b74-252a6589b412 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:09.768337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475ae13b-3877-49ca-9b74-252a6589b412 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:09.768778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475ae13b-3877-49ca-9b74-252a6589b412 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:09.769516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475ae13b-3877-49ca-9b74-252a6589b412 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:09.769963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475ae13b-3877-49ca-9b74-252a6589b412 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:09.770575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475ae13b-3877-49ca-9b74-252a6589b412 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:09.816689 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-475ae13b-3877-49ca-9b74-252a6589b412 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.479701 Oct 11 19:42:09.818091 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1/3] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 11 19:42:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:42:09.822578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-475ae13b-3877-49ca-9b74-252a6589b412 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:09.823537 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-475ae13b-3877-49ca-9b74-252a6589b412 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004641 Oct 11 19:42:09.832692 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2/4] 10.222.0.27 () {56 vars in 886 bytes} [Tue Oct 11 19:42:09 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 19:42:09.848167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '.version_select at 0x7f83cde441f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:09.852423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:09.853164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:09.853878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:09.892829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:09.893315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:09.893959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:09.920581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:09.921344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:09.921784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:09.934979 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-af053e61-a427-4a10-886d-ebd7b5ff8990 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.271044 Oct 11 19:42:09.949534 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 11 19:42:09 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:09.957375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6a22af74-7b94-4b4f-89c8-e5dc5e5d7ebc tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1903774246"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:09.986698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.aggregate [None req-6a22af74-7b94-4b4f-89c8-e5dc5e5d7ebc tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Generated uuid 3202f017-e219-4a09-9415-4fef22e7aaeb for aggregate {{(pid=126956) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:10.107196 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6a22af74-7b94-4b4f-89c8-e5dc5e5d7ebc tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.156246 Oct 11 19:42:10.107822 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 4/6] 10.222.0.27 () {62 vars in 1205 bytes} [Tue Oct 11 19:42:09 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:42:10.359217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Calling method '.version_select at 0x7f83cde440d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:10.366700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) {{(pid=126955) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 11 19:42:10.367658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:10.368311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:10.368982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:10.399696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:10.401087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:10.401772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:10.425501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:10.426269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:10.427401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:10.436181 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-74c96b32-1af2-463d-9769-2462059bd647 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.602408 Oct 11 19:42:10.436968 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:42:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:10.443152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-da49beb7-8e69-4a39-b41c-ea06f1b50d65 tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-998718574"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:10.477195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-48554281", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:10.624237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-da49beb7-8e69-4a39-b41c-ea06f1b50d65 tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.186014 Oct 11 19:42:10.626032 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 4/8] 10.222.0.27 () {62 vars in 1210 bytes} [Tue Oct 11 19:42:10 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:42:10.634697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Calling method '.version_select at 0x7f83cdde45e0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:10.639131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:10.639739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:10.640175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:10.658913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:10.659400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:10.659892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:10.671849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:10.672335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:10.672766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:10.680733 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-94334fa5-144a-4c6d-95ea-ec5dd03fd1d6 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.053453 Oct 11 19:42:10.681627 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 5/9] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 11 19:42:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:10.687200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c7293357-4e31-4eb7-8f12-ada4bb938368 tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:10.696728 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c7293357-4e31-4eb7-8f12-ada4bb938368 tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.013638 Oct 11 19:42:10.697439 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 6/10] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 11 19:42:10 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:42:10.703411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Calling method '.version_select at 0x7f83cdde44c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:10.706823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:10.707537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:10.708185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:10.727290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:10.727917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:10.728465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:10.739886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:10.740529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:10.741041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:10.763348 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-df3b566e-2b29-4a95-b4cc-f612a4a91cf4 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.062722 Oct 11 19:42:10.763982 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 7/11] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:42:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:10.777761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ae180ff-6a7b-4570-a500-2fd7283071fd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:10.794194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ae180ff-6a7b-4570-a500-2fd7283071fd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:10.794736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ae180ff-6a7b-4570-a500-2fd7283071fd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:10.795178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ae180ff-6a7b-4570-a500-2fd7283071fd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:11.490370 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1ae180ff-6a7b-4570-a500-2fd7283071fd tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.724602 Oct 11 19:42:11.491833 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 8/12] 10.222.0.27 () {62 vars in 1232 bytes} [Tue Oct 11 19:42:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:42:11.497463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32e30326-897a-4d3a-8547-d4927d9ddcdf tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Calling method '.version_select at 0x7f83cde1ddc0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:11.499634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32e30326-897a-4d3a-8547-d4927d9ddcdf tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:11.500588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32e30326-897a-4d3a-8547-d4927d9ddcdf tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:11.501535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32e30326-897a-4d3a-8547-d4927d9ddcdf tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:11.552319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32e30326-897a-4d3a-8547-d4927d9ddcdf tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:11.554230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32e30326-897a-4d3a-8547-d4927d9ddcdf tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:11.554858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32e30326-897a-4d3a-8547-d4927d9ddcdf tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:11.563073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:42:11.569037 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-32e30326-897a-4d3a-8547-d4927d9ddcdf tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.075324 Oct 11 19:42:11.570338 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 9/13] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:11 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:11.578227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ad420eb8-16ce-4967-ad0b-94893c11ac6b tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:11.598692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad420eb8-16ce-4967-ad0b-94893c11ac6b tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:11.599415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad420eb8-16ce-4967-ad0b-94893c11ac6b tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:11.600275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad420eb8-16ce-4967-ad0b-94893c11ac6b tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:11.806576 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ad420eb8-16ce-4967-ad0b-94893c11ac6b tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.234878 Oct 11 19:42:11.809590 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 10/14] 10.222.0.27 () {62 vars in 1232 bytes} [Tue Oct 11 19:42:11 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:42:11.818380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ef58df11-3997-43b6-b4e5-6904975cf352 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Calling method '.version_select at 0x7f83cde6e790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:11.821446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef58df11-3997-43b6-b4e5-6904975cf352 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:11.824245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef58df11-3997-43b6-b4e5-6904975cf352 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:11.826282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef58df11-3997-43b6-b4e5-6904975cf352 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:11.861141 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ef58df11-3997-43b6-b4e5-6904975cf352 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.047721 Oct 11 19:42:11.862087 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 11/15] 10.222.0.27 () {58 vars in 1179 bytes} [Tue Oct 11 19:42:11 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:11.866734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f4e25a94-2877-4604-a454-ec0e15b2181e tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:11.918797 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f4e25a94-2877-4604-a454-ec0e15b2181e tempest-AggregatesAdminTestV241-665174734 tempest-AggregatesAdminTestV241-665174734-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.054070 Oct 11 19:42:11.925244 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 12/16] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 11 19:42:11 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:11.931566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Calling method '.version_select at 0x7f83cd592790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:11.935678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:11.939294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:11.940039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:11.970856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:11.973585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:11.975869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:11.992261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:11.997030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:11.998704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.010699 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b63fa5b0-0fa4-4719-bf47-494b5b2735ff tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.088498 Oct 11 19:42:12.013573 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 13/17] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:42:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:12.030340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1dcff4f3-eb94-4625-88ea-80ca6440a6e2 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1796618764"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:12.074618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-1dcff4f3-eb94-4625-88ea-80ca6440a6e2 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Generated uuid 1e1c497a-cab2-4237-a0b7-99fc33beb7a8 for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:12.116384 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1dcff4f3-eb94-4625-88ea-80ca6440a6e2 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.100473 Oct 11 19:42:12.127101 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 14/18] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:12.138995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cbdb25ef-0b4c-49fc-831d-147065def973 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Calling method '.version_select at 0x7f83cd592ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:12.141486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbdb25ef-0b4c-49fc-831d-147065def973 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.141974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbdb25ef-0b4c-49fc-831d-147065def973 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.142583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbdb25ef-0b4c-49fc-831d-147065def973 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.160949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbdb25ef-0b4c-49fc-831d-147065def973 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.161678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbdb25ef-0b4c-49fc-831d-147065def973 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.162370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbdb25ef-0b4c-49fc-831d-147065def973 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.164740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:42:12.165403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:42:12.166083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:42:12.166735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:42:12.167647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:42:12.178337 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cbdb25ef-0b4c-49fc-831d-147065def973 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.049742 Oct 11 19:42:12.181568 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 15/19] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:12.188529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-951bba27-510a-451a-a7d3-ecf7b57848ff tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:12.204821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-951bba27-510a-451a-a7d3-ecf7b57848ff tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.206609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-951bba27-510a-451a-a7d3-ecf7b57848ff tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.207262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-951bba27-510a-451a-a7d3-ecf7b57848ff tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.208693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.209546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.209991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.210749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.211764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.214887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.296421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Getting quotas for project c9ed7b56298642c58cf65003f2853902. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:42:12.316765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Getting quotas for user 2a07205057b54dc5a85ec740783c3dab and project c9ed7b56298642c58cf65003f2853902. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:42:12.345021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:42:12.351759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:42:12.453638 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-951bba27-510a-451a-a7d3-ecf7b57848ff tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.270821 Oct 11 19:42:12.454540 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 16/20] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 11 19:42:12 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:12.458846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-876190b6-eb4e-4bc7-a884-ef287acbfa76 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Calling method '.version_select at 0x7f83cd51cf70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:12.467924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-876190b6-eb4e-4bc7-a884-ef287acbfa76 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.468653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-876190b6-eb4e-4bc7-a884-ef287acbfa76 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.469239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-876190b6-eb4e-4bc7-a884-ef287acbfa76 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.477891 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8db10b69-711a-4435-b254-03e1baf475ed tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.368971 Oct 11 19:42:12.481776 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 5/21] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:42:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:42:12.492590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c78f8989-d29e-41d6-8077-375f1213eb1f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860864-3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:12.497944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-876190b6-eb4e-4bc7-a884-ef287acbfa76 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.500747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-876190b6-eb4e-4bc7-a884-ef287acbfa76 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.502800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-876190b6-eb4e-4bc7-a884-ef287acbfa76 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.517136 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-876190b6-eb4e-4bc7-a884-ef287acbfa76 tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.061178 Oct 11 19:42:12.519949 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 17/22] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:12 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:12.525842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c78f8989-d29e-41d6-8077-375f1213eb1f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.526515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c78f8989-d29e-41d6-8077-375f1213eb1f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.528180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c78f8989-d29e-41d6-8077-375f1213eb1f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.530572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53a8ca0b-257e-49b2-a477-75f7fc3a0d16 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:12.531685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-53a8ca0b-257e-49b2-a477-75f7fc3a0d16 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:12.617633 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c78f8989-d29e-41d6-8077-375f1213eb1f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-860864-3. Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c78f8989-d29e-41d6-8077-375f1213eb1f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Request method failure captured: Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 39 Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccQUu-K9GwdjDlO3eAn392VeVHRVrCLZmP5eULB7StwmsbAWOAL2gUp4hwAiM5dp-3NoXAqjK-xbXNJo9nEZVl6ANFUG2r393uv94Tycp3JMQqpt_IIPTAEOpXj0HpXvdLhsy-smZxLXMIZ4KUtdwS0f4AkHbNdKZtIxqTsWtf-Bjg Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:42:12.637628 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9886de91491b437891a2c5aecc4ca160", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}] Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 90196219db0242d6a529e61fbeab9e9b Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: {"add_host": {"host": "n-h1-860864-3"}} Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:42:12.638722 n-d-860864-3 devstack@n-api.service[126956]: exception: Aggregate 2 already has host n-h1-860864-3. Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-860864-3'}}} Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result.read() Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 19:42:12.639362 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-860864-3-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 19:42:12.640214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 19:42:12.641250 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 19:42:12.642141 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result.read() Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-860864-3-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 19, 42, 12, 595349), 'updated_at': None, 'host': 'n-h1-860864-3', 'aggregate_id': 2}] Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:12.643006 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-860864-3. Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:12.643796 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-860864-3. Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:42:12.644719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:42:12.645679 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-860864-3. Oct 11 19:42:12.645679 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:12.649682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c78f8989-d29e-41d6-8077-375f1213eb1f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-860864-3. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:12.650872 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c78f8989-d29e-41d6-8077-375f1213eb1f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.166756 Oct 11 19:42:12.651889 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 6/23] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 11 19:42:12 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 11 19:42:12.662736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Calling method '.version_select at 0x7f83cd2021f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:12.666894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.668623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.669651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.688949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.690033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.690836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.707601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.708553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.709549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.717200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:42:12.718333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33811a35-8c81-41a8-8749-bcfaa5ef7c0e tempest-HypervisorAdminTestJSON-1243687395 tempest-HypervisorAdminTestJSON-1243687395-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:42:12.720929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a618e23a-6a12-4988-b122-42f6e7951566 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.721877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a618e23a-6a12-4988-b122-42f6e7951566 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.723028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a618e23a-6a12-4988-b122-42f6e7951566 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.724018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a618e23a-6a12-4988-b122-42f6e7951566 None None] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.725208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a618e23a-6a12-4988-b122-42f6e7951566 None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.725956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a618e23a-6a12-4988-b122-42f6e7951566 None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:12.738927 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.compute.rpcapi [None req-a618e23a-6a12-4988-b122-42f6e7951566 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 19:42:12.740492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a618e23a-6a12-4988-b122-42f6e7951566 None None] Releasing lock "compute-rpcapi-router" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:42:12.809150 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a618e23a-6a12-4988-b122-42f6e7951566 None None] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.154985 Oct 11 19:42:12.810363 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 7/24] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 11 19:42:12 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:12.815975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b3d621a-0040-4912-953c-6803f03fce3f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860864-3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:12.843268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b3d621a-0040-4912-953c-6803f03fce3f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:12.846439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b3d621a-0040-4912-953c-6803f03fce3f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:12.847357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b3d621a-0040-4912-953c-6803f03fce3f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:13.513133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-53a8ca0b-257e-49b2-a477-75f7fc3a0d16 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:13.540679 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-53a8ca0b-257e-49b2-a477-75f7fc3a0d16 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1218 microversion: 2.1 time: 1.019426 Oct 11 19:42:13.541282 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 18/25] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:12 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1218 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:14.565847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-552484e0-9959-4bec-932d-b0ded95e6a5d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:14.567610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-552484e0-9959-4bec-932d-b0ded95e6a5d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:14.609399 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b3d621a-0040-4912-953c-6803f03fce3f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 1.796645 Oct 11 19:42:14.615291 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 8/26] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 11 19:42:12 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:14.626681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a756562c-699e-4f99-9e38-a437fa1504f6 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:14.696935 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a756562c-699e-4f99-9e38-a437fa1504f6 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.074352 Oct 11 19:42:14.700967 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 9/27] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:14 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:42:14.716270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b36105c7-409d-4728-b9e2-887c39d07b6d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-34651140"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:14.724279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.aggregate [None req-b36105c7-409d-4728-b9e2-887c39d07b6d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Generated uuid 820118e9-a754-403a-b046-0aab6836bbfa for aggregate {{(pid=126956) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:14.768437 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b36105c7-409d-4728-b9e2-887c39d07b6d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.060531 Oct 11 19:42:14.772162 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 10/28] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:14 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:14.782150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-624fc290-a4d5-40aa-82fe-522e5942912e tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-918636938", "name": "tempest-test_aggregate-113345525"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:14.824466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.aggregate [None req-624fc290-a4d5-40aa-82fe-522e5942912e tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Generated uuid 8d57ea6b-377e-4e45-9b8a-1c87335dfdc1 for aggregate {{(pid=126956) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:14.883715 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-624fc290-a4d5-40aa-82fe-522e5942912e tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.109706 Oct 11 19:42:14.892907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-552484e0-9959-4bec-932d-b0ded95e6a5d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:14.895063 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 11/29] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Oct 11 19:42:14 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:14.900172 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-552484e0-9959-4bec-932d-b0ded95e6a5d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1218 microversion: 2.1 time: 0.338910 Oct 11 19:42:14.916288 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 19/30] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:14 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1218 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:14.916288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-baeaf172-0d99-4bbd-afb1-81eb76913383 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:14.944708 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-baeaf172-0d99-4bbd-afb1-81eb76913383 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 512 microversion: 2.1 time: 0.038496 Oct 11 19:42:14.954791 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 20/31] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:42:14 2022] GET /compute/v2.1/os-aggregates => generated 512 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:14.960504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2cb596b-562e-4188-8a1f-bdc35d97ff98 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:14.978718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2cb596b-562e-4188-8a1f-bdc35d97ff98 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:14.979575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2cb596b-562e-4188-8a1f-bdc35d97ff98 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:14.980292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2cb596b-562e-4188-8a1f-bdc35d97ff98 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:15.308807 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a2cb596b-562e-4188-8a1f-bdc35d97ff98 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 312 microversion: 2.1 time: 0.351491 Oct 11 19:42:15.322989 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 21/32] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 11 19:42:14 2022] POST /compute/v2.1/os-aggregates/4/action => generated 312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:15.584337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbe76cc6-ea0a-46a2-b968-a951b15d6dcd tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860864-3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:15.595941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fbe76cc6-ea0a-46a2-b968-a951b15d6dcd tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '07a1f16d8ee14486a26b29bfd38e732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25470d7b46924b7ab1069620d4b7d113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbe76cc6-ea0a-46a2-b968-a951b15d6dcd tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Request method failure captured: Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 39 Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccNEP6Y5R7_O2P5k5xJiMaJcIIr52y1Uo-Quy-OLZ2GH8gCtFQlX5V2vBpGyZN4Bv05MDPPZL5LAxLIBEMXg0gg2s6fZFK2IsSud6OJ1bgMv1Y8-_3wtjYSaBKOwq_giqppL2TiDFwuNakJ4K5FalALDy-NTnC43g75f6cJMhM66tA Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:42:15.608088 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25470d7b46924b7ab1069620d4b7d113", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}] Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 07a1f16d8ee14486a26b29bfd38e732d Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: {"add_host": {"host": "n-h1-860864-3"}} Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:42:15.609155 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-860864-3'}}} Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:15.610439 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 19:42:15.611375 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.617806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbe76cc6-ea0a-46a2-b968-a951b15d6dcd tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:15.619723 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fbe76cc6-ea0a-46a2-b968-a951b15d6dcd tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.723469 Oct 11 19:42:15.623511 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 12/33] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 11 19:42:14 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 728 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:15.632361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3d5d2914-f374-4a14-8162-6567c1ba520a tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:15.731206 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3d5d2914-f374-4a14-8162-6567c1ba520a tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.098255 Oct 11 19:42:15.735474 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 22/34] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:15 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:42:15.762429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-881f4cb6-e758-4c1a-8d09-9f29f58f43a3 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2105844561"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:15.770957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-881f4cb6-e758-4c1a-8d09-9f29f58f43a3 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Generated uuid d6c99dcb-3b4f-439e-b66b-b51ec0c51f91 for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:15.818392 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-881f4cb6-e758-4c1a-8d09-9f29f58f43a3 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071167 Oct 11 19:42:15.819492 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 23/35] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:15.846604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1045493003"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:15.866359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:15.880495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:15.880985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:15.881710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:15.895778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:15.896455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:15.897167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:15.916450 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1045493003 could not be found. Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Request method failure captured: Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 58 Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccQUu-K9GwdjDlO3eAn392VeVHRVrCLZmP5eULB7StwmsbAWOAL2gUp4hwAiM5dp-3NoXAqjK-xbXNJo9nEZVl6ANFUG2r393uv94Tycp3JMQqpt_IIPTAEOpXj0HpXvdLhsy-smZxLXMIZ4KUtdwS0f4AkHbNdKZtIxqTsWtf-Bjg Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:42:15.927914 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9886de91491b437891a2c5aecc4ca160", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}] Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 90196219db0242d6a529e61fbeab9e9b Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: {"add_host": {"host": "tempest-nonexist_host-1045493003"}} Oct 11 19:42:15.929330 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: exception: Compute host tempest-nonexist_host-1045493003 could not be found. Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1045493003'}}} Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1045493003' is not mapped to any cell Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:15.930144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 11 19:42:15.934811 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1045493003 could not be found. Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1045493003 could not be found. Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:15.936121 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.937294 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:15.937294 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:15.937294 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:15.937294 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:42:15.937294 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:42:15.937294 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1045493003 could not be found. Oct 11 19:42:15.937294 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:15.939826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1045493003 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:15.940855 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-49c5218a-dfdc-4ccf-ad93-bd86abc3815d tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.113253 Oct 11 19:42:15.942099 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 24/36] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 11 19:42:15 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:15.947253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d0d6e2b9-a487-4808-89dc-00e27638eda9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:15.954187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d0d6e2b9-a487-4808-89dc-00e27638eda9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:15.965916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0d6e2b9-a487-4808-89dc-00e27638eda9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:15.968520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0d6e2b9-a487-4808-89dc-00e27638eda9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:15.969292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0d6e2b9-a487-4808-89dc-00e27638eda9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:15.970206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0d6e2b9-a487-4808-89dc-00e27638eda9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:15.971060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0d6e2b9-a487-4808-89dc-00e27638eda9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:15.971651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0d6e2b9-a487-4808-89dc-00e27638eda9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:16.256008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-737604868", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "availability_zone": "tempest-test_az-918636938"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:16.271292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d0d6e2b9-a487-4808-89dc-00e27638eda9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:16.278274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:16.278997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:16.279657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:16.280897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:16.281563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:16.282345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:16.297164 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d0d6e2b9-a487-4808-89dc-00e27638eda9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1214 microversion: 2.1 time: 0.353652 Oct 11 19:42:16.297756 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 25/37] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:15 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:16.317861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4df25f0-0c03-46cf-a120-f18a2793d264 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:16.405053 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a4df25f0-0c03-46cf-a120-f18a2793d264 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.106196 Oct 11 19:42:16.412159 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 26/38] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:16 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:42:16.426413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-913beee3-92f8-478e-bb58-74a473a2adf5 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-913beee3-92f8-478e-bb58-74a473a2adf5 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Request method failure captured: Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 283 Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccQUu-K9GwdjDlO3eAn392VeVHRVrCLZmP5eULB7StwmsbAWOAL2gUp4hwAiM5dp-3NoXAqjK-xbXNJo9nEZVl6ANFUG2r393uv94Tycp3JMQqpt_IIPTAEOpXj0HpXvdLhsy-smZxLXMIZ4KUtdwS0f4AkHbNdKZtIxqTsWtf-Bjg Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:42:16.451155 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:42:16.452188 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9886de91491b437891a2c5aecc4ca160", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}] Oct 11 19:42:16.452188 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:16.452188 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:16.452188 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:16.452188 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:16.452188 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:16.452188 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:16.452188 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 90196219db0242d6a529e61fbeab9e9b Oct 11 19:42:16.452188 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:16.452188 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:42:16.452676 n-d-860864-3 devstack@n-api.service[126955]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 19:42:16.452676 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:16.452676 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:42:16.452676 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 19:42:16.452676 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:16.452676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.452676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:42:16.452676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:42:16.452676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:42:16.452676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:16.453157 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:16.453958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:16.455574 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:42:16.455574 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:42:16.455574 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:42:16.455574 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.455574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-913beee3-92f8-478e-bb58-74a473a2adf5 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:16.460056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:42:16.460644 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-913beee3-92f8-478e-bb58-74a473a2adf5 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.038111 Oct 11 19:42:16.462714 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 27/39] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Oct 11 19:42:16 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:42:16.486739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-76b14b02-6f2d-4e29-a3c2-0dd72e0cf9ac tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-76b14b02-6f2d-4e29-a3c2-0dd72e0cf9ac tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Request method failure captured: Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 27 Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccQUu-K9GwdjDlO3eAn392VeVHRVrCLZmP5eULB7StwmsbAWOAL2gUp4hwAiM5dp-3NoXAqjK-xbXNJo9nEZVl6ANFUG2r393uv94Tycp3JMQqpt_IIPTAEOpXj0HpXvdLhsy-smZxLXMIZ4KUtdwS0f4AkHbNdKZtIxqTsWtf-Bjg Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:42:16.505811 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9886de91491b437891a2c5aecc4ca160", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}] Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 90196219db0242d6a529e61fbeab9e9b Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: {"aggregate": {"name": ""}} Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:16.506843 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi '' Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:16.507449 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:42:16.508483 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.509396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-76b14b02-6f2d-4e29-a3c2-0dd72e0cf9ac tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:16.514153 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-76b14b02-6f2d-4e29-a3c2-0dd72e0cf9ac tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.038743 Oct 11 19:42:16.514863 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 28/40] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:16 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:42:16.535910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4d72f54e-3a5f-4414-b51d-6b9d371846ed tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1129739267"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:16.549141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4d72f54e-3a5f-4414-b51d-6b9d371846ed tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '07a1f16d8ee14486a26b29bfd38e732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25470d7b46924b7ab1069620d4b7d113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4d72f54e-3a5f-4414-b51d-6b9d371846ed tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Request method failure captured: Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 60 Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccNEP6Y5R7_O2P5k5xJiMaJcIIr52y1Uo-Quy-OLZ2GH8gCtFQlX5V2vBpGyZN4Bv05MDPPZL5LAxLIBEMXg0gg2s6fZFK2IsSud6OJ1bgMv1Y8-_3wtjYSaBKOwq_giqppL2TiDFwuNakJ4K5FalALDy-NTnC43g75f6cJMhM66tA Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:42:16.557431 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25470d7b46924b7ab1069620d4b7d113", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}] Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 07a1f16d8ee14486a26b29bfd38e732d Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: {"aggregate": {"name": "tempest-test_aggregate-1129739267"}} Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:16.559308 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1129739267'}}} Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:16.559968 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:16.560894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 19:42:16.561833 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.561833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4d72f54e-3a5f-4414-b51d-6b9d371846ed tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:16.561833 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4d72f54e-3a5f-4414-b51d-6b9d371846ed tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.038341 Oct 11 19:42:16.561833 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 29/41] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:16 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:16.572353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-48c25fe9-5bc7-47a0-808f-b333d1addf0f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1708116078"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:16.597162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-48c25fe9-5bc7-47a0-808f-b333d1addf0f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Generated uuid 15002c93-c8b6-49dc-b720-c47c8f3cd7f0 for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:16.637107 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-48c25fe9-5bc7-47a0-808f-b333d1addf0f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068287 Oct 11 19:42:16.644595 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 30/42] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:16.654711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1880d83f-3d54-4521-9d50-bd7b05f293c3 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1708116078"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:16.658121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-1880d83f-3d54-4521-9d50-bd7b05f293c3 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Generated uuid 14d73918-6ed3-4542-a873-a7b41e7472b2 for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:16.685104 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-1880d83f-3d54-4521-9d50-bd7b05f293c3 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1708116078 already exists. Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1880d83f-3d54-4521-9d50-bd7b05f293c3 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Request method failure captured: Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 60 Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccQUu-K9GwdjDlO3eAn392VeVHRVrCLZmP5eULB7StwmsbAWOAL2gUp4hwAiM5dp-3NoXAqjK-xbXNJo9nEZVl6ANFUG2r393uv94Tycp3JMQqpt_IIPTAEOpXj0HpXvdLhsy-smZxLXMIZ4KUtdwS0f4AkHbNdKZtIxqTsWtf-Bjg Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:42:16.687235 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9886de91491b437891a2c5aecc4ca160", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}] Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 90196219db0242d6a529e61fbeab9e9b Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: {"aggregate": {"name": "tempest-test_aggregate-1708116078"}} Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:16.688256 n-d-860864-3 devstack@n-api.service[126955]: exception: Aggregate tempest-test_aggregate-1708116078 already exists. Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1708116078'}}} Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 11 19:42:16.688902 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1708116078 already exists. Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:16.689792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1708116078 already exists. Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1708116078 already exists. Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1880d83f-3d54-4521-9d50-bd7b05f293c3 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1708116078 already exists. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:16.691567 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1880d83f-3d54-4521-9d50-bd7b05f293c3 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.040160 Oct 11 19:42:16.700774 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 31/43] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:16 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:42:16.712767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9e7ff91-3201-468f-8811-4e088b58290a tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:16.794982 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9e7ff91-3201-468f-8811-4e088b58290a tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.092806 Oct 11 19:42:16.798035 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 32/44] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:16 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:42:16.814887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f7851b3a-3ca3-4f11-aeb1-27256b8386b7 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1972428666"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:16.824941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-f7851b3a-3ca3-4f11-aeb1-27256b8386b7 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Generated uuid df3e6b0e-78df-41e6-9d73-4cc890a53e23 for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:16.868224 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f7851b3a-3ca3-4f11-aeb1-27256b8386b7 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060081 Oct 11 19:42:16.871598 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 33/45] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:16.892979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e06d9142-e2de-4618-a607-27b471505f6e tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:16.900056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e06d9142-e2de-4618-a607-27b471505f6e tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '07a1f16d8ee14486a26b29bfd38e732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25470d7b46924b7ab1069620d4b7d113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e06d9142-e2de-4618-a607-27b471505f6e tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Request method failure captured: Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccNEP6Y5R7_O2P5k5xJiMaJcIIr52y1Uo-Quy-OLZ2GH8gCtFQlX5V2vBpGyZN4Bv05MDPPZL5LAxLIBEMXg0gg2s6fZFK2IsSud6OJ1bgMv1Y8-_3wtjYSaBKOwq_giqppL2TiDFwuNakJ4K5FalALDy-NTnC43g75f6cJMhM66tA Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:42:16.910018 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25470d7b46924b7ab1069620d4b7d113", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}] Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 07a1f16d8ee14486a26b29bfd38e732d Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 19:42:16.911200 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '7'} Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:16.911819 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 19:42:16.912753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:16.915732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e06d9142-e2de-4618-a607-27b471505f6e tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:16.918328 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e06d9142-e2de-4618-a607-27b471505f6e tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.037844 Oct 11 19:42:16.924421 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 34/46] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:16 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:16.946656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fcca57b7-1316-4b53-a74d-c26c800f0cdc tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:17.012320 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fcca57b7-1316-4b53-a74d-c26c800f0cdc tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.086144 Oct 11 19:42:17.016832 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 35/47] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:16 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:42:17.040609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5ab7c929-e4ab-42ec-b728-b2290091a92f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:17.070080 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5ab7c929-e4ab-42ec-b728-b2290091a92f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5ab7c929-e4ab-42ec-b728-b2290091a92f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Request method failure captured: Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccQUu-K9GwdjDlO3eAn392VeVHRVrCLZmP5eULB7StwmsbAWOAL2gUp4hwAiM5dp-3NoXAqjK-xbXNJo9nEZVl6ANFUG2r393uv94Tycp3JMQqpt_IIPTAEOpXj0HpXvdLhsy-smZxLXMIZ4KUtdwS0f4AkHbNdKZtIxqTsWtf-Bjg Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:42:17.073781 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9886de91491b437891a2c5aecc4ca160", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}] Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 90196219db0242d6a529e61fbeab9e9b Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: exception: Aggregate -1 could not be found. Oct 11 19:42:17.075259 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '-1'} Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 19:42:17.075981 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.077074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:17.078281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:17.078281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:17.078281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:42:17.078281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:42:17.078281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 11 19:42:17.078281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.081129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5ab7c929-e4ab-42ec-b728-b2290091a92f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:17.096805 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5ab7c929-e4ab-42ec-b728-b2290091a92f tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.072590 Oct 11 19:42:17.110698 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 36/48] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:42:17 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:42:17.119826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1d5bfc7d-e380-4c11-a901-25adb59ea830 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-380796651"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:17.139575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-1d5bfc7d-e380-4c11-a901-25adb59ea830 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Generated uuid f3651ee6-f412-4b40-b861-634b441e7c9e for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:17.202963 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1d5bfc7d-e380-4c11-a901-25adb59ea830 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.084475 Oct 11 19:42:17.205129 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 37/49] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:17 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:42:17.235341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb58e52d-f133-4481-9c02-e72de2537c9a tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:17.240068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb58e52d-f133-4481-9c02-e72de2537c9a tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '07a1f16d8ee14486a26b29bfd38e732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25470d7b46924b7ab1069620d4b7d113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb58e52d-f133-4481-9c02-e72de2537c9a tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Request method failure captured: Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccNEP6Y5R7_O2P5k5xJiMaJcIIr52y1Uo-Quy-OLZ2GH8gCtFQlX5V2vBpGyZN4Bv05MDPPZL5LAxLIBEMXg0gg2s6fZFK2IsSud6OJ1bgMv1Y8-_3wtjYSaBKOwq_giqppL2TiDFwuNakJ4K5FalALDy-NTnC43g75f6cJMhM66tA Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:42:17.249798 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25470d7b46924b7ab1069620d4b7d113", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}] Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 07a1f16d8ee14486a26b29bfd38e732d Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 19:42:17.251041 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '8'} Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:17.251631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 19:42:17.252665 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.254998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb58e52d-f133-4481-9c02-e72de2537c9a tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:17.260651 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cb58e52d-f133-4481-9c02-e72de2537c9a tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.047323 Oct 11 19:42:17.284097 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 38/50] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 11 19:42:17 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 71 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:42:17.302426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2ca5b808-ea39-46dc-85e9-53e331deb984 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:17.385022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:42:17.385574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:42:17.386293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:42:17.386884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:42:17.387309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:42:17.405576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:17.412922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:17.413644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:17.414255 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2ca5b808-ea39-46dc-85e9-53e331deb984 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.115215 Oct 11 19:42:17.414907 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 39/51] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:17 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:42:17.420941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:17.421898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:17.424646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:17.448085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-304ebdc1-8da5-4959-bcae-7f0eba743c59 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:17.451480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-304ebdc1-8da5-4959-bcae-7f0eba743c59 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:17.473661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-304ebdc1-8da5-4959-bcae-7f0eba743c59 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:17.474077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-304ebdc1-8da5-4959-bcae-7f0eba743c59 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:17.474518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-304ebdc1-8da5-4959-bcae-7f0eba743c59 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:17.475256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-304ebdc1-8da5-4959-bcae-7f0eba743c59 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:17.475715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-304ebdc1-8da5-4959-bcae-7f0eba743c59 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:17.476063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Getting quotas for project d62e7d63cd6c4318a4b79659c96ef9ef. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:42:17.476177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-304ebdc1-8da5-4959-bcae-7f0eba743c59 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:17.497270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Getting quotas for user 1a5502bee89642e5a5779b6f1f540fc4 and project d62e7d63cd6c4318a4b79659c96ef9ef. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:42:17.534434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:42:17.538265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:42:17.690736 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-68dc90d8-fb30-4997-b2e8-5681361772a3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.974784 Oct 11 19:42:17.693818 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 13/52] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:42:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:42:17.699702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-02a94557-305b-40ea-94d0-dd7f326127cf tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:17.730616 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-02a94557-305b-40ea-94d0-dd7f326127cf tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-02a94557-305b-40ea-94d0-dd7f326127cf tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Request method failure captured: Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccQUu-K9GwdjDlO3eAn392VeVHRVrCLZmP5eULB7StwmsbAWOAL2gUp4hwAiM5dp-3NoXAqjK-xbXNJo9nEZVl6ANFUG2r393uv94Tycp3JMQqpt_IIPTAEOpXj0HpXvdLhsy-smZxLXMIZ4KUtdwS0f4AkHbNdKZtIxqTsWtf-Bjg Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:42:17.746337 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9886de91491b437891a2c5aecc4ca160", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}] Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 90196219db0242d6a529e61fbeab9e9b Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: exception: Aggregate -1 could not be found. Oct 11 19:42:17.747766 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '-1'} Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:17.748510 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 11 19:42:17.749662 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.750737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-02a94557-305b-40ea-94d0-dd7f326127cf tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:17.751359 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-02a94557-305b-40ea-94d0-dd7f326127cf tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.056413 Oct 11 19:42:17.758661 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 14/53] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:17 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:42:17.767958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-30d8b772-35b7-4fe7-acb7-ff650f154e52 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:17.772506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-30d8b772-35b7-4fe7-acb7-ff650f154e52 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:17.777504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-304ebdc1-8da5-4959-bcae-7f0eba743c59 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:17.787315 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-304ebdc1-8da5-4959-bcae-7f0eba743c59 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1297 microversion: 2.1 time: 0.370783 Oct 11 19:42:17.796796 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 40/54] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:17 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1297 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:17.814108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-534a0bb1-fb53-48fd-b117-e141d8d8795f tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:17.816248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-534a0bb1-fb53-48fd-b117-e141d8d8795f tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '07a1f16d8ee14486a26b29bfd38e732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25470d7b46924b7ab1069620d4b7d113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-534a0bb1-fb53-48fd-b117-e141d8d8795f tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Request method failure captured: Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccNEP6Y5R7_O2P5k5xJiMaJcIIr52y1Uo-Quy-OLZ2GH8gCtFQlX5V2vBpGyZN4Bv05MDPPZL5LAxLIBEMXg0gg2s6fZFK2IsSud6OJ1bgMv1Y8-_3wtjYSaBKOwq_giqppL2TiDFwuNakJ4K5FalALDy-NTnC43g75f6cJMhM66tA Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:42:17.817596 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25470d7b46924b7ab1069620d4b7d113", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}] Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 07a1f16d8ee14486a26b29bfd38e732d Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 19:42:17.818882 n-d-860864-3 devstack@n-api.service[126955]: action_args: {} Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:17.819600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:17.820712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-534a0bb1-fb53-48fd-b117-e141d8d8795f tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:17.836215 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-534a0bb1-fb53-48fd-b117-e141d8d8795f tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.038354 Oct 11 19:42:17.838923 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 41/55] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:42:17 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:17.933429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-30d8b772-35b7-4fe7-acb7-ff650f154e52 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:17.966794 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-30d8b772-35b7-4fe7-acb7-ff650f154e52 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1241 microversion: 2.1 time: 0.206424 Oct 11 19:42:17.976434 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 15/56] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:17 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1241 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:18.822431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-859725a0-16e6-4b21-8a07-94ce31a644cc tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:18.823579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-859725a0-16e6-4b21-8a07-94ce31a644cc tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:18.846765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859725a0-16e6-4b21-8a07-94ce31a644cc tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:18.849280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859725a0-16e6-4b21-8a07-94ce31a644cc tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:18.850052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859725a0-16e6-4b21-8a07-94ce31a644cc tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:18.851352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859725a0-16e6-4b21-8a07-94ce31a644cc tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:18.855247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859725a0-16e6-4b21-8a07-94ce31a644cc tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:18.857218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859725a0-16e6-4b21-8a07-94ce31a644cc tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:19.001501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-41b54351-fa90-42ac-be67-28bf1b588133 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:19.002882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-41b54351-fa90-42ac-be67-28bf1b588133 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:19.106193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-859725a0-16e6-4b21-8a07-94ce31a644cc tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:19.135126 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-859725a0-16e6-4b21-8a07-94ce31a644cc tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1297 microversion: 2.1 time: 0.317721 Oct 11 19:42:19.136586 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 42/57] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:18 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1297 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:19.374013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-41b54351-fa90-42ac-be67-28bf1b588133 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:19.383549 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-41b54351-fa90-42ac-be67-28bf1b588133 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1241 microversion: 2.1 time: 0.388317 Oct 11 19:42:19.399523 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 16/58] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:18 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1241 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:20.167166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7e45c10-e249-42d9-8757-f5ce3247be9d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:20.175987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e7e45c10-e249-42d9-8757-f5ce3247be9d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:20.200239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7e45c10-e249-42d9-8757-f5ce3247be9d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:20.200732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7e45c10-e249-42d9-8757-f5ce3247be9d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:20.201164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7e45c10-e249-42d9-8757-f5ce3247be9d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:20.201907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7e45c10-e249-42d9-8757-f5ce3247be9d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:20.202335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7e45c10-e249-42d9-8757-f5ce3247be9d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:20.210056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7e45c10-e249-42d9-8757-f5ce3247be9d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:20.413855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c74e7ab-18aa-4f0f-8c01-dda0faa34786 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:20.414471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c74e7ab-18aa-4f0f-8c01-dda0faa34786 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:20.432376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c74e7ab-18aa-4f0f-8c01-dda0faa34786 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:20.436199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c74e7ab-18aa-4f0f-8c01-dda0faa34786 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:20.436873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c74e7ab-18aa-4f0f-8c01-dda0faa34786 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:20.440200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c74e7ab-18aa-4f0f-8c01-dda0faa34786 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:20.447282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c74e7ab-18aa-4f0f-8c01-dda0faa34786 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:20.450044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c74e7ab-18aa-4f0f-8c01-dda0faa34786 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:20.521315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e7e45c10-e249-42d9-8757-f5ce3247be9d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:20.531210 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e7e45c10-e249-42d9-8757-f5ce3247be9d tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1297 microversion: 2.1 time: 0.369722 Oct 11 19:42:20.540723 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 43/59] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:20 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1297 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:20.779908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c74e7ab-18aa-4f0f-8c01-dda0faa34786 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:20.793456 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c74e7ab-18aa-4f0f-8c01-dda0faa34786 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1289 microversion: 2.1 time: 0.383677 Oct 11 19:42:20.793976 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 17/60] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:20 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1289 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:21.562837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-353fdb7a-d2f3-4958-8a9c-c61720b8c534 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:21.564081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-353fdb7a-d2f3-4958-8a9c-c61720b8c534 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:21.575847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-353fdb7a-d2f3-4958-8a9c-c61720b8c534 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:21.576568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-353fdb7a-d2f3-4958-8a9c-c61720b8c534 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:21.578489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-353fdb7a-d2f3-4958-8a9c-c61720b8c534 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:21.579419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-353fdb7a-d2f3-4958-8a9c-c61720b8c534 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:21.581420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-353fdb7a-d2f3-4958-8a9c-c61720b8c534 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:21.582210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-353fdb7a-d2f3-4958-8a9c-c61720b8c534 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:22.021045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-353fdb7a-d2f3-4958-8a9c-c61720b8c534 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:22.041448 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-353fdb7a-d2f3-4958-8a9c-c61720b8c534 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.483810 Oct 11 19:42:22.044059 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 44/61] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:21 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:22.096875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0f7baead-730f-4b6f-ad3b-0c50c6d2e194 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:22.097490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0f7baead-730f-4b6f-ad3b-0c50c6d2e194 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:22.149150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f7baead-730f-4b6f-ad3b-0c50c6d2e194 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:22.161574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f7baead-730f-4b6f-ad3b-0c50c6d2e194 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:22.167621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f7baead-730f-4b6f-ad3b-0c50c6d2e194 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:22.169956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f7baead-730f-4b6f-ad3b-0c50c6d2e194 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:22.170849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f7baead-730f-4b6f-ad3b-0c50c6d2e194 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:22.172016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f7baead-730f-4b6f-ad3b-0c50c6d2e194 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:22.496348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0f7baead-730f-4b6f-ad3b-0c50c6d2e194 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:22.505620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0f7baead-730f-4b6f-ad3b-0c50c6d2e194 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1295 microversion: 2.1 time: 0.456827 Oct 11 19:42:22.527156 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 45/62] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:22 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1295 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:22.671680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Calling method '.version_select at 0x7f83cd1b0b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:22.696288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:22.697084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:22.697634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:22.770942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=11,nova_api:DELETE=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:22.785153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:22.785666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:22.789213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:22.928486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:22.929444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:22.930753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:22.955207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:22.955712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:22.957132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.000728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:23.001819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:23.003635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.027442 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fdbef723-b3a1-470c-afd1-88c168a2380c tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 1.298271 Oct 11 19:42:23.048730 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 18/63] 10.222.0.27 () {60 vars in 1243 bytes} [Tue Oct 11 19:42:21 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:42:23.070722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Calling method '.version_select at 0x7f83cd094040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:23.086234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:23.087150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:23.090980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.138473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:23.138970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-39538c84-5ff8-4605-b753-7d27df7ea1e4 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Calling method '.version_select at 0x7f83cd2334c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:23.141213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:23.141806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-39538c84-5ff8-4605-b753-7d27df7ea1e4 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e0370c15d96948babd4709960c131000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288b93a80eb42d3a3103c563ccf801c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:23.142773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-39538c84-5ff8-4605-b753-7d27df7ea1e4 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Request method failure captured: Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccaMpODqDzF-zj0oKz79KiWUNixIrs6-R4KcgDM6GW219cTXIyl3RtdVMrNXV_ersdO6Yd5NzDTxvXOxIOEmEBrghP-uHl6HVRhGSITJYn9UIfg-0P9i6KJk8mDEDoubMfcFwbI59rgpw4pEq2BFnCYObj_bMic-5_n40KhJJyznLI Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3288b93a80eb42d3a3103c563ccf801c Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:42:23.144015 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3288b93a80eb42d3a3103c563ccf801c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3288b93a80eb42d3a3103c563ccf801c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3288b93a80eb42d3a3103c563ccf801c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3288b93a80eb42d3a3103c563ccf801c"}]}] Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3288b93a80eb42d3a3103c563ccf801c Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HypervisorAdminNegativeTestJSON-674489754-project Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e0370c15d96948babd4709960c131000 Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-674489754-project Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: action_args: {} Oct 11 19:42:23.145179 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:23.145875 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 19:42:23.146898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:23.152123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-39538c84-5ff8-4605-b753-7d27df7ea1e4 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:23.161459 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-39538c84-5ff8-4605-b753-7d27df7ea1e4 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.632986 Oct 11 19:42:23.162767 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 46/64] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 11 19:42:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 635 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:23.175096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6eb1e74-cc21-4c85-b1d2-634e84020cc6 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:23.183214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a6eb1e74-cc21-4c85-b1d2-634e84020cc6 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:23.204622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6eb1e74-cc21-4c85-b1d2-634e84020cc6 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:23.205139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6eb1e74-cc21-4c85-b1d2-634e84020cc6 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:23.205491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6eb1e74-cc21-4c85-b1d2-634e84020cc6 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.206197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6eb1e74-cc21-4c85-b1d2-634e84020cc6 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:23.206694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6eb1e74-cc21-4c85-b1d2-634e84020cc6 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:23.211043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6eb1e74-cc21-4c85-b1d2-634e84020cc6 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.228634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:23.230102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:23.231437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.267224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:23.268611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:23.270050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.313544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:23.326849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:23.327505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.344232 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fbb52368-c447-4d4b-9525-c9d1ffb9d646 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.293861 Oct 11 19:42:23.352012 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 19/65] 10.222.0.27 () {60 vars in 1222 bytes} [Tue Oct 11 19:42:23 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:42:23.352012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-001a3c58-627e-44be-9582-6f6ff6f93508 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Calling method '.version_select at 0x7f83cd0ae310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:23.352256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-001a3c58-627e-44be-9582-6f6ff6f93508 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e0370c15d96948babd4709960c131000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288b93a80eb42d3a3103c563ccf801c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-001a3c58-627e-44be-9582-6f6ff6f93508 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Request method failure captured: Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccaMpODqDzF-zj0oKz79KiWUNixIrs6-R4KcgDM6GW219cTXIyl3RtdVMrNXV_ersdO6Yd5NzDTxvXOxIOEmEBrghP-uHl6HVRhGSITJYn9UIfg-0P9i6KJk8mDEDoubMfcFwbI59rgpw4pEq2BFnCYObj_bMic-5_n40KhJJyznLI Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3288b93a80eb42d3a3103c563ccf801c Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:42:23.354305 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3288b93a80eb42d3a3103c563ccf801c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3288b93a80eb42d3a3103c563ccf801c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3288b93a80eb42d3a3103c563ccf801c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3288b93a80eb42d3a3103c563ccf801c"}]}] Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3288b93a80eb42d3a3103c563ccf801c Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HypervisorAdminNegativeTestJSON-674489754-project Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e0370c15d96948babd4709960c131000 Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-674489754-project Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: action_args: {} Oct 11 19:42:23.355591 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:23.356249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 19:42:23.357187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:23.358124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-001a3c58-627e-44be-9582-6f6ff6f93508 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:23.358124 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-001a3c58-627e-44be-9582-6f6ff6f93508 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009763 Oct 11 19:42:23.364369 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 20/66] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:42:23 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:23.371726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c08e948-189c-4791-bf7e-2ba737d305b1 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Calling method '.version_select at 0x7f83cd0430d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:23.375635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c08e948-189c-4791-bf7e-2ba737d305b1 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:23.376118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c08e948-189c-4791-bf7e-2ba737d305b1 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:23.376555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c08e948-189c-4791-bf7e-2ba737d305b1 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.405744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c08e948-189c-4791-bf7e-2ba737d305b1 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:23.406238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c08e948-189c-4791-bf7e-2ba737d305b1 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:23.406722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c08e948-189c-4791-bf7e-2ba737d305b1 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:23.414476 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c08e948-189c-4791-bf7e-2ba737d305b1 tempest-HypervisorAdminV253TestBase-849683654 tempest-HypervisorAdminV253TestBase-849683654-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/beb627bb-79a9-4355-b994-644dc927bccb" status: 200 len: 792 microversion: 2.53 time: 0.050711 Oct 11 19:42:23.434199 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 21/67] 10.222.0.27 () {60 vars in 1298 bytes} [Tue Oct 11 19:42:23 2022] GET /compute/v2.1/os-hypervisors/beb627bb-79a9-4355-b994-644dc927bccb => generated 792 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:42:23.434199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd4add0d-fcb1-4691-9a55-67d15691e4d7 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Calling method '.version_select at 0x7f83cd4dd4c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:23.434199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fd4add0d-fcb1-4691-9a55-67d15691e4d7 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e0370c15d96948babd4709960c131000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288b93a80eb42d3a3103c563ccf801c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd4add0d-fcb1-4691-9a55-67d15691e4d7 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Request method failure captured: Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccaMpODqDzF-zj0oKz79KiWUNixIrs6-R4KcgDM6GW219cTXIyl3RtdVMrNXV_ersdO6Yd5NzDTxvXOxIOEmEBrghP-uHl6HVRhGSITJYn9UIfg-0P9i6KJk8mDEDoubMfcFwbI59rgpw4pEq2BFnCYObj_bMic-5_n40KhJJyznLI Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3288b93a80eb42d3a3103c563ccf801c Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:42:23.436444 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3288b93a80eb42d3a3103c563ccf801c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3288b93a80eb42d3a3103c563ccf801c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3288b93a80eb42d3a3103c563ccf801c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3288b93a80eb42d3a3103c563ccf801c"}]}] Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3288b93a80eb42d3a3103c563ccf801c Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HypervisorAdminNegativeTestJSON-674489754-project Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e0370c15d96948babd4709960c131000 Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-674489754-project Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: action_args: {} Oct 11 19:42:23.437475 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:23.438278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 19:42:23.439248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:23.440153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd4add0d-fcb1-4691-9a55-67d15691e4d7 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:23.440153 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fd4add0d-fcb1-4691-9a55-67d15691e4d7 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015354 Oct 11 19:42:23.444107 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 22/68] 10.222.0.27 () {58 vars in 1179 bytes} [Tue Oct 11 19:42:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:24.095071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Calling method '.version_select at 0x7f83cd02b3a0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:24.097704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:24.098403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:24.099035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:24.152289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:24.153105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:24.154180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:24.180413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:24.181184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:24.183935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:24.200321 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4dbd7018-73fc-4e7e-aa8d-ba0db28cfa6a tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.754990 Oct 11 19:42:24.209638 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 23/69] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:42:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:24.220843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-27753033-2c7d-44fe-a3bf-16671b13aa83 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:24.221476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-27753033-2c7d-44fe-a3bf-16671b13aa83 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:24.236281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27753033-2c7d-44fe-a3bf-16671b13aa83 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:24.236781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27753033-2c7d-44fe-a3bf-16671b13aa83 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:24.244641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27753033-2c7d-44fe-a3bf-16671b13aa83 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:24.246361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27753033-2c7d-44fe-a3bf-16671b13aa83 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:24.247091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27753033-2c7d-44fe-a3bf-16671b13aa83 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:24.247784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27753033-2c7d-44fe-a3bf-16671b13aa83 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:24.330702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6eb1e74-cc21-4c85-b1d2-634e84020cc6 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:24.335258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:24.356909 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6eb1e74-cc21-4c85-b1d2-634e84020cc6 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 1.188582 Oct 11 19:42:24.362326 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 47/70] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:23 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:24.372224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-08ce452a-a711-4df9-9871-e56a3e0c29a2 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Calling method '.version_select at 0x7f83cd233dc0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:24.390790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-08ce452a-a711-4df9-9871-e56a3e0c29a2 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e0370c15d96948babd4709960c131000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288b93a80eb42d3a3103c563ccf801c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-08ce452a-a711-4df9-9871-e56a3e0c29a2 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Request method failure captured: Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccaMpODqDzF-zj0oKz79KiWUNixIrs6-R4KcgDM6GW219cTXIyl3RtdVMrNXV_ersdO6Yd5NzDTxvXOxIOEmEBrghP-uHl6HVRhGSITJYn9UIfg-0P9i6KJk8mDEDoubMfcFwbI59rgpw4pEq2BFnCYObj_bMic-5_n40KhJJyznLI Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3288b93a80eb42d3a3103c563ccf801c Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:42:24.399172 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3288b93a80eb42d3a3103c563ccf801c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3288b93a80eb42d3a3103c563ccf801c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3288b93a80eb42d3a3103c563ccf801c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3288b93a80eb42d3a3103c563ccf801c"}]}] Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3288b93a80eb42d3a3103c563ccf801c Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HypervisorAdminNegativeTestJSON-674489754-project Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e0370c15d96948babd4709960c131000 Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-674489754-project Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '1'} Oct 11 19:42:24.400596 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:24.402135 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 19:42:24.403499 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.408567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-08ce452a-a711-4df9-9871-e56a3e0c29a2 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:24.412066 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-08ce452a-a711-4df9-9871-e56a3e0c29a2 tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.048334 Oct 11 19:42:24.413103 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 48/71] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 11 19:42:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:24.605360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-27753033-2c7d-44fe-a3bf-16671b13aa83 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:24.618862 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-27753033-2c7d-44fe-a3bf-16671b13aa83 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1295 microversion: 2.1 time: 0.408563 Oct 11 19:42:24.620989 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 24/72] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:24 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1295 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:24.641326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ddcd72e-452a-488a-989b-e47ef7c126d4 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Calling method '.version_select at 0x7f83cd4dd1f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:24.644822 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0ddcd72e-452a-488a-989b-e47ef7c126d4 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] HTTP exception thrown: Hypervisor with ID 'eafc8a2c-dc1c-4874-a810-4bac1736e1ec' could not be found. Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ddcd72e-452a-488a-989b-e47ef7c126d4 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Request method failure captured: Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-hypervisors/eafc8a2c-dc1c-4874-a810-4bac1736e1ec/uptime HTTP/1.1 Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcceMG2LnUTctB9UP4cc2HDARop7n8AygY_7apciyhvNB-Vryfek450VrmTAK0DqBJu3PwvyHFyAXYNQGqQ0wbOp_NFgMWLKRIE_QE3oo_CB7flurtDC11tRxB0ZqbKUaO1zbEjrT3t5Eskk2g_SBfq0iEEIaJXuLf_nUVUY6RlDQRQ Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 8d0058e29d4e4ffe9f75882c1b17e658 Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-823386969 Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:42:24.654080 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d0058e29d4e4ffe9f75882c1b17e658"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d0058e29d4e4ffe9f75882c1b17e658", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0058e29d4e4ffe9f75882c1b17e658"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0058e29d4e4ffe9f75882c1b17e658"}]}] Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-823386969 Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 8d0058e29d4e4ffe9f75882c1b17e658 Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-823386969 Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5a8296dc02c746f6bcc874c88728a7f2 Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: exception: Hypervisor with ID 'eafc8a2c-dc1c-4874-a810-4bac1736e1ec' could not be found. Oct 11 19:42:24.655480 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'eafc8a2c-dc1c-4874-a810-4bac1736e1ec'} Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'eafc8a2c-dc1c-4874-a810-4bac1736e1ec' Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 11 19:42:24.656472 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'eafc8a2c-dc1c-4874-a810-4bac1736e1ec' could not be found. Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:24.657959 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.659169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.659169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:24.659169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:24.659169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:42:24.659169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:42:24.659169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'eafc8a2c-dc1c-4874-a810-4bac1736e1ec' could not be found. Oct 11 19:42:24.659169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.661207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ddcd72e-452a-488a-989b-e47ef7c126d4 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Returning 404 to user: Hypervisor with ID 'eafc8a2c-dc1c-4874-a810-4bac1736e1ec' could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:24.664797 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0ddcd72e-452a-488a-989b-e47ef7c126d4 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/eafc8a2c-dc1c-4874-a810-4bac1736e1ec/uptime" status: 404 len: 123 microversion: 2.1 time: 0.039335 Oct 11 19:42:24.668997 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 25/73] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 11 19:42:24 2022] GET /compute/v2.1/os-hypervisors/eafc8a2c-dc1c-4874-a810-4bac1736e1ec/uptime => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:24.680350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Calling method '.version_select at 0x7f83cd223160>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:24.683245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:24.684030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:24.689925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:24.757826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:24.761698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:24.763003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:24.789773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:24.790562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:24.791257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:24.815747 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-30c90b5a-8a8b-4aab-8bb8-f151276bb495 tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.142063 Oct 11 19:42:24.820796 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 26/74] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:42:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:42:24.833369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13a70312-2c62-420f-bdb5-2aeeaedfecbe tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Calling method '.version_select at 0x7f83cd07ee50>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:24.838885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13a70312-2c62-420f-bdb5-2aeeaedfecbe tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e0370c15d96948babd4709960c131000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288b93a80eb42d3a3103c563ccf801c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13a70312-2c62-420f-bdb5-2aeeaedfecbe tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Request method failure captured: Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccaMpODqDzF-zj0oKz79KiWUNixIrs6-R4KcgDM6GW219cTXIyl3RtdVMrNXV_ersdO6Yd5NzDTxvXOxIOEmEBrghP-uHl6HVRhGSITJYn9UIfg-0P9i6KJk8mDEDoubMfcFwbI59rgpw4pEq2BFnCYObj_bMic-5_n40KhJJyznLI Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3288b93a80eb42d3a3103c563ccf801c Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:42:24.841184 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3288b93a80eb42d3a3103c563ccf801c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3288b93a80eb42d3a3103c563ccf801c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3288b93a80eb42d3a3103c563ccf801c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3288b93a80eb42d3a3103c563ccf801c"}]}] Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3288b93a80eb42d3a3103c563ccf801c Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-674489754 Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HypervisorAdminNegativeTestJSON-674489754-project Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e0370c15d96948babd4709960c131000 Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-674489754-project Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '1'} Oct 11 19:42:24.842431 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:24.843266 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 19:42:24.844402 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.847279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13a70312-2c62-420f-bdb5-2aeeaedfecbe tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:24.859518 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13a70312-2c62-420f-bdb5-2aeeaedfecbe tempest-HypervisorAdminNegativeTestJSON-674489754 tempest-HypervisorAdminNegativeTestJSON-674489754-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.032180 Oct 11 19:42:24.860079 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 27/75] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:42:24.889421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4311b7c2-5efb-4d14-8e5f-f455c69fd24c tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Calling method '.version_select at 0x7f83cd02b280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:24.891151 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4311b7c2-5efb-4d14-8e5f-f455c69fd24c tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] HTTP exception thrown: Hypervisor with ID '22caf02e-e747-4d64-a9e0-9bd1b7c53db7' could not be found. Oct 11 19:42:24.896816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4311b7c2-5efb-4d14-8e5f-f455c69fd24c tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Request method failure captured: Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-hypervisors/22caf02e-e747-4d64-a9e0-9bd1b7c53db7 HTTP/1.1 Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcceMG2LnUTctB9UP4cc2HDARop7n8AygY_7apciyhvNB-Vryfek450VrmTAK0DqBJu3PwvyHFyAXYNQGqQ0wbOp_NFgMWLKRIE_QE3oo_CB7flurtDC11tRxB0ZqbKUaO1zbEjrT3t5Eskk2g_SBfq0iEEIaJXuLf_nUVUY6RlDQRQ Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 8d0058e29d4e4ffe9f75882c1b17e658 Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-823386969 Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:42:24.896978 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d0058e29d4e4ffe9f75882c1b17e658"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d0058e29d4e4ffe9f75882c1b17e658", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0058e29d4e4ffe9f75882c1b17e658"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d0058e29d4e4ffe9f75882c1b17e658"}]}] Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-823386969 Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 8d0058e29d4e4ffe9f75882c1b17e658 Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-823386969 Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5a8296dc02c746f6bcc874c88728a7f2 Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: exception: Hypervisor with ID '22caf02e-e747-4d64-a9e0-9bd1b7c53db7' could not be found. Oct 11 19:42:24.898270 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '22caf02e-e747-4d64-a9e0-9bd1b7c53db7'} Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '22caf02e-e747-4d64-a9e0-9bd1b7c53db7' Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 11 19:42:24.898968 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:42:24.900231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '22caf02e-e747-4d64-a9e0-9bd1b7c53db7' could not be found. Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '22caf02e-e747-4d64-a9e0-9bd1b7c53db7' could not be found. Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4311b7c2-5efb-4d14-8e5f-f455c69fd24c tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] Returning 404 to user: Hypervisor with ID '22caf02e-e747-4d64-a9e0-9bd1b7c53db7' could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:24.901567 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4311b7c2-5efb-4d14-8e5f-f455c69fd24c tempest-HypervisorAdminNegativeTestJSON-823386969 tempest-HypervisorAdminNegativeTestJSON-823386969-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/22caf02e-e747-4d64-a9e0-9bd1b7c53db7" status: 404 len: 123 microversion: 2.1 time: 0.029781 Oct 11 19:42:24.904628 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 28/76] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 11 19:42:24 2022] GET /compute/v2.1/os-hypervisors/22caf02e-e747-4d64-a9e0-9bd1b7c53db7 => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:25.176693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a3858720-19d8-46d5-a383-399136773e87 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:25.262259 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a3858720-19d8-46d5-a383-399136773e87 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.840763 Oct 11 19:42:25.276704 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 49/77] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:42:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:25.380562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4c85b626-a499-4cdc-ba15-aee531f06318 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:25.381917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4c85b626-a499-4cdc-ba15-aee531f06318 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:25.399784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c85b626-a499-4cdc-ba15-aee531f06318 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:25.401599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c85b626-a499-4cdc-ba15-aee531f06318 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:25.403122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c85b626-a499-4cdc-ba15-aee531f06318 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:25.404501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c85b626-a499-4cdc-ba15-aee531f06318 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:25.410324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c85b626-a499-4cdc-ba15-aee531f06318 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:25.411404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c85b626-a499-4cdc-ba15-aee531f06318 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:25.890397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:26.020852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-644c428c-0577-4602-8eb2-e9804b77e63f tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-996172171", "id": 384604654, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:26.070836 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-644c428c-0577-4602-8eb2-e9804b77e63f tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.796988 Oct 11 19:42:26.084754 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 29/78] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:42:25 2022] POST /compute/v2.1/flavors => generated 421 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:26.090719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-330e62ff-9ff1-462d-a7d4-3e38832ad7f0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:26.091537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-330e62ff-9ff1-462d-a7d4-3e38832ad7f0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:26.100247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330e62ff-9ff1-462d-a7d4-3e38832ad7f0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:26.101060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330e62ff-9ff1-462d-a7d4-3e38832ad7f0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:26.101641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330e62ff-9ff1-462d-a7d4-3e38832ad7f0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:26.102497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330e62ff-9ff1-462d-a7d4-3e38832ad7f0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:26.103156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330e62ff-9ff1-462d-a7d4-3e38832ad7f0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:26.103789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330e62ff-9ff1-462d-a7d4-3e38832ad7f0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:26.234314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4c85b626-a499-4cdc-ba15-aee531f06318 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:26.251101 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4c85b626-a499-4cdc-ba15-aee531f06318 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.867084 Oct 11 19:42:26.256763 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 50/79] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:25 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:26.264815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6412380c-0a5b-4060-9c9e-9957ec7d6091 tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:26.380332 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6412380c-0a5b-4060-9c9e-9957ec7d6091 tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.120800 Oct 11 19:42:26.384767 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 51/80] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Oct 11 19:42:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:42:26.765653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6b594e35-6e7d-49c7-9bac-d8672bf4f283 tempest-QuotaClassesAdmin257Test-1324203414 tempest-QuotaClassesAdmin257Test-1324203414-project-admin] Calling method '.version_select at 0x7f83cd28c670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:26.806912 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6b594e35-6e7d-49c7-9bac-d8672bf4f283 tempest-QuotaClassesAdmin257Test-1324203414 tempest-QuotaClassesAdmin257Test-1324203414-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.411089 Oct 11 19:42:26.821964 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 52/81] 10.222.0.27 () {60 vars in 1226 bytes} [Tue Oct 11 19:42:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:42:26.833329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-52f81650-12e4-4237-b8c9-3f3761a11277 tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-86009063", "id": 372895867, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:26.837978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-330e62ff-9ff1-462d-a7d4-3e38832ad7f0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:26.848919 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-330e62ff-9ff1-462d-a7d4-3e38832ad7f0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.762697 Oct 11 19:42:26.851051 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 30/82] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:26 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:26.858610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6513225-d724-426f-937e-e7b371cb1b17 tempest-QuotaClassesAdmin257Test-1324203414 tempest-QuotaClassesAdmin257Test-1324203414-project-admin] Action: 'update', calling method: .version_select at 0x7f83cd02b430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:26.953564 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-52f81650-12e4-4237-b8c9-3f3761a11277 tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.129141 Oct 11 19:42:26.954885 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 53/83] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:42:26 2022] POST /compute/v2.1/flavors => generated 420 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:26.969548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fcdad00a-a4ed-4f2d-942d-243f6880d90b tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:26.986502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fcdad00a-a4ed-4f2d-942d-243f6880d90b tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023262 Oct 11 19:42:26.987789 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 54/84] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Oct 11 19:42:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:42:27.005477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e9f07f25-19c3-432a-8607-48e00019471a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Action: 'create', calling method: .version_select at 0x7f83cd28cca0>, body: {"keypair": {"name": "tempest-keypair-356615870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHwMjUG3I6HRhyz903hqJWjlmaPdg8L87taMdIAck7+Kh5PYEIsJuuJO4kzM8IxKCx1bl7W5wEfy9A7xlnbIIq0cRfhs8xoHgOMidj4N6vztmkIIeS3UIaff3pD0qcCfQ=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:27.122510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-e9f07f25-19c3-432a-8607-48e00019471a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Getting quotas for project 2a7b6535ad3d4f56b4483a9cde85691b. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:42:27.143083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-e9f07f25-19c3-432a-8607-48e00019471a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Getting quotas for user 603e5875618949c1998ea23bf0e954b5 and project 2a7b6535ad3d4f56b4483a9cde85691b. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:42:27.235957 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e9f07f25-19c3-432a-8607-48e00019471a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.239023 Oct 11 19:42:27.237172 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 55/85] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:42:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:27.283279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c2065d56-f81f-47e4-8db6-e4e324507d47 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:27.284252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c2065d56-f81f-47e4-8db6-e4e324507d47 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:27.304159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2065d56-f81f-47e4-8db6-e4e324507d47 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:27.304779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2065d56-f81f-47e4-8db6-e4e324507d47 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:27.305330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2065d56-f81f-47e4-8db6-e4e324507d47 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:27.306309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2065d56-f81f-47e4-8db6-e4e324507d47 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:27.308388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2065d56-f81f-47e4-8db6-e4e324507d47 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:27.308980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2065d56-f81f-47e4-8db6-e4e324507d47 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:27.430913 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6513225-d724-426f-937e-e7b371cb1b17 tempest-QuotaClassesAdmin257Test-1324203414 tempest-QuotaClassesAdmin257Test-1324203414-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.576603 Oct 11 19:42:27.438901 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 31/86] 10.222.0.27 () {62 vars in 1247 bytes} [Tue Oct 11 19:42:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:42:27.456841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-accbc88e-a63e-4302-9436-4126212e8c5f tempest-QuotaClassesAdmin257Test-1324203414 tempest-QuotaClassesAdmin257Test-1324203414-project-admin] Calling method '.version_select at 0x7f83ccfbeee0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:27.460861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:27.492127 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-accbc88e-a63e-4302-9436-4126212e8c5f tempest-QuotaClassesAdmin257Test-1324203414 tempest-QuotaClassesAdmin257Test-1324203414-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.040710 Oct 11 19:42:27.494622 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 32/87] 10.222.0.27 () {60 vars in 1226 bytes} [Tue Oct 11 19:42:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 19:42:27.509198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a7bda0bd-9fa3-44d9-8f04-aa320acc1b5c tempest-QuotaClassesAdmin257Test-1324203414 tempest-QuotaClassesAdmin257Test-1324203414-project-admin] Action: 'update', calling method: .version_select at 0x7f83ccf8d040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:27.717337 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a7bda0bd-9fa3-44d9-8f04-aa320acc1b5c tempest-QuotaClassesAdmin257Test-1324203414 tempest-QuotaClassesAdmin257Test-1324203414-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.215542 Oct 11 19:42:27.718133 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 33/88] 10.222.0.27 () {62 vars in 1247 bytes} [Tue Oct 11 19:42:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 19:42:27.875108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5a7a55c-51a5-46a5-90c3-35f726b4d7d9 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:27.876094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b5a7a55c-51a5-46a5-90c3-35f726b4d7d9 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:27.889650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5a7a55c-51a5-46a5-90c3-35f726b4d7d9 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:27.890285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5a7a55c-51a5-46a5-90c3-35f726b4d7d9 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:27.893137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5a7a55c-51a5-46a5-90c3-35f726b4d7d9 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:27.894766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5a7a55c-51a5-46a5-90c3-35f726b4d7d9 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:27.896605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5a7a55c-51a5-46a5-90c3-35f726b4d7d9 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:27.897371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5a7a55c-51a5-46a5-90c3-35f726b4d7d9 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:28.991697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c2065d56-f81f-47e4-8db6-e4e324507d47 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:29.005374 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c2065d56-f81f-47e4-8db6-e4e324507d47 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 1.726063 Oct 11 19:42:29.028197 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 56/89] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:27 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:42:29.311057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c7e72e95-e7f9-4023-a71e-ae1656b85bbc req-da57cfc6-983c-4a36-a792-8f2babe12b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77ba20d-cd31-4f68-ab97-edd11f22a708", "tag": "097a4ee4-babc-4ec6-806d-f7b20f748046"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:29.374025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c7e72e95-e7f9-4023-a71e-ae1656b85bbc req-da57cfc6-983c-4a36-a792-8f2babe12b74 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:29.391645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c7e72e95-e7f9-4023-a71e-ae1656b85bbc req-da57cfc6-983c-4a36-a792-8f2babe12b74 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:29.392566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c7e72e95-e7f9-4023-a71e-ae1656b85bbc req-da57cfc6-983c-4a36-a792-8f2babe12b74 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:29.488092 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c7e72e95-e7f9-4023-a71e-ae1656b85bbc req-da57cfc6-983c-4a36-a792-8f2babe12b74 service nova] Creating event network-changed:097a4ee4-babc-4ec6-806d-f7b20f748046 for instance a77ba20d-cd31-4f68-ab97-edd11f22a708 on n-h1-860864-3 Oct 11 19:42:29.492633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c7e72e95-e7f9-4023-a71e-ae1656b85bbc req-da57cfc6-983c-4a36-a792-8f2babe12b74 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:42:29.493405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c7e72e95-e7f9-4023-a71e-ae1656b85bbc req-da57cfc6-983c-4a36-a792-8f2babe12b74 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:42:29.499518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2925d66-9c74-43ac-a65a-80607bf9a6b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:29.500848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2925d66-9c74-43ac-a65a-80607bf9a6b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:29.501622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2925d66-9c74-43ac-a65a-80607bf9a6b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:29.504851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2925d66-9c74-43ac-a65a-80607bf9a6b3 None None] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:29.508250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2925d66-9c74-43ac-a65a-80607bf9a6b3 None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:29.509973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2925d66-9c74-43ac-a65a-80607bf9a6b3 None None] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:29.554409 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.compute.rpcapi [None req-f2925d66-9c74-43ac-a65a-80607bf9a6b3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 19:42:29.560028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2925d66-9c74-43ac-a65a-80607bf9a6b3 None None] Releasing lock "compute-rpcapi-router" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:42:29.608770 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f2925d66-9c74-43ac-a65a-80607bf9a6b3 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.578855 Oct 11 19:42:29.612118 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 57/90] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:29.772127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b5a7a55c-51a5-46a5-90c3-35f726b4d7d9 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:29.784767 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b5a7a55c-51a5-46a5-90c3-35f726b4d7d9 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 1.912475 Oct 11 19:42:29.787545 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 34/91] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:27 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:29.966048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-d5ef67cb-84ca-4033-bc40-949588faad01 req-fda58b72-5faf-4168-9485-6b706dd3ff98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c488615e-e44e-41d8-8632-7428d37ce48f", "tag": "236ea2ce-3953-487a-a1e5-ce4648623dcc"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:29.983480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d5ef67cb-84ca-4033-bc40-949588faad01 req-fda58b72-5faf-4168-9485-6b706dd3ff98 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:29.984330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d5ef67cb-84ca-4033-bc40-949588faad01 req-fda58b72-5faf-4168-9485-6b706dd3ff98 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:29.985242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d5ef67cb-84ca-4033-bc40-949588faad01 req-fda58b72-5faf-4168-9485-6b706dd3ff98 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:30.008191 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-d5ef67cb-84ca-4033-bc40-949588faad01 req-fda58b72-5faf-4168-9485-6b706dd3ff98 service nova] Creating event network-changed:236ea2ce-3953-487a-a1e5-ce4648623dcc for instance c488615e-e44e-41d8-8632-7428d37ce48f on n-h1-860864-3 Oct 11 19:42:30.030188 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-d5ef67cb-84ca-4033-bc40-949588faad01 req-fda58b72-5faf-4168-9485-6b706dd3ff98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.412773 Oct 11 19:42:30.031189 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 58/92] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:30.032487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d48f1ebf-67f2-48d4-9590-75dce873d825 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:30.033542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d48f1ebf-67f2-48d4-9590-75dce873d825 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:30.056301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d48f1ebf-67f2-48d4-9590-75dce873d825 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:30.057216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d48f1ebf-67f2-48d4-9590-75dce873d825 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:30.059963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d48f1ebf-67f2-48d4-9590-75dce873d825 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:30.061010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d48f1ebf-67f2-48d4-9590-75dce873d825 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:30.065371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d48f1ebf-67f2-48d4-9590-75dce873d825 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:30.069464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d48f1ebf-67f2-48d4-9590-75dce873d825 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:30.163562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:30.644276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d48f1ebf-67f2-48d4-9590-75dce873d825 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:30.654467 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d48f1ebf-67f2-48d4-9590-75dce873d825 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.626016 Oct 11 19:42:30.655903 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 35/93] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:30 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:42:30.813618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1d922297-5706-4965-ad02-b4117f9a791d tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:30.814649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1d922297-5706-4965-ad02-b4117f9a791d tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:30.816836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:INSERT=5 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:30.829674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d922297-5706-4965-ad02-b4117f9a791d tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:30.833214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d922297-5706-4965-ad02-b4117f9a791d tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:30.834230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d922297-5706-4965-ad02-b4117f9a791d tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:30.836711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d922297-5706-4965-ad02-b4117f9a791d tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:30.837407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d922297-5706-4965-ad02-b4117f9a791d tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:30.837844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d922297-5706-4965-ad02-b4117f9a791d tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:31.722735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3f351850-bbb9-4d43-8a76-c577314e90e4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:31.723632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3f351850-bbb9-4d43-8a76-c577314e90e4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:31.778901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f351850-bbb9-4d43-8a76-c577314e90e4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:31.780505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f351850-bbb9-4d43-8a76-c577314e90e4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:31.789114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1d922297-5706-4965-ad02-b4117f9a791d tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:31.790099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f351850-bbb9-4d43-8a76-c577314e90e4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:31.790982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f351850-bbb9-4d43-8a76-c577314e90e4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:31.791533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f351850-bbb9-4d43-8a76-c577314e90e4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:31.792117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f351850-bbb9-4d43-8a76-c577314e90e4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:31.800835 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1d922297-5706-4965-ad02-b4117f9a791d tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.990752 Oct 11 19:42:31.802007 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 59/94] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:30 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:32.116067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3f351850-bbb9-4d43-8a76-c577314e90e4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:32.129555 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3f351850-bbb9-4d43-8a76-c577314e90e4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.451928 Oct 11 19:42:32.132525 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 36/95] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:31 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:32.841362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-475fafdd-054d-4b51-981f-bc814a69a0a0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:32.842929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-475fafdd-054d-4b51-981f-bc814a69a0a0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:32.855746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475fafdd-054d-4b51-981f-bc814a69a0a0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:32.858005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475fafdd-054d-4b51-981f-bc814a69a0a0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:32.860054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475fafdd-054d-4b51-981f-bc814a69a0a0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:32.860940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475fafdd-054d-4b51-981f-bc814a69a0a0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:32.864685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475fafdd-054d-4b51-981f-bc814a69a0a0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:32.865341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475fafdd-054d-4b51-981f-bc814a69a0a0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:33.162706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-718e0233-b7f9-4a91-a060-a3f27131e552 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:33.163629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-718e0233-b7f9-4a91-a060-a3f27131e552 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:33.181336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8,nova_api:UPDATE=14 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:33.203447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-718e0233-b7f9-4a91-a060-a3f27131e552 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:33.205456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-718e0233-b7f9-4a91-a060-a3f27131e552 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:33.207139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-718e0233-b7f9-4a91-a060-a3f27131e552 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:33.209718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-718e0233-b7f9-4a91-a060-a3f27131e552 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:33.210896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-718e0233-b7f9-4a91-a060-a3f27131e552 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:33.213651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-718e0233-b7f9-4a91-a060-a3f27131e552 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:33.651177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-475fafdd-054d-4b51-981f-bc814a69a0a0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:33.660206 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-475fafdd-054d-4b51-981f-bc814a69a0a0 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.825346 Oct 11 19:42:33.667700 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 60/96] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:32 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:33.823613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-718e0233-b7f9-4a91-a060-a3f27131e552 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:33.833902 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-718e0233-b7f9-4a91-a060-a3f27131e552 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.680248 Oct 11 19:42:33.834622 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 37/97] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:33 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:34.692168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cbf5d80f-1077-42fc-b15b-05b9b5440d22 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:34.692786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cbf5d80f-1077-42fc-b15b-05b9b5440d22 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:34.700560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbf5d80f-1077-42fc-b15b-05b9b5440d22 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:34.704689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbf5d80f-1077-42fc-b15b-05b9b5440d22 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:34.705139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbf5d80f-1077-42fc-b15b-05b9b5440d22 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:34.706787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbf5d80f-1077-42fc-b15b-05b9b5440d22 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:34.707250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbf5d80f-1077-42fc-b15b-05b9b5440d22 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:34.707677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cbf5d80f-1077-42fc-b15b-05b9b5440d22 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:34.863213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-307d7056-e3f0-4f15-b145-4ae6b248eaef tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:34.863848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-307d7056-e3f0-4f15-b145-4ae6b248eaef tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:34.882144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-307d7056-e3f0-4f15-b145-4ae6b248eaef tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:34.882705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-307d7056-e3f0-4f15-b145-4ae6b248eaef tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:34.888465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-307d7056-e3f0-4f15-b145-4ae6b248eaef tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:34.889545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-307d7056-e3f0-4f15-b145-4ae6b248eaef tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:34.894102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-307d7056-e3f0-4f15-b145-4ae6b248eaef tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:34.897291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-307d7056-e3f0-4f15-b145-4ae6b248eaef tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:35.019585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cbf5d80f-1077-42fc-b15b-05b9b5440d22 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:35.029188 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cbf5d80f-1077-42fc-b15b-05b9b5440d22 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.341237 Oct 11 19:42:35.033822 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 61/98] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:34 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:35.190923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-307d7056-e3f0-4f15-b145-4ae6b248eaef tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:35.200725 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-307d7056-e3f0-4f15-b145-4ae6b248eaef tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.342397 Oct 11 19:42:35.203193 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 38/99] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:34 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:35.667108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d73a934-9b51-4e7d-bd71-f62d8030d104 tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113 tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:35.678837 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6d73a934-9b51-4e7d-bd71-f62d8030d104 tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113 tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d73a934-9b51-4e7d-bd71-f62d8030d104 tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113 tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113-project-admin] Request method failure captured: Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccrhUiFnFeXkF7EQDl9yQfXzCMZJq-5yWLhePz-PLjY1fyU7EoE0s3zl7G8KaRGBNxggYfsrdcfgioT2SjAj6fAw1ULC7z18L6zB94uALrB2dmPWf266vVDSuruhxZRxyhxfH3cusPcIQR5t0TQbXmk-NkOpb_OQaVrDJYhoRTN5U4 Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: e977abad69ec4566a0049f55214490b7 Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113 Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:42:35.691782 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e977abad69ec4566a0049f55214490b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e977abad69ec4566a0049f55214490b7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e977abad69ec4566a0049f55214490b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e977abad69ec4566a0049f55214490b7"}]}] Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113 Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: e977abad69ec4566a0049f55214490b7 Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113 Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113-project-admin Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: be21575cf54a40b0aab773ad1c18cbac Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113-project-admin Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:35.693481 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid timestamp for date invalid_time Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'invalid_time'} Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:35.694189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 11 19:42:35.695262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:35.698580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d73a934-9b51-4e7d-bd71-f62d8030d104 tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113 tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:35.698580 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6d73a934-9b51-4e7d-bd71-f62d8030d104 tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113 tempest-InstanceUsageAuditLogNegativeTestJSON-1758833113-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.501073 Oct 11 19:42:35.698580 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 62/100] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 11 19:42:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 502 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:42:35.948639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-181294223", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "372895867", "adminPass": "***", "networks": [{"uuid": "4d33fc3c-6ffd-40f8-9ec5-ef472bfacbe9"}], "security_groups": [{"name": "tempest-securitygroup--683654186"}], "key_name": "tempest-keypair-356615870", "user_data": "}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:36.123117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c5ca414-da82-4bf3-a554-dd51427c0bf8 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:36.125457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6c5ca414-da82-4bf3-a554-dd51427c0bf8 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '222bf7baa19547f2877be458b68a32f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d9a40d126d406ca4b3ae2f4945e984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c5ca414-da82-4bf3-a554-dd51427c0bf8 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project] Request method failure captured: Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccpAWlHtuupKdE49x5hJ99BCaC1Y6UL_-NYWgJ2Srxgk-MUGZqQ78mxe7Tj_wJfbQ_HcoASKl1pZQUjCSXAX-um_AUW5cn4GhFYK_GjUL7THEWv6TBmhFjr2-EhkAw3E-LvHogWiQ-eMQ7KRNtUNHQ1FvkqWDIaq6g8Ljon_vZjA9M Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 50d9a40d126d406ca4b3ae2f4945e984 Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:42:36.128936 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:42:36.130211 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50d9a40d126d406ca4b3ae2f4945e984"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50d9a40d126d406ca4b3ae2f4945e984", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50d9a40d126d406ca4b3ae2f4945e984"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50d9a40d126d406ca4b3ae2f4945e984"}]}] Oct 11 19:42:36.130211 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 Oct 11 19:42:36.130211 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 50d9a40d126d406ca4b3ae2f4945e984 Oct 11 19:42:36.130211 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 Oct 11 19:42:36.130211 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project Oct 11 19:42:36.130211 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:36.130211 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:36.130211 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 222bf7baa19547f2877be458b68a32f8 Oct 11 19:42:36.130211 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project Oct 11 19:42:36.130211 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: action_args: {} Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:36.130828 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 19:42:36.132734 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:36.135872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c5ca414-da82-4bf3-a554-dd51427c0bf8 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:36.137185 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6c5ca414-da82-4bf3-a554-dd51427c0bf8 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.434446 Oct 11 19:42:36.138187 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 39/101] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 11 19:42:35 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 436 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:36.140660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] validate_networks() for [('4d33fc3c-6ffd-40f8-9ec5-ef472bfacbe9', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:42:36.143283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a27c7ff0-bfea-4ec6-b2da-b1966e59cf46 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:36.144302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a27c7ff0-bfea-4ec6-b2da-b1966e59cf46 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:36.154202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27c7ff0-bfea-4ec6-b2da-b1966e59cf46 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:36.157012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27c7ff0-bfea-4ec6-b2da-b1966e59cf46 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:36.157564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27c7ff0-bfea-4ec6-b2da-b1966e59cf46 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:36.159334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27c7ff0-bfea-4ec6-b2da-b1966e59cf46 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:36.160617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27c7ff0-bfea-4ec6-b2da-b1966e59cf46 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:36.161971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27c7ff0-bfea-4ec6-b2da-b1966e59cf46 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:36.556270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a27c7ff0-bfea-4ec6-b2da-b1966e59cf46 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:36.566673 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a27c7ff0-bfea-4ec6-b2da-b1966e59cf46 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.427186 Oct 11 19:42:36.579230 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 40/102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:36 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:36.582838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11aa8cd9-70a0-4a2b-aff6-c93e72577ed0 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:36.585172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-11aa8cd9-70a0-4a2b-aff6-c93e72577ed0 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '222bf7baa19547f2877be458b68a32f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d9a40d126d406ca4b3ae2f4945e984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11aa8cd9-70a0-4a2b-aff6-c93e72577ed0 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project] Request method failure captured: Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2019:42:36 HTTP/1.1 Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccpAWlHtuupKdE49x5hJ99BCaC1Y6UL_-NYWgJ2Srxgk-MUGZqQ78mxe7Tj_wJfbQ_HcoASKl1pZQUjCSXAX-um_AUW5cn4GhFYK_GjUL7THEWv6TBmhFjr2-EhkAw3E-LvHogWiQ-eMQ7KRNtUNHQ1FvkqWDIaq6g8Ljon_vZjA9M Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 50d9a40d126d406ca4b3ae2f4945e984 Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:42:36.586842 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:42:36.588352 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50d9a40d126d406ca4b3ae2f4945e984"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50d9a40d126d406ca4b3ae2f4945e984", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50d9a40d126d406ca4b3ae2f4945e984"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50d9a40d126d406ca4b3ae2f4945e984"}]}] Oct 11 19:42:36.588352 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 Oct 11 19:42:36.588352 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 50d9a40d126d406ca4b3ae2f4945e984 Oct 11 19:42:36.588352 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 Oct 11 19:42:36.588352 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project Oct 11 19:42:36.588352 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:36.588352 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:36.588352 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 222bf7baa19547f2877be458b68a32f8 Oct 11 19:42:36.588352 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project Oct 11 19:42:36.588352 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '2022-10-11 19:42:36'} Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:36.588886 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 19:42:36.589977 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:36.590968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11aa8cd9-70a0-4a2b-aff6-c93e72577ed0 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:36.590968 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-11aa8cd9-70a0-4a2b-aff6-c93e72577ed0 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247 tempest-InstanceUsageAuditLogNegativeTestJSON-2089584247-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11 19:42:36" status: 403 len: 128 microversion: 2.1 time: 0.017826 Oct 11 19:42:36.601923 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 41/103] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 19:42:36 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2019%3A42%3A36 => generated 128 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:36.610936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0e7af82-281f-45b1-8ba4-38432811a1ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:36.611561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0e7af82-281f-45b1-8ba4-38432811a1ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:36.622461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0e7af82-281f-45b1-8ba4-38432811a1ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:36.622907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0e7af82-281f-45b1-8ba4-38432811a1ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:36.624223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0e7af82-281f-45b1-8ba4-38432811a1ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:36.625103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0e7af82-281f-45b1-8ba4-38432811a1ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:36.625603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0e7af82-281f-45b1-8ba4-38432811a1ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:36.626122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0e7af82-281f-45b1-8ba4-38432811a1ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:36.803419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e0e7af82-281f-45b1-8ba4-38432811a1ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:36.813999 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0e7af82-281f-45b1-8ba4-38432811a1ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.210183 Oct 11 19:42:36.814608 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 42/104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:36 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:37.199605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:37.593273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c1c2ae8-5105-4dbb-88b5-d07790d0a156 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:37.593926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c1c2ae8-5105-4dbb-88b5-d07790d0a156 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:37.604780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c1c2ae8-5105-4dbb-88b5-d07790d0a156 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:37.605280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c1c2ae8-5105-4dbb-88b5-d07790d0a156 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:37.606352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c1c2ae8-5105-4dbb-88b5-d07790d0a156 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:37.607102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c1c2ae8-5105-4dbb-88b5-d07790d0a156 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:37.607556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c1c2ae8-5105-4dbb-88b5-d07790d0a156 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:37.607992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c1c2ae8-5105-4dbb-88b5-d07790d0a156 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:37.675517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:42:37.675936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:42:37.676414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:42:37.676825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:42:37.677230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:42:37.700532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:37.702135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:37.703017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:37.707002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:37.709776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:37.710615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:37.714328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=43,nova_cell0:UPDATE=7 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:37.778866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Getting quotas for project 2a7b6535ad3d4f56b4483a9cde85691b. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:42:37.784938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Getting quotas for user 603e5875618949c1998ea23bf0e954b5 and project 2a7b6535ad3d4f56b4483a9cde85691b. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:42:37.817030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:42:37.820259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:42:37.856292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c1c2ae8-5105-4dbb-88b5-d07790d0a156 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:37.866250 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c1c2ae8-5105-4dbb-88b5-d07790d0a156 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.276694 Oct 11 19:42:37.868110 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 43/105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:37 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:42:37.880441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c4e1d9c7-025c-402e-9588-6c49248e52ac tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:37.883971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c4e1d9c7-025c-402e-9588-6c49248e52ac tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:37.901181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4e1d9c7-025c-402e-9588-6c49248e52ac tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:37.902083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4e1d9c7-025c-402e-9588-6c49248e52ac tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:37.903293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4e1d9c7-025c-402e-9588-6c49248e52ac tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:37.904108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4e1d9c7-025c-402e-9588-6c49248e52ac tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:37.905675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4e1d9c7-025c-402e-9588-6c49248e52ac tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:37.907875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4e1d9c7-025c-402e-9588-6c49248e52ac tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:37.953145 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b4292e0d-8935-46c8-b0cb-8194aac0e59a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.010781 Oct 11 19:42:37.954471 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 63/106] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:42:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 2013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 19:42:37.966935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-47531c16-68c1-4f2c-be1f-975d37c33131 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:37.967883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-47531c16-68c1-4f2c-be1f-975d37c33131 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:38.116339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-47531c16-68c1-4f2c-be1f-975d37c33131 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:38.128653 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-47531c16-68c1-4f2c-be1f-975d37c33131 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1261 microversion: 2.1 time: 0.166047 Oct 11 19:42:38.146753 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 64/107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:37 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:42:38.246157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c4e1d9c7-025c-402e-9588-6c49248e52ac tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:38.264444 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c4e1d9c7-025c-402e-9588-6c49248e52ac tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.393543 Oct 11 19:42:38.265155 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 44/108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:37 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:38.735163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1843387875", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:38.745303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3c60cdde-5624-42bb-9d3e-14a7b0190a01 tempest-QuotaClassesAdminTestJSON-964419566 tempest-QuotaClassesAdminTestJSON-964419566-project-admin] Calling method '.version_select at 0x7f83ccef5940>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:38.774694 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3c60cdde-5624-42bb-9d3e-14a7b0190a01 tempest-QuotaClassesAdminTestJSON-964419566 tempest-QuotaClassesAdminTestJSON-964419566-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.496099 Oct 11 19:42:38.780728 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 45/109] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 11 19:42:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:38.795723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b63b80d-753f-4b97-9c21-a96c1ca385a4 tempest-QuotaClassesAdminTestJSON-964419566 tempest-QuotaClassesAdminTestJSON-964419566-project-admin] Action: 'update', calling method: .version_select at 0x7f83ccef5f70>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:38.844867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:42:39.170718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:42:39.171634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:42:39.172494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:42:39.173165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:42:39.173894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:42:39.192018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:39.195265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:39.195885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:39.196772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:39.197673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:39.198352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:39.245085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:42:39.258929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:42:39.287187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:42:39.291325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:42:39.376661 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b63b80d-753f-4b97-9c21-a96c1ca385a4 tempest-QuotaClassesAdminTestJSON-964419566 tempest-QuotaClassesAdminTestJSON-964419566-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.585516 Oct 11 19:42:39.377556 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c6044bee-9fcd-491f-9aa1-3dea88a6e09e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.204987 Oct 11 19:42:39.378318 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 46/110] 10.222.0.27 () {60 vars in 1206 bytes} [Tue Oct 11 19:42:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:39.379396 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 65/111] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:42:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:42:39.389788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-948b12ce-2165-44c7-b6cb-a4f87f50c388 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:39.390946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-948b12ce-2165-44c7-b6cb-a4f87f50c388 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:39.401217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-948b12ce-2165-44c7-b6cb-a4f87f50c388 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:39.402830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-948b12ce-2165-44c7-b6cb-a4f87f50c388 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:39.403921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-948b12ce-2165-44c7-b6cb-a4f87f50c388 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:39.405411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-948b12ce-2165-44c7-b6cb-a4f87f50c388 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:39.405940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-948b12ce-2165-44c7-b6cb-a4f87f50c388 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:39.406382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-948b12ce-2165-44c7-b6cb-a4f87f50c388 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:39.407035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-05b2eb0a-245c-4fde-b1cf-219dac3674ce tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:39.409249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-05b2eb0a-245c-4fde-b1cf-219dac3674ce tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:39.437481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05b2eb0a-245c-4fde-b1cf-219dac3674ce tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:39.439054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05b2eb0a-245c-4fde-b1cf-219dac3674ce tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:39.439612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05b2eb0a-245c-4fde-b1cf-219dac3674ce tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:39.440636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05b2eb0a-245c-4fde-b1cf-219dac3674ce tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:39.444579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05b2eb0a-245c-4fde-b1cf-219dac3674ce tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:39.445197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05b2eb0a-245c-4fde-b1cf-219dac3674ce tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:39.538775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-948b12ce-2165-44c7-b6cb-a4f87f50c388 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:39.549662 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-948b12ce-2165-44c7-b6cb-a4f87f50c388 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1313 microversion: 2.1 time: 0.168586 Oct 11 19:42:39.550267 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 66/112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:39 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:39.563428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a1851ba-960e-487b-bcb1-ea69b158dc2f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:39.564055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a1851ba-960e-487b-bcb1-ea69b158dc2f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:39.578277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a1851ba-960e-487b-bcb1-ea69b158dc2f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:39.579212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a1851ba-960e-487b-bcb1-ea69b158dc2f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:39.579985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a1851ba-960e-487b-bcb1-ea69b158dc2f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:39.580903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a1851ba-960e-487b-bcb1-ea69b158dc2f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:39.581371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a1851ba-960e-487b-bcb1-ea69b158dc2f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:39.581803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a1851ba-960e-487b-bcb1-ea69b158dc2f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:39.736969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-05b2eb0a-245c-4fde-b1cf-219dac3674ce tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:39.749420 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-05b2eb0a-245c-4fde-b1cf-219dac3674ce tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.354811 Oct 11 19:42:39.752325 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 47/113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:39 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:39.763246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0c63a9b-c13b-44a7-8d62-86d0453f6468 tempest-QuotaClassesAdminTestJSON-964419566 tempest-QuotaClassesAdminTestJSON-964419566-project-admin] Calling method '.version_select at 0x7f83cd02b670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:39.808762 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a0c63a9b-c13b-44a7-8d62-86d0453f6468 tempest-QuotaClassesAdminTestJSON-964419566 tempest-QuotaClassesAdminTestJSON-964419566-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.055093 Oct 11 19:42:39.809805 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 48/114] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 11 19:42:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:39.821047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cc9aeadf-13c7-4b8e-83d6-16c5001ba5a0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:39.822625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cc9aeadf-13c7-4b8e-83d6-16c5001ba5a0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:40.065257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cc9aeadf-13c7-4b8e-83d6-16c5001ba5a0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:40.080468 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cc9aeadf-13c7-4b8e-83d6-16c5001ba5a0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1217 microversion: 2.1 time: 0.265203 Oct 11 19:42:40.083958 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 49/115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:39 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1217 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:40.111070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-00747068-b15a-4295-bc85-4db31c35b251 tempest-QuotaClassesAdminTestJSON-964419566 tempest-QuotaClassesAdminTestJSON-964419566-project-admin] Action: 'update', calling method: .version_select at 0x7f83cd1ab0d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:40.161322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4a1851ba-960e-487b-bcb1-ea69b158dc2f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:40.173780 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a1851ba-960e-487b-bcb1-ea69b158dc2f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.622046 Oct 11 19:42:40.175467 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 67/116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:39 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:40.376482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=24,nova_api:INSERT=7 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:40.397063 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-00747068-b15a-4295-bc85-4db31c35b251 tempest-QuotaClassesAdminTestJSON-964419566 tempest-QuotaClassesAdminTestJSON-964419566-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.305624 Oct 11 19:42:40.401604 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 50/117] 10.222.0.27 () {60 vars in 1206 bytes} [Tue Oct 11 19:42:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:40.582245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cc4e770f-6e13-47ee-87f9-0b613a67c74d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:40.583006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cc4e770f-6e13-47ee-87f9-0b613a67c74d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:40.592879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc4e770f-6e13-47ee-87f9-0b613a67c74d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:40.593442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc4e770f-6e13-47ee-87f9-0b613a67c74d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:40.594097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc4e770f-6e13-47ee-87f9-0b613a67c74d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:40.594895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc4e770f-6e13-47ee-87f9-0b613a67c74d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:40.595406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc4e770f-6e13-47ee-87f9-0b613a67c74d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:40.596653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc4e770f-6e13-47ee-87f9-0b613a67c74d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:40.707253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-3cd386ca-c0f5-4a82-9b45-52a7dd1f1105 req-9e709ed8-bde2-4b6b-8d7c-eb14a7ecd1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77ba20d-cd31-4f68-ab97-edd11f22a708", "name": "network-vif-plugged", "status": "completed", "tag": "097a4ee4-babc-4ec6-806d-f7b20f748046"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:40.714850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cc4e770f-6e13-47ee-87f9-0b613a67c74d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:40.733295 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cc4e770f-6e13-47ee-87f9-0b613a67c74d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1319 microversion: 2.1 time: 0.158104 Oct 11 19:42:40.734957 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 51/118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:40 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:42:40.765212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3cd386ca-c0f5-4a82-9b45-52a7dd1f1105 req-9e709ed8-bde2-4b6b-8d7c-eb14a7ecd1ed service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:40.775916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3cd386ca-c0f5-4a82-9b45-52a7dd1f1105 req-9e709ed8-bde2-4b6b-8d7c-eb14a7ecd1ed service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:40.776943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3cd386ca-c0f5-4a82-9b45-52a7dd1f1105 req-9e709ed8-bde2-4b6b-8d7c-eb14a7ecd1ed service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:40.777232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-58fee9fb-358a-475a-9b70-1b7ae9852a3b tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:40.777701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-58fee9fb-358a-475a-9b70-1b7ae9852a3b tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:40.802374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58fee9fb-358a-475a-9b70-1b7ae9852a3b tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:40.802883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58fee9fb-358a-475a-9b70-1b7ae9852a3b tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:40.811291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58fee9fb-358a-475a-9b70-1b7ae9852a3b tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:40.812379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58fee9fb-358a-475a-9b70-1b7ae9852a3b tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:40.812984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58fee9fb-358a-475a-9b70-1b7ae9852a3b tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:40.815089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58fee9fb-358a-475a-9b70-1b7ae9852a3b tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:40.825118 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-3cd386ca-c0f5-4a82-9b45-52a7dd1f1105 req-9e709ed8-bde2-4b6b-8d7c-eb14a7ecd1ed service nova] Creating event network-vif-plugged:097a4ee4-babc-4ec6-806d-f7b20f748046 for instance a77ba20d-cd31-4f68-ab97-edd11f22a708 on n-h1-860864-3 Oct 11 19:42:40.841205 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-3cd386ca-c0f5-4a82-9b45-52a7dd1f1105 req-9e709ed8-bde2-4b6b-8d7c-eb14a7ecd1ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.535404 Oct 11 19:42:40.859583 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 68/119] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:42:41.112293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-61b0a663-012b-4f64-ad29-3b554ae850e0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:41.113234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-61b0a663-012b-4f64-ad29-3b554ae850e0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:41.153477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b0a663-012b-4f64-ad29-3b554ae850e0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:41.155386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b0a663-012b-4f64-ad29-3b554ae850e0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:41.163783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b0a663-012b-4f64-ad29-3b554ae850e0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:41.165357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b0a663-012b-4f64-ad29-3b554ae850e0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:41.174658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b0a663-012b-4f64-ad29-3b554ae850e0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:41.204535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b0a663-012b-4f64-ad29-3b554ae850e0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:41.452020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-58fee9fb-358a-475a-9b70-1b7ae9852a3b tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:41.466280 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-58fee9fb-358a-475a-9b70-1b7ae9852a3b tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.693881 Oct 11 19:42:41.478738 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 52/120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:40 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:41.478738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-29424e5b-e8ee-4066-9eb3-8b1d9021ea24 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:41.478738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-29424e5b-e8ee-4066-9eb3-8b1d9021ea24 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:41.486567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29424e5b-e8ee-4066-9eb3-8b1d9021ea24 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:41.486567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29424e5b-e8ee-4066-9eb3-8b1d9021ea24 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:41.486567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29424e5b-e8ee-4066-9eb3-8b1d9021ea24 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:41.486567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29424e5b-e8ee-4066-9eb3-8b1d9021ea24 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:41.496128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29424e5b-e8ee-4066-9eb3-8b1d9021ea24 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:41.496698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29424e5b-e8ee-4066-9eb3-8b1d9021ea24 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:42.019743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-61b0a663-012b-4f64-ad29-3b554ae850e0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:42.041325 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-61b0a663-012b-4f64-ad29-3b554ae850e0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1269 microversion: 2.1 time: 0.922348 Oct 11 19:42:42.042346 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 69/121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:41 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1269 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:42:42.057984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6e1b5a4a-ed93-40a3-ba24-613e2a3247ad tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:42.059307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6e1b5a4a-ed93-40a3-ba24-613e2a3247ad tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:42.088075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e1b5a4a-ed93-40a3-ba24-613e2a3247ad tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:42.088695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e1b5a4a-ed93-40a3-ba24-613e2a3247ad tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:42.089203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e1b5a4a-ed93-40a3-ba24-613e2a3247ad tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:42.090164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e1b5a4a-ed93-40a3-ba24-613e2a3247ad tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:42.090669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e1b5a4a-ed93-40a3-ba24-613e2a3247ad tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:42.091239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e1b5a4a-ed93-40a3-ba24-613e2a3247ad tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:42.275434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6e1b5a4a-ed93-40a3-ba24-613e2a3247ad tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:42.290104 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6e1b5a4a-ed93-40a3-ba24-613e2a3247ad tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1319 microversion: 2.1 time: 0.246507 Oct 11 19:42:42.291880 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 70/122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:42 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:42.427307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-29424e5b-e8ee-4066-9eb3-8b1d9021ea24 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:42.437356 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-29424e5b-e8ee-4066-9eb3-8b1d9021ea24 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.968689 Oct 11 19:42:42.441602 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 53/123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:41 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:42.497829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-124b917c-ea18-45e7-9a69-daabbce6169c tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:42.498974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-124b917c-ea18-45e7-9a69-daabbce6169c tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:42.512827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-124b917c-ea18-45e7-9a69-daabbce6169c tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:42.513933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-124b917c-ea18-45e7-9a69-daabbce6169c tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:42.515659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-124b917c-ea18-45e7-9a69-daabbce6169c tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:42.517105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-124b917c-ea18-45e7-9a69-daabbce6169c tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:42.517690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-124b917c-ea18-45e7-9a69-daabbce6169c tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:42.518113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-124b917c-ea18-45e7-9a69-daabbce6169c tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:42.942582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-124b917c-ea18-45e7-9a69-daabbce6169c tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:42.956597 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-124b917c-ea18-45e7-9a69-daabbce6169c tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.465864 Oct 11 19:42:42.957982 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 71/124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:42 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:43.068339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-473ac83f-ad32-466b-8899-4328ca0f9532 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:43.068958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-473ac83f-ad32-466b-8899-4328ca0f9532 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:43.079195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-473ac83f-ad32-466b-8899-4328ca0f9532 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:43.079654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-473ac83f-ad32-466b-8899-4328ca0f9532 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:43.080085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-473ac83f-ad32-466b-8899-4328ca0f9532 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:43.080786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-473ac83f-ad32-466b-8899-4328ca0f9532 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:43.084829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-473ac83f-ad32-466b-8899-4328ca0f9532 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:43.085274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-473ac83f-ad32-466b-8899-4328ca0f9532 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:43.188281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a83ce260-9d6d-4828-a154-b070d9230428 req-0faa8a7b-26ca-4e42-b8c5-631542e57beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c488615e-e44e-41d8-8632-7428d37ce48f", "name": "network-vif-plugged", "status": "completed", "tag": "236ea2ce-3953-487a-a1e5-ce4648623dcc"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:43.209617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a83ce260-9d6d-4828-a154-b070d9230428 req-0faa8a7b-26ca-4e42-b8c5-631542e57beb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:43.210264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a83ce260-9d6d-4828-a154-b070d9230428 req-0faa8a7b-26ca-4e42-b8c5-631542e57beb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:43.210772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a83ce260-9d6d-4828-a154-b070d9230428 req-0faa8a7b-26ca-4e42-b8c5-631542e57beb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:43.227795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-473ac83f-ad32-466b-8899-4328ca0f9532 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:43.235844 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a83ce260-9d6d-4828-a154-b070d9230428 req-0faa8a7b-26ca-4e42-b8c5-631542e57beb service nova] Creating event network-vif-plugged:236ea2ce-3953-487a-a1e5-ce4648623dcc for instance c488615e-e44e-41d8-8632-7428d37ce48f on n-h1-860864-3 Oct 11 19:42:43.251100 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-473ac83f-ad32-466b-8899-4328ca0f9532 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1269 microversion: 2.1 time: 0.188570 Oct 11 19:42:43.254680 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 54/125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:43 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:43.272539 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a83ce260-9d6d-4828-a154-b070d9230428 req-0faa8a7b-26ca-4e42-b8c5-631542e57beb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100028 Oct 11 19:42:43.275776 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 72/126] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:42:43.325591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a80ba594-9999-4aaf-83cb-96c8253cc593 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:43.326209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a80ba594-9999-4aaf-83cb-96c8253cc593 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:43.350476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80ba594-9999-4aaf-83cb-96c8253cc593 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:43.351090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80ba594-9999-4aaf-83cb-96c8253cc593 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:43.351542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80ba594-9999-4aaf-83cb-96c8253cc593 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:43.352274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80ba594-9999-4aaf-83cb-96c8253cc593 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:43.355342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80ba594-9999-4aaf-83cb-96c8253cc593 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:43.355942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80ba594-9999-4aaf-83cb-96c8253cc593 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:43.477246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0cb16046-e604-4404-8c7e-f40391953e9f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:43.479138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0cb16046-e604-4404-8c7e-f40391953e9f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:43.503655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb16046-e604-4404-8c7e-f40391953e9f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:43.504607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb16046-e604-4404-8c7e-f40391953e9f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:43.505298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb16046-e604-4404-8c7e-f40391953e9f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:43.515206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb16046-e604-4404-8c7e-f40391953e9f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:43.516022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb16046-e604-4404-8c7e-f40391953e9f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:43.516790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb16046-e604-4404-8c7e-f40391953e9f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:43.653603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a80ba594-9999-4aaf-83cb-96c8253cc593 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:43.664917 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a80ba594-9999-4aaf-83cb-96c8253cc593 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1319 microversion: 2.1 time: 0.348365 Oct 11 19:42:43.666100 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 55/127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:43 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:43.983698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a5431caf-c68d-4bdb-8989-c8063b2d8eca tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:43.984320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a5431caf-c68d-4bdb-8989-c8063b2d8eca tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:44.003251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5431caf-c68d-4bdb-8989-c8063b2d8eca tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:44.003750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5431caf-c68d-4bdb-8989-c8063b2d8eca tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:44.004188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5431caf-c68d-4bdb-8989-c8063b2d8eca tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:44.004905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5431caf-c68d-4bdb-8989-c8063b2d8eca tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:44.005366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5431caf-c68d-4bdb-8989-c8063b2d8eca tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:44.005792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5431caf-c68d-4bdb-8989-c8063b2d8eca tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:44.127836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0cb16046-e604-4404-8c7e-f40391953e9f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:44.137480 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0cb16046-e604-4404-8c7e-f40391953e9f tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1339 microversion: 2.1 time: 0.671665 Oct 11 19:42:44.143295 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 73/128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:43 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1339 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:44.277718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-18d1b38b-7177-44ef-aa6a-7efe1422babb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:44.278506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-18d1b38b-7177-44ef-aa6a-7efe1422babb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:44.286164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d1b38b-7177-44ef-aa6a-7efe1422babb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:44.299379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d1b38b-7177-44ef-aa6a-7efe1422babb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:44.300138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d1b38b-7177-44ef-aa6a-7efe1422babb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:44.302373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d1b38b-7177-44ef-aa6a-7efe1422babb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:44.302915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d1b38b-7177-44ef-aa6a-7efe1422babb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:44.303347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d1b38b-7177-44ef-aa6a-7efe1422babb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:44.339141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a5431caf-c68d-4bdb-8989-c8063b2d8eca tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:44.351051 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a5431caf-c68d-4bdb-8989-c8063b2d8eca tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.372809 Oct 11 19:42:44.355210 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 56/129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:43 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:42:44.425965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-18d1b38b-7177-44ef-aa6a-7efe1422babb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:44.435705 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-18d1b38b-7177-44ef-aa6a-7efe1422babb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1269 microversion: 2.1 time: 0.161868 Oct 11 19:42:44.436985 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 74/130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:44 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:44.693803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7d5b1c16-5c77-4a9a-a1b1-58e76776132f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:44.695216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d5b1c16-5c77-4a9a-a1b1-58e76776132f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:44.716943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d5b1c16-5c77-4a9a-a1b1-58e76776132f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:44.718075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d5b1c16-5c77-4a9a-a1b1-58e76776132f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:44.718515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d5b1c16-5c77-4a9a-a1b1-58e76776132f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:44.719437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d5b1c16-5c77-4a9a-a1b1-58e76776132f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:44.719896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d5b1c16-5c77-4a9a-a1b1-58e76776132f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:44.720320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d5b1c16-5c77-4a9a-a1b1-58e76776132f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:44.810614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7d5b1c16-5c77-4a9a-a1b1-58e76776132f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:44.820044 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7d5b1c16-5c77-4a9a-a1b1-58e76776132f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1319 microversion: 2.1 time: 0.130188 Oct 11 19:42:44.836604 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 57/131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:44 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:45.165296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cefa6e87-5ec1-4647-85bf-07cf877ca81c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:45.166854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cefa6e87-5ec1-4647-85bf-07cf877ca81c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:45.177273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefa6e87-5ec1-4647-85bf-07cf877ca81c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:45.178151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefa6e87-5ec1-4647-85bf-07cf877ca81c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:45.178616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefa6e87-5ec1-4647-85bf-07cf877ca81c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:45.184824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefa6e87-5ec1-4647-85bf-07cf877ca81c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:45.185298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefa6e87-5ec1-4647-85bf-07cf877ca81c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:45.185740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefa6e87-5ec1-4647-85bf-07cf877ca81c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:45.378912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4625ef66-900f-4461-8a15-2f8eb9b53b35 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:45.380129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4625ef66-900f-4461-8a15-2f8eb9b53b35 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:45.401878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4625ef66-900f-4461-8a15-2f8eb9b53b35 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:45.404481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4625ef66-900f-4461-8a15-2f8eb9b53b35 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:45.405887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4625ef66-900f-4461-8a15-2f8eb9b53b35 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:45.408221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4625ef66-900f-4461-8a15-2f8eb9b53b35 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:45.409148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4625ef66-900f-4461-8a15-2f8eb9b53b35 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:45.411185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4625ef66-900f-4461-8a15-2f8eb9b53b35 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:45.466308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cefa6e87-5ec1-4647-85bf-07cf877ca81c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:45.486809 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cefa6e87-5ec1-4647-85bf-07cf877ca81c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1489 microversion: 2.1 time: 0.325115 Oct 11 19:42:45.493858 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 75/132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:45 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1489 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:45.504346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb84ac5f-53a4-4532-8e01-ddfcc235c56b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:45.506734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cb84ac5f-53a4-4532-8e01-ddfcc235c56b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:45.536934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb84ac5f-53a4-4532-8e01-ddfcc235c56b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:45.537619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb84ac5f-53a4-4532-8e01-ddfcc235c56b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:45.539017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb84ac5f-53a4-4532-8e01-ddfcc235c56b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:45.540796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb84ac5f-53a4-4532-8e01-ddfcc235c56b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:45.549087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb84ac5f-53a4-4532-8e01-ddfcc235c56b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:45.550775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb84ac5f-53a4-4532-8e01-ddfcc235c56b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:45.633520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb84ac5f-53a4-4532-8e01-ddfcc235c56b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:45.639075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4625ef66-900f-4461-8a15-2f8eb9b53b35 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:45.646787 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cb84ac5f-53a4-4532-8e01-ddfcc235c56b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1269 microversion: 2.1 time: 0.151155 Oct 11 19:42:45.647387 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 76/133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:45 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:45.649852 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4625ef66-900f-4461-8a15-2f8eb9b53b35 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1337 microversion: 2.1 time: 0.275696 Oct 11 19:42:45.651130 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 58/134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:45 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1337 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:45.844635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e32a2fac-5be9-4e2c-842d-266672075b5e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:45.845248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e32a2fac-5be9-4e2c-842d-266672075b5e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:45.854255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e32a2fac-5be9-4e2c-842d-266672075b5e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:45.858368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e32a2fac-5be9-4e2c-842d-266672075b5e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:45.859098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e32a2fac-5be9-4e2c-842d-266672075b5e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:45.866149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e32a2fac-5be9-4e2c-842d-266672075b5e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:45.872673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e32a2fac-5be9-4e2c-842d-266672075b5e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:45.873126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e32a2fac-5be9-4e2c-842d-266672075b5e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:45.889048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:46.059625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae865ae5-ab89-4151-b958-dbf430a381b5 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:46.059777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae865ae5-ab89-4151-b958-dbf430a381b5 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:46.072901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae865ae5-ab89-4151-b958-dbf430a381b5 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:46.073398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae865ae5-ab89-4151-b958-dbf430a381b5 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:46.079303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae865ae5-ab89-4151-b958-dbf430a381b5 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:46.080117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae865ae5-ab89-4151-b958-dbf430a381b5 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:46.080602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae865ae5-ab89-4151-b958-dbf430a381b5 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:46.081030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae865ae5-ab89-4151-b958-dbf430a381b5 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:46.191187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:46.265192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae865ae5-ab89-4151-b958-dbf430a381b5 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:42:46.273932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e32a2fac-5be9-4e2c-842d-266672075b5e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:46.284972 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e32a2fac-5be9-4e2c-842d-266672075b5e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1319 microversion: 2.1 time: 0.444190 Oct 11 19:42:46.285772 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 59/135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:45 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:42:46.581727 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ae865ae5-ab89-4151-b958-dbf430a381b5 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 204 len: 0 microversion: 2.1 time: 0.931728 Oct 11 19:42:46.583532 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 77/136] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:42:45 2022] DELETE /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 0 bytes in 935 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:42:46.594953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-96547c80-4252-4cde-9886-9ced49ff2d4c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:46.596148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-96547c80-4252-4cde-9886-9ced49ff2d4c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:46.603477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96547c80-4252-4cde-9886-9ced49ff2d4c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:46.607186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96547c80-4252-4cde-9886-9ced49ff2d4c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:46.608644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96547c80-4252-4cde-9886-9ced49ff2d4c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:46.612113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96547c80-4252-4cde-9886-9ced49ff2d4c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:46.613358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96547c80-4252-4cde-9886-9ced49ff2d4c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:46.615512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96547c80-4252-4cde-9886-9ced49ff2d4c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:46.671629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1b6cdc31-b056-4a48-9f2d-59614a868f8f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:46.672339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1b6cdc31-b056-4a48-9f2d-59614a868f8f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:46.687936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc31-b056-4a48-9f2d-59614a868f8f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:46.688516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc31-b056-4a48-9f2d-59614a868f8f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:46.690773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc31-b056-4a48-9f2d-59614a868f8f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:46.693332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc31-b056-4a48-9f2d-59614a868f8f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:46.693834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc31-b056-4a48-9f2d-59614a868f8f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:46.694270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b6cdc31-b056-4a48-9f2d-59614a868f8f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:46.881834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b6cdc31-b056-4a48-9f2d-59614a868f8f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:46.896506 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1b6cdc31-b056-4a48-9f2d-59614a868f8f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1275 microversion: 2.1 time: 0.230691 Oct 11 19:42:46.911541 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 78/137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:46 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:46.928209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2176373f-d539-428e-bedb-e0c830940551 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:46.929532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2176373f-d539-428e-bedb-e0c830940551 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:46.944672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2176373f-d539-428e-bedb-e0c830940551 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:46.945190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2176373f-d539-428e-bedb-e0c830940551 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:46.947542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2176373f-d539-428e-bedb-e0c830940551 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:46.950341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2176373f-d539-428e-bedb-e0c830940551 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:46.950861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2176373f-d539-428e-bedb-e0c830940551 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:46.951333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2176373f-d539-428e-bedb-e0c830940551 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:47.038784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-96547c80-4252-4cde-9886-9ced49ff2d4c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:47.048896 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-96547c80-4252-4cde-9886-9ced49ff2d4c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1495 microversion: 2.1 time: 0.459612 Oct 11 19:42:47.052631 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 60/138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:46 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1495 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:42:47.319096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1f345b82-1cc3-4bfc-b8eb-ee8fab7cd225 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:47.320518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1f345b82-1cc3-4bfc-b8eb-ee8fab7cd225 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:47.365995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f345b82-1cc3-4bfc-b8eb-ee8fab7cd225 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:47.367534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f345b82-1cc3-4bfc-b8eb-ee8fab7cd225 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:47.372222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f345b82-1cc3-4bfc-b8eb-ee8fab7cd225 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:47.374818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2176373f-d539-428e-bedb-e0c830940551 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:47.376669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f345b82-1cc3-4bfc-b8eb-ee8fab7cd225 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:47.377952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f345b82-1cc3-4bfc-b8eb-ee8fab7cd225 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:47.378334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f345b82-1cc3-4bfc-b8eb-ee8fab7cd225 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:47.394544 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2176373f-d539-428e-bedb-e0c830940551 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1487 microversion: 2.1 time: 0.487606 Oct 11 19:42:47.396760 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 79/139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:46 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1487 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:47.424484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56fa6c47-e675-46f9-aa3f-568bff707ae0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:47.425696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56fa6c47-e675-46f9-aa3f-568bff707ae0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:47.447405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56fa6c47-e675-46f9-aa3f-568bff707ae0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:47.448436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56fa6c47-e675-46f9-aa3f-568bff707ae0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:47.460756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56fa6c47-e675-46f9-aa3f-568bff707ae0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:47.465433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56fa6c47-e675-46f9-aa3f-568bff707ae0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:47.468713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56fa6c47-e675-46f9-aa3f-568bff707ae0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:47.469348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56fa6c47-e675-46f9-aa3f-568bff707ae0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:47.551124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1f345b82-1cc3-4bfc-b8eb-ee8fab7cd225 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:47.567839 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1f345b82-1cc3-4bfc-b8eb-ee8fab7cd225 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1319 microversion: 2.1 time: 0.257266 Oct 11 19:42:47.569027 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 61/140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:47 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:42:47.923768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8224da7b-2e1b-452d-a132-4791465388f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:47.924686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8224da7b-2e1b-452d-a132-4791465388f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:47.931404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8224da7b-2e1b-452d-a132-4791465388f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:47.942816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8224da7b-2e1b-452d-a132-4791465388f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:47.943448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8224da7b-2e1b-452d-a132-4791465388f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:47.944278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8224da7b-2e1b-452d-a132-4791465388f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:47.944825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8224da7b-2e1b-452d-a132-4791465388f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:47.945317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8224da7b-2e1b-452d-a132-4791465388f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:48.516516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8224da7b-2e1b-452d-a132-4791465388f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:48.526189 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8224da7b-2e1b-452d-a132-4791465388f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1317 microversion: 2.1 time: 0.606624 Oct 11 19:42:48.543040 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 62/141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:47 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:48.548808 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56fa6c47-e675-46f9-aa3f-568bff707ae0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1638 microversion: 2.1 time: 1.128174 Oct 11 19:42:48.563383 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 80/142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:47 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1638 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:48.578295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1300fc43-9d4a-4b40-8a18-3e057eb56c1b tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:48.586023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1300fc43-9d4a-4b40-8a18-3e057eb56c1b tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:48.592898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1300fc43-9d4a-4b40-8a18-3e057eb56c1b tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:48.593362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1300fc43-9d4a-4b40-8a18-3e057eb56c1b tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:48.598838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1300fc43-9d4a-4b40-8a18-3e057eb56c1b tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:48.599732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1300fc43-9d4a-4b40-8a18-3e057eb56c1b tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:48.600399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1300fc43-9d4a-4b40-8a18-3e057eb56c1b tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:48.600995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1300fc43-9d4a-4b40-8a18-3e057eb56c1b tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:48.788604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98a6b1b1-6cb7-41cb-83c3-775cc9cb2f68 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:48.792257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6b1b1-6cb7-41cb-83c3-775cc9cb2f68 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:48.792739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6b1b1-6cb7-41cb-83c3-775cc9cb2f68 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:48.793167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6b1b1-6cb7-41cb-83c3-775cc9cb2f68 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:48.793880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6b1b1-6cb7-41cb-83c3-775cc9cb2f68 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:48.794325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6b1b1-6cb7-41cb-83c3-775cc9cb2f68 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:48.800350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6b1b1-6cb7-41cb-83c3-775cc9cb2f68 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:48.866744 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98a6b1b1-6cb7-41cb-83c3-775cc9cb2f68 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.315016 Oct 11 19:42:48.869323 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 63/143] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:42:48 2022] GET /compute/v2.1/os-services => generated 965 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:48.884438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8721047d-ffd8-4e14-965d-2674d4597cd5 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:48.885211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8721047d-ffd8-4e14-965d-2674d4597cd5 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:48.896553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8721047d-ffd8-4e14-965d-2674d4597cd5 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:48.897899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8721047d-ffd8-4e14-965d-2674d4597cd5 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:48.899396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8721047d-ffd8-4e14-965d-2674d4597cd5 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:48.901829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8721047d-ffd8-4e14-965d-2674d4597cd5 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:48.903401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8721047d-ffd8-4e14-965d-2674d4597cd5 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:48.904533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8721047d-ffd8-4e14-965d-2674d4597cd5 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:48.959570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8721047d-ffd8-4e14-965d-2674d4597cd5 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:42:49.132211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1300fc43-9d4a-4b40-8a18-3e057eb56c1b tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:49.141318 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1300fc43-9d4a-4b40-8a18-3e057eb56c1b tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1495 microversion: 2.1 time: 0.576697 Oct 11 19:42:49.156693 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 81/144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:48 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1495 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:49.156693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-adc6b0a6-5b57-4735-9a8c-07c60d6f7c0b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:49.156693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-adc6b0a6-5b57-4735-9a8c-07c60d6f7c0b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:49.188359 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8721047d-ffd8-4e14-965d-2674d4597cd5 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 204 len: 0 microversion: 2.1 time: 0.316760 Oct 11 19:42:49.190728 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 64/145] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:42:48 2022] DELETE /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:42:49.198695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dfa0470f-4ab2-49d0-a8ae-53331595c176 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:49.203271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfa0470f-4ab2-49d0-a8ae-53331595c176 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:49.203772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfa0470f-4ab2-49d0-a8ae-53331595c176 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:49.204213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfa0470f-4ab2-49d0-a8ae-53331595c176 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:49.204951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfa0470f-4ab2-49d0-a8ae-53331595c176 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:49.205557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfa0470f-4ab2-49d0-a8ae-53331595c176 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:49.205985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfa0470f-4ab2-49d0-a8ae-53331595c176 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:49.218571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc6b0a6-5b57-4735-9a8c-07c60d6f7c0b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:49.219086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc6b0a6-5b57-4735-9a8c-07c60d6f7c0b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:49.223101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc6b0a6-5b57-4735-9a8c-07c60d6f7c0b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:49.223838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc6b0a6-5b57-4735-9a8c-07c60d6f7c0b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:49.224306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc6b0a6-5b57-4735-9a8c-07c60d6f7c0b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:49.224732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc6b0a6-5b57-4735-9a8c-07c60d6f7c0b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:49.232212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:49.244794 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dfa0470f-4ab2-49d0-a8ae-53331595c176 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.050709 Oct 11 19:42:49.245417 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 65/146] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 11 19:42:49 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 965 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:49.264954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54ed5a9a-112e-4bd3-9a61-51f65c202062 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:49.266024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-54ed5a9a-112e-4bd3-9a61-51f65c202062 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:49.279693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54ed5a9a-112e-4bd3-9a61-51f65c202062 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:49.280442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54ed5a9a-112e-4bd3-9a61-51f65c202062 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:49.281757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54ed5a9a-112e-4bd3-9a61-51f65c202062 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:49.282624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54ed5a9a-112e-4bd3-9a61-51f65c202062 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:49.285397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54ed5a9a-112e-4bd3-9a61-51f65c202062 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:49.287191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54ed5a9a-112e-4bd3-9a61-51f65c202062 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:49.287525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=14 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:49.769221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54ed5a9a-112e-4bd3-9a61-51f65c202062 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:49.779796 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-54ed5a9a-112e-4bd3-9a61-51f65c202062 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1493 microversion: 2.1 time: 0.532915 Oct 11 19:42:49.780362 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 66/147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:49 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1493 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:49.803933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6f8f81fe-08d8-4bd0-8da9-2c2d4c876d7c tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:49.819379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f8f81fe-08d8-4bd0-8da9-2c2d4c876d7c tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:49.819865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f8f81fe-08d8-4bd0-8da9-2c2d4c876d7c tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:49.820297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f8f81fe-08d8-4bd0-8da9-2c2d4c876d7c tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:49.821018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f8f81fe-08d8-4bd0-8da9-2c2d4c876d7c tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:49.821566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f8f81fe-08d8-4bd0-8da9-2c2d4c876d7c tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:49.822271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f8f81fe-08d8-4bd0-8da9-2c2d4c876d7c tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:49.875426 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6f8f81fe-08d8-4bd0-8da9-2c2d4c876d7c tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.075078 Oct 11 19:42:49.886952 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 67/148] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:42:49 2022] GET /compute/v2.1/os-services => generated 965 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:49.891938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5daf9930-4521-42f1-8ab9-d0956783e4dd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:49.892551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5daf9930-4521-42f1-8ab9-d0956783e4dd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:49.911541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5daf9930-4521-42f1-8ab9-d0956783e4dd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:49.912031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5daf9930-4521-42f1-8ab9-d0956783e4dd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:49.912663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5daf9930-4521-42f1-8ab9-d0956783e4dd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:49.913151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5daf9930-4521-42f1-8ab9-d0956783e4dd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:49.913600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5daf9930-4521-42f1-8ab9-d0956783e4dd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:49.914015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5daf9930-4521-42f1-8ab9-d0956783e4dd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.162544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-adc6b0a6-5b57-4735-9a8c-07c60d6f7c0b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:50.172460 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-adc6b0a6-5b57-4735-9a8c-07c60d6f7c0b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1386 microversion: 2.1 time: 1.029451 Oct 11 19:42:50.173042 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 82/149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:49 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1386 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:50.179058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-21d0c862-fd09-4f9c-82cc-6e1130a29386 req-aab3cb3b-ecb3-4064-b588-85b942bae48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77ba20d-cd31-4f68-ab97-edd11f22a708", "name": "network-vif-deleted", "tag": "097a4ee4-babc-4ec6-806d-f7b20f748046"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:50.196424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-21d0c862-fd09-4f9c-82cc-6e1130a29386 req-aab3cb3b-ecb3-4064-b588-85b942bae48b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.197474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-21d0c862-fd09-4f9c-82cc-6e1130a29386 req-aab3cb3b-ecb3-4064-b588-85b942bae48b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.197937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-21d0c862-fd09-4f9c-82cc-6e1130a29386 req-aab3cb3b-ecb3-4064-b588-85b942bae48b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.210781 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-21d0c862-fd09-4f9c-82cc-6e1130a29386 req-aab3cb3b-ecb3-4064-b588-85b942bae48b service nova] Creating event network-vif-deleted:097a4ee4-babc-4ec6-806d-f7b20f748046 for instance a77ba20d-cd31-4f68-ab97-edd11f22a708 on n-h1-860864-3 Oct 11 19:42:50.216641 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-21d0c862-fd09-4f9c-82cc-6e1130a29386 req-aab3cb3b-ecb3-4064-b588-85b942bae48b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041888 Oct 11 19:42:50.217541 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 83/150] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:50.223177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ccf5471c-bc6d-4380-9e9a-b648810c3410 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:50.227096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccf5471c-bc6d-4380-9e9a-b648810c3410 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.227600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccf5471c-bc6d-4380-9e9a-b648810c3410 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.228839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccf5471c-bc6d-4380-9e9a-b648810c3410 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.229798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccf5471c-bc6d-4380-9e9a-b648810c3410 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.230391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccf5471c-bc6d-4380-9e9a-b648810c3410 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.231011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccf5471c-bc6d-4380-9e9a-b648810c3410 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.258176 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ccf5471c-bc6d-4380-9e9a-b648810c3410 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-860864-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.038917 Oct 11 19:42:50.259204 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 84/151] 10.222.0.27 () {58 vars in 1194 bytes} [Tue Oct 11 19:42:50 2022] GET /compute/v2.1/os-services?host=n-d-860864-3&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:42:50.265326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5daf9930-4521-42f1-8ab9-d0956783e4dd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:50.277267 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5daf9930-4521-42f1-8ab9-d0956783e4dd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1317 microversion: 2.1 time: 0.387604 Oct 11 19:42:50.279093 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 68/152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:49 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:50.280280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dfbda3e2-de37-45ca-9414-24741b64797a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:50.284916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a668345-2e2b-4e68-bff8-835af76acf55 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:50.286417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dfbda3e2-de37-45ca-9414-24741b64797a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:50.298359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfbda3e2-de37-45ca-9414-24741b64797a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.299241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a668345-2e2b-4e68-bff8-835af76acf55 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.299943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfbda3e2-de37-45ca-9414-24741b64797a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.300647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a668345-2e2b-4e68-bff8-835af76acf55 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.301276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfbda3e2-de37-45ca-9414-24741b64797a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.301907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a668345-2e2b-4e68-bff8-835af76acf55 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.303168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfbda3e2-de37-45ca-9414-24741b64797a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.304075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a668345-2e2b-4e68-bff8-835af76acf55 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.304710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfbda3e2-de37-45ca-9414-24741b64797a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.305312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a668345-2e2b-4e68-bff8-835af76acf55 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.306070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfbda3e2-de37-45ca-9414-24741b64797a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.306950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a668345-2e2b-4e68-bff8-835af76acf55 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.349962 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a668345-2e2b-4e68-bff8-835af76acf55 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.068511 Oct 11 19:42:50.351189 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 69/153] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:42:50 2022] GET /compute/v2.1/os-services => generated 965 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:50.363857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b0e9cf05-c886-466f-8938-e82425a26806 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:50.377818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e9cf05-c886-466f-8938-e82425a26806 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.378370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e9cf05-c886-466f-8938-e82425a26806 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.378844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e9cf05-c886-466f-8938-e82425a26806 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.379742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e9cf05-c886-466f-8938-e82425a26806 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.380337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e9cf05-c886-466f-8938-e82425a26806 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.380908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e9cf05-c886-466f-8938-e82425a26806 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.383617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:50.399040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=31,nova_cell0:UPDATE=7 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:50.422072 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b0e9cf05-c886-466f-8938-e82425a26806 tempest-ServicesAdminNegativeTestJSON-1979249013 tempest-ServicesAdminNegativeTestJSON-1979249013-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.061639 Oct 11 19:42:50.423307 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 70/154] 10.222.0.27 () {58 vars in 1198 bytes} [Tue Oct 11 19:42:50 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:42:50.492183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dfbda3e2-de37-45ca-9414-24741b64797a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:50.506484 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dfbda3e2-de37-45ca-9414-24741b64797a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 200 len: 1324 microversion: 2.1 time: 0.246026 Oct 11 19:42:50.507220 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 85/155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:50 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:50.580375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1804bc54-2b40-427d-af45-5b8b161ac417 tempest-ServicesAdminNegativeTestJSON-222805634 tempest-ServicesAdminNegativeTestJSON-222805634-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:50.585081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1804bc54-2b40-427d-af45-5b8b161ac417 tempest-ServicesAdminNegativeTestJSON-222805634 tempest-ServicesAdminNegativeTestJSON-222805634-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '873214c2d53e4c59bb0148581e0c90da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d13807c108401fb92618e424fd2a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1804bc54-2b40-427d-af45-5b8b161ac417 tempest-ServicesAdminNegativeTestJSON-222805634 tempest-ServicesAdminNegativeTestJSON-222805634-project] Request method failure captured: Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcc28wvxVF4nN8bH3kjqiETIOG_kDTJlnWS5IugU1T7TktDmaTf2Yb5teHNhcTnJeh_MNQkjqP43kvDdXJkrJhPFJ35cUC_gVdWibPho4vkaJkGOE3DeyCQek9GKl0jmdlBROxmKnR93MGhzXoCSrEmJgH5ktOYXit-iUziXNK3cMvw Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 95d13807c108401fb92618e424fd2a63 Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-222805634 Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:42:50.594747 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/95d13807c108401fb92618e424fd2a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_95d13807c108401fb92618e424fd2a63", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95d13807c108401fb92618e424fd2a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95d13807c108401fb92618e424fd2a63"}]}] Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-222805634 Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 95d13807c108401fb92618e424fd2a63 Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-222805634 Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServicesAdminNegativeTestJSON-222805634-project Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 873214c2d53e4c59bb0148581e0c90da Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-222805634-project Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 19:42:50.595909 n-d-860864-3 devstack@n-api.service[126956]: action_args: {} Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:42:50.596696 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 19:42:50.597943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:50.599739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1804bc54-2b40-427d-af45-5b8b161ac417 tempest-ServicesAdminNegativeTestJSON-222805634 tempest-ServicesAdminNegativeTestJSON-222805634-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:50.600460 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1804bc54-2b40-427d-af45-5b8b161ac417 tempest-ServicesAdminNegativeTestJSON-222805634 tempest-ServicesAdminNegativeTestJSON-222805634-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.162404 Oct 11 19:42:50.605604 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 71/156] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:42:50 2022] GET /compute/v2.1/os-services => generated 112 bytes in 170 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:50.808982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8068f915-7b10-49cc-8f11-461733fae604 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:50.809980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8068f915-7b10-49cc-8f11-461733fae604 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:50.820187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8068f915-7b10-49cc-8f11-461733fae604 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.825619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8068f915-7b10-49cc-8f11-461733fae604 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.826545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8068f915-7b10-49cc-8f11-461733fae604 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:50.828555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8068f915-7b10-49cc-8f11-461733fae604 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:50.829231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8068f915-7b10-49cc-8f11-461733fae604 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:50.829842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8068f915-7b10-49cc-8f11-461733fae604 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:51.039790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9a4c9424-dc0e-46a7-8988-2a76dfc2e22e req-c069cf53-29de-4912-be12-f088ea5b3e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f392b558-6079-4c4d-88bd-a50aa499dce6", "tag": "c17e735a-c9a1-4253-b84d-b15594905be3"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:51.063091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9a4c9424-dc0e-46a7-8988-2a76dfc2e22e req-c069cf53-29de-4912-be12-f088ea5b3e06 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:51.065541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9a4c9424-dc0e-46a7-8988-2a76dfc2e22e req-c069cf53-29de-4912-be12-f088ea5b3e06 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:51.067188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9a4c9424-dc0e-46a7-8988-2a76dfc2e22e req-c069cf53-29de-4912-be12-f088ea5b3e06 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:51.101254 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9a4c9424-dc0e-46a7-8988-2a76dfc2e22e req-c069cf53-29de-4912-be12-f088ea5b3e06 service nova] Creating event network-changed:c17e735a-c9a1-4253-b84d-b15594905be3 for instance f392b558-6079-4c4d-88bd-a50aa499dce6 on n-h2-860864-3 Oct 11 19:42:51.107918 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9a4c9424-dc0e-46a7-8988-2a76dfc2e22e req-c069cf53-29de-4912-be12-f088ea5b3e06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077542 Oct 11 19:42:51.108991 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 72/157] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 11 19:42:51.272937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8068f915-7b10-49cc-8f11-461733fae604 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:51.285626 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8068f915-7b10-49cc-8f11-461733fae604 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1493 microversion: 2.1 time: 0.482514 Oct 11 19:42:51.286493 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 86/158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:50 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1493 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:51.292757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-81f1ff55-478b-4b93-bbf9-07c63e75af6a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:51.293590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-81f1ff55-478b-4b93-bbf9-07c63e75af6a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:51.300346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81f1ff55-478b-4b93-bbf9-07c63e75af6a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:51.301476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81f1ff55-478b-4b93-bbf9-07c63e75af6a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:51.302195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81f1ff55-478b-4b93-bbf9-07c63e75af6a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:51.303366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81f1ff55-478b-4b93-bbf9-07c63e75af6a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:51.304355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81f1ff55-478b-4b93-bbf9-07c63e75af6a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:51.305010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81f1ff55-478b-4b93-bbf9-07c63e75af6a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:51.425555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1103069553", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "12e7d5a8-d39a-440c-a1be-ed5e1c015008"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:51.500287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] validate_networks() for [('12e7d5a8-d39a-440c-a1be-ed5e1c015008', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:42:51.783428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-81f1ff55-478b-4b93-bbf9-07c63e75af6a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:51.794686 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-81f1ff55-478b-4b93-bbf9-07c63e75af6a tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1386 microversion: 2.1 time: 0.506727 Oct 11 19:42:51.806717 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 87/159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:51 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1386 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:51.814418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8e864aea-905b-4d00-9359-362e20205512 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:51.815198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8e864aea-905b-4d00-9359-362e20205512 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:51.831929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e864aea-905b-4d00-9359-362e20205512 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:51.832587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e864aea-905b-4d00-9359-362e20205512 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:51.833383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e864aea-905b-4d00-9359-362e20205512 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:51.834905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e864aea-905b-4d00-9359-362e20205512 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:51.835344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e864aea-905b-4d00-9359-362e20205512 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:51.835867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e864aea-905b-4d00-9359-362e20205512 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:52.509820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8e864aea-905b-4d00-9359-362e20205512 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:52.523359 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8e864aea-905b-4d00-9359-362e20205512 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1317 microversion: 2.1 time: 0.715141 Oct 11 19:42:52.523948 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 88/160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:51 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1317 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:52.551214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:52.551847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:52.571670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:52.572359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:52.573304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:52.573841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:52.574638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:52.575169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:52.627452 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] HTTP exception thrown: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Request method failure captured: Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 HTTP/1.1 Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccNMJV2nreYD35izhrGrkspU2eYbEw7YaUmAZRRkdeZh6R88h8rTc8SefWKL257WyLfe3MO7Q1w7pnoa9xH5zGZ_s5YPWrzXwSRjHbPaFlwjCu3Tth-dNBTaOh55HrOU2u4aSemJmU_oFKmyJhfqxmbNBPIZZadRFbb_XAgpyRE2uQ Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:42:52.634758 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9ed7b56298642c58cf65003f2853902", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}] Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 2a07205057b54dc5a85ec740783c3dab Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:42:52.636170 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a77ba20d-cd31-4f68-ab97-edd11f22a708'} Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:52.637067 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:42:52.638412 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:42:52.639626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Returning 404 to user: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:52.639626 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-71fe2ccd-36e3-42c0-9baa-85a4153f0ccf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 404 len: 111 microversion: 2.1 time: 0.102588 Oct 11 19:42:52.642831 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 89/161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:52 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:52.656790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8384a0cb-529e-444e-9535-fa53ebabd8a5 req-c2cbbbb0-e185-4c6c-b2f9-cec3386e231d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27956e70-3a33-46ba-98c8-f9dbfe444d2e", "tag": "a8198729-0bcb-443a-8dbd-3e7eac134b9d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:52.691838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8384a0cb-529e-444e-9535-fa53ebabd8a5 req-c2cbbbb0-e185-4c6c-b2f9-cec3386e231d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:52.692317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8384a0cb-529e-444e-9535-fa53ebabd8a5 req-c2cbbbb0-e185-4c6c-b2f9-cec3386e231d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:52.692747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8384a0cb-529e-444e-9535-fa53ebabd8a5 req-c2cbbbb0-e185-4c6c-b2f9-cec3386e231d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:52.731976 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8384a0cb-529e-444e-9535-fa53ebabd8a5 req-c2cbbbb0-e185-4c6c-b2f9-cec3386e231d service nova] Creating event network-changed:a8198729-0bcb-443a-8dbd-3e7eac134b9d for instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e on n-h2-860864-3 Oct 11 19:42:52.740442 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8384a0cb-529e-444e-9535-fa53ebabd8a5 req-c2cbbbb0-e185-4c6c-b2f9-cec3386e231d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096167 Oct 11 19:42:52.742815 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 90/162] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:52.753314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-580b75c7-80a9-4085-b2c9-0fec1e0285fc tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:52.759707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-580b75c7-80a9-4085-b2c9-0fec1e0285fc tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:52.776447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580b75c7-80a9-4085-b2c9-0fec1e0285fc tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:52.777079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580b75c7-80a9-4085-b2c9-0fec1e0285fc tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:52.777528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580b75c7-80a9-4085-b2c9-0fec1e0285fc tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:52.780114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580b75c7-80a9-4085-b2c9-0fec1e0285fc tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:52.780593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580b75c7-80a9-4085-b2c9-0fec1e0285fc tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:52.781029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580b75c7-80a9-4085-b2c9-0fec1e0285fc tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:53.192032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-580b75c7-80a9-4085-b2c9-0fec1e0285fc tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5502bee89642e5a5779b6f1f540fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62e7d63cd6c4318a4b79659c96ef9ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:53.201765 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-580b75c7-80a9-4085-b2c9-0fec1e0285fc tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 200 len: 1322 microversion: 2.1 time: 0.454396 Oct 11 19:42:53.202359 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 91/163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:52 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:53.218172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21d5002f-2e78-45de-99ba-91aa2c10177f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:53.219373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-21d5002f-2e78-45de-99ba-91aa2c10177f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:53.238558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d5002f-2e78-45de-99ba-91aa2c10177f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:53.239208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d5002f-2e78-45de-99ba-91aa2c10177f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:53.244621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d5002f-2e78-45de-99ba-91aa2c10177f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:53.245704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d5002f-2e78-45de-99ba-91aa2c10177f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:53.248950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d5002f-2e78-45de-99ba-91aa2c10177f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:53.251670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d5002f-2e78-45de-99ba-91aa2c10177f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:53.293865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:42:53.294264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:42:53.294545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:42:53.295287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:42:53.296006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:42:53.335708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:53.339468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:53.340159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:53.340926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:53.344442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:53.344938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:53.427714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Getting quotas for project 947af1a9d24f4e19a59ec820ba1a65e4. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:42:53.447757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Getting quotas for user 4e2460b9a8f34662b802709a91907510 and project 947af1a9d24f4e19a59ec820ba1a65e4. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:42:53.466912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:42:53.469576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:42:53.584767 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c9b669c-bd2d-4f9f-a0fb-175f29ced422 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.471831 Oct 11 19:42:53.598852 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 73/164] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:42:53.613776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1074366706", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:53.739878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:42:53.839652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-21d5002f-2e78-45de-99ba-91aa2c10177f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:53.877606 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21d5002f-2e78-45de-99ba-91aa2c10177f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1386 microversion: 2.1 time: 0.652565 Oct 11 19:42:53.895724 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 92/165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:53 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1386 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:53.902470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f75917c8-4428-4fe4-969d-4d03d753e218 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:53.903479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f75917c8-4428-4fe4-969d-4d03d753e218 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:53.939238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75917c8-4428-4fe4-969d-4d03d753e218 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:53.939933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75917c8-4428-4fe4-969d-4d03d753e218 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:53.940501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75917c8-4428-4fe4-969d-4d03d753e218 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:53.942828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75917c8-4428-4fe4-969d-4d03d753e218 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:53.944194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75917c8-4428-4fe4-969d-4d03d753e218 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:53.945318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75917c8-4428-4fe4-969d-4d03d753e218 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:54.341472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:42:54.341998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:42:54.342670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:42:54.343249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:42:54.343807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:42:54.370118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:54.371268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:54.371777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:54.372818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:54.373294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:54.376442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:54.425548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Getting quotas for project c9ed7b56298642c58cf65003f2853902. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:42:54.432091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Getting quotas for user 2a07205057b54dc5a85ec740783c3dab and project c9ed7b56298642c58cf65003f2853902. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:42:54.437565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f75917c8-4428-4fe4-969d-4d03d753e218 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:54.453971 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f75917c8-4428-4fe4-969d-4d03d753e218 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1317 microversion: 2.1 time: 0.556809 Oct 11 19:42:54.456823 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 93/166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:53 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:54.468917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ab0773ac-4af0-4b93-9a55-055c3a9216b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:54.471428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ab0773ac-4af0-4b93-9a55-055c3a9216b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:54.491405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:42:54.497109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:42:54.638292 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a5e72a2a-a825-462a-bf72-a6fc46cc8553 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037050 Oct 11 19:42:54.655005 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 74/167] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:42:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:42:54.660236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:54.662108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:54.672430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:54.673148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:54.673795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:54.675763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:54.676433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:54.677073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:54.693337 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] HTTP exception thrown: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Request method failure captured: Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f HTTP/1.1 Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccNQIipuFQQjFpjkvm4N7AtWq2-rP09KfBu52edmE51_WK2ampAK-cIRKSt4JPhTFWdOzAYrKh9KkASyvt6vZHSJP9gT_vSai10MJrw51S5HjLO1BjHnTxO1T-4KzhiiSEC2qz-OItQ8AlFkYQzWu0Svk5aFk3ublcfrPuUm4xOYR8 Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: d62e7d63cd6c4318a4b79659c96ef9ef Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AggregatesAdminTestJSON-761719749 Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:42:54.697377 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d62e7d63cd6c4318a4b79659c96ef9ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d62e7d63cd6c4318a4b79659c96ef9ef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d62e7d63cd6c4318a4b79659c96ef9ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d62e7d63cd6c4318a4b79659c96ef9ef"}]}] Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AggregatesAdminTestJSON-761719749 Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: d62e7d63cd6c4318a4b79659c96ef9ef Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-761719749 Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AggregatesAdminTestJSON-761719749-project Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 1a5502bee89642e5a5779b6f1f540fc4 Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AggregatesAdminTestJSON-761719749-project Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:42:54.698571 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'c488615e-e44e-41d8-8632-7428d37ce48f'} Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:42:54.699480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:42:54.700717 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:42:54.704436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Returning 404 to user: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:42:54.708867 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-93040452-a40a-4d36-b0a9-1dfcb25f451e tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 404 len: 111 microversion: 2.1 time: 0.051434 Oct 11 19:42:54.713157 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 75/168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:54 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:42:54.728221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fdb6056d-8017-4714-aab0-98ec7e8637cb tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:54.731523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fdb6056d-8017-4714-aab0-98ec7e8637cb tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:54.736913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ab0773ac-4af0-4b93-9a55-055c3a9216b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:54.744761 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ab0773ac-4af0-4b93-9a55-055c3a9216b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1211 microversion: 2.1 time: 0.285517 Oct 11 19:42:54.745353 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 94/169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:54 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1211 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:54.766103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:54.770144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-48e20c45-84f7-4cd0-b2d1-63e59c3dc5a5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:54.819778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48e20c45-84f7-4cd0-b2d1-63e59c3dc5a5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:54.820274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48e20c45-84f7-4cd0-b2d1-63e59c3dc5a5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:54.820707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48e20c45-84f7-4cd0-b2d1-63e59c3dc5a5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:55.000077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fdb6056d-8017-4714-aab0-98ec7e8637cb tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:55.012957 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fdb6056d-8017-4714-aab0-98ec7e8637cb tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1220 microversion: 2.1 time: 0.296598 Oct 11 19:42:55.014553 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 76/170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:54 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1220 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:55.028151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fa27e7c1-0f1d-4c1f-af78-933b297901e7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:55.055256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fa27e7c1-0f1d-4c1f-af78-933b297901e7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:55.095429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa27e7c1-0f1d-4c1f-af78-933b297901e7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:55.101270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa27e7c1-0f1d-4c1f-af78-933b297901e7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:55.102615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa27e7c1-0f1d-4c1f-af78-933b297901e7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:55.104424 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-48e20c45-84f7-4cd0-b2d1-63e59c3dc5a5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 297 microversion: 2.1 time: 0.336818 Oct 11 19:42:55.105138 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 95/171] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 11 19:42:54 2022] POST /compute/v2.1/os-aggregates/4/action => generated 297 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:55.106620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa27e7c1-0f1d-4c1f-af78-933b297901e7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:55.109577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa27e7c1-0f1d-4c1f-af78-933b297901e7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:55.110248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa27e7c1-0f1d-4c1f-af78-933b297901e7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:55.116861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6976b44e-ae62-4506-bbc1-e1596eba6e61 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:55.170281 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6976b44e-ae62-4506-bbc1-e1596eba6e61 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.056613 Oct 11 19:42:55.174772 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 96/172] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:55 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:42:55.188353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-28c979e0-8358-4472-883d-9cd5815697f3 req-311691a2-0e49-4e56-a973-dcaa72a9fa14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c488615e-e44e-41d8-8632-7428d37ce48f", "name": "network-vif-deleted", "tag": "236ea2ce-3953-487a-a1e5-ce4648623dcc"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:55.216263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-28c979e0-8358-4472-883d-9cd5815697f3 req-311691a2-0e49-4e56-a973-dcaa72a9fa14 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:55.222186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-28c979e0-8358-4472-883d-9cd5815697f3 req-311691a2-0e49-4e56-a973-dcaa72a9fa14 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:55.224611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-28c979e0-8358-4472-883d-9cd5815697f3 req-311691a2-0e49-4e56-a973-dcaa72a9fa14 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:55.242163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:55.292416 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-28c979e0-8358-4472-883d-9cd5815697f3 req-311691a2-0e49-4e56-a973-dcaa72a9fa14 service nova] Creating event network-vif-deleted:236ea2ce-3953-487a-a1e5-ce4648623dcc for instance c488615e-e44e-41d8-8632-7428d37ce48f on n-h1-860864-3 Oct 11 19:42:55.323037 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-28c979e0-8358-4472-883d-9cd5815697f3 req-311691a2-0e49-4e56-a973-dcaa72a9fa14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146264 Oct 11 19:42:55.327448 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 97/173] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:55.354679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5ceecafb-91b8-4cc5-9368-c6d8004f7226 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-157036771"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:55.365349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-5ceecafb-91b8-4cc5-9368-c6d8004f7226 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Generated uuid 089bee42-8f1d-4b1b-b00c-0280522d300e for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:55.455889 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5ceecafb-91b8-4cc5-9368-c6d8004f7226 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.123960 Oct 11 19:42:55.460388 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 98/174] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:55.484906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-232b5d69-889a-43ee-ad4b-04223d68078d tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:55.525899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-232b5d69-889a-43ee-ad4b-04223d68078d tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:55.528986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-232b5d69-889a-43ee-ad4b-04223d68078d tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:55.529706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-232b5d69-889a-43ee-ad4b-04223d68078d tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:55.665722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fa27e7c1-0f1d-4c1f-af78-933b297901e7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:55.684461 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fa27e7c1-0f1d-4c1f-af78-933b297901e7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1386 microversion: 2.1 time: 0.665982 Oct 11 19:42:55.686795 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 77/175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:55 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1386 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:55.701933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5ad9d696-1f0f-402e-9191-abb67a35ccd8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:55.703018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5ad9d696-1f0f-402e-9191-abb67a35ccd8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:55.724879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ad9d696-1f0f-402e-9191-abb67a35ccd8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:55.728105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ad9d696-1f0f-402e-9191-abb67a35ccd8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:55.729061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ad9d696-1f0f-402e-9191-abb67a35ccd8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:55.731496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ad9d696-1f0f-402e-9191-abb67a35ccd8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:55.732379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ad9d696-1f0f-402e-9191-abb67a35ccd8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:55.733785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ad9d696-1f0f-402e-9191-abb67a35ccd8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:55.823623 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-232b5d69-889a-43ee-ad4b-04223d68078d tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.355165 Oct 11 19:42:55.824539 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 99/176] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 11 19:42:55 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:55.829439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cc31161e-eea7-4815-9d1c-1d4f4fde6822 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:55.830181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cc31161e-eea7-4815-9d1c-1d4f4fde6822 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:55.845604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc31161e-eea7-4815-9d1c-1d4f4fde6822 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:55.846111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc31161e-eea7-4815-9d1c-1d4f4fde6822 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:55.846585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc31161e-eea7-4815-9d1c-1d4f4fde6822 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:55.850785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc31161e-eea7-4815-9d1c-1d4f4fde6822 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:55.851460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc31161e-eea7-4815-9d1c-1d4f4fde6822 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:55.851851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc31161e-eea7-4815-9d1c-1d4f4fde6822 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:56.142234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cc31161e-eea7-4815-9d1c-1d4f4fde6822 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:56.157971 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cc31161e-eea7-4815-9d1c-1d4f4fde6822 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1269 microversion: 2.1 time: 0.330666 Oct 11 19:42:56.160638 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 100/177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:55 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1269 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:56.172164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f950b740-98f1-4ba8-bfa7-31bde7d1f987 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:56.192072 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f950b740-98f1-4ba8-bfa7-31bde7d1f987 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.027662 Oct 11 19:42:56.195394 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 101/178] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 11 19:42:56 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:56.202770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e4bfd0a0-0824-4876-9acf-5efe6decebf0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:56.204361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e4bfd0a0-0824-4876-9acf-5efe6decebf0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:56.214280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4bfd0a0-0824-4876-9acf-5efe6decebf0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:56.215785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4bfd0a0-0824-4876-9acf-5efe6decebf0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:56.216541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4bfd0a0-0824-4876-9acf-5efe6decebf0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:56.217599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4bfd0a0-0824-4876-9acf-5efe6decebf0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:56.219231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4bfd0a0-0824-4876-9acf-5efe6decebf0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:56.219961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4bfd0a0-0824-4876-9acf-5efe6decebf0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:56.550661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4bfd0a0-0824-4876-9acf-5efe6decebf0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:56.558391 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e4bfd0a0-0824-4876-9acf-5efe6decebf0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1224 microversion: 2.1 time: 0.360831 Oct 11 19:42:56.571487 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 102/179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:56 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1224 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:56.571585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5ad9d696-1f0f-402e-9191-abb67a35ccd8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:56.578420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2316e228-bcf5-4f72-b579-0521bcf511b5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:56.580035 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5ad9d696-1f0f-402e-9191-abb67a35ccd8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1317 microversion: 2.1 time: 0.890820 Oct 11 19:42:56.584549 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 78/180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:55 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1317 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:56.611942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2316e228-bcf5-4f72-b579-0521bcf511b5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:56.612450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2316e228-bcf5-4f72-b579-0521bcf511b5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:56.613200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2316e228-bcf5-4f72-b579-0521bcf511b5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:56.716937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2372f886-4351-4f09-afbb-9f92b0150f16 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:56.718436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2372f886-4351-4f09-afbb-9f92b0150f16 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:56.739283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2372f886-4351-4f09-afbb-9f92b0150f16 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:56.741935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2372f886-4351-4f09-afbb-9f92b0150f16 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:56.742670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2372f886-4351-4f09-afbb-9f92b0150f16 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:56.745006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2372f886-4351-4f09-afbb-9f92b0150f16 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:56.746142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2372f886-4351-4f09-afbb-9f92b0150f16 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:56.748541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2372f886-4351-4f09-afbb-9f92b0150f16 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:57.103233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2372f886-4351-4f09-afbb-9f92b0150f16 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:57.115328 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2372f886-4351-4f09-afbb-9f92b0150f16 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1386 microversion: 2.1 time: 0.406167 Oct 11 19:42:57.116840 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 79/181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:56 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1386 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:57.187814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13d3e849-c07e-4ed8-ab53-69b096ee285f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:57.188508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-13d3e849-c07e-4ed8-ab53-69b096ee285f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:57.195654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13d3e849-c07e-4ed8-ab53-69b096ee285f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:57.199315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13d3e849-c07e-4ed8-ab53-69b096ee285f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:57.200878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13d3e849-c07e-4ed8-ab53-69b096ee285f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:57.203264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13d3e849-c07e-4ed8-ab53-69b096ee285f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:57.205709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13d3e849-c07e-4ed8-ab53-69b096ee285f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:57.206299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13d3e849-c07e-4ed8-ab53-69b096ee285f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:57.258332 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2316e228-bcf5-4f72-b579-0521bcf511b5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.686788 Oct 11 19:42:57.259064 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 103/182] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 11 19:42:56 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:57.284495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2bd1f895-7df4-42f2-ad77-930ecfb89232 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:57.339485 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2bd1f895-7df4-42f2-ad77-930ecfb89232 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.066441 Oct 11 19:42:57.341959 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 104/183] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:42:57 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:42:57.361571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-255504b6-7c9a-43c5-80c6-47e509eecb7a tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1525479423"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:57.373232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-255504b6-7c9a-43c5-80c6-47e509eecb7a tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Generated uuid 77e5154b-05cc-4c08-83c3-74e8fc0ad759 for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:57.450928 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-255504b6-7c9a-43c5-80c6-47e509eecb7a tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082376 Oct 11 19:42:57.455732 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 105/184] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:57.473926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9dc3160-578c-4b0c-be9b-1d4e68d163b0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:57.494215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9dc3160-578c-4b0c-be9b-1d4e68d163b0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:57.496455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9dc3160-578c-4b0c-be9b-1d4e68d163b0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:57.497388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9dc3160-578c-4b0c-be9b-1d4e68d163b0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:57.738965 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9dc3160-578c-4b0c-be9b-1d4e68d163b0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.274835 Oct 11 19:42:57.739975 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 106/185] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 19:42:57 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:57.750231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b1ea300b-64fc-4352-a432-d7806b4304ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:57.751483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b1ea300b-64fc-4352-a432-d7806b4304ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:57.772830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13d3e849-c07e-4ed8-ab53-69b096ee285f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:57.779158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1ea300b-64fc-4352-a432-d7806b4304ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:57.782167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1ea300b-64fc-4352-a432-d7806b4304ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:57.783084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1ea300b-64fc-4352-a432-d7806b4304ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:57.786041 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13d3e849-c07e-4ed8-ab53-69b096ee285f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1269 microversion: 2.1 time: 0.601908 Oct 11 19:42:57.789275 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 80/186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:57 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1269 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:57.792497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1ea300b-64fc-4352-a432-d7806b4304ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:57.793004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1ea300b-64fc-4352-a432-d7806b4304ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:57.794584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1ea300b-64fc-4352-a432-d7806b4304ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:57.800465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5313dac-4f67-431f-990f-c5f34ce86fb5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:57.802872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f5313dac-4f67-431f-990f-c5f34ce86fb5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:57.815570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5313dac-4f67-431f-990f-c5f34ce86fb5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:57.820757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5313dac-4f67-431f-990f-c5f34ce86fb5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:57.821663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5313dac-4f67-431f-990f-c5f34ce86fb5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:57.822631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5313dac-4f67-431f-990f-c5f34ce86fb5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:57.823290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5313dac-4f67-431f-990f-c5f34ce86fb5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:57.823929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5313dac-4f67-431f-990f-c5f34ce86fb5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:58.007626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b1ea300b-64fc-4352-a432-d7806b4304ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:58.018226 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b1ea300b-64fc-4352-a432-d7806b4304ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1278 microversion: 2.1 time: 0.277111 Oct 11 19:42:58.019422 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 107/187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:57 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1278 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:58.025509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1362d665-b70c-4bcd-aff6-16917a655c67 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:58.033113 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1362d665-b70c-4bcd-aff6-16917a655c67 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.012290 Oct 11 19:42:58.041801 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 108/188] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:42:58 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:58.212652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f5313dac-4f67-431f-990f-c5f34ce86fb5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:58.253006 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5313dac-4f67-431f-990f-c5f34ce86fb5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1317 microversion: 2.1 time: 0.461032 Oct 11 19:42:58.263392 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 81/189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:57 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:58.277326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3cf360f3-0875-4754-b111-408fa48ec5c0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860864-3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:58.321649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6086d185-856f-46a3-86f5-3099094656a3 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:58.328449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cf360f3-0875-4754-b111-408fa48ec5c0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:58.328957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cf360f3-0875-4754-b111-408fa48ec5c0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:58.329396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cf360f3-0875-4754-b111-408fa48ec5c0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:58.334497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:58.338388 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6086d185-856f-46a3-86f5-3099094656a3 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.294606 Oct 11 19:42:58.339289 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 109/190] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:42:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:58.349652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e7a4569-6c59-4ecc-bb50-af4ba753caf7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:58.351580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e7a4569-6c59-4ecc-bb50-af4ba753caf7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:58.367431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e7a4569-6c59-4ecc-bb50-af4ba753caf7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:58.370325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e7a4569-6c59-4ecc-bb50-af4ba753caf7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:58.370982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e7a4569-6c59-4ecc-bb50-af4ba753caf7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:58.371882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e7a4569-6c59-4ecc-bb50-af4ba753caf7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:58.373304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e7a4569-6c59-4ecc-bb50-af4ba753caf7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:58.375018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e7a4569-6c59-4ecc-bb50-af4ba753caf7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:58.550617 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3cf360f3-0875-4754-b111-408fa48ec5c0 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.285362 Oct 11 19:42:58.551277 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 82/191] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 19:42:58 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:58.573310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-58b11795-94c3-4d5c-a968-8c96122ae18f tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:58.649583 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-58b11795-94c3-4d5c-a968-8c96122ae18f tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3073 microversion: 2.1 time: 0.086727 Oct 11 19:42:58.653022 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 83/192] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 19:42:58 2022] GET /compute/v2.1/flavors => generated 3073 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:58.659332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a089840c-4855-4231-b37b-5fa85ee23830 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:58.693989 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a089840c-4855-4231-b37b-5fa85ee23830 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.039360 Oct 11 19:42:58.695175 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 84/193] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:42:58 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:42:58.705661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d50510e-43ce-455f-b44d-d7a30f775b8c tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:58.718766 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8d50510e-43ce-455f-b44d-d7a30f775b8c tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021570 Oct 11 19:42:58.719352 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 85/194] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:42:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:58.724112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e6818ab3-780b-46ff-95ab-6fcaf1dc0679 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2087772259"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:58.729403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.aggregate [None req-e6818ab3-780b-46ff-95ab-6fcaf1dc0679 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Generated uuid cc6a3e80-2a4c-42d7-ba02-2e2754fe4374 for aggregate {{(pid=126956) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:42:58.761191 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e6818ab3-780b-46ff-95ab-6fcaf1dc0679 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040510 Oct 11 19:42:58.762952 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 86/195] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:58.770265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-14eb9b05-8e0b-4077-ba9f-e7ca34b6df56 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:58.787607 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-14eb9b05-8e0b-4077-ba9f-e7ca34b6df56 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022774 Oct 11 19:42:58.789196 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 87/196] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:42:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:58.796145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f29eda6e-e174-4d22-b057-d408e162a893 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860864-3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:58.823682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f29eda6e-e174-4d22-b057-d408e162a893 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:58.824535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f29eda6e-e174-4d22-b057-d408e162a893 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:58.825134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f29eda6e-e174-4d22-b057-d408e162a893 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:58.995399 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f29eda6e-e174-4d22-b057-d408e162a893 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.203041 Oct 11 19:42:58.997541 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 88/197] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 19:42:58 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:59.004421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eab216cb-d4c9-4550-b002-8cff3841a780 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:59.043165 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eab216cb-d4c9-4550-b002-8cff3841a780 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.043142 Oct 11 19:42:59.044412 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 89/198] 10.222.0.27 () {58 vars in 1165 bytes} [Tue Oct 11 19:42:58 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:59.049842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ad4fdad-1e83-4d0b-b221-e7ddef606892 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:59.050696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ad4fdad-1e83-4d0b-b221-e7ddef606892 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:59.059511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad4fdad-1e83-4d0b-b221-e7ddef606892 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:59.060235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad4fdad-1e83-4d0b-b221-e7ddef606892 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:59.061113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad4fdad-1e83-4d0b-b221-e7ddef606892 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:59.062160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad4fdad-1e83-4d0b-b221-e7ddef606892 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:59.062973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad4fdad-1e83-4d0b-b221-e7ddef606892 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:59.063542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad4fdad-1e83-4d0b-b221-e7ddef606892 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:59.088592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e7a4569-6c59-4ecc-bb50-af4ba753caf7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:59.097139 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e7a4569-6c59-4ecc-bb50-af4ba753caf7 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1386 microversion: 2.1 time: 0.756818 Oct 11 19:42:59.103316 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 110/199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:58 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1386 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:59.114907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2a79110d-4f4f-4e4d-8044-4897d8ef0590 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:42:59.137991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a79110d-4f4f-4e4d-8044-4897d8ef0590 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:59.138936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a79110d-4f4f-4e4d-8044-4897d8ef0590 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:59.140254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a79110d-4f4f-4e4d-8044-4897d8ef0590 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:59.396961 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2a79110d-4f4f-4e4d-8044-4897d8ef0590 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.292140 Oct 11 19:42:59.399565 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 111/200] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 19:42:59 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:59.406056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-258ad4e1-fd27-4d30-a8aa-09fd133b37f9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:59.408322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-258ad4e1-fd27-4d30-a8aa-09fd133b37f9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:59.416256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-258ad4e1-fd27-4d30-a8aa-09fd133b37f9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:59.417368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-258ad4e1-fd27-4d30-a8aa-09fd133b37f9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:59.418082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-258ad4e1-fd27-4d30-a8aa-09fd133b37f9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:59.419181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-258ad4e1-fd27-4d30-a8aa-09fd133b37f9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:59.419875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-258ad4e1-fd27-4d30-a8aa-09fd133b37f9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:59.420862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-258ad4e1-fd27-4d30-a8aa-09fd133b37f9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:59.821859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7ad4fdad-1e83-4d0b-b221-e7ddef606892 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:59.832177 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ad4fdad-1e83-4d0b-b221-e7ddef606892 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1311 microversion: 2.1 time: 0.786504 Oct 11 19:42:59.849762 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 90/201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:59 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1311 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:59.855835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-258ad4e1-fd27-4d30-a8aa-09fd133b37f9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:42:59.856159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1a27e728-b248-4bc7-ac4d-82766a41ef12 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:59.864467 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-258ad4e1-fd27-4d30-a8aa-09fd133b37f9 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1320 microversion: 2.1 time: 0.463465 Oct 11 19:42:59.865997 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 112/202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:59 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1320 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:42:59.870495 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1a27e728-b248-4bc7-ac4d-82766a41ef12 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018914 Oct 11 19:42:59.872097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-021a846e-0baa-441b-8350-25d0bdb89c81 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:59.872979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-021a846e-0baa-441b-8350-25d0bdb89c81 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:42:59.873979 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 91/203] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:42:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:42:59.881024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:42:59.886140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9529b416-2318-4fa8-8afa-404192e79dd6 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:59.896343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021a846e-0baa-441b-8350-25d0bdb89c81 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:59.897342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021a846e-0baa-441b-8350-25d0bdb89c81 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:59.898031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021a846e-0baa-441b-8350-25d0bdb89c81 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:59.899132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021a846e-0baa-441b-8350-25d0bdb89c81 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:42:59.899799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021a846e-0baa-441b-8350-25d0bdb89c81 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:42:59.900424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021a846e-0baa-441b-8350-25d0bdb89c81 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:42:59.935553 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9529b416-2318-4fa8-8afa-404192e79dd6 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.060498 Oct 11 19:42:59.943217 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 92/204] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:42:59 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:42:59.949817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-51967b38-b4cd-4ba2-8ad5-e10a870fec92 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:42:59.998906 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-51967b38-b4cd-4ba2-8ad5-e10a870fec92 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.054220 Oct 11 19:42:59.999799 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 93/205] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Oct 11 19:42:59 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:00.014778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1bb597ad-313a-49fe-adde-9300a97434ff tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1445570917"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:00.019767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.aggregate [None req-1bb597ad-313a-49fe-adde-9300a97434ff tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Generated uuid dc6921a7-bd0f-43cc-9bdf-e3f21dec4b51 for aggregate {{(pid=126956) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:43:00.067936 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1bb597ad-313a-49fe-adde-9300a97434ff tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065666 Oct 11 19:43:00.075124 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 94/206] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:42:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:00.080809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4757c84d-b5ff-4567-a5aa-f89cde889a2c tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-744963789"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:00.087040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.aggregate [None req-4757c84d-b5ff-4567-a5aa-f89cde889a2c tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Generated uuid 0215780a-e1f3-469b-bacd-822e0b3fd2d9 for aggregate {{(pid=126956) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:43:00.134820 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4757c84d-b5ff-4567-a5aa-f89cde889a2c tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063111 Oct 11 19:43:00.142924 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 95/207] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:43:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:00.148225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1d9731fd-43f9-4c66-8830-5b5ccc1aa34e req-82cba50b-8b66-44c3-ba44-42b1251cd470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ac645a-a576-4cad-a7f2-58d8920c2523", "tag": "8f81cfc1-8024-4193-8b3a-821edf92818d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:00.159363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1d9731fd-43f9-4c66-8830-5b5ccc1aa34e req-82cba50b-8b66-44c3-ba44-42b1251cd470 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:00.159852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1d9731fd-43f9-4c66-8830-5b5ccc1aa34e req-82cba50b-8b66-44c3-ba44-42b1251cd470 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:00.160287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1d9731fd-43f9-4c66-8830-5b5ccc1aa34e req-82cba50b-8b66-44c3-ba44-42b1251cd470 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:00.173560 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1d9731fd-43f9-4c66-8830-5b5ccc1aa34e req-82cba50b-8b66-44c3-ba44-42b1251cd470 service nova] Creating event network-changed:8f81cfc1-8024-4193-8b3a-821edf92818d for instance 71ac645a-a576-4cad-a7f2-58d8920c2523 on n-h1-860864-3 Oct 11 19:43:00.178999 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1d9731fd-43f9-4c66-8830-5b5ccc1aa34e req-82cba50b-8b66-44c3-ba44-42b1251cd470 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034773 Oct 11 19:43:00.179683 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 96/208] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:00.185297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a7ec8d4-c8bb-4c87-ac78-96c10190a527 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:00.199248 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a7ec8d4-c8bb-4c87-ac78-96c10190a527 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.018280 Oct 11 19:43:00.206680 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 97/209] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:00 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:00.217943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d999ef01-0b99-4882-8719-f7e32df6677e tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:00.239266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:00.252137 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d999ef01-0b99-4882-8719-f7e32df6677e tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.049555 Oct 11 19:43:00.255584 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 98/210] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:00 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:43:00.260843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d700a17b-f2a0-40d4-ad3b-42d7d59df29c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:00.261768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d700a17b-f2a0-40d4-ad3b-42d7d59df29c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:00.270965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d700a17b-f2a0-40d4-ad3b-42d7d59df29c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:00.271320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d700a17b-f2a0-40d4-ad3b-42d7d59df29c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:00.271831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d700a17b-f2a0-40d4-ad3b-42d7d59df29c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:00.272920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d700a17b-f2a0-40d4-ad3b-42d7d59df29c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:00.273115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d700a17b-f2a0-40d4-ad3b-42d7d59df29c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:00.273611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d700a17b-f2a0-40d4-ad3b-42d7d59df29c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:00.309493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-021a846e-0baa-441b-8350-25d0bdb89c81 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:00.319230 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-021a846e-0baa-441b-8350-25d0bdb89c81 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1317 microversion: 2.1 time: 0.451900 Oct 11 19:43:00.323949 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 113/211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:42:59 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:00.336027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-836e3dd5-69da-48d2-a7f1-ac242926d67a tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:00.363084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-836e3dd5-69da-48d2-a7f1-ac242926d67a tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:00.364202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-836e3dd5-69da-48d2-a7f1-ac242926d67a tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:00.364830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-836e3dd5-69da-48d2-a7f1-ac242926d67a tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:00.565270 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-836e3dd5-69da-48d2-a7f1-ac242926d67a tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.239010 Oct 11 19:43:00.566645 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 114/212] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 19:43:00 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:00.574611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eaf679ac-5f3c-4aab-abac-a373677d2127 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:00.586997 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eaf679ac-5f3c-4aab-abac-a373677d2127 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018153 Oct 11 19:43:00.588569 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 115/213] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:43:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:00.601382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-321fa406-9c6d-40a4-9b4d-e66607ef9f05 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:00.616052 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-321fa406-9c6d-40a4-9b4d-e66607ef9f05 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 11 19:43:00.618361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d700a17b-f2a0-40d4-ad3b-42d7d59df29c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-321fa406-9c6d-40a4-9b4d-e66607ef9f05 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Request method failure captured: Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccQiqtl_3GrBx3sRQStI-vKLVq286y3JUwwJRVf391CBkAwWfTwfnuoHDDLS3aNIzE0Oo9ouS1jJFwU35Sses2NM1W5Or90W5H9ASwAz3ETBtE_b2it4sBf6Mi9O88XnPdjMc2QbDs4nvtZVb295iL2SaPI3DAzgjKSRRzCijlGOdI Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 806ec08d0c724c4b885a1b71410f2f94 Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:43:00.618843 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/806ec08d0c724c4b885a1b71410f2f94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_806ec08d0c724c4b885a1b71410f2f94", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/806ec08d0c724c4b885a1b71410f2f94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/806ec08d0c724c4b885a1b71410f2f94"}]}] Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 806ec08d0c724c4b885a1b71410f2f94 Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminTestJSON-8140730-project-admin Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3dd8768740164da6b957c693e79f98d5 Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminTestJSON-8140730-project-admin Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: exception: Aggregate 12 could not be found. Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '12'} Oct 11 19:43:00.620451 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:00.621289 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.622501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-321fa406-9c6d-40a4-9b4d-e66607ef9f05 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:00.624642 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-321fa406-9c6d-40a4-9b4d-e66607ef9f05 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.033743 Oct 11 19:43:00.627575 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 116/214] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:43:00 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:43:00.634368 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d700a17b-f2a0-40d4-ad3b-42d7d59df29c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1386 microversion: 2.1 time: 0.376909 Oct 11 19:43:00.635040 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 99/215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:00 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1386 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:00.642431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-3451b9ac-87f9-49e4-bf74-2dddb0e1e450 req-ed0191ed-108f-431a-815a-395c641c0e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f392b558-6079-4c4d-88bd-a50aa499dce6", "name": "network-vif-plugged", "status": "completed", "tag": "c17e735a-c9a1-4253-b84d-b15594905be3"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:00.657308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3451b9ac-87f9-49e4-bf74-2dddb0e1e450 req-ed0191ed-108f-431a-815a-395c641c0e1a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:00.657802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3451b9ac-87f9-49e4-bf74-2dddb0e1e450 req-ed0191ed-108f-431a-815a-395c641c0e1a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:00.658243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3451b9ac-87f9-49e4-bf74-2dddb0e1e450 req-ed0191ed-108f-431a-815a-395c641c0e1a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:00.659993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f995a7bc-f236-489e-9aaf-c651ce252d6e tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860864-3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:00.671926 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-3451b9ac-87f9-49e4-bf74-2dddb0e1e450 req-ed0191ed-108f-431a-815a-395c641c0e1a service nova] Creating event network-vif-plugged:c17e735a-c9a1-4253-b84d-b15594905be3 for instance f392b558-6079-4c4d-88bd-a50aa499dce6 on n-h2-860864-3 Oct 11 19:43:00.674666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f995a7bc-f236-489e-9aaf-c651ce252d6e tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '07a1f16d8ee14486a26b29bfd38e732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25470d7b46924b7ab1069620d4b7d113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f995a7bc-f236-489e-9aaf-c651ce252d6e tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Request method failure captured: Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 42 Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccNEP6Y5R7_O2P5k5xJiMaJcIIr52y1Uo-Quy-OLZ2GH8gCtFQlX5V2vBpGyZN4Bv05MDPPZL5LAxLIBEMXg0gg2s6fZFK2IsSud6OJ1bgMv1Y8-_3wtjYSaBKOwq_giqppL2TiDFwuNakJ4K5FalALDy-NTnC43g75f6cJMhM66tA Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:43:00.676570 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25470d7b46924b7ab1069620d4b7d113", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25470d7b46924b7ab1069620d4b7d113"}]}] Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 25470d7b46924b7ab1069620d4b7d113 Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995996465 Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 07a1f16d8ee14486a26b29bfd38e732d Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995996465-project Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: {"remove_host": {"host": "n-h1-860864-3"}} Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:00.677716 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-860864-3'}}} Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:00.678408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 19:43:00.679418 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.680518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f995a7bc-f236-489e-9aaf-c651ce252d6e tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:00.680518 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f995a7bc-f236-489e-9aaf-c651ce252d6e tempest-AggregatesAdminNegativeTestJSON-995996465 tempest-AggregatesAdminNegativeTestJSON-995996465-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.022711 Oct 11 19:43:00.684828 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-3451b9ac-87f9-49e4-bf74-2dddb0e1e450 req-ed0191ed-108f-431a-815a-395c641c0e1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055524 Oct 11 19:43:00.685580 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 117/216] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:00.686373 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 100/217] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 19:43:00 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:00.693931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d37873b7-37e9-4f8e-8673-a57aa4241171 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:00.712764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ca6dae34-fa5e-4af3-b940-c18c928c4bcb tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:00.753098 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d37873b7-37e9-4f8e-8673-a57aa4241171 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.065312 Oct 11 19:43:00.764420 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 118/218] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 11 19:43:00 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:00.766637 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-ca6dae34-fa5e-4af3-b940-c18c928c4bcb tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 11 19:43:00.767282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-485f9e98-a791-461e-b712-8b971c312a44 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ca6dae34-fa5e-4af3-b940-c18c928c4bcb tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Request method failure captured: Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccQiqtl_3GrBx3sRQStI-vKLVq286y3JUwwJRVf391CBkAwWfTwfnuoHDDLS3aNIzE0Oo9ouS1jJFwU35Sses2NM1W5Or90W5H9ASwAz3ETBtE_b2it4sBf6Mi9O88XnPdjMc2QbDs4nvtZVb295iL2SaPI3DAzgjKSRRzCijlGOdI Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 806ec08d0c724c4b885a1b71410f2f94 Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:43:00.768403 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/806ec08d0c724c4b885a1b71410f2f94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_806ec08d0c724c4b885a1b71410f2f94", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/806ec08d0c724c4b885a1b71410f2f94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/806ec08d0c724c4b885a1b71410f2f94"}]}] Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 806ec08d0c724c4b885a1b71410f2f94 Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AggregatesAdminTestJSON-8140730-project-admin Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3dd8768740164da6b957c693e79f98d5 Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AggregatesAdminTestJSON-8140730-project-admin Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: exception: Aggregate 12 could not be found. Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '12'} Oct 11 19:43:00.770184 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:43:00.771212 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:00.772559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:00.773647 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:00.773647 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:00.773647 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:00.773647 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 11 19:43:00.773647 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:00.773647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ca6dae34-fa5e-4af3-b940-c18c928c4bcb tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:00.773647 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ca6dae34-fa5e-4af3-b940-c18c928c4bcb tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.080230 Oct 11 19:43:00.773647 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 101/219] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:00 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:43:00.780377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98e64061-074a-44fe-9a64-4ad7cf5ec7d7 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:00.792914 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98e64061-074a-44fe-9a64-4ad7cf5ec7d7 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019190 Oct 11 19:43:00.801731 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 102/220] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:43:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:00.804231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-485f9e98-a791-461e-b712-8b971c312a44 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:00.804731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-485f9e98-a791-461e-b712-8b971c312a44 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:00.806223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-485f9e98-a791-461e-b712-8b971c312a44 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:00.808506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-35dcec57-b918-4c97-b549-8b070a7fde8c tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-721533070", "name": "tempest-test_aggregate-1636158089"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:00.813335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.aggregate [None req-35dcec57-b918-4c97-b549-8b070a7fde8c tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Generated uuid 8b353887-aede-48bd-8315-aab43d8d31a9 for aggregate {{(pid=126956) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:43:00.843973 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-35dcec57-b918-4c97-b549-8b070a7fde8c tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.040756 Oct 11 19:43:00.845437 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 103/221] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Oct 11 19:43:00 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:00.856874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e9667c22-1d9c-4b8c-a215-c1c1f9f67e1b tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:00.879306 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e9667c22-1d9c-4b8c-a215-c1c1f9f67e1b tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.032308 Oct 11 19:43:00.890974 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 104/222] 10.222.0.27 () {58 vars in 1144 bytes} [Tue Oct 11 19:43:00 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:00.897449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fa07c6c1-d9d8-4ef6-b424-6dfef71d7d3e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:00.897995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fa07c6c1-d9d8-4ef6-b424-6dfef71d7d3e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:00.919621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa07c6c1-d9d8-4ef6-b424-6dfef71d7d3e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:00.920780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa07c6c1-d9d8-4ef6-b424-6dfef71d7d3e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:00.921226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa07c6c1-d9d8-4ef6-b424-6dfef71d7d3e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:00.922020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa07c6c1-d9d8-4ef6-b424-6dfef71d7d3e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:00.922436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa07c6c1-d9d8-4ef6-b424-6dfef71d7d3e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:00.922897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa07c6c1-d9d8-4ef6-b424-6dfef71d7d3e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:01.066508 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-485f9e98-a791-461e-b712-8b971c312a44 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.310468 Oct 11 19:43:01.076863 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 119/223] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 19:43:00 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.087325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-259ebba4-505d-4ce4-b7f4-47010855b4d5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.137219 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-259ebba4-505d-4ce4-b7f4-47010855b4d5 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.059168 Oct 11 19:43:01.138652 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 120/224] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:01 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:43:01.153006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d0307eb9-c09e-4b37-96ab-1bcab4703890 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.175249 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d0307eb9-c09e-4b37-96ab-1bcab4703890 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034708 Oct 11 19:43:01.177982 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 121/225] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.192436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-83838a97-fdac-40b2-9c93-c5163e7866a0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.194661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-83838a97-fdac-40b2-9c93-c5163e7866a0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:01.213970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fa07c6c1-d9d8-4ef6-b424-6dfef71d7d3e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:01.215715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83838a97-fdac-40b2-9c93-c5163e7866a0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:01.216457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83838a97-fdac-40b2-9c93-c5163e7866a0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:01.217123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83838a97-fdac-40b2-9c93-c5163e7866a0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:01.218035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83838a97-fdac-40b2-9c93-c5163e7866a0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:01.219471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83838a97-fdac-40b2-9c93-c5163e7866a0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:01.220128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83838a97-fdac-40b2-9c93-c5163e7866a0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:01.225020 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fa07c6c1-d9d8-4ef6-b424-6dfef71d7d3e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1311 microversion: 2.1 time: 0.334201 Oct 11 19:43:01.225611 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 105/226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:00 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:01.234467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40faff15-2a1d-4649-90bd-e762b7b66816 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.269861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=7,nova_api:INSERT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:01.303359 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40faff15-2a1d-4649-90bd-e762b7b66816 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.076643 Oct 11 19:43:01.303954 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 106/227] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:01 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:43:01.316389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b91cdf37-8907-416d-8fa6-b58480ef0fd1 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.326023 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-b91cdf37-8907-416d-8fa6-b58480ef0fd1 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b91cdf37-8907-416d-8fa6-b58480ef0fd1 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Request method failure captured: Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccQiqtl_3GrBx3sRQStI-vKLVq286y3JUwwJRVf391CBkAwWfTwfnuoHDDLS3aNIzE0Oo9ouS1jJFwU35Sses2NM1W5Or90W5H9ASwAz3ETBtE_b2it4sBf6Mi9O88XnPdjMc2QbDs4nvtZVb295iL2SaPI3DAzgjKSRRzCijlGOdI Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 806ec08d0c724c4b885a1b71410f2f94 Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:43:01.327953 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/806ec08d0c724c4b885a1b71410f2f94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_806ec08d0c724c4b885a1b71410f2f94", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/806ec08d0c724c4b885a1b71410f2f94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/806ec08d0c724c4b885a1b71410f2f94"}]}] Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 806ec08d0c724c4b885a1b71410f2f94 Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AggregatesAdminTestJSON-8140730-project-admin Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3dd8768740164da6b957c693e79f98d5 Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AggregatesAdminTestJSON-8140730-project-admin Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: exception: Aggregate 14 could not be found. Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '14'} Oct 11 19:43:01.329095 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.329801 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.330781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b91cdf37-8907-416d-8fa6-b58480ef0fd1 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:01.331936 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b91cdf37-8907-416d-8fa6-b58480ef0fd1 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.017805 Oct 11 19:43:01.331936 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 107/228] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:43:01.338115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d196c5cf-3170-425d-a1dd-0f76d3db6739 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.357801 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d196c5cf-3170-425d-a1dd-0f76d3db6739 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.023294 Oct 11 19:43:01.358787 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 108/229] 10.222.0.27 () {58 vars in 1148 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:01.363608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cca0ccf8-bf21-4fee-9d1e-00ac56f399f0 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1869632482"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:01.370243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.aggregate [None req-cca0ccf8-bf21-4fee-9d1e-00ac56f399f0 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Generated uuid c7d27fc4-ec05-4b05-b0c7-135878173104 for aggregate {{(pid=126956) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:43:01.396263 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cca0ccf8-bf21-4fee-9d1e-00ac56f399f0 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.035413 Oct 11 19:43:01.396956 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 109/230] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:43:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.411008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-92c964e4-057d-4dfd-b7c1-ce9d00c9c23e tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.425117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-83838a97-fdac-40b2-9c93-c5163e7866a0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:01.429775 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-92c964e4-057d-4dfd-b7c1-ce9d00c9c23e tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-92c964e4-057d-4dfd-b7c1-ce9d00c9c23e tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Request method failure captured: Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccQiqtl_3GrBx3sRQStI-vKLVq286y3JUwwJRVf391CBkAwWfTwfnuoHDDLS3aNIzE0Oo9ouS1jJFwU35Sses2NM1W5Or90W5H9ASwAz3ETBtE_b2it4sBf6Mi9O88XnPdjMc2QbDs4nvtZVb295iL2SaPI3DAzgjKSRRzCijlGOdI Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 806ec08d0c724c4b885a1b71410f2f94 Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:43:01.431532 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/806ec08d0c724c4b885a1b71410f2f94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_806ec08d0c724c4b885a1b71410f2f94", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/806ec08d0c724c4b885a1b71410f2f94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/806ec08d0c724c4b885a1b71410f2f94"}]}] Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 806ec08d0c724c4b885a1b71410f2f94 Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-8140730 Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AggregatesAdminTestJSON-8140730-project-admin Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3dd8768740164da6b957c693e79f98d5 Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AggregatesAdminTestJSON-8140730-project-admin Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: exception: Aggregate 14 could not be found. Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '14'} Oct 11 19:43:01.432671 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:43:01.433403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.434381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:01.436692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:01.436692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:01.436692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:01.436692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 11 19:43:01.436692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.436692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-92c964e4-057d-4dfd-b7c1-ce9d00c9c23e tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:01.436692 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-92c964e4-057d-4dfd-b7c1-ce9d00c9c23e tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.029402 Oct 11 19:43:01.439312 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 110/231] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:01 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:43:01.442818 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-83838a97-fdac-40b2-9c93-c5163e7866a0 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1320 microversion: 2.1 time: 0.261959 Oct 11 19:43:01.457499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2a02cc01-9a02-4f93-9b32-6554ae168a4b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.457499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2a02cc01-9a02-4f93-9b32-6554ae168a4b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:01.457499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a02cc01-9a02-4f93-9b32-6554ae168a4b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:01.457499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a02cc01-9a02-4f93-9b32-6554ae168a4b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:01.458158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a02cc01-9a02-4f93-9b32-6554ae168a4b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:01.458158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a02cc01-9a02-4f93-9b32-6554ae168a4b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:01.458158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a02cc01-9a02-4f93-9b32-6554ae168a4b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:01.458158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a02cc01-9a02-4f93-9b32-6554ae168a4b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:01.460180 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 122/232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1320 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:01.466739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2898e624-3db2-4a31-8942-81695e810caf tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.504220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2898e624-3db2-4a31-8942-81695e810caf tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.044304 Oct 11 19:43:01.505987 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 123/233] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.512072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:01.538712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:01.539693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:01.540996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:01.550871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:01.551677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:01.552333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:01.562809 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.compute.aggregates [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 11 19:43:01.563608 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Request method failure captured: Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 42 Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccQUu-K9GwdjDlO3eAn392VeVHRVrCLZmP5eULB7StwmsbAWOAL2gUp4hwAiM5dp-3NoXAqjK-xbXNJo9nEZVl6ANFUG2r393uv94Tycp3JMQqpt_IIPTAEOpXj0HpXvdLhsy-smZxLXMIZ4KUtdwS0f4AkHbNdKZtIxqTsWtf-Bjg Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:43:01.565809 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9886de91491b437891a2c5aecc4ca160", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9886de91491b437891a2c5aecc4ca160"}]}] Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9886de91491b437891a2c5aecc4ca160 Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262 Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 90196219db0242d6a529e61fbeab9e9b Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: {"remove_host": {"host": "nonexist_host"}} Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:01.567480 n-d-860864-3 devstack@n-api.service[126955]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 11 19:43:01.568173 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 11 19:43:01.569190 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.570311 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:01.571603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:01.571603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:01.571603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:01.571603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:01.571603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 11 19:43:01.571603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:01.574225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:01.575354 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bce2167f-5979-4fe6-8833-209b01dd9786 tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.068146 Oct 11 19:43:01.577991 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 124/234] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 19:43:01 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:43:01.584407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-313d91d7-3603-4d48-9c8a-3c58d5df2946 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-413502387"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:01.594708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-313d91d7-3603-4d48-9c8a-3c58d5df2946 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Generated uuid d0574111-94dc-4646-81a8-3cdbe1b5a25e for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:43:01.623556 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-313d91d7-3603-4d48-9c8a-3c58d5df2946 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043759 Oct 11 19:43:01.624367 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 125/235] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:43:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.632720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2a02cc01-9a02-4f93-9b32-6554ae168a4b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:01.637492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-de6ccb42-02f3-4c94-aa35-db0f728007bf tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.642156 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2a02cc01-9a02-4f93-9b32-6554ae168a4b tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1317 microversion: 2.1 time: 0.201751 Oct 11 19:43:01.643721 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 111/236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:01.649548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ba7f6c3d-5feb-442d-b217-b310653f5fc6 req-8bf362ed-8010-47c6-88bd-ba484cd92f19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f601b40f-73ac-45fa-8e64-093dfeaf1b4a", "tag": "20c9f587-0ead-4247-af06-840e4129c936"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:01.658300 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-de6ccb42-02f3-4c94-aa35-db0f728007bf tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025599 Oct 11 19:43:01.661926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ba7f6c3d-5feb-442d-b217-b310653f5fc6 req-8bf362ed-8010-47c6-88bd-ba484cd92f19 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:01.662497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ba7f6c3d-5feb-442d-b217-b310653f5fc6 req-8bf362ed-8010-47c6-88bd-ba484cd92f19 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:01.662670 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 126/237] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.663110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ba7f6c3d-5feb-442d-b217-b310653f5fc6 req-8bf362ed-8010-47c6-88bd-ba484cd92f19 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:01.673826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d8825507-c92a-4696-b061-95e500c057eb tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.678673 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ba7f6c3d-5feb-442d-b217-b310653f5fc6 req-8bf362ed-8010-47c6-88bd-ba484cd92f19 service nova] Creating event network-changed:20c9f587-0ead-4247-af06-840e4129c936 for instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a on n-h1-860864-3 Oct 11 19:43:01.684335 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ba7f6c3d-5feb-442d-b217-b310653f5fc6 req-8bf362ed-8010-47c6-88bd-ba484cd92f19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038884 Oct 11 19:43:01.685070 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 112/238] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.690541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98e52c91-99d3-4ae5-82d3-ef28d2a2a832 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.700157 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98e52c91-99d3-4ae5-82d3-ef28d2a2a832 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.013812 Oct 11 19:43:01.707481 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 113/239] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.711883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-69b91621-70fe-47e1-a032-6dd46c4b5c15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.712999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-69b91621-70fe-47e1-a032-6dd46c4b5c15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:01.713130 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d8825507-c92a-4696-b061-95e500c057eb tempest-AggregatesAdminNegativeTestJSON-1820298262 tempest-AggregatesAdminNegativeTestJSON-1820298262-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.048058 Oct 11 19:43:01.715218 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 127/240] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:01 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:43:01.721220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-42c03685-4699-4aae-883c-2c1c0fff91c2 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.738442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69b91621-70fe-47e1-a032-6dd46c4b5c15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:01.738981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69b91621-70fe-47e1-a032-6dd46c4b5c15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:01.739418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69b91621-70fe-47e1-a032-6dd46c4b5c15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:01.740129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69b91621-70fe-47e1-a032-6dd46c4b5c15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:01.740584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69b91621-70fe-47e1-a032-6dd46c4b5c15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:01.741016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69b91621-70fe-47e1-a032-6dd46c4b5c15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:01.752330 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-42c03685-4699-4aae-883c-2c1c0fff91c2 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.036026 Oct 11 19:43:01.753112 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 128/241] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:01.762921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65a192f4-0761-4f42-bfcd-3251e8a8a12f tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:01.804691 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-65a192f4-0761-4f42-bfcd-3251e8a8a12f tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.050243 Oct 11 19:43:01.807128 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 129/242] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 19:43:01 2022] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.816406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4c26ef89-ebb3-4897-8730-ccb4dd94a8fa tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.892952 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4c26ef89-ebb3-4897-8730-ccb4dd94a8fa tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.084350 Oct 11 19:43:01.893589 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 130/243] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:01.903063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0ebc576e-1c9d-4ba8-a805-0e9a0f40dbc6 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.924624 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0ebc576e-1c9d-4ba8-a805-0e9a0f40dbc6 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.029251 Oct 11 19:43:01.931588 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 131/244] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.944092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b9e7091-d263-45e7-9c7f-2447b4fb5237 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:01.967269 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b9e7091-d263-45e7-9c7f-2447b4fb5237 tempest-FlavorsV2TestJSON-1746257841 tempest-FlavorsV2TestJSON-1746257841-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039046 Oct 11 19:43:01.968348 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 132/245] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:01.979237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a0126f9-3661-4c11-a850-3b79ee8f09cd tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:02.010641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-69b91621-70fe-47e1-a032-6dd46c4b5c15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:02.022215 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-69b91621-70fe-47e1-a032-6dd46c4b5c15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1386 microversion: 2.1 time: 0.320445 Oct 11 19:43:02.024340 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 114/246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:01 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1386 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:02.043510 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a0126f9-3661-4c11-a850-3b79ee8f09cd tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.070835 Oct 11 19:43:02.050300 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 133/247] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:01 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:43:02.053820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-50e5da0c-518b-4172-aa4e-309ec41a8c19 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1850726273", "availability_zone": "tempest-test_az-1553661061"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:02.063729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.aggregate [None req-50e5da0c-518b-4172-aa4e-309ec41a8c19 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Generated uuid f7f1782f-99a7-4047-ba4d-7f5366663274 for aggregate {{(pid=126956) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:43:02.136379 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-50e5da0c-518b-4172-aa4e-309ec41a8c19 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.085951 Oct 11 19:43:02.145404 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 115/248] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Oct 11 19:43:02 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:43:02.150555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-419a2b22-bb75-45b5-8fd6-0ce8b23740ec tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1850726273_new", "availability_zone": "tempest-test_az-1553661061_new"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:02.248737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-419a2b22-bb75-45b5-8fd6-0ce8b23740ec tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:02.249216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-419a2b22-bb75-45b5-8fd6-0ce8b23740ec tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:02.249661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-419a2b22-bb75-45b5-8fd6-0ce8b23740ec tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:02.252339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb383859-c41a-4f9b-aedd-fd61b1f30dfe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:02.253168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bb383859-c41a-4f9b-aedd-fd61b1f30dfe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:02.271983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb383859-c41a-4f9b-aedd-fd61b1f30dfe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:02.272225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb383859-c41a-4f9b-aedd-fd61b1f30dfe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:02.272588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb383859-c41a-4f9b-aedd-fd61b1f30dfe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:02.277582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb383859-c41a-4f9b-aedd-fd61b1f30dfe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:02.278618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb383859-c41a-4f9b-aedd-fd61b1f30dfe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:02.283805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb383859-c41a-4f9b-aedd-fd61b1f30dfe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:02.315885 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-419a2b22-bb75-45b5-8fd6-0ce8b23740ec tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.168977 Oct 11 19:43:02.322498 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 134/249] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 11 19:43:02 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:02.328017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8807c4ee-d090-4179-85dc-88ec7ce422cc tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:02.352620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8807c4ee-d090-4179-85dc-88ec7ce422cc tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.020079 Oct 11 19:43:02.352620 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 135/250] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:43:02 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:43:02.358848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-982428a7-b0be-495e-ba55-6f472cae7d85 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:02.397010 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-982428a7-b0be-495e-ba55-6f472cae7d85 tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.042450 Oct 11 19:43:02.402760 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 136/251] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:02 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:43:02.422229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c2863b55-498b-46ad-9f8b-33863abdf97a tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-256830604"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:02.430653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-c2863b55-498b-46ad-9f8b-33863abdf97a tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Generated uuid 117e949e-6614-4bf0-8fea-d0670383a7c4 for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 19:43:02.502128 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c2863b55-498b-46ad-9f8b-33863abdf97a tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.096240 Oct 11 19:43:02.502781 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 137/252] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 19:43:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:43:02.527675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6e93b8dd-3c24-4eea-af7f-ffa4a87d4011 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:02.530582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6e93b8dd-3c24-4eea-af7f-ffa4a87d4011 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:02.552097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e93b8dd-3c24-4eea-af7f-ffa4a87d4011 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:02.552615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e93b8dd-3c24-4eea-af7f-ffa4a87d4011 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:02.553162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e93b8dd-3c24-4eea-af7f-ffa4a87d4011 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:02.553898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e93b8dd-3c24-4eea-af7f-ffa4a87d4011 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:02.554362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e93b8dd-3c24-4eea-af7f-ffa4a87d4011 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:02.554849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e93b8dd-3c24-4eea-af7f-ffa4a87d4011 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:02.799999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bb383859-c41a-4f9b-aedd-fd61b1f30dfe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:02.814404 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bb383859-c41a-4f9b-aedd-fd61b1f30dfe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1311 microversion: 2.1 time: 0.567800 Oct 11 19:43:02.819852 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 116/253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:02 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1311 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:02.845130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-113e2b63-6df7-407a-9baf-6f39bb57840c tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:02.876046 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-113e2b63-6df7-407a-9baf-6f39bb57840c tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.053071 Oct 11 19:43:02.876307 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 117/254] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:43:02 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:02.888820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff7c3952-ebd7-4484-94f0-46599296185c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:02.889441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ff7c3952-ebd7-4484-94f0-46599296185c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:02.912178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7c3952-ebd7-4484-94f0-46599296185c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:02.915708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7c3952-ebd7-4484-94f0-46599296185c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:02.916461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7c3952-ebd7-4484-94f0-46599296185c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:02.919467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7c3952-ebd7-4484-94f0-46599296185c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:02.920112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7c3952-ebd7-4484-94f0-46599296185c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:02.922125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7c3952-ebd7-4484-94f0-46599296185c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:03.578944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6e93b8dd-3c24-4eea-af7f-ffa4a87d4011 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:03.595802 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6e93b8dd-3c24-4eea-af7f-ffa4a87d4011 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1320 microversion: 2.1 time: 1.091948 Oct 11 19:43:03.596395 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 138/255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:02 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1320 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:03.605208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-20c8e882-ab65-4cdf-9666-94ea3f979dc1 req-c2eb09a2-87dc-431e-b3d0-02deb727453f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27956e70-3a33-46ba-98c8-f9dbfe444d2e", "name": "network-vif-plugged", "status": "completed", "tag": "a8198729-0bcb-443a-8dbd-3e7eac134b9d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:03.643289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-20c8e882-ab65-4cdf-9666-94ea3f979dc1 req-c2eb09a2-87dc-431e-b3d0-02deb727453f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:03.643773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-20c8e882-ab65-4cdf-9666-94ea3f979dc1 req-c2eb09a2-87dc-431e-b3d0-02deb727453f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:03.644205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-20c8e882-ab65-4cdf-9666-94ea3f979dc1 req-c2eb09a2-87dc-431e-b3d0-02deb727453f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:03.674020 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-20c8e882-ab65-4cdf-9666-94ea3f979dc1 req-c2eb09a2-87dc-431e-b3d0-02deb727453f service nova] Creating event network-vif-plugged:a8198729-0bcb-443a-8dbd-3e7eac134b9d for instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e on n-h2-860864-3 Oct 11 19:43:03.683303 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-20c8e882-ab65-4cdf-9666-94ea3f979dc1 req-c2eb09a2-87dc-431e-b3d0-02deb727453f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081534 Oct 11 19:43:03.683913 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 139/256] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:03.699290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ff7c3952-ebd7-4484-94f0-46599296185c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:03.721771 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff7c3952-ebd7-4484-94f0-46599296185c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1467 microversion: 2.1 time: 0.844587 Oct 11 19:43:03.725365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56843f5c-0d3c-45a3-94fc-6a7eb8684ccd tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:03.733995 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 118/257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:02 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1467 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:03.755112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1cbab8b0-e23a-4560-b0bf-d659c87c1ce6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:03.755728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1cbab8b0-e23a-4560-b0bf-d659c87c1ce6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:03.787963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cbab8b0-e23a-4560-b0bf-d659c87c1ce6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:03.788735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cbab8b0-e23a-4560-b0bf-d659c87c1ce6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:03.789998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cbab8b0-e23a-4560-b0bf-d659c87c1ce6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:03.793152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cbab8b0-e23a-4560-b0bf-d659c87c1ce6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:03.794207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cbab8b0-e23a-4560-b0bf-d659c87c1ce6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:03.796479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cbab8b0-e23a-4560-b0bf-d659c87c1ce6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:03.808748 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56843f5c-0d3c-45a3-94fc-6a7eb8684ccd tempest-AggregatesAdminTestJSON-8140730 tempest-AggregatesAdminTestJSON-8140730-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.115961 Oct 11 19:43:03.812905 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 140/258] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:03 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:43:04.335092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-912c2a80-4193-4d8a-92b6-301af4571ed3 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:04.335915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-912c2a80-4193-4d8a-92b6-301af4571ed3 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:04.339945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:DELETE=11,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:04.360972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-912c2a80-4193-4d8a-92b6-301af4571ed3 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:04.362904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-912c2a80-4193-4d8a-92b6-301af4571ed3 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:04.366042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-912c2a80-4193-4d8a-92b6-301af4571ed3 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:04.384842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-912c2a80-4193-4d8a-92b6-301af4571ed3 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:04.385670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-912c2a80-4193-4d8a-92b6-301af4571ed3 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:04.388477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-912c2a80-4193-4d8a-92b6-301af4571ed3 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:04.395122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=14 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:04.676272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1cbab8b0-e23a-4560-b0bf-d659c87c1ce6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:04.688227 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1cbab8b0-e23a-4560-b0bf-d659c87c1ce6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1386 microversion: 2.1 time: 0.953282 Oct 11 19:43:04.691759 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 119/259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:03 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1386 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:04.697457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:04.698176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:04.721857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:04.735750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:04.736388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:04.739681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:04.740535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:04.741683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:04.743336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:04.785000 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] HTTP exception thrown: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Request method failure captured: Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f HTTP/1.1 Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccNQIipuFQQjFpjkvm4N7AtWq2-rP09KfBu52edmE51_WK2ampAK-cIRKSt4JPhTFWdOzAYrKh9KkASyvt6vZHSJP9gT_vSai10MJrw51S5HjLO1BjHnTxO1T-4KzhiiSEC2qz-OItQ8AlFkYQzWu0Svk5aFk3ublcfrPuUm4xOYR8 Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: d62e7d63cd6c4318a4b79659c96ef9ef Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AggregatesAdminTestJSON-761719749 Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:43:04.788099 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d62e7d63cd6c4318a4b79659c96ef9ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d62e7d63cd6c4318a4b79659c96ef9ef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d62e7d63cd6c4318a4b79659c96ef9ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d62e7d63cd6c4318a4b79659c96ef9ef"}]}] Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AggregatesAdminTestJSON-761719749 Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: d62e7d63cd6c4318a4b79659c96ef9ef Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-761719749 Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AggregatesAdminTestJSON-761719749-project Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 1a5502bee89642e5a5779b6f1f540fc4 Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AggregatesAdminTestJSON-761719749-project Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:43:04.790333 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'c488615e-e44e-41d8-8632-7428d37ce48f'} Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:04.791118 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:43:04.793297 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:04.797188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Returning 404 to user: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:04.798378 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eda402bb-69f7-4e5c-8722-b236f9a4b5c3 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 404 len: 111 microversion: 2.1 time: 0.105083 Oct 11 19:43:04.799525 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 120/260] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:43:04 2022] DELETE /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:04.808858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a6c71b72-ca98-4a04-bdc5-1ed627fe9c61 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:04.810126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a6c71b72-ca98-4a04-bdc5-1ed627fe9c61 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:04.821485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c71b72-ca98-4a04-bdc5-1ed627fe9c61 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:04.822334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c71b72-ca98-4a04-bdc5-1ed627fe9c61 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:04.823480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c71b72-ca98-4a04-bdc5-1ed627fe9c61 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:04.824811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c71b72-ca98-4a04-bdc5-1ed627fe9c61 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:04.826037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c71b72-ca98-4a04-bdc5-1ed627fe9c61 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:04.826615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c71b72-ca98-4a04-bdc5-1ed627fe9c61 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:05.004943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=14 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:05.117636 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-912c2a80-4193-4d8a-92b6-301af4571ed3 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1618 microversion: 2.1 time: 1.299376 Oct 11 19:43:05.118821 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 141/261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:03 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1618 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:05.130968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a46848b-d5e6-4c6d-b88c-9cfe4c84c12a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:05.131827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a46848b-d5e6-4c6d-b88c-9cfe4c84c12a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:05.148706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a46848b-d5e6-4c6d-b88c-9cfe4c84c12a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:05.152087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a46848b-d5e6-4c6d-b88c-9cfe4c84c12a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:05.153882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a46848b-d5e6-4c6d-b88c-9cfe4c84c12a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:05.157094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a46848b-d5e6-4c6d-b88c-9cfe4c84c12a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:05.167943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a46848b-d5e6-4c6d-b88c-9cfe4c84c12a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:05.168575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a46848b-d5e6-4c6d-b88c-9cfe4c84c12a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:05.795793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a6c71b72-ca98-4a04-bdc5-1ed627fe9c61 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:05.805106 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a6c71b72-ca98-4a04-bdc5-1ed627fe9c61 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1311 microversion: 2.1 time: 1.003942 Oct 11 19:43:05.805835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 121/262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:04 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1311 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:05.826139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:05.826804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] [instance: c488615e-e44e-41d8-8632-7428d37ce48f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:05.835391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a46848b-d5e6-4c6d-b88c-9cfe4c84c12a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:05.844134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:05.844687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:05.845219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:05.857573 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a46848b-d5e6-4c6d-b88c-9cfe4c84c12a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1320 microversion: 2.1 time: 0.733498 Oct 11 19:43:05.859375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:05.860233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:05.860849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:05.881741 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 142/263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:05 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1320 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:05.898029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-73cdd5ad-427b-4d00-a037-027fcbe275f6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Action: 'create', calling method: .version_select at 0x7f83cd157ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-925708901", "policies": ["affinity"]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:05.904720 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] HTTP exception thrown: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Request method failure captured: Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f HTTP/1.1 Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccNQIipuFQQjFpjkvm4N7AtWq2-rP09KfBu52edmE51_WK2ampAK-cIRKSt4JPhTFWdOzAYrKh9KkASyvt6vZHSJP9gT_vSai10MJrw51S5HjLO1BjHnTxO1T-4KzhiiSEC2qz-OItQ8AlFkYQzWu0Svk5aFk3ublcfrPuUm4xOYR8 Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: d62e7d63cd6c4318a4b79659c96ef9ef Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AggregatesAdminTestJSON-761719749 Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:43:05.906301 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d62e7d63cd6c4318a4b79659c96ef9ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d62e7d63cd6c4318a4b79659c96ef9ef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d62e7d63cd6c4318a4b79659c96ef9ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d62e7d63cd6c4318a4b79659c96ef9ef"}]}] Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AggregatesAdminTestJSON-761719749 Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: d62e7d63cd6c4318a4b79659c96ef9ef Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-761719749 Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AggregatesAdminTestJSON-761719749-project Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 1a5502bee89642e5a5779b6f1f540fc4 Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AggregatesAdminTestJSON-761719749-project Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:43:05.907773 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'c488615e-e44e-41d8-8632-7428d37ce48f'} Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:05.908581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. Oct 11 19:43:05.909848 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:05.911831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] Returning 404 to user: Instance c488615e-e44e-41d8-8632-7428d37ce48f could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:05.911831 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-daf093b9-d753-4d5c-a177-59ec35bd0f62 tempest-AggregatesAdminTestJSON-761719749 tempest-AggregatesAdminTestJSON-761719749-project] 10.222.0.27 "GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f" status: 404 len: 111 microversion: 2.1 time: 0.100975 Oct 11 19:43:05.911831 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 122/264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:05 2022] GET /compute/v2.1/servers/c488615e-e44e-41d8-8632-7428d37ce48f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:05.917621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9f68d7f5-fdc0-4c15-85f5-06d1c5d51cab tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:05.918711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9f68d7f5-fdc0-4c15-85f5-06d1c5d51cab tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:05.925777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f68d7f5-fdc0-4c15-85f5-06d1c5d51cab tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:05.926449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f68d7f5-fdc0-4c15-85f5-06d1c5d51cab tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:05.927907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f68d7f5-fdc0-4c15-85f5-06d1c5d51cab tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:05.931866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f68d7f5-fdc0-4c15-85f5-06d1c5d51cab tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:05.932559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f68d7f5-fdc0-4c15-85f5-06d1c5d51cab tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:05.933157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f68d7f5-fdc0-4c15-85f5-06d1c5d51cab tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:05.952115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-73cdd5ad-427b-4d00-a037-027fcbe275f6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:05.962554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-73cdd5ad-427b-4d00-a037-027fcbe275f6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:06.059426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-73cdd5ad-427b-4d00-a037-027fcbe275f6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:06.080374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-73cdd5ad-427b-4d00-a037-027fcbe275f6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:06.119765 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-73cdd5ad-427b-4d00-a037-027fcbe275f6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.236321 Oct 11 19:43:06.120382 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 143/265] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 11 19:43:05 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:06.400009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-83816830", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2b535411-8be5-410e-b035-f9000ef01694"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:06.536666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:43:06.787693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9f68d7f5-fdc0-4c15-85f5-06d1c5d51cab tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:06.806503 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9f68d7f5-fdc0-4c15-85f5-06d1c5d51cab tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1585 microversion: 2.1 time: 0.893558 Oct 11 19:43:06.811123 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 123/266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:05 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1585 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:06.838135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b4971cf-38db-4807-9ea7-65603a5e5dd1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:06.839009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0b4971cf-38db-4807-9ea7-65603a5e5dd1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:06.849578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b4971cf-38db-4807-9ea7-65603a5e5dd1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:06.850080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b4971cf-38db-4807-9ea7-65603a5e5dd1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:06.850516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b4971cf-38db-4807-9ea7-65603a5e5dd1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:06.851257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b4971cf-38db-4807-9ea7-65603a5e5dd1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:06.852031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b4971cf-38db-4807-9ea7-65603a5e5dd1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:06.869665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b4971cf-38db-4807-9ea7-65603a5e5dd1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:07.421815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:43:07.422279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:43:07.422717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:43:07.423532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:43:07.424197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:43:07.427917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0b4971cf-38db-4807-9ea7-65603a5e5dd1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:07.439685 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b4971cf-38db-4807-9ea7-65603a5e5dd1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1311 microversion: 2.1 time: 0.610309 Oct 11 19:43:07.442835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 124/267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:06 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1311 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:07.452468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e4012996-8900-4441-96e6-6b439eaf2c86 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:07.452964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e4012996-8900-4441-96e6-6b439eaf2c86 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:07.471702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4012996-8900-4441-96e6-6b439eaf2c86 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:07.472212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4012996-8900-4441-96e6-6b439eaf2c86 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:07.472654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4012996-8900-4441-96e6-6b439eaf2c86 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:07.473367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4012996-8900-4441-96e6-6b439eaf2c86 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:07.473828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4012996-8900-4441-96e6-6b439eaf2c86 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:07.474255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4012996-8900-4441-96e6-6b439eaf2c86 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:07.581741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:07.582133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:07.583343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:07.585063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:07.587062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:07.589774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:07.618866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:07.626056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:07.646404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Going to run 2 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:43:07.652721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:43:07.703091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126955) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 11 19:43:07.708508 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e4012996-8900-4441-96e6-6b439eaf2c86 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.263678 Oct 11 19:43:07.709691 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 125/268] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:43:07 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e/os-interface => generated 284 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:07.716557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3fd189b3-1cf5-4550-a421-52e290b4fc0e tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:07.717424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3fd189b3-1cf5-4550-a421-52e290b4fc0e tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:07.730043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fd189b3-1cf5-4550-a421-52e290b4fc0e tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:07.735345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fd189b3-1cf5-4550-a421-52e290b4fc0e tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:07.735809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fd189b3-1cf5-4550-a421-52e290b4fc0e tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:07.736551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fd189b3-1cf5-4550-a421-52e290b4fc0e tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:07.737012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fd189b3-1cf5-4550-a421-52e290b4fc0e tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:07.737438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fd189b3-1cf5-4550-a421-52e290b4fc0e tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:07.743113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:07.750405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:07.841215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:07.852320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:07.874872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=28f5e45d-a8da-4de0-b75a-3e8a3119d855,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:43:07.993731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:07.999894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:08.076212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:08.090151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:08.092986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:08.165822 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c4bbe212-a611-4897-9bd0-ded3212bef63 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.770755 Oct 11 19:43:08.167136 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 144/269] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 1772 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 11 19:43:08.177365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c627e77a-f158-474d-a31b-88c20d6f9e8c req-8a354916-d152-43b7-8bdc-daf442242eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ac645a-a576-4cad-a7f2-58d8920c2523", "name": "network-vif-plugged", "status": "completed", "tag": "8f81cfc1-8024-4193-8b3a-821edf92818d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:08.193688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c627e77a-f158-474d-a31b-88c20d6f9e8c req-8a354916-d152-43b7-8bdc-daf442242eb6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:08.194177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c627e77a-f158-474d-a31b-88c20d6f9e8c req-8a354916-d152-43b7-8bdc-daf442242eb6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:08.194767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c627e77a-f158-474d-a31b-88c20d6f9e8c req-8a354916-d152-43b7-8bdc-daf442242eb6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:08.209647 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c627e77a-f158-474d-a31b-88c20d6f9e8c req-8a354916-d152-43b7-8bdc-daf442242eb6 service nova] Creating event network-vif-plugged:8f81cfc1-8024-4193-8b3a-821edf92818d for instance 71ac645a-a576-4cad-a7f2-58d8920c2523 on n-h1-860864-3 Oct 11 19:43:08.218482 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c627e77a-f158-474d-a31b-88c20d6f9e8c req-8a354916-d152-43b7-8bdc-daf442242eb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050030 Oct 11 19:43:08.219925 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 145/270] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:08.224571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:08.229990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:08.231889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Searching by: {'deleted': False, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:43:08.250728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:08.251219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:08.251663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:08.252399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:08.252832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:08.253254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:08.336920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3fd189b3-1cf5-4550-a421-52e290b4fc0e tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:08.345962 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3fd189b3-1cf5-4550-a421-52e290b4fc0e tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1320 microversion: 2.1 time: 0.635008 Oct 11 19:43:08.349813 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 126/271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:07 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1320 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:08.391084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:43:08.422417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:08.469826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c812f429-cafc-4f9d-8b93-07c2371e6b01 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:08.470821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c812f429-cafc-4f9d-8b93-07c2371e6b01 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:08.477908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c812f429-cafc-4f9d-8b93-07c2371e6b01 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:08.479100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c812f429-cafc-4f9d-8b93-07c2371e6b01 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:08.480611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c812f429-cafc-4f9d-8b93-07c2371e6b01 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:08.481435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c812f429-cafc-4f9d-8b93-07c2371e6b01 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:08.488727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c812f429-cafc-4f9d-8b93-07c2371e6b01 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:08.489304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c812f429-cafc-4f9d-8b93-07c2371e6b01 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:08.504956 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca6327f5-2f5f-4351-b971-57084c9e9ced tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.284330 Oct 11 19:43:08.506202 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 146/272] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 19:43:08 2022] GET /compute/v2.1/servers => generated 1000 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:08.524861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58df9dcb-1013-4e0e-a473-5ed90c693526 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:08.540897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58df9dcb-1013-4e0e-a473-5ed90c693526 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:08.718429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58df9dcb-1013-4e0e-a473-5ed90c693526 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:08.732847 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58df9dcb-1013-4e0e-a473-5ed90c693526 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1217 microversion: 2.1 time: 0.216441 Oct 11 19:43:08.734031 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 147/273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:08 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:09.137535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c812f429-cafc-4f9d-8b93-07c2371e6b01 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:09.155592 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c812f429-cafc-4f9d-8b93-07c2371e6b01 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1311 microversion: 2.1 time: 0.689995 Oct 11 19:43:09.166564 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 127/274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:08 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1311 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:09.373954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fcbf7aef-0d23-44e6-874d-1b212d24ca80 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:09.375350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fcbf7aef-0d23-44e6-874d-1b212d24ca80 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:09.385176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcbf7aef-0d23-44e6-874d-1b212d24ca80 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:09.391290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcbf7aef-0d23-44e6-874d-1b212d24ca80 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:09.392019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcbf7aef-0d23-44e6-874d-1b212d24ca80 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:09.393006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcbf7aef-0d23-44e6-874d-1b212d24ca80 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:09.393657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcbf7aef-0d23-44e6-874d-1b212d24ca80 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:09.394295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcbf7aef-0d23-44e6-874d-1b212d24ca80 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:09.761741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b332351-aa9f-435f-af04-6f08adb1160d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:09.762518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b332351-aa9f-435f-af04-6f08adb1160d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:09.774889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332351-aa9f-435f-af04-6f08adb1160d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:09.778989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332351-aa9f-435f-af04-6f08adb1160d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:09.780693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332351-aa9f-435f-af04-6f08adb1160d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:09.781706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332351-aa9f-435f-af04-6f08adb1160d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:09.784548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332351-aa9f-435f-af04-6f08adb1160d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:09.787271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332351-aa9f-435f-af04-6f08adb1160d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:09.847601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:10.100424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b332351-aa9f-435f-af04-6f08adb1160d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:10.112822 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b332351-aa9f-435f-af04-6f08adb1160d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1221 microversion: 2.1 time: 0.355808 Oct 11 19:43:10.126633 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 128/275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:09 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1221 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:10.179268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7952e71a-8c50-4f4b-b8a7-108d5a464224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:10.181865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7952e71a-8c50-4f4b-b8a7-108d5a464224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:10.206163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7952e71a-8c50-4f4b-b8a7-108d5a464224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:10.208199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7952e71a-8c50-4f4b-b8a7-108d5a464224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:10.209325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7952e71a-8c50-4f4b-b8a7-108d5a464224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:10.210055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7952e71a-8c50-4f4b-b8a7-108d5a464224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:10.210514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7952e71a-8c50-4f4b-b8a7-108d5a464224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:10.211054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7952e71a-8c50-4f4b-b8a7-108d5a464224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:10.273869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fcbf7aef-0d23-44e6-874d-1b212d24ca80 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:10.285027 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fcbf7aef-0d23-44e6-874d-1b212d24ca80 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1320 microversion: 2.1 time: 0.917122 Oct 11 19:43:10.293405 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 148/276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:09 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1320 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:10.852348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7952e71a-8c50-4f4b-b8a7-108d5a464224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:10.879123 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7952e71a-8c50-4f4b-b8a7-108d5a464224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1494 microversion: 2.1 time: 0.702487 Oct 11 19:43:10.883983 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 129/277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:10 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1494 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:11.140085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb554582-5537-4dcd-8cf5-9a0cf8ff605e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:11.140861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eb554582-5537-4dcd-8cf5-9a0cf8ff605e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:11.154340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb554582-5537-4dcd-8cf5-9a0cf8ff605e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:11.155068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb554582-5537-4dcd-8cf5-9a0cf8ff605e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:11.159109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb554582-5537-4dcd-8cf5-9a0cf8ff605e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:11.175101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb554582-5537-4dcd-8cf5-9a0cf8ff605e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:11.175875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb554582-5537-4dcd-8cf5-9a0cf8ff605e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:11.176526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb554582-5537-4dcd-8cf5-9a0cf8ff605e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:11.428956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb554582-5537-4dcd-8cf5-9a0cf8ff605e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:11.443672 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb554582-5537-4dcd-8cf5-9a0cf8ff605e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1269 microversion: 2.1 time: 0.304550 Oct 11 19:43:11.451649 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 130/278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:11 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1269 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:11.456548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-08760dbd-0adf-41e3-90fa-000f4bbf1307 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:11.457160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-08760dbd-0adf-41e3-90fa-000f4bbf1307 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:11.469788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08760dbd-0adf-41e3-90fa-000f4bbf1307 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:11.471251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08760dbd-0adf-41e3-90fa-000f4bbf1307 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:11.471754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08760dbd-0adf-41e3-90fa-000f4bbf1307 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:11.473666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08760dbd-0adf-41e3-90fa-000f4bbf1307 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:11.474158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08760dbd-0adf-41e3-90fa-000f4bbf1307 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:11.477627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08760dbd-0adf-41e3-90fa-000f4bbf1307 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:11.597319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c7c720cc-99c3-449f-9676-92fe1f877a64 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:11.600725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c7c720cc-99c3-449f-9676-92fe1f877a64 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:11.616579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c720cc-99c3-449f-9676-92fe1f877a64 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:11.638709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c720cc-99c3-449f-9676-92fe1f877a64 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:11.639668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c720cc-99c3-449f-9676-92fe1f877a64 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:11.643380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c720cc-99c3-449f-9676-92fe1f877a64 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:11.644086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c720cc-99c3-449f-9676-92fe1f877a64 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:11.648918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c720cc-99c3-449f-9676-92fe1f877a64 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:12.323333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-08760dbd-0adf-41e3-90fa-000f4bbf1307 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:12.340938 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-08760dbd-0adf-41e3-90fa-000f4bbf1307 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1320 microversion: 2.1 time: 0.886976 Oct 11 19:43:12.354920 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 131/279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:11 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1320 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:12.525782 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c7c720cc-99c3-449f-9676-92fe1f877a64 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1645 microversion: 2.1 time: 1.617683 Oct 11 19:43:12.528050 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 149/280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:10 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1645 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:12.542891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c6bcb590-bcd3-4b85-88be-0410607b67c9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:12.547401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c6bcb590-bcd3-4b85-88be-0410607b67c9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:12.562235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff6cd0fb-4879-4c68-88e2-74e45515c35e tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:12.563542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bcb590-bcd3-4b85-88be-0410607b67c9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:12.563811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6cd0fb-4879-4c68-88e2-74e45515c35e tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:12.564287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6cd0fb-4879-4c68-88e2-74e45515c35e tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:12.564929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6cd0fb-4879-4c68-88e2-74e45515c35e tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:12.565155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bcb590-bcd3-4b85-88be-0410607b67c9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:12.566155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bcb590-bcd3-4b85-88be-0410607b67c9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:12.566736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6cd0fb-4879-4c68-88e2-74e45515c35e tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:12.567381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6cd0fb-4879-4c68-88e2-74e45515c35e tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:12.567510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bcb590-bcd3-4b85-88be-0410607b67c9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:12.568058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6cd0fb-4879-4c68-88e2-74e45515c35e tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:12.572241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bcb590-bcd3-4b85-88be-0410607b67c9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:12.572883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bcb590-bcd3-4b85-88be-0410607b67c9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:12.603971 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff6cd0fb-4879-4c68-88e2-74e45515c35e tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.249932 Oct 11 19:43:12.604876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 132/281] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Oct 11 19:43:12 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:43:12.610473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1f7912c4-851a-4bfc-960a-b1ccea50a69b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:12.611447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1f7912c4-851a-4bfc-960a-b1ccea50a69b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:12.618898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f7912c4-851a-4bfc-960a-b1ccea50a69b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:12.619712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f7912c4-851a-4bfc-960a-b1ccea50a69b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:12.620348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f7912c4-851a-4bfc-960a-b1ccea50a69b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:12.621257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f7912c4-851a-4bfc-960a-b1ccea50a69b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:12.621937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f7912c4-851a-4bfc-960a-b1ccea50a69b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:12.622579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f7912c4-851a-4bfc-960a-b1ccea50a69b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:13.188304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c6bcb590-bcd3-4b85-88be-0410607b67c9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:13.198817 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c6bcb590-bcd3-4b85-88be-0410607b67c9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1275 microversion: 2.1 time: 0.669386 Oct 11 19:43:13.199837 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 150/282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:12 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1275 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:13.204796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0aad1f5-1a0b-4b2f-8e72-0c8d91ee2863 tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:13.206798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0aad1f5-1a0b-4b2f-8e72-0c8d91ee2863 tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:13.207763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0aad1f5-1a0b-4b2f-8e72-0c8d91ee2863 tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:13.208436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0aad1f5-1a0b-4b2f-8e72-0c8d91ee2863 tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:13.209380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0aad1f5-1a0b-4b2f-8e72-0c8d91ee2863 tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:13.210151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0aad1f5-1a0b-4b2f-8e72-0c8d91ee2863 tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:13.212020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0aad1f5-1a0b-4b2f-8e72-0c8d91ee2863 tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:13.272414 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c0aad1f5-1a0b-4b2f-8e72-0c8d91ee2863 tempest-AZAdminV2TestJSON-206904647 tempest-AZAdminV2TestJSON-206904647-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.070998 Oct 11 19:43:13.273970 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 151/283] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 11 19:43:13 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:13.366466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4b6f68ee-9a25-4938-a2a8-bebbdf52f515 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:13.368108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4b6f68ee-9a25-4938-a2a8-bebbdf52f515 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:13.380875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b6f68ee-9a25-4938-a2a8-bebbdf52f515 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:13.381627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b6f68ee-9a25-4938-a2a8-bebbdf52f515 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:13.384920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b6f68ee-9a25-4938-a2a8-bebbdf52f515 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:13.386500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b6f68ee-9a25-4938-a2a8-bebbdf52f515 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:13.387310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b6f68ee-9a25-4938-a2a8-bebbdf52f515 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:13.387953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b6f68ee-9a25-4938-a2a8-bebbdf52f515 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:13.857582 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1f7912c4-851a-4bfc-960a-b1ccea50a69b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1645 microversion: 2.1 time: 1.250057 Oct 11 19:43:13.858244 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 133/284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:12 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1645 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:13.877609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8f0a99a7-575e-4ab8-8c57-be3826b0503e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:13.878227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8f0a99a7-575e-4ab8-8c57-be3826b0503e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:13.889528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f0a99a7-575e-4ab8-8c57-be3826b0503e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:13.890036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f0a99a7-575e-4ab8-8c57-be3826b0503e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:13.890471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f0a99a7-575e-4ab8-8c57-be3826b0503e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:13.891236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f0a99a7-575e-4ab8-8c57-be3826b0503e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:13.891722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f0a99a7-575e-4ab8-8c57-be3826b0503e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:13.892143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f0a99a7-575e-4ab8-8c57-be3826b0503e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:14.069657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4b6f68ee-9a25-4938-a2a8-bebbdf52f515 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:14.095074 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4b6f68ee-9a25-4938-a2a8-bebbdf52f515 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1320 microversion: 2.1 time: 0.732391 Oct 11 19:43:14.103336 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 152/285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:13 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1320 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:14.120601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-67039a4c-4704-4859-87f4-afb82214df88 req-28e43c95-496b-4619-8925-5e64a3fe1ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27956e70-3a33-46ba-98c8-f9dbfe444d2e", "tag": "a8198729-0bcb-443a-8dbd-3e7eac134b9d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:14.144526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-67039a4c-4704-4859-87f4-afb82214df88 req-28e43c95-496b-4619-8925-5e64a3fe1ada service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:14.144694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-67039a4c-4704-4859-87f4-afb82214df88 req-28e43c95-496b-4619-8925-5e64a3fe1ada service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:14.145326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-67039a4c-4704-4859-87f4-afb82214df88 req-28e43c95-496b-4619-8925-5e64a3fe1ada service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:14.196490 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-67039a4c-4704-4859-87f4-afb82214df88 req-28e43c95-496b-4619-8925-5e64a3fe1ada service nova] Creating event network-changed:a8198729-0bcb-443a-8dbd-3e7eac134b9d for instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e on n-h2-860864-3 Oct 11 19:43:14.214021 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-67039a4c-4704-4859-87f4-afb82214df88 req-28e43c95-496b-4619-8925-5e64a3fe1ada service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108854 Oct 11 19:43:14.216096 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 153/286] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:14.230492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fdf29941-62c8-494b-8f3e-e139b4439f39 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:14.238610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf29941-62c8-494b-8f3e-e139b4439f39 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:14.239099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf29941-62c8-494b-8f3e-e139b4439f39 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:14.239540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf29941-62c8-494b-8f3e-e139b4439f39 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:14.240264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf29941-62c8-494b-8f3e-e139b4439f39 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:14.240715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf29941-62c8-494b-8f3e-e139b4439f39 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:14.241125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf29941-62c8-494b-8f3e-e139b4439f39 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:14.270636 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fdf29941-62c8-494b-8f3e-e139b4439f39 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052730 Oct 11 19:43:14.271484 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 154/287] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 11 19:43:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:14.286136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e6091ab0-a748-4372-aac9-a3729b532768 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:14.287558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e6091ab0-a748-4372-aac9-a3729b532768 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:14.296995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6091ab0-a748-4372-aac9-a3729b532768 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:14.297868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6091ab0-a748-4372-aac9-a3729b532768 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:14.298652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6091ab0-a748-4372-aac9-a3729b532768 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:14.299932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6091ab0-a748-4372-aac9-a3729b532768 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:14.301046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6091ab0-a748-4372-aac9-a3729b532768 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:14.301684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6091ab0-a748-4372-aac9-a3729b532768 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:14.326667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8f0a99a7-575e-4ab8-8c57-be3826b0503e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:14.335241 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8f0a99a7-575e-4ab8-8c57-be3826b0503e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 200 len: 1585 microversion: 2.1 time: 0.475946 Oct 11 19:43:14.343425 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 134/288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:13 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 1585 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:14.349162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:14.355575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:14.375883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:14.376395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:14.376862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:14.377602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:14.378162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:14.378825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:14.562219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lazy-loading 'flavor' on Instance uuid 71ac645a-a576-4cad-a7f2-58d8920c2523 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:43:14.657270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Going to try to live migrate instance to n-h2-860864-3 {{(pid=126956) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 19:43:15.240753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e6091ab0-a748-4372-aac9-a3729b532768 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:15.267846 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e6091ab0-a748-4372-aac9-a3729b532768 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1317 microversion: 2.1 time: 0.994292 Oct 11 19:43:15.269369 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 155/289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:14 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1317 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:15.278644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b4dd6fcf-34e9-4df2-b7d7-82012f5784d4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:15.279546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b4dd6fcf-34e9-4df2-b7d7-82012f5784d4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:15.329539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4dd6fcf-34e9-4df2-b7d7-82012f5784d4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:15.330758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4dd6fcf-34e9-4df2-b7d7-82012f5784d4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:15.333139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4dd6fcf-34e9-4df2-b7d7-82012f5784d4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:15.338082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4dd6fcf-34e9-4df2-b7d7-82012f5784d4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:15.341155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4dd6fcf-34e9-4df2-b7d7-82012f5784d4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:15.343879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4dd6fcf-34e9-4df2-b7d7-82012f5784d4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:16.547778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b4dd6fcf-34e9-4df2-b7d7-82012f5784d4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:16.556278 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b4dd6fcf-34e9-4df2-b7d7-82012f5784d4 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1320 microversion: 2.1 time: 1.285352 Oct 11 19:43:16.563224 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 156/290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:15 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1320 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:16.573510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5cdf3052-a7f9-476b-b5e4-4aba72d54eb2 req-7bb1937c-a8ff-4897-a10b-2335cbf004c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f601b40f-73ac-45fa-8e64-093dfeaf1b4a", "name": "network-vif-plugged", "status": "completed", "tag": "20c9f587-0ead-4247-af06-840e4129c936"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:16.601426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5cdf3052-a7f9-476b-b5e4-4aba72d54eb2 req-7bb1937c-a8ff-4897-a10b-2335cbf004c3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:16.601934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5cdf3052-a7f9-476b-b5e4-4aba72d54eb2 req-7bb1937c-a8ff-4897-a10b-2335cbf004c3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:16.602445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5cdf3052-a7f9-476b-b5e4-4aba72d54eb2 req-7bb1937c-a8ff-4897-a10b-2335cbf004c3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:16.634446 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5cdf3052-a7f9-476b-b5e4-4aba72d54eb2 req-7bb1937c-a8ff-4897-a10b-2335cbf004c3 service nova] Creating event network-vif-plugged:20c9f587-0ead-4247-af06-840e4129c936 for instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a on n-h1-860864-3 Oct 11 19:43:16.647646 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5cdf3052-a7f9-476b-b5e4-4aba72d54eb2 req-7bb1937c-a8ff-4897-a10b-2335cbf004c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082790 Oct 11 19:43:16.649216 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 157/291] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:16.655591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c23e1a5-bffc-44a5-a21d-d45cf30de9c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:16.663725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c23e1a5-bffc-44a5-a21d-d45cf30de9c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:16.681605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23e1a5-bffc-44a5-a21d-d45cf30de9c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:16.682117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23e1a5-bffc-44a5-a21d-d45cf30de9c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:16.682595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23e1a5-bffc-44a5-a21d-d45cf30de9c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:16.683337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23e1a5-bffc-44a5-a21d-d45cf30de9c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:16.683760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23e1a5-bffc-44a5-a21d-d45cf30de9c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:16.684182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23e1a5-bffc-44a5-a21d-d45cf30de9c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:17.458155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9c23e1a5-bffc-44a5-a21d-d45cf30de9c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:17.469611 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c23e1a5-bffc-44a5-a21d-d45cf30de9c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1317 microversion: 2.1 time: 0.818908 Oct 11 19:43:17.484332 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 158/292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:16 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1317 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:17.581094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d914258-f148-4d61-91d5-df0703267afa tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:17.583110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6d914258-f148-4d61-91d5-df0703267afa tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:17.592893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d914258-f148-4d61-91d5-df0703267afa tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:17.594056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d914258-f148-4d61-91d5-df0703267afa tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:17.594741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d914258-f148-4d61-91d5-df0703267afa tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:17.595666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d914258-f148-4d61-91d5-df0703267afa tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:17.597499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d914258-f148-4d61-91d5-df0703267afa tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:17.598210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d914258-f148-4d61-91d5-df0703267afa tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:18.588472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6d914258-f148-4d61-91d5-df0703267afa tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:18.599725 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6d914258-f148-4d61-91d5-df0703267afa tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1320 microversion: 2.1 time: 1.023281 Oct 11 19:43:18.605467 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 159/293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:17 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1320 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:18.724008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=32 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:19.042447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4d19a74a-3ab0-4b67-b78a-1d4e9ce6338c tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-182732624", "id": 1172399608, "os-flavor-access:is_public": "False"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:19.095409 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4d19a74a-3ab0-4b67-b78a-1d4e9ce6338c tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.488587 Oct 11 19:43:19.096397 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 160/294] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:18 2022] POST /compute/v2.1/flavors => generated 438 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:19.104328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7239aee8-882f-4eb0-8f62-86cac9cd3ec9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:19.105534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7239aee8-882f-4eb0-8f62-86cac9cd3ec9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:19.114031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7239aee8-882f-4eb0-8f62-86cac9cd3ec9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:19.115820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7239aee8-882f-4eb0-8f62-86cac9cd3ec9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:19.116526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7239aee8-882f-4eb0-8f62-86cac9cd3ec9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:19.118216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7239aee8-882f-4eb0-8f62-86cac9cd3ec9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:19.119093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7239aee8-882f-4eb0-8f62-86cac9cd3ec9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:19.119832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7239aee8-882f-4eb0-8f62-86cac9cd3ec9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:19.550615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7239aee8-882f-4eb0-8f62-86cac9cd3ec9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:19.571344 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7239aee8-882f-4eb0-8f62-86cac9cd3ec9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1317 microversion: 2.1 time: 0.472831 Oct 11 19:43:19.572951 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 161/295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:19 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:19.579692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7faa3617-6b9c-453d-92ac-c41eef8115e8 req-f015752b-6447-4fa7-b209-db523658f309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bfcd6d-640c-4cae-8025-09798db76580", "tag": "20d5c53b-0385-4ec9-b7ac-f5872bfa0bb3"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:19.593334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7faa3617-6b9c-453d-92ac-c41eef8115e8 req-f015752b-6447-4fa7-b209-db523658f309 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:19.594733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7faa3617-6b9c-453d-92ac-c41eef8115e8 req-f015752b-6447-4fa7-b209-db523658f309 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:19.595373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7faa3617-6b9c-453d-92ac-c41eef8115e8 req-f015752b-6447-4fa7-b209-db523658f309 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:19.627728 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7faa3617-6b9c-453d-92ac-c41eef8115e8 req-f015752b-6447-4fa7-b209-db523658f309 service nova] Creating event network-changed:20d5c53b-0385-4ec9-b7ac-f5872bfa0bb3 for instance a3bfcd6d-640c-4cae-8025-09798db76580 on n-h1-860864-3 Oct 11 19:43:19.634892 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7faa3617-6b9c-453d-92ac-c41eef8115e8 req-f015752b-6447-4fa7-b209-db523658f309 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059934 Oct 11 19:43:19.635832 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 162/296] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:19.641422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-806c1228-5c37-4190-beb0-85a462db4d3b tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3aa955b65ff445ad9b6b2148042eaabc"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:19.739225 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-806c1228-5c37-4190-beb0-85a462db4d3b tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1172399608/action" status: 200 len: 97 microversion: 2.1 time: 0.101942 Oct 11 19:43:19.740151 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 163/297] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 11 19:43:19 2022] POST /compute/v2.1/flavors/1172399608/action => generated 97 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:43:19.748597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4f608197-7c0e-4a89-819a-47171074e30e req-b033e071-6a30-4d1f-90cd-0e5f04c00b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28f5e45d-a8da-4de0-b75a-3e8a3119d855", "tag": "7e7af7a4-dce7-4f1b-924e-0a177b2ccdfc"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:19.760709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4f608197-7c0e-4a89-819a-47171074e30e req-b033e071-6a30-4d1f-90cd-0e5f04c00b25 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:19.761215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4f608197-7c0e-4a89-819a-47171074e30e req-b033e071-6a30-4d1f-90cd-0e5f04c00b25 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:19.761643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4f608197-7c0e-4a89-819a-47171074e30e req-b033e071-6a30-4d1f-90cd-0e5f04c00b25 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:19.776771 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4f608197-7c0e-4a89-819a-47171074e30e req-b033e071-6a30-4d1f-90cd-0e5f04c00b25 service nova] Creating event network-changed:7e7af7a4-dce7-4f1b-924e-0a177b2ccdfc for instance 28f5e45d-a8da-4de0-b75a-3e8a3119d855 on n-h1-860864-3 Oct 11 19:43:19.783819 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4f608197-7c0e-4a89-819a-47171074e30e req-b033e071-6a30-4d1f-90cd-0e5f04c00b25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041593 Oct 11 19:43:19.785614 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 164/298] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:19.793725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5b9ec341-ae6a-4487-b872-a8bc8815e89c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:19.794725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5b9ec341-ae6a-4487-b872-a8bc8815e89c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:19.802220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b9ec341-ae6a-4487-b872-a8bc8815e89c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:19.803529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b9ec341-ae6a-4487-b872-a8bc8815e89c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:19.804647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b9ec341-ae6a-4487-b872-a8bc8815e89c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:19.805580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b9ec341-ae6a-4487-b872-a8bc8815e89c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:19.806358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b9ec341-ae6a-4487-b872-a8bc8815e89c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:19.807623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b9ec341-ae6a-4487-b872-a8bc8815e89c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:20.092578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5b9ec341-ae6a-4487-b872-a8bc8815e89c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:20.105289 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5b9ec341-ae6a-4487-b872-a8bc8815e89c tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1470 microversion: 2.1 time: 0.318089 Oct 11 19:43:20.105882 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 165/299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:19 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:20.115781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e67d1a8c-0e89-4cf3-a50a-989cf4d103be tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3aa955b65ff445ad9b6b2148042eaabc"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:20.265605 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-329417d5-6c63-4c34-a29d-68182f28cef1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523/action" status: 202 len: 0 microversion: 2.1 time: 5.920689 Oct 11 19:43:20.270032 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 135/300] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:43:14 2022] POST /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523/action => generated 0 bytes in 5923 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:20.287147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62e8c779-34f8-4153-9a6a-3ef5077f0090 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:20.302873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-62e8c779-34f8-4153-9a6a-3ef5077f0090 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:20.322209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e8c779-34f8-4153-9a6a-3ef5077f0090 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:20.334679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e8c779-34f8-4153-9a6a-3ef5077f0090 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:20.335898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e8c779-34f8-4153-9a6a-3ef5077f0090 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:20.338328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e8c779-34f8-4153-9a6a-3ef5077f0090 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:20.340451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e8c779-34f8-4153-9a6a-3ef5077f0090 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:20.341422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e8c779-34f8-4153-9a6a-3ef5077f0090 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:20.536088 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-62e8c779-34f8-4153-9a6a-3ef5077f0090 tempest-DeleteServersAdminTestJSON-688197241 tempest-DeleteServersAdminTestJSON-688197241-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a/action" status: 202 len: 0 microversion: 2.1 time: 0.259794 Oct 11 19:43:20.536819 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 136/301] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:43:20 2022] POST /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:20.544695 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e67d1a8c-0e89-4cf3-a50a-989cf4d103be tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 3aa955b65ff445ad9b6b2148042eaabc combination. Oct 11 19:43:20.554893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-147f8eaa-b743-46d0-859e-97027707c55a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:20.556114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-147f8eaa-b743-46d0-859e-97027707c55a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:20.564076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-147f8eaa-b743-46d0-859e-97027707c55a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:20.565538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-147f8eaa-b743-46d0-859e-97027707c55a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:20.566158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-147f8eaa-b743-46d0-859e-97027707c55a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:20.567182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-147f8eaa-b743-46d0-859e-97027707c55a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:20.567795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-147f8eaa-b743-46d0-859e-97027707c55a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:20.568424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-147f8eaa-b743-46d0-859e-97027707c55a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e67d1a8c-0e89-4cf3-a50a-989cf4d103be tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Request method failure captured: Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/flavors/1172399608/action HTTP/1.1 Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 67 Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdURbyXr8sNNpMmi-IxpfScUjVkOHklAQLFsSxS3uofszrGxSK4XtxVjEPFa2E7kPLTgYvWCsgEb2JomZp0hKSTJvHpcATyDzw3ihM3Q-OmqoqR_jX2uUMhNM4Wa2Ts4HNEkjjOX0QOvEurvB2U6xKhQIc8iAds-StuRxxXp0O1VS4 Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c937166183d24ec9b09e5f6aaa877c78 Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-889082205 Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:43:20.597451 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c937166183d24ec9b09e5f6aaa877c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c937166183d24ec9b09e5f6aaa877c78", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c937166183d24ec9b09e5f6aaa877c78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c937166183d24ec9b09e5f6aaa877c78"}]}] Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-889082205 Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c937166183d24ec9b09e5f6aaa877c78 Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-889082205 Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f94add2cfe734d3bb906fd36c38c3817 Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: {"addTenantAccess": {"tenant": "3aa955b65ff445ad9b6b2148042eaabc"}} Oct 11 19:43:20.599250 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: exception: Flavor access already exists for flavor 17 and project 3aa955b65ff445ad9b6b2148042eaabc combination. Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '1172399608', 'body': {'addTenantAccess': {'tenant': '3aa955b65ff445ad9b6b2148042eaabc'}}} Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result.read() Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 19:43:20.600080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-3aa955b65ff445ad9b6b2148042eaabc' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 19:43:20.601859 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 19:43:20.607032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 19:43:20.608202 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result.read() Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-3aa955b65ff445ad9b6b2148042eaabc' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 19, 43, 20, 530966), 'updated_at': None, 'flavor_id': 17, 'project_id': '3aa955b65ff445ad9b6b2148042eaabc'}] Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:20.609361 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project 3aa955b65ff445ad9b6b2148042eaabc combination. Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:20.611769 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project 3aa955b65ff445ad9b6b2148042eaabc combination. Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:20.613101 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:20.614474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project 3aa955b65ff445ad9b6b2148042eaabc combination. Oct 11 19:43:20.614474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:20.614474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e67d1a8c-0e89-4cf3-a50a-989cf4d103be tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 3aa955b65ff445ad9b6b2148042eaabc combination. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:20.614474 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e67d1a8c-0e89-4cf3-a50a-989cf4d103be tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1172399608/action" status: 409 len: 152 microversion: 2.1 time: 0.488777 Oct 11 19:43:20.614474 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 166/302] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 11 19:43:20 2022] POST /compute/v2.1/flavors/1172399608/action => generated 152 bytes in 490 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:43:20.614474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:20.614947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:20.644371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:20.644877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:20.645320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:20.646038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:20.646500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:20.646957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:20.729241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:20.729737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:20.730179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:20.731471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lazy-loading 'fault' on Instance uuid f601b40f-73ac-45fa-8e64-093dfeaf1b4a {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:43:20.852803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-147f8eaa-b743-46d0-859e-97027707c55a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:20.862733 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-147f8eaa-b743-46d0-859e-97027707c55a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1504 microversion: 2.1 time: 0.321168 Oct 11 19:43:20.879204 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 137/303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:20 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:20.887172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4928a438-7934-41e9-a906-9a37eef234d1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:20.888120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4928a438-7934-41e9-a906-9a37eef234d1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:20.898662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4928a438-7934-41e9-a906-9a37eef234d1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:20.900140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4928a438-7934-41e9-a906-9a37eef234d1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:20.901086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4928a438-7934-41e9-a906-9a37eef234d1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:20.902285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4928a438-7934-41e9-a906-9a37eef234d1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:20.903225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4928a438-7934-41e9-a906-9a37eef234d1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:20.904009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4928a438-7934-41e9-a906-9a37eef234d1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:21.003538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:21.013237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ebc4001f-03e9-41fe-898c-c4a5d2eadcf7 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1453 microversion: 2.1 time: 0.412362 Oct 11 19:43:21.028357 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 167/304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:20 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1453 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:21.038895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7a55fc9e-adf2-47e0-9f9f-6a1bbff2482c tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3aa955b65ff445ad9b6b2148042eaabc"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:21.230437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4928a438-7934-41e9-a906-9a37eef234d1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:21.238603 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4928a438-7934-41e9-a906-9a37eef234d1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1317 microversion: 2.1 time: 0.357802 Oct 11 19:43:21.248265 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 138/305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:20 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:21.263720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c36ce5c9-c7c6-4917-a9cf-a36d040385cf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:21.265394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c36ce5c9-c7c6-4917-a9cf-a36d040385cf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:21.292622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce5c9-c7c6-4917-a9cf-a36d040385cf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:21.297180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce5c9-c7c6-4917-a9cf-a36d040385cf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:21.299133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce5c9-c7c6-4917-a9cf-a36d040385cf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:21.301824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce5c9-c7c6-4917-a9cf-a36d040385cf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:21.304702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce5c9-c7c6-4917-a9cf-a36d040385cf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:21.305228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce5c9-c7c6-4917-a9cf-a36d040385cf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:21.360834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c36ce5c9-c7c6-4917-a9cf-a36d040385cf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:43:21.501959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:21.535771 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c36ce5c9-c7c6-4917-a9cf-a36d040385cf tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 204 len: 0 microversion: 2.1 time: 0.282114 Oct 11 19:43:21.542474 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 139/306] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:43:21 2022] DELETE /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:43:21.558781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:21.560873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:21.577825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:21.582669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:21.583322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:21.584729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:21.587230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:21.589520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:21.707577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:21.711910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:21.712962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:21.714055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lazy-loading 'fault' on Instance uuid f601b40f-73ac-45fa-8e64-093dfeaf1b4a {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:43:21.729025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:21.732194 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7a55fc9e-adf2-47e0-9f9f-6a1bbff2482c tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1172399608/action" status: 200 len: 21 microversion: 2.1 time: 0.702362 Oct 11 19:43:21.733861 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 168/307] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 11 19:43:21 2022] POST /compute/v2.1/flavors/1172399608/action => generated 21 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:43:21.751848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a940c9c1-47aa-438e-815a-0d30525a718d tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:21.800315 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a940c9c1-47aa-438e-815a-0d30525a718d tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1172399608" status: 202 len: 0 microversion: 2.1 time: 0.060059 Oct 11 19:43:21.801294 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 169/308] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:21 2022] DELETE /compute/v2.1/flavors/1172399608 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:21.812907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-83884782-d58f-4494-b515-2553607d8bb0 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:21.919292 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-83884782-d58f-4494-b515-2553607d8bb0 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.113060 Oct 11 19:43:21.919913 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 170/309] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:21 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:21.927590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05954226-92da-4e88-a60c-ae708ba9299f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:21.928196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05954226-92da-4e88-a60c-ae708ba9299f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:21.944783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05954226-92da-4e88-a60c-ae708ba9299f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:21.945403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05954226-92da-4e88-a60c-ae708ba9299f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:21.945862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05954226-92da-4e88-a60c-ae708ba9299f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:21.950638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05954226-92da-4e88-a60c-ae708ba9299f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:21.951473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05954226-92da-4e88-a60c-ae708ba9299f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:21.952668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05954226-92da-4e88-a60c-ae708ba9299f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:22.084733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:22.096050 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e008edd-770d-4cc9-884c-195671c1362a tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1459 microversion: 2.1 time: 0.551430 Oct 11 19:43:22.097415 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 140/310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:21 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1459 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:22.104010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7bbec35e-8da9-4076-8355-a304fd7c20f0 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1639207118", "id": 1281449999, "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:22.137192 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7bbec35e-8da9-4076-8355-a304fd7c20f0 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.037633 Oct 11 19:43:22.146734 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 141/311] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:22 2022] POST /compute/v2.1/flavors => generated 438 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:22.155220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0942abf-5238-42bf-a358-c13b27c6db5d tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:22.181253 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a0942abf-5238-42bf-a358-c13b27c6db5d tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0942abf-5238-42bf-a358-c13b27c6db5d tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Request method failure captured: Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/flavors/1281449999/os-flavor-access HTTP/1.1 Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcdURbyXr8sNNpMmi-IxpfScUjVkOHklAQLFsSxS3uofszrGxSK4XtxVjEPFa2E7kPLTgYvWCsgEb2JomZp0hKSTJvHpcATyDzw3ihM3Q-OmqoqR_jX2uUMhNM4Wa2Ts4HNEkjjOX0QOvEurvB2U6xKhQIc8iAds-StuRxxXp0O1VS4 Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: c937166183d24ec9b09e5f6aaa877c78 Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-889082205 Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:43:22.185784 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c937166183d24ec9b09e5f6aaa877c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c937166183d24ec9b09e5f6aaa877c78", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c937166183d24ec9b09e5f6aaa877c78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c937166183d24ec9b09e5f6aaa877c78"}]}] Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-889082205 Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: c937166183d24ec9b09e5f6aaa877c78 Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-889082205 Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: f94add2cfe734d3bb906fd36c38c3817 Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: exception: Access list not available for public flavors. Oct 11 19:43:22.187291 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'flavor_id': '1281449999'} Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 11 19:43:22.188156 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:22.189661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0942abf-5238-42bf-a358-c13b27c6db5d tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:22.189661 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a0942abf-5238-42bf-a358-c13b27c6db5d tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1281449999/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.040388 Oct 11 19:43:22.190225 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 142/312] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 11 19:43:22 2022] GET /compute/v2.1/flavors/1281449999/os-flavor-access => generated 91 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:43:22.201215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eae8b052-5b83-4431-a915-bf590edf54b6 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:22.256034 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eae8b052-5b83-4431-a915-bf590edf54b6 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1281449999" status: 202 len: 0 microversion: 2.1 time: 0.058460 Oct 11 19:43:22.262484 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 143/313] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:22 2022] DELETE /compute/v2.1/flavors/1281449999 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:22.271364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e8936c7c-4b0f-4463-8827-e61cf026669e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:22.272861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e8936c7c-4b0f-4463-8827-e61cf026669e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:22.281166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8936c7c-4b0f-4463-8827-e61cf026669e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:22.282510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8936c7c-4b0f-4463-8827-e61cf026669e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:22.283084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8936c7c-4b0f-4463-8827-e61cf026669e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:22.283881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8936c7c-4b0f-4463-8827-e61cf026669e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:22.284418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8936c7c-4b0f-4463-8827-e61cf026669e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:22.284850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8936c7c-4b0f-4463-8827-e61cf026669e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:22.583450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:22.839547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-05954226-92da-4e88-a60c-ae708ba9299f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:22.848669 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05954226-92da-4e88-a60c-ae708ba9299f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1504 microversion: 2.1 time: 0.927711 Oct 11 19:43:22.849242 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 171/314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:21 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1504 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:22.868133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d0b698bf-12a4-49dc-902c-4681d7f45cf6 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:22.907425 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d0b698bf-12a4-49dc-902c-4681d7f45cf6 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.053087 Oct 11 19:43:22.915348 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 172/315] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:22 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:22.981570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e8936c7c-4b0f-4463-8827-e61cf026669e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:22.994423 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e8936c7c-4b0f-4463-8827-e61cf026669e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1317 microversion: 2.1 time: 0.726999 Oct 11 19:43:23.006551 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 144/316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:22 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:23.006551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-65de71b3-6acf-4855-942b-274c6f31813e tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1524322688", "id": 247198005, "os-flavor-access:is_public": "False"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:23.049913 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-65de71b3-6acf-4855-942b-274c6f31813e tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.053686 Oct 11 19:43:23.050612 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 145/317] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:22 2022] POST /compute/v2.1/flavors => generated 436 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:23.112687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e251d0f1-f6b0-4b93-9851-7af7c6362004 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1268322314", "id": 1655484841, "os-flavor-access:is_public": "True"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:23.152604 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e251d0f1-f6b0-4b93-9851-7af7c6362004 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.233810 Oct 11 19:43:23.154762 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 173/318] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:22 2022] POST /compute/v2.1/flavors => generated 430 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:23.170151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:23.171083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:23.189529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:23.190235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:23.195904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:23.197161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:23.197932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:23.200220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:23.283364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:23.285076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:23.285529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:23.286468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lazy-loading 'fault' on Instance uuid f601b40f-73ac-45fa-8e64-093dfeaf1b4a {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:43:23.347848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-39114974-a229-4fb2-9ea3-2fe0214fdc8d tempest-FlavorsAccessNegativeTestJSON-532170231 tempest-FlavorsAccessNegativeTestJSON-532170231-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3aa955b65ff445ad9b6b2148042eaabc"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:23.356930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-39114974-a229-4fb2-9ea3-2fe0214fdc8d tempest-FlavorsAccessNegativeTestJSON-532170231 tempest-FlavorsAccessNegativeTestJSON-532170231-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '024b34c60ca34c53a78cd4b7e4db28a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa955b65ff445ad9b6b2148042eaabc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-39114974-a229-4fb2-9ea3-2fe0214fdc8d tempest-FlavorsAccessNegativeTestJSON-532170231 tempest-FlavorsAccessNegativeTestJSON-532170231-project] Request method failure captured: Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/flavors/247198005/action HTTP/1.1 Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 67 Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcdS7gdkz1ssmOwUnhg_F0Eh-8WBTJ9rHjGicAohewkqREW5uzKMxU9KaBUFgbv3MrREah2fxRlpJtRofHYUZAuPjnPujPMV6BYBC11qbbHHUnRj09PDboMfPN0ljcfJURy4GqrsrGT25xDp3W0sXl3D77aYO_UuBVICgHwTGrtFKgo Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3aa955b65ff445ad9b6b2148042eaabc Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-532170231 Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:43:23.359711 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3aa955b65ff445ad9b6b2148042eaabc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3aa955b65ff445ad9b6b2148042eaabc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3aa955b65ff445ad9b6b2148042eaabc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3aa955b65ff445ad9b6b2148042eaabc"}]}] Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-532170231 Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3aa955b65ff445ad9b6b2148042eaabc Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-532170231 Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-FlavorsAccessNegativeTestJSON-532170231-project Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 024b34c60ca34c53a78cd4b7e4db28a6 Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-532170231-project Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: {"addTenantAccess": {"tenant": "3aa955b65ff445ad9b6b2148042eaabc"}} Oct 11 19:43:23.361123 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '247198005', 'body': {'addTenantAccess': {'tenant': '3aa955b65ff445ad9b6b2148042eaabc'}}} Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:43:23.361917 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 19:43:23.363198 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:23.365228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-39114974-a229-4fb2-9ea3-2fe0214fdc8d tempest-FlavorsAccessNegativeTestJSON-532170231 tempest-FlavorsAccessNegativeTestJSON-532170231-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:23.367536 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-39114974-a229-4fb2-9ea3-2fe0214fdc8d tempest-FlavorsAccessNegativeTestJSON-532170231 tempest-FlavorsAccessNegativeTestJSON-532170231-project] 10.222.0.27 "POST /compute/v2.1/flavors/247198005/action" status: 403 len: 130 microversion: 2.1 time: 0.306965 Oct 11 19:43:23.368734 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 146/319] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Oct 11 19:43:23 2022] POST /compute/v2.1/flavors/247198005/action => generated 130 bytes in 310 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:43:23.374617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-afb48f49-aa58-4000-bbbf-831257fdff85 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:23.419594 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-afb48f49-aa58-4000-bbbf-831257fdff85 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1655484841" status: 202 len: 0 microversion: 2.1 time: 0.049268 Oct 11 19:43:23.421076 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 147/320] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:23 2022] DELETE /compute/v2.1/flavors/1655484841 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:23.426790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-039c36e1-5691-4b8d-a6e4-90af2f3ae6e7 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:23.457751 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-039c36e1-5691-4b8d-a6e4-90af2f3ae6e7 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/247198005" status: 202 len: 0 microversion: 2.1 time: 0.035051 Oct 11 19:43:23.458356 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 148/321] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:43:23 2022] DELETE /compute/v2.1/flavors/247198005 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:23.463829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eee14b5f-e68f-40fd-ac75-7571e66a3e33 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:23.531726 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eee14b5f-e68f-40fd-ac75-7571e66a3e33 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.072222 Oct 11 19:43:23.532944 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 149/322] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:23 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:23.539508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b93185da-2882-41a8-b99a-f0534e4ba8c9 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:23.571282 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b93185da-2882-41a8-b99a-f0534e4ba8c9 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.037055 Oct 11 19:43:23.572453 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 150/323] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:23 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:23.577495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-69cf4f89-6af5-45ab-a12a-7eeffa6e97b7 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-887673815", "id": 1722259663, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:23.611688 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-69cf4f89-6af5-45ab-a12a-7eeffa6e97b7 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.037731 Oct 11 19:43:23.612396 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 151/324] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:23 2022] POST /compute/v2.1/flavors => generated 416 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:23.623297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a61718c3-8737-49ad-817a-a803919d9fb6 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1009540753", "id": 1512991832, "os-flavor-access:is_public": "False"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:23.661028 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a61718c3-8737-49ad-817a-a803919d9fb6 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.047398 Oct 11 19:43:23.662057 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 152/325] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:23 2022] POST /compute/v2.1/flavors => generated 439 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:23.670693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5e7d2002-1eaf-46ed-b0f5-c3829bd0314b tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:23.722774 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5e7d2002-1eaf-46ed-b0f5-c3829bd0314b tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.058223 Oct 11 19:43:23.724007 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 153/326] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:23 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:23.729834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1844ba8c-eae7-4401-b0ac-e43542a2feaf tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3aa955b65ff445ad9b6b2148042eaabc"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:23.960734 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1844ba8c-eae7-4401-b0ac-e43542a2feaf tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1512991832/action" status: 200 len: 97 microversion: 2.1 time: 0.235400 Oct 11 19:43:23.968625 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 154/327] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 11 19:43:23 2022] POST /compute/v2.1/flavors/1512991832/action => generated 97 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:43:23.973404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-180dcc2a-03eb-48ab-bdb6-d1fa9e54d0fb tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:24.014289 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-180dcc2a-03eb-48ab-bdb6-d1fa9e54d0fb tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1722259663" status: 202 len: 0 microversion: 2.1 time: 0.047424 Oct 11 19:43:24.018311 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 155/328] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:23 2022] DELETE /compute/v2.1/flavors/1722259663 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:24.024030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9ee76025-af96-40d9-b443-b622593b13c2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:24.024787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9ee76025-af96-40d9-b443-b622593b13c2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:24.031250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee76025-af96-40d9-b443-b622593b13c2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:24.031867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee76025-af96-40d9-b443-b622593b13c2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:24.032411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee76025-af96-40d9-b443-b622593b13c2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:24.033368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee76025-af96-40d9-b443-b622593b13c2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:24.033953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee76025-af96-40d9-b443-b622593b13c2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:24.034471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee76025-af96-40d9-b443-b622593b13c2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:24.251194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:24.592514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:24.629198 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f7b8284c-8fd8-4b94-8c84-950ca80ed392 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1459 microversion: 2.1 time: 1.471944 Oct 11 19:43:24.642017 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 174/329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:23 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1459 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:24.665323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32283c2c-b92b-4173-82fc-b8916feae618 tempest-FlavorsAccessNegativeTestJSON-532170231 tempest-FlavorsAccessNegativeTestJSON-532170231-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3aa955b65ff445ad9b6b2148042eaabc"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:24.676662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-32283c2c-b92b-4173-82fc-b8916feae618 tempest-FlavorsAccessNegativeTestJSON-532170231 tempest-FlavorsAccessNegativeTestJSON-532170231-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '024b34c60ca34c53a78cd4b7e4db28a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa955b65ff445ad9b6b2148042eaabc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32283c2c-b92b-4173-82fc-b8916feae618 tempest-FlavorsAccessNegativeTestJSON-532170231 tempest-FlavorsAccessNegativeTestJSON-532170231-project] Request method failure captured: Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/flavors/1512991832/action HTTP/1.1 Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 70 Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdS7gdkz1ssmOwUnhg_F0Eh-8WBTJ9rHjGicAohewkqREW5uzKMxU9KaBUFgbv3MrREah2fxRlpJtRofHYUZAuPjnPujPMV6BYBC11qbbHHUnRj09PDboMfPN0ljcfJURy4GqrsrGT25xDp3W0sXl3D77aYO_UuBVICgHwTGrtFKgo Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3aa955b65ff445ad9b6b2148042eaabc Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-532170231 Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:24.679358 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3aa955b65ff445ad9b6b2148042eaabc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3aa955b65ff445ad9b6b2148042eaabc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3aa955b65ff445ad9b6b2148042eaabc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3aa955b65ff445ad9b6b2148042eaabc"}]}] Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-532170231 Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3aa955b65ff445ad9b6b2148042eaabc Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-532170231 Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FlavorsAccessNegativeTestJSON-532170231-project Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 024b34c60ca34c53a78cd4b7e4db28a6 Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-532170231-project Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: {"removeTenantAccess": {"tenant": "3aa955b65ff445ad9b6b2148042eaabc"}} Oct 11 19:43:24.680939 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '1512991832', 'body': {'removeTenantAccess': {'tenant': '3aa955b65ff445ad9b6b2148042eaabc'}}} Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can( Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:24.681751 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 19:43:24.683027 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:24.684202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32283c2c-b92b-4173-82fc-b8916feae618 tempest-FlavorsAccessNegativeTestJSON-532170231 tempest-FlavorsAccessNegativeTestJSON-532170231-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:24.684202 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-32283c2c-b92b-4173-82fc-b8916feae618 tempest-FlavorsAccessNegativeTestJSON-532170231 tempest-FlavorsAccessNegativeTestJSON-532170231-project] 10.222.0.27 "POST /compute/v2.1/flavors/1512991832/action" status: 403 len: 133 microversion: 2.1 time: 0.038226 Oct 11 19:43:24.685401 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 175/330] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 11 19:43:24 2022] POST /compute/v2.1/flavors/1512991832/action => generated 133 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:24.691384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bbd82f35-c87c-4b9a-96d1-0573a529f122 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:24.692000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bbd82f35-c87c-4b9a-96d1-0573a529f122 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:24.700923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbd82f35-c87c-4b9a-96d1-0573a529f122 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:24.701424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbd82f35-c87c-4b9a-96d1-0573a529f122 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:24.701960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbd82f35-c87c-4b9a-96d1-0573a529f122 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:24.702661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbd82f35-c87c-4b9a-96d1-0573a529f122 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:24.703118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbd82f35-c87c-4b9a-96d1-0573a529f122 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:24.703592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbd82f35-c87c-4b9a-96d1-0573a529f122 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:24.712071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:25.775623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9ee76025-af96-40d9-b443-b622593b13c2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:25.797306 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9ee76025-af96-40d9-b443-b622593b13c2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1504 microversion: 2.1 time: 1.777737 Oct 11 19:43:25.797898 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 156/331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:24 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1504 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:25.809068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-02dc63e8-d48a-4e50-8827-8ccee71728bc tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:25.878739 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-02dc63e8-d48a-4e50-8827-8ccee71728bc tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.075027 Oct 11 19:43:25.881108 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 157/332] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:25 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:25.893091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bdd41bee-1349-4bbf-8de3-7f164684576c tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3aa955b65ff445ad9b6b2148042eaabc"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:26.044391 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bdd41bee-1349-4bbf-8de3-7f164684576c tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1512991832/action" status: 200 len: 21 microversion: 2.1 time: 0.160729 Oct 11 19:43:26.045862 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 158/333] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 11 19:43:25 2022] POST /compute/v2.1/flavors/1512991832/action => generated 21 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:43:26.057965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-dbef78d1-81c1-4405-a027-36e855467ed7 req-0d0d67b9-7549-4bb9-8888-f73f422bcd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f601b40f-73ac-45fa-8e64-093dfeaf1b4a", "name": "network-vif-deleted", "tag": "20c9f587-0ead-4247-af06-840e4129c936"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:26.080557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dbef78d1-81c1-4405-a027-36e855467ed7 req-0d0d67b9-7549-4bb9-8888-f73f422bcd1e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:26.081081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dbef78d1-81c1-4405-a027-36e855467ed7 req-0d0d67b9-7549-4bb9-8888-f73f422bcd1e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:26.081528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dbef78d1-81c1-4405-a027-36e855467ed7 req-0d0d67b9-7549-4bb9-8888-f73f422bcd1e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:26.105076 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-dbef78d1-81c1-4405-a027-36e855467ed7 req-0d0d67b9-7549-4bb9-8888-f73f422bcd1e service nova] Creating event network-vif-deleted:20c9f587-0ead-4247-af06-840e4129c936 for instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a on n-h1-860864-3 Oct 11 19:43:26.112967 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-dbef78d1-81c1-4405-a027-36e855467ed7 req-0d0d67b9-7549-4bb9-8888-f73f422bcd1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065650 Oct 11 19:43:26.114253 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 159/334] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:26.134063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:26.136382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:26.146332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:26.147196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:26.148034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:26.149130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:26.150434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:26.153011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:26.165581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bbd82f35-c87c-4b9a-96d1-0573a529f122 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:26.178371 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bbd82f35-c87c-4b9a-96d1-0573a529f122 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1317 microversion: 2.1 time: 1.491623 Oct 11 19:43:26.179690 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 176/335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:24 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1317 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:26.226896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:26.229125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:26.230339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:26.234292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lazy-loading 'fault' on Instance uuid f601b40f-73ac-45fa-8e64-093dfeaf1b4a {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:43:26.347732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1806492284", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "7a7a5c8e-4510-4be6-9fd7-12b19dbcc68f"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:26.402697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a07205057b54dc5a85ec740783c3dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ed7b56298642c58cf65003f2853902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:26.415633 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a805bdf3-3661-4946-a487-f3c6785b40ab tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 200 len: 1310 microversion: 2.1 time: 0.292366 Oct 11 19:43:26.417018 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 160/336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:26 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 1310 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:26.427642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-0bb45593-92b0-4490-a6d3-42fcf3bb7858 req-eae7cafe-3147-4de1-8f3d-77e77a199da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bfcd6d-640c-4cae-8025-09798db76580", "name": "network-vif-plugged", "status": "completed", "tag": "20d5c53b-0385-4ec9-b7ac-f5872bfa0bb3"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:26.476039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0bb45593-92b0-4490-a6d3-42fcf3bb7858 req-eae7cafe-3147-4de1-8f3d-77e77a199da1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:26.478667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0bb45593-92b0-4490-a6d3-42fcf3bb7858 req-eae7cafe-3147-4de1-8f3d-77e77a199da1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:26.479298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0bb45593-92b0-4490-a6d3-42fcf3bb7858 req-eae7cafe-3147-4de1-8f3d-77e77a199da1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:26.505505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] validate_networks() for [('7a7a5c8e-4510-4be6-9fd7-12b19dbcc68f', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:43:26.521250 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-0bb45593-92b0-4490-a6d3-42fcf3bb7858 req-eae7cafe-3147-4de1-8f3d-77e77a199da1 service nova] Creating event network-vif-plugged:20d5c53b-0385-4ec9-b7ac-f5872bfa0bb3 for instance a3bfcd6d-640c-4cae-8025-09798db76580 on n-h1-860864-3 Oct 11 19:43:26.534792 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-0bb45593-92b0-4490-a6d3-42fcf3bb7858 req-eae7cafe-3147-4de1-8f3d-77e77a199da1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115686 Oct 11 19:43:26.535412 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 161/337] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:26.541141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e4032d44-32b5-418e-852d-28cd88a41178 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1646661248", "id": 1033835742, "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:26.574304 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e4032d44-32b5-418e-852d-28cd88a41178 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.037063 Oct 11 19:43:26.576740 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 162/338] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:26 2022] POST /compute/v2.1/flavors => generated 429 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:26.592088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0b748ca-6438-4e8f-bbca-180bc2da2334 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:26.646190 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0b748ca-6438-4e8f-bbca-180bc2da2334 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1512991832" status: 202 len: 0 microversion: 2.1 time: 0.066599 Oct 11 19:43:26.647910 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 163/339] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:26 2022] DELETE /compute/v2.1/flavors/1512991832 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:26.665010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2370885b-989a-491e-981a-5a40c2a866b8 req-68fd8dd9-7271-47f4-82f2-648251cff011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ac645a-a576-4cad-a7f2-58d8920c2523", "name": "network-vif-unplugged", "status": "completed", "tag": "8f81cfc1-8024-4193-8b3a-821edf92818d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:26.677590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2370885b-989a-491e-981a-5a40c2a866b8 req-68fd8dd9-7271-47f4-82f2-648251cff011 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:26.679351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2370885b-989a-491e-981a-5a40c2a866b8 req-68fd8dd9-7271-47f4-82f2-648251cff011 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:26.680030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2370885b-989a-491e-981a-5a40c2a866b8 req-68fd8dd9-7271-47f4-82f2-648251cff011 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:26.695364 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2370885b-989a-491e-981a-5a40c2a866b8 req-68fd8dd9-7271-47f4-82f2-648251cff011 service nova] Creating event network-vif-unplugged:8f81cfc1-8024-4193-8b3a-821edf92818d for instance 71ac645a-a576-4cad-a7f2-58d8920c2523 on n-h1-860864-3 Oct 11 19:43:26.705645 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2370885b-989a-491e-981a-5a40c2a866b8 req-68fd8dd9-7271-47f4-82f2-648251cff011 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055322 Oct 11 19:43:26.706795 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 164/340] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:26.715325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-139a8f51-6e25-482d-8907-78121826cf88 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:26.723271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:DELETE=16 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:26.748454 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-139a8f51-6e25-482d-8907-78121826cf88 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1033835742" status: 202 len: 0 microversion: 2.1 time: 0.039321 Oct 11 19:43:26.752325 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 165/341] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:26 2022] DELETE /compute/v2.1/flavors/1033835742 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:26.765670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6fd225bc-1274-49c8-b06f-98244934d83b tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:26.816915 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6fd225bc-1274-49c8-b06f-98244934d83b tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.066308 Oct 11 19:43:26.818572 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 166/342] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:26 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:26.832844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-50fd202f-9306-4d38-a667-065330e673d5 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:26.875898 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-50fd202f-9306-4d38-a667-065330e673d5 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.055124 Oct 11 19:43:26.880424 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 167/343] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:26 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:26.888204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a7a6f69-bfc7-483d-a28b-6b69663e6fd6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:26.889162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0a7a6f69-bfc7-483d-a28b-6b69663e6fd6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:26.897289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a7a6f69-bfc7-483d-a28b-6b69663e6fd6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:26.900364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a7a6f69-bfc7-483d-a28b-6b69663e6fd6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:26.901296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a7a6f69-bfc7-483d-a28b-6b69663e6fd6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:26.902816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a7a6f69-bfc7-483d-a28b-6b69663e6fd6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:26.903447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a7a6f69-bfc7-483d-a28b-6b69663e6fd6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:26.904033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a7a6f69-bfc7-483d-a28b-6b69663e6fd6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:27.321769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0a7a6f69-bfc7-483d-a28b-6b69663e6fd6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:27.329502 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a7a6f69-bfc7-483d-a28b-6b69663e6fd6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1504 microversion: 2.1 time: 0.447755 Oct 11 19:43:27.330305 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 168/344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:26 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:27.338860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-073bde32-86c8-4a06-9d1b-797ebeba500b tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-835004418", "id": 144289997, "os-flavor-access:is_public": "False"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:27.367910 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-073bde32-86c8-4a06-9d1b-797ebeba500b tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.036555 Oct 11 19:43:27.368936 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 169/345] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:27 2022] POST /compute/v2.1/flavors => generated 435 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:27.373601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a5e7bbdb-d540-40bb-ba02-5ba62e4739ac tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-441826759", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:27.396333 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a5e7bbdb-d540-40bb-ba02-5ba62e4739ac tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.025898 Oct 11 19:43:27.404791 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 170/346] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:27 2022] POST /compute/v2.1/flavors => generated 506 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:27.404791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce5b1c17-84cd-46a7-bbcc-8465325078e8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:27.404791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ce5b1c17-84cd-46a7-bbcc-8465325078e8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:27.412182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5b1c17-84cd-46a7-bbcc-8465325078e8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:27.414640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5b1c17-84cd-46a7-bbcc-8465325078e8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:27.415371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5b1c17-84cd-46a7-bbcc-8465325078e8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:27.416219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5b1c17-84cd-46a7-bbcc-8465325078e8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:27.416746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5b1c17-84cd-46a7-bbcc-8465325078e8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:27.417241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5b1c17-84cd-46a7-bbcc-8465325078e8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:27.817549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:43:27.818158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:43:27.820848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:43:27.822237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:43:27.823034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:43:27.825484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:27.845945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ce5b1c17-84cd-46a7-bbcc-8465325078e8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:27.861619 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ce5b1c17-84cd-46a7-bbcc-8465325078e8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1317 microversion: 2.1 time: 0.458404 Oct 11 19:43:27.863684 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 171/347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:27 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:27.865578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:27.866994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:27.867787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:27.868785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:27.869421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:27.869603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89f1e14d-58db-45b7-83c6-35c8df1253bd tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2dc7e93e1f084721aaa4de690e210845"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:27.870201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:27.895948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Getting quotas for project 21a886c8ddf44b77974321e34b2fad8a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:27.902615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Getting quotas for user 23b671bc2d4849be938178f53135af2d and project 21a886c8ddf44b77974321e34b2fad8a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:27.918466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:43:27.921473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:43:27.988522 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2e9f52ff-3e49-45a4-b2a0-72ccaf7c7264 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.806916 Oct 11 19:43:27.989820 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 177/348] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:43:27.998454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-20b83b14-ddf8-477b-bcae-5d955520ebe5 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.066918 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-20b83b14-ddf8-477b-bcae-5d955520ebe5 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/b9abdcab-42c8-40c9-b75f-7d53aa97b2e9" status: 202 len: 0 microversion: 2.1 time: 0.074534 Oct 11 19:43:28.068098 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 178/349] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:43:27 2022] DELETE /compute/v2.1/flavors/b9abdcab-42c8-40c9-b75f-7d53aa97b2e9 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:28.077121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.077991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:28.086794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.087531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.088124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.088984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.089633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.090245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.108797 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] HTTP exception thrown: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Request method failure captured: Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a HTTP/1.1 Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccNMJV2nreYD35izhrGrkspU2eYbEw7YaUmAZRRkdeZh6R88h8rTc8SefWKL257WyLfe3MO7Q1w7pnoa9xH5zGZ_s5YPWrzXwSRjHbPaFlwjCu3Tth-dNBTaOh55HrOU2u4aSemJmU_oFKmyJhfqxmbNBPIZZadRFbb_XAgpyRE2uQ Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:28.111195 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9ed7b56298642c58cf65003f2853902", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}] Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 2a07205057b54dc5a85ec740783c3dab Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.112365 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f601b40f-73ac-45fa-8e64-093dfeaf1b4a'} Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:28.113003 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.114064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.117990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Returning 404 to user: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:28.119066 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5391ec50-029e-4b34-bd98-fb451309bb94 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 404 len: 111 microversion: 2.1 time: 0.049894 Oct 11 19:43:28.120089 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 179/350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:28.125254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6dedd69-f957-4764-a78a-7ef504cc9b31 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.127229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a6dedd69-f957-4764-a78a-7ef504cc9b31 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:28.235307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6dedd69-f957-4764-a78a-7ef504cc9b31 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:28.245026 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6dedd69-f957-4764-a78a-7ef504cc9b31 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1225 microversion: 2.1 time: 0.123714 Oct 11 19:43:28.245601 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 180/351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:28.251381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1a995002-dae9-4544-bb12-d8bca98ddfef tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.279955 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1a995002-dae9-4544-bb12-d8bca98ddfef tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.032650 Oct 11 19:43:28.281664 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 181/352] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:28.292613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.293098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:28.319560 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-89f1e14d-58db-45b7-83c6-35c8df1253bd tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] HTTP exception thrown: Flavor access not found for 24 / 2dc7e93e1f084721aaa4de690e210845 combination. Oct 11 19:43:28.323569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.324075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.324659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.328349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.328819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.329231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89f1e14d-58db-45b7-83c6-35c8df1253bd tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Request method failure captured: Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/flavors/144289997/action HTTP/1.1 Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 70 Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcdURbyXr8sNNpMmi-IxpfScUjVkOHklAQLFsSxS3uofszrGxSK4XtxVjEPFa2E7kPLTgYvWCsgEb2JomZp0hKSTJvHpcATyDzw3ihM3Q-OmqoqR_jX2uUMhNM4Wa2Ts4HNEkjjOX0QOvEurvB2U6xKhQIc8iAds-StuRxxXp0O1VS4 Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: c937166183d24ec9b09e5f6aaa877c78 Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-889082205 Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:43:28.332667 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c937166183d24ec9b09e5f6aaa877c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c937166183d24ec9b09e5f6aaa877c78", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c937166183d24ec9b09e5f6aaa877c78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c937166183d24ec9b09e5f6aaa877c78"}]}] Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-889082205 Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: c937166183d24ec9b09e5f6aaa877c78 Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-889082205 Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: f94add2cfe734d3bb906fd36c38c3817 Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: {"removeTenantAccess": {"tenant": "2dc7e93e1f084721aaa4de690e210845"}} Oct 11 19:43:28.333929 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: exception: Flavor access not found for 24 / 2dc7e93e1f084721aaa4de690e210845 combination. Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '144289997', 'body': {'removeTenantAccess': {'tenant': '2dc7e93e1f084721aaa4de690e210845'}}} Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 11 19:43:28.334878 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 24 / 2dc7e93e1f084721aaa4de690e210845 combination. Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 24 / 2dc7e93e1f084721aaa4de690e210845 combination. Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.336278 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.337601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.337601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.337601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:28.337601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:28.337601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 24 / 2dc7e93e1f084721aaa4de690e210845 combination. Oct 11 19:43:28.337601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.339170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89f1e14d-58db-45b7-83c6-35c8df1253bd tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Returning 404 to user: Flavor access not found for 24 / 2dc7e93e1f084721aaa4de690e210845 combination. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:28.342188 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-89f1e14d-58db-45b7-83c6-35c8df1253bd tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/144289997/action" status: 404 len: 124 microversion: 2.1 time: 0.477361 Oct 11 19:43:28.344054 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 172/353] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Oct 11 19:43:27 2022] POST /compute/v2.1/flavors/144289997/action => generated 124 bytes in 479 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:28.355624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8a255c4f-b2fb-4321-af7b-4cf2ef9a364a tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-249465588", "id": "2fc27f18-b59d-47b0-9fff-374425872163", "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:28.360494 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] HTTP exception thrown: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Request method failure captured: Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a HTTP/1.1 Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccNMJV2nreYD35izhrGrkspU2eYbEw7YaUmAZRRkdeZh6R88h8rTc8SefWKL257WyLfe3MO7Q1w7pnoa9xH5zGZ_s5YPWrzXwSRjHbPaFlwjCu3Tth-dNBTaOh55HrOU2u4aSemJmU_oFKmyJhfqxmbNBPIZZadRFbb_XAgpyRE2uQ Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:28.363656 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9ed7b56298642c58cf65003f2853902", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}] Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 2a07205057b54dc5a85ec740783c3dab Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.365215 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f601b40f-73ac-45fa-8e64-093dfeaf1b4a'} Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:28.366152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.367423 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.374512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Returning 404 to user: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:28.375582 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-668799b8-4106-4204-9120-25904fd17958 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 404 len: 111 microversion: 2.1 time: 0.092462 Oct 11 19:43:28.376244 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 182/354] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:43:28 2022] DELETE /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:28.385076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d43ec357-a1a0-49bb-90cd-d055ae50db86 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.399874 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8a255c4f-b2fb-4321-af7b-4cf2ef9a364a tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.054648 Oct 11 19:43:28.404195 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 173/355] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:28 2022] POST /compute/v2.1/flavors => generated 506 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:28.415304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b1857d0-b7ce-428b-bc26-173d5f2e6d9c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.416654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0b1857d0-b7ce-428b-bc26-173d5f2e6d9c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:28.423050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b1857d0-b7ce-428b-bc26-173d5f2e6d9c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.423762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b1857d0-b7ce-428b-bc26-173d5f2e6d9c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.424429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b1857d0-b7ce-428b-bc26-173d5f2e6d9c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.425293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b1857d0-b7ce-428b-bc26-173d5f2e6d9c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.425905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b1857d0-b7ce-428b-bc26-173d5f2e6d9c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.426500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b1857d0-b7ce-428b-bc26-173d5f2e6d9c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.429168 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d43ec357-a1a0-49bb-90cd-d055ae50db86 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/144289997" status: 202 len: 0 microversion: 2.1 time: 0.051343 Oct 11 19:43:28.430362 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 183/356] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:43:28 2022] DELETE /compute/v2.1/flavors/144289997 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:28.438612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.439400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: f601b40f-73ac-45fa-8e64-093dfeaf1b4a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:28.465087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.467183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.469911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.483039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.485690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.486149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.524475 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] HTTP exception thrown: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Request method failure captured: Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a HTTP/1.1 Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccNMJV2nreYD35izhrGrkspU2eYbEw7YaUmAZRRkdeZh6R88h8rTc8SefWKL257WyLfe3MO7Q1w7pnoa9xH5zGZ_s5YPWrzXwSRjHbPaFlwjCu3Tth-dNBTaOh55HrOU2u4aSemJmU_oFKmyJhfqxmbNBPIZZadRFbb_XAgpyRE2uQ Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:28.536185 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9ed7b56298642c58cf65003f2853902", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}] Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 2a07205057b54dc5a85ec740783c3dab Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.537649 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f601b40f-73ac-45fa-8e64-093dfeaf1b4a'} Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:28.539024 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. Oct 11 19:43:28.540177 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.542827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Returning 404 to user: Instance f601b40f-73ac-45fa-8e64-093dfeaf1b4a could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:28.549284 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dd780f34-f456-4ee8-8953-738e1cd2a988 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a" status: 404 len: 111 microversion: 2.1 time: 0.116712 Oct 11 19:43:28.550060 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 184/357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/servers/f601b40f-73ac-45fa-8e64-093dfeaf1b4a => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:28.561255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-981db534-9563-4355-8c11-9eb80408f522 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.597442 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-981db534-9563-4355-8c11-9eb80408f522 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2fc27f18-b59d-47b0-9fff-374425872163" status: 202 len: 0 microversion: 2.1 time: 0.046119 Oct 11 19:43:28.601470 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 185/358] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:43:28 2022] DELETE /compute/v2.1/flavors/2fc27f18-b59d-47b0-9fff-374425872163 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:28.610236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0b1857d0-b7ce-428b-bc26-173d5f2e6d9c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:28.613789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-43e8e61e-2259-4d8f-a8cb-43952e515050 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.621791 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b1857d0-b7ce-428b-bc26-173d5f2e6d9c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1504 microversion: 2.1 time: 0.216358 Oct 11 19:43:28.622379 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 174/359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:28.629442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.630112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:28.640025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.640550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.640984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.642779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.643247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.643678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.661977 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] HTTP exception thrown: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Request method failure captured: Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 HTTP/1.1 Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccNMJV2nreYD35izhrGrkspU2eYbEw7YaUmAZRRkdeZh6R88h8rTc8SefWKL257WyLfe3MO7Q1w7pnoa9xH5zGZ_s5YPWrzXwSRjHbPaFlwjCu3Tth-dNBTaOh55HrOU2u4aSemJmU_oFKmyJhfqxmbNBPIZZadRFbb_XAgpyRE2uQ Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:43:28.664623 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9ed7b56298642c58cf65003f2853902", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}] Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 2a07205057b54dc5a85ec740783c3dab Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:43:28.666138 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a77ba20d-cd31-4f68-ab97-edd11f22a708'} Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:28.666955 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:43:28.668256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.669579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Returning 404 to user: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:28.669579 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1aaef50f-29bf-47c0-89ff-d7a9a6692672 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 404 len: 111 microversion: 2.1 time: 0.040685 Oct 11 19:43:28.669747 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-43e8e61e-2259-4d8f-a8cb-43952e515050 tempest-FlavorsAccessNegativeTestJSON-889082205 tempest-FlavorsAccessNegativeTestJSON-889082205-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.061241 Oct 11 19:43:28.670321 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 175/360] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:43:28 2022] DELETE /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:28.675060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-05ce4755-3791-4075-a5e0-cbc799f8b33b tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.685749 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 186/361] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:28.696868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.699734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] [instance: a77ba20d-cd31-4f68-ab97-edd11f22a708] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:28.701447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-05ce4755-3791-4075-a5e0-cbc799f8b33b tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.029789 Oct 11 19:43:28.702369 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 176/362] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:28.723559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.724945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.726574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.727434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.727962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.728558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.739796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a3f848c-ac05-4668-826a-b600ad0a98e8 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1340944949", "id": 669727698, "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:28.758802 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] HTTP exception thrown: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Request method failure captured: Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 HTTP/1.1 Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccNMJV2nreYD35izhrGrkspU2eYbEw7YaUmAZRRkdeZh6R88h8rTc8SefWKL257WyLfe3MO7Q1w7pnoa9xH5zGZ_s5YPWrzXwSRjHbPaFlwjCu3Tth-dNBTaOh55HrOU2u4aSemJmU_oFKmyJhfqxmbNBPIZZadRFbb_XAgpyRE2uQ Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:28.760373 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9ed7b56298642c58cf65003f2853902", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9ed7b56298642c58cf65003f2853902"}]}] Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c9ed7b56298642c58cf65003f2853902 Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2069115318 Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 2a07205057b54dc5a85ec740783c3dab Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersAdminTestJSON-2069115318-project Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:43:28.761568 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a77ba20d-cd31-4f68-ab97-edd11f22a708'} Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:28.762366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. Oct 11 19:43:28.763493 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:28.764535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] Returning 404 to user: Instance a77ba20d-cd31-4f68-ab97-edd11f22a708 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:28.764535 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e123034c-18d7-4645-865c-a5392c0628c2 tempest-DeleteServersAdminTestJSON-2069115318 tempest-DeleteServersAdminTestJSON-2069115318-project] 10.222.0.27 "GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708" status: 404 len: 111 microversion: 2.1 time: 0.074218 Oct 11 19:43:28.764535 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 187/363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/servers/a77ba20d-cd31-4f68-ab97-edd11f22a708 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:28.774968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-68efe319-5a3f-4fb8-9deb-126d94f299e4 req-07e80416-1d73-4010-ae98-4ba44ff416e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ac645a-a576-4cad-a7f2-58d8920c2523", "tag": "8f81cfc1-8024-4193-8b3a-821edf92818d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:28.776452 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a3f848c-ac05-4668-826a-b600ad0a98e8 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.044672 Oct 11 19:43:28.779905 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 177/364] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:28 2022] POST /compute/v2.1/flavors => generated 411 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:28.792735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-68efe319-5a3f-4fb8-9deb-126d94f299e4 req-07e80416-1d73-4010-ae98-4ba44ff416e9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.793688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e017b7f9-ff37-4639-86f1-6fbf95a76a3a tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.798925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-68efe319-5a3f-4fb8-9deb-126d94f299e4 req-07e80416-1d73-4010-ae98-4ba44ff416e9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.799485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-68efe319-5a3f-4fb8-9deb-126d94f299e4 req-07e80416-1d73-4010-ae98-4ba44ff416e9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.811030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e017b7f9-ff37-4639-86f1-6fbf95a76a3a tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/669727698" status: 200 len: 411 microversion: 2.1 time: 0.022730 Oct 11 19:43:28.814144 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 178/365] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/flavors/669727698 => generated 411 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:28.824055 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-68efe319-5a3f-4fb8-9deb-126d94f299e4 req-07e80416-1d73-4010-ae98-4ba44ff416e9 service nova] Creating event network-changed:8f81cfc1-8024-4193-8b3a-821edf92818d for instance 71ac645a-a576-4cad-a7f2-58d8920c2523 on n-h1-860864-3 Oct 11 19:43:28.839415 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-68efe319-5a3f-4fb8-9deb-126d94f299e4 req-07e80416-1d73-4010-ae98-4ba44ff416e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075891 Oct 11 19:43:28.840019 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 188/366] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:28.888605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d1ba9dce-210e-462d-bc1d-a886f2dd0038 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:28.889953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d1ba9dce-210e-462d-bc1d-a886f2dd0038 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:28.902085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1ba9dce-210e-462d-bc1d-a886f2dd0038 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.902622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1ba9dce-210e-462d-bc1d-a886f2dd0038 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.903058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1ba9dce-210e-462d-bc1d-a886f2dd0038 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:28.904743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1ba9dce-210e-462d-bc1d-a886f2dd0038 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:28.905428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1ba9dce-210e-462d-bc1d-a886f2dd0038 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:28.906945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1ba9dce-210e-462d-bc1d-a886f2dd0038 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:29.203994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d1ba9dce-210e-462d-bc1d-a886f2dd0038 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:29.218015 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d1ba9dce-210e-462d-bc1d-a886f2dd0038 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1467 microversion: 2.1 time: 0.333636 Oct 11 19:43:29.218918 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 189/367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1467 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:29.245593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9cfee970-0904-4c4a-a323-fdec5b11e8b4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:29.246223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9cfee970-0904-4c4a-a323-fdec5b11e8b4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:29.257375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cfee970-0904-4c4a-a323-fdec5b11e8b4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:29.257829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cfee970-0904-4c4a-a323-fdec5b11e8b4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:29.258246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cfee970-0904-4c4a-a323-fdec5b11e8b4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:29.258990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cfee970-0904-4c4a-a323-fdec5b11e8b4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:29.259446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cfee970-0904-4c4a-a323-fdec5b11e8b4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:29.259875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cfee970-0904-4c4a-a323-fdec5b11e8b4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:29.537537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9cfee970-0904-4c4a-a323-fdec5b11e8b4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:29.554241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d7717cd-a401-4538-8f24-f83e43fe9670 tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:29.563035 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9cfee970-0904-4c4a-a323-fdec5b11e8b4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855" status: 200 len: 1317 microversion: 2.1 time: 0.322744 Oct 11 19:43:29.580291 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 190/368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:29 2022] GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:29.601542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0c4e6c51-a1cd-4bc5-86c6-8b46a12aa07c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:29.602159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0c4e6c51-a1cd-4bc5-86c6-8b46a12aa07c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:29.620258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4e6c51-a1cd-4bc5-86c6-8b46a12aa07c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:29.624845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4e6c51-a1cd-4bc5-86c6-8b46a12aa07c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:29.626461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4e6c51-a1cd-4bc5-86c6-8b46a12aa07c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:29.627378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4e6c51-a1cd-4bc5-86c6-8b46a12aa07c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:29.629378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4e6c51-a1cd-4bc5-86c6-8b46a12aa07c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:29.630001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4e6c51-a1cd-4bc5-86c6-8b46a12aa07c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:29.632806 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4d7717cd-a401-4538-8f24-f83e43fe9670 tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6213 microversion: 2.1 time: 0.810611 Oct 11 19:43:29.636562 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 179/369] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:28 2022] GET /compute/v2.1/flavors/detail => generated 6213 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:29.668616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a296e597-a9f1-40fe-8ac1-0685bd203170 req-b9cd8820-2bf4-4ea2-91e1-dcbe8e659d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28f5e45d-a8da-4de0-b75a-3e8a3119d855", "name": "network-vif-plugged", "status": "completed", "tag": "7e7af7a4-dce7-4f1b-924e-0a177b2ccdfc"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:29.701107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a296e597-a9f1-40fe-8ac1-0685bd203170 req-b9cd8820-2bf4-4ea2-91e1-dcbe8e659d15 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:29.703597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a296e597-a9f1-40fe-8ac1-0685bd203170 req-b9cd8820-2bf4-4ea2-91e1-dcbe8e659d15 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:29.706051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a296e597-a9f1-40fe-8ac1-0685bd203170 req-b9cd8820-2bf4-4ea2-91e1-dcbe8e659d15 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:29.733762 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a296e597-a9f1-40fe-8ac1-0685bd203170 req-b9cd8820-2bf4-4ea2-91e1-dcbe8e659d15 service nova] Creating event network-vif-plugged:7e7af7a4-dce7-4f1b-924e-0a177b2ccdfc for instance 28f5e45d-a8da-4de0-b75a-3e8a3119d855 on n-h1-860864-3 Oct 11 19:43:29.742000 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a296e597-a9f1-40fe-8ac1-0685bd203170 req-b9cd8820-2bf4-4ea2-91e1-dcbe8e659d15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084610 Oct 11 19:43:29.742918 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 180/370] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:29.752360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0e582df4-a666-4254-b3b6-8832e0f69786 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:29.754234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0e582df4-a666-4254-b3b6-8832e0f69786 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:29.789481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e582df4-a666-4254-b3b6-8832e0f69786 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:29.790393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e582df4-a666-4254-b3b6-8832e0f69786 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:29.792779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e582df4-a666-4254-b3b6-8832e0f69786 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:29.795754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e582df4-a666-4254-b3b6-8832e0f69786 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:29.798760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e582df4-a666-4254-b3b6-8832e0f69786 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:29.800397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e582df4-a666-4254-b3b6-8832e0f69786 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:29.868906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0c4e6c51-a1cd-4bc5-86c6-8b46a12aa07c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:29.888331 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0c4e6c51-a1cd-4bc5-86c6-8b46a12aa07c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1277 microversion: 2.1 time: 0.303427 Oct 11 19:43:29.888331 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 191/371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:29 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1277 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:29.915075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-17686244-a736-4e59-9e9b-8b4446735e46 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:29.970873 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-17686244-a736-4e59-9e9b-8b4446735e46 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/669727698" status: 202 len: 0 microversion: 2.1 time: 0.067525 Oct 11 19:43:29.971527 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 192/372] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:43:29 2022] DELETE /compute/v2.1/flavors/669727698 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:29.982821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-63ee1842-293a-45c4-bfad-2a934420246d tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.019704 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-63ee1842-293a-45c4-bfad-2a934420246d tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.041664 Oct 11 19:43:30.021228 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 193/373] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:29 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:30.043713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-92556696-c6cf-403b-9631-894efd079125 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-622408251", "id": 238974028, "os-flavor-access:is_public": "False"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:30.087878 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-92556696-c6cf-403b-9631-894efd079125 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.047785 Oct 11 19:43:30.092925 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 194/374] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:30 2022] POST /compute/v2.1/flavors => generated 426 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:30.104606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2775b909-6cee-4867-9075-0c105cd7eed6 tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "238974028"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:30.135558 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-2775b909-6cee-4867-9075-0c105cd7eed6 tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] HTTP exception thrown: Flavor 238974028 could not be found. Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2775b909-6cee-4867-9075-0c105cd7eed6 tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] Request method failure captured: Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 106 Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdZOvYkMoNq5s4as8fg_OgsDa-WaMNDfBsATtJe0jHgw6JKiJLwTrvhK7te1iJMpxFAoeihHOISbH4vsYYL2VVnL-DS01Jah3orNYyQU0qC0dKbOyeO1zv_k94iWeLzOPwaqWCLWTcv0g8Jssq94oC18NJCRSKYIEo9nvnQv0mfcOY Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 740cd64f01f340a08be81fe2020d501c Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FlavorsAdminTestJSON-838139668 Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:30.141590 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/740cd64f01f340a08be81fe2020d501c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_740cd64f01f340a08be81fe2020d501c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/740cd64f01f340a08be81fe2020d501c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/740cd64f01f340a08be81fe2020d501c"}]}] Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FlavorsAdminTestJSON-838139668 Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 740cd64f01f340a08be81fe2020d501c Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-838139668 Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FlavorsAdminTestJSON-838139668-project Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a3226d5365e445a49720eb7270ea4b1d Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FlavorsAdminTestJSON-838139668-project Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "test", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "238974028"}} Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:30.143665 n-d-860864-3 devstack@n-api.service[126955]: exception: Flavor 238974028 could not be found. Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '238974028'}}} Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 238974028 could not be found. Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:30.144779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 238974028 could not be found. Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:30.145839 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:30.147709 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:30.147709 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:30.147709 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:30.147709 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 238974028 could not be found. Oct 11 19:43:30.147709 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:30.147709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2775b909-6cee-4867-9075-0c105cd7eed6 tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] Returning 400 to user: Flavor 238974028 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:30.147709 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2775b909-6cee-4867-9075-0c105cd7eed6 tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.046434 Oct 11 19:43:30.152416 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 195/375] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:30 2022] POST /compute/v2.1/servers => generated 80 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:43:30.164226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06880e12-6826-4ac7-bab3-d02474a2702d tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.207390 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-06880e12-6826-4ac7-bab3-d02474a2702d tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/238974028" status: 202 len: 0 microversion: 2.1 time: 0.052710 Oct 11 19:43:30.208543 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 196/376] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:43:30 2022] DELETE /compute/v2.1/flavors/238974028 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:43:30.235253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9baee2b3-7744-42b4-add9-48482cb47435 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.298751 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9baee2b3-7744-42b4-add9-48482cb47435 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.077008 Oct 11 19:43:30.299286 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 197/377] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:30.322230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51258caa-e9a4-4c92-86da-a93264bf0979 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1599185989", "id": 983603815, "os-flavor-access:is_public": "False"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:30.369475 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51258caa-e9a4-4c92-86da-a93264bf0979 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.049704 Oct 11 19:43:30.370179 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 198/378] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:30 2022] POST /compute/v2.1/flavors => generated 412 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:30.384318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-779f7393-3f59-43d7-9b73-73f8e62e985f tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1974807473", "id": 810731729, "os-flavor-access:is_public": "True"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:30.419321 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-779f7393-3f59-43d7-9b73-73f8e62e985f tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.040412 Oct 11 19:43:30.421299 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 199/379] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:30 2022] POST /compute/v2.1/flavors => generated 411 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:43:30.437413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-43750b7f-846e-433e-bd7a-6811a4e1053b tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.469373 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-43750b7f-846e-433e-bd7a-6811a4e1053b tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.039613 Oct 11 19:43:30.470766 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 200/380] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:30.487606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7375d650-0f93-429c-940f-c59000fea169 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.510075 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7375d650-0f93-429c-940f-c59000fea169 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.028839 Oct 11 19:43:30.511756 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 201/381] 10.222.0.27 () {58 vars in 1177 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:30.538906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c3b31af0-3d7c-4d96-8864-e0cc9295312c tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.557118 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c3b31af0-3d7c-4d96-8864-e0cc9295312c tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.033051 Oct 11 19:43:30.565915 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 202/382] 10.222.0.27 () {58 vars in 1171 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:30.581666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db7c5eb2-9fef-4177-b726-b6d7728cb737 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.601229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0e582df4-a666-4254-b3b6-8832e0f69786 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:30.602462 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-db7c5eb2-9fef-4177-b726-b6d7728cb737 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.035005 Oct 11 19:43:30.603319 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 203/383] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:30.615361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0d3ef07-42d2-476e-8693-119a5e0ecf93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.618062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c0d3ef07-42d2-476e-8693-119a5e0ecf93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:30.624641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:DELETE=15 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:30.625077 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0e582df4-a666-4254-b3b6-8832e0f69786 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1504 microversion: 2.1 time: 0.876252 Oct 11 19:43:30.628133 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 181/384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:29 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1504 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:30.636428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0d3ef07-42d2-476e-8693-119a5e0ecf93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:30.637237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0d3ef07-42d2-476e-8693-119a5e0ecf93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:30.638380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0d3ef07-42d2-476e-8693-119a5e0ecf93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:30.639562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0d3ef07-42d2-476e-8693-119a5e0ecf93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:30.640386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0d3ef07-42d2-476e-8693-119a5e0ecf93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:30.641010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0d3ef07-42d2-476e-8693-119a5e0ecf93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:30.643855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1d94be14-0823-49b9-9f05-76044db1336c tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.710126 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1d94be14-0823-49b9-9f05-76044db1336c tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6213 microversion: 2.1 time: 0.075792 Oct 11 19:43:30.724384 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 182/385] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:30.735275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2933f445-4249-4057-b362-85f0d217c7ab tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.783613 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2933f445-4249-4057-b362-85f0d217c7ab tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6213 microversion: 2.1 time: 0.052373 Oct 11 19:43:30.798357 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 183/386] 10.222.0.27 () {58 vars in 1175 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6213 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:30.814118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c899ff6-9923-477b-baad-3d99e7a0a698 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.850452 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c899ff6-9923-477b-baad-3d99e7a0a698 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6213 microversion: 2.1 time: 0.046958 Oct 11 19:43:30.851977 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 184/387] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6213 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:30.874148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5af81007-e284-483a-bc59-e56ea2dbcf01 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.924825 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5af81007-e284-483a-bc59-e56ea2dbcf01 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6213 microversion: 2.1 time: 0.056256 Oct 11 19:43:30.926157 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 185/388] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6213 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:30.934834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-95cf3e0d-b015-4949-bf36-0eeeed980784 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:30.935836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-95cf3e0d-b015-4949-bf36-0eeeed980784 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:30.948857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95cf3e0d-b015-4949-bf36-0eeeed980784 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:30.958361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95cf3e0d-b015-4949-bf36-0eeeed980784 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:30.959075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95cf3e0d-b015-4949-bf36-0eeeed980784 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:30.960577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95cf3e0d-b015-4949-bf36-0eeeed980784 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:30.961180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95cf3e0d-b015-4949-bf36-0eeeed980784 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:30.961759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95cf3e0d-b015-4949-bf36-0eeeed980784 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:30.977782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c0d3ef07-42d2-476e-8693-119a5e0ecf93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:30.987386 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c0d3ef07-42d2-476e-8693-119a5e0ecf93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855" status: 200 len: 1317 microversion: 2.1 time: 0.381986 Oct 11 19:43:30.991692 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 204/389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:30.997544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-49fbb0b5-78e7-473a-829a-2a5ae45a9e51 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.048302 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-49fbb0b5-78e7-473a-829a-2a5ae45a9e51 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/810731729" status: 202 len: 0 microversion: 2.1 time: 0.055097 Oct 11 19:43:31.049074 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 205/390] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:43:30 2022] DELETE /compute/v2.1/flavors/810731729 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:31.055012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-95cf3e0d-b015-4949-bf36-0eeeed980784 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:31.073477 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-95cf3e0d-b015-4949-bf36-0eeeed980784 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1283 microversion: 2.1 time: 0.145639 Oct 11 19:43:31.082586 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 186/391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:30 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1283 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:31.083324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f187cdfa-2d2b-4afb-b29d-ddd5eefbdd7b tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.128064 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f187cdfa-2d2b-4afb-b29d-ddd5eefbdd7b tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.063731 Oct 11 19:43:31.135340 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 206/392] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:31 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:31.148944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6a4c1c13-467f-4be6-a77a-552cd2126beb tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.174074 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6a4c1c13-467f-4be6-a77a-552cd2126beb tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/983603815" status: 202 len: 0 microversion: 2.1 time: 0.029488 Oct 11 19:43:31.188867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ac88cc6b-b170-4716-bc7c-bc984d97cec3 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.195840 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 187/393] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:43:31 2022] DELETE /compute/v2.1/flavors/983603815 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:31.247736 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ac88cc6b-b170-4716-bc7c-bc984d97cec3 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.066269 Oct 11 19:43:31.261830 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 207/394] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:31 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:31.271492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-096b3e5a-f979-4d05-9583-5533efe54284 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1400506599", "id": 1346844653, "os-flavor-access:is_public": "False"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:31.299764 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-096b3e5a-f979-4d05-9583-5533efe54284 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.032242 Oct 11 19:43:31.314396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-523fc4fb-0b6c-46a8-acb1-75e6e28e77f2 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.319642 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 188/395] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:31 2022] POST /compute/v2.1/flavors => generated 415 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:31.371447 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-523fc4fb-0b6c-46a8-acb1-75e6e28e77f2 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.061293 Oct 11 19:43:31.372923 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 208/396] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:31 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:31.392668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bdc75dd1-09e0-4c12-a3a9-d1ae6aa5ba75 tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.437568 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bdc75dd1-09e0-4c12-a3a9-d1ae6aa5ba75 tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.048868 Oct 11 19:43:31.442459 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 189/397] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:31 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:31.473315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6fa13c6f-47c9-4180-93c1-5313ab91cecc tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.541972 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6fa13c6f-47c9-4180-93c1-5313ab91cecc tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1346844653" status: 202 len: 0 microversion: 2.1 time: 0.078744 Oct 11 19:43:31.543754 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 209/398] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:31 2022] DELETE /compute/v2.1/flavors/1346844653 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:31.552243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-135bb1ba-9b11-4b4e-9fa7-b291da2c4640 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.650994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-327f9dfc-1d83-496d-9651-42918e130bb5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.652654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-327f9dfc-1d83-496d-9651-42918e130bb5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:31.654627 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-135bb1ba-9b11-4b4e-9fa7-b291da2c4640 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.097602 Oct 11 19:43:31.655324 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 190/399] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:31 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:31.681579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f548ccdb-2d6d-43e8-8e22-6e7b55490535 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1877578730", "id": 155050168, "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:31.688874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327f9dfc-1d83-496d-9651-42918e130bb5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:31.700096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327f9dfc-1d83-496d-9651-42918e130bb5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:31.701397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327f9dfc-1d83-496d-9651-42918e130bb5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:31.730370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327f9dfc-1d83-496d-9651-42918e130bb5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:31.732345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327f9dfc-1d83-496d-9651-42918e130bb5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:31.734299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327f9dfc-1d83-496d-9651-42918e130bb5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:31.747625 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f548ccdb-2d6d-43e8-8e22-6e7b55490535 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.071897 Oct 11 19:43:31.752824 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 191/400] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:31 2022] POST /compute/v2.1/flavors => generated 411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:31.765396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0423de9-51e6-4124-bb3a-aa7c1f45201c tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.820203 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0423de9-51e6-4124-bb3a-aa7c1f45201c tempest-FlavorsAdminTestJSON-838139668 tempest-FlavorsAdminTestJSON-838139668-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6213 microversion: 2.1 time: 0.063384 Oct 11 19:43:31.825026 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 192/401] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:31 2022] GET /compute/v2.1/flavors/detail => generated 6213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:31.845998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bf4ea0f4-4d73-475b-9a2b-c23d5af706a6 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.873608 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bf4ea0f4-4d73-475b-9a2b-c23d5af706a6 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/155050168" status: 202 len: 0 microversion: 2.1 time: 0.031322 Oct 11 19:43:31.874468 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 193/402] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:43:31 2022] DELETE /compute/v2.1/flavors/155050168 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:31.884759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2a2d2370-26e5-4055-9b48-232f74185065 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:31.928881 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2a2d2370-26e5-4055-9b48-232f74185065 tempest-FlavorsAdminTestJSON-1380768694 tempest-FlavorsAdminTestJSON-1380768694-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.050014 Oct 11 19:43:31.929485 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 194/403] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:31 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:32.014303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-37d63fa4-0002-4a35-a97e-22f65c35b1b1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:32.014435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-37d63fa4-0002-4a35-a97e-22f65c35b1b1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:32.027723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d63fa4-0002-4a35-a97e-22f65c35b1b1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:32.029219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d63fa4-0002-4a35-a97e-22f65c35b1b1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:32.031880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d63fa4-0002-4a35-a97e-22f65c35b1b1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:32.033489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d63fa4-0002-4a35-a97e-22f65c35b1b1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:32.035369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d63fa4-0002-4a35-a97e-22f65c35b1b1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:32.037078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d63fa4-0002-4a35-a97e-22f65c35b1b1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:32.384949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-327f9dfc-1d83-496d-9651-42918e130bb5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:32.401366 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-327f9dfc-1d83-496d-9651-42918e130bb5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1504 microversion: 2.1 time: 0.755578 Oct 11 19:43:32.410568 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 210/404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:31 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1504 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:32.418149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-441f9fcd-48b7-4b80-9639-2d50735a2d51 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:32.418818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-441f9fcd-48b7-4b80-9639-2d50735a2d51 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:32.426298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-441f9fcd-48b7-4b80-9639-2d50735a2d51 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:32.426824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-441f9fcd-48b7-4b80-9639-2d50735a2d51 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:32.427263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-441f9fcd-48b7-4b80-9639-2d50735a2d51 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:32.428143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-441f9fcd-48b7-4b80-9639-2d50735a2d51 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:32.429253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-441f9fcd-48b7-4b80-9639-2d50735a2d51 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:32.429691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-441f9fcd-48b7-4b80-9639-2d50735a2d51 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:32.569116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-37d63fa4-0002-4a35-a97e-22f65c35b1b1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:32.591004 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-37d63fa4-0002-4a35-a97e-22f65c35b1b1 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855" status: 200 len: 1467 microversion: 2.1 time: 0.580808 Oct 11 19:43:32.591865 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 195/405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:32 2022] GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 => generated 1467 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:32.795522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-441f9fcd-48b7-4b80-9639-2d50735a2d51 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:32.804620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-441f9fcd-48b7-4b80-9639-2d50735a2d51 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1325 microversion: 2.1 time: 0.401255 Oct 11 19:43:32.810066 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 211/406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:32 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1325 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:32.826848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:32.832116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:32.832875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Searching by: {'reservation_id': 'r-0mdc023x', 'deleted': False, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:43:32.849179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:32.849575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:32.850511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:32.851279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:32.851726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:32.852141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:33.083643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1767530563", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:33.084300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:43:33.167451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:43:33.204772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:33.213197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:33.213678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:33.214115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:33.686611 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6fc05f38-2ab8-4b15-b5f1-acf3e1a76c5f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-0mdc023x" status: 200 len: 2927 microversion: 2.1 time: 0.875404 Oct 11 19:43:33.687532 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 212/407] 10.222.0.27 () {58 vars in 1197 bytes} [Tue Oct 11 19:43:32 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0mdc023x => generated 2927 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:33.692186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5fd5d01-7218-431c-b3e6-4a31d7639e8b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:33.692796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c5fd5d01-7218-431c-b3e6-4a31d7639e8b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:33.714239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5fd5d01-7218-431c-b3e6-4a31d7639e8b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:33.719875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5fd5d01-7218-431c-b3e6-4a31d7639e8b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:33.720431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5fd5d01-7218-431c-b3e6-4a31d7639e8b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:33.723646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5fd5d01-7218-431c-b3e6-4a31d7639e8b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:33.724881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5fd5d01-7218-431c-b3e6-4a31d7639e8b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:33.727606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5fd5d01-7218-431c-b3e6-4a31d7639e8b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:34.238101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:43:34.238631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:43:34.239082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:43:34.239500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:43:34.239916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:43:34.254905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:34.255402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:34.255850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:34.262728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:34.263628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:34.264312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:34.319862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:34.341405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for project 33b91a834ad24c82805880555930825d. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:34.346490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c5fd5d01-7218-431c-b3e6-4a31d7639e8b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:34.361502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c5fd5d01-7218-431c-b3e6-4a31d7639e8b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1504 microversion: 2.1 time: 0.672651 Oct 11 19:43:34.365593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for user 5c26541efd824c5ab866c2891adcd748 and project 33b91a834ad24c82805880555930825d. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:34.376715 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 213/408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:33 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1504 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:34.386259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a53b86e5-9762-4674-ad04-7ea3c8b7e595 req-db6e1a59-c39b-4d68-8e42-5aab5d49a4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bc7749-0f31-48b7-bf11-8fdc03fbb734", "tag": "d655f2a8-e159-4bde-9b89-9517f5997d24"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:34.394429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:43:34.403665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:43:34.416038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a53b86e5-9762-4674-ad04-7ea3c8b7e595 req-db6e1a59-c39b-4d68-8e42-5aab5d49a4cb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:34.417048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a53b86e5-9762-4674-ad04-7ea3c8b7e595 req-db6e1a59-c39b-4d68-8e42-5aab5d49a4cb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:34.418000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a53b86e5-9762-4674-ad04-7ea3c8b7e595 req-db6e1a59-c39b-4d68-8e42-5aab5d49a4cb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:34.432665 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a53b86e5-9762-4674-ad04-7ea3c8b7e595 req-db6e1a59-c39b-4d68-8e42-5aab5d49a4cb service nova] Creating event network-changed:d655f2a8-e159-4bde-9b89-9517f5997d24 for instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 on n-h2-860864-3 Oct 11 19:43:34.441220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a53b86e5-9762-4674-ad04-7ea3c8b7e595 req-db6e1a59-c39b-4d68-8e42-5aab5d49a4cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062920 Oct 11 19:43:34.442586 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 214/409] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:34.450604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5b8c167f-fa25-4129-bd89-77c5de8a1e15 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:34.470851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.compute.server_groups [None req-5b8c167f-fa25-4129-bd89-77c5de8a1e15 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Querying cell 3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) for 2 instances {{(pid=126955) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 19:43:34.471875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b8c167f-fa25-4129-bd89-77c5de8a1e15 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:34.472627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b8c167f-fa25-4129-bd89-77c5de8a1e15 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:34.473212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b8c167f-fa25-4129-bd89-77c5de8a1e15 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:34.494951 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e4a17896-f88a-46da-9afe-05db1f67b610 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901703 Oct 11 19:43:34.496216 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 196/410] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:43:34.503652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-330b637c-ec51-4aba-a42f-651bf0774e70 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:34.504579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-330b637c-ec51-4aba-a42f-651bf0774e70 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:34.512161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330b637c-ec51-4aba-a42f-651bf0774e70 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:34.513037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330b637c-ec51-4aba-a42f-651bf0774e70 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:34.513786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330b637c-ec51-4aba-a42f-651bf0774e70 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:34.514773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330b637c-ec51-4aba-a42f-651bf0774e70 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:34.515493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330b637c-ec51-4aba-a42f-651bf0774e70 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:34.516199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330b637c-ec51-4aba-a42f-651bf0774e70 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:34.519824 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5b8c167f-fa25-4129-bd89-77c5de8a1e15 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/2b535411-8be5-410e-b035-f9000ef01694" status: 200 len: 265 microversion: 2.1 time: 0.075793 Oct 11 19:43:34.527567 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 215/411] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:43:34 2022] GET /compute/v2.1/os-server-groups/2b535411-8be5-410e-b035-f9000ef01694 => generated 265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:34.535460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6baab900-2660-46a5-838f-47cf1a6c4d82 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:34.536538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6baab900-2660-46a5-838f-47cf1a6c4d82 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:34.668284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6baab900-2660-46a5-838f-47cf1a6c4d82 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:34.694921 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6baab900-2660-46a5-838f-47cf1a6c4d82 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1213 microversion: 2.1 time: 0.163539 Oct 11 19:43:34.696698 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 216/412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:34 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:34.702220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5a166ca-06d8-4c15-a4e7-2e9f4c913008 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:34.703050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f5a166ca-06d8-4c15-a4e7-2e9f4c913008 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:34.712309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a166ca-06d8-4c15-a4e7-2e9f4c913008 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:34.713023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a166ca-06d8-4c15-a4e7-2e9f4c913008 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:34.713530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a166ca-06d8-4c15-a4e7-2e9f4c913008 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:34.714242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a166ca-06d8-4c15-a4e7-2e9f4c913008 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:34.714737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a166ca-06d8-4c15-a4e7-2e9f4c913008 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:34.715162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a166ca-06d8-4c15-a4e7-2e9f4c913008 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:34.895021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-330b637c-ec51-4aba-a42f-651bf0774e70 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:34.906123 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-330b637c-ec51-4aba-a42f-651bf0774e70 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1325 microversion: 2.1 time: 0.407620 Oct 11 19:43:34.910401 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 197/413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:34 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:35.097920 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f5a166ca-06d8-4c15-a4e7-2e9f4c913008 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855" status: 200 len: 1618 microversion: 2.1 time: 0.399677 Oct 11 19:43:35.098803 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 217/414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:34 2022] GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 => generated 1618 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:35.122134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2a95b908-48b1-46e9-99f7-32d8d554b401 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:35.123530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2a95b908-48b1-46e9-99f7-32d8d554b401 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:35.136815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a95b908-48b1-46e9-99f7-32d8d554b401 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:35.141431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a95b908-48b1-46e9-99f7-32d8d554b401 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:35.141903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a95b908-48b1-46e9-99f7-32d8d554b401 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:35.143549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a95b908-48b1-46e9-99f7-32d8d554b401 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:35.144340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a95b908-48b1-46e9-99f7-32d8d554b401 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:35.146250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a95b908-48b1-46e9-99f7-32d8d554b401 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:35.390503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4a3f857-5c8e-47f5-a289-20f9e0e3abfc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:35.392094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a4a3f857-5c8e-47f5-a289-20f9e0e3abfc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:35.399517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4a3f857-5c8e-47f5-a289-20f9e0e3abfc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:35.400571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4a3f857-5c8e-47f5-a289-20f9e0e3abfc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:35.401217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4a3f857-5c8e-47f5-a289-20f9e0e3abfc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:35.402129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4a3f857-5c8e-47f5-a289-20f9e0e3abfc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:35.402700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4a3f857-5c8e-47f5-a289-20f9e0e3abfc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:35.403342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4a3f857-5c8e-47f5-a289-20f9e0e3abfc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:35.430009 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2a95b908-48b1-46e9-99f7-32d8d554b401 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 200 len: 1618 microversion: 2.1 time: 0.312984 Oct 11 19:43:35.430645 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 198/415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:35 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 1618 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:35.475887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44dd6626-a640-4df9-8109-20ebe97318a3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Action: 'create', calling method: .version_select at 0x7f83ccba79d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1318547594", "policies": ["anti-affinity"]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:35.517793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-44dd6626-a640-4df9-8109-20ebe97318a3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:35.525135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-44dd6626-a640-4df9-8109-20ebe97318a3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:35.622925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a4a3f857-5c8e-47f5-a289-20f9e0e3abfc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:35.632928 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a4a3f857-5c8e-47f5-a289-20f9e0e3abfc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1504 microversion: 2.1 time: 0.247176 Oct 11 19:43:35.641184 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 218/416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:35 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:35.641657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-44dd6626-a640-4df9-8109-20ebe97318a3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:35.659898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-44dd6626-a640-4df9-8109-20ebe97318a3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:35.685410 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-44dd6626-a640-4df9-8109-20ebe97318a3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.233688 Oct 11 19:43:35.687621 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 199/417] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 11 19:43:35 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:43:35.723929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aea5dd98-fa7c-41e6-b6e2-dcb85b719e66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:35.725020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aea5dd98-fa7c-41e6-b6e2-dcb85b719e66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:35.732556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea5dd98-fa7c-41e6-b6e2-dcb85b719e66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:35.733061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea5dd98-fa7c-41e6-b6e2-dcb85b719e66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:35.733520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea5dd98-fa7c-41e6-b6e2-dcb85b719e66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:35.734229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea5dd98-fa7c-41e6-b6e2-dcb85b719e66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:35.734714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea5dd98-fa7c-41e6-b6e2-dcb85b719e66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:35.735142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea5dd98-fa7c-41e6-b6e2-dcb85b719e66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:35.805031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aea5dd98-fa7c-41e6-b6e2-dcb85b719e66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:35.812852 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aea5dd98-fa7c-41e6-b6e2-dcb85b719e66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1265 microversion: 2.1 time: 0.097514 Oct 11 19:43:35.814059 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 200/418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:35 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:35.877079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb26e078-c1c4-43dc-ba07-de9bb18edb74 tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-693129443", "id": 1026076302, "os-flavor-access:is_public": "False"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:35.900755 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cb26e078-c1c4-43dc-ba07-de9bb18edb74 tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.257168 Oct 11 19:43:35.901978 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 219/419] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:35 2022] POST /compute/v2.1/flavors => generated 430 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:35.914668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98100226-0deb-49ab-a230-3d0ffee7808f tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4f2fdec111cd4d76bc3f3b0e75d43f6f"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:35.933884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-79ef87b3-4f26-4c5d-8a0e-1471e4f262f2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:35.934603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-79ef87b3-4f26-4c5d-8a0e-1471e4f262f2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:35.940722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79ef87b3-4f26-4c5d-8a0e-1471e4f262f2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:35.941208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79ef87b3-4f26-4c5d-8a0e-1471e4f262f2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:35.941642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79ef87b3-4f26-4c5d-8a0e-1471e4f262f2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:35.942335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79ef87b3-4f26-4c5d-8a0e-1471e4f262f2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:35.942821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79ef87b3-4f26-4c5d-8a0e-1471e4f262f2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:35.943243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79ef87b3-4f26-4c5d-8a0e-1471e4f262f2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:36.161749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79ef87b3-4f26-4c5d-8a0e-1471e4f262f2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:36.169773 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-79ef87b3-4f26-4c5d-8a0e-1471e4f262f2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1325 microversion: 2.1 time: 0.241404 Oct 11 19:43:36.174052 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 220/420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:35 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1325 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:36.187926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-581765215", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "286cb564-17fc-4291-a412-c93dfe1ca59e"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:36.272944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:43:36.536309 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98100226-0deb-49ab-a230-3d0ffee7808f tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1026076302/action" status: 200 len: 97 microversion: 2.1 time: 0.625987 Oct 11 19:43:36.539148 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 201/421] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 11 19:43:35 2022] POST /compute/v2.1/flavors/1026076302/action => generated 97 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 19:43:36.886363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8eca14de-2e9d-4412-a827-d609ca1bf3cf tempest-FlavorsAccessTestJSON-148672877 tempest-FlavorsAccessTestJSON-148672877-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:36.912026 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8eca14de-2e9d-4412-a827-d609ca1bf3cf tempest-FlavorsAccessTestJSON-148672877 tempest-FlavorsAccessTestJSON-148672877-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6232 microversion: 2.1 time: 0.363353 Oct 11 19:43:36.912904 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 202/422] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:36 2022] GET /compute/v2.1/flavors/detail => generated 6232 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:36.931940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:43:36.932375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:43:36.932762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:43:36.933175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:43:36.933584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:43:36.934693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-82874165-b071-4086-80f9-b27c64476abd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:36.935472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-82874165-b071-4086-80f9-b27c64476abd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:36.942391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82874165-b071-4086-80f9-b27c64476abd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:36.943296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82874165-b071-4086-80f9-b27c64476abd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:36.943957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82874165-b071-4086-80f9-b27c64476abd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:36.945119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82874165-b071-4086-80f9-b27c64476abd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:36.946370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82874165-b071-4086-80f9-b27c64476abd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:36.946909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82874165-b071-4086-80f9-b27c64476abd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:36.963989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:36.964479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:36.964917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:36.965647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:36.966102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:36.966541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:37.014778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:37.028364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:37.065682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Going to run 2 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:43:37.068395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: b8f663a0-eedd-4d4f-934b-05c7bd72ce6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:43:37.139993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:37.145344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:37.189119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:37.199176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:37.217280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=b8f663a0-eedd-4d4f-934b-05c7bd72ce6f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:43:37.261295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:37.291428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:37.302334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:37.339908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82874165-b071-4086-80f9-b27c64476abd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:37.349447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-82874165-b071-4086-80f9-b27c64476abd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1504 microversion: 2.1 time: 0.421376 Oct 11 19:43:37.352046 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 203/423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:36 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:37.357171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5d640533-7c37-4a41-a09b-78b9ccf4d39d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:37.358026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5d640533-7c37-4a41-a09b-78b9ccf4d39d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:37.379555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d640533-7c37-4a41-a09b-78b9ccf4d39d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:37.380127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d640533-7c37-4a41-a09b-78b9ccf4d39d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:37.380634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d640533-7c37-4a41-a09b-78b9ccf4d39d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:37.383850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d640533-7c37-4a41-a09b-78b9ccf4d39d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:37.385386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d640533-7c37-4a41-a09b-78b9ccf4d39d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:37.385994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d640533-7c37-4a41-a09b-78b9ccf4d39d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:37.386544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:37.396025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'server_group_members'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:37.450131 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6007204c-1cc8-4f42-824f-88e74219bb62 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.274811 Oct 11 19:43:37.452470 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 221/424] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:36 2022] POST /compute/v2.1/servers => generated 32 bytes in 1278 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 11 19:43:37.460762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a475b0d-e61a-4d8b-ada0-ff8ec40c22cf tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4f2fdec111cd4d76bc3f3b0e75d43f6f"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:37.542050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5d640533-7c37-4a41-a09b-78b9ccf4d39d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:37.544261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:37.554911 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5d640533-7c37-4a41-a09b-78b9ccf4d39d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1271 microversion: 2.1 time: 0.198327 Oct 11 19:43:37.572448 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 204/425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:37 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:37.579422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0e5db834-fa0d-46c7-82a9-a6abde648dfa tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:37.580261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0e5db834-fa0d-46c7-82a9-a6abde648dfa tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:37.589125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db834-fa0d-46c7-82a9-a6abde648dfa tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:37.590178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db834-fa0d-46c7-82a9-a6abde648dfa tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:37.590814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db834-fa0d-46c7-82a9-a6abde648dfa tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:37.592049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db834-fa0d-46c7-82a9-a6abde648dfa tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:37.592619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db834-fa0d-46c7-82a9-a6abde648dfa tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:37.593147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db834-fa0d-46c7-82a9-a6abde648dfa tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:37.788137 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a475b0d-e61a-4d8b-ada0-ff8ec40c22cf tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1026076302/action" status: 200 len: 21 microversion: 2.1 time: 0.334000 Oct 11 19:43:37.788758 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 222/426] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 11 19:43:37 2022] POST /compute/v2.1/flavors/1026076302/action => generated 21 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:43:37.935947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ce271bac-826f-49f6-8c06-44f1391a5b86 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Calling method '.version_select at 0x7f83ccdae5e0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:37.939651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce271bac-826f-49f6-8c06-44f1391a5b86 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:37.940246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce271bac-826f-49f6-8c06-44f1391a5b86 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:37.940793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce271bac-826f-49f6-8c06-44f1391a5b86 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:37.941878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce271bac-826f-49f6-8c06-44f1391a5b86 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:37.942579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce271bac-826f-49f6-8c06-44f1391a5b86 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:37.943080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce271bac-826f-49f6-8c06-44f1391a5b86 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:37.973631 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ce271bac-826f-49f6-8c06-44f1391a5b86 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.180670 Oct 11 19:43:37.974258 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 223/427] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 11 19:43:37 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:37.980253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:37.986362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:37.987174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Searching by: {'deleted': False, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:43:38.006567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.007143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.007523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.008265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.008910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.009338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.040347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:43:38.045104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:38.082621 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-71927ec9-7594-49fa-903e-f1e71293e36f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1660 microversion: 2.1 time: 0.106110 Oct 11 19:43:38.083469 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 224/428] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 19:43:37 2022] GET /compute/v2.1/servers => generated 1660 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:38.142417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0e5db834-fa0d-46c7-82a9-a6abde648dfa tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:38.143117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Calling method '.version_select at 0x7f83ccd40700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.145060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.145493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.145931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.151487 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0e5db834-fa0d-46c7-82a9-a6abde648dfa tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1325 microversion: 2.1 time: 0.576477 Oct 11 19:43:38.152611 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 205/429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:37 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1325 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:38.161665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.163001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.163672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.169599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a2776fd-c04e-4635-b480-246c6fa3d2ab tempest-FlavorsAccessTestJSON-148672877 tempest-FlavorsAccessTestJSON-148672877-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.175789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.176452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.177185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.184377 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c688c855-d76b-419d-bb18-26d447c3100c tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.099246 Oct 11 19:43:38.185517 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 225/430] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:38.195729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db953890-a9fe-4790-9ab2-9c7ddc4bbe6c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Calling method '.version_select at 0x7f83ccb36670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.200036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db953890-a9fe-4790-9ab2-9c7ddc4bbe6c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.200729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db953890-a9fe-4790-9ab2-9c7ddc4bbe6c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.201664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db953890-a9fe-4790-9ab2-9c7ddc4bbe6c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.202831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db953890-a9fe-4790-9ab2-9c7ddc4bbe6c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.203466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db953890-a9fe-4790-9ab2-9c7ddc4bbe6c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.204065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db953890-a9fe-4790-9ab2-9c7ddc4bbe6c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.206227 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a2776fd-c04e-4635-b480-246c6fa3d2ab tempest-FlavorsAccessTestJSON-148672877 tempest-FlavorsAccessTestJSON-148672877-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.051965 Oct 11 19:43:38.218551 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 206/431] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:38.218551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-94e92c26-b022-423e-ac9b-094806910639 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.218551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-94e92c26-b022-423e-ac9b-094806910639 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:38.243970 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-db953890-a9fe-4790-9ab2-9c7ddc4bbe6c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.057205 Oct 11 19:43:38.244793 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 226/432] 10.222.0.27 () {58 vars in 1139 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:38.293701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-94e92c26-b022-423e-ac9b-094806910639 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:38.303569 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-94e92c26-b022-423e-ac9b-094806910639 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1218 microversion: 2.1 time: 0.094227 Oct 11 19:43:38.304474 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 207/433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:38.323817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-85ea1aea-3167-45a8-be6b-e6aa39ec901f tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.351509 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-85ea1aea-3167-45a8-be6b-e6aa39ec901f tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1026076302" status: 202 len: 0 microversion: 2.1 time: 0.045767 Oct 11 19:43:38.352177 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 208/434] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:38 2022] DELETE /compute/v2.1/flavors/1026076302 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:38.357964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-712678fe-7ab4-445b-b4c0-53c176389fe7 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Calling method '.version_select at 0x7f83ccc23940>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.363464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-712678fe-7ab4-445b-b4c0-53c176389fe7 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.364532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-712678fe-7ab4-445b-b4c0-53c176389fe7 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.365144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-712678fe-7ab4-445b-b4c0-53c176389fe7 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.366650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-712678fe-7ab4-445b-b4c0-53c176389fe7 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.369278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-712678fe-7ab4-445b-b4c0-53c176389fe7 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.369760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-712678fe-7ab4-445b-b4c0-53c176389fe7 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.395435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a319b055-7ab9-4be1-bde7-7754efd9df3c tempest-HypervisorAdminNegativeUnderV252Test-1701143013 tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project] Calling method '.version_select at 0x7f83cca54280>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.403901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a319b055-7ab9-4be1-bde7-7754efd9df3c tempest-HypervisorAdminNegativeUnderV252Test-1701143013 tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '2221159838e045f3afde02f795a0f5d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f90d38ec9be431a8a9dd26c960c7319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a319b055-7ab9-4be1-bde7-7754efd9df3c tempest-HypervisorAdminNegativeUnderV252Test-1701143013 tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project] Request method failure captured: Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-hypervisors/n-h1-860864-3/search HTTP/1.1 Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdoNIoNS7g5DLxmin5HfulAIR0n_v3qI0kTr2zmCYqRvhDeQg-ZXdpUHYknbJ6soYZDTAfOUa8Gw3Hs3l_ROt4t8hYKT3vAMgWtyb3EPJ5K-QRXqtyg9N7w0BAid1hT12spyL4Hq1J5bWSj7gHoMyjW9SVL5xPiLOMCm349QRBgQTE Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 4f90d38ec9be431a8a9dd26c960c7319 Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1701143013 Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:38.409452 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f90d38ec9be431a8a9dd26c960c7319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f90d38ec9be431a8a9dd26c960c7319", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f90d38ec9be431a8a9dd26c960c7319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f90d38ec9be431a8a9dd26c960c7319"}]}] Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1701143013 Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 4f90d38ec9be431a8a9dd26c960c7319 Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1701143013 Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 2221159838e045f3afde02f795a0f5d5 Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 19:43:38.410827 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'n-h1-860864-3'} Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:38.411577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 19:43:38.413014 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:38.414030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-712678fe-7ab4-445b-b4c0-53c176389fe7 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.060073 Oct 11 19:43:38.414831 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 209/435] 10.222.0.27 () {58 vars in 1145 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:43:38.416265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a319b055-7ab9-4be1-bde7-7754efd9df3c tempest-HypervisorAdminNegativeUnderV252Test-1701143013 tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:38.419978 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a319b055-7ab9-4be1-bde7-7754efd9df3c tempest-HypervisorAdminNegativeUnderV252Test-1701143013 tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-860864-3/search" status: 403 len: 117 microversion: 2.1 time: 0.173490 Oct 11 19:43:38.419978 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 227/436] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-860864-3/search => generated 117 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:38.432559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1440a5dc-364b-434b-8f2f-e75f012a4750 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.433362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1440a5dc-364b-434b-8f2f-e75f012a4750 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:38.433869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-729b5775-b41d-4502-99bc-a4f8a6f6f589 tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.442413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1440a5dc-364b-434b-8f2f-e75f012a4750 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.442963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1440a5dc-364b-434b-8f2f-e75f012a4750 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.443509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1440a5dc-364b-434b-8f2f-e75f012a4750 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.444238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1440a5dc-364b-434b-8f2f-e75f012a4750 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.444681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1440a5dc-364b-434b-8f2f-e75f012a4750 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.445108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1440a5dc-364b-434b-8f2f-e75f012a4750 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.463264 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-729b5775-b41d-4502-99bc-a4f8a6f6f589 tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.046793 Oct 11 19:43:38.464653 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 210/437] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:38.471199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-51ed8ef9-d343-482b-98a3-f2308c3e00b2 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Calling method '.version_select at 0x7f83ccb889d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.476190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51ed8ef9-d343-482b-98a3-f2308c3e00b2 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.476844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51ed8ef9-d343-482b-98a3-f2308c3e00b2 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.477607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51ed8ef9-d343-482b-98a3-f2308c3e00b2 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.481966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51ed8ef9-d343-482b-98a3-f2308c3e00b2 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.482457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51ed8ef9-d343-482b-98a3-f2308c3e00b2 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.483156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51ed8ef9-d343-482b-98a3-f2308c3e00b2 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.517672 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-51ed8ef9-d343-482b-98a3-f2308c3e00b2 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.050848 Oct 11 19:43:38.518300 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 211/438] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:38.523682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c4816ad3-b8d2-47ce-96a9-3ac8a694ef50 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Calling method '.version_select at 0x7f83ccb88af0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.525813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4816ad3-b8d2-47ce-96a9-3ac8a694ef50 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.526438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4816ad3-b8d2-47ce-96a9-3ac8a694ef50 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.526923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4816ad3-b8d2-47ce-96a9-3ac8a694ef50 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.536017 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c4816ad3-b8d2-47ce-96a9-3ac8a694ef50 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c4816ad3-b8d2-47ce-96a9-3ac8a694ef50 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Request method failure captured: Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcdpURRSk6rkJyHPaHLB6w_BvxfbprjBeNYxq9AtFcr2BE15zOedwQyRUg7YOnwYcjBHwzolwlXUs0TYZ7WtVQo-6skGKZAGj46-PR1HNaRwRJ36KIL7bWcXlF0oO6gmWuIxLFHaR9wZlKxcgz23YkJi4_TEpuDeALWv3jKDO1KXus8 Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f51f722d8cf74c088851d5e83d888ff7 Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1516323481 Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:43:38.537801 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f51f722d8cf74c088851d5e83d888ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f51f722d8cf74c088851d5e83d888ff7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f51f722d8cf74c088851d5e83d888ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f51f722d8cf74c088851d5e83d888ff7"}]}] Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1516323481 Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f51f722d8cf74c088851d5e83d888ff7 Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1516323481 Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: ec3c907b5e514716b96d9dc117902678 Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 19:43:38.539384 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:38.540216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:38.541518 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:38.541518 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:38.541518 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:38.541518 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 19:43:38.541518 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:38.542592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c4816ad3-b8d2-47ce-96a9-3ac8a694ef50 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:38.544064 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c4816ad3-b8d2-47ce-96a9-3ac8a694ef50 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.024395 Oct 11 19:43:38.549240 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 212/439] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:38.554827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f98b1227-ebfc-4d2b-bd4c-0965db5d919b tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1972081398", "id": 1287936201, "os-flavor-access:is_public": "False"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:38.577977 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f98b1227-ebfc-4d2b-bd4c-0965db5d919b tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.027439 Oct 11 19:43:38.578972 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 213/440] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:38 2022] POST /compute/v2.1/flavors => generated 431 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:38.589464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-db2ed06a-8bd2-4ee0-9501-ab83ea7948e1 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Calling method '.version_select at 0x7f83ccba8f70>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.595033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db2ed06a-8bd2-4ee0-9501-ab83ea7948e1 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.595573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db2ed06a-8bd2-4ee0-9501-ab83ea7948e1 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.596165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db2ed06a-8bd2-4ee0-9501-ab83ea7948e1 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.596987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db2ed06a-8bd2-4ee0-9501-ab83ea7948e1 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.597443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db2ed06a-8bd2-4ee0-9501-ab83ea7948e1 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.603268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db2ed06a-8bd2-4ee0-9501-ab83ea7948e1 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.627857 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-db2ed06a-8bd2-4ee0-9501-ab83ea7948e1 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.047397 Oct 11 19:43:38.628637 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 214/441] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:38.638862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Calling method '.version_select at 0x7f83ccba7040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.641249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.641909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.642506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.674069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.674904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.675496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.695790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.696290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.696732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.705280 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f9e7d0a2-1f29-4e63-b165-75e535760a45 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075340 Oct 11 19:43:38.708191 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 215/442] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:38.717920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a8d713f-2cca-4500-bdca-fe0d7d98170c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.719605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7a8d713f-2cca-4500-bdca-fe0d7d98170c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:38.722927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1440a5dc-364b-434b-8f2f-e75f012a4750 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:38.730081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a8d713f-2cca-4500-bdca-fe0d7d98170c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.730718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a8d713f-2cca-4500-bdca-fe0d7d98170c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.731254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a8d713f-2cca-4500-bdca-fe0d7d98170c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.732158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a8d713f-2cca-4500-bdca-fe0d7d98170c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.732712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a8d713f-2cca-4500-bdca-fe0d7d98170c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.733393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a8d713f-2cca-4500-bdca-fe0d7d98170c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.733976 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1440a5dc-364b-434b-8f2f-e75f012a4750 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1494 microversion: 2.1 time: 0.309726 Oct 11 19:43:38.734789 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 228/443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1494 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:38.745469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b88d1f55-a014-4be0-be90-5429d98e1d72 tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.777559 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b88d1f55-a014-4be0-be90-5429d98e1d72 tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1287936201/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.037772 Oct 11 19:43:38.778183 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 229/444] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/flavors/1287936201/os-flavor-access => generated 21 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:43:38.788791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d0793dc4-4d41-4bfe-ace9-84c58a2f6881 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Calling method '.version_select at 0x7f83ccb85f70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.792423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0793dc4-4d41-4bfe-ace9-84c58a2f6881 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.793082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0793dc4-4d41-4bfe-ace9-84c58a2f6881 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.793796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0793dc4-4d41-4bfe-ace9-84c58a2f6881 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.794699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0793dc4-4d41-4bfe-ace9-84c58a2f6881 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.795323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0793dc4-4d41-4bfe-ace9-84c58a2f6881 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.795899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0793dc4-4d41-4bfe-ace9-84c58a2f6881 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.837166 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d0793dc4-4d41-4bfe-ace9-84c58a2f6881 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.052505 Oct 11 19:43:38.840702 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 230/445] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:38.848173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8900127a-004c-4cf1-a1d3-bad87a39cc2f tempest-HypervisorAdminNegativeUnderV252Test-1701143013 tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project] Calling method '.version_select at 0x7f83cce175e0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.852973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8900127a-004c-4cf1-a1d3-bad87a39cc2f tempest-HypervisorAdminNegativeUnderV252Test-1701143013 tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '2221159838e045f3afde02f795a0f5d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f90d38ec9be431a8a9dd26c960c7319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8900127a-004c-4cf1-a1d3-bad87a39cc2f tempest-HypervisorAdminNegativeUnderV252Test-1701143013 tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project] Request method failure captured: Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdoNIoNS7g5DLxmin5HfulAIR0n_v3qI0kTr2zmCYqRvhDeQg-ZXdpUHYknbJ6soYZDTAfOUa8Gw3Hs3l_ROt4t8hYKT3vAMgWtyb3EPJ5K-QRXqtyg9N7w0BAid1hT12spyL4Hq1J5bWSj7gHoMyjW9SVL5xPiLOMCm349QRBgQTE Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 4f90d38ec9be431a8a9dd26c960c7319 Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1701143013 Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:38.857415 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f90d38ec9be431a8a9dd26c960c7319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f90d38ec9be431a8a9dd26c960c7319", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f90d38ec9be431a8a9dd26c960c7319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f90d38ec9be431a8a9dd26c960c7319"}]}] Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1701143013 Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 4f90d38ec9be431a8a9dd26c960c7319 Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1701143013 Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 2221159838e045f3afde02f795a0f5d5 Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 19:43:38.858853 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '1'} Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:38.859924 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 19:43:38.861486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:38.879465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8900127a-004c-4cf1-a1d3-bad87a39cc2f tempest-HypervisorAdminNegativeUnderV252Test-1701143013 tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:38.880318 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8900127a-004c-4cf1-a1d3-bad87a39cc2f tempest-HypervisorAdminNegativeUnderV252Test-1701143013 tempest-HypervisorAdminNegativeUnderV252Test-1701143013-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.038481 Oct 11 19:43:38.881379 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 231/446] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:38.889054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c9a578a-4d91-48dc-8fd5-8bcbde0ed9ae tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '.version_select at 0x7f83ccb52c10>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.892791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c9a578a-4d91-48dc-8fd5-8bcbde0ed9ae tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.893513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c9a578a-4d91-48dc-8fd5-8bcbde0ed9ae tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.894182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c9a578a-4d91-48dc-8fd5-8bcbde0ed9ae tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.909995 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5c9a578a-4d91-48dc-8fd5-8bcbde0ed9ae tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.024700 Oct 11 19:43:38.911057 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 232/447] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:38.916613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32f67375-36d3-43ae-add1-a04968d32845 tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.941888 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-32f67375-36d3-43ae-add1-a04968d32845 tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1287936201" status: 202 len: 0 microversion: 2.1 time: 0.029308 Oct 11 19:43:38.946845 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 233/448] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:38 2022] DELETE /compute/v2.1/flavors/1287936201 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:38.952209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-34e36a94-0d9e-4e00-8d8e-0e24b348a787 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Calling method '.version_select at 0x7f83cce174c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:38.960951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e36a94-0d9e-4e00-8d8e-0e24b348a787 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.962037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e36a94-0d9e-4e00-8d8e-0e24b348a787 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.962893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e36a94-0d9e-4e00-8d8e-0e24b348a787 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:38.979281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e36a94-0d9e-4e00-8d8e-0e24b348a787 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:38.979764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e36a94-0d9e-4e00-8d8e-0e24b348a787 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:38.980189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e36a94-0d9e-4e00-8d8e-0e24b348a787 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:39.016079 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-34e36a94-0d9e-4e00-8d8e-0e24b348a787 tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-860864-3" status: 200 len: 598 microversion: 2.1 time: 0.068078 Oct 11 19:43:39.016927 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 234/449] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/os-hosts/n-h1-860864-3 => generated 598 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:39.021389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-179c1304-b1de-4f39-b6b3-17dfccb22160 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Calling method '.version_select at 0x7f83ccb52c10>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:39.024006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-179c1304-b1de-4f39-b6b3-17dfccb22160 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:39.024906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-179c1304-b1de-4f39-b6b3-17dfccb22160 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:39.025724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-179c1304-b1de-4f39-b6b3-17dfccb22160 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:39.042444 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-179c1304-b1de-4f39-b6b3-17dfccb22160 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] HTTP exception thrown: No hypervisor matching 'b332f4e0-29b3-4658-b08c-f4acf6e743ab' could be found. Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-179c1304-b1de-4f39-b6b3-17dfccb22160 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Request method failure captured: Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-hypervisors/b332f4e0-29b3-4658-b08c-f4acf6e743ab/servers HTTP/1.1 Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdpURRSk6rkJyHPaHLB6w_BvxfbprjBeNYxq9AtFcr2BE15zOedwQyRUg7YOnwYcjBHwzolwlXUs0TYZ7WtVQo-6skGKZAGj46-PR1HNaRwRJ36KIL7bWcXlF0oO6gmWuIxLFHaR9wZlKxcgz23YkJi4_TEpuDeALWv3jKDO1KXus8 Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f51f722d8cf74c088851d5e83d888ff7 Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1516323481 Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:43:39.043686 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f51f722d8cf74c088851d5e83d888ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f51f722d8cf74c088851d5e83d888ff7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f51f722d8cf74c088851d5e83d888ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f51f722d8cf74c088851d5e83d888ff7"}]}] Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1516323481 Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f51f722d8cf74c088851d5e83d888ff7 Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1516323481 Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: ec3c907b5e514716b96d9dc117902678 Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: exception: No hypervisor matching 'b332f4e0-29b3-4658-b08c-f4acf6e743ab' could be found. Oct 11 19:43:39.045041 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'b332f4e0-29b3-4658-b08c-f4acf6e743ab'} Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'b332f4e0-29b3-4658-b08c-f4acf6e743ab' could be found. Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:39.045720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:39.048376 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:39.048376 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:39.048376 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:39.048376 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:39.048376 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'b332f4e0-29b3-4658-b08c-f4acf6e743ab' could be found. Oct 11 19:43:39.048376 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:39.048376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-179c1304-b1de-4f39-b6b3-17dfccb22160 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] Returning 404 to user: No hypervisor matching 'b332f4e0-29b3-4658-b08c-f4acf6e743ab' could be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:39.048376 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-179c1304-b1de-4f39-b6b3-17dfccb22160 tempest-HypervisorAdminNegativeUnderV252Test-1516323481 tempest-HypervisorAdminNegativeUnderV252Test-1516323481-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/b332f4e0-29b3-4658-b08c-f4acf6e743ab/servers" status: 404 len: 123 microversion: 2.1 time: 0.027158 Oct 11 19:43:39.048376 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 235/450] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 11 19:43:39 2022] GET /compute/v2.1/os-hypervisors/b332f4e0-29b3-4658-b08c-f4acf6e743ab/servers => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:39.062945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a3572bc6-c62a-4509-815c-2684bea15c87 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:39.063572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a3572bc6-c62a-4509-815c-2684bea15c87 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:39.077424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7a8d713f-2cca-4500-bdca-fe0d7d98170c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:39.086604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3572bc6-c62a-4509-815c-2684bea15c87 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:39.087812 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a8d713f-2cca-4500-bdca-fe0d7d98170c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1313 microversion: 2.1 time: 0.377038 Oct 11 19:43:39.088874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3572bc6-c62a-4509-815c-2684bea15c87 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:39.089006 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 216/451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:38 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:39.089908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3572bc6-c62a-4509-815c-2684bea15c87 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:39.090917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3572bc6-c62a-4509-815c-2684bea15c87 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:39.091618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3572bc6-c62a-4509-815c-2684bea15c87 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:39.092334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3572bc6-c62a-4509-815c-2684bea15c87 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:39.102387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0bbb0c33-4453-4ea6-aad0-9ab865b19d4c tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:39.140056 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0bbb0c33-4453-4ea6-aad0-9ab865b19d4c tempest-FlavorsAccessTestJSON-2094263416 tempest-FlavorsAccessTestJSON-2094263416-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.049948 Oct 11 19:43:39.153013 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 217/452] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:39 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:39.169192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6458f698-7042-4e47-b693-ac5d3f49712c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Calling method '.version_select at 0x7f83ccba75e0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:39.175838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:39.184999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6458f698-7042-4e47-b693-ac5d3f49712c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:39.185502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6458f698-7042-4e47-b693-ac5d3f49712c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:39.186068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6458f698-7042-4e47-b693-ac5d3f49712c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:39.203378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6458f698-7042-4e47-b693-ac5d3f49712c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:39.203978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6458f698-7042-4e47-b693-ac5d3f49712c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:39.204492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6458f698-7042-4e47-b693-ac5d3f49712c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:39.253267 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6458f698-7042-4e47-b693-ac5d3f49712c tempest-HostsAdminTestJSON-1083554966 tempest-HostsAdminTestJSON-1083554966-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-860864-3" status: 200 len: 860 microversion: 2.1 time: 0.098005 Oct 11 19:43:39.254890 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 218/453] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 11 19:43:39 2022] GET /compute/v2.1/os-hosts/n-h2-860864-3 => generated 860 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:39.265173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5d692a9f-b87a-4581-b619-6a4305556d5c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:39.266173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5d692a9f-b87a-4581-b619-6a4305556d5c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:39.273732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d692a9f-b87a-4581-b619-6a4305556d5c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:39.274230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d692a9f-b87a-4581-b619-6a4305556d5c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:39.274702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d692a9f-b87a-4581-b619-6a4305556d5c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:39.275479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d692a9f-b87a-4581-b619-6a4305556d5c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:39.275994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d692a9f-b87a-4581-b619-6a4305556d5c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:39.276422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d692a9f-b87a-4581-b619-6a4305556d5c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:39.345812 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a3572bc6-c62a-4509-815c-2684bea15c87 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1645 microversion: 2.1 time: 0.298762 Oct 11 19:43:39.347037 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 236/454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:39 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1645 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:39.370237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3e0caf41-40a5-4446-8d29-2a70d1c0c83d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:39.372998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3e0caf41-40a5-4446-8d29-2a70d1c0c83d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:39.401967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e0caf41-40a5-4446-8d29-2a70d1c0c83d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:39.402716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e0caf41-40a5-4446-8d29-2a70d1c0c83d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:39.404338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e0caf41-40a5-4446-8d29-2a70d1c0c83d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:39.405211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e0caf41-40a5-4446-8d29-2a70d1c0c83d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:39.407205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e0caf41-40a5-4446-8d29-2a70d1c0c83d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:39.408256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e0caf41-40a5-4446-8d29-2a70d1c0c83d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:39.633207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3e0caf41-40a5-4446-8d29-2a70d1c0c83d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:39.656669 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3e0caf41-40a5-4446-8d29-2a70d1c0c83d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1214 microversion: 2.1 time: 0.308319 Oct 11 19:43:39.660631 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 237/455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:39 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:39.782666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5d692a9f-b87a-4581-b619-6a4305556d5c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:39.786543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1744052282", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "12e7d5a8-d39a-440c-a1be-ed5e1c015008"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:39.799750 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5d692a9f-b87a-4581-b619-6a4305556d5c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1325 microversion: 2.1 time: 0.540439 Oct 11 19:43:39.801285 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 219/456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:39 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:39.992008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] validate_networks() for [('12e7d5a8-d39a-440c-a1be-ed5e1c015008', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:43:40.113189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-03ce5b2b-1e51-442d-a16b-5a2d35d51143 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:40.114311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-03ce5b2b-1e51-442d-a16b-5a2d35d51143 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:40.128950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03ce5b2b-1e51-442d-a16b-5a2d35d51143 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:40.129674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03ce5b2b-1e51-442d-a16b-5a2d35d51143 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:40.131266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03ce5b2b-1e51-442d-a16b-5a2d35d51143 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:40.133134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03ce5b2b-1e51-442d-a16b-5a2d35d51143 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:40.136026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03ce5b2b-1e51-442d-a16b-5a2d35d51143 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:40.136772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03ce5b2b-1e51-442d-a16b-5a2d35d51143 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:40.706450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-03ce5b2b-1e51-442d-a16b-5a2d35d51143 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:40.718233 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-03ce5b2b-1e51-442d-a16b-5a2d35d51143 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1313 microversion: 2.1 time: 0.610631 Oct 11 19:43:40.719354 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 220/457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:40 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:40.737945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f7ab175c-9415-48a0-9f06-1aaa5d237f57 req-c182949e-965b-4c4b-b81a-6da4b10606f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1463ded-d983-4703-b256-08dfbb0cda89", "tag": "9a1e3906-cf0e-4288-b9c2-eba283fe7bcf"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:40.752362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f7ab175c-9415-48a0-9f06-1aaa5d237f57 req-c182949e-965b-4c4b-b81a-6da4b10606f4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:40.753066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f7ab175c-9415-48a0-9f06-1aaa5d237f57 req-c182949e-965b-4c4b-b81a-6da4b10606f4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:40.753714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f7ab175c-9415-48a0-9f06-1aaa5d237f57 req-c182949e-965b-4c4b-b81a-6da4b10606f4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:40.786045 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f7ab175c-9415-48a0-9f06-1aaa5d237f57 req-c182949e-965b-4c4b-b81a-6da4b10606f4 service nova] Creating event network-changed:9a1e3906-cf0e-4288-b9c2-eba283fe7bcf for instance b1463ded-d983-4703-b256-08dfbb0cda89 on n-h1-860864-3 Oct 11 19:43:40.807617 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f7ab175c-9415-48a0-9f06-1aaa5d237f57 req-c182949e-965b-4c4b-b81a-6da4b10606f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080692 Oct 11 19:43:40.809540 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 221/458] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:40.818083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-da79028b-e784-4034-8f67-b99268b73670 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:40.819714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-da79028b-e784-4034-8f67-b99268b73670 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:40.826003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da79028b-e784-4034-8f67-b99268b73670 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:40.826818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da79028b-e784-4034-8f67-b99268b73670 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:40.827340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da79028b-e784-4034-8f67-b99268b73670 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:40.828222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da79028b-e784-4034-8f67-b99268b73670 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:40.828792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da79028b-e784-4034-8f67-b99268b73670 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:40.829306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da79028b-e784-4034-8f67-b99268b73670 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:40.970351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-da79028b-e784-4034-8f67-b99268b73670 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:40.978953 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-da79028b-e784-4034-8f67-b99268b73670 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1276 microversion: 2.1 time: 0.167684 Oct 11 19:43:40.979532 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 222/459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:40 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:41.003288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c4fdfcbf-d648-452b-b26b-8c88c0de84d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:41.003901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c4fdfcbf-d648-452b-b26b-8c88c0de84d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:41.018706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4fdfcbf-d648-452b-b26b-8c88c0de84d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:41.019147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4fdfcbf-d648-452b-b26b-8c88c0de84d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:41.019581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4fdfcbf-d648-452b-b26b-8c88c0de84d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:41.020510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4fdfcbf-d648-452b-b26b-8c88c0de84d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:41.020940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4fdfcbf-d648-452b-b26b-8c88c0de84d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:41.021688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4fdfcbf-d648-452b-b26b-8c88c0de84d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:41.301588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:43:41.302052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:43:41.302483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:43:41.303561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:43:41.303986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:43:41.314978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:41.315866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:41.316742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:41.317511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:41.317943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:41.318615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:41.336917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Getting quotas for project 947af1a9d24f4e19a59ec820ba1a65e4. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:41.342608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Getting quotas for user 4e2460b9a8f34662b802709a91907510 and project 947af1a9d24f4e19a59ec820ba1a65e4. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:41.356178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:43:41.358409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:43:41.414513 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b8d412bb-c2b8-44fe-bdb3-84d825eff379 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.635560 Oct 11 19:43:41.415286 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 238/460] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:43:41.429411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a2090e1-6d0d-406e-abb2-406206a3333b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:41.430195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8a2090e1-6d0d-406e-abb2-406206a3333b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:41.667686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8a2090e1-6d0d-406e-abb2-406206a3333b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:41.679510 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a2090e1-6d0d-406e-abb2-406206a3333b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1211 microversion: 2.1 time: 0.255595 Oct 11 19:43:41.680038 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 239/461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:41 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1211 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:41.696596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4df46e12-ad7c-49ee-90f6-d5b132c795cd req-0ff0a3d1-9c18-4817-bb7f-8884eeef9bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bc7749-0f31-48b7-bf11-8fdc03fbb734", "name": "network-vif-plugged", "status": "completed", "tag": "d655f2a8-e159-4bde-9b89-9517f5997d24"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:41.713030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4df46e12-ad7c-49ee-90f6-d5b132c795cd req-0ff0a3d1-9c18-4817-bb7f-8884eeef9bdb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:41.715050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4df46e12-ad7c-49ee-90f6-d5b132c795cd req-0ff0a3d1-9c18-4817-bb7f-8884eeef9bdb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:41.715913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4df46e12-ad7c-49ee-90f6-d5b132c795cd req-0ff0a3d1-9c18-4817-bb7f-8884eeef9bdb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:41.734930 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4df46e12-ad7c-49ee-90f6-d5b132c795cd req-0ff0a3d1-9c18-4817-bb7f-8884eeef9bdb service nova] Creating event network-vif-plugged:d655f2a8-e159-4bde-9b89-9517f5997d24 for instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 on n-h2-860864-3 Oct 11 19:43:41.746750 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4df46e12-ad7c-49ee-90f6-d5b132c795cd req-0ff0a3d1-9c18-4817-bb7f-8884eeef9bdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059708 Oct 11 19:43:41.747969 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 240/462] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:43:41.753548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fac44f46-64b5-4dd8-bfa8-43732459c496 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:41.757902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fac44f46-64b5-4dd8-bfa8-43732459c496 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:41.772790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fac44f46-64b5-4dd8-bfa8-43732459c496 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:41.778312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fac44f46-64b5-4dd8-bfa8-43732459c496 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:41.780093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fac44f46-64b5-4dd8-bfa8-43732459c496 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:41.781560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fac44f46-64b5-4dd8-bfa8-43732459c496 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:41.782765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fac44f46-64b5-4dd8-bfa8-43732459c496 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:41.785318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fac44f46-64b5-4dd8-bfa8-43732459c496 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:41.862836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c4fdfcbf-d648-452b-b26b-8c88c0de84d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:41.874952 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c4fdfcbf-d648-452b-b26b-8c88c0de84d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1325 microversion: 2.1 time: 0.875379 Oct 11 19:43:41.875709 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 223/463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:40 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1325 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:42.016089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bbe50f6c-5159-48c2-848c-8a0be513c7af tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:42.017847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bbe50f6c-5159-48c2-848c-8a0be513c7af tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:42.033659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe50f6c-5159-48c2-848c-8a0be513c7af tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:42.034190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe50f6c-5159-48c2-848c-8a0be513c7af tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:42.034828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe50f6c-5159-48c2-848c-8a0be513c7af tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:42.035703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe50f6c-5159-48c2-848c-8a0be513c7af tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:42.036362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe50f6c-5159-48c2-848c-8a0be513c7af tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:42.037144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe50f6c-5159-48c2-848c-8a0be513c7af tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:42.211645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bbe50f6c-5159-48c2-848c-8a0be513c7af tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:42.225442 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bbe50f6c-5159-48c2-848c-8a0be513c7af tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1276 microversion: 2.1 time: 0.221492 Oct 11 19:43:42.242394 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 224/464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:42 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:42.265892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fac44f46-64b5-4dd8-bfa8-43732459c496 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:42.286270 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fac44f46-64b5-4dd8-bfa8-43732459c496 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1313 microversion: 2.1 time: 0.535635 Oct 11 19:43:42.286270 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 241/465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:41 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:42.709802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a00988bf-8daa-440d-9037-b0105abf8a8f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:42.710574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a00988bf-8daa-440d-9037-b0105abf8a8f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:42.724784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a00988bf-8daa-440d-9037-b0105abf8a8f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:42.726000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a00988bf-8daa-440d-9037-b0105abf8a8f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:42.729569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a00988bf-8daa-440d-9037-b0105abf8a8f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:42.730328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a00988bf-8daa-440d-9037-b0105abf8a8f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:42.730940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a00988bf-8daa-440d-9037-b0105abf8a8f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:42.731262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a00988bf-8daa-440d-9037-b0105abf8a8f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:42.899435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ded43d20-ec0d-478d-8f04-4f3a73ca4b08 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:42.900441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ded43d20-ec0d-478d-8f04-4f3a73ca4b08 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:42.913235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ded43d20-ec0d-478d-8f04-4f3a73ca4b08 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:42.913742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ded43d20-ec0d-478d-8f04-4f3a73ca4b08 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:42.914183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ded43d20-ec0d-478d-8f04-4f3a73ca4b08 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:42.919218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ded43d20-ec0d-478d-8f04-4f3a73ca4b08 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:42.919731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ded43d20-ec0d-478d-8f04-4f3a73ca4b08 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:42.920459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ded43d20-ec0d-478d-8f04-4f3a73ca4b08 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:42.967233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a00988bf-8daa-440d-9037-b0105abf8a8f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:42.984612 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a00988bf-8daa-440d-9037-b0105abf8a8f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1207 microversion: 2.1 time: 0.282195 Oct 11 19:43:43.001197 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 225/466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:42 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1207 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:43.254719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f815ff21-5bc6-4f9c-936d-1ca4c1fecd73 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:43.255346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f815ff21-5bc6-4f9c-936d-1ca4c1fecd73 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:43.275195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f815ff21-5bc6-4f9c-936d-1ca4c1fecd73 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:43.278688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f815ff21-5bc6-4f9c-936d-1ca4c1fecd73 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:43.279864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f815ff21-5bc6-4f9c-936d-1ca4c1fecd73 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:43.281768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f815ff21-5bc6-4f9c-936d-1ca4c1fecd73 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:43.286149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f815ff21-5bc6-4f9c-936d-1ca4c1fecd73 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:43.287828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f815ff21-5bc6-4f9c-936d-1ca4c1fecd73 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:43.436910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ded43d20-ec0d-478d-8f04-4f3a73ca4b08 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:43.451100 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ded43d20-ec0d-478d-8f04-4f3a73ca4b08 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1325 microversion: 2.1 time: 0.556593 Oct 11 19:43:43.462708 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 242/467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:42 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:43.485017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-492788d7-89e9-4166-964a-72b9e5ffec8e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:43.487900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-492788d7-89e9-4166-964a-72b9e5ffec8e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:43.508343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-492788d7-89e9-4166-964a-72b9e5ffec8e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:43.508839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-492788d7-89e9-4166-964a-72b9e5ffec8e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:43.509273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-492788d7-89e9-4166-964a-72b9e5ffec8e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:43.510140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-492788d7-89e9-4166-964a-72b9e5ffec8e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:43.510766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-492788d7-89e9-4166-964a-72b9e5ffec8e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:43.511358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-492788d7-89e9-4166-964a-72b9e5ffec8e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:44.043192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f815ff21-5bc6-4f9c-936d-1ca4c1fecd73 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:44.050905 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f815ff21-5bc6-4f9c-936d-1ca4c1fecd73 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1318 microversion: 2.1 time: 0.803715 Oct 11 19:43:44.068549 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 226/468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:43 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:44.074472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c5cec9f9-bca9-4335-8400-653eb2bf9d19 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:44.077718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c5cec9f9-bca9-4335-8400-653eb2bf9d19 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:44.086174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5cec9f9-bca9-4335-8400-653eb2bf9d19 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:44.087745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5cec9f9-bca9-4335-8400-653eb2bf9d19 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:44.088434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5cec9f9-bca9-4335-8400-653eb2bf9d19 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:44.089647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5cec9f9-bca9-4335-8400-653eb2bf9d19 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:44.090188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5cec9f9-bca9-4335-8400-653eb2bf9d19 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:44.090978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5cec9f9-bca9-4335-8400-653eb2bf9d19 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:44.128469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-492788d7-89e9-4166-964a-72b9e5ffec8e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:44.143382 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-492788d7-89e9-4166-964a-72b9e5ffec8e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1313 microversion: 2.1 time: 0.665735 Oct 11 19:43:44.162935 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 243/469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:43 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:44.253486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c5cec9f9-bca9-4335-8400-653eb2bf9d19 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:44.272760 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c5cec9f9-bca9-4335-8400-653eb2bf9d19 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1263 microversion: 2.1 time: 0.198442 Oct 11 19:43:44.274200 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 227/470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:44 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1263 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:44.488626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-979be83c-d38b-4b6a-8958-702c895b75f9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:44.489245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-979be83c-d38b-4b6a-8958-702c895b75f9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:44.492963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:44.516315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-979be83c-d38b-4b6a-8958-702c895b75f9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:44.517258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-979be83c-d38b-4b6a-8958-702c895b75f9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:44.519440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-979be83c-d38b-4b6a-8958-702c895b75f9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:44.524638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-979be83c-d38b-4b6a-8958-702c895b75f9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:44.526911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-979be83c-d38b-4b6a-8958-702c895b75f9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:44.528009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-979be83c-d38b-4b6a-8958-702c895b75f9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:44.698651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-26dbced5-b491-4a1b-932c-ba775f0f3dd1 req-dd26be2e-f206-4618-be6b-e3610cb4639c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "997ed107-5049-429a-9611-ba2857048a40", "tag": "07530b11-69b9-4de4-8e00-bad254f64145"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:44.721448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-26dbced5-b491-4a1b-932c-ba775f0f3dd1 req-dd26be2e-f206-4618-be6b-e3610cb4639c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:44.722331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-26dbced5-b491-4a1b-932c-ba775f0f3dd1 req-dd26be2e-f206-4618-be6b-e3610cb4639c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:44.723041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-26dbced5-b491-4a1b-932c-ba775f0f3dd1 req-dd26be2e-f206-4618-be6b-e3610cb4639c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:44.740842 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-26dbced5-b491-4a1b-932c-ba775f0f3dd1 req-dd26be2e-f206-4618-be6b-e3610cb4639c service nova] Creating event network-changed:07530b11-69b9-4de4-8e00-bad254f64145 for instance 997ed107-5049-429a-9611-ba2857048a40 on n-h1-860864-3 Oct 11 19:43:44.750375 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-26dbced5-b491-4a1b-932c-ba775f0f3dd1 req-dd26be2e-f206-4618-be6b-e3610cb4639c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071059 Oct 11 19:43:44.751699 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 228/471] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:43:44.980125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-979be83c-d38b-4b6a-8958-702c895b75f9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:44.993315 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-979be83c-d38b-4b6a-8958-702c895b75f9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1520 microversion: 2.1 time: 0.506155 Oct 11 19:43:44.995768 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 244/472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:44 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1520 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:45.022812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d3306071-70c0-43b4-82e1-ecb3b357b1fe tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:45.024137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d3306071-70c0-43b4-82e1-ecb3b357b1fe tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:45.042268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3306071-70c0-43b4-82e1-ecb3b357b1fe tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:45.044663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3306071-70c0-43b4-82e1-ecb3b357b1fe tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:45.045878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3306071-70c0-43b4-82e1-ecb3b357b1fe tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:45.046832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3306071-70c0-43b4-82e1-ecb3b357b1fe tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:45.050509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3306071-70c0-43b4-82e1-ecb3b357b1fe tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:45.051158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3306071-70c0-43b4-82e1-ecb3b357b1fe tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:45.078865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51d2ef95-b507-4ce7-bcaf-3ea28ad2b2ba tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:45.079913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51d2ef95-b507-4ce7-bcaf-3ea28ad2b2ba tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:45.100100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51d2ef95-b507-4ce7-bcaf-3ea28ad2b2ba tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:45.101527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51d2ef95-b507-4ce7-bcaf-3ea28ad2b2ba tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:45.105750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51d2ef95-b507-4ce7-bcaf-3ea28ad2b2ba tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:45.107991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51d2ef95-b507-4ce7-bcaf-3ea28ad2b2ba tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:45.113095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51d2ef95-b507-4ce7-bcaf-3ea28ad2b2ba tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:45.118220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51d2ef95-b507-4ce7-bcaf-3ea28ad2b2ba tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:45.800467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d3306071-70c0-43b4-82e1-ecb3b357b1fe tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:45.803241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51d2ef95-b507-4ce7-bcaf-3ea28ad2b2ba tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:45.813144 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51d2ef95-b507-4ce7-bcaf-3ea28ad2b2ba tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1318 microversion: 2.1 time: 0.739225 Oct 11 19:43:45.814251 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 245/473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:45 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:45.821477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bf65d0db-c4c3-4224-ae45-ca5c0b6c856f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:45.822287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bf65d0db-c4c3-4224-ae45-ca5c0b6c856f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:45.837227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf65d0db-c4c3-4224-ae45-ca5c0b6c856f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:45.845222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d3306071-70c0-43b4-82e1-ecb3b357b1fe tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1520 microversion: 2.1 time: 0.828139 Oct 11 19:43:45.846170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf65d0db-c4c3-4224-ae45-ca5c0b6c856f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:45.856289 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 229/474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:45 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1520 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:45.856840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d52c8613-0c6a-453a-84f3-0320d787b999 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:45.857335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf65d0db-c4c3-4224-ae45-ca5c0b6c856f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:45.858199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d52c8613-0c6a-453a-84f3-0320d787b999 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:45.858500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf65d0db-c4c3-4224-ae45-ca5c0b6c856f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:45.867477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf65d0db-c4c3-4224-ae45-ca5c0b6c856f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:45.868131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf65d0db-c4c3-4224-ae45-ca5c0b6c856f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:45.871142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d52c8613-0c6a-453a-84f3-0320d787b999 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:45.871686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d52c8613-0c6a-453a-84f3-0320d787b999 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:45.872315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d52c8613-0c6a-453a-84f3-0320d787b999 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:45.882263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d52c8613-0c6a-453a-84f3-0320d787b999 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:45.882263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d52c8613-0c6a-453a-84f3-0320d787b999 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:45.882263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d52c8613-0c6a-453a-84f3-0320d787b999 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:46.289922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d52c8613-0c6a-453a-84f3-0320d787b999 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:46.301951 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d52c8613-0c6a-453a-84f3-0320d787b999 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1311 microversion: 2.1 time: 0.451241 Oct 11 19:43:46.312947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bf65d0db-c4c3-4224-ae45-ca5c0b6c856f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:46.315672 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 230/475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:45 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1311 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:46.324095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8db2cc92-6efe-4dac-834a-0b1e85b4e479 req-3978e83d-30e5-4572-9142-ed9b487f7f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f663a0-eedd-4d4f-934b-05c7bd72ce6f", "tag": "3a7eecd6-579e-43b5-bdc4-004193387045"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:46.329105 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bf65d0db-c4c3-4224-ae45-ca5c0b6c856f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1313 microversion: 2.1 time: 0.511054 Oct 11 19:43:46.330485 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 246/476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:45 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:46.352281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8db2cc92-6efe-4dac-834a-0b1e85b4e479 req-3978e83d-30e5-4572-9142-ed9b487f7f52 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:46.353009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8db2cc92-6efe-4dac-834a-0b1e85b4e479 req-3978e83d-30e5-4572-9142-ed9b487f7f52 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:46.353592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8db2cc92-6efe-4dac-834a-0b1e85b4e479 req-3978e83d-30e5-4572-9142-ed9b487f7f52 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:46.365874 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8db2cc92-6efe-4dac-834a-0b1e85b4e479 req-3978e83d-30e5-4572-9142-ed9b487f7f52 service nova] Creating event network-changed:3a7eecd6-579e-43b5-bdc4-004193387045 for instance b8f663a0-eedd-4d4f-934b-05c7bd72ce6f on n-h2-860864-3 Oct 11 19:43:46.371078 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8db2cc92-6efe-4dac-834a-0b1e85b4e479 req-3978e83d-30e5-4572-9142-ed9b487f7f52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054129 Oct 11 19:43:46.371974 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 231/477] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:46.377746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eeda1abb-7010-414c-916b-1f143edf2047 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-50693496", "metadata": {"": ""}}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eeda1abb-7010-414c-916b-1f143edf2047 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action HTTP/1.1 Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 105 Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:43:46.388677 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-50693496", "metadata": {"": ""}}} Oct 11 19:43:46.389966 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '69bc7749-0f31-48b7-bf11-8fdc03fbb734', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-50693496', 'metadata': {'': ''}}}} Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'': ''} Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:46.390702 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:46.391867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:46.392933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:46.392933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:46.392933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:43:46.392933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:43:46.392933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 19:43:46.392933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:46.394844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eeda1abb-7010-414c-916b-1f143edf2047 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:46.395988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eeda1abb-7010-414c-916b-1f143edf2047 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action" status: 400 len: 170 microversion: 2.1 time: 0.022927 Oct 11 19:43:46.397278 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 232/478] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Oct 11 19:43:46 2022] POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action => generated 170 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:43:46.402247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e4931e29-52fc-4f21-8186-2325a82a4d15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:46.403668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e4931e29-52fc-4f21-8186-2325a82a4d15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:46.411598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4931e29-52fc-4f21-8186-2325a82a4d15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:46.413142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4931e29-52fc-4f21-8186-2325a82a4d15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:46.413808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4931e29-52fc-4f21-8186-2325a82a4d15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:46.414950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4931e29-52fc-4f21-8186-2325a82a4d15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:46.415556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4931e29-52fc-4f21-8186-2325a82a4d15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:46.416131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4931e29-52fc-4f21-8186-2325a82a4d15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:46.426020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:46.463162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e4931e29-52fc-4f21-8186-2325a82a4d15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:43:46.574147 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e4931e29-52fc-4f21-8186-2325a82a4d15 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "DELETE /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 204 len: 0 microversion: 2.1 time: 0.175286 Oct 11 19:43:46.574966 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 233/479] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:43:46 2022] DELETE /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:43:46.579839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-33bdec41-9405-4f4d-b78b-e2a2e4cd1eb8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:46.580543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-33bdec41-9405-4f4d-b78b-e2a2e4cd1eb8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:46.587101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33bdec41-9405-4f4d-b78b-e2a2e4cd1eb8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:46.587472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33bdec41-9405-4f4d-b78b-e2a2e4cd1eb8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:46.587908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33bdec41-9405-4f4d-b78b-e2a2e4cd1eb8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:46.588603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33bdec41-9405-4f4d-b78b-e2a2e4cd1eb8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:46.589226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33bdec41-9405-4f4d-b78b-e2a2e4cd1eb8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:46.589820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33bdec41-9405-4f4d-b78b-e2a2e4cd1eb8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:46.669261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d43ff79a-bc19-40e6-bc91-45fdcf82c9d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-479831075", "ram": 512, "vcpus": 1, "disk": 10, "id": 1218245296, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:46.693553 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d43ff79a-bc19-40e6-bc91-45fdcf82c9d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.359796 Oct 11 19:43:46.694404 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 247/480] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:46 2022] POST /compute/v2.1/flavors => generated 415 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:46.751974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-33bdec41-9405-4f4d-b78b-e2a2e4cd1eb8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:46.765382 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-33bdec41-9405-4f4d-b78b-e2a2e4cd1eb8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1520 microversion: 2.1 time: 0.188860 Oct 11 19:43:46.766773 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 234/481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:46 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:46.775298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-128709512", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "384604654", "adminPass": "***", "networks": [{"uuid": "4d33fc3c-6ffd-40f8-9ec5-ef472bfacbe9"}], "security_groups": [{"name": "tempest-securitygroup--683654186"}], "key_name": "tempest-keypair-356615870", "user_data": "}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:46.913430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] validate_networks() for [('4d33fc3c-6ffd-40f8-9ec5-ef472bfacbe9', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:43:47.003231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6af6ba9a-220c-4136-aedd-560b6a4b99c2 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:47.025802 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6af6ba9a-220c-4136-aedd-560b6a4b99c2 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] HTTP exception thrown: Flavor 1218245296 has no extra specs with key hw:cpu_thread_policy. Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6af6ba9a-220c-4136-aedd-560b6a4b99c2 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Request method failure captured: Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/flavors/1218245296/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdvKT6FNA_HVEofXCDRYStNPwls3MFJ837hs0gn2Nbm0e4Vu2qYrqpQdiN9MRLDD5VY4OaBxDkDKo_6D55CzZeoOBeEhmM3otL6l5oK0ts4KRQVBHj2ihHU4nlrl5OxYqg3M2_6e2kQkrE5c9dQCvXEHXbiK48NpMeehxYMYqgKe6s Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 77322cd1bc5340099c40ea5cda93bcf6 Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:47.030726 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77322cd1bc5340099c40ea5cda93bcf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77322cd1bc5340099c40ea5cda93bcf6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77322cd1bc5340099c40ea5cda93bcf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77322cd1bc5340099c40ea5cda93bcf6"}]}] Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 77322cd1bc5340099c40ea5cda93bcf6 Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7d2de2aa42f041faa8049f2ebdb78365 Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:47.032131 n-d-860864-3 devstack@n-api.service[126955]: exception: Flavor 1218245296 has no extra specs with key hw:cpu_thread_policy. Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'flavor_id': '1218245296', 'id': 'hw:cpu_thread_policy'} Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1218245296 has no extra specs with key hw:cpu_thread_policy. Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:47.032879 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:47.034264 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:47.034264 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:47.034264 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:47.034264 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:47.034264 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:47.034264 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1218245296 has no extra specs with key hw:cpu_thread_policy. Oct 11 19:43:47.034264 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:47.040563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6af6ba9a-220c-4136-aedd-560b6a4b99c2 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Returning 404 to user: Flavor 1218245296 has no extra specs with key hw:cpu_thread_policy. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:47.041676 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6af6ba9a-220c-4136-aedd-560b6a4b99c2 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] 10.222.0.27 "GET /compute/v2.1/flavors/1218245296/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.338207 Oct 11 19:43:47.047762 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 248/482] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 19:43:46 2022] GET /compute/v2.1/flavors/1218245296/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 345 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:47.066199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a63445f-0821-4ac3-8a44-697f37bf4ed8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:47.068462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9a63445f-0821-4ac3-8a44-697f37bf4ed8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:47.085139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a63445f-0821-4ac3-8a44-697f37bf4ed8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:47.087092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a63445f-0821-4ac3-8a44-697f37bf4ed8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:47.090653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a63445f-0821-4ac3-8a44-697f37bf4ed8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:47.091426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a63445f-0821-4ac3-8a44-697f37bf4ed8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:47.092074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a63445f-0821-4ac3-8a44-697f37bf4ed8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:47.092522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a63445f-0821-4ac3-8a44-697f37bf4ed8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:47.396990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9a63445f-0821-4ac3-8a44-697f37bf4ed8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:47.404894 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a63445f-0821-4ac3-8a44-697f37bf4ed8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1520 microversion: 2.1 time: 0.355828 Oct 11 19:43:47.405463 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 249/483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:47 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:47.411034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d7a14474-8ea1-4008-ac02-c72f30fdc0f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:47.411907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d7a14474-8ea1-4008-ac02-c72f30fdc0f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:47.419296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7a14474-8ea1-4008-ac02-c72f30fdc0f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:47.420047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7a14474-8ea1-4008-ac02-c72f30fdc0f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:47.420620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7a14474-8ea1-4008-ac02-c72f30fdc0f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:47.421473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7a14474-8ea1-4008-ac02-c72f30fdc0f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:47.422371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7a14474-8ea1-4008-ac02-c72f30fdc0f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:47.422825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7a14474-8ea1-4008-ac02-c72f30fdc0f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:47.658416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:43:47.658975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:43:47.659480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:43:47.659995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:43:47.660479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:43:47.667068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d7a14474-8ea1-4008-ac02-c72f30fdc0f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:47.671731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:47.672299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:47.672948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:47.673684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:47.674143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:47.674784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:47.676126 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d7a14474-8ea1-4008-ac02-c72f30fdc0f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1318 microversion: 2.1 time: 0.269238 Oct 11 19:43:47.690874 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 250/484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:47 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:47.696767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Getting quotas for project 2a7b6535ad3d4f56b4483a9cde85691b. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:47.697470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-28027f3b-b1ed-4984-86f1-f7ffdb8cf7bb tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:47.701162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-28027f3b-b1ed-4984-86f1-f7ffdb8cf7bb tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '7d2de2aa42f041faa8049f2ebdb78365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77322cd1bc5340099c40ea5cda93bcf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:47.702062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Getting quotas for user 603e5875618949c1998ea23bf0e954b5 and project 2a7b6535ad3d4f56b4483a9cde85691b. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-28027f3b-b1ed-4984-86f1-f7ffdb8cf7bb tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Request method failure captured: Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/flavors/1218245296/os-extra_specs HTTP/1.1 Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 66 Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdvKT6FNA_HVEofXCDRYStNPwls3MFJ837hs0gn2Nbm0e4Vu2qYrqpQdiN9MRLDD5VY4OaBxDkDKo_6D55CzZeoOBeEhmM3otL6l5oK0ts4KRQVBHj2ihHU4nlrl5OxYqg3M2_6e2kQkrE5c9dQCvXEHXbiK48NpMeehxYMYqgKe6s Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 77322cd1bc5340099c40ea5cda93bcf6 Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:47.702812 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77322cd1bc5340099c40ea5cda93bcf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77322cd1bc5340099c40ea5cda93bcf6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77322cd1bc5340099c40ea5cda93bcf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77322cd1bc5340099c40ea5cda93bcf6"}]}] Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 77322cd1bc5340099c40ea5cda93bcf6 Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7d2de2aa42f041faa8049f2ebdb78365 Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 11 19:43:47.704100 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'flavor_id': '1218245296', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:43:47.704738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 19:43:47.705805 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:47.707832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-28027f3b-b1ed-4984-86f1-f7ffdb8cf7bb tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:47.707832 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-28027f3b-b1ed-4984-86f1-f7ffdb8cf7bb tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] 10.222.0.27 "POST /compute/v2.1/flavors/1218245296/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.011987 Oct 11 19:43:47.707832 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 251/485] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Oct 11 19:43:47 2022] POST /compute/v2.1/flavors/1218245296/os-extra_specs => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:47.717975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:43:47.720784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:43:47.785511 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-05ea3ddc-a55d-4977-9190-69d11e7a68cd tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.016473 Oct 11 19:43:47.787172 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 235/486] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:43:47.945376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Calling method '.version_select at 0x7f83ccb46430>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:47.949136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:47.950267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:47.951059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:47.969989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:47.970673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:47.971949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:47.986943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:47.987429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:47.987860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:47.996292 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0ca4b8f6-fc68-4295-b0bc-d2ece0162a52 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.207441 Oct 11 19:43:47.997206 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 236/487] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:48.002463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-be7c451b-6060-49ae-933f-0267d3a6859b req-8a96056c-ecaf-41e2-87f6-d3efc9b8b381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1463ded-d983-4703-b256-08dfbb0cda89", "name": "network-vif-plugged", "status": "completed", "tag": "9a1e3906-cf0e-4288-b9c2-eba283fe7bcf"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:48.017441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d4abdd2e-6aac-44a7-b7d9-29ec3bf8361c tempest-InstanceUsageAuditLogTestJSON-1079187720 tempest-InstanceUsageAuditLogTestJSON-1079187720-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.018937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-be7c451b-6060-49ae-933f-0267d3a6859b req-8a96056c-ecaf-41e2-87f6-d3efc9b8b381 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.019525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-be7c451b-6060-49ae-933f-0267d3a6859b req-8a96056c-ecaf-41e2-87f6-d3efc9b8b381 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.020139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-be7c451b-6060-49ae-933f-0267d3a6859b req-8a96056c-ecaf-41e2-87f6-d3efc9b8b381 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.034211 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-be7c451b-6060-49ae-933f-0267d3a6859b req-8a96056c-ecaf-41e2-87f6-d3efc9b8b381 service nova] Creating event network-vif-plugged:9a1e3906-cf0e-4288-b9c2-eba283fe7bcf for instance b1463ded-d983-4703-b256-08dfbb0cda89 on n-h1-860864-3 Oct 11 19:43:48.040124 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-be7c451b-6060-49ae-933f-0267d3a6859b req-8a96056c-ecaf-41e2-87f6-d3efc9b8b381 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041490 Oct 11 19:43:48.045521 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 237/488] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:48.079272 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d4abdd2e-6aac-44a7-b7d9-29ec3bf8361c tempest-InstanceUsageAuditLogTestJSON-1079187720 tempest-InstanceUsageAuditLogTestJSON-1079187720-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11 19:43:47" status: 200 len: 318 microversion: 2.1 time: 0.373084 Oct 11 19:43:48.079982 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 252/489] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 19:43:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2019%3A43%3A47 => generated 318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:48.086069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11057515-011a-45e2-b8eb-41057da8799b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.087088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-11057515-011a-45e2-b8eb-41057da8799b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:48.096314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5bf9edd6-931b-4a5d-a168-6b9bc20792d6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.097566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11057515-011a-45e2-b8eb-41057da8799b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.098357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11057515-011a-45e2-b8eb-41057da8799b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.099179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11057515-011a-45e2-b8eb-41057da8799b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.100123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11057515-011a-45e2-b8eb-41057da8799b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.101286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11057515-011a-45e2-b8eb-41057da8799b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.102075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5bf9edd6-931b-4a5d-a168-6b9bc20792d6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:48.102348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11057515-011a-45e2-b8eb-41057da8799b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.117314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf9edd6-931b-4a5d-a168-6b9bc20792d6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.118134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf9edd6-931b-4a5d-a168-6b9bc20792d6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.132856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf9edd6-931b-4a5d-a168-6b9bc20792d6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.133720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf9edd6-931b-4a5d-a168-6b9bc20792d6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.135952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf9edd6-931b-4a5d-a168-6b9bc20792d6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.136397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf9edd6-931b-4a5d-a168-6b9bc20792d6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.323057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11057515-011a-45e2-b8eb-41057da8799b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:48.326610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:48.335342 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11057515-011a-45e2-b8eb-41057da8799b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1313 microversion: 2.1 time: 0.254019 Oct 11 19:43:48.350732 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 253/490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:48 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:48.350732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a593e3da-8088-49ea-a163-c440857e6a25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1641625949", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a593e3da-8088-49ea-a163-c440857e6a25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action HTTP/1.1 Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 619 Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:48.351904 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:48.353362 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:43:48.353362 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:48.353362 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:43:48.353362 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:48.353362 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:43:48.353362 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:48.353362 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:48.353362 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:43:48.353362 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:43:48.353362 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:43:48.354018 n-d-860864-3 devstack@n-api.service[126955]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1641625949", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 11 19:43:48.354018 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:48.354018 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '69bc7749-0f31-48b7-bf11-8fdc03fbb734', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1641625949', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 11 19:43:48.354257 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:48.355030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.356127 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:48.356921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:48.356921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:48.356921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:43:48.356921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:43:48.356921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 19:43:48.356921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.357317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5bf9edd6-931b-4a5d-a168-6b9bc20792d6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:48.358318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a593e3da-8088-49ea-a163-c440857e6a25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:48.359192 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a593e3da-8088-49ea-a163-c440857e6a25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action" status: 400 len: 938 microversion: 2.1 time: 0.018657 Oct 11 19:43:48.359873 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 254/491] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Oct 11 19:43:48 2022] POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action => generated 938 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:43:48.363342 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5bf9edd6-931b-4a5d-a168-6b9bc20792d6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1311 microversion: 2.1 time: 0.316156 Oct 11 19:43:48.363908 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 238/492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:48 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1311 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:48.365366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4028441f-57f4-49d3-bb03-21fb5577088c tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:48.374325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3a8d9356-13f9-4865-a65b-2ebf0b089498 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.375173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3a8d9356-13f9-4865-a65b-2ebf0b089498 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:48.384096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a8d9356-13f9-4865-a65b-2ebf0b089498 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.384984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a8d9356-13f9-4865-a65b-2ebf0b089498 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.385942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a8d9356-13f9-4865-a65b-2ebf0b089498 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.386804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a8d9356-13f9-4865-a65b-2ebf0b089498 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.387586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a8d9356-13f9-4865-a65b-2ebf0b089498 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.388024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a8d9356-13f9-4865-a65b-2ebf0b089498 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.402888 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4028441f-57f4-49d3-bb03-21fb5577088c tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1218245296/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041697 Oct 11 19:43:48.409156 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 255/493] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Oct 11 19:43:48 2022] POST /compute/v2.1/flavors/1218245296/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:43:48.414646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Calling method '.version_select at 0x7f83cc99b0d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.416678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.417164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.417599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.430584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.431069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.431640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.459340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3a8d9356-13f9-4865-a65b-2ebf0b089498 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:48.463245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.463732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.464165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.468534 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3a8d9356-13f9-4865-a65b-2ebf0b089498 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1265 microversion: 2.1 time: 0.102874 Oct 11 19:43:48.469109 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 239/494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:48 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:48.470799 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9e345cda-d333-4f8e-bad8-295da752d53c tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-860864-3/servers" status: 200 len: 512 microversion: 2.1 time: 0.060327 Oct 11 19:43:48.471352 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 256/495] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Oct 11 19:43:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-860864-3/servers => generated 512 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:48.478670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cd288769-269f-4c02-bf24-d973521bb4db tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.478865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cd288769-269f-4c02-bf24-d973521bb4db tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:48.482997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-289e8b5b-0ea6-4d4e-8f7f-2b5286d7b259 tempest-InstanceUsageAuditLogTestJSON-1079187720 tempest-InstanceUsageAuditLogTestJSON-1079187720-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.484994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd288769-269f-4c02-bf24-d973521bb4db tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.485510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd288769-269f-4c02-bf24-d973521bb4db tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.485939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd288769-269f-4c02-bf24-d973521bb4db tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.486654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd288769-269f-4c02-bf24-d973521bb4db tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.487101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd288769-269f-4c02-bf24-d973521bb4db tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.487516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd288769-269f-4c02-bf24-d973521bb4db tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.502354 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-289e8b5b-0ea6-4d4e-8f7f-2b5286d7b259 tempest-InstanceUsageAuditLogTestJSON-1079187720 tempest-InstanceUsageAuditLogTestJSON-1079187720-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.032240 Oct 11 19:43:48.502942 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 240/496] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 11 19:43:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:48.508156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbcc87ee-6eae-4788-8244-2bce071b7111 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.509675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fbcc87ee-6eae-4788-8244-2bce071b7111 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '7d2de2aa42f041faa8049f2ebdb78365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77322cd1bc5340099c40ea5cda93bcf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbcc87ee-6eae-4788-8244-2bce071b7111 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Request method failure captured: Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcdvKT6FNA_HVEofXCDRYStNPwls3MFJ837hs0gn2Nbm0e4Vu2qYrqpQdiN9MRLDD5VY4OaBxDkDKo_6D55CzZeoOBeEhmM3otL6l5oK0ts4KRQVBHj2ihHU4nlrl5OxYqg3M2_6e2kQkrE5c9dQCvXEHXbiK48NpMeehxYMYqgKe6s Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 77322cd1bc5340099c40ea5cda93bcf6 Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:43:48.511856 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77322cd1bc5340099c40ea5cda93bcf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77322cd1bc5340099c40ea5cda93bcf6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77322cd1bc5340099c40ea5cda93bcf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77322cd1bc5340099c40ea5cda93bcf6"}]}] Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 77322cd1bc5340099c40ea5cda93bcf6 Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 7d2de2aa42f041faa8049f2ebdb78365 Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:48.513263 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'flavor_id': '1218245296', 'id': 'hw:numa_nodes'} Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:48.514090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 19:43:48.515308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.519816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbcc87ee-6eae-4788-8244-2bce071b7111 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:48.520762 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fbcc87ee-6eae-4788-8244-2bce071b7111 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016707 Oct 11 19:43:48.522047 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 241/497] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 19:43:48 2022] DELETE /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:48.526754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-02e64185-6349-4ca6-94d0-984c262b480b req-e3a84cac-5a6f-4294-a4d9-2f4373531079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dea9975-b38a-465e-a181-454a20b0ae00", "tag": "44663329-774c-463a-a864-c1e0c979ab76"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:48.538619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-02e64185-6349-4ca6-94d0-984c262b480b req-e3a84cac-5a6f-4294-a4d9-2f4373531079 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.539145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-02e64185-6349-4ca6-94d0-984c262b480b req-e3a84cac-5a6f-4294-a4d9-2f4373531079 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.539570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-02e64185-6349-4ca6-94d0-984c262b480b req-e3a84cac-5a6f-4294-a4d9-2f4373531079 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.551602 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-02e64185-6349-4ca6-94d0-984c262b480b req-e3a84cac-5a6f-4294-a4d9-2f4373531079 service nova] Creating event network-changed:44663329-774c-463a-a864-c1e0c979ab76 for instance 7dea9975-b38a-465e-a181-454a20b0ae00 on n-h1-860864-3 Oct 11 19:43:48.557170 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-02e64185-6349-4ca6-94d0-984c262b480b req-e3a84cac-5a6f-4294-a4d9-2f4373531079 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033797 Oct 11 19:43:48.557762 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 242/498] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:48.562683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Calling method '.version_select at 0x7f83ccb46f70>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.564611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.565290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.565724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.593068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.593567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.594639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.609249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.609740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.610176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.625584 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3d14500f-cd0a-49d4-9ee1-8b518c22fdcf tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.066411 Oct 11 19:43:48.631785 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 243/499] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:48.636688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7755e995-20ac-4dd1-8bfe-2be046c3c81b tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:48.680867 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7755e995-20ac-4dd1-8bfe-2be046c3c81b tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1218245296/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047755 Oct 11 19:43:48.681852 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 244/500] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Oct 11 19:43:48 2022] POST /compute/v2.1/flavors/1218245296/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:43:48.690166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-47d56add-7d69-414d-9a1c-ecd75925e254 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Calling method '.version_select at 0x7f83ccb283a0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.691972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47d56add-7d69-414d-9a1c-ecd75925e254 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.692446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47d56add-7d69-414d-9a1c-ecd75925e254 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.693830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47d56add-7d69-414d-9a1c-ecd75925e254 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.708361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47d56add-7d69-414d-9a1c-ecd75925e254 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.709044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47d56add-7d69-414d-9a1c-ecd75925e254 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.709481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47d56add-7d69-414d-9a1c-ecd75925e254 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.715724 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-47d56add-7d69-414d-9a1c-ecd75925e254 tempest-HypervisorAdminUnderV252Test-1840928452 tempest-HypervisorAdminUnderV252Test-1840928452-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-860864-3/search" status: 200 len: 104 microversion: 2.1 time: 0.032841 Oct 11 19:43:48.718691 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 245/501] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 11 19:43:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-860864-3/search => generated 104 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:48.724920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c86995c-1443-4e28-b7b1-07407b0e377c tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:48.730604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c86995c-1443-4e28-b7b1-07407b0e377c tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '7d2de2aa42f041faa8049f2ebdb78365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77322cd1bc5340099c40ea5cda93bcf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c86995c-1443-4e28-b7b1-07407b0e377c tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Request method failure captured: Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 22 Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcdvKT6FNA_HVEofXCDRYStNPwls3MFJ837hs0gn2Nbm0e4Vu2qYrqpQdiN9MRLDD5VY4OaBxDkDKo_6D55CzZeoOBeEhmM3otL6l5oK0ts4KRQVBHj2ihHU4nlrl5OxYqg3M2_6e2kQkrE5c9dQCvXEHXbiK48NpMeehxYMYqgKe6s Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 77322cd1bc5340099c40ea5cda93bcf6 Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:43:48.736074 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77322cd1bc5340099c40ea5cda93bcf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77322cd1bc5340099c40ea5cda93bcf6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77322cd1bc5340099c40ea5cda93bcf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77322cd1bc5340099c40ea5cda93bcf6"}]}] Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 77322cd1bc5340099c40ea5cda93bcf6 Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 7d2de2aa42f041faa8049f2ebdb78365 Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: {"hw:numa_nodes": "1"} Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:48.737527 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'flavor_id': '1218245296', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:43:48.738444 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 19:43:48.740393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.744888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c86995c-1443-4e28-b7b1-07407b0e377c tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:48.747347 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c86995c-1443-4e28-b7b1-07407b0e377c tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400 tempest-FlavorsExtraSpecsNegativeTestJSON-1719823400-project] 10.222.0.27 "PUT /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026828 Oct 11 19:43:48.749964 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 246/502] 10.222.0.27 () {60 vars in 1265 bytes} [Tue Oct 11 19:43:48 2022] PUT /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:48.762604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9845c142-0177-4d4c-b9b3-47c34303423c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.763483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9845c142-0177-4d4c-b9b3-47c34303423c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:48.770780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9845c142-0177-4d4c-b9b3-47c34303423c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.772372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9845c142-0177-4d4c-b9b3-47c34303423c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.773032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9845c142-0177-4d4c-b9b3-47c34303423c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.773851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9845c142-0177-4d4c-b9b3-47c34303423c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.774641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9845c142-0177-4d4c-b9b3-47c34303423c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.775262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9845c142-0177-4d4c-b9b3-47c34303423c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.779005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cd288769-269f-4c02-bf24-d973521bb4db tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:48.788787 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cd288769-269f-4c02-bf24-d973521bb4db tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1520 microversion: 2.1 time: 0.316426 Oct 11 19:43:48.792415 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 257/503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:48 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:48.797520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6daa553b-f0af-407d-87e3-8d96e80a7c7a tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.811757 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6daa553b-f0af-407d-87e3-8d96e80a7c7a tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] HTTP exception thrown: Flavor 1218245296 has no extra specs with key hw:cpu_thread_policy. Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6daa553b-f0af-407d-87e3-8d96e80a7c7a tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Request method failure captured: Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/flavors/1218245296/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdxY47SD_9pp7QJ7e1lbj28nEMG7fhCVruMLeLahvWzL8ivCQz9ZjdZ1bSjdN9XBrG_g2aszPJjVfkhjclYq8m_4IeeXnIbpH_HMyMcEkix_WHe61MB71d9UJZOAYXUs0cwwypojzpKVbKfVXAmWJE89Gybm3d_HBZC938mkRRcLk8 Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c3ddfe68298747638795f49730c28fa9 Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:43:48.817168 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3ddfe68298747638795f49730c28fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3ddfe68298747638795f49730c28fa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3ddfe68298747638795f49730c28fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3ddfe68298747638795f49730c28fa9"}]}] Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c3ddfe68298747638795f49730c28fa9 Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bf0e527239684c0f8a194d93f200e22e Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:48.818971 n-d-860864-3 devstack@n-api.service[126955]: exception: Flavor 1218245296 has no extra specs with key hw:cpu_thread_policy. Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'flavor_id': '1218245296', 'id': 'hw:cpu_thread_policy'} Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1218245296 has no extra specs with key hw:cpu_thread_policy. Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:48.819747 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.821274 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:48.821274 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:48.821274 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:48.821274 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:48.821274 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:48.821274 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1218245296 has no extra specs with key hw:cpu_thread_policy. Oct 11 19:43:48.821274 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:48.821274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6daa553b-f0af-407d-87e3-8d96e80a7c7a tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Returning 404 to user: Flavor 1218245296 has no extra specs with key hw:cpu_thread_policy. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:48.821274 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6daa553b-f0af-407d-87e3-8d96e80a7c7a tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1218245296/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.025145 Oct 11 19:43:48.826701 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 258/504] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:43:48 2022] DELETE /compute/v2.1/flavors/1218245296/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:43:48.837364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2ac7ba2c-614d-498e-8f4c-f77eb4c3e5a3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:48.838001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2ac7ba2c-614d-498e-8f4c-f77eb4c3e5a3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:48.846542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ac7ba2c-614d-498e-8f4c-f77eb4c3e5a3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.847054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ac7ba2c-614d-498e-8f4c-f77eb4c3e5a3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.851514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ac7ba2c-614d-498e-8f4c-f77eb4c3e5a3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:48.852763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ac7ba2c-614d-498e-8f4c-f77eb4c3e5a3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:48.853461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ac7ba2c-614d-498e-8f4c-f77eb4c3e5a3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:48.854051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ac7ba2c-614d-498e-8f4c-f77eb4c3e5a3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:49.121273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9845c142-0177-4d4c-b9b3-47c34303423c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:49.129226 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9845c142-0177-4d4c-b9b3-47c34303423c tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1318 microversion: 2.1 time: 0.377763 Oct 11 19:43:49.129732 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 247/505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:48 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:49.147127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0df586a0-271f-4db9-bf89-a85745ea1768 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:49.158559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2ac7ba2c-614d-498e-8f4c-f77eb4c3e5a3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:49.162484 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0df586a0-271f-4db9-bf89-a85745ea1768 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0df586a0-271f-4db9-bf89-a85745ea1768 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Request method failure captured: Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 27 Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcdxY47SD_9pp7QJ7e1lbj28nEMG7fhCVruMLeLahvWzL8ivCQz9ZjdZ1bSjdN9XBrG_g2aszPJjVfkhjclYq8m_4IeeXnIbpH_HMyMcEkix_WHe61MB71d9UJZOAYXUs0cwwypojzpKVbKfVXAmWJE89Gybm3d_HBZC938mkRRcLk8 Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: c3ddfe68298747638795f49730c28fa9 Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:43:49.166878 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3ddfe68298747638795f49730c28fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3ddfe68298747638795f49730c28fa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3ddfe68298747638795f49730c28fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3ddfe68298747638795f49730c28fa9"}]}] Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: c3ddfe68298747638795f49730c28fa9 Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bf0e527239684c0f8a194d93f200e22e Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: {"hw:cpu_policy": "shared"} Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:49.168576 n-d-860864-3 devstack@n-api.service[126956]: exception: Request body and URI mismatch Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'flavor_id': '1218245296', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:49.169480 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:49.170814 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:49.170814 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:49.170814 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 11 19:43:49.170814 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.170814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0df586a0-271f-4db9-bf89-a85745ea1768 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:49.174036 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2ac7ba2c-614d-498e-8f4c-f77eb4c3e5a3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1520 microversion: 2.1 time: 0.346770 Oct 11 19:43:49.175339 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0df586a0-271f-4db9-bf89-a85745ea1768 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.042038 Oct 11 19:43:49.192239 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 259/506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:48 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:49.193556 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 248/507] 10.222.0.27 () {60 vars in 1265 bytes} [Tue Oct 11 19:43:49 2022] PUT /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes => generated 73 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:43:49.198969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a1c282b0-a565-4a6e-a854-b78ce398b600 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:49.202491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a200dba-d828-4415-a4b5-92b754adf4ec tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a200dba-d828-4415-a4b5-92b754adf4ec tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Request method failure captured: Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: request: PUT /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 49 Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdxY47SD_9pp7QJ7e1lbj28nEMG7fhCVruMLeLahvWzL8ivCQz9ZjdZ1bSjdN9XBrG_g2aszPJjVfkhjclYq8m_4IeeXnIbpH_HMyMcEkix_WHe61MB71d9UJZOAYXUs0cwwypojzpKVbKfVXAmWJE89Gybm3d_HBZC938mkRRcLk8 Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c3ddfe68298747638795f49730c28fa9 Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:43:49.206812 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3ddfe68298747638795f49730c28fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3ddfe68298747638795f49730c28fa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3ddfe68298747638795f49730c28fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3ddfe68298747638795f49730c28fa9"}]}] Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c3ddfe68298747638795f49730c28fa9 Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bf0e527239684c0f8a194d93f200e22e Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 11 19:43:49.208676 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'flavor_id': '1218245296', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance: Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 11 19:43:49.209487 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.211193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:49.213562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:49.213562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:49.213562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:43:49.213562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:43:49.213562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 19:43:49.213562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.215189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a200dba-d828-4415-a4b5-92b754adf4ec tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:49.216299 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a200dba-d828-4415-a4b5-92b754adf4ec tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017668 Oct 11 19:43:49.217074 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 260/508] 10.222.0.27 () {60 vars in 1265 bytes} [Tue Oct 11 19:43:49 2022] PUT /compute/v2.1/flavors/1218245296/os-extra_specs/hw:numa_nodes => generated 117 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a1c282b0-a565-4a6e-a854-b78ce398b600 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action HTTP/1.1 Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 285 Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:43:49.225336 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:43:49.227377 n-d-860864-3 devstack@n-api.service[126956]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 19:43:49.228018 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:43:49.228018 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:43:49.228018 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '69bc7749-0f31-48b7-bf11-8fdc03fbb734', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 19:43:49.228018 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:49.228018 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:49.228018 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:43:49.228018 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:43:49.228018 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:43:49.228018 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:43:49.228018 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:43:49.228552 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:43:49.229598 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:43:49.230406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:43:49.230406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:43:49.230581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-804c8e03-7550-4ed6-bfde-1873d3f09e4d tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:49.233894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a1c282b0-a565-4a6e-a854-b78ce398b600 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:49.235304 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a1c282b0-a565-4a6e-a854-b78ce398b600 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action" status: 400 len: 619 microversion: 2.1 time: 0.040700 Oct 11 19:43:49.239931 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 249/509] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Oct 11 19:43:49 2022] POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action => generated 619 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:43:49.245327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-df2440de-01fe-411d-bdbb-7b09ce4e23a5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:49.246078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-df2440de-01fe-411d-bdbb-7b09ce4e23a5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:49.252742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df2440de-01fe-411d-bdbb-7b09ce4e23a5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:49.253450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df2440de-01fe-411d-bdbb-7b09ce4e23a5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:49.254090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df2440de-01fe-411d-bdbb-7b09ce4e23a5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:49.255087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df2440de-01fe-411d-bdbb-7b09ce4e23a5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:49.255870 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-804c8e03-7550-4ed6-bfde-1873d3f09e4d tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1218245296" status: 202 len: 0 microversion: 2.1 time: 0.031094 Oct 11 19:43:49.256508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df2440de-01fe-411d-bdbb-7b09ce4e23a5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:49.257222 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 261/510] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:43:49 2022] DELETE /compute/v2.1/flavors/1218245296 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:43:49.257502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df2440de-01fe-411d-bdbb-7b09ce4e23a5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:49.268497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7704dbc3-5e4d-4455-93e0-cbb21f0472f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:49.304573 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7704dbc3-5e4d-4455-93e0-cbb21f0472f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461 tempest-FlavorsExtraSpecsNegativeTestJSON-1972470461-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.042064 Oct 11 19:43:49.318558 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 262/511] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:43:49 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:49.370055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0ab82f80-2ef1-4408-b87c-15d1a560cc53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:49.372091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0ab82f80-2ef1-4408-b87c-15d1a560cc53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:49.405263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ab82f80-2ef1-4408-b87c-15d1a560cc53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:49.406178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ab82f80-2ef1-4408-b87c-15d1a560cc53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:49.411068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ab82f80-2ef1-4408-b87c-15d1a560cc53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:49.412471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ab82f80-2ef1-4408-b87c-15d1a560cc53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:49.420190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ab82f80-2ef1-4408-b87c-15d1a560cc53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:49.421540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ab82f80-2ef1-4408-b87c-15d1a560cc53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:49.596699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-df2440de-01fe-411d-bdbb-7b09ce4e23a5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:49.604788 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-df2440de-01fe-411d-bdbb-7b09ce4e23a5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1520 microversion: 2.1 time: 0.363295 Oct 11 19:43:49.619406 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 250/512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:49 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:49.644422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-53dfcc18-181a-4297-9463-2a2e503369de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:49.645215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-53dfcc18-181a-4297-9463-2a2e503369de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:49.653039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53dfcc18-181a-4297-9463-2a2e503369de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:49.655948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53dfcc18-181a-4297-9463-2a2e503369de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:49.656541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53dfcc18-181a-4297-9463-2a2e503369de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:49.660925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53dfcc18-181a-4297-9463-2a2e503369de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:49.661721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53dfcc18-181a-4297-9463-2a2e503369de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:49.662482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53dfcc18-181a-4297-9463-2a2e503369de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:49.808533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0ab82f80-2ef1-4408-b87c-15d1a560cc53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:49.821530 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0ab82f80-2ef1-4408-b87c-15d1a560cc53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1313 microversion: 2.1 time: 0.463239 Oct 11 19:43:49.842156 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 263/513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:49 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:49.858788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c368b616-7f62-488f-8158-a8e4fff99d71 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:49.859899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c368b616-7f62-488f-8158-a8e4fff99d71 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:49.880041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c368b616-7f62-488f-8158-a8e4fff99d71 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:49.882990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c368b616-7f62-488f-8158-a8e4fff99d71 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:49.883501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c368b616-7f62-488f-8158-a8e4fff99d71 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:49.884260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c368b616-7f62-488f-8158-a8e4fff99d71 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:49.884732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c368b616-7f62-488f-8158-a8e4fff99d71 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:49.885158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c368b616-7f62-488f-8158-a8e4fff99d71 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:50.088761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c368b616-7f62-488f-8158-a8e4fff99d71 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:50.105016 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c368b616-7f62-488f-8158-a8e4fff99d71 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1313 microversion: 2.1 time: 0.260947 Oct 11 19:43:50.125846 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 264/514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:49 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:50.134356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0293889c-9988-48e8-9b23-070c3b4e34b1 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:50.135759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0293889c-9988-48e8-9b23-070c3b4e34b1 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:50.148289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0293889c-9988-48e8-9b23-070c3b4e34b1 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:50.149552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0293889c-9988-48e8-9b23-070c3b4e34b1 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:50.150405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0293889c-9988-48e8-9b23-070c3b4e34b1 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:50.151806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0293889c-9988-48e8-9b23-070c3b4e34b1 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:50.152655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0293889c-9988-48e8-9b23-070c3b4e34b1 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:50.153436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0293889c-9988-48e8-9b23-070c3b4e34b1 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:50.155552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-53dfcc18-181a-4297-9463-2a2e503369de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:50.164447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-53dfcc18-181a-4297-9463-2a2e503369de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1311 microversion: 2.1 time: 0.528301 Oct 11 19:43:50.178834 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 251/515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:49 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1311 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:50.180800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-90d17f81-4cfc-4763-8d33-680171b39178 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:50.181965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-90d17f81-4cfc-4763-8d33-680171b39178 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:50.197378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90d17f81-4cfc-4763-8d33-680171b39178 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:50.199572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90d17f81-4cfc-4763-8d33-680171b39178 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:50.201146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90d17f81-4cfc-4763-8d33-680171b39178 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:50.202443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90d17f81-4cfc-4763-8d33-680171b39178 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:50.204623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90d17f81-4cfc-4763-8d33-680171b39178 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:50.206998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90d17f81-4cfc-4763-8d33-680171b39178 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:50.569376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0293889c-9988-48e8-9b23-070c3b4e34b1 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:50.587866 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0293889c-9988-48e8-9b23-070c3b4e34b1 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1520 microversion: 2.1 time: 0.460258 Oct 11 19:43:50.588460 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 265/516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:50 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1520 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:50.632722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-68e88e80-684e-418e-b3e4-a950f6d512d8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1933185827"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:50.637491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-68e88e80-684e-418e-b3e4-a950f6d512d8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:50.645394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-90d17f81-4cfc-4763-8d33-680171b39178 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:50.649253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e88e80-684e-418e-b3e4-a950f6d512d8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:50.650479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e88e80-684e-418e-b3e4-a950f6d512d8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:50.651107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e88e80-684e-418e-b3e4-a950f6d512d8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:50.659137 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-90d17f81-4cfc-4763-8d33-680171b39178 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1318 microversion: 2.1 time: 0.489357 Oct 11 19:43:50.659731 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 252/517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:50 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:50.663414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e88e80-684e-418e-b3e4-a950f6d512d8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:50.664627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e88e80-684e-418e-b3e4-a950f6d512d8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:50.665281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e88e80-684e-418e-b3e4-a950f6d512d8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:50.855833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-52e3aed3-7068-4a93-9a28-53fa7f581414 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:50.856716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-52e3aed3-7068-4a93-9a28-53fa7f581414 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:50.872019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52e3aed3-7068-4a93-9a28-53fa7f581414 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:50.890624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52e3aed3-7068-4a93-9a28-53fa7f581414 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:50.891684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52e3aed3-7068-4a93-9a28-53fa7f581414 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:50.893136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52e3aed3-7068-4a93-9a28-53fa7f581414 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:50.896852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52e3aed3-7068-4a93-9a28-53fa7f581414 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:50.898798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52e3aed3-7068-4a93-9a28-53fa7f581414 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:51.094319 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-68e88e80-684e-418e-b3e4-a950f6d512d8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action" status: 202 len: 0 microversion: 2.1 time: 0.474539 Oct 11 19:43:51.098566 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 266/518] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:43:50 2022] POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 19:43:51.115046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1469361069"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:51.119233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:51.128664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:51.129500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:51.130509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:51.132071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:51.132790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:51.133467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:51.217471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-52e3aed3-7068-4a93-9a28-53fa7f581414 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:51.234961 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-52e3aed3-7068-4a93-9a28-53fa7f581414 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1463 microversion: 2.1 time: 0.382777 Oct 11 19:43:51.237352 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 253/519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:50 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1463 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:51.245942 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Cannot 'createImage' instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 while it is in task_state image_snapshot_pending Oct 11 19:43:51.246288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3b0eedae-2ece-43fa-b445-caaedd2fda09 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:51.247206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3b0eedae-2ece-43fa-b445-caaedd2fda09 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action HTTP/1.1 Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 85 Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:43:51.261549 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1469361069"}} Oct 11 19:43:51.263099 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: exception: Cannot 'createImage' instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 while it is in task_state image_snapshot_pending Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '69bc7749-0f31-48b7-bf11-8fdc03fbb734', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1469361069'}}} Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:43:51.263913 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 while it is in task_state image_snapshot_pending Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 while it is in task_state image_snapshot_pending Oct 11 19:43:51.264899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:43:51.265995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 409 to user: Cannot 'createImage' instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 while it is in task_state image_snapshot_pending {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:43:51.265995 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f99aa201-b8cb-4471-bcb6-9e2c4dd48454 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action" status: 409 len: 167 microversion: 2.1 time: 0.159597 Oct 11 19:43:51.265995 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 267/520] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:43:51 2022] POST /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734/action => generated 167 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:43:51.276944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b0eedae-2ece-43fa-b445-caaedd2fda09 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:51.277343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6755fa75-f5d0-4bfc-81e5-6f827b0c1bb7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:51.277966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6755fa75-f5d0-4bfc-81e5-6f827b0c1bb7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:51.279417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b0eedae-2ece-43fa-b445-caaedd2fda09 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:51.280069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b0eedae-2ece-43fa-b445-caaedd2fda09 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:51.281492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b0eedae-2ece-43fa-b445-caaedd2fda09 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:51.282298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b0eedae-2ece-43fa-b445-caaedd2fda09 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:51.286091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b0eedae-2ece-43fa-b445-caaedd2fda09 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:51.311607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6755fa75-f5d0-4bfc-81e5-6f827b0c1bb7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:51.312141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6755fa75-f5d0-4bfc-81e5-6f827b0c1bb7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:51.315209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6755fa75-f5d0-4bfc-81e5-6f827b0c1bb7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:51.316019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6755fa75-f5d0-4bfc-81e5-6f827b0c1bb7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:51.316480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6755fa75-f5d0-4bfc-81e5-6f827b0c1bb7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:51.316928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6755fa75-f5d0-4bfc-81e5-6f827b0c1bb7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:51.369121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=16 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:51.410435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3b0eedae-2ece-43fa-b445-caaedd2fda09 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:51.433385 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3b0eedae-2ece-43fa-b445-caaedd2fda09 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1319 microversion: 2.1 time: 0.194391 Oct 11 19:43:51.439457 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 254/521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:51 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:51.897805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6755fa75-f5d0-4bfc-81e5-6f827b0c1bb7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:51.908755 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6755fa75-f5d0-4bfc-81e5-6f827b0c1bb7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1311 microversion: 2.1 time: 0.643829 Oct 11 19:43:51.912048 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 268/522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:51 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1311 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:51.921532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-35b71ccc-c498-456a-9ad0-265e36cc592f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '.version_select at 0x7f83cc99b790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:52.361261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5bc4b0cc-1d1e-4e6a-bd53-9e464ce83807 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:52.362450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5bc4b0cc-1d1e-4e6a-bd53-9e464ce83807 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:52.373843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bc4b0cc-1d1e-4e6a-bd53-9e464ce83807 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:52.384396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bc4b0cc-1d1e-4e6a-bd53-9e464ce83807 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:52.388182 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-35b71ccc-c498-456a-9ad0-265e36cc592f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "DELETE /compute/v2.1/images/a9494a38-3976-406d-956a-8e019283f2bf" status: 204 len: 0 microversion: 2.1 time: 0.474397 Oct 11 19:43:52.389059 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 269/523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:51 2022] DELETE /compute/v2.1/images/a9494a38-3976-406d-956a-8e019283f2bf => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:43:52.397060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4d8ec863-5cbc-4afb-9bac-e3015924b7bb req-d475cbf6-5d60-425f-bc97-b0216b2e3ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "997ed107-5049-429a-9611-ba2857048a40", "name": "network-vif-plugged", "status": "completed", "tag": "07530b11-69b9-4de4-8e00-bad254f64145"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:52.446297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bc4b0cc-1d1e-4e6a-bd53-9e464ce83807 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:52.450835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bc4b0cc-1d1e-4e6a-bd53-9e464ce83807 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:52.451872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bc4b0cc-1d1e-4e6a-bd53-9e464ce83807 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:52.454463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bc4b0cc-1d1e-4e6a-bd53-9e464ce83807 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:52.489193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4d8ec863-5cbc-4afb-9bac-e3015924b7bb req-d475cbf6-5d60-425f-bc97-b0216b2e3ee0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:52.493875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4d8ec863-5cbc-4afb-9bac-e3015924b7bb req-d475cbf6-5d60-425f-bc97-b0216b2e3ee0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:52.498410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4d8ec863-5cbc-4afb-9bac-e3015924b7bb req-d475cbf6-5d60-425f-bc97-b0216b2e3ee0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:52.538089 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4d8ec863-5cbc-4afb-9bac-e3015924b7bb req-d475cbf6-5d60-425f-bc97-b0216b2e3ee0 service nova] Creating event network-vif-plugged:07530b11-69b9-4de4-8e00-bad254f64145 for instance 997ed107-5049-429a-9611-ba2857048a40 on n-h1-860864-3 Oct 11 19:43:52.552997 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4d8ec863-5cbc-4afb-9bac-e3015924b7bb req-d475cbf6-5d60-425f-bc97-b0216b2e3ee0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162263 Oct 11 19:43:52.557219 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 270/524] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:52.569330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-02eb12d5-598a-46b6-b1dd-5e5641c9df9d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:52.585553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-02eb12d5-598a-46b6-b1dd-5e5641c9df9d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:52.617312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02eb12d5-598a-46b6-b1dd-5e5641c9df9d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:52.618558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02eb12d5-598a-46b6-b1dd-5e5641c9df9d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:52.620119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02eb12d5-598a-46b6-b1dd-5e5641c9df9d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:52.622725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02eb12d5-598a-46b6-b1dd-5e5641c9df9d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:52.625566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02eb12d5-598a-46b6-b1dd-5e5641c9df9d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:52.626206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02eb12d5-598a-46b6-b1dd-5e5641c9df9d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:53.575267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-02eb12d5-598a-46b6-b1dd-5e5641c9df9d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:53.590771 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-02eb12d5-598a-46b6-b1dd-5e5641c9df9d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1318 microversion: 2.1 time: 1.031114 Oct 11 19:43:53.601749 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 271/525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:52 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1318 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:53.607816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-88349f74-6ae8-4fb4-b27d-348aed5357f2 req-67e2cd60-bf4b-4174-8a18-fafbf264a58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27956e70-3a33-46ba-98c8-f9dbfe444d2e", "name": "network-vif-deleted", "tag": "a8198729-0bcb-443a-8dbd-3e7eac134b9d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:53.646022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-88349f74-6ae8-4fb4-b27d-348aed5357f2 req-67e2cd60-bf4b-4174-8a18-fafbf264a58c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:53.647043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-88349f74-6ae8-4fb4-b27d-348aed5357f2 req-67e2cd60-bf4b-4174-8a18-fafbf264a58c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:53.648003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-88349f74-6ae8-4fb4-b27d-348aed5357f2 req-67e2cd60-bf4b-4174-8a18-fafbf264a58c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:53.689749 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-88349f74-6ae8-4fb4-b27d-348aed5357f2 req-67e2cd60-bf4b-4174-8a18-fafbf264a58c service nova] Creating event network-vif-deleted:a8198729-0bcb-443a-8dbd-3e7eac134b9d for instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e on n-h2-860864-3 Oct 11 19:43:53.705657 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-88349f74-6ae8-4fb4-b27d-348aed5357f2 req-67e2cd60-bf4b-4174-8a18-fafbf264a58c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101094 Oct 11 19:43:53.709033 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 272/526] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:53.722785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a73d858-eb64-48f0-8764-b15005a1ceb4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:53.726191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a73d858-eb64-48f0-8764-b15005a1ceb4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:53.749701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a73d858-eb64-48f0-8764-b15005a1ceb4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:53.752057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a73d858-eb64-48f0-8764-b15005a1ceb4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:53.752525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a73d858-eb64-48f0-8764-b15005a1ceb4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:53.753254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a73d858-eb64-48f0-8764-b15005a1ceb4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:53.753724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a73d858-eb64-48f0-8764-b15005a1ceb4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:53.754149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a73d858-eb64-48f0-8764-b15005a1ceb4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:53.798820 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5bc4b0cc-1d1e-4e6a-bd53-9e464ce83807 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1614 microversion: 2.1 time: 2.358126 Oct 11 19:43:53.799418 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 255/527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:51 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1614 bytes in 2359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:53.836074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ebafa9c-8e17-4933-9f41-79e8cc3ad94d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:53.837652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6ebafa9c-8e17-4933-9f41-79e8cc3ad94d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:53.841792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:53.858999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ebafa9c-8e17-4933-9f41-79e8cc3ad94d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:53.859827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ebafa9c-8e17-4933-9f41-79e8cc3ad94d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:53.860460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ebafa9c-8e17-4933-9f41-79e8cc3ad94d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:53.863044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ebafa9c-8e17-4933-9f41-79e8cc3ad94d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:53.864806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ebafa9c-8e17-4933-9f41-79e8cc3ad94d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:53.865814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ebafa9c-8e17-4933-9f41-79e8cc3ad94d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:53.888381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:54.076758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6ebafa9c-8e17-4933-9f41-79e8cc3ad94d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:54.088661 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6ebafa9c-8e17-4933-9f41-79e8cc3ad94d tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1319 microversion: 2.1 time: 0.265490 Oct 11 19:43:54.089263 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 256/528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:53 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:54.133432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ab0b058-a3f1-4f8b-9148-7349cadb91df tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:54.134202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ab0b058-a3f1-4f8b-9148-7349cadb91df tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:54.164731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab0b058-a3f1-4f8b-9148-7349cadb91df tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:54.166036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab0b058-a3f1-4f8b-9148-7349cadb91df tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:54.167016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab0b058-a3f1-4f8b-9148-7349cadb91df tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:54.170918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab0b058-a3f1-4f8b-9148-7349cadb91df tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:54.172684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab0b058-a3f1-4f8b-9148-7349cadb91df tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:54.173292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab0b058-a3f1-4f8b-9148-7349cadb91df tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:54.177400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4a73d858-eb64-48f0-8764-b15005a1ceb4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:54.187713 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a73d858-eb64-48f0-8764-b15005a1ceb4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1538 microversion: 2.1 time: 0.477197 Oct 11 19:43:54.191298 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 273/529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:53 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1538 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:54.222112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:54.227290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:54.237784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:54.243791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:54.244992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:54.245891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:54.246500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:54.250020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:54.514705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c8cff5826fdb465489829b5e796836a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69937da30873420eae45ebcc276a3501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:54.515760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] flavor_id is None. Assuming migration. {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 19:43:54.516374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 19:43:54.534150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8ab0b058-a3f1-4f8b-9148-7349cadb91df tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:54.546613 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ab0b058-a3f1-4f8b-9148-7349cadb91df tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1311 microversion: 2.1 time: 0.434001 Oct 11 19:43:54.547216 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 257/530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:54 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1311 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:54.628940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-58ae7cc8-07fe-430e-88ab-4f1c78ab427f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:54.631172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-58ae7cc8-07fe-430e-88ab-4f1c78ab427f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:54.642725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ae7cc8-07fe-430e-88ab-4f1c78ab427f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:54.644295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ae7cc8-07fe-430e-88ab-4f1c78ab427f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:54.645876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ae7cc8-07fe-430e-88ab-4f1c78ab427f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:54.648691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ae7cc8-07fe-430e-88ab-4f1c78ab427f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:54.649447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ae7cc8-07fe-430e-88ab-4f1c78ab427f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:54.652319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ae7cc8-07fe-430e-88ab-4f1c78ab427f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:54.905021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-58ae7cc8-07fe-430e-88ab-4f1c78ab427f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:54.923568 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-58ae7cc8-07fe-430e-88ab-4f1c78ab427f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1318 microversion: 2.1 time: 0.300569 Oct 11 19:43:54.933233 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 258/531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:54 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:43:54.954773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-dc21d205-a225-4660-a736-4aeed653f284 req-ff8191d6-6981-4fa5-812e-af9155eb7d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f663a0-eedd-4d4f-934b-05c7bd72ce6f", "name": "network-vif-plugged", "status": "completed", "tag": "3a7eecd6-579e-43b5-bdc4-004193387045"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:54.975964 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-62d3becf-c5b6-46da-9e39-464135c87b7b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89/action" status: 202 len: 0 microversion: 2.1 time: 0.761207 Oct 11 19:43:54.976629 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 274/532] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:43:54 2022] POST /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:43:55.011561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-02d9ca7a-f139-4d67-b784-92266185a2c6 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:55.026379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-02d9ca7a-f139-4d67-b784-92266185a2c6 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:55.031563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dc21d205-a225-4660-a736-4aeed653f284 req-ff8191d6-6981-4fa5-812e-af9155eb7d11 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:55.034320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dc21d205-a225-4660-a736-4aeed653f284 req-ff8191d6-6981-4fa5-812e-af9155eb7d11 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:55.039853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dc21d205-a225-4660-a736-4aeed653f284 req-ff8191d6-6981-4fa5-812e-af9155eb7d11 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:55.081498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02d9ca7a-f139-4d67-b784-92266185a2c6 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:55.084332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02d9ca7a-f139-4d67-b784-92266185a2c6 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:55.088144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02d9ca7a-f139-4d67-b784-92266185a2c6 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:55.089737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02d9ca7a-f139-4d67-b784-92266185a2c6 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:55.096765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02d9ca7a-f139-4d67-b784-92266185a2c6 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:55.097929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02d9ca7a-f139-4d67-b784-92266185a2c6 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:55.119479 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-dc21d205-a225-4660-a736-4aeed653f284 req-ff8191d6-6981-4fa5-812e-af9155eb7d11 service nova] Creating event network-vif-plugged:3a7eecd6-579e-43b5-bdc4-004193387045 for instance b8f663a0-eedd-4d4f-934b-05c7bd72ce6f on n-h2-860864-3 Oct 11 19:43:55.140000 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-dc21d205-a225-4660-a736-4aeed653f284 req-ff8191d6-6981-4fa5-812e-af9155eb7d11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203683 Oct 11 19:43:55.141758 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 259/533] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:55.147513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8162f0e6-d805-425b-9b9c-0256e1e3db13 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:55.157232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:55.157482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8162f0e6-d805-425b-9b9c-0256e1e3db13 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:55.170984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8162f0e6-d805-425b-9b9c-0256e1e3db13 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:55.176167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8162f0e6-d805-425b-9b9c-0256e1e3db13 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:55.178372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8162f0e6-d805-425b-9b9c-0256e1e3db13 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:55.179465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8162f0e6-d805-425b-9b9c-0256e1e3db13 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:55.183112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8162f0e6-d805-425b-9b9c-0256e1e3db13 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:55.183814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8162f0e6-d805-425b-9b9c-0256e1e3db13 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:55.918327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8162f0e6-d805-425b-9b9c-0256e1e3db13 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:55.932759 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8162f0e6-d805-425b-9b9c-0256e1e3db13 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1386 microversion: 2.1 time: 0.789165 Oct 11 19:43:55.933572 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 260/534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:55 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1386 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:55.944251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eade1248-7395-4628-b194-1f60943d0cb5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:55.948884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-02d9ca7a-f139-4d67-b784-92266185a2c6 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:55.954586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eade1248-7395-4628-b194-1f60943d0cb5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:55.962077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eade1248-7395-4628-b194-1f60943d0cb5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:55.965283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eade1248-7395-4628-b194-1f60943d0cb5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:55.965779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eade1248-7395-4628-b194-1f60943d0cb5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:55.966509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eade1248-7395-4628-b194-1f60943d0cb5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:55.967033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eade1248-7395-4628-b194-1f60943d0cb5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:55.967459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eade1248-7395-4628-b194-1f60943d0cb5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:55.969802 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-02d9ca7a-f139-4d67-b784-92266185a2c6 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1472 microversion: 2.1 time: 0.971839 Oct 11 19:43:55.973109 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 275/535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:54 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1472 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:55.993320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2ceae0c7-1991-433b-9b44-ecf54d5fe631 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:55.995701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2ceae0c7-1991-433b-9b44-ecf54d5fe631 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:56.024796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ceae0c7-1991-433b-9b44-ecf54d5fe631 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:56.025599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ceae0c7-1991-433b-9b44-ecf54d5fe631 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:56.027759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ceae0c7-1991-433b-9b44-ecf54d5fe631 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:56.028666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ceae0c7-1991-433b-9b44-ecf54d5fe631 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:56.029526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ceae0c7-1991-433b-9b44-ecf54d5fe631 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:56.034363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ceae0c7-1991-433b-9b44-ecf54d5fe631 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:56.771898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2ceae0c7-1991-433b-9b44-ecf54d5fe631 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:56.783500 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2ceae0c7-1991-433b-9b44-ecf54d5fe631 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1311 microversion: 2.1 time: 0.807209 Oct 11 19:43:56.784091 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 276/536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:55 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1311 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:56.791088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eade1248-7395-4628-b194-1f60943d0cb5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:56.805997 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eade1248-7395-4628-b194-1f60943d0cb5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1520 microversion: 2.1 time: 0.868030 Oct 11 19:43:56.807092 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 261/537] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:55 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1520 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:56.813823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a7fba35c-98bf-4bcb-9ecb-a0d1fbd112c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:56.819069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a7fba35c-98bf-4bcb-9ecb-a0d1fbd112c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:56.822948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c65f3919-a76c-4e3e-b350-4fd8dbd93767 req-3f6b70c6-b70f-4c5b-ae36-16bac99a4e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9040218a-3ba8-4621-b4e7-20732e4cafd0", "tag": "01598c88-4628-48c1-93e9-e3dada9b0918"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:56.842421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7fba35c-98bf-4bcb-9ecb-a0d1fbd112c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:56.844264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7fba35c-98bf-4bcb-9ecb-a0d1fbd112c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:56.847539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7fba35c-98bf-4bcb-9ecb-a0d1fbd112c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:56.854895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7fba35c-98bf-4bcb-9ecb-a0d1fbd112c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:56.856757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7fba35c-98bf-4bcb-9ecb-a0d1fbd112c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:56.858048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7fba35c-98bf-4bcb-9ecb-a0d1fbd112c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:56.860028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c65f3919-a76c-4e3e-b350-4fd8dbd93767 req-3f6b70c6-b70f-4c5b-ae36-16bac99a4e0c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:56.864585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c65f3919-a76c-4e3e-b350-4fd8dbd93767 req-3f6b70c6-b70f-4c5b-ae36-16bac99a4e0c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:56.866427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c65f3919-a76c-4e3e-b350-4fd8dbd93767 req-3f6b70c6-b70f-4c5b-ae36-16bac99a4e0c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:56.904097 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c65f3919-a76c-4e3e-b350-4fd8dbd93767 req-3f6b70c6-b70f-4c5b-ae36-16bac99a4e0c service nova] Creating event network-changed:01598c88-4628-48c1-93e9-e3dada9b0918 for instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 on n-h1-860864-3 Oct 11 19:43:56.914012 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c65f3919-a76c-4e3e-b350-4fd8dbd93767 req-3f6b70c6-b70f-4c5b-ae36-16bac99a4e0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101149 Oct 11 19:43:56.916683 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 262/538] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:56.932546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e9b717a-d6dd-488b-ae0c-493667a55fcd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:56.936193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1e9b717a-d6dd-488b-ae0c-493667a55fcd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:56.947187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e9b717a-d6dd-488b-ae0c-493667a55fcd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:56.948108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e9b717a-d6dd-488b-ae0c-493667a55fcd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:56.948898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e9b717a-d6dd-488b-ae0c-493667a55fcd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:56.950057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e9b717a-d6dd-488b-ae0c-493667a55fcd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:56.950825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e9b717a-d6dd-488b-ae0c-493667a55fcd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:56.951764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e9b717a-d6dd-488b-ae0c-493667a55fcd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:57.029254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1e9b717a-d6dd-488b-ae0c-493667a55fcd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:43:57.224793 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1e9b717a-d6dd-488b-ae0c-493667a55fcd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 204 len: 0 microversion: 2.1 time: 0.305466 Oct 11 19:43:57.226136 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 263/539] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:43:56 2022] DELETE /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:43:57.242056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-896b08f3-ead7-4b01-af03-b0bd2781b2b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:57.243002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-896b08f3-ead7-4b01-af03-b0bd2781b2b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:57.257467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-896b08f3-ead7-4b01-af03-b0bd2781b2b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:57.257959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-896b08f3-ead7-4b01-af03-b0bd2781b2b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:57.258394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-896b08f3-ead7-4b01-af03-b0bd2781b2b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:57.259312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-896b08f3-ead7-4b01-af03-b0bd2781b2b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:57.260797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-896b08f3-ead7-4b01-af03-b0bd2781b2b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:57.267342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-896b08f3-ead7-4b01-af03-b0bd2781b2b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:57.315352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a7fba35c-98bf-4bcb-9ecb-a0d1fbd112c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:57.324910 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a7fba35c-98bf-4bcb-9ecb-a0d1fbd112c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1467 microversion: 2.1 time: 0.539585 Oct 11 19:43:57.330573 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 277/540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:56 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1467 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:57.342008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c548a858-7332-454d-a98b-03986ec092a2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:57.342997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c548a858-7332-454d-a98b-03986ec092a2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:57.367851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c548a858-7332-454d-a98b-03986ec092a2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:57.369497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c548a858-7332-454d-a98b-03986ec092a2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:57.370286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c548a858-7332-454d-a98b-03986ec092a2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:57.371564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c548a858-7332-454d-a98b-03986ec092a2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:57.375189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c548a858-7332-454d-a98b-03986ec092a2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:57.377346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c548a858-7332-454d-a98b-03986ec092a2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:57.687412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=10 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:57.768434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-896b08f3-ead7-4b01-af03-b0bd2781b2b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:57.773886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c548a858-7332-454d-a98b-03986ec092a2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:57.782968 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c548a858-7332-454d-a98b-03986ec092a2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1472 microversion: 2.1 time: 0.449019 Oct 11 19:43:57.783909 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 278/541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:57 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1472 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:57.787166 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-896b08f3-ead7-4b01-af03-b0bd2781b2b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1386 microversion: 2.1 time: 0.558646 Oct 11 19:43:57.788270 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 264/542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:57 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1386 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:57.790596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a3d392f-db3e-4d42-9976-4d41491c063c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:57.791562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a3d392f-db3e-4d42-9976-4d41491c063c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:57.793237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-7be05539-4517-4ebb-ace3-635df8fa20ba req-5128e98c-4b66-4e45-b5de-82bd0e91c557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dea9975-b38a-465e-a181-454a20b0ae00", "name": "network-vif-plugged", "status": "completed", "tag": "44663329-774c-463a-a864-c1e0c979ab76"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:57.799284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a3d392f-db3e-4d42-9976-4d41491c063c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:57.800054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a3d392f-db3e-4d42-9976-4d41491c063c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:57.800793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a3d392f-db3e-4d42-9976-4d41491c063c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:57.801880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a3d392f-db3e-4d42-9976-4d41491c063c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:57.804320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7be05539-4517-4ebb-ace3-635df8fa20ba req-5128e98c-4b66-4e45-b5de-82bd0e91c557 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:57.804568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a3d392f-db3e-4d42-9976-4d41491c063c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:57.805434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a3d392f-db3e-4d42-9976-4d41491c063c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:57.806031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7be05539-4517-4ebb-ace3-635df8fa20ba req-5128e98c-4b66-4e45-b5de-82bd0e91c557 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:57.806824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7be05539-4517-4ebb-ace3-635df8fa20ba req-5128e98c-4b66-4e45-b5de-82bd0e91c557 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:57.824951 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-7be05539-4517-4ebb-ace3-635df8fa20ba req-5128e98c-4b66-4e45-b5de-82bd0e91c557 service nova] Creating event network-vif-plugged:44663329-774c-463a-a864-c1e0c979ab76 for instance 7dea9975-b38a-465e-a181-454a20b0ae00 on n-h1-860864-3 Oct 11 19:43:57.832053 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-7be05539-4517-4ebb-ace3-635df8fa20ba req-5128e98c-4b66-4e45-b5de-82bd0e91c557 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042364 Oct 11 19:43:57.833411 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 265/543] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:43:58.061210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ba6804a-143f-4897-8c37-665a1817d1c1 tempest-FlavorsV255TestJSON-299589641 tempest-FlavorsV255TestJSON-299589641-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-397823582", "id": 732390331, "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:58.065959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a3d392f-db3e-4d42-9976-4d41491c063c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:58.076959 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a3d392f-db3e-4d42-9976-4d41491c063c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1526 microversion: 2.1 time: 0.291205 Oct 11 19:43:58.078857 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 279/544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:57 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1526 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:58.095383 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ba6804a-143f-4897-8c37-665a1817d1c1 tempest-FlavorsV255TestJSON-299589641 tempest-FlavorsV255TestJSON-299589641-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.259026 Oct 11 19:43:58.096678 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 266/545] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:43:57 2022] POST /compute/v2.1/flavors => generated 445 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:43:58.104792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c841f3d2-56af-4aef-b348-ee112f9e2f2f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:58.105410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c841f3d2-56af-4aef-b348-ee112f9e2f2f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: b8f663a0-eedd-4d4f-934b-05c7bd72ce6f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:58.114396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=46 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:58.119263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c841f3d2-56af-4aef-b348-ee112f9e2f2f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:58.119755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c841f3d2-56af-4aef-b348-ee112f9e2f2f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:58.120237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c841f3d2-56af-4aef-b348-ee112f9e2f2f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:58.120943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c841f3d2-56af-4aef-b348-ee112f9e2f2f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:58.121388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c841f3d2-56af-4aef-b348-ee112f9e2f2f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:58.121811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c841f3d2-56af-4aef-b348-ee112f9e2f2f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:58.175075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-301601906", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:43:58.246669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:43:58.445598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c841f3d2-56af-4aef-b348-ee112f9e2f2f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:58.454403 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c841f3d2-56af-4aef-b348-ee112f9e2f2f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f" status: 200 len: 1467 microversion: 2.1 time: 0.362491 Oct 11 19:43:58.455185 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 280/546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:58 2022] GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f => generated 1467 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:58.460601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a996c76d-b09e-4b22-b65e-5a3e2919d7a7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:58.461524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a996c76d-b09e-4b22-b65e-5a3e2919d7a7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:58.477869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a996c76d-b09e-4b22-b65e-5a3e2919d7a7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:58.478486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a996c76d-b09e-4b22-b65e-5a3e2919d7a7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:58.480285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a996c76d-b09e-4b22-b65e-5a3e2919d7a7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:58.480285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a996c76d-b09e-4b22-b65e-5a3e2919d7a7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:58.480618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a996c76d-b09e-4b22-b65e-5a3e2919d7a7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:58.481130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a996c76d-b09e-4b22-b65e-5a3e2919d7a7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:58.499310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=26 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:43:58.668301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:43:58.668966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:43:58.669783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:43:58.670479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:43:58.671103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:43:58.684436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:58.685159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:58.685897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:58.686896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:58.687696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:58.688200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:58.708642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Getting quotas for project 305f047e2a5b43df83b2ae40e448a1ab. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:43:58.713736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Getting quotas for user 78d551deb3024dc2969b3fc19c3cb42d and project 305f047e2a5b43df83b2ae40e448a1ab. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:43:58.729499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:43:58.733235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:43:58.788373 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9533de24-10e5-437f-8c9f-f3c521420cf4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690442 Oct 11 19:43:58.789249 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 267/547] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:43:58.842620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a996c76d-b09e-4b22-b65e-5a3e2919d7a7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:58.850814 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a996c76d-b09e-4b22-b65e-5a3e2919d7a7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1311 microversion: 2.1 time: 0.394365 Oct 11 19:43:58.871246 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 281/548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:58 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1311 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:58.882133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:58.890144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:58.891549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Searching by: {'reservation_id': 'r-6oj30cm6', 'deleted': False, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:43:58.898012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:58.898801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:58.899391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:58.900299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:58.900919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:58.901680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:59.032659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-af3a15f6-3879-4ffd-ad32-c52fdd0d7a3c tempest-FlavorsV255TestJSON-794464820 tempest-FlavorsV255TestJSON-794464820-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:59.047382 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-af3a15f6-3879-4ffd-ad32-c52fdd0d7a3c tempest-FlavorsV255TestJSON-794464820 tempest-FlavorsV255TestJSON-794464820-project] 10.222.0.27 "GET /compute/v2.1/flavors/732390331" status: 200 len: 445 microversion: 2.55 time: 0.250001 Oct 11 19:43:59.047974 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 268/549] 10.222.0.27 () {60 vars in 1196 bytes} [Tue Oct 11 19:43:58 2022] GET /compute/v2.1/flavors/732390331 => generated 445 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:43:59.090544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a564f2f0-1fb7-4eb6-93fc-065408b45373 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:59.095125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a564f2f0-1fb7-4eb6-93fc-065408b45373 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:59.197407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:43:59.335969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:59.346974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:59.347945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:59.350728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:59.458130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a564f2f0-1fb7-4eb6-93fc-065408b45373 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:43:59.476135 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a564f2f0-1fb7-4eb6-93fc-065408b45373 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1218 microversion: 2.1 time: 0.386614 Oct 11 19:43:59.482311 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 269/550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:59 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1218 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:43:59.487931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cea60721-fc05-4103-a740-cbef0095835b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:43:59.488884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cea60721-fc05-4103-a740-cbef0095835b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:43:59.518803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea60721-fc05-4103-a740-cbef0095835b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:59.519467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea60721-fc05-4103-a740-cbef0095835b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:59.521192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea60721-fc05-4103-a740-cbef0095835b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:43:59.523569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea60721-fc05-4103-a740-cbef0095835b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:43:59.524395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea60721-fc05-4103-a740-cbef0095835b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:43:59.525815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea60721-fc05-4103-a740-cbef0095835b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.002015 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dabdcbd2-9a4b-41bf-a9b2-fa940bc23248 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-6oj30cm6" status: 200 len: 2927 microversion: 2.1 time: 1.128761 Oct 11 19:44:00.002657 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 282/551] 10.222.0.27 () {58 vars in 1197 bytes} [Tue Oct 11 19:43:58 2022] GET /compute/v2.1/servers/detail?reservation_id=r-6oj30cm6 => generated 2927 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:00.031324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84e2ae0f-bc77-4cf8-88c3-b3703b28b850 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:00.034486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-84e2ae0f-bc77-4cf8-88c3-b3703b28b850 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:00.054362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84e2ae0f-bc77-4cf8-88c3-b3703b28b850 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.055112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84e2ae0f-bc77-4cf8-88c3-b3703b28b850 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.055724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84e2ae0f-bc77-4cf8-88c3-b3703b28b850 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.056598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84e2ae0f-bc77-4cf8-88c3-b3703b28b850 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.061445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84e2ae0f-bc77-4cf8-88c3-b3703b28b850 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.062221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84e2ae0f-bc77-4cf8-88c3-b3703b28b850 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.414582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cea60721-fc05-4103-a740-cbef0095835b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:00.432183 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cea60721-fc05-4103-a740-cbef0095835b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1472 microversion: 2.1 time: 0.941319 Oct 11 19:44:00.434318 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 270/552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:43:59 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1472 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:00.441183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c037cfa7-80e5-42d5-9f09-303155ff2914 tempest-FlavorsV255TestJSON-299589641 tempest-FlavorsV255TestJSON-299589641-project-admin] Action: 'update', calling method: .version_select at 0x7f83ce342b80>, body: {"flavor": {"description": "new"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:00.477321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-84e2ae0f-bc77-4cf8-88c3-b3703b28b850 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:00.487725 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-84e2ae0f-bc77-4cf8-88c3-b3703b28b850 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1386 microversion: 2.1 time: 0.463810 Oct 11 19:44:00.488490 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 283/553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:00 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1386 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:00.492024 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c037cfa7-80e5-42d5-9f09-303155ff2914 tempest-FlavorsV255TestJSON-299589641 tempest-FlavorsV255TestJSON-299589641-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/732390331" status: 200 len: 446 microversion: 2.55 time: 0.055970 Oct 11 19:44:00.493173 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 271/554] 10.222.0.27 () {62 vars in 1216 bytes} [Tue Oct 11 19:44:00 2022] PUT /compute/v2.1/flavors/732390331 => generated 446 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:44:00.502186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:00.503113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:00.510107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a71680cf-8a96-4737-a825-f31db8981743 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:00.510772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a71680cf-8a96-4737-a825-f31db8981743 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:00.512411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.513196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.513830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.514827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.515475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.516086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.523741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a71680cf-8a96-4737-a825-f31db8981743 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.524395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a71680cf-8a96-4737-a825-f31db8981743 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.524928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a71680cf-8a96-4737-a825-f31db8981743 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.525732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a71680cf-8a96-4737-a825-f31db8981743 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.526308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a71680cf-8a96-4737-a825-f31db8981743 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.526851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a71680cf-8a96-4737-a825-f31db8981743 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.555058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.555762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.556372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.556966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lazy-loading 'fault' on Instance uuid 69bc7749-0f31-48b7-bf11-8fdc03fbb734 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:00.682751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:00.700820 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4faf73f4-769a-4e49-bebd-d77b5fe59e8c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 200 len: 1315 microversion: 2.1 time: 0.211119 Oct 11 19:44:00.701539 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 284/555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:00 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:00.707286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9880ed2a-ac39-4d32-91d0-6490798457a7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:00.728836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:00.736942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.compute.server_groups [None req-9880ed2a-ac39-4d32-91d0-6490798457a7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Querying cell 3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) for 2 instances {{(pid=126955) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 19:44:00.737983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9880ed2a-ac39-4d32-91d0-6490798457a7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.738639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9880ed2a-ac39-4d32-91d0-6490798457a7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.739872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9880ed2a-ac39-4d32-91d0-6490798457a7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.761447 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9880ed2a-ac39-4d32-91d0-6490798457a7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/286cb564-17fc-4291-a412-c93dfe1ca59e" status: 200 len: 271 microversion: 2.1 time: 0.058197 Oct 11 19:44:00.762734 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 285/556] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:44:00 2022] GET /compute/v2.1/os-server-groups/286cb564-17fc-4291-a412-c93dfe1ca59e => generated 271 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:00.768778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1081808c-1c7b-4795-a16c-44111a83b602 req-510242e7-3721-4945-b103-d8fc426feaec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bc7749-0f31-48b7-bf11-8fdc03fbb734", "name": "network-vif-deleted", "tag": "d655f2a8-e159-4bde-9b89-9517f5997d24"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:00.781618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1081808c-1c7b-4795-a16c-44111a83b602 req-510242e7-3721-4945-b103-d8fc426feaec service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.789577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1081808c-1c7b-4795-a16c-44111a83b602 req-510242e7-3721-4945-b103-d8fc426feaec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.790292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1081808c-1c7b-4795-a16c-44111a83b602 req-510242e7-3721-4945-b103-d8fc426feaec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.805122 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1081808c-1c7b-4795-a16c-44111a83b602 req-510242e7-3721-4945-b103-d8fc426feaec service nova] Creating event network-vif-deleted:d655f2a8-e159-4bde-9b89-9517f5997d24 for instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 on n-h2-860864-3 Oct 11 19:44:00.813459 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1081808c-1c7b-4795-a16c-44111a83b602 req-510242e7-3721-4945-b103-d8fc426feaec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049277 Oct 11 19:44:00.814231 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 286/557] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:00.819587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-add2312f-9e43-47be-a933-d6cc50c8ca71 tempest-FlavorsV255TestJSON-794464820 tempest-FlavorsV255TestJSON-794464820-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:00.847406 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-add2312f-9e43-47be-a933-d6cc50c8ca71 tempest-FlavorsV255TestJSON-794464820 tempest-FlavorsV255TestJSON-794464820-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6584 microversion: 2.55 time: 0.032051 Oct 11 19:44:00.848458 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 287/558] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 19:44:00 2022] GET /compute/v2.1/flavors/detail => generated 6584 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:00.853648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b6a65f31-6063-469b-9e5e-908bca22ab54 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:00.854374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b6a65f31-6063-469b-9e5e-908bca22ab54 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:00.861537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a65f31-6063-469b-9e5e-908bca22ab54 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.862139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a65f31-6063-469b-9e5e-908bca22ab54 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.862607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a65f31-6063-469b-9e5e-908bca22ab54 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.863356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a65f31-6063-469b-9e5e-908bca22ab54 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:00.863812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a65f31-6063-469b-9e5e-908bca22ab54 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:00.864758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a65f31-6063-469b-9e5e-908bca22ab54 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:00.951073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a71680cf-8a96-4737-a825-f31db8981743 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:00.963907 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a71680cf-8a96-4737-a825-f31db8981743 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1311 microversion: 2.1 time: 0.469463 Oct 11 19:44:00.978875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6a65f31-6063-469b-9e5e-908bca22ab54 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:00.979473 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 272/559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:00 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1311 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:00.987836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0aabbc9-505e-42b9-b7c9-999eee155bb1 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:00.988714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0aabbc9-505e-42b9-b7c9-999eee155bb1 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:00.995618 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b6a65f31-6063-469b-9e5e-908bca22ab54 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1270 microversion: 2.1 time: 0.144217 Oct 11 19:44:00.998732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0aabbc9-505e-42b9-b7c9-999eee155bb1 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:01.000796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0aabbc9-505e-42b9-b7c9-999eee155bb1 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:01.001453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0aabbc9-505e-42b9-b7c9-999eee155bb1 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:01.003116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0aabbc9-505e-42b9-b7c9-999eee155bb1 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:01.003740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0aabbc9-505e-42b9-b7c9-999eee155bb1 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:01.004318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0aabbc9-505e-42b9-b7c9-999eee155bb1 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:01.005691 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 288/560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:00 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:01.027744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4fb719e-abf5-4d66-a454-d23fc43a5bc6 tempest-FlavorsV255TestJSON-794464820 tempest-FlavorsV255TestJSON-794464820-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:01.113959 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a4fb719e-abf5-4d66-a454-d23fc43a5bc6 tempest-FlavorsV255TestJSON-794464820 tempest-FlavorsV255TestJSON-794464820-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3674 microversion: 2.55 time: 0.093425 Oct 11 19:44:01.130900 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 289/561] 10.222.0.27 () {60 vars in 1166 bytes} [Tue Oct 11 19:44:01 2022] GET /compute/v2.1/flavors => generated 3674 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:01.141041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-990bb277-dfd0-40c8-bbac-3e9e942486fd tempest-FlavorsV255TestJSON-299589641 tempest-FlavorsV255TestJSON-299589641-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:01.163563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-990bb277-dfd0-40c8-bbac-3e9e942486fd tempest-FlavorsV255TestJSON-299589641 tempest-FlavorsV255TestJSON-299589641-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/732390331" status: 202 len: 0 microversion: 2.55 time: 0.029043 Oct 11 19:44:01.164489 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 290/562] 10.222.0.27 () {60 vars in 1199 bytes} [Tue Oct 11 19:44:01 2022] DELETE /compute/v2.1/flavors/732390331 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:44:01.173214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c903c3a4-0e8b-4c08-97cb-82ab8f43b778 tempest-FlavorsV255TestJSON-299589641 tempest-FlavorsV255TestJSON-299589641-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:01.199217 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c903c3a4-0e8b-4c08-97cb-82ab8f43b778 tempest-FlavorsV255TestJSON-299589641 tempest-FlavorsV255TestJSON-299589641-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6148 microversion: 2.55 time: 0.030109 Oct 11 19:44:01.200262 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 291/563] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 19:44:01 2022] GET /compute/v2.1/flavors/detail => generated 6148 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:44:01.417871 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0aabbc9-505e-42b9-b7c9-999eee155bb1 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 200 len: 1618 microversion: 2.1 time: 0.437051 Oct 11 19:44:01.418459 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 273/564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:00 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 1618 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:01.448389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-88ac82f8-34f4-4c27-8a2b-edb26ea3a7a2 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:01.449233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-88ac82f8-34f4-4c27-8a2b-edb26ea3a7a2 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] [instance: b8f663a0-eedd-4d4f-934b-05c7bd72ce6f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:01.488480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f7fd1ede-1242-41ca-be8e-71baced3de9e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:01.489738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f7fd1ede-1242-41ca-be8e-71baced3de9e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:01.490825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88ac82f8-34f4-4c27-8a2b-edb26ea3a7a2 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:01.491489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88ac82f8-34f4-4c27-8a2b-edb26ea3a7a2 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:01.492084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88ac82f8-34f4-4c27-8a2b-edb26ea3a7a2 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:01.492980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88ac82f8-34f4-4c27-8a2b-edb26ea3a7a2 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:01.500032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88ac82f8-34f4-4c27-8a2b-edb26ea3a7a2 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:01.500524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88ac82f8-34f4-4c27-8a2b-edb26ea3a7a2 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:01.512461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7fd1ede-1242-41ca-be8e-71baced3de9e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:01.513039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7fd1ede-1242-41ca-be8e-71baced3de9e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:01.513547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7fd1ede-1242-41ca-be8e-71baced3de9e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:01.514277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7fd1ede-1242-41ca-be8e-71baced3de9e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:01.538013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7fd1ede-1242-41ca-be8e-71baced3de9e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:01.540642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7fd1ede-1242-41ca-be8e-71baced3de9e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:02.720009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7fd1ede-1242-41ca-be8e-71baced3de9e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:02.729468 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f7fd1ede-1242-41ca-be8e-71baced3de9e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1472 microversion: 2.1 time: 1.273523 Oct 11 19:44:02.730051 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 274/565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:01 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1472 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:02.735560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4dfbb55d-d605-4775-b6ef-adf39ae3e54b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:02.738331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4dfbb55d-d605-4775-b6ef-adf39ae3e54b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:02.745998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dfbb55d-d605-4775-b6ef-adf39ae3e54b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:02.746829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dfbb55d-d605-4775-b6ef-adf39ae3e54b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:02.747481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dfbb55d-d605-4775-b6ef-adf39ae3e54b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:02.748388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dfbb55d-d605-4775-b6ef-adf39ae3e54b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:02.749077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dfbb55d-d605-4775-b6ef-adf39ae3e54b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:02.749714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4dfbb55d-d605-4775-b6ef-adf39ae3e54b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:02.870703 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-88ac82f8-34f4-4c27-8a2b-edb26ea3a7a2 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f" status: 200 len: 1618 microversion: 2.1 time: 1.429259 Oct 11 19:44:02.884279 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 292/566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:01 2022] GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f => generated 1618 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:02.889573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:02.890201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:02.910386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:02.910938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:02.911526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:02.912236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:02.912696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:02.914262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:02.933618 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 HTTP/1.1 Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:44:02.935742 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:44:02.937015 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '69bc7749-0f31-48b7-bf11-8fdc03fbb734'} Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:02.937834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:44:02.939193 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:02.940911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 404 to user: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:02.940911 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-da2da1ed-37d8-4e77-839e-c054471b2f5f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 404 len: 111 microversion: 2.1 time: 0.051594 Oct 11 19:44:02.940911 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 293/567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:02 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:44:02.945910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2eaa5886-35d5-49e8-9764-c19a405f7060 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:02.946405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2eaa5886-35d5-49e8-9764-c19a405f7060 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:02.954844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eaa5886-35d5-49e8-9764-c19a405f7060 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:02.954844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eaa5886-35d5-49e8-9764-c19a405f7060 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:02.954844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eaa5886-35d5-49e8-9764-c19a405f7060 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:02.955661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eaa5886-35d5-49e8-9764-c19a405f7060 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:02.956556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eaa5886-35d5-49e8-9764-c19a405f7060 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:02.957131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eaa5886-35d5-49e8-9764-c19a405f7060 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:03.181786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4dfbb55d-d605-4775-b6ef-adf39ae3e54b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:03.193811 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4dfbb55d-d605-4775-b6ef-adf39ae3e54b tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1386 microversion: 2.1 time: 0.462466 Oct 11 19:44:03.194631 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 275/568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:02 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1386 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:03.200176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-318809c9-f8a8-4c45-9f20-1e46341c4844 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:03.201025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-318809c9-f8a8-4c45-9f20-1e46341c4844 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:03.209268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318809c9-f8a8-4c45-9f20-1e46341c4844 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:03.210135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318809c9-f8a8-4c45-9f20-1e46341c4844 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:03.210893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318809c9-f8a8-4c45-9f20-1e46341c4844 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:03.211897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318809c9-f8a8-4c45-9f20-1e46341c4844 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:03.212646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318809c9-f8a8-4c45-9f20-1e46341c4844 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:03.213311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318809c9-f8a8-4c45-9f20-1e46341c4844 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:03.347247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-318809c9-f8a8-4c45-9f20-1e46341c4844 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:03.364229 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-318809c9-f8a8-4c45-9f20-1e46341c4844 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1276 microversion: 2.1 time: 0.168231 Oct 11 19:44:03.367260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2eaa5886-35d5-49e8-9764-c19a405f7060 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:03.386396 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 276/569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:03 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:03.390519 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2eaa5886-35d5-49e8-9764-c19a405f7060 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1494 microversion: 2.1 time: 0.450745 Oct 11 19:44:03.393438 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 294/570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:02 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1494 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:03.397580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5b53d2ad-01a6-46cb-b18a-9fbcadf1e4e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Action: 'create', calling method: .version_select at 0x7f83cca75310>, body: {"keypair": {"name": "tempest-keypair-208620753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz+QMPNS9bpQXape2GZE/kJ9KdwQ3j8Mz2D0QLjHHPldIEIXDMPpD+/Rk9KC9aJT2Sd/+JvR44QtXiLdmeKsAYJa9WU3LU23aPD9n50QzNgX2Gc9C2Juu3ccP9KabnrQQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:03.401778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1183727164", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "f392b558-6079-4c4d-88bd-a50aa499dce6"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:03.432205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-5b53d2ad-01a6-46cb-b18a-9fbcadf1e4e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Getting quotas for project 21a886c8ddf44b77974321e34b2fad8a. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:03.440285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-5b53d2ad-01a6-46cb-b18a-9fbcadf1e4e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Getting quotas for user 23b671bc2d4849be938178f53135af2d and project 21a886c8ddf44b77974321e34b2fad8a. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:03.485948 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5b53d2ad-01a6-46cb-b18a-9fbcadf1e4e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097305 Oct 11 19:44:03.487161 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 277/571] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:44:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:03.492844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce3d52ce-772b-469b-bf08-7e49e5161bc1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:03.493705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ce3d52ce-772b-469b-bf08-7e49e5161bc1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:03.502273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce3d52ce-772b-469b-bf08-7e49e5161bc1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:03.502805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce3d52ce-772b-469b-bf08-7e49e5161bc1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:03.503265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce3d52ce-772b-469b-bf08-7e49e5161bc1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:03.504011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce3d52ce-772b-469b-bf08-7e49e5161bc1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:03.505092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce3d52ce-772b-469b-bf08-7e49e5161bc1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:03.505533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce3d52ce-772b-469b-bf08-7e49e5161bc1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:03.513303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:44:04.375469 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ce3d52ce-772b-469b-bf08-7e49e5161bc1 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1645 microversion: 2.1 time: 0.887009 Oct 11 19:44:04.378598 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 278/572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:03 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1645 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:04.393011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-56c2b5ce-1989-46e7-86a0-871387e68c55 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:04.394306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-56c2b5ce-1989-46e7-86a0-871387e68c55 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:04.404278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c2b5ce-1989-46e7-86a0-871387e68c55 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:04.404787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c2b5ce-1989-46e7-86a0-871387e68c55 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:04.405230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c2b5ce-1989-46e7-86a0-871387e68c55 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:04.405942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c2b5ce-1989-46e7-86a0-871387e68c55 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:04.406407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c2b5ce-1989-46e7-86a0-871387e68c55 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:04.406863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c2b5ce-1989-46e7-86a0-871387e68c55 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:04.413195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:04.593160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:44:04.593594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:44:04.594184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:44:04.599451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:44:04.600320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:44:04.610513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:04.611123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:04.611572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:04.612641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:04.613466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:04.614436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:04.644618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:04.651802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:04.667995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:44:04.670624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:44:04.726439 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-35ac261f-7339-4afb-8485-0c1470dcc0a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331146 Oct 11 19:44:04.727718 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 295/573] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:44:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:44:04.734296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7f5178a3-7cb2-48e0-9665-de7e71229947 req-9a3ec74e-910f-4a55-81c3-322d416dfa62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9040218a-3ba8-4621-b4e7-20732e4cafd0", "name": "network-vif-plugged", "status": "completed", "tag": "01598c88-4628-48c1-93e9-e3dada9b0918"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:04.756320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7f5178a3-7cb2-48e0-9665-de7e71229947 req-9a3ec74e-910f-4a55-81c3-322d416dfa62 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:04.756831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7f5178a3-7cb2-48e0-9665-de7e71229947 req-9a3ec74e-910f-4a55-81c3-322d416dfa62 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:04.759281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7f5178a3-7cb2-48e0-9665-de7e71229947 req-9a3ec74e-910f-4a55-81c3-322d416dfa62 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:04.786854 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7f5178a3-7cb2-48e0-9665-de7e71229947 req-9a3ec74e-910f-4a55-81c3-322d416dfa62 service nova] Creating event network-vif-plugged:01598c88-4628-48c1-93e9-e3dada9b0918 for instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 on n-h1-860864-3 Oct 11 19:44:04.796732 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7f5178a3-7cb2-48e0-9665-de7e71229947 req-9a3ec74e-910f-4a55-81c3-322d416dfa62 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067531 Oct 11 19:44:04.797755 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 296/574] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:04.811549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff93c5f6-af23-4be6-ac31-92b14299e4b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:04.812671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ff93c5f6-af23-4be6-ac31-92b14299e4b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:04.820482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff93c5f6-af23-4be6-ac31-92b14299e4b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:04.821371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff93c5f6-af23-4be6-ac31-92b14299e4b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:04.822026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff93c5f6-af23-4be6-ac31-92b14299e4b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:04.822853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff93c5f6-af23-4be6-ac31-92b14299e4b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:04.823402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff93c5f6-af23-4be6-ac31-92b14299e4b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:04.823956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff93c5f6-af23-4be6-ac31-92b14299e4b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:05.188653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56c2b5ce-1989-46e7-86a0-871387e68c55 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:05.203195 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-56c2b5ce-1989-46e7-86a0-871387e68c55 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.825513 Oct 11 19:44:05.204077 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 279/575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:04 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:05.227556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b495ae23-b182-40f5-b032-e6599ab645c0 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:05.228168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b495ae23-b182-40f5-b032-e6599ab645c0 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:05.235366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b495ae23-b182-40f5-b032-e6599ab645c0 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:05.236439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b495ae23-b182-40f5-b032-e6599ab645c0 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:05.237067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b495ae23-b182-40f5-b032-e6599ab645c0 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:05.237795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b495ae23-b182-40f5-b032-e6599ab645c0 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:05.238262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b495ae23-b182-40f5-b032-e6599ab645c0 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:05.239280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b495ae23-b182-40f5-b032-e6599ab645c0 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:05.386567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ff93c5f6-af23-4be6-ac31-92b14299e4b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:05.400277 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ff93c5f6-af23-4be6-ac31-92b14299e4b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1386 microversion: 2.1 time: 0.598066 Oct 11 19:44:05.427818 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 297/576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:04 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1386 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:05.437647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-496f26c0-3154-4158-913a-8d322eb0f260 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:05.438767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-496f26c0-3154-4158-913a-8d322eb0f260 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:05.448615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-496f26c0-3154-4158-913a-8d322eb0f260 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:05.449577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-496f26c0-3154-4158-913a-8d322eb0f260 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:05.450311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-496f26c0-3154-4158-913a-8d322eb0f260 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:05.451340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-496f26c0-3154-4158-913a-8d322eb0f260 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:05.452064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-496f26c0-3154-4158-913a-8d322eb0f260 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:05.452705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-496f26c0-3154-4158-913a-8d322eb0f260 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:05.458893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:06.057553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b495ae23-b182-40f5-b032-e6599ab645c0 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:06.067252 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b495ae23-b182-40f5-b032-e6599ab645c0 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1318 microversion: 2.1 time: 0.851151 Oct 11 19:44:06.081328 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 280/577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:05 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1318 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:06.081328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-33a6932b-f380-4552-a69e-bd3069daf7e6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:06.081328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-33a6932b-f380-4552-a69e-bd3069daf7e6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:06.081716 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-496f26c0-3154-4158-913a-8d322eb0f260 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1645 microversion: 2.1 time: 0.651056 Oct 11 19:44:06.083511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a6932b-f380-4552-a69e-bd3069daf7e6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:06.084036 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 298/578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:05 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1645 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:06.084185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a6932b-f380-4552-a69e-bd3069daf7e6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:06.084793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a6932b-f380-4552-a69e-bd3069daf7e6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:06.085863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a6932b-f380-4552-a69e-bd3069daf7e6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:06.086517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a6932b-f380-4552-a69e-bd3069daf7e6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:06.087058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a6932b-f380-4552-a69e-bd3069daf7e6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:06.103009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1144804989", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:06.199469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] validate_networks() for [('7a7a5c8e-4510-4be6-9fd7-12b19dbcc68f', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:44:06.250355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-33a6932b-f380-4552-a69e-bd3069daf7e6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:06.260590 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-33a6932b-f380-4552-a69e-bd3069daf7e6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1269 microversion: 2.1 time: 0.191082 Oct 11 19:44:06.261273 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 281/579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:06 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:06.267610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2a8e8d98-8d3c-4081-946f-773e82b2599b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:06.272691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a8e8d98-8d3c-4081-946f-773e82b2599b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:06.273883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a8e8d98-8d3c-4081-946f-773e82b2599b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:06.274738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a8e8d98-8d3c-4081-946f-773e82b2599b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:06.276237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a8e8d98-8d3c-4081-946f-773e82b2599b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:06.276922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a8e8d98-8d3c-4081-946f-773e82b2599b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:06.277574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a8e8d98-8d3c-4081-946f-773e82b2599b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:06.320228 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2a8e8d98-8d3c-4081-946f-773e82b2599b tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048336 Oct 11 19:44:06.323254 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 282/580] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 11 19:44:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:06.330740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cf0bf3a2-9139-4d94-aa30-ab65acbf956c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:06.332694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cf0bf3a2-9139-4d94-aa30-ab65acbf956c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:06.340253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf0bf3a2-9139-4d94-aa30-ab65acbf956c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:06.340749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf0bf3a2-9139-4d94-aa30-ab65acbf956c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:06.341381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf0bf3a2-9139-4d94-aa30-ab65acbf956c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:06.342092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf0bf3a2-9139-4d94-aa30-ab65acbf956c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:06.342583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf0bf3a2-9139-4d94-aa30-ab65acbf956c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:06.343013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf0bf3a2-9139-4d94-aa30-ab65acbf956c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:06.768553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cf0bf3a2-9139-4d94-aa30-ab65acbf956c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:06.779018 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cf0bf3a2-9139-4d94-aa30-ab65acbf956c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.452801 Oct 11 19:44:06.779978 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 283/581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:06 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:06.786942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44272175-ffe1-4b50-8255-41dd65ad2a9f tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:06.788968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-44272175-ffe1-4b50-8255-41dd65ad2a9f tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:06.799429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44272175-ffe1-4b50-8255-41dd65ad2a9f tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:06.800276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44272175-ffe1-4b50-8255-41dd65ad2a9f tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:06.800920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44272175-ffe1-4b50-8255-41dd65ad2a9f tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:06.802050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44272175-ffe1-4b50-8255-41dd65ad2a9f tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:06.802775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44272175-ffe1-4b50-8255-41dd65ad2a9f tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:06.803382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44272175-ffe1-4b50-8255-41dd65ad2a9f tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:06.880444 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-44272175-ffe1-4b50-8255-41dd65ad2a9f tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00/action" status: 202 len: 0 microversion: 2.1 time: 0.098694 Oct 11 19:44:06.884503 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 284/582] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:44:06 2022] POST /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:44:06.888762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c845acdb-575e-4025-b52b-d3e8176b45b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:06.889503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c845acdb-575e-4025-b52b-d3e8176b45b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:06.893391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:06.898446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c845acdb-575e-4025-b52b-d3e8176b45b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:06.898985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c845acdb-575e-4025-b52b-d3e8176b45b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:06.899425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c845acdb-575e-4025-b52b-d3e8176b45b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:06.900129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c845acdb-575e-4025-b52b-d3e8176b45b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:06.900590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c845acdb-575e-4025-b52b-d3e8176b45b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:06.901016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c845acdb-575e-4025-b52b-d3e8176b45b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:07.733317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c845acdb-575e-4025-b52b-d3e8176b45b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:07.742656 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c845acdb-575e-4025-b52b-d3e8176b45b6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1585 microversion: 2.1 time: 0.860197 Oct 11 19:44:07.759653 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 285/583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:06 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1585 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:07.766514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-85a42de7-6b07-4438-a531-8cff272316a9 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:07.767160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-85a42de7-6b07-4438-a531-8cff272316a9 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:07.773981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85a42de7-6b07-4438-a531-8cff272316a9 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:07.774488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85a42de7-6b07-4438-a531-8cff272316a9 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:07.775023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85a42de7-6b07-4438-a531-8cff272316a9 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:07.775826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85a42de7-6b07-4438-a531-8cff272316a9 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:07.776298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85a42de7-6b07-4438-a531-8cff272316a9 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:07.776747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85a42de7-6b07-4438-a531-8cff272316a9 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:07.865052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:44:07.865803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:44:07.866382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:44:07.867542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:44:07.868062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:44:07.880649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:07.881373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:07.883258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:07.885195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:07.885907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:07.887494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:07.922093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Getting quotas for project 21a886c8ddf44b77974321e34b2fad8a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:07.930738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Getting quotas for user 23b671bc2d4849be938178f53135af2d and project 21a886c8ddf44b77974321e34b2fad8a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:07.951627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:44:07.953958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:44:08.009619 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4fb793ee-e1ac-418e-854d-76d001409fa8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.924316 Oct 11 19:44:08.020402 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 299/584] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:44:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:44:08.029081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05c5e1b6-6aab-473e-b842-6e22b7b2180d tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:08.029777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05c5e1b6-6aab-473e-b842-6e22b7b2180d tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:08.044223 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-85a42de7-6b07-4438-a531-8cff272316a9 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1630 microversion: 2.1 time: 0.282659 Oct 11 19:44:08.061211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c5e1b6-6aab-473e-b842-6e22b7b2180d tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:08.061396 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 286/585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:07 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1630 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:08.061715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c5e1b6-6aab-473e-b842-6e22b7b2180d tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:08.062629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c5e1b6-6aab-473e-b842-6e22b7b2180d tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:08.062957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c5e1b6-6aab-473e-b842-6e22b7b2180d tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:08.063642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c5e1b6-6aab-473e-b842-6e22b7b2180d tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:08.064521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c5e1b6-6aab-473e-b842-6e22b7b2180d tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:08.072578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2248a4cd-818a-40a1-83e6-c4e3384b5aeb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:08.078735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2248a4cd-818a-40a1-83e6-c4e3384b5aeb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:08.104092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2248a4cd-818a-40a1-83e6-c4e3384b5aeb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:08.109653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2248a4cd-818a-40a1-83e6-c4e3384b5aeb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:08.112815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2248a4cd-818a-40a1-83e6-c4e3384b5aeb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:08.113692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2248a4cd-818a-40a1-83e6-c4e3384b5aeb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:08.114174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2248a4cd-818a-40a1-83e6-c4e3384b5aeb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:08.114630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2248a4cd-818a-40a1-83e6-c4e3384b5aeb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:08.644357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-05c5e1b6-6aab-473e-b842-6e22b7b2180d tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:08.654231 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05c5e1b6-6aab-473e-b842-6e22b7b2180d tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1318 microversion: 2.1 time: 0.632337 Oct 11 19:44:08.660032 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 300/586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:08 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:08.863358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2248a4cd-818a-40a1-83e6-c4e3384b5aeb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:08.877724 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2248a4cd-818a-40a1-83e6-c4e3384b5aeb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1317 microversion: 2.1 time: 0.815226 Oct 11 19:44:08.878765 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 287/587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:08 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:08.893966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-41fc86f2-4de5-4af6-8688-c6f09140d31f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:08.894942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-41fc86f2-4de5-4af6-8688-c6f09140d31f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:08.914804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41fc86f2-4de5-4af6-8688-c6f09140d31f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:08.915601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41fc86f2-4de5-4af6-8688-c6f09140d31f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:08.916201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41fc86f2-4de5-4af6-8688-c6f09140d31f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:08.917201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41fc86f2-4de5-4af6-8688-c6f09140d31f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:08.918271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41fc86f2-4de5-4af6-8688-c6f09140d31f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:08.918977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41fc86f2-4de5-4af6-8688-c6f09140d31f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:09.116704 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-41fc86f2-4de5-4af6-8688-c6f09140d31f tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236117 Oct 11 19:44:09.117303 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 288/588] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:44:08 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:09.131075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d3eaec42-1141-470a-8522-dfec6fe79027 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:09.131860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d3eaec42-1141-470a-8522-dfec6fe79027 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:09.138995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3eaec42-1141-470a-8522-dfec6fe79027 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:09.139698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3eaec42-1141-470a-8522-dfec6fe79027 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:09.140299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3eaec42-1141-470a-8522-dfec6fe79027 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:09.141172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3eaec42-1141-470a-8522-dfec6fe79027 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:09.141780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3eaec42-1141-470a-8522-dfec6fe79027 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:09.142356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3eaec42-1141-470a-8522-dfec6fe79027 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:09.229546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-52fd33c4-6407-461a-8bbf-f83f2ffb79de tempest-FlavorsV261TestJSON-1127561407 tempest-FlavorsV261TestJSON-1127561407-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-480765264", "id": 630729895, "os-flavor-access:is_public": "True"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:09.263640 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-52fd33c4-6407-461a-8bbf-f83f2ffb79de tempest-FlavorsV261TestJSON-1127561407 tempest-FlavorsV261TestJSON-1127561407-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.601613 Oct 11 19:44:09.264377 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 301/589] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:44:08 2022] POST /compute/v2.1/flavors => generated 464 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:44:09.270727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b1b4c26-3007-4deb-9b69-2f07e3f88b62 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:09.271670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8b1b4c26-3007-4deb-9b69-2f07e3f88b62 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:09.279194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b1b4c26-3007-4deb-9b69-2f07e3f88b62 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:09.279978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b1b4c26-3007-4deb-9b69-2f07e3f88b62 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:09.280779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b1b4c26-3007-4deb-9b69-2f07e3f88b62 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:09.282137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b1b4c26-3007-4deb-9b69-2f07e3f88b62 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:09.282830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b1b4c26-3007-4deb-9b69-2f07e3f88b62 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:09.283287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b1b4c26-3007-4deb-9b69-2f07e3f88b62 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:09.430888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d3eaec42-1141-470a-8522-dfec6fe79027 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:09.441330 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d3eaec42-1141-470a-8522-dfec6fe79027 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.314509 Oct 11 19:44:09.443934 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 289/590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:09 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:09.454063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-af6b46d8-696d-4c16-8665-ecac5c85b34d req-f72645b5-ae10-4eea-92dd-b0b4fbf6a08a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbe5ea6-515a-45e2-9d56-2dae509d87ab", "tag": "c7d714c2-cbed-4ffc-8bac-481c12889743"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:09.484467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-af6b46d8-696d-4c16-8665-ecac5c85b34d req-f72645b5-ae10-4eea-92dd-b0b4fbf6a08a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:09.486654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-af6b46d8-696d-4c16-8665-ecac5c85b34d req-f72645b5-ae10-4eea-92dd-b0b4fbf6a08a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:09.487671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-af6b46d8-696d-4c16-8665-ecac5c85b34d req-f72645b5-ae10-4eea-92dd-b0b4fbf6a08a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:09.511832 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-af6b46d8-696d-4c16-8665-ecac5c85b34d req-f72645b5-ae10-4eea-92dd-b0b4fbf6a08a service nova] Creating event network-changed:c7d714c2-cbed-4ffc-8bac-481c12889743 for instance ccbe5ea6-515a-45e2-9d56-2dae509d87ab on n-h2-860864-3 Oct 11 19:44:09.529792 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-af6b46d8-696d-4c16-8665-ecac5c85b34d req-f72645b5-ae10-4eea-92dd-b0b4fbf6a08a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084364 Oct 11 19:44:09.530735 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 290/591] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:09.536840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:09.545611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:09.561000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:09.561497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:09.565433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:09.567177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:09.567825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:09.568472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:09.597358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lazy-loading 'flavor' on Instance uuid 7dea9975-b38a-465e-a181-454a20b0ae00 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:09.616410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Going to try to live migrate instance to n-h2-860864-3 {{(pid=126956) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 19:44:09.675437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b1b4c26-3007-4deb-9b69-2f07e3f88b62 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:09.688806 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b1b4c26-3007-4deb-9b69-2f07e3f88b62 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1221 microversion: 2.1 time: 0.423261 Oct 11 19:44:09.689390 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 302/592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:09 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1221 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:10.024915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-36823f6b-e943-4d80-b15c-c0e2ac1f74ce tempest-FlavorsV261TestJSON-905128464 tempest-FlavorsV261TestJSON-905128464-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:10.043946 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-36823f6b-e943-4d80-b15c-c0e2ac1f74ce tempest-FlavorsV261TestJSON-905128464 tempest-FlavorsV261TestJSON-905128464-project] 10.222.0.27 "GET /compute/v2.1/flavors/630729895" status: 200 len: 464 microversion: 2.61 time: 0.328378 Oct 11 19:44:10.045181 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 303/593] 10.222.0.27 () {60 vars in 1196 bytes} [Tue Oct 11 19:44:09 2022] GET /compute/v2.1/flavors/630729895 => generated 464 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:44:10.052072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b454b89-6acb-49e8-9bf3-f0f87e089720 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:10.061773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8b454b89-6acb-49e8-9bf3-f0f87e089720 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:10.069414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b454b89-6acb-49e8-9bf3-f0f87e089720 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:10.070265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b454b89-6acb-49e8-9bf3-f0f87e089720 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:10.079319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b454b89-6acb-49e8-9bf3-f0f87e089720 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:10.080201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b454b89-6acb-49e8-9bf3-f0f87e089720 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:10.081109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b454b89-6acb-49e8-9bf3-f0f87e089720 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:10.081797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b454b89-6acb-49e8-9bf3-f0f87e089720 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:10.570766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b454b89-6acb-49e8-9bf3-f0f87e089720 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:10.589675 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b454b89-6acb-49e8-9bf3-f0f87e089720 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1318 microversion: 2.1 time: 0.534858 Oct 11 19:44:10.603140 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 304/594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:10 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:10.612225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e62c1b2b-61a8-49c0-898b-792d35b1ad41 req-8e297154-e780-4e81-b015-6c043f96c918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36452fd4-4ace-49b4-89b3-4872701681d6", "tag": "b8c5011d-0676-464c-bd00-7980511354e5"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:10.624212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e62c1b2b-61a8-49c0-898b-792d35b1ad41 req-8e297154-e780-4e81-b015-6c043f96c918 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:10.624956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e62c1b2b-61a8-49c0-898b-792d35b1ad41 req-8e297154-e780-4e81-b015-6c043f96c918 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:10.625549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e62c1b2b-61a8-49c0-898b-792d35b1ad41 req-8e297154-e780-4e81-b015-6c043f96c918 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:10.638343 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e62c1b2b-61a8-49c0-898b-792d35b1ad41 req-8e297154-e780-4e81-b015-6c043f96c918 service nova] Creating event network-changed:b8c5011d-0676-464c-bd00-7980511354e5 for instance 36452fd4-4ace-49b4-89b3-4872701681d6 on n-h1-860864-3 Oct 11 19:44:10.652563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e62c1b2b-61a8-49c0-898b-792d35b1ad41 req-8e297154-e780-4e81-b015-6c043f96c918 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043694 Oct 11 19:44:10.654277 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 305/595] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:10.663523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-57bd0da6-b914-4495-b9aa-52b44b3cb617 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:10.664554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-57bd0da6-b914-4495-b9aa-52b44b3cb617 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:10.672445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57bd0da6-b914-4495-b9aa-52b44b3cb617 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:10.673370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57bd0da6-b914-4495-b9aa-52b44b3cb617 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:10.674622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57bd0da6-b914-4495-b9aa-52b44b3cb617 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:10.675524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57bd0da6-b914-4495-b9aa-52b44b3cb617 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:10.677317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57bd0da6-b914-4495-b9aa-52b44b3cb617 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:10.677930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57bd0da6-b914-4495-b9aa-52b44b3cb617 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:10.963375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-57bd0da6-b914-4495-b9aa-52b44b3cb617 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:11.003775 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-57bd0da6-b914-4495-b9aa-52b44b3cb617 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1317 microversion: 2.1 time: 0.347571 Oct 11 19:44:11.018552 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 306/596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:10 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:11.018552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ceee62e7-b9e7-4154-be9f-b5f6e7f9f30a tempest-FlavorsV261TestJSON-1127561407 tempest-FlavorsV261TestJSON-1127561407-project-admin] Action: 'update', calling method: .version_select at 0x7f83ce340b80>, body: {"flavor": {"description": "new"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:11.119931 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ceee62e7-b9e7-4154-be9f-b5f6e7f9f30a tempest-FlavorsV261TestJSON-1127561407 tempest-FlavorsV261TestJSON-1127561407-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/630729895" status: 200 len: 465 microversion: 2.61 time: 0.111673 Oct 11 19:44:11.121748 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 307/597] 10.222.0.27 () {62 vars in 1216 bytes} [Tue Oct 11 19:44:11 2022] PUT /compute/v2.1/flavors/630729895 => generated 465 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:44:11.138230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db01aa3d-6b95-429d-8ef7-90a691ef5a47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:11.138999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-db01aa3d-6b95-429d-8ef7-90a691ef5a47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:11.155915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db01aa3d-6b95-429d-8ef7-90a691ef5a47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:11.156477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db01aa3d-6b95-429d-8ef7-90a691ef5a47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:11.156945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db01aa3d-6b95-429d-8ef7-90a691ef5a47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:11.157686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db01aa3d-6b95-429d-8ef7-90a691ef5a47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:11.158145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db01aa3d-6b95-429d-8ef7-90a691ef5a47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:11.158608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db01aa3d-6b95-429d-8ef7-90a691ef5a47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:11.867730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-db01aa3d-6b95-429d-8ef7-90a691ef5a47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:11.875860 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-db01aa3d-6b95-429d-8ef7-90a691ef5a47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.742045 Oct 11 19:44:11.893289 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 308/598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:11 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:11.901435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ad728f44-954d-43ad-b2ae-f4fbb471fac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:11.902355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ad728f44-954d-43ad-b2ae-f4fbb471fac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:11.915497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad728f44-954d-43ad-b2ae-f4fbb471fac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:11.918092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad728f44-954d-43ad-b2ae-f4fbb471fac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:11.922939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad728f44-954d-43ad-b2ae-f4fbb471fac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:11.923832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad728f44-954d-43ad-b2ae-f4fbb471fac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:11.924418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad728f44-954d-43ad-b2ae-f4fbb471fac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:11.924957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad728f44-954d-43ad-b2ae-f4fbb471fac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:12.052920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ad728f44-954d-43ad-b2ae-f4fbb471fac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:12.074681 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ad728f44-954d-43ad-b2ae-f4fbb471fac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1283 microversion: 2.1 time: 0.179724 Oct 11 19:44:12.076464 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 309/599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:11 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:12.100305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d1068cd3-c4a9-4abb-afe7-a62b22815f23 tempest-FlavorsV261TestJSON-905128464 tempest-FlavorsV261TestJSON-905128464-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:12.160680 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d1068cd3-c4a9-4abb-afe7-a62b22815f23 tempest-FlavorsV261TestJSON-905128464 tempest-FlavorsV261TestJSON-905128464-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 7147 microversion: 2.61 time: 0.081944 Oct 11 19:44:12.161621 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 310/600] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 19:44:12 2022] GET /compute/v2.1/flavors/detail => generated 7147 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:12.173115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b161d1be-9eb3-4be9-9827-44307f9bde68 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:12.173991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b161d1be-9eb3-4be9-9827-44307f9bde68 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:12.181609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b161d1be-9eb3-4be9-9827-44307f9bde68 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:12.182462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b161d1be-9eb3-4be9-9827-44307f9bde68 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:12.183130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b161d1be-9eb3-4be9-9827-44307f9bde68 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:12.184231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b161d1be-9eb3-4be9-9827-44307f9bde68 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:12.184687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b161d1be-9eb3-4be9-9827-44307f9bde68 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:12.185120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b161d1be-9eb3-4be9-9827-44307f9bde68 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:12.449520 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa2168fe-5308-4841-bef0-7d3a8bc5e59e tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00/action" status: 202 len: 0 microversion: 2.1 time: 2.917259 Oct 11 19:44:12.450306 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 291/601] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:44:09 2022] POST /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00/action => generated 0 bytes in 2919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:44:12.461191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a19e6889-0509-4d63-87ab-3429c2c297fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:12.464260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a19e6889-0509-4d63-87ab-3429c2c297fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:12.475771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a19e6889-0509-4d63-87ab-3429c2c297fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:12.476379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a19e6889-0509-4d63-87ab-3429c2c297fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:12.478386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a19e6889-0509-4d63-87ab-3429c2c297fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:12.479624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a19e6889-0509-4d63-87ab-3429c2c297fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:12.480181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a19e6889-0509-4d63-87ab-3429c2c297fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:12.481356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a19e6889-0509-4d63-87ab-3429c2c297fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:12.728050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b161d1be-9eb3-4be9-9827-44307f9bde68 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:12.737517 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b161d1be-9eb3-4be9-9827-44307f9bde68 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1318 microversion: 2.1 time: 0.574798 Oct 11 19:44:12.738116 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 311/602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:12 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:12.747320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff935fd2-bbde-4dcc-9812-3e7fd33d4e63 tempest-FlavorsV261TestJSON-905128464 tempest-FlavorsV261TestJSON-905128464-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:12.788816 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ff935fd2-bbde-4dcc-9812-3e7fd33d4e63 tempest-FlavorsV261TestJSON-905128464 tempest-FlavorsV261TestJSON-905128464-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3674 microversion: 2.61 time: 0.048984 Oct 11 19:44:12.789848 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 312/603] 10.222.0.27 () {60 vars in 1166 bytes} [Tue Oct 11 19:44:12 2022] GET /compute/v2.1/flavors => generated 3674 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:12.795803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f74da00a-b5ca-415c-9b80-5079083fb538 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:12.796446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f74da00a-b5ca-415c-9b80-5079083fb538 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:12.806487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f74da00a-b5ca-415c-9b80-5079083fb538 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:12.815990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f74da00a-b5ca-415c-9b80-5079083fb538 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:12.815990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f74da00a-b5ca-415c-9b80-5079083fb538 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:12.815990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f74da00a-b5ca-415c-9b80-5079083fb538 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:12.815990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f74da00a-b5ca-415c-9b80-5079083fb538 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:12.816924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f74da00a-b5ca-415c-9b80-5079083fb538 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:13.010872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a19e6889-0509-4d63-87ab-3429c2c297fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:13.026481 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a19e6889-0509-4d63-87ab-3429c2c297fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1317 microversion: 2.1 time: 0.573084 Oct 11 19:44:13.033527 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 292/604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:12 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:13.063932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d27994c3-690a-4c7b-93ac-0eefea96f751 tempest-FlavorsV261TestJSON-1127561407 tempest-FlavorsV261TestJSON-1127561407-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:13.125907 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d27994c3-690a-4c7b-93ac-0eefea96f751 tempest-FlavorsV261TestJSON-1127561407 tempest-FlavorsV261TestJSON-1127561407-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/630729895" status: 202 len: 0 microversion: 2.61 time: 0.090509 Oct 11 19:44:13.127355 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 293/605] 10.222.0.27 () {60 vars in 1199 bytes} [Tue Oct 11 19:44:13 2022] DELETE /compute/v2.1/flavors/630729895 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:44:13.135890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-030b94f3-0f9f-4202-82dc-458d2da767d5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:13.136757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-030b94f3-0f9f-4202-82dc-458d2da767d5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:13.145893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-030b94f3-0f9f-4202-82dc-458d2da767d5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:13.146882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-030b94f3-0f9f-4202-82dc-458d2da767d5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:13.147654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-030b94f3-0f9f-4202-82dc-458d2da767d5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:13.148978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-030b94f3-0f9f-4202-82dc-458d2da767d5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:13.149615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-030b94f3-0f9f-4202-82dc-458d2da767d5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:13.150183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-030b94f3-0f9f-4202-82dc-458d2da767d5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:13.415859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f74da00a-b5ca-415c-9b80-5079083fb538 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:13.431527 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f74da00a-b5ca-415c-9b80-5079083fb538 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1504 microversion: 2.1 time: 0.640544 Oct 11 19:44:13.432712 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 313/606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:12 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1504 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:13.440189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ba1c6fe-2c46-4dd4-abe2-a86498bc4713 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:13.441838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1ba1c6fe-2c46-4dd4-abe2-a86498bc4713 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:13.450164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba1c6fe-2c46-4dd4-abe2-a86498bc4713 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:13.451855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba1c6fe-2c46-4dd4-abe2-a86498bc4713 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:13.452482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba1c6fe-2c46-4dd4-abe2-a86498bc4713 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:13.454775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=12 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:13.456147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba1c6fe-2c46-4dd4-abe2-a86498bc4713 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:13.458030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba1c6fe-2c46-4dd4-abe2-a86498bc4713 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:13.459115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba1c6fe-2c46-4dd4-abe2-a86498bc4713 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:13.655233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1ba1c6fe-2c46-4dd4-abe2-a86498bc4713 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:13.672065 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1ba1c6fe-2c46-4dd4-abe2-a86498bc4713 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1283 microversion: 2.1 time: 0.238000 Oct 11 19:44:13.679310 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 314/607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:13 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1283 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:13.697866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0cdb4ccc-3c25-400d-a3cd-efd1add02f7f tempest-FlavorsV261TestJSON-1127561407 tempest-FlavorsV261TestJSON-1127561407-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:13.710950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:13.761951 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0cdb4ccc-3c25-400d-a3cd-efd1add02f7f tempest-FlavorsV261TestJSON-1127561407 tempest-FlavorsV261TestJSON-1127561407-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6692 microversion: 2.61 time: 0.081208 Oct 11 19:44:13.782029 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 315/608] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 19:44:13 2022] GET /compute/v2.1/flavors/detail => generated 6692 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:13.785272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e33a206a-efb2-43e1-9a0e-67dd7f453a79 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:13.786514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e33a206a-efb2-43e1-9a0e-67dd7f453a79 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:13.798950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e33a206a-efb2-43e1-9a0e-67dd7f453a79 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:13.799473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e33a206a-efb2-43e1-9a0e-67dd7f453a79 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:13.800126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e33a206a-efb2-43e1-9a0e-67dd7f453a79 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:13.803948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e33a206a-efb2-43e1-9a0e-67dd7f453a79 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:13.805229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e33a206a-efb2-43e1-9a0e-67dd7f453a79 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:13.805766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e33a206a-efb2-43e1-9a0e-67dd7f453a79 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:13.849874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-030b94f3-0f9f-4202-82dc-458d2da767d5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:13.859139 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-030b94f3-0f9f-4202-82dc-458d2da767d5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.728729 Oct 11 19:44:13.859727 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 294/609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:13 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:13.880597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-511c9104-51f2-43f7-bd27-a45556f13413 req-d5fce9b1-a166-4927-8205-12e6f629705c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9040218a-3ba8-4621-b4e7-20732e4cafd0", "tag": "01598c88-4628-48c1-93e9-e3dada9b0918"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:13.929522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-511c9104-51f2-43f7-bd27-a45556f13413 req-d5fce9b1-a166-4927-8205-12e6f629705c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:13.930010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-511c9104-51f2-43f7-bd27-a45556f13413 req-d5fce9b1-a166-4927-8205-12e6f629705c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:13.930438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-511c9104-51f2-43f7-bd27-a45556f13413 req-d5fce9b1-a166-4927-8205-12e6f629705c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:13.993637 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-511c9104-51f2-43f7-bd27-a45556f13413 req-d5fce9b1-a166-4927-8205-12e6f629705c service nova] Creating event network-changed:01598c88-4628-48c1-93e9-e3dada9b0918 for instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 on n-h1-860864-3 Oct 11 19:44:14.005747 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-511c9104-51f2-43f7-bd27-a45556f13413 req-d5fce9b1-a166-4927-8205-12e6f629705c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142395 Oct 11 19:44:14.007607 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 295/610] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:14.024520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-04660248-82e5-4566-adfa-35d75e009acf tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:14.027531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-04660248-82e5-4566-adfa-35d75e009acf tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:14.047944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04660248-82e5-4566-adfa-35d75e009acf tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:14.052775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04660248-82e5-4566-adfa-35d75e009acf tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:14.053306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04660248-82e5-4566-adfa-35d75e009acf tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:14.054394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04660248-82e5-4566-adfa-35d75e009acf tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:14.054929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04660248-82e5-4566-adfa-35d75e009acf tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:14.055358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04660248-82e5-4566-adfa-35d75e009acf tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:14.058478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:15.220958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e33a206a-efb2-43e1-9a0e-67dd7f453a79 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:15.242367 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e33a206a-efb2-43e1-9a0e-67dd7f453a79 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1585 microversion: 2.1 time: 1.460705 Oct 11 19:44:15.243382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-04660248-82e5-4566-adfa-35d75e009acf tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:15.252113 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-04660248-82e5-4566-adfa-35d75e009acf tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1318 microversion: 2.1 time: 1.241583 Oct 11 19:44:15.259321 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 296/611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:14 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1318 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:15.262161 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 316/612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:13 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1585 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:15.264853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3f7739a0-dea6-4806-82d2-a3ac86b866bf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:15.265468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3f7739a0-dea6-4806-82d2-a3ac86b866bf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:15.286133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f7739a0-dea6-4806-82d2-a3ac86b866bf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:15.286851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f7739a0-dea6-4806-82d2-a3ac86b866bf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:15.287304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f7739a0-dea6-4806-82d2-a3ac86b866bf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:15.288042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f7739a0-dea6-4806-82d2-a3ac86b866bf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:15.288165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-60626a4b-93a7-436e-bd6a-39b891c2b787 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:15.288554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f7739a0-dea6-4806-82d2-a3ac86b866bf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:15.288860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-60626a4b-93a7-436e-bd6a-39b891c2b787 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:15.289094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f7739a0-dea6-4806-82d2-a3ac86b866bf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:15.295853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60626a4b-93a7-436e-bd6a-39b891c2b787 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:15.296179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60626a4b-93a7-436e-bd6a-39b891c2b787 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:15.296623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60626a4b-93a7-436e-bd6a-39b891c2b787 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:15.297695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60626a4b-93a7-436e-bd6a-39b891c2b787 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:15.298159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60626a4b-93a7-436e-bd6a-39b891c2b787 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:15.299289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60626a4b-93a7-436e-bd6a-39b891c2b787 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:15.921254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-60626a4b-93a7-436e-bd6a-39b891c2b787 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:15.922348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3f7739a0-dea6-4806-82d2-a3ac86b866bf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:15.956037 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-60626a4b-93a7-436e-bd6a-39b891c2b787 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1504 microversion: 2.1 time: 0.691442 Oct 11 19:44:15.956684 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3f7739a0-dea6-4806-82d2-a3ac86b866bf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1317 microversion: 2.1 time: 0.694445 Oct 11 19:44:15.959615 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 317/613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:15 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1504 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:15.961192 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 297/614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:15 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:15.975129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6db1ef8d-d067-4a99-8741-df30aadba7eb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:15.976832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d91ec6fe-863c-4010-894d-91b87926530e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:15.977454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6db1ef8d-d067-4a99-8741-df30aadba7eb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:15.979061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d91ec6fe-863c-4010-894d-91b87926530e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:15.997232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91ec6fe-863c-4010-894d-91b87926530e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:15.997537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1ef8d-d067-4a99-8741-df30aadba7eb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:15.998227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1ef8d-d067-4a99-8741-df30aadba7eb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:15.999462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1ef8d-d067-4a99-8741-df30aadba7eb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:16.000390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1ef8d-d067-4a99-8741-df30aadba7eb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:16.001009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1ef8d-d067-4a99-8741-df30aadba7eb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:16.001393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91ec6fe-863c-4010-894d-91b87926530e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:16.001821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1ef8d-d067-4a99-8741-df30aadba7eb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:16.008323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91ec6fe-863c-4010-894d-91b87926530e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:16.009248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91ec6fe-863c-4010-894d-91b87926530e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:16.009824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91ec6fe-863c-4010-894d-91b87926530e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:16.010325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91ec6fe-863c-4010-894d-91b87926530e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:16.285461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:16.476641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d91ec6fe-863c-4010-894d-91b87926530e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:16.502396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6db1ef8d-d067-4a99-8741-df30aadba7eb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:16.509053 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d91ec6fe-863c-4010-894d-91b87926530e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1325 microversion: 2.1 time: 0.545693 Oct 11 19:44:16.512101 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6db1ef8d-d067-4a99-8741-df30aadba7eb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.549194 Oct 11 19:44:16.512397 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 318/615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:15 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:16.513174 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 298/616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:15 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:16.520017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fde333ce-65bb-4473-a901-50e57064be03 req-17b297e7-18e9-45f7-b47c-423dcaf1dbec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f96af3c9-b2ae-4568-9aad-268b2595cf5f", "tag": "3ce1b418-c559-46e6-97d6-9f0890b9bfac"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:16.527638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e6e9060c-313a-4ef9-96c9-1285de7a3087 req-539b50fc-c994-480a-8819-0786031a518c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbe5ea6-515a-45e2-9d56-2dae509d87ab", "name": "network-vif-plugged", "status": "completed", "tag": "c7d714c2-cbed-4ffc-8bac-481c12889743"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:16.547554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fde333ce-65bb-4473-a901-50e57064be03 req-17b297e7-18e9-45f7-b47c-423dcaf1dbec service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:16.548455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fde333ce-65bb-4473-a901-50e57064be03 req-17b297e7-18e9-45f7-b47c-423dcaf1dbec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:16.553043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fde333ce-65bb-4473-a901-50e57064be03 req-17b297e7-18e9-45f7-b47c-423dcaf1dbec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:16.563025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e6e9060c-313a-4ef9-96c9-1285de7a3087 req-539b50fc-c994-480a-8819-0786031a518c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:16.563566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e6e9060c-313a-4ef9-96c9-1285de7a3087 req-539b50fc-c994-480a-8819-0786031a518c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:16.563989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e6e9060c-313a-4ef9-96c9-1285de7a3087 req-539b50fc-c994-480a-8819-0786031a518c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:16.568111 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fde333ce-65bb-4473-a901-50e57064be03 req-17b297e7-18e9-45f7-b47c-423dcaf1dbec service nova] Creating event network-changed:3ce1b418-c559-46e6-97d6-9f0890b9bfac for instance f96af3c9-b2ae-4568-9aad-268b2595cf5f on n-h2-860864-3 Oct 11 19:44:16.573788 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fde333ce-65bb-4473-a901-50e57064be03 req-17b297e7-18e9-45f7-b47c-423dcaf1dbec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059164 Oct 11 19:44:16.576040 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 299/617] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:16.582775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87d53227-82e2-4c2a-824c-2c1399193c23 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:16.583763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-87d53227-82e2-4c2a-824c-2c1399193c23 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:16.591721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87d53227-82e2-4c2a-824c-2c1399193c23 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:16.591950 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e6e9060c-313a-4ef9-96c9-1285de7a3087 req-539b50fc-c994-480a-8819-0786031a518c service nova] Creating event network-vif-plugged:c7d714c2-cbed-4ffc-8bac-481c12889743 for instance ccbe5ea6-515a-45e2-9d56-2dae509d87ab on n-h2-860864-3 Oct 11 19:44:16.592690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87d53227-82e2-4c2a-824c-2c1399193c23 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:16.593290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87d53227-82e2-4c2a-824c-2c1399193c23 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:16.594303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87d53227-82e2-4c2a-824c-2c1399193c23 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:16.595087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87d53227-82e2-4c2a-824c-2c1399193c23 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:16.595668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87d53227-82e2-4c2a-824c-2c1399193c23 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:16.599555 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e6e9060c-313a-4ef9-96c9-1285de7a3087 req-539b50fc-c994-480a-8819-0786031a518c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083832 Oct 11 19:44:16.605875 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 319/618] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:16.762925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-87d53227-82e2-4c2a-824c-2c1399193c23 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:16.773978 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87d53227-82e2-4c2a-824c-2c1399193c23 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1318 microversion: 2.1 time: 0.196349 Oct 11 19:44:16.775843 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 300/619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:16 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:16.987455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-13747266-413c-4838-91eb-8452971124a4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:16.988712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-13747266-413c-4838-91eb-8452971124a4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:16.995966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b99a146-8a5d-4fd9-9090-352625a55fee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:16.996663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0b99a146-8a5d-4fd9-9090-352625a55fee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:16.998391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13747266-413c-4838-91eb-8452971124a4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:16.999110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13747266-413c-4838-91eb-8452971124a4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:16.999710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13747266-413c-4838-91eb-8452971124a4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:17.000953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13747266-413c-4838-91eb-8452971124a4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:17.001908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13747266-413c-4838-91eb-8452971124a4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:17.002791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13747266-413c-4838-91eb-8452971124a4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:17.009749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b99a146-8a5d-4fd9-9090-352625a55fee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:17.010338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b99a146-8a5d-4fd9-9090-352625a55fee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:17.010872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b99a146-8a5d-4fd9-9090-352625a55fee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:17.011650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b99a146-8a5d-4fd9-9090-352625a55fee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:17.012325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b99a146-8a5d-4fd9-9090-352625a55fee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:17.013115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b99a146-8a5d-4fd9-9090-352625a55fee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:17.257543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-13747266-413c-4838-91eb-8452971124a4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:17.271173 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-13747266-413c-4838-91eb-8452971124a4 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1317 microversion: 2.1 time: 0.288001 Oct 11 19:44:17.272196 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 320/620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:16 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:17.287943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0b99a146-8a5d-4fd9-9090-352625a55fee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:17.300129 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b99a146-8a5d-4fd9-9090-352625a55fee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1504 microversion: 2.1 time: 0.308247 Oct 11 19:44:17.302581 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 301/621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:16 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:17.553667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-48000700-8c64-49dc-bf27-100e862dd0cc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:17.554640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d99f29b4-6b94-4bd6-903e-810c4753ee30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:17.555671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-48000700-8c64-49dc-bf27-100e862dd0cc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:17.556431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d99f29b4-6b94-4bd6-903e-810c4753ee30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:17.576677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48000700-8c64-49dc-bf27-100e862dd0cc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:17.579268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d99f29b4-6b94-4bd6-903e-810c4753ee30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:17.581643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d99f29b4-6b94-4bd6-903e-810c4753ee30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:17.582403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48000700-8c64-49dc-bf27-100e862dd0cc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:17.583155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d99f29b4-6b94-4bd6-903e-810c4753ee30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:17.583723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48000700-8c64-49dc-bf27-100e862dd0cc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:17.585022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48000700-8c64-49dc-bf27-100e862dd0cc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:17.585537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d99f29b4-6b94-4bd6-903e-810c4753ee30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:17.586709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48000700-8c64-49dc-bf27-100e862dd0cc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:17.587134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d99f29b4-6b94-4bd6-903e-810c4753ee30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:17.588461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48000700-8c64-49dc-bf27-100e862dd0cc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:17.589732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d99f29b4-6b94-4bd6-903e-810c4753ee30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:17.909494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:17.944710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=14 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:18.167029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-48000700-8c64-49dc-bf27-100e862dd0cc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:18.181644 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-48000700-8c64-49dc-bf27-100e862dd0cc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1325 microversion: 2.1 time: 0.639908 Oct 11 19:44:18.187204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d99f29b4-6b94-4bd6-903e-810c4753ee30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:18.187440 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 321/622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:17 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1325 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:18.194133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b1f47aae-5037-4ee0-9060-370beba1265b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:18.195154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b1f47aae-5037-4ee0-9060-370beba1265b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:18.200282 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d99f29b4-6b94-4bd6-903e-810c4753ee30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.655149 Oct 11 19:44:18.203274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1f47aae-5037-4ee0-9060-370beba1265b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:18.204197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1f47aae-5037-4ee0-9060-370beba1265b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:18.204889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1f47aae-5037-4ee0-9060-370beba1265b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:18.205953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1f47aae-5037-4ee0-9060-370beba1265b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:18.206512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1f47aae-5037-4ee0-9060-370beba1265b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:18.208233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b1f47aae-5037-4ee0-9060-370beba1265b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:18.211455 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 302/623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:17 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:18.298809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7b35c904-4e27-4091-84c3-b0c3d3a7a212 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:18.300055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7b35c904-4e27-4091-84c3-b0c3d3a7a212 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:18.317043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b35c904-4e27-4091-84c3-b0c3d3a7a212 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:18.317761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b35c904-4e27-4091-84c3-b0c3d3a7a212 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:18.318362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b35c904-4e27-4091-84c3-b0c3d3a7a212 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:18.319261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b35c904-4e27-4091-84c3-b0c3d3a7a212 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:18.319879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b35c904-4e27-4091-84c3-b0c3d3a7a212 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:18.320302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b35c904-4e27-4091-84c3-b0c3d3a7a212 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:18.456654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b1f47aae-5037-4ee0-9060-370beba1265b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:18.461098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:18.466048 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b1f47aae-5037-4ee0-9060-370beba1265b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1318 microversion: 2.1 time: 0.277315 Oct 11 19:44:18.466654 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 322/624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:18 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:18.478726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c592539a-3005-4086-a9b5-3c98abb7e5de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:18.481899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c592539a-3005-4086-a9b5-3c98abb7e5de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:18.490063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c592539a-3005-4086-a9b5-3c98abb7e5de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:18.490656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c592539a-3005-4086-a9b5-3c98abb7e5de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:18.491206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c592539a-3005-4086-a9b5-3c98abb7e5de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:18.492168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c592539a-3005-4086-a9b5-3c98abb7e5de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:18.492722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c592539a-3005-4086-a9b5-3c98abb7e5de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:18.493265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c592539a-3005-4086-a9b5-3c98abb7e5de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:18.699434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7b35c904-4e27-4091-84c3-b0c3d3a7a212 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:18.725073 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7b35c904-4e27-4091-84c3-b0c3d3a7a212 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1317 microversion: 2.1 time: 0.430088 Oct 11 19:44:18.729610 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 303/625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:18 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:18.856468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c592539a-3005-4086-a9b5-3c98abb7e5de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:18.871766 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c592539a-3005-4086-a9b5-3c98abb7e5de tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1504 microversion: 2.1 time: 0.397097 Oct 11 19:44:18.874611 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 323/626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:18 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:18.880344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c9addec3-f9d4-4bb3-8844-e22bdca5eba7 req-f28f4d5d-2f16-4ad0-ab76-3ae5b5b92f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36452fd4-4ace-49b4-89b3-4872701681d6", "name": "network-vif-plugged", "status": "completed", "tag": "b8c5011d-0676-464c-bd00-7980511354e5"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:18.891942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c9addec3-f9d4-4bb3-8844-e22bdca5eba7 req-f28f4d5d-2f16-4ad0-ab76-3ae5b5b92f48 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:18.892729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c9addec3-f9d4-4bb3-8844-e22bdca5eba7 req-f28f4d5d-2f16-4ad0-ab76-3ae5b5b92f48 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:18.893396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c9addec3-f9d4-4bb3-8844-e22bdca5eba7 req-f28f4d5d-2f16-4ad0-ab76-3ae5b5b92f48 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:18.910273 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c9addec3-f9d4-4bb3-8844-e22bdca5eba7 req-f28f4d5d-2f16-4ad0-ab76-3ae5b5b92f48 service nova] Creating event network-vif-plugged:b8c5011d-0676-464c-bd00-7980511354e5 for instance 36452fd4-4ace-49b4-89b3-4872701681d6 on n-h1-860864-3 Oct 11 19:44:18.918499 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c9addec3-f9d4-4bb3-8844-e22bdca5eba7 req-f28f4d5d-2f16-4ad0-ab76-3ae5b5b92f48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042069 Oct 11 19:44:18.920062 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 324/627] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:18.943930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-faa3480f-bed2-46dc-b4a8-1774db9ef26f req-f9c6043c-613b-48e7-bf89-c7acde08bd4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dea9975-b38a-465e-a181-454a20b0ae00", "name": "network-vif-unplugged", "status": "completed", "tag": "44663329-774c-463a-a864-c1e0c979ab76"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:18.951762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3934df79-4fd8-4490-95db-11a075ad712e tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Calling method '.version_select at 0x7f83cc9f2700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:18.960465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3934df79-4fd8-4490-95db-11a075ad712e tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:18.966317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3934df79-4fd8-4490-95db-11a075ad712e tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:18.969143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3934df79-4fd8-4490-95db-11a075ad712e tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:18.972975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3934df79-4fd8-4490-95db-11a075ad712e tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:18.974817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3934df79-4fd8-4490-95db-11a075ad712e tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:18.976977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3934df79-4fd8-4490-95db-11a075ad712e tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.007512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-faa3480f-bed2-46dc-b4a8-1774db9ef26f req-f9c6043c-613b-48e7-bf89-c7acde08bd4c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.008385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-faa3480f-bed2-46dc-b4a8-1774db9ef26f req-f9c6043c-613b-48e7-bf89-c7acde08bd4c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.011860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-faa3480f-bed2-46dc-b4a8-1774db9ef26f req-f9c6043c-613b-48e7-bf89-c7acde08bd4c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.040067 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-faa3480f-bed2-46dc-b4a8-1774db9ef26f req-f9c6043c-613b-48e7-bf89-c7acde08bd4c service nova] Creating event network-vif-unplugged:44663329-774c-463a-a864-c1e0c979ab76 for instance 7dea9975-b38a-465e-a181-454a20b0ae00 on n-h1-860864-3 Oct 11 19:44:19.049875 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-faa3480f-bed2-46dc-b4a8-1774db9ef26f req-f9c6043c-613b-48e7-bf89-c7acde08bd4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128030 Oct 11 19:44:19.057243 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3934df79-4fd8-4490-95db-11a075ad712e tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.326066 Oct 11 19:44:19.058680 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 325/628] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:19.059514 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 304/629] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 11 19:44:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:19.214992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-669fb1f0-8f90-475e-bf8c-c7132e314133 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.216062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-669fb1f0-8f90-475e-bf8c-c7132e314133 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:19.232620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669fb1f0-8f90-475e-bf8c-c7132e314133 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.233579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669fb1f0-8f90-475e-bf8c-c7132e314133 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.233579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669fb1f0-8f90-475e-bf8c-c7132e314133 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.234263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669fb1f0-8f90-475e-bf8c-c7132e314133 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.234758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669fb1f0-8f90-475e-bf8c-c7132e314133 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.235193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669fb1f0-8f90-475e-bf8c-c7132e314133 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.325878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2397bfe6-127b-4acd-b869-1b2f6c0e7bcd tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Calling method '.version_select at 0x7f83cc9d9e50>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.332172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2397bfe6-127b-4acd-b869-1b2f6c0e7bcd tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '7775c30a64f0492a9d34be879043fb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23bee778ee3f4b78b0bead02a2e29244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2397bfe6-127b-4acd-b869-1b2f6c0e7bcd tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Request method failure captured: Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceRub2wlle3VSTPglAvmEJPi0YMLbyiRXwJYUYD5UN2es4rh_qcYfIM-bWmzo5sY1jo-pzn4gyNOVxm93Om-s--kfOpvkwNqrMnFPOuTH0RG6hJnk5dYGeW-SEEKA9JAjEVuS4IMSq3kk7pXfI2fGGWfh8Drv3Y9iaQBZHA8Xhtrbs Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:44:19.334553 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23bee778ee3f4b78b0bead02a2e29244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}] Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7775c30a64f0492a9d34be879043fb09 Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: action_args: {} Oct 11 19:44:19.336152 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:44:19.337044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 19:44:19.338200 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.339331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2397bfe6-127b-4acd-b869-1b2f6c0e7bcd tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:19.339331 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2397bfe6-127b-4acd-b869-1b2f6c0e7bcd tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.270026 Oct 11 19:44:19.339331 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 326/630] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:44:19.354145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1b56efe0-9b45-4c4c-a009-9258474cd2a1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.355002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1b56efe0-9b45-4c4c-a009-9258474cd2a1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:19.369851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b56efe0-9b45-4c4c-a009-9258474cd2a1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.370453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b56efe0-9b45-4c4c-a009-9258474cd2a1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.370999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b56efe0-9b45-4c4c-a009-9258474cd2a1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.371818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b56efe0-9b45-4c4c-a009-9258474cd2a1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.372340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b56efe0-9b45-4c4c-a009-9258474cd2a1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.372828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b56efe0-9b45-4c4c-a009-9258474cd2a1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.417095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-669fb1f0-8f90-475e-bf8c-c7132e314133 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:19.426962 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-669fb1f0-8f90-475e-bf8c-c7132e314133 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1325 microversion: 2.1 time: 0.217843 Oct 11 19:44:19.427880 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 305/631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:19.433309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2a51761f-0081-4c41-81bc-14112b841bdb tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Calling method '.version_select at 0x7f83cca94b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.448464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2a51761f-0081-4c41-81bc-14112b841bdb tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '7775c30a64f0492a9d34be879043fb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23bee778ee3f4b78b0bead02a2e29244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2a51761f-0081-4c41-81bc-14112b841bdb tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Request method failure captured: Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-hosts/n-d-860864-3/reboot HTTP/1.1 Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRceRub2wlle3VSTPglAvmEJPi0YMLbyiRXwJYUYD5UN2es4rh_qcYfIM-bWmzo5sY1jo-pzn4gyNOVxm93Om-s--kfOpvkwNqrMnFPOuTH0RG6hJnk5dYGeW-SEEKA9JAjEVuS4IMSq3kk7pXfI2fGGWfh8Drv3Y9iaQBZHA8Xhtrbs Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:44:19.451777 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23bee778ee3f4b78b0bead02a2e29244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}] Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 7775c30a64f0492a9d34be879043fb09 Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'n-d-860864-3'} Oct 11 19:44:19.453458 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:44:19.454721 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 19:44:19.456346 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.458269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2a51761f-0081-4c41-81bc-14112b841bdb tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:19.458269 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2a51761f-0081-4c41-81bc-14112b841bdb tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-860864-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.024378 Oct 11 19:44:19.458269 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 306/632] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/os-hosts/n-d-860864-3/reboot => generated 111 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:44:19.470949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-95f3bb9b-f53f-47cb-b9f0-40c97806d432 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Calling method '.version_select at 0x7f83cca01d30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.487077 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-95f3bb9b-f53f-47cb-b9f0-40c97806d432 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-95f3bb9b-f53f-47cb-b9f0-40c97806d432 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Request method failure captured: Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRceSH1VzfMAyNJcuHBqgyuAVPouH-spjNuFTZi_LIGDH7jyA-ojWaBLjSYIwULO664_338amrs-Pgr_D5xUwJRfcfu7PXxugndP9FM1Ftp8rHcdKEy1OEoviKmw3B6nJNCDn0ECl8CA_9I_tnvsTAKDRVZir5NJva_IaNoG7qvG9_eQ Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:44:19.491127 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b985e7e2e61444e8066a3dc5f46530d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}] Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e1afb67880814b8d85f413b435d30b05 Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'nonexistent_hostname'} Oct 11 19:44:19.492418 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:44:19.493220 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 19:44:19.494311 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.495556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.500168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-95f3bb9b-f53f-47cb-b9f0-40c97806d432 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:19.501269 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-95f3bb9b-f53f-47cb-b9f0-40c97806d432 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.034140 Oct 11 19:44:19.502198 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 307/633] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:44:19.511001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7d46dc0f-5027-468d-b751-b9f5b19df0c9 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.511960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d46dc0f-5027-468d-b751-b9f5b19df0c9 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:19.519982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d46dc0f-5027-468d-b751-b9f5b19df0c9 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.520822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d46dc0f-5027-468d-b751-b9f5b19df0c9 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.521479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d46dc0f-5027-468d-b751-b9f5b19df0c9 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.522714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d46dc0f-5027-468d-b751-b9f5b19df0c9 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.523722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d46dc0f-5027-468d-b751-b9f5b19df0c9 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.524363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d46dc0f-5027-468d-b751-b9f5b19df0c9 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.638377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b56efe0-9b45-4c4c-a009-9258474cd2a1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:19.655453 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1b56efe0-9b45-4c4c-a009-9258474cd2a1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.310876 Oct 11 19:44:19.656032 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 327/634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:19.667304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-128d1f41-aff9-415f-9f76-b9574172b110 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Calling method '.version_select at 0x7f83cc991790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.669074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-128d1f41-aff9-415f-9f76-b9574172b110 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '7775c30a64f0492a9d34be879043fb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23bee778ee3f4b78b0bead02a2e29244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-128d1f41-aff9-415f-9f76-b9574172b110 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Request method failure captured: Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-hosts/n-d-860864-3 HTTP/1.1 Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceRub2wlle3VSTPglAvmEJPi0YMLbyiRXwJYUYD5UN2es4rh_qcYfIM-bWmzo5sY1jo-pzn4gyNOVxm93Om-s--kfOpvkwNqrMnFPOuTH0RG6hJnk5dYGeW-SEEKA9JAjEVuS4IMSq3kk7pXfI2fGGWfh8Drv3Y9iaQBZHA8Xhtrbs Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:44:19.670680 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23bee778ee3f4b78b0bead02a2e29244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}] Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7775c30a64f0492a9d34be879043fb09 Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'n-d-860864-3'} Oct 11 19:44:19.671968 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:44:19.672712 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 19:44:19.673834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.678937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-128d1f41-aff9-415f-9f76-b9574172b110 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:19.678937 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-128d1f41-aff9-415f-9f76-b9574172b110 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-860864-3" status: 403 len: 109 microversion: 2.1 time: 0.013943 Oct 11 19:44:19.678937 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 328/635] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/os-hosts/n-d-860864-3 => generated 109 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:44:19.687386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e338d7c4-6d46-4fc1-93bb-74748f656583 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Calling method '.version_select at 0x7f83ccde83a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.700183 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e338d7c4-6d46-4fc1-93bb-74748f656583 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e338d7c4-6d46-4fc1-93bb-74748f656583 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Request method failure captured: Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceSH1VzfMAyNJcuHBqgyuAVPouH-spjNuFTZi_LIGDH7jyA-ojWaBLjSYIwULO664_338amrs-Pgr_D5xUwJRfcfu7PXxugndP9FM1Ftp8rHcdKEy1OEoviKmw3B6nJNCDn0ECl8CA_9I_tnvsTAKDRVZir5NJva_IaNoG7qvG9_eQ Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:44:19.701760 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b985e7e2e61444e8066a3dc5f46530d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}] Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e1afb67880814b8d85f413b435d30b05 Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'nonexistent_hostname'} Oct 11 19:44:19.703106 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.703829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.704877 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.708990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e338d7c4-6d46-4fc1-93bb-74748f656583 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:19.708990 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e338d7c4-6d46-4fc1-93bb-74748f656583 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.021685 Oct 11 19:44:19.708990 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 329/636] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:44:19.717200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a4bbfa9-9de1-4b5d-964d-b3b7e970e244 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Calling method '.version_select at 0x7f83ccde8550>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.719620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8a4bbfa9-9de1-4b5d-964d-b3b7e970e244 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '7775c30a64f0492a9d34be879043fb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23bee778ee3f4b78b0bead02a2e29244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a4bbfa9-9de1-4b5d-964d-b3b7e970e244 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Request method failure captured: Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-hosts/n-d-860864-3/shutdown HTTP/1.1 Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceRub2wlle3VSTPglAvmEJPi0YMLbyiRXwJYUYD5UN2es4rh_qcYfIM-bWmzo5sY1jo-pzn4gyNOVxm93Om-s--kfOpvkwNqrMnFPOuTH0RG6hJnk5dYGeW-SEEKA9JAjEVuS4IMSq3kk7pXfI2fGGWfh8Drv3Y9iaQBZHA8Xhtrbs Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:44:19.721637 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23bee778ee3f4b78b0bead02a2e29244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}] Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7775c30a64f0492a9d34be879043fb09 Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'n-d-860864-3'} Oct 11 19:44:19.724568 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:44:19.725332 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 19:44:19.726485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.728710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a4bbfa9-9de1-4b5d-964d-b3b7e970e244 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:19.728710 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a4bbfa9-9de1-4b5d-964d-b3b7e970e244 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-860864-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.012022 Oct 11 19:44:19.728710 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 330/637] 10.222.0.27 () {58 vars in 1194 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/os-hosts/n-d-860864-3/shutdown => generated 113 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:44:19.734603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-85e288b2-f957-417d-b9d1-5aadf2ad7ef8 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Calling method '.version_select at 0x7f83ccd834c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.745306 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-85e288b2-f957-417d-b9d1-5aadf2ad7ef8 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-85e288b2-f957-417d-b9d1-5aadf2ad7ef8 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Request method failure captured: Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceSH1VzfMAyNJcuHBqgyuAVPouH-spjNuFTZi_LIGDH7jyA-ojWaBLjSYIwULO664_338amrs-Pgr_D5xUwJRfcfu7PXxugndP9FM1Ftp8rHcdKEy1OEoviKmw3B6nJNCDn0ECl8CA_9I_tnvsTAKDRVZir5NJva_IaNoG7qvG9_eQ Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:44:19.748753 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b985e7e2e61444e8066a3dc5f46530d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}] Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e1afb67880814b8d85f413b435d30b05 Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'nonexistent_hostname'} Oct 11 19:44:19.750029 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:44:19.751037 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 19:44:19.752075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-85e288b2-f957-417d-b9d1-5aadf2ad7ef8 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:19.753153 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-85e288b2-f957-417d-b9d1-5aadf2ad7ef8 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.019205 Oct 11 19:44:19.754963 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 331/638] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:44:19.761773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9e57a54-af55-4e01-b97e-5d97d4ba9010 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.762646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b9e57a54-af55-4e01-b97e-5d97d4ba9010 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:19.771226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e57a54-af55-4e01-b97e-5d97d4ba9010 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.771713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7d46dc0f-5027-468d-b751-b9f5b19df0c9 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:19.772130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e57a54-af55-4e01-b97e-5d97d4ba9010 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.773232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e57a54-af55-4e01-b97e-5d97d4ba9010 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.774396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e57a54-af55-4e01-b97e-5d97d4ba9010 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.775256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e57a54-af55-4e01-b97e-5d97d4ba9010 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.775830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e57a54-af55-4e01-b97e-5d97d4ba9010 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.780002 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7d46dc0f-5027-468d-b751-b9f5b19df0c9 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1468 microversion: 2.1 time: 0.276520 Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 308/639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1468 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b016aef5-4b5e-4aa5-9ddd-5cbbb98a8c49 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Calling method '.version_select at 0x7f83cca01b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b016aef5-4b5e-4aa5-9ddd-5cbbb98a8c49 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '7775c30a64f0492a9d34be879043fb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23bee778ee3f4b78b0bead02a2e29244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b016aef5-4b5e-4aa5-9ddd-5cbbb98a8c49 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Request method failure captured: Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-hosts/n-d-860864-3/startup HTTP/1.1 Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:44:19.794425 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRceRub2wlle3VSTPglAvmEJPi0YMLbyiRXwJYUYD5UN2es4rh_qcYfIM-bWmzo5sY1jo-pzn4gyNOVxm93Om-s--kfOpvkwNqrMnFPOuTH0RG6hJnk5dYGeW-SEEKA9JAjEVuS4IMSq3kk7pXfI2fGGWfh8Drv3Y9iaQBZHA8Xhtrbs Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23bee778ee3f4b78b0bead02a2e29244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}] Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:19.795373 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 7775c30a64f0492a9d34be879043fb09 Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'n-d-860864-3'} Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:44:19.796274 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:44:19.798056 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:44:19.805548 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 19:44:19.805548 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.805548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b016aef5-4b5e-4aa5-9ddd-5cbbb98a8c49 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:19.805548 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b016aef5-4b5e-4aa5-9ddd-5cbbb98a8c49 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-860864-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.008786 Oct 11 19:44:19.805548 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 309/640] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/os-hosts/n-d-860864-3/startup => generated 110 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:44:19.805548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ed467801-b587-47d1-927d-7840df9ae0d9 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Calling method '.version_select at 0x7f83cca99ee0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:19.812148 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-ed467801-b587-47d1-927d-7840df9ae0d9 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ed467801-b587-47d1-927d-7840df9ae0d9 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Request method failure captured: Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRceSH1VzfMAyNJcuHBqgyuAVPouH-spjNuFTZi_LIGDH7jyA-ojWaBLjSYIwULO664_338amrs-Pgr_D5xUwJRfcfu7PXxugndP9FM1Ftp8rHcdKEy1OEoviKmw3B6nJNCDn0ECl8CA_9I_tnvsTAKDRVZir5NJva_IaNoG7qvG9_eQ Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:44:19.813873 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b985e7e2e61444e8066a3dc5f46530d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}] Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e1afb67880814b8d85f413b435d30b05 Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'nonexistent_hostname'} Oct 11 19:44:19.815183 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:44:19.816750 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 19:44:19.819302 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ed467801-b587-47d1-927d-7840df9ae0d9 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ed467801-b587-47d1-927d-7840df9ae0d9 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.018332 Oct 11 19:44:19.822043 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 310/641] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:44:19.953047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b9e57a54-af55-4e01-b97e-5d97d4ba9010 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:19.963840 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b9e57a54-af55-4e01-b97e-5d97d4ba9010 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1317 microversion: 2.1 time: 0.207143 Oct 11 19:44:19.964429 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 332/642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:19 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:19.968622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1634370194", "block_migration": true, "disk_over_commit": false}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:19.969695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53a31774-0c5d-4b7a-80d5-151152d21ba3 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc879670>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:19.971273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53a31774-0c5d-4b7a-80d5-151152d21ba3 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Request method failure captured: Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: request: PUT /compute/v2.1/os-hosts/n-d-860864-3 HTTP/1.1 Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 51 Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceSH1VzfMAyNJcuHBqgyuAVPouH-spjNuFTZi_LIGDH7jyA-ojWaBLjSYIwULO664_338amrs-Pgr_D5xUwJRfcfu7PXxugndP9FM1Ftp8rHcdKEy1OEoviKmw3B6nJNCDn0ECl8CA_9I_tnvsTAKDRVZir5NJva_IaNoG7qvG9_eQ Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:44:19.975211 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b985e7e2e61444e8066a3dc5f46530d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}] Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e1afb67880814b8d85f413b435d30b05 Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: {"status": "enable", "maintenance_mode": "invalid"} Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:44:19.976592 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'n-d-860864-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance: Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.977355 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:19.978855 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:19.979965 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:19.979965 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:44:19.979965 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:44:19.979965 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 19:44:19.979965 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:19.980272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.980272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.980272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.980927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:19.981449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:19.981854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53a31774-0c5d-4b7a-80d5-151152d21ba3 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:19.982001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:19.983270 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-53a31774-0c5d-4b7a-80d5-151152d21ba3 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-860864-3" status: 400 len: 199 microversion: 2.1 time: 0.017424 Oct 11 19:44:19.983971 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 333/643] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 19:44:19 2022] PUT /compute/v2.1/os-hosts/n-d-860864-3 => generated 199 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:44:20.013123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lazy-loading 'flavor' on Instance uuid ccbe5ea6-515a-45e2-9d56-2dae509d87ab {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:20.026099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Going to try to live migrate instance to tempest-host-1634370194 {{(pid=126956) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 19:44:20.033207 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] HTTP exception thrown: Compute host tempest-host-1634370194 could not be found. Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Request method failure captured: Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab/action HTTP/1.1 Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 107 Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcd93CB7IPSgz6uB7RZC1AFDcZHOo43TX_hQNQpA_TmQil7T5j1MvuAyMOsXFRCSD0jyzHwCyn4riFSR29nl8R2RvdEv_TX1-czIe7tpws-NYVCTHPOz_WCFkpofJjYqZJaeTERyrIq063kgO3YIaMT84a_FamqVm25evPncLPEc_ow Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 525e861c8de141f0b285204354f3b4b2 Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-LiveMigrationNegativeTest-1254531373 Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:44:20.037491 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/525e861c8de141f0b285204354f3b4b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_525e861c8de141f0b285204354f3b4b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/525e861c8de141f0b285204354f3b4b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/525e861c8de141f0b285204354f3b4b2"}]}] Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-LiveMigrationNegativeTest-1254531373 Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 525e861c8de141f0b285204354f3b4b2 Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1254531373 Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-LiveMigrationNegativeTest-1254531373-project-admin Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e4929f6109af4b1888fb6a28d71f1d0c Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-LiveMigrationNegativeTest-1254531373-project-admin Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: {"os-migrateLive": {"host": "tempest-host-1634370194", "block_migration": true, "disk_over_commit": false}} Oct 11 19:44:20.038832 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: exception: Compute host tempest-host-1634370194 could not be found. Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ccbe5ea6-515a-45e2-9d56-2dae509d87ab', 'body': {'os-migrateLive': {'host': 'tempest-host-1634370194', 'block_migration': True, 'disk_over_commit': False}}} Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:44:20.039600 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1634370194 could not be found. Oct 11 19:44:20.040676 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1634370194 could not be found. Oct 11 19:44:20.041787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1634370194 could not be found. Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Returning 400 to user: Compute host tempest-host-1634370194 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-08046af4-3044-402d-9bc1-568f45ff8daf tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab/action" status: 400 len: 100 microversion: 2.1 time: 0.217673 Oct 11 19:44:20.044813 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 311/644] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Oct 11 19:44:19 2022] POST /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab/action => generated 100 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:44:20.050931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3915b852-d9a4-4f58-bd16-955f1f34d56b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:20.051881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3915b852-d9a4-4f58-bd16-955f1f34d56b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:20.060265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3915b852-d9a4-4f58-bd16-955f1f34d56b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:20.060788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3915b852-d9a4-4f58-bd16-955f1f34d56b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:20.063035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3915b852-d9a4-4f58-bd16-955f1f34d56b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:20.063799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3915b852-d9a4-4f58-bd16-955f1f34d56b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:20.064316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3915b852-d9a4-4f58-bd16-955f1f34d56b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:20.064752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3915b852-d9a4-4f58-bd16-955f1f34d56b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:20.071690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1667283085", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "80479427-085a-4dd2-8698-782034cdbfac"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:20.139635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] validate_networks() for [('80479427-085a-4dd2-8698-782034cdbfac', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:44:20.302344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3915b852-d9a4-4f58-bd16-955f1f34d56b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:20.310352 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3915b852-d9a4-4f58-bd16-955f1f34d56b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1504 microversion: 2.1 time: 0.265326 Oct 11 19:44:20.311143 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 312/645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:20 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:20.315736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb3d92d0-7f0b-40ea-9b03-2b9f460e8268 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Action: 'update', calling method: .version_select at 0x7f83cca8aa60>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb3d92d0-7f0b-40ea-9b03-2b9f460e8268 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Request method failure captured: Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/os-hosts/n-d-860864-3 HTTP/1.1 Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 51 Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRceSH1VzfMAyNJcuHBqgyuAVPouH-spjNuFTZi_LIGDH7jyA-ojWaBLjSYIwULO664_338amrs-Pgr_D5xUwJRfcfu7PXxugndP9FM1Ftp8rHcdKEy1OEoviKmw3B6nJNCDn0ECl8CA_9I_tnvsTAKDRVZir5NJva_IaNoG7qvG9_eQ Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:44:20.319892 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b985e7e2e61444e8066a3dc5f46530d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}] Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e1afb67880814b8d85f413b435d30b05 Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: {"status": "invalid", "maintenance_mode": "enable"} Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:44:20.321189 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'n-d-860864-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance: Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:20.321943 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:20.324049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:20.325104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:20.325104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:44:20.325104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:44:20.325104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 19:44:20.325104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.325104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb3d92d0-7f0b-40ea-9b03-2b9f460e8268 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:20.325104 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bb3d92d0-7f0b-40ea-9b03-2b9f460e8268 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-860864-3" status: 400 len: 189 microversion: 2.1 time: 0.008969 Oct 11 19:44:20.325104 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 313/646] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 19:44:20 2022] PUT /compute/v2.1/os-hosts/n-d-860864-3 => generated 189 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:44:20.329751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ee521d6-0bd1-4b91-b0ae-12cddef08a72 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:20.330376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1ee521d6-0bd1-4b91-b0ae-12cddef08a72 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:20.338431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ee521d6-0bd1-4b91-b0ae-12cddef08a72 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:20.338969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ee521d6-0bd1-4b91-b0ae-12cddef08a72 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:20.339398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ee521d6-0bd1-4b91-b0ae-12cddef08a72 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:20.340092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ee521d6-0bd1-4b91-b0ae-12cddef08a72 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:20.340543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ee521d6-0bd1-4b91-b0ae-12cddef08a72 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:20.340961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ee521d6-0bd1-4b91-b0ae-12cddef08a72 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:20.778208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1ee521d6-0bd1-4b91-b0ae-12cddef08a72 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:20.792540 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1ee521d6-0bd1-4b91-b0ae-12cddef08a72 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1468 microversion: 2.1 time: 0.468625 Oct 11 19:44:20.808518 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 314/647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:20 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1468 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:20.822021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-190a7647-fa91-412f-80fc-7951bfe29343 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Action: 'update', calling method: .version_select at 0x7f83ccba8670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:20.826804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-190a7647-fa91-412f-80fc-7951bfe29343 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '7775c30a64f0492a9d34be879043fb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23bee778ee3f4b78b0bead02a2e29244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-190a7647-fa91-412f-80fc-7951bfe29343 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Request method failure captured: Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/os-hosts/n-d-860864-3 HTTP/1.1 Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 50 Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRceRub2wlle3VSTPglAvmEJPi0YMLbyiRXwJYUYD5UN2es4rh_qcYfIM-bWmzo5sY1jo-pzn4gyNOVxm93Om-s--kfOpvkwNqrMnFPOuTH0RG6hJnk5dYGeW-SEEKA9JAjEVuS4IMSq3kk7pXfI2fGGWfh8Drv3Y9iaQBZHA8Xhtrbs Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:44:20.829026 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23bee778ee3f4b78b0bead02a2e29244", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23bee778ee3f4b78b0bead02a2e29244"}]}] Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 23bee778ee3f4b78b0bead02a2e29244 Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1395686253 Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 7775c30a64f0492a9d34be879043fb09 Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1395686253-project Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: {"status": "enable", "maintenance_mode": "enable"} Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 19:44:20.830331 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'n-d-860864-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:44:20.831492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 19:44:20.833995 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:20.835995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-190a7647-fa91-412f-80fc-7951bfe29343 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:20.835995 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-190a7647-fa91-412f-80fc-7951bfe29343 tempest-HostsAdminNegativeTestJSON-1395686253 tempest-HostsAdminNegativeTestJSON-1395686253-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-860864-3" status: 403 len: 111 microversion: 2.1 time: 0.020899 Oct 11 19:44:20.837684 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 315/648] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 19:44:20 2022] PUT /compute/v2.1/os-hosts/n-d-860864-3 => generated 111 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:44:20.842814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-32184da1-ba6c-459e-87f5-9a914fda5a09 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:20.843516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-32184da1-ba6c-459e-87f5-9a914fda5a09 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:20.851967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32184da1-ba6c-459e-87f5-9a914fda5a09 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:20.852062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32184da1-ba6c-459e-87f5-9a914fda5a09 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:20.852684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32184da1-ba6c-459e-87f5-9a914fda5a09 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:20.853399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32184da1-ba6c-459e-87f5-9a914fda5a09 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:20.853956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32184da1-ba6c-459e-87f5-9a914fda5a09 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:20.854463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32184da1-ba6c-459e-87f5-9a914fda5a09 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:20.960691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:44:20.961190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:44:20.961741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:44:20.962230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:44:20.962756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:44:20.972093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:20.972714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:20.973165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:20.973914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:20.974381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:20.974947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:20.995640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Getting quotas for project 0ac923f5632e40b2bd81aa5de2ed3f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:21.001691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Getting quotas for user 823a414535d04791844ab997869542b2 and project 0ac923f5632e40b2bd81aa5de2ed3f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:21.015919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:44:21.018272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:44:21.022011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-32184da1-ba6c-459e-87f5-9a914fda5a09 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:21.029818 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-32184da1-ba6c-459e-87f5-9a914fda5a09 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1325 microversion: 2.1 time: 0.191035 Oct 11 19:44:21.030706 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 316/649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:20 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1325 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:21.035684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd3e7c10-d340-4e6a-a213-69eef92ffccc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:21.036417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bd3e7c10-d340-4e6a-a213-69eef92ffccc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:21.047957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd3e7c10-d340-4e6a-a213-69eef92ffccc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.048533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd3e7c10-d340-4e6a-a213-69eef92ffccc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.049395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd3e7c10-d340-4e6a-a213-69eef92ffccc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.049814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd3e7c10-d340-4e6a-a213-69eef92ffccc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.050883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd3e7c10-d340-4e6a-a213-69eef92ffccc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.051368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd3e7c10-d340-4e6a-a213-69eef92ffccc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.084534 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dfae2638-5eae-4674-91d2-49ea45c3a6e2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.099100 Oct 11 19:44:21.085191 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 334/650] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:44:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 19:44:21.090217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3bbb36cb-3c9f-4b03-8e3b-1ee7024999b5 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Action: 'update', calling method: .version_select at 0x7f83ccde8040>, body: {"status": null, "maintenance_mode": null} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3bbb36cb-3c9f-4b03-8e3b-1ee7024999b5 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Request method failure captured: Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: request: PUT /compute/v2.1/os-hosts/n-d-860864-3 HTTP/1.1 Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 42 Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceSH1VzfMAyNJcuHBqgyuAVPouH-spjNuFTZi_LIGDH7jyA-ojWaBLjSYIwULO664_338amrs-Pgr_D5xUwJRfcfu7PXxugndP9FM1Ftp8rHcdKEy1OEoviKmw3B6nJNCDn0ECl8CA_9I_tnvsTAKDRVZir5NJva_IaNoG7qvG9_eQ Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:44:21.094780 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b985e7e2e61444e8066a3dc5f46530d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}] Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e1afb67880814b8d85f413b435d30b05 Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: {"status": null, "maintenance_mode": null} Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 19:44:21.096446 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'n-d-860864-3', 'body': {'status': None, 'maintenance_mode': None}} Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance: Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi None Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:21.097503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:21.099156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:21.100526 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:44:21.100526 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:44:21.100526 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 19:44:21.100526 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.101826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3bbb36cb-3c9f-4b03-8e3b-1ee7024999b5 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:21.102883 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3bbb36cb-3c9f-4b03-8e3b-1ee7024999b5 tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-860864-3" status: 400 len: 127 microversion: 2.1 time: 0.016337 Oct 11 19:44:21.109485 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 335/651] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 19:44:21 2022] PUT /compute/v2.1/os-hosts/n-d-860864-3 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:44:21.115448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-807455273", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:21.172848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:44:21.261398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd3e7c10-d340-4e6a-a213-69eef92ffccc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:21.271702 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bd3e7c10-d340-4e6a-a213-69eef92ffccc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.239690 Oct 11 19:44:21.272739 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 317/652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:21 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:21.278172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbd07d9a-6892-4502-b4d6-ffaad326f945 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:21.279009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cbd07d9a-6892-4502-b4d6-ffaad326f945 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:21.295492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbd07d9a-6892-4502-b4d6-ffaad326f945 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.296207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbd07d9a-6892-4502-b4d6-ffaad326f945 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.296931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbd07d9a-6892-4502-b4d6-ffaad326f945 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.298476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbd07d9a-6892-4502-b4d6-ffaad326f945 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.299318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbd07d9a-6892-4502-b4d6-ffaad326f945 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.299907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbd07d9a-6892-4502-b4d6-ffaad326f945 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.486290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:44:21.486759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:44:21.487291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:44:21.488524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:44:21.489278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:44:21.499180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.500093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.500960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.501998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.502786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.504129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.525177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Getting quotas for project 305f047e2a5b43df83b2ae40e448a1ab. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:21.530973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Getting quotas for user 78d551deb3024dc2969b3fc19c3cb42d and project 305f047e2a5b43df83b2ae40e448a1ab. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:21.532105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cbd07d9a-6892-4502-b4d6-ffaad326f945 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:21.542146 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cbd07d9a-6892-4502-b4d6-ffaad326f945 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1467 microversion: 2.1 time: 0.268106 Oct 11 19:44:21.542900 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 318/653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:21 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1467 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:21.568539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0470358-e942-4bf8-bf06-d11af23142a2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:21.569714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d0470358-e942-4bf8-bf06-d11af23142a2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:21.582699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:44:21.584902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:44:21.664935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0470358-e942-4bf8-bf06-d11af23142a2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:21.674985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0470358-e942-4bf8-bf06-d11af23142a2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:21.677507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0470358-e942-4bf8-bf06-d11af23142a2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:21.678031 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a4d442fc-06c5-454c-bfb5-dfd031190c25 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567390 Oct 11 19:44:21.678971 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0470358-e942-4bf8-bf06-d11af23142a2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1262 microversion: 2.25 time: 0.135200 Oct 11 19:44:21.679226 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 336/654] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:44:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:44:21.689737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2294337-7169-452b-924a-871d673071ad tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc8795e0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:21.694114 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 319/655] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:21 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1262 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:21.694958 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.hosts [None req-a2294337-7169-452b-924a-871d673071ad tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Enabling host nonexistent_hostname. Oct 11 19:44:21.701653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a84153f4-0ef5-4711-bd6b-d1cfe3cf03a5 req-eaab1940-3d45-4efc-9b05-4a011df442db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dea9975-b38a-465e-a181-454a20b0ae00", "tag": "44663329-774c-463a-a864-c1e0c979ab76"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:21.709248 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-a2294337-7169-452b-924a-871d673071ad tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2294337-7169-452b-924a-871d673071ad tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Request method failure captured: Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 50 Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceSH1VzfMAyNJcuHBqgyuAVPouH-spjNuFTZi_LIGDH7jyA-ojWaBLjSYIwULO664_338amrs-Pgr_D5xUwJRfcfu7PXxugndP9FM1Ftp8rHcdKEy1OEoviKmw3B6nJNCDn0ECl8CA_9I_tnvsTAKDRVZir5NJva_IaNoG7qvG9_eQ Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:44:21.711709 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b985e7e2e61444e8066a3dc5f46530d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b985e7e2e61444e8066a3dc5f46530d"}]}] Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 6b985e7e2e61444e8066a3dc5f46530d Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-748516178 Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e1afb67880814b8d85f413b435d30b05 Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-HostsAdminNegativeTestJSON-748516178-project-admin Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: {"status": "enable", "maintenance_mode": "enable"} Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:21.713201 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 19:44:21.713984 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:44:21.715102 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 19:44:21.716921 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:21.717881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a84153f4-0ef5-4711-bd6b-d1cfe3cf03a5 req-eaab1940-3d45-4efc-9b05-4a011df442db service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.717881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a84153f4-0ef5-4711-bd6b-d1cfe3cf03a5 req-eaab1940-3d45-4efc-9b05-4a011df442db service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.717881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a84153f4-0ef5-4711-bd6b-d1cfe3cf03a5 req-eaab1940-3d45-4efc-9b05-4a011df442db service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.722051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2294337-7169-452b-924a-871d673071ad tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:21.723281 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a2294337-7169-452b-924a-871d673071ad tempest-HostsAdminNegativeTestJSON-748516178 tempest-HostsAdminNegativeTestJSON-748516178-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.042156 Oct 11 19:44:21.724133 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 337/656] 10.222.0.27 () {60 vars in 1211 bytes} [Tue Oct 11 19:44:21 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:44:21.728862 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a84153f4-0ef5-4711-bd6b-d1cfe3cf03a5 req-eaab1940-3d45-4efc-9b05-4a011df442db service nova] Creating event network-changed:44663329-774c-463a-a864-c1e0c979ab76 for instance 7dea9975-b38a-465e-a181-454a20b0ae00 on n-h1-860864-3 Oct 11 19:44:21.735767 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a84153f4-0ef5-4711-bd6b-d1cfe3cf03a5 req-eaab1940-3d45-4efc-9b05-4a011df442db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039692 Oct 11 19:44:21.736722 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 320/657] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:21.744664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-149b97c0-a2c9-4391-b47c-b4b95733a359 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:21.745405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-149b97c0-a2c9-4391-b47c-b4b95733a359 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:21.748979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f494319a-57fc-4008-bba7-c6f655da4eb9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:21.751654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f494319a-57fc-4008-bba7-c6f655da4eb9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:21.752732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-149b97c0-a2c9-4391-b47c-b4b95733a359 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.753268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-149b97c0-a2c9-4391-b47c-b4b95733a359 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.753729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-149b97c0-a2c9-4391-b47c-b4b95733a359 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.755030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-149b97c0-a2c9-4391-b47c-b4b95733a359 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.755554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-149b97c0-a2c9-4391-b47c-b4b95733a359 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.756113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-149b97c0-a2c9-4391-b47c-b4b95733a359 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.772009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f494319a-57fc-4008-bba7-c6f655da4eb9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.773630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f494319a-57fc-4008-bba7-c6f655da4eb9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.774447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f494319a-57fc-4008-bba7-c6f655da4eb9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.777609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f494319a-57fc-4008-bba7-c6f655da4eb9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:21.778146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f494319a-57fc-4008-bba7-c6f655da4eb9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:21.778788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f494319a-57fc-4008-bba7-c6f655da4eb9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:21.817048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:22.216936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f494319a-57fc-4008-bba7-c6f655da4eb9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:22.226693 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f494319a-57fc-4008-bba7-c6f655da4eb9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1504 microversion: 2.1 time: 0.501307 Oct 11 19:44:22.232859 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 338/658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:21 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1504 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:22.237922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-29d55faf-93b2-48ed-9e4f-9bb06ddd5781 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:22.242487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-29d55faf-93b2-48ed-9e4f-9bb06ddd5781 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:22.283479 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-149b97c0-a2c9-4391-b47c-b4b95733a359 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1618 microversion: 2.1 time: 0.545243 Oct 11 19:44:22.284070 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 321/659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:21 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1618 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:22.301063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa3f6ead-ecd9-40bf-a560-5d87a64a7867 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:22.301705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa3f6ead-ecd9-40bf-a560-5d87a64a7867 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:22.341058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3f6ead-ecd9-40bf-a560-5d87a64a7867 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:22.344954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3f6ead-ecd9-40bf-a560-5d87a64a7867 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:22.345531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3f6ead-ecd9-40bf-a560-5d87a64a7867 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:22.346505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3f6ead-ecd9-40bf-a560-5d87a64a7867 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:22.350786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3f6ead-ecd9-40bf-a560-5d87a64a7867 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:22.351485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3f6ead-ecd9-40bf-a560-5d87a64a7867 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:22.451107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-29d55faf-93b2-48ed-9e4f-9bb06ddd5781 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:22.459749 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-29d55faf-93b2-48ed-9e4f-9bb06ddd5781 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1218 microversion: 2.1 time: 0.225562 Oct 11 19:44:22.476562 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 339/660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:22 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1218 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:22.499530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-75c6baa6-2bbb-4b12-91fa-bf9b195e4d47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:22.500539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-75c6baa6-2bbb-4b12-91fa-bf9b195e4d47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:22.515564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75c6baa6-2bbb-4b12-91fa-bf9b195e4d47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:22.516552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75c6baa6-2bbb-4b12-91fa-bf9b195e4d47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:22.517156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75c6baa6-2bbb-4b12-91fa-bf9b195e4d47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:22.518402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75c6baa6-2bbb-4b12-91fa-bf9b195e4d47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:22.519814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75c6baa6-2bbb-4b12-91fa-bf9b195e4d47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:22.520475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75c6baa6-2bbb-4b12-91fa-bf9b195e4d47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:22.653115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa3f6ead-ecd9-40bf-a560-5d87a64a7867 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:22.661270 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa3f6ead-ecd9-40bf-a560-5d87a64a7867 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1325 microversion: 2.1 time: 0.375587 Oct 11 19:44:22.662442 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 322/661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:22 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1325 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:22.680862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-93546896", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["f392b558-6079-4c4d-88bd-a50aa499dce6"]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:22.745490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:44:23.113702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-75c6baa6-2bbb-4b12-91fa-bf9b195e4d47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:23.126653 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-75c6baa6-2bbb-4b12-91fa-bf9b195e4d47 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.640745 Oct 11 19:44:23.127280 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 340/662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:22 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:23.135890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:23.142648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:23.156934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:23.158063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:23.158239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:23.158975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:23.160228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:23.160602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:23.261351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:44:23.263800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:44:23.264490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:44:23.265069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:44:23.265664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:44:23.288128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:23.288735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:23.289189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:23.289928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:23.290390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:23.291006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:23.315700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:23.323034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:23.342499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:44:23.345251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:44:23.360706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:23.372079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:23.380496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:23.383316 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-71f4f576-d155-4e2c-b8b6-6abe0349d035 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1320 microversion: 2.25 time: 0.252208 Oct 11 19:44:23.388858 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 341/663] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:23 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:23.395250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8e5becf9-0962-48e1-9da1-b9ba67c35732 req-3b6c0b84-dc39-4d32-a8e4-f8e2b622af8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96af3c9-b2ae-4568-9aad-268b2595cf5f", "name": "network-vif-plugged", "status": "completed", "tag": "3ce1b418-c559-46e6-97d6-9f0890b9bfac"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:23.424806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8e5becf9-0962-48e1-9da1-b9ba67c35732 req-3b6c0b84-dc39-4d32-a8e4-f8e2b622af8b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:23.426508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8e5becf9-0962-48e1-9da1-b9ba67c35732 req-3b6c0b84-dc39-4d32-a8e4-f8e2b622af8b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:23.426947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8e5becf9-0962-48e1-9da1-b9ba67c35732 req-3b6c0b84-dc39-4d32-a8e4-f8e2b622af8b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:23.453762 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7f541f95-45d9-4107-9967-e5fddfe5b655 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789973 Oct 11 19:44:23.454699 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 323/664] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:44:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:44:23.459883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1a881a9-bde7-43fa-a76b-7b423045dd46 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:23.464153 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8e5becf9-0962-48e1-9da1-b9ba67c35732 req-3b6c0b84-dc39-4d32-a8e4-f8e2b622af8b service nova] Creating event network-vif-plugged:3ce1b418-c559-46e6-97d6-9f0890b9bfac for instance f96af3c9-b2ae-4568-9aad-268b2595cf5f on n-h2-860864-3 Oct 11 19:44:23.467775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1a881a9-bde7-43fa-a76b-7b423045dd46 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:23.486768 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8e5becf9-0962-48e1-9da1-b9ba67c35732 req-3b6c0b84-dc39-4d32-a8e4-f8e2b622af8b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082560 Oct 11 19:44:23.496630 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 342/665] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:23.502020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b68538a-380e-417b-bd1c-4d206dd47f51 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:23.505962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1a881a9-bde7-43fa-a76b-7b423045dd46 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:23.506491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1a881a9-bde7-43fa-a76b-7b423045dd46 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:23.507116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1a881a9-bde7-43fa-a76b-7b423045dd46 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:23.507856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1a881a9-bde7-43fa-a76b-7b423045dd46 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:23.508362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1a881a9-bde7-43fa-a76b-7b423045dd46 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:23.508791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1a881a9-bde7-43fa-a76b-7b423045dd46 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:23.515183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9b68538a-380e-417b-bd1c-4d206dd47f51 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:23.896386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9b68538a-380e-417b-bd1c-4d206dd47f51 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:23.904420 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9b68538a-380e-417b-bd1c-4d206dd47f51 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1215 microversion: 2.1 time: 0.406494 Oct 11 19:44:23.915678 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 343/666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:23 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1215 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:23.947036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0378cbf1-1e42-4f6f-99ca-abef9ec145b1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:23.948310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0378cbf1-1e42-4f6f-99ca-abef9ec145b1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:23.956016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0378cbf1-1e42-4f6f-99ca-abef9ec145b1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:23.957486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0378cbf1-1e42-4f6f-99ca-abef9ec145b1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:23.958045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0378cbf1-1e42-4f6f-99ca-abef9ec145b1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:23.959061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0378cbf1-1e42-4f6f-99ca-abef9ec145b1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:23.959642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0378cbf1-1e42-4f6f-99ca-abef9ec145b1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:23.960179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0378cbf1-1e42-4f6f-99ca-abef9ec145b1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:24.021575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f1a881a9-bde7-43fa-a76b-7b423045dd46 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:24.034949 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1a881a9-bde7-43fa-a76b-7b423045dd46 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1504 microversion: 2.1 time: 0.578688 Oct 11 19:44:24.040011 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 324/667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:23 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1504 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:24.046930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-809f8111-0fd2-47f0-a950-8f0d90a911af tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:24.053507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-809f8111-0fd2-47f0-a950-8f0d90a911af tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:24.067914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-809f8111-0fd2-47f0-a950-8f0d90a911af tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:24.071559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-809f8111-0fd2-47f0-a950-8f0d90a911af tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:24.072273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-809f8111-0fd2-47f0-a950-8f0d90a911af tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:24.073253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-809f8111-0fd2-47f0-a950-8f0d90a911af tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:24.073935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-809f8111-0fd2-47f0-a950-8f0d90a911af tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:24.075904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-809f8111-0fd2-47f0-a950-8f0d90a911af tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:24.236949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0378cbf1-1e42-4f6f-99ca-abef9ec145b1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:24.260059 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0378cbf1-1e42-4f6f-99ca-abef9ec145b1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1270 microversion: 2.1 time: 0.329139 Oct 11 19:44:24.265895 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 344/668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:23 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1270 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:24.288782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-40be0de0-3334-482a-90e7-0f4fd62dc363 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:24.290480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-40be0de0-3334-482a-90e7-0f4fd62dc363 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:24.311131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40be0de0-3334-482a-90e7-0f4fd62dc363 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:24.313530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40be0de0-3334-482a-90e7-0f4fd62dc363 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:24.314965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40be0de0-3334-482a-90e7-0f4fd62dc363 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:24.315794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40be0de0-3334-482a-90e7-0f4fd62dc363 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:24.316377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40be0de0-3334-482a-90e7-0f4fd62dc363 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:24.323568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40be0de0-3334-482a-90e7-0f4fd62dc363 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:24.731373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-809f8111-0fd2-47f0-a950-8f0d90a911af tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:24.741480 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-809f8111-0fd2-47f0-a950-8f0d90a911af tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1325 microversion: 2.1 time: 0.698214 Oct 11 19:44:24.754927 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 325/669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:24 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1325 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:24.760438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:24.760913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:24.776037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:24.776880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:24.777284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:24.778116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:24.778607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:24.779042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:24.911012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-40be0de0-3334-482a-90e7-0f4fd62dc363 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:24.931711 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-40be0de0-3334-482a-90e7-0f4fd62dc363 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1477 microversion: 2.1 time: 0.663394 Oct 11 19:44:24.932622 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 345/670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:24 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1477 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:24.949039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51db4d2e-6f00-4c7b-862c-3cfe80f81811 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:24.950904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51db4d2e-6f00-4c7b-862c-3cfe80f81811 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:24.969990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51db4d2e-6f00-4c7b-862c-3cfe80f81811 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:24.970492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51db4d2e-6f00-4c7b-862c-3cfe80f81811 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:24.970962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51db4d2e-6f00-4c7b-862c-3cfe80f81811 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:24.971684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51db4d2e-6f00-4c7b-862c-3cfe80f81811 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:24.980458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51db4d2e-6f00-4c7b-862c-3cfe80f81811 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:24.980919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51db4d2e-6f00-4c7b-862c-3cfe80f81811 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:25.163514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51db4d2e-6f00-4c7b-862c-3cfe80f81811 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:25.179447 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51db4d2e-6f00-4c7b-862c-3cfe80f81811 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1267 microversion: 2.1 time: 0.234424 Oct 11 19:44:25.191742 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 346/671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:24 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:25.201226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9741df89-e26e-4f2b-b349-c97fe2846a14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:25.202084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9741df89-e26e-4f2b-b349-c97fe2846a14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:25.216156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9741df89-e26e-4f2b-b349-c97fe2846a14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:25.218416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9741df89-e26e-4f2b-b349-c97fe2846a14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:25.220158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9741df89-e26e-4f2b-b349-c97fe2846a14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:25.221240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9741df89-e26e-4f2b-b349-c97fe2846a14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:25.222770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9741df89-e26e-4f2b-b349-c97fe2846a14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:25.223776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9741df89-e26e-4f2b-b349-c97fe2846a14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:25.274097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:25.288122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:25.289546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:25.295759 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5938709-f70f-4a7e-bf49-7bbfed10fa2e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1362 microversion: 2.25 time: 0.534436 Oct 11 19:44:25.310776 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 326/672] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:24 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:25.310776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-00cf57e4-6e02-4f68-b209-e8fb6f0e8666 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:25.310776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-00cf57e4-6e02-4f68-b209-e8fb6f0e8666 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:25.310776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:25.325125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00cf57e4-6e02-4f68-b209-e8fb6f0e8666 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:25.325647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00cf57e4-6e02-4f68-b209-e8fb6f0e8666 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:25.326099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00cf57e4-6e02-4f68-b209-e8fb6f0e8666 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:25.326857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00cf57e4-6e02-4f68-b209-e8fb6f0e8666 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:25.327318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00cf57e4-6e02-4f68-b209-e8fb6f0e8666 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:25.327748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00cf57e4-6e02-4f68-b209-e8fb6f0e8666 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:25.692372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-00cf57e4-6e02-4f68-b209-e8fb6f0e8666 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:25.702410 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-00cf57e4-6e02-4f68-b209-e8fb6f0e8666 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1276 microversion: 2.1 time: 0.402418 Oct 11 19:44:25.719151 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 327/673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:25 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1276 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:25.766101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8dc63ef7-3528-495f-8417-cc7543210d25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:25.766870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8dc63ef7-3528-495f-8417-cc7543210d25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:25.780870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dc63ef7-3528-495f-8417-cc7543210d25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:25.781760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dc63ef7-3528-495f-8417-cc7543210d25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:25.782415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dc63ef7-3528-495f-8417-cc7543210d25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:25.783337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dc63ef7-3528-495f-8417-cc7543210d25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:25.783789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dc63ef7-3528-495f-8417-cc7543210d25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:25.791649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dc63ef7-3528-495f-8417-cc7543210d25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:25.973442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9741df89-e26e-4f2b-b349-c97fe2846a14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:25.983359 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9741df89-e26e-4f2b-b349-c97fe2846a14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1504 microversion: 2.1 time: 0.790498 Oct 11 19:44:26.009256 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 347/674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:25 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1504 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:26.017532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05f10770-826f-4a08-aade-19b7e8f5dc4e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:26.018722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05f10770-826f-4a08-aade-19b7e8f5dc4e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:26.026686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f10770-826f-4a08-aade-19b7e8f5dc4e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:26.027490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f10770-826f-4a08-aade-19b7e8f5dc4e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:26.028226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f10770-826f-4a08-aade-19b7e8f5dc4e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:26.029438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f10770-826f-4a08-aade-19b7e8f5dc4e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:26.030071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f10770-826f-4a08-aade-19b7e8f5dc4e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:26.030825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f10770-826f-4a08-aade-19b7e8f5dc4e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:26.750660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8dc63ef7-3528-495f-8417-cc7543210d25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:26.765120 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8dc63ef7-3528-495f-8417-cc7543210d25 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1521 microversion: 2.1 time: 1.001618 Oct 11 19:44:26.766886 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 328/675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:25 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1521 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:26.773533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e4a203bd-f463-402c-ad47-3ef03a01d0d3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:26.774656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e4a203bd-f463-402c-ad47-3ef03a01d0d3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:26.797723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a203bd-f463-402c-ad47-3ef03a01d0d3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:26.801539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a203bd-f463-402c-ad47-3ef03a01d0d3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:26.802103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a203bd-f463-402c-ad47-3ef03a01d0d3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:26.802905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a203bd-f463-402c-ad47-3ef03a01d0d3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:26.803710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a203bd-f463-402c-ad47-3ef03a01d0d3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:26.804320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4a203bd-f463-402c-ad47-3ef03a01d0d3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:26.817014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-05f10770-826f-4a08-aade-19b7e8f5dc4e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:26.833943 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05f10770-826f-4a08-aade-19b7e8f5dc4e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1476 microversion: 2.1 time: 0.822516 Oct 11 19:44:26.848445 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 348/676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:26 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1476 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:26.857668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:26.858707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:26.865340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:26.866174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:26.866907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:26.867832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:26.868496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:26.869345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:27.000332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e4a203bd-f463-402c-ad47-3ef03a01d0d3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:27.010419 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e4a203bd-f463-402c-ad47-3ef03a01d0d3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1273 microversion: 2.1 time: 0.240976 Oct 11 19:44:27.011053 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 329/677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:26 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:27.038361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f9ea5a78-7597-4bd2-a796-a29f27b3d609 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:27.039870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f9ea5a78-7597-4bd2-a796-a29f27b3d609 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:27.048215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9ea5a78-7597-4bd2-a796-a29f27b3d609 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:27.049265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9ea5a78-7597-4bd2-a796-a29f27b3d609 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:27.051296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9ea5a78-7597-4bd2-a796-a29f27b3d609 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:27.052480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9ea5a78-7597-4bd2-a796-a29f27b3d609 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:27.054761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9ea5a78-7597-4bd2-a796-a29f27b3d609 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:27.055451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9ea5a78-7597-4bd2-a796-a29f27b3d609 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:27.519126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:27.531876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:27.534824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:27.536981 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-16565a0d-0c48-427f-9554-dda9938dff98 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1362 microversion: 2.25 time: 0.687196 Oct 11 19:44:27.537862 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 349/678] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:26 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1362 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:27.564376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-79b250f3-68cb-4b14-ab12-6f8320419bdf tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:27.567080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-79b250f3-68cb-4b14-ab12-6f8320419bdf tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:27.583346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b250f3-68cb-4b14-ab12-6f8320419bdf tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:27.583902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b250f3-68cb-4b14-ab12-6f8320419bdf tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:27.586317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b250f3-68cb-4b14-ab12-6f8320419bdf tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:27.587384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b250f3-68cb-4b14-ab12-6f8320419bdf tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:27.588572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b250f3-68cb-4b14-ab12-6f8320419bdf tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:27.589466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b250f3-68cb-4b14-ab12-6f8320419bdf tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:27.649562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f9ea5a78-7597-4bd2-a796-a29f27b3d609 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:27.662679 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f9ea5a78-7597-4bd2-a796-a29f27b3d609 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1318 microversion: 2.1 time: 0.633023 Oct 11 19:44:27.676741 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 330/679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:27 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:27.686791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-be79ae45-63b7-47c9-b75a-144c4ce5b267 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:27.687678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-be79ae45-63b7-47c9-b75a-144c4ce5b267 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:27.695283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be79ae45-63b7-47c9-b75a-144c4ce5b267 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:27.697080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be79ae45-63b7-47c9-b75a-144c4ce5b267 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:27.697689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be79ae45-63b7-47c9-b75a-144c4ce5b267 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:27.699264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be79ae45-63b7-47c9-b75a-144c4ce5b267 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:27.699879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be79ae45-63b7-47c9-b75a-144c4ce5b267 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:27.700575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be79ae45-63b7-47c9-b75a-144c4ce5b267 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.097238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79b250f3-68cb-4b14-ab12-6f8320419bdf tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:28.107117 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-79b250f3-68cb-4b14-ab12-6f8320419bdf tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.567519 Oct 11 19:44:28.107794 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 350/680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:27 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1521 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:28.112651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-76e75819-b1ef-445f-b6e4-74f84b37dca9 req-3162ce26-8eb0-401b-9a8e-fd8ff73b543b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337", "tag": "8295ec70-df13-4a58-810c-672a4906086f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:28.124839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-76e75819-b1ef-445f-b6e4-74f84b37dca9 req-3162ce26-8eb0-401b-9a8e-fd8ff73b543b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.125993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-76e75819-b1ef-445f-b6e4-74f84b37dca9 req-3162ce26-8eb0-401b-9a8e-fd8ff73b543b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.126807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-76e75819-b1ef-445f-b6e4-74f84b37dca9 req-3162ce26-8eb0-401b-9a8e-fd8ff73b543b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.143073 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-76e75819-b1ef-445f-b6e4-74f84b37dca9 req-3162ce26-8eb0-401b-9a8e-fd8ff73b543b service nova] Creating event network-changed:8295ec70-df13-4a58-810c-672a4906086f for instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 on n-h2-860864-3 Oct 11 19:44:28.149934 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-76e75819-b1ef-445f-b6e4-74f84b37dca9 req-3162ce26-8eb0-401b-9a8e-fd8ff73b543b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040303 Oct 11 19:44:28.151227 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 351/681] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:28.156737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-878c8d55-8633-4a21-b597-345ec6373a42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:28.157107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-878c8d55-8633-4a21-b597-345ec6373a42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:28.164661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-be79ae45-63b7-47c9-b75a-144c4ce5b267 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:28.165204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878c8d55-8633-4a21-b597-345ec6373a42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.165382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878c8d55-8633-4a21-b597-345ec6373a42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.166012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878c8d55-8633-4a21-b597-345ec6373a42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.166971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878c8d55-8633-4a21-b597-345ec6373a42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.167428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878c8d55-8633-4a21-b597-345ec6373a42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.168034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878c8d55-8633-4a21-b597-345ec6373a42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.176869 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-be79ae45-63b7-47c9-b75a-144c4ce5b267 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1504 microversion: 2.1 time: 0.498703 Oct 11 19:44:28.178166 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 331/682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:27 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1504 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:28.204225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-76dd8777-4dba-467b-955f-5adaf62d94d5 req-2af90b71-93ed-4931-a4a5-cfa09db16c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1463ded-d983-4703-b256-08dfbb0cda89", "name": "network-vif-unplugged", "status": "completed", "tag": "9a1e3906-cf0e-4288-b9c2-eba283fe7bcf"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:28.214385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-76dd8777-4dba-467b-955f-5adaf62d94d5 req-2af90b71-93ed-4931-a4a5-cfa09db16c78 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.214896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-76dd8777-4dba-467b-955f-5adaf62d94d5 req-2af90b71-93ed-4931-a4a5-cfa09db16c78 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.215534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-76dd8777-4dba-467b-955f-5adaf62d94d5 req-2af90b71-93ed-4931-a4a5-cfa09db16c78 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.228726 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-76dd8777-4dba-467b-955f-5adaf62d94d5 req-2af90b71-93ed-4931-a4a5-cfa09db16c78 service nova] Creating event network-vif-unplugged:9a1e3906-cf0e-4288-b9c2-eba283fe7bcf for instance b1463ded-d983-4703-b256-08dfbb0cda89 on n-h2-860864-3 Oct 11 19:44:28.241708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-76dd8777-4dba-467b-955f-5adaf62d94d5 req-2af90b71-93ed-4931-a4a5-cfa09db16c78 service nova] Instance b1463ded-d983-4703-b256-08dfbb0cda89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:44:28.252533 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-76dd8777-4dba-467b-955f-5adaf62d94d5 req-2af90b71-93ed-4931-a4a5-cfa09db16c78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058424 Oct 11 19:44:28.253707 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 332/683] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:28.258668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e9808abb-2745-40bb-9a5b-c29f529ca96f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:28.259358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e9808abb-2745-40bb-9a5b-c29f529ca96f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:28.266019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9808abb-2745-40bb-9a5b-c29f529ca96f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.266761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9808abb-2745-40bb-9a5b-c29f529ca96f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.267200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9808abb-2745-40bb-9a5b-c29f529ca96f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.267894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9808abb-2745-40bb-9a5b-c29f529ca96f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.268351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9808abb-2745-40bb-9a5b-c29f529ca96f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.269433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9808abb-2745-40bb-9a5b-c29f529ca96f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.390083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e9808abb-2745-40bb-9a5b-c29f529ca96f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:28.398043 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e9808abb-2745-40bb-9a5b-c29f529ca96f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1273 microversion: 2.1 time: 0.143156 Oct 11 19:44:28.398841 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 333/684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:28 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:28.403644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7e365b3-5e88-4e8c-a5f1-f80bad56d848 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1996314269"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:28.405875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7e365b3-5e88-4e8c-a5f1-f80bad56d848 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:28.412545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e365b3-5e88-4e8c-a5f1-f80bad56d848 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.413034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e365b3-5e88-4e8c-a5f1-f80bad56d848 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.413468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e365b3-5e88-4e8c-a5f1-f80bad56d848 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.414245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e365b3-5e88-4e8c-a5f1-f80bad56d848 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.414800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e365b3-5e88-4e8c-a5f1-f80bad56d848 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.415222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e365b3-5e88-4e8c-a5f1-f80bad56d848 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.519924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-878c8d55-8633-4a21-b597-345ec6373a42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:28.531425 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-878c8d55-8633-4a21-b597-345ec6373a42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1476 microversion: 2.1 time: 0.378709 Oct 11 19:44:28.532760 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 352/685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:28 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:28.641926 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7e365b3-5e88-4e8c-a5f1-f80bad56d848 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "POST /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f/action" status: 202 len: 0 microversion: 2.1 time: 0.241708 Oct 11 19:44:28.643264 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 334/686] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:44:28 2022] POST /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 19:44:28.649686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:28.650458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:28.657292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.657972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.658592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.660198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.661097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.661097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.702362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Calling method '.version_select at 0x7f83cd2331f0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:28.705089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.707113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.707567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.723969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.724474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.724914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.728383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:28.735832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:28.740241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.740743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.741182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.748884 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1f736bf9-646a-42b1-845a-ae35cf423082 tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.214306 Oct 11 19:44:28.755717 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 353/687] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 19:44:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:44:28.763565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2c9abea4-887e-4c1c-bb4d-328f97a7f215 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '.version_select at 0x7f83ccd83310>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:28.954594 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2c9abea4-887e-4c1c-bb4d-328f97a7f215 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "DELETE /compute/v2.1/images/9ea9524b-bad6-4c87-bc2b-a5a331f5acf4" status: 204 len: 0 microversion: 2.1 time: 0.197269 Oct 11 19:44:28.955711 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 354/688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:28 2022] DELETE /compute/v2.1/images/9ea9524b-bad6-4c87-bc2b-a5a331f5acf4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:44:28.964778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e4618b63-4671-4a82-bb01-75f4cc9e8ab4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:28.965397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e4618b63-4671-4a82-bb01-75f4cc9e8ab4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:28.974673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4618b63-4671-4a82-bb01-75f4cc9e8ab4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.975415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4618b63-4671-4a82-bb01-75f4cc9e8ab4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.976090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4618b63-4671-4a82-bb01-75f4cc9e8ab4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:28.977378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4618b63-4671-4a82-bb01-75f4cc9e8ab4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:28.978748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4618b63-4671-4a82-bb01-75f4cc9e8ab4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:28.979476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4618b63-4671-4a82-bb01-75f4cc9e8ab4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:29.052084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:29.062992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:29.064993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:29.067288 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e97ba252-a6ee-46c2-bbd0-17a0f0abea37 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1362 microversion: 2.25 time: 0.421973 Oct 11 19:44:29.068425 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 335/689] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:28 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:29.073352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5b290c8-fe69-42e5-b4f8-2961f761a2dc tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Calling method '.version_select at 0x7f83cca50280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:29.075525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5b290c8-fe69-42e5-b4f8-2961f761a2dc tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:29.076623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5b290c8-fe69-42e5-b4f8-2961f761a2dc tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:29.077355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5b290c8-fe69-42e5-b4f8-2961f761a2dc tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:29.093064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5b290c8-fe69-42e5-b4f8-2961f761a2dc tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:29.093926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5b290c8-fe69-42e5-b4f8-2961f761a2dc tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:29.094672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5b290c8-fe69-42e5-b4f8-2961f761a2dc tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:29.104260 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b5b290c8-fe69-42e5-b4f8-2961f761a2dc tempest-HypervisorAdminV228Test-34676024 tempest-HypervisorAdminV228Test-34676024-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.033795 Oct 11 19:44:29.104928 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 336/690] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 11 19:44:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:44:29.109754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-18b6d4f5-86d6-4688-ba92-c1241d665d01 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '.version_select at 0x7f83cca04310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:29.169733 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-18b6d4f5-86d6-4688-ba92-c1241d665d01 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Image not found. Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-18b6d4f5-86d6-4688-ba92-c1241d665d01 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/images/9ea9524b-bad6-4c87-bc2b-a5a331f5acf4 HTTP/1.1 Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:44:29.186984 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: exception: Image not found. Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '9ea9524b-bad6-4c87-bc2b-a5a331f5acf4'} Oct 11 19:44:29.188921 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:44:29.189805 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9ea9524b-bad6-4c87-bc2b-a5a331f5acf4 Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:44:29.191842 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ea9524b-bad6-4c87-bc2b-a5a331f5acf4 could not be found. Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:44:29.193112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:44:29.194205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:29.196639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-18b6d4f5-86d6-4688-ba92-c1241d665d01 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 404 to user: Image not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:29.197588 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-18b6d4f5-86d6-4688-ba92-c1241d665d01 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/images/9ea9524b-bad6-4c87-bc2b-a5a331f5acf4" status: 404 len: 62 microversion: 2.1 time: 0.091182 Oct 11 19:44:29.200115 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 337/691] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:44:29 2022] GET /compute/v2.1/images/9ea9524b-bad6-4c87-bc2b-a5a331f5acf4 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:44:29.213482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e95b53be-902f-40e6-820a-57011982c4b8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:29.213482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e95b53be-902f-40e6-820a-57011982c4b8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:29.240306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e95b53be-902f-40e6-820a-57011982c4b8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:29.240840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e95b53be-902f-40e6-820a-57011982c4b8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:29.242132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e95b53be-902f-40e6-820a-57011982c4b8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:29.242132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e95b53be-902f-40e6-820a-57011982c4b8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:29.242880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e95b53be-902f-40e6-820a-57011982c4b8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:29.243646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e95b53be-902f-40e6-820a-57011982c4b8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:29.818809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4618b63-4671-4a82-bb01-75f4cc9e8ab4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:29.836469 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e4618b63-4671-4a82-bb01-75f4cc9e8ab4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1318 microversion: 2.1 time: 0.875472 Oct 11 19:44:29.837088 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 355/692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:28 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1318 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:29.841881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6ebf847-83a2-4415-a997-26d6b050a5b9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:29.842851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d6ebf847-83a2-4415-a997-26d6b050a5b9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:29.849843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6ebf847-83a2-4415-a997-26d6b050a5b9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:29.850656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6ebf847-83a2-4415-a997-26d6b050a5b9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:29.851312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6ebf847-83a2-4415-a997-26d6b050a5b9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:29.853001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6ebf847-83a2-4415-a997-26d6b050a5b9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:29.853920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6ebf847-83a2-4415-a997-26d6b050a5b9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:29.854656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6ebf847-83a2-4415-a997-26d6b050a5b9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:30.103216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e95b53be-902f-40e6-820a-57011982c4b8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:30.116268 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e95b53be-902f-40e6-820a-57011982c4b8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1504 microversion: 2.1 time: 0.914880 Oct 11 19:44:30.130971 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 338/693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:29 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1504 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:30.138101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a27225e9-a17b-4c99-931f-25676d4f7efb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:30.139020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a27225e9-a17b-4c99-931f-25676d4f7efb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:30.146221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27225e9-a17b-4c99-931f-25676d4f7efb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:30.147039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27225e9-a17b-4c99-931f-25676d4f7efb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:30.147721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27225e9-a17b-4c99-931f-25676d4f7efb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:30.148644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27225e9-a17b-4c99-931f-25676d4f7efb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:30.149314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27225e9-a17b-4c99-931f-25676d4f7efb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:30.149948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a27225e9-a17b-4c99-931f-25676d4f7efb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:30.154870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:30.368685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d6ebf847-83a2-4415-a997-26d6b050a5b9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:30.377536 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d6ebf847-83a2-4415-a997-26d6b050a5b9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1533 microversion: 2.1 time: 0.539220 Oct 11 19:44:30.378714 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 356/694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:29 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1533 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:30.384845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c10659e2-e431-4b03-8ea0-6324c1be2697 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:30.387000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c10659e2-e431-4b03-8ea0-6324c1be2697 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:30.401248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c10659e2-e431-4b03-8ea0-6324c1be2697 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:30.402786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c10659e2-e431-4b03-8ea0-6324c1be2697 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:30.404162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c10659e2-e431-4b03-8ea0-6324c1be2697 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:30.405308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c10659e2-e431-4b03-8ea0-6324c1be2697 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:30.405913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c10659e2-e431-4b03-8ea0-6324c1be2697 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:30.406561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c10659e2-e431-4b03-8ea0-6324c1be2697 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:30.763226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a27225e9-a17b-4c99-931f-25676d4f7efb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:30.772215 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a27225e9-a17b-4c99-931f-25676d4f7efb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1315 microversion: 2.1 time: 0.639682 Oct 11 19:44:30.773136 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 339/695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:30 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:30.778810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:30.779509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:30.787571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:30.788241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:30.788835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:30.789983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:30.790830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:30.791286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:30.968650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c10659e2-e431-4b03-8ea0-6324c1be2697 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:30.982758 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c10659e2-e431-4b03-8ea0-6324c1be2697 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1476 microversion: 2.1 time: 0.602170 Oct 11 19:44:30.983767 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 357/696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:30 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1476 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:31.008483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-50b22b1b-c5ae-4434-b641-829d1ef78703 req-f99e65b4-512a-4c4d-a2e8-af7f100b55da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1463ded-d983-4703-b256-08dfbb0cda89", "tag": "9a1e3906-cf0e-4288-b9c2-eba283fe7bcf"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:31.027934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-50b22b1b-c5ae-4434-b641-829d1ef78703 req-f99e65b4-512a-4c4d-a2e8-af7f100b55da service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:31.029302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-50b22b1b-c5ae-4434-b641-829d1ef78703 req-f99e65b4-512a-4c4d-a2e8-af7f100b55da service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:31.030222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-50b22b1b-c5ae-4434-b641-829d1ef78703 req-f99e65b4-512a-4c4d-a2e8-af7f100b55da service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:31.057952 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-50b22b1b-c5ae-4434-b641-829d1ef78703 req-f99e65b4-512a-4c4d-a2e8-af7f100b55da service nova] Creating event network-changed:9a1e3906-cf0e-4288-b9c2-eba283fe7bcf for instance b1463ded-d983-4703-b256-08dfbb0cda89 on n-h2-860864-3 Oct 11 19:44:31.075270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-50b22b1b-c5ae-4434-b641-829d1ef78703 req-f99e65b4-512a-4c4d-a2e8-af7f100b55da service nova] Instance b1463ded-d983-4703-b256-08dfbb0cda89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:44:31.092265 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-50b22b1b-c5ae-4434-b641-829d1ef78703 req-f99e65b4-512a-4c4d-a2e8-af7f100b55da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107137 Oct 11 19:44:31.093478 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 358/697] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:31.116923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5da8bbc3-a99d-40ff-8df5-e359452cf0a3 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:31.118366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5da8bbc3-a99d-40ff-8df5-e359452cf0a3 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:31.126020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5da8bbc3-a99d-40ff-8df5-e359452cf0a3 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:31.126626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5da8bbc3-a99d-40ff-8df5-e359452cf0a3 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:31.127258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5da8bbc3-a99d-40ff-8df5-e359452cf0a3 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:31.128877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5da8bbc3-a99d-40ff-8df5-e359452cf0a3 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:31.129425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5da8bbc3-a99d-40ff-8df5-e359452cf0a3 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:31.129864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5da8bbc3-a99d-40ff-8df5-e359452cf0a3 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:31.324808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:31.337618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:31.339448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:31.340589 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13a23eb2-96a9-4ea5-9417-ab6e6707b744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1362 microversion: 2.25 time: 0.566303 Oct 11 19:44:31.354553 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 340/698] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:30 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1362 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:31.354553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae10897e-1a2e-411c-ab25-048ea2d8a6f6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:31.354553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ae10897e-1a2e-411c-ab25-048ea2d8a6f6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:31.355621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae10897e-1a2e-411c-ab25-048ea2d8a6f6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:31.356694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae10897e-1a2e-411c-ab25-048ea2d8a6f6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:31.357577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae10897e-1a2e-411c-ab25-048ea2d8a6f6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:31.358633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae10897e-1a2e-411c-ab25-048ea2d8a6f6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:31.359373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae10897e-1a2e-411c-ab25-048ea2d8a6f6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:31.360009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae10897e-1a2e-411c-ab25-048ea2d8a6f6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:31.514354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:31.910907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5da8bbc3-a99d-40ff-8df5-e359452cf0a3 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:31.919984 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5da8bbc3-a99d-40ff-8df5-e359452cf0a3 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1318 microversion: 2.1 time: 0.823858 Oct 11 19:44:31.920982 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 359/699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:31 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1318 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:31.927977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11a01d0f-d2d0-4427-977c-55c4f282da3c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:31.929738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-11a01d0f-d2d0-4427-977c-55c4f282da3c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:31.936989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a01d0f-d2d0-4427-977c-55c4f282da3c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:31.937707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a01d0f-d2d0-4427-977c-55c4f282da3c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:31.938504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a01d0f-d2d0-4427-977c-55c4f282da3c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:31.939266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a01d0f-d2d0-4427-977c-55c4f282da3c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:31.939813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a01d0f-d2d0-4427-977c-55c4f282da3c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:31.940289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a01d0f-d2d0-4427-977c-55c4f282da3c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.048543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae10897e-1a2e-411c-ab25-048ea2d8a6f6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:32.067460 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae10897e-1a2e-411c-ab25-048ea2d8a6f6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1479 microversion: 2.1 time: 0.724584 Oct 11 19:44:32.068501 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 341/700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:31 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1479 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:32.082986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70ecfa72-5044-4c94-b825-7c4f96a3c361 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:32.083870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-70ecfa72-5044-4c94-b825-7c4f96a3c361 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:32.090957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ecfa72-5044-4c94-b825-7c4f96a3c361 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.091906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ecfa72-5044-4c94-b825-7c4f96a3c361 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.092586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ecfa72-5044-4c94-b825-7c4f96a3c361 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.093523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ecfa72-5044-4c94-b825-7c4f96a3c361 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.094246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ecfa72-5044-4c94-b825-7c4f96a3c361 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.095013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ecfa72-5044-4c94-b825-7c4f96a3c361 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.352473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11a01d0f-d2d0-4427-977c-55c4f282da3c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:32.365798 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11a01d0f-d2d0-4427-977c-55c4f282da3c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1539 microversion: 2.1 time: 0.443401 Oct 11 19:44:32.367743 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 360/701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:31 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1539 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:32.373291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-973926bc-cd53-46be-8173-de0a1572d882 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:32.374637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-973926bc-cd53-46be-8173-de0a1572d882 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:32.385161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-973926bc-cd53-46be-8173-de0a1572d882 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.386094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-973926bc-cd53-46be-8173-de0a1572d882 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.386554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-973926bc-cd53-46be-8173-de0a1572d882 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.387285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-973926bc-cd53-46be-8173-de0a1572d882 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.388484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-973926bc-cd53-46be-8173-de0a1572d882 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.389771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-973926bc-cd53-46be-8173-de0a1572d882 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.432550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-70ecfa72-5044-4c94-b825-7c4f96a3c361 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:32.441991 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-70ecfa72-5044-4c94-b825-7c4f96a3c361 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1315 microversion: 2.1 time: 0.372129 Oct 11 19:44:32.448012 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 342/702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:32 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:32.462277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ecdda446-b230-4515-9c3b-531da6e25bac tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '.version_select at 0x7f83cca188b0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:32.467285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecdda446-b230-4515-9c3b-531da6e25bac tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.468485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecdda446-b230-4515-9c3b-531da6e25bac tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.469970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecdda446-b230-4515-9c3b-531da6e25bac tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.490050 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ecdda446-b230-4515-9c3b-531da6e25bac tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1182 microversion: 2.1 time: 0.040574 Oct 11 19:44:32.491590 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 343/703] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:44:32 2022] GET /compute/v2.1/os-migrations => generated 1182 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:32.496608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:32.497499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:32.507037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.507870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.509380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.510340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.511174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.511830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.691513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-973926bc-cd53-46be-8173-de0a1572d882 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:32.700178 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-973926bc-cd53-46be-8173-de0a1572d882 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1474 microversion: 2.1 time: 0.331225 Oct 11 19:44:32.701017 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 361/704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:32 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1474 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:32.706854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-13eefe2a-1ed6-4d14-8a97-c8903268a507 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:32.711388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-13eefe2a-1ed6-4d14-8a97-c8903268a507 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:32.723117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13eefe2a-1ed6-4d14-8a97-c8903268a507 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.723750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13eefe2a-1ed6-4d14-8a97-c8903268a507 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.724266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13eefe2a-1ed6-4d14-8a97-c8903268a507 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.725049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13eefe2a-1ed6-4d14-8a97-c8903268a507 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.725743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13eefe2a-1ed6-4d14-8a97-c8903268a507 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.726360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13eefe2a-1ed6-4d14-8a97-c8903268a507 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.861578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:32.882106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:32.883871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:32.885341 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78011bd6-0261-4635-a6fa-6fa3d7f31abe tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1362 microversion: 2.25 time: 0.392696 Oct 11 19:44:32.886822 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 344/705] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:32 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:32.945586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-82cafd49-f09d-4a13-a33e-0b995f938d21 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:32.946591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-82cafd49-f09d-4a13-a33e-0b995f938d21 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:32.953983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82cafd49-f09d-4a13-a33e-0b995f938d21 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.954803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82cafd49-f09d-4a13-a33e-0b995f938d21 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.955952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82cafd49-f09d-4a13-a33e-0b995f938d21 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.956440 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-13eefe2a-1ed6-4d14-8a97-c8903268a507 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1630 microversion: 2.1 time: 0.254138 Oct 11 19:44:32.957162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82cafd49-f09d-4a13-a33e-0b995f938d21 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:32.957408 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 362/706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:32 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1630 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:32.958301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82cafd49-f09d-4a13-a33e-0b995f938d21 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:32.959021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82cafd49-f09d-4a13-a33e-0b995f938d21 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:32.995169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a1c3230-3043-43ea-949f-9d9a7611965e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Action: 'create', calling method: .version_select at 0x7f83cc920f70>, body: {"keypair": {"name": "tempest-keypair-458505072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMch6eIDv4TAFUn/ybtJG/AzmfHArysFp7NWOLqPdnc+curdxcDdRamQrPzi/tXNbhvSbRpB59E/ylb7yls/b+VYe0ZPD3sEy5YbESV4LRMs/xIvynZbtqwydpnJX2mzGg=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:33.014760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-8a1c3230-3043-43ea-949f-9d9a7611965e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Getting quotas for project 947af1a9d24f4e19a59ec820ba1a65e4. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:33.022914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-8a1c3230-3043-43ea-949f-9d9a7611965e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Getting quotas for user 4e2460b9a8f34662b802709a91907510 and project 947af1a9d24f4e19a59ec820ba1a65e4. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:33.065315 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a1c3230-3043-43ea-949f-9d9a7611965e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078939 Oct 11 19:44:33.066516 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 363/707] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:44:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:33.122274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f9591259-da01-4730-be4f-9bbfb9e333b6 req-73b64d48-ed86-4837-87dc-3e72e5c110e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ecbdb6e-ccfd-4837-8e14-d316bbf156b9", "tag": "43f9af93-c53b-4d2a-a0b5-bc9140ac61f8"}, {"name": "network-changed", "server_uuid": "ff847e4e-cee6-43c2-add2-c4ea051c71fe", "tag": "4e1d87b7-e947-4cc8-8086-f1e31ac19bba"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:33.122898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82cafd49-f09d-4a13-a33e-0b995f938d21 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:33.136394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f9591259-da01-4730-be4f-9bbfb9e333b6 req-73b64d48-ed86-4837-87dc-3e72e5c110e6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:33.137026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f9591259-da01-4730-be4f-9bbfb9e333b6 req-73b64d48-ed86-4837-87dc-3e72e5c110e6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:33.137584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f9591259-da01-4730-be4f-9bbfb9e333b6 req-73b64d48-ed86-4837-87dc-3e72e5c110e6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:33.143804 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-82cafd49-f09d-4a13-a33e-0b995f938d21 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1318 microversion: 2.1 time: 0.201718 Oct 11 19:44:33.159128 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f9591259-da01-4730-be4f-9bbfb9e333b6 req-73b64d48-ed86-4837-87dc-3e72e5c110e6 service nova] Creating event network-changed:43f9af93-c53b-4d2a-a0b5-bc9140ac61f8 for instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 on n-h2-860864-3 Oct 11 19:44:33.159128 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f9591259-da01-4730-be4f-9bbfb9e333b6 req-73b64d48-ed86-4837-87dc-3e72e5c110e6 service nova] Creating event network-changed:4e1d87b7-e947-4cc8-8086-f1e31ac19bba for instance ff847e4e-cee6-43c2-add2-c4ea051c71fe on n-h1-860864-3 Oct 11 19:44:33.160075 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 345/708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:32 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:33.164485 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f9591259-da01-4730-be4f-9bbfb9e333b6 req-73b64d48-ed86-4837-87dc-3e72e5c110e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046318 Oct 11 19:44:33.165488 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 364/709] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:44:33.302333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:33.337024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:33.371851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1141882727", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:33.396202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-acf0e070-76d7-4fa3-a4d1-f9329c1b28e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:33.396914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-acf0e070-76d7-4fa3-a4d1-f9329c1b28e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:33.406608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf0e070-76d7-4fa3-a4d1-f9329c1b28e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:33.407246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf0e070-76d7-4fa3-a4d1-f9329c1b28e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:33.408264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf0e070-76d7-4fa3-a4d1-f9329c1b28e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:33.410860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf0e070-76d7-4fa3-a4d1-f9329c1b28e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:33.411749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf0e070-76d7-4fa3-a4d1-f9329c1b28e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:33.412801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf0e070-76d7-4fa3-a4d1-f9329c1b28e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:33.443289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:44:33.884832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-acf0e070-76d7-4fa3-a4d1-f9329c1b28e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:33.895211 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-acf0e070-76d7-4fa3-a4d1-f9329c1b28e0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1539 microversion: 2.1 time: 0.503461 Oct 11 19:44:33.896003 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 365/710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:33 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1539 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:33.918340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-644387ad-3cfe-463b-8472-15312b6944fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:33.919009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-644387ad-3cfe-463b-8472-15312b6944fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:33.928523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-644387ad-3cfe-463b-8472-15312b6944fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:33.928523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-644387ad-3cfe-463b-8472-15312b6944fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:33.928523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-644387ad-3cfe-463b-8472-15312b6944fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:33.928523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-644387ad-3cfe-463b-8472-15312b6944fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:33.928822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-644387ad-3cfe-463b-8472-15312b6944fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:33.928822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-644387ad-3cfe-463b-8472-15312b6944fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:33.964466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:44:33.965206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:44:33.965840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:44:33.966245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:44:33.966706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:44:33.980403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:33.981179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:33.981611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:33.982333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:33.982889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:33.983317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:34.003174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Getting quotas for project 1dc7fd4b21fb43a99990a513786fd9ec. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:34.009098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Getting quotas for user 0465ef383d894553a8116adca7f4cf0a and project 1dc7fd4b21fb43a99990a513786fd9ec. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:34.028271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:44:34.030994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:44:34.123506 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b75e13ae-484b-47d4-9466-f8e428957454 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871161 Oct 11 19:44:34.126753 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 346/711] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:44:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:44:34.136403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-43389304-8b6d-4eab-bbad-496187dd93c8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:34.138401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-43389304-8b6d-4eab-bbad-496187dd93c8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:34.147628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43389304-8b6d-4eab-bbad-496187dd93c8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:34.148456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43389304-8b6d-4eab-bbad-496187dd93c8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:34.149054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43389304-8b6d-4eab-bbad-496187dd93c8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:34.149985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43389304-8b6d-4eab-bbad-496187dd93c8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:34.150744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43389304-8b6d-4eab-bbad-496187dd93c8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:34.151499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43389304-8b6d-4eab-bbad-496187dd93c8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:34.162960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-644387ad-3cfe-463b-8472-15312b6944fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:34.176915 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-644387ad-3cfe-463b-8472-15312b6944fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1315 microversion: 2.1 time: 0.269591 Oct 11 19:44:34.179567 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 366/712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:33 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:34.187233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:34.188455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:34.208710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:34.209229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:34.212633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:34.213399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:34.216883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:34.217424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:34.541907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-43389304-8b6d-4eab-bbad-496187dd93c8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:34.550689 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-43389304-8b6d-4eab-bbad-496187dd93c8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1474 microversion: 2.1 time: 0.422763 Oct 11 19:44:34.554798 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 347/713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:34 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1474 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:34.561650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cb9655e8-8586-44f5-b110-501fd2168bf8 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:34.562261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cb9655e8-8586-44f5-b110-501fd2168bf8 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:34.571050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:34.583423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:34.591480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:34.593239 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-09dc080d-4fa2-4070-9fcd-5c28299ec965 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1362 microversion: 2.25 time: 0.412500 Oct 11 19:44:34.594503 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 367/714] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:34 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1362 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:34.617990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93721fc1-b74f-4fe3-9ee3-770b4ddbfdba tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:34.619523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-93721fc1-b74f-4fe3-9ee3-770b4ddbfdba tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:34.636334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93721fc1-b74f-4fe3-9ee3-770b4ddbfdba tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:34.637357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93721fc1-b74f-4fe3-9ee3-770b4ddbfdba tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:34.638032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93721fc1-b74f-4fe3-9ee3-770b4ddbfdba tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:34.639707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93721fc1-b74f-4fe3-9ee3-770b4ddbfdba tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:34.640490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93721fc1-b74f-4fe3-9ee3-770b4ddbfdba tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:34.641471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93721fc1-b74f-4fe3-9ee3-770b4ddbfdba tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:34.718056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cb9655e8-8586-44f5-b110-501fd2168bf8 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:34.727226 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cb9655e8-8586-44f5-b110-501fd2168bf8 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1214 microversion: 2.1 time: 0.171278 Oct 11 19:44:34.729994 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 348/715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:34 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:34.740574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a10818c4-875e-42da-912c-6f43d4044425 req-3de24b7e-ffb9-4c7d-b01d-3591bc1acd34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96af3c9-b2ae-4568-9aad-268b2595cf5f", "name": "network-vif-plugged", "status": "completed", "tag": "3ce1b418-c559-46e6-97d6-9f0890b9bfac"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:34.767708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a10818c4-875e-42da-912c-6f43d4044425 req-3de24b7e-ffb9-4c7d-b01d-3591bc1acd34 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:34.769914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a10818c4-875e-42da-912c-6f43d4044425 req-3de24b7e-ffb9-4c7d-b01d-3591bc1acd34 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:34.770619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a10818c4-875e-42da-912c-6f43d4044425 req-3de24b7e-ffb9-4c7d-b01d-3591bc1acd34 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:34.813473 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a10818c4-875e-42da-912c-6f43d4044425 req-3de24b7e-ffb9-4c7d-b01d-3591bc1acd34 service nova] Creating event network-vif-plugged:3ce1b418-c559-46e6-97d6-9f0890b9bfac for instance f96af3c9-b2ae-4568-9aad-268b2595cf5f on n-h2-860864-3 Oct 11 19:44:34.826851 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a10818c4-875e-42da-912c-6f43d4044425 req-3de24b7e-ffb9-4c7d-b01d-3591bc1acd34 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095492 Oct 11 19:44:34.827799 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 349/716] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:34.881368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-93721fc1-b74f-4fe3-9ee3-770b4ddbfdba tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:34.889512 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93721fc1-b74f-4fe3-9ee3-770b4ddbfdba tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1318 microversion: 2.1 time: 0.293675 Oct 11 19:44:34.890365 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 368/717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:34 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:34.927219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a36d02e2-565e-4a82-bc54-facbc6a77e8b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:34.928475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a36d02e2-565e-4a82-bc54-facbc6a77e8b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:34.937234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a36d02e2-565e-4a82-bc54-facbc6a77e8b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:34.937943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a36d02e2-565e-4a82-bc54-facbc6a77e8b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:34.938814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a36d02e2-565e-4a82-bc54-facbc6a77e8b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:34.940554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a36d02e2-565e-4a82-bc54-facbc6a77e8b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:34.941377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a36d02e2-565e-4a82-bc54-facbc6a77e8b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:34.942023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a36d02e2-565e-4a82-bc54-facbc6a77e8b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:35.209415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-521e6109-68f5-4121-982e-fb77b8d8506d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:35.210303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-521e6109-68f5-4121-982e-fb77b8d8506d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:35.224772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-521e6109-68f5-4121-982e-fb77b8d8506d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:35.225278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-521e6109-68f5-4121-982e-fb77b8d8506d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:35.225745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-521e6109-68f5-4121-982e-fb77b8d8506d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:35.226436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-521e6109-68f5-4121-982e-fb77b8d8506d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:35.226927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-521e6109-68f5-4121-982e-fb77b8d8506d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:35.227371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-521e6109-68f5-4121-982e-fb77b8d8506d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:35.232717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a36d02e2-565e-4a82-bc54-facbc6a77e8b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:35.242062 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a36d02e2-565e-4a82-bc54-facbc6a77e8b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.321614 Oct 11 19:44:35.242674 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 350/718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:34 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:35.250407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1262657366", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "12e7d5a8-d39a-440c-a1be-ed5e1c015008"}], "security_groups": [{"name": "tempest-securitygroup--1056797174"}], "key_name": "tempest-keypair-458505072", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:35.477357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-521e6109-68f5-4121-982e-fb77b8d8506d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:35.477564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] validate_networks() for [('12e7d5a8-d39a-440c-a1be-ed5e1c015008', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:44:35.488162 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-521e6109-68f5-4121-982e-fb77b8d8506d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1315 microversion: 2.1 time: 0.284698 Oct 11 19:44:35.490006 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 369/719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:35 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:35.495995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c570abe1-6040-44c0-94c4-d5f6d88af79e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:35.496772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c570abe1-6040-44c0-94c4-d5f6d88af79e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:35.504451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c570abe1-6040-44c0-94c4-d5f6d88af79e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:35.505285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c570abe1-6040-44c0-94c4-d5f6d88af79e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:35.505968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c570abe1-6040-44c0-94c4-d5f6d88af79e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:35.506972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c570abe1-6040-44c0-94c4-d5f6d88af79e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:35.507668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c570abe1-6040-44c0-94c4-d5f6d88af79e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:35.508412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c570abe1-6040-44c0-94c4-d5f6d88af79e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:35.542601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c570abe1-6040-44c0-94c4-d5f6d88af79e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:44:35.629878 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c570abe1-6040-44c0-94c4-d5f6d88af79e tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 204 len: 0 microversion: 2.1 time: 0.138260 Oct 11 19:44:35.635075 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 370/720] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:44:35 2022] DELETE /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:44:35.640246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4d9fdec5-af9f-459a-b47f-20016340e817 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:35.640960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4d9fdec5-af9f-459a-b47f-20016340e817 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:35.647315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d9fdec5-af9f-459a-b47f-20016340e817 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:35.647830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d9fdec5-af9f-459a-b47f-20016340e817 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:35.648280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d9fdec5-af9f-459a-b47f-20016340e817 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:35.648986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d9fdec5-af9f-459a-b47f-20016340e817 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:35.649482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d9fdec5-af9f-459a-b47f-20016340e817 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:35.649911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d9fdec5-af9f-459a-b47f-20016340e817 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:35.669860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:36.223516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4d9fdec5-af9f-459a-b47f-20016340e817 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:36.233624 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4d9fdec5-af9f-459a-b47f-20016340e817 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1471 microversion: 2.1 time: 0.597509 Oct 11 19:44:36.246505 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 371/721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:35 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1471 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:36.253989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:36.254835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:36.261025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:36.261746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:36.262644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:36.263509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:36.263968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:36.264391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:36.565761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:36.574575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:36.577299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:36.578726 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-46b6133e-48be-434b-bb86-8c1405248786 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1362 microversion: 2.25 time: 0.331104 Oct 11 19:44:36.579292 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 372/722] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:36 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:36.585148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b0e1c50c-a1bd-45dd-97f4-1bbf24570074 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:36.586253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b0e1c50c-a1bd-45dd-97f4-1bbf24570074 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:36.595342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e1c50c-a1bd-45dd-97f4-1bbf24570074 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:36.597454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e1c50c-a1bd-45dd-97f4-1bbf24570074 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:36.598220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e1c50c-a1bd-45dd-97f4-1bbf24570074 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:36.599231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e1c50c-a1bd-45dd-97f4-1bbf24570074 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:36.599924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e1c50c-a1bd-45dd-97f4-1bbf24570074 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:36.600568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e1c50c-a1bd-45dd-97f4-1bbf24570074 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:36.719264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:44:36.720487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:44:36.721250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:44:36.721859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:44:36.722836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:44:36.736238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:36.737528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:36.738206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:36.739227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:36.739858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:36.740592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:36.764649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Getting quotas for project 947af1a9d24f4e19a59ec820ba1a65e4. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:36.773280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Getting quotas for user 4e2460b9a8f34662b802709a91907510 and project 947af1a9d24f4e19a59ec820ba1a65e4. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:36.791826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:44:36.795334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:44:36.828328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b0e1c50c-a1bd-45dd-97f4-1bbf24570074 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:36.843088 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b0e1c50c-a1bd-45dd-97f4-1bbf24570074 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1527 microversion: 2.1 time: 0.261872 Oct 11 19:44:36.844508 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 373/723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:36 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1527 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:36.851474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a2097ca-ee09-4ff4-b53d-965c74582d0a tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:36.852325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a2097ca-ee09-4ff4-b53d-965c74582d0a tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:36.860273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a2097ca-ee09-4ff4-b53d-965c74582d0a tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:36.861196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a2097ca-ee09-4ff4-b53d-965c74582d0a tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:36.862371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a2097ca-ee09-4ff4-b53d-965c74582d0a tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:36.863770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a2097ca-ee09-4ff4-b53d-965c74582d0a tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:36.864495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a2097ca-ee09-4ff4-b53d-965c74582d0a tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:36.865249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a2097ca-ee09-4ff4-b53d-965c74582d0a tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:36.879397 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-71ffe934-1170-49e1-8f04-84544c1f9f2c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.635058 Oct 11 19:44:36.879979 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 351/724] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:44:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:44:36.891376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0eaa4687-7fd1-42f8-a5fa-f7d8d788886c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:36.892032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0eaa4687-7fd1-42f8-a5fa-f7d8d788886c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:36.898840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eaa4687-7fd1-42f8-a5fa-f7d8d788886c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:36.899578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eaa4687-7fd1-42f8-a5fa-f7d8d788886c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:36.900186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eaa4687-7fd1-42f8-a5fa-f7d8d788886c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:36.901129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eaa4687-7fd1-42f8-a5fa-f7d8d788886c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:36.901758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eaa4687-7fd1-42f8-a5fa-f7d8d788886c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:36.902341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eaa4687-7fd1-42f8-a5fa-f7d8d788886c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:36.984140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a2097ca-ee09-4ff4-b53d-965c74582d0a tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:36.993914 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a2097ca-ee09-4ff4-b53d-965c74582d0a tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1272 microversion: 2.1 time: 0.147739 Oct 11 19:44:37.009509 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 374/725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:36 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:37.015114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-64461efe-479b-4744-83b4-bdee13f5cc9b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:37.015655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-64461efe-479b-4744-83b4-bdee13f5cc9b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:37.022883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64461efe-479b-4744-83b4-bdee13f5cc9b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.023381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64461efe-479b-4744-83b4-bdee13f5cc9b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.023823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64461efe-479b-4744-83b4-bdee13f5cc9b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:37.024526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64461efe-479b-4744-83b4-bdee13f5cc9b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.025257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64461efe-479b-4744-83b4-bdee13f5cc9b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.025391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64461efe-479b-4744-83b4-bdee13f5cc9b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:37.113313 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-64461efe-479b-4744-83b4-bdee13f5cc9b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89/action" status: 204 len: 0 microversion: 2.1 time: 0.102421 Oct 11 19:44:37.114065 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 375/726] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:44:37 2022] POST /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89/action => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:44:37.121874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-943651b5-ac65-4e78-aa10-1a670985acb8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:37.122698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-943651b5-ac65-4e78-aa10-1a670985acb8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:37.130411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943651b5-ac65-4e78-aa10-1a670985acb8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.131017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943651b5-ac65-4e78-aa10-1a670985acb8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.131562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943651b5-ac65-4e78-aa10-1a670985acb8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:37.132331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943651b5-ac65-4e78-aa10-1a670985acb8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.132821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943651b5-ac65-4e78-aa10-1a670985acb8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.133334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943651b5-ac65-4e78-aa10-1a670985acb8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:37.135234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0eaa4687-7fd1-42f8-a5fa-f7d8d788886c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:37.151317 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0eaa4687-7fd1-42f8-a5fa-f7d8d788886c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1318 microversion: 2.1 time: 0.262353 Oct 11 19:44:37.152698 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 352/727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:36 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:37.159863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a87aa58f-8f45-4af7-b418-2679b1db59ad req-f848acd0-231a-415b-883d-b1a1e96aaebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337", "name": "network-vif-plugged", "status": "completed", "tag": "8295ec70-df13-4a58-810c-672a4906086f"}, {"server_uuid": "ff847e4e-cee6-43c2-add2-c4ea051c71fe", "name": "network-vif-plugged", "status": "completed", "tag": "4e1d87b7-e947-4cc8-8086-f1e31ac19bba"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:37.181223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a87aa58f-8f45-4af7-b418-2679b1db59ad req-f848acd0-231a-415b-883d-b1a1e96aaebd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.182896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a87aa58f-8f45-4af7-b418-2679b1db59ad req-f848acd0-231a-415b-883d-b1a1e96aaebd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.183789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a87aa58f-8f45-4af7-b418-2679b1db59ad req-f848acd0-231a-415b-883d-b1a1e96aaebd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:37.207010 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a87aa58f-8f45-4af7-b418-2679b1db59ad req-f848acd0-231a-415b-883d-b1a1e96aaebd service nova] Creating event network-vif-plugged:8295ec70-df13-4a58-810c-672a4906086f for instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 on n-h2-860864-3 Oct 11 19:44:37.209134 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a87aa58f-8f45-4af7-b418-2679b1db59ad req-f848acd0-231a-415b-883d-b1a1e96aaebd service nova] Creating event network-vif-plugged:4e1d87b7-e947-4cc8-8086-f1e31ac19bba for instance ff847e4e-cee6-43c2-add2-c4ea051c71fe on n-h1-860864-3 Oct 11 19:44:37.218474 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a87aa58f-8f45-4af7-b418-2679b1db59ad req-f848acd0-231a-415b-883d-b1a1e96aaebd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062758 Oct 11 19:44:37.219194 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 353/728] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:37.230984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a65b0e6-a828-4109-8530-622f2c5c2132 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:37.231740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0a65b0e6-a828-4109-8530-622f2c5c2132 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:37.366387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0a65b0e6-a828-4109-8530-622f2c5c2132 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:37.377872 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a65b0e6-a828-4109-8530-622f2c5c2132 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1234 microversion: 2.1 time: 0.149459 Oct 11 19:44:37.379956 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 354/729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:37 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1234 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:37.400024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e708b70-4fac-40e5-97e9-9eb57b54f94c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:37.400743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1e708b70-4fac-40e5-97e9-9eb57b54f94c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:37.414610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e708b70-4fac-40e5-97e9-9eb57b54f94c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.415037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e708b70-4fac-40e5-97e9-9eb57b54f94c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.415490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e708b70-4fac-40e5-97e9-9eb57b54f94c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:37.416214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e708b70-4fac-40e5-97e9-9eb57b54f94c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.416641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e708b70-4fac-40e5-97e9-9eb57b54f94c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.423046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e708b70-4fac-40e5-97e9-9eb57b54f94c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:37.637653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-943651b5-ac65-4e78-aa10-1a670985acb8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:37.647652 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-943651b5-ac65-4e78-aa10-1a670985acb8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1315 microversion: 2.1 time: 0.532146 Oct 11 19:44:37.648456 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 376/730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:37 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:37.654112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:37.655119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:37.663020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.663615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.664160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:37.664971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.665526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.666177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:37.929551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1e708b70-4fac-40e5-97e9-9eb57b54f94c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:37.940593 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1e708b70-4fac-40e5-97e9-9eb57b54f94c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1471 microversion: 2.1 time: 0.558454 Oct 11 19:44:37.941449 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 355/731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:37 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1471 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:37.947112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c862ccb-a86f-4bcc-aef2-64c140fbf758 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:37.948059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c862ccb-a86f-4bcc-aef2-64c140fbf758 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:37.968411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c862ccb-a86f-4bcc-aef2-64c140fbf758 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.969397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c862ccb-a86f-4bcc-aef2-64c140fbf758 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.970081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c862ccb-a86f-4bcc-aef2-64c140fbf758 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:37.970852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c862ccb-a86f-4bcc-aef2-64c140fbf758 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:37.973149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c862ccb-a86f-4bcc-aef2-64c140fbf758 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:37.973643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c862ccb-a86f-4bcc-aef2-64c140fbf758 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:38.091438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:38.104797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:38.106490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:38.107987 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d66eff73-10c7-40ea-ab71-2f7a928e33a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1362 microversion: 2.25 time: 0.458132 Oct 11 19:44:38.108832 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 377/732] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:37 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:38.119906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-354eba5e-9393-4090-ad7b-5b6c2b7d0a08 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:38.123962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-354eba5e-9393-4090-ad7b-5b6c2b7d0a08 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:38.140708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-354eba5e-9393-4090-ad7b-5b6c2b7d0a08 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:38.141224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-354eba5e-9393-4090-ad7b-5b6c2b7d0a08 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:38.141671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-354eba5e-9393-4090-ad7b-5b6c2b7d0a08 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:38.142387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-354eba5e-9393-4090-ad7b-5b6c2b7d0a08 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:38.143597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-354eba5e-9393-4090-ad7b-5b6c2b7d0a08 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:38.144108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-354eba5e-9393-4090-ad7b-5b6c2b7d0a08 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:38.478919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c862ccb-a86f-4bcc-aef2-64c140fbf758 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:38.488503 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c862ccb-a86f-4bcc-aef2-64c140fbf758 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1527 microversion: 2.1 time: 0.545827 Oct 11 19:44:38.489756 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 356/733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:37 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1527 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:38.506868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-601bc3ca-a2c4-4a75-a823-c28db1d1de0b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:38.507482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-601bc3ca-a2c4-4a75-a823-c28db1d1de0b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:38.519363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-601bc3ca-a2c4-4a75-a823-c28db1d1de0b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:38.520158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-601bc3ca-a2c4-4a75-a823-c28db1d1de0b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:38.520761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-601bc3ca-a2c4-4a75-a823-c28db1d1de0b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:38.521703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-601bc3ca-a2c4-4a75-a823-c28db1d1de0b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:38.522476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-601bc3ca-a2c4-4a75-a823-c28db1d1de0b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:38.523071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-601bc3ca-a2c4-4a75-a823-c28db1d1de0b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:38.562482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-354eba5e-9393-4090-ad7b-5b6c2b7d0a08 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:38.586308 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-354eba5e-9393-4090-ad7b-5b6c2b7d0a08 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1314 microversion: 2.1 time: 0.476021 Oct 11 19:44:38.589018 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 378/734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:38 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:38.605091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1579b25b-7dc0-4b3d-b175-53bd63667ca0 req-56a47386-3a8c-4c8b-9ebb-f6851f55b549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96af3c9-b2ae-4568-9aad-268b2595cf5f", "name": "network-vif-deleted", "tag": "3ce1b418-c559-46e6-97d6-9f0890b9bfac"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:38.616301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1579b25b-7dc0-4b3d-b175-53bd63667ca0 req-56a47386-3a8c-4c8b-9ebb-f6851f55b549 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:38.616904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1579b25b-7dc0-4b3d-b175-53bd63667ca0 req-56a47386-3a8c-4c8b-9ebb-f6851f55b549 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:38.617454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1579b25b-7dc0-4b3d-b175-53bd63667ca0 req-56a47386-3a8c-4c8b-9ebb-f6851f55b549 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:38.630689 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1579b25b-7dc0-4b3d-b175-53bd63667ca0 req-56a47386-3a8c-4c8b-9ebb-f6851f55b549 service nova] Creating event network-vif-deleted:3ce1b418-c559-46e6-97d6-9f0890b9bfac for instance f96af3c9-b2ae-4568-9aad-268b2595cf5f on n-h2-860864-3 Oct 11 19:44:38.636362 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1579b25b-7dc0-4b3d-b175-53bd63667ca0 req-56a47386-3a8c-4c8b-9ebb-f6851f55b549 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043906 Oct 11 19:44:38.640859 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 379/735] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:38.646826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-240da2b3-d94d-4d44-b7f3-06825538ed49 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:38.650445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-240da2b3-d94d-4d44-b7f3-06825538ed49 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:38.657617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240da2b3-d94d-4d44-b7f3-06825538ed49 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:38.659004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240da2b3-d94d-4d44-b7f3-06825538ed49 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:38.659675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240da2b3-d94d-4d44-b7f3-06825538ed49 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:38.660821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240da2b3-d94d-4d44-b7f3-06825538ed49 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:38.661481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240da2b3-d94d-4d44-b7f3-06825538ed49 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:38.662104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240da2b3-d94d-4d44-b7f3-06825538ed49 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:38.999470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-240da2b3-d94d-4d44-b7f3-06825538ed49 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:39.008423 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-240da2b3-d94d-4d44-b7f3-06825538ed49 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1286 microversion: 2.1 time: 0.365651 Oct 11 19:44:39.008783 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 380/736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:38 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1286 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:39.018668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ac6b51bd-4b8d-4fed-bc9b-8b703aa61222 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:39.019698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ac6b51bd-4b8d-4fed-bc9b-8b703aa61222 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:39.025898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac6b51bd-4b8d-4fed-bc9b-8b703aa61222 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.026401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac6b51bd-4b8d-4fed-bc9b-8b703aa61222 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.026870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac6b51bd-4b8d-4fed-bc9b-8b703aa61222 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.027757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac6b51bd-4b8d-4fed-bc9b-8b703aa61222 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.028221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac6b51bd-4b8d-4fed-bc9b-8b703aa61222 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.028651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac6b51bd-4b8d-4fed-bc9b-8b703aa61222 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.171824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-601bc3ca-a2c4-4a75-a823-c28db1d1de0b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:39.180921 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-601bc3ca-a2c4-4a75-a823-c28db1d1de0b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1318 microversion: 2.1 time: 0.689778 Oct 11 19:44:39.181978 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 357/737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:38 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:39.187171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8826449f-d442-45c2-908c-501de9318258 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:39.188005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8826449f-d442-45c2-908c-501de9318258 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:39.195936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8826449f-d442-45c2-908c-501de9318258 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.196671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8826449f-d442-45c2-908c-501de9318258 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.197289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8826449f-d442-45c2-908c-501de9318258 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.197992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8826449f-d442-45c2-908c-501de9318258 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.198704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8826449f-d442-45c2-908c-501de9318258 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.199307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8826449f-d442-45c2-908c-501de9318258 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.275382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ac6b51bd-4b8d-4fed-bc9b-8b703aa61222 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:39.284607 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ac6b51bd-4b8d-4fed-bc9b-8b703aa61222 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1315 microversion: 2.1 time: 0.272645 Oct 11 19:44:39.285338 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 381/738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:39 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:39.291391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:39.292006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:39.305334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.305985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.306774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.307444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.307913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.308347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.581350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8826449f-d442-45c2-908c-501de9318258 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:39.594513 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8826449f-d442-45c2-908c-501de9318258 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1471 microversion: 2.1 time: 0.409292 Oct 11 19:44:39.596503 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 358/739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:39 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1471 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:39.609628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4f47ea52-8390-44dc-bcb4-654f734c1297 req-17858ff3-7e26-42db-8dbf-d6173cb89572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1463ded-d983-4703-b256-08dfbb0cda89", "name": "network-vif-plugged", "status": "completed", "tag": "9a1e3906-cf0e-4288-b9c2-eba283fe7bcf"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:39.626628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4f47ea52-8390-44dc-bcb4-654f734c1297 req-17858ff3-7e26-42db-8dbf-d6173cb89572 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.628031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4f47ea52-8390-44dc-bcb4-654f734c1297 req-17858ff3-7e26-42db-8dbf-d6173cb89572 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.629018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4f47ea52-8390-44dc-bcb4-654f734c1297 req-17858ff3-7e26-42db-8dbf-d6173cb89572 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.652595 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4f47ea52-8390-44dc-bcb4-654f734c1297 req-17858ff3-7e26-42db-8dbf-d6173cb89572 service nova] Creating event network-vif-plugged:9a1e3906-cf0e-4288-b9c2-eba283fe7bcf for instance b1463ded-d983-4703-b256-08dfbb0cda89 on n-h2-860864-3 Oct 11 19:44:39.660980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-4f47ea52-8390-44dc-bcb4-654f734c1297 req-17858ff3-7e26-42db-8dbf-d6173cb89572 service nova] Instance b1463ded-d983-4703-b256-08dfbb0cda89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:44:39.673447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4f47ea52-8390-44dc-bcb4-654f734c1297 req-17858ff3-7e26-42db-8dbf-d6173cb89572 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075464 Oct 11 19:44:39.674891 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 359/740] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:39.682381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:39.695861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:39.696608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:39.698935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:39.700520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:39.701718 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ab592fc1-92d9-4f3d-b99a-184932d93744 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1558 microversion: 2.25 time: 0.414231 Oct 11 19:44:39.704741 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 382/741] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:39 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1558 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:39.714123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.717661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a595edd1-cae1-40d0-84de-0e38a381cb28 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:39.717948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.718617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.719509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.720130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.720774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a595edd1-cae1-40d0-84de-0e38a381cb28 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:39.721449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.732062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a595edd1-cae1-40d0-84de-0e38a381cb28 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.732567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a595edd1-cae1-40d0-84de-0e38a381cb28 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.733009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a595edd1-cae1-40d0-84de-0e38a381cb28 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.733897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a595edd1-cae1-40d0-84de-0e38a381cb28 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.734369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a595edd1-cae1-40d0-84de-0e38a381cb28 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.734825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a595edd1-cae1-40d0-84de-0e38a381cb28 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.759933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:39.760698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:39.761297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:39.761944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lazy-loading 'fault' on Instance uuid f96af3c9-b2ae-4568-9aad-268b2595cf5f {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:39.850763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:39.859105 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-46b787e5-787f-42bb-86f7-f0836a7e1129 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 200 len: 1315 microversion: 2.1 time: 0.182399 Oct 11 19:44:39.860009 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 360/742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:39 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:39.982952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a595edd1-cae1-40d0-84de-0e38a381cb28 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:39.992766 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a595edd1-cae1-40d0-84de-0e38a381cb28 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1314 microversion: 2.1 time: 0.284637 Oct 11 19:44:39.995259 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 383/743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:39 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:40.034840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bdee32b0-80ef-466d-ab75-e7d6c94070fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:40.035741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bdee32b0-80ef-466d-ab75-e7d6c94070fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:40.051600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdee32b0-80ef-466d-ab75-e7d6c94070fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.052254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdee32b0-80ef-466d-ab75-e7d6c94070fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.052599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdee32b0-80ef-466d-ab75-e7d6c94070fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.053385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdee32b0-80ef-466d-ab75-e7d6c94070fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.053880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdee32b0-80ef-466d-ab75-e7d6c94070fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.054415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdee32b0-80ef-466d-ab75-e7d6c94070fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.131572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c11d9932-13e1-4b27-9488-a46dee1f9d94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:40.132317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c11d9932-13e1-4b27-9488-a46dee1f9d94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:40.135245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:40.137443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bdee32b0-80ef-466d-ab75-e7d6c94070fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:40.141006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c11d9932-13e1-4b27-9488-a46dee1f9d94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.141502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c11d9932-13e1-4b27-9488-a46dee1f9d94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.141937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c11d9932-13e1-4b27-9488-a46dee1f9d94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.142801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c11d9932-13e1-4b27-9488-a46dee1f9d94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.143267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c11d9932-13e1-4b27-9488-a46dee1f9d94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.143964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c11d9932-13e1-4b27-9488-a46dee1f9d94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.145589 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bdee32b0-80ef-466d-ab75-e7d6c94070fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1292 microversion: 2.1 time: 0.116888 Oct 11 19:44:40.146182 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 384/744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:40 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1292 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:40.147254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:40.151975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-517c60b1-cb94-4837-b98b-0448e83e18c2 req-bbddb4b4-8fcd-4d16-bc7a-0e29ae86e236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba749f54-95af-4373-a6c8-c7e54b4091f3", "tag": "253f7484-d56b-4b0f-8146-b613fea588c9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:40.162841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-517c60b1-cb94-4837-b98b-0448e83e18c2 req-bbddb4b4-8fcd-4d16-bc7a-0e29ae86e236 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.163580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-517c60b1-cb94-4837-b98b-0448e83e18c2 req-bbddb4b4-8fcd-4d16-bc7a-0e29ae86e236 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.164194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-517c60b1-cb94-4837-b98b-0448e83e18c2 req-bbddb4b4-8fcd-4d16-bc7a-0e29ae86e236 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.175940 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-517c60b1-cb94-4837-b98b-0448e83e18c2 req-bbddb4b4-8fcd-4d16-bc7a-0e29ae86e236 service nova] Creating event network-changed:253f7484-d56b-4b0f-8146-b613fea588c9 for instance ba749f54-95af-4373-a6c8-c7e54b4091f3 on n-h1-860864-3 Oct 11 19:44:40.180969 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-517c60b1-cb94-4837-b98b-0448e83e18c2 req-bbddb4b4-8fcd-4d16-bc7a-0e29ae86e236 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033412 Oct 11 19:44:40.182154 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 385/745] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:40.206875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df9c38aa-72df-4e02-88e0-da9f52bef219 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:40.208656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-df9c38aa-72df-4e02-88e0-da9f52bef219 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:40.216400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9c38aa-72df-4e02-88e0-da9f52bef219 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.216902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9c38aa-72df-4e02-88e0-da9f52bef219 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.217348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9c38aa-72df-4e02-88e0-da9f52bef219 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.218061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9c38aa-72df-4e02-88e0-da9f52bef219 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.218535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9c38aa-72df-4e02-88e0-da9f52bef219 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.218974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9c38aa-72df-4e02-88e0-da9f52bef219 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.409467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-c11d9932-13e1-4b27-9488-a46dee1f9d94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:40.480137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df9c38aa-72df-4e02-88e0-da9f52bef219 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:40.495388 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-df9c38aa-72df-4e02-88e0-da9f52bef219 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1318 microversion: 2.1 time: 0.293984 Oct 11 19:44:40.496036 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 386/746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:40 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:40.504559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2839087d-b3c4-40d2-8a8b-cad39731bb33 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:40.506149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2839087d-b3c4-40d2-8a8b-cad39731bb33 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:40.520212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c11d9932-13e1-4b27-9488-a46dee1f9d94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 2051 microversion: 2.25 time: 0.658834 Oct 11 19:44:40.526876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 361/747] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:39 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 2051 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:40.533739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2839087d-b3c4-40d2-8a8b-cad39731bb33 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.534547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2839087d-b3c4-40d2-8a8b-cad39731bb33 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.536627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2839087d-b3c4-40d2-8a8b-cad39731bb33 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.538598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2839087d-b3c4-40d2-8a8b-cad39731bb33 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.541634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2839087d-b3c4-40d2-8a8b-cad39731bb33 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.542332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2839087d-b3c4-40d2-8a8b-cad39731bb33 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.549984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f125a2e-b0d5-4231-b240-debec8e294bc tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:40.550655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0f125a2e-b0d5-4231-b240-debec8e294bc tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:40.557326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f125a2e-b0d5-4231-b240-debec8e294bc tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.557678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f125a2e-b0d5-4231-b240-debec8e294bc tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.558288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f125a2e-b0d5-4231-b240-debec8e294bc tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.559014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f125a2e-b0d5-4231-b240-debec8e294bc tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.559644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f125a2e-b0d5-4231-b240-debec8e294bc tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.560240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f125a2e-b0d5-4231-b240-debec8e294bc tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.904969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-0f125a2e-b0d5-4231-b240-debec8e294bc tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:40.918175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2839087d-b3c4-40d2-8a8b-cad39731bb33 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:40.925918 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f125a2e-b0d5-4231-b240-debec8e294bc tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 2051 microversion: 2.25 time: 0.382444 Oct 11 19:44:40.926958 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2839087d-b3c4-40d2-8a8b-cad39731bb33 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1464 microversion: 2.1 time: 0.429553 Oct 11 19:44:40.927780 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 387/748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:40 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1464 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:40.928857 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 362/749] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:40 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 2051 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:40.935226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5e3bedc4-99a2-4e1e-bc54-d5fc72a81b17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:40.938137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5e3bedc4-99a2-4e1e-bc54-d5fc72a81b17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:40.951398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e3bedc4-99a2-4e1e-bc54-d5fc72a81b17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.951748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:40.951939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e3bedc4-99a2-4e1e-bc54-d5fc72a81b17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.952245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e3bedc4-99a2-4e1e-bc54-d5fc72a81b17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.952951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e3bedc4-99a2-4e1e-bc54-d5fc72a81b17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.953079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:40.953419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e3bedc4-99a2-4e1e-bc54-d5fc72a81b17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.953847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e3bedc4-99a2-4e1e-bc54-d5fc72a81b17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.959912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.960681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.961311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.962223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:40.962732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:40.963376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:40.977154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:40.980883 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f HTTP/1.1 Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:44:40.983549 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:44:40.985251 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'f96af3c9-b2ae-4568-9aad-268b2595cf5f'} Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:40.986159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:44:40.987859 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:40.989331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 404 to user: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:40.989756 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6412cc0e-336f-4454-a62e-3119e2107bdc tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 404 len: 111 microversion: 2.1 time: 0.049303 Oct 11 19:44:40.990721 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 363/750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:40 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:44:40.995252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ce40b1c-6099-45ce-b3c0-df47f60aeb14 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:40.995934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0ce40b1c-6099-45ce-b3c0-df47f60aeb14 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:41.002669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ce40b1c-6099-45ce-b3c0-df47f60aeb14 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.003336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ce40b1c-6099-45ce-b3c0-df47f60aeb14 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.003835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ce40b1c-6099-45ce-b3c0-df47f60aeb14 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.004702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ce40b1c-6099-45ce-b3c0-df47f60aeb14 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.005150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ce40b1c-6099-45ce-b3c0-df47f60aeb14 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.005729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ce40b1c-6099-45ce-b3c0-df47f60aeb14 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.229026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5e3bedc4-99a2-4e1e-bc54-d5fc72a81b17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:41.241147 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5e3bedc4-99a2-4e1e-bc54-d5fc72a81b17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1463 microversion: 2.1 time: 0.312091 Oct 11 19:44:41.242094 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 388/751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:40 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1463 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:41.244511 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0ce40b1c-6099-45ce-b3c0-df47f60aeb14 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1615 microversion: 2.1 time: 0.252672 Oct 11 19:44:41.245083 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 364/752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:40 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1615 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:41.249846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2450750-f678-4e91-9ea5-d33357a0cad9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:41.250707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2450750-f678-4e91-9ea5-d33357a0cad9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:41.263458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-89c0721c-9a82-4e7f-9e63-c8c4b1603d64 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:41.270962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c0721c-9a82-4e7f-9e63-c8c4b1603d64 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.271173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2450750-f678-4e91-9ea5-d33357a0cad9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.271915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2450750-f678-4e91-9ea5-d33357a0cad9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.272030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c0721c-9a82-4e7f-9e63-c8c4b1603d64 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.272141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2450750-f678-4e91-9ea5-d33357a0cad9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.272440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c0721c-9a82-4e7f-9e63-c8c4b1603d64 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.272805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2450750-f678-4e91-9ea5-d33357a0cad9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.273258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c0721c-9a82-4e7f-9e63-c8c4b1603d64 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.273448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2450750-f678-4e91-9ea5-d33357a0cad9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.273653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c0721c-9a82-4e7f-9e63-c8c4b1603d64 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.273838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2450750-f678-4e91-9ea5-d33357a0cad9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.274096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c0721c-9a82-4e7f-9e63-c8c4b1603d64 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.302269 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-89c0721c-9a82-4e7f-9e63-c8c4b1603d64 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046625 Oct 11 19:44:41.310822 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 389/753] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Oct 11 19:44:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:44:41.310822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-226127123", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:41.380686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] validate_networks() for [('7a7a5c8e-4510-4be6-9fd7-12b19dbcc68f', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:44:41.459444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a2450750-f678-4e91-9ea5-d33357a0cad9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:41.468441 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2450750-f678-4e91-9ea5-d33357a0cad9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1314 microversion: 2.1 time: 0.222173 Oct 11 19:44:41.479378 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 365/754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:41 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:41.479378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dd7c0989-07db-4936-b538-2af8eaa5ea6d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:41.479378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dd7c0989-07db-4936-b538-2af8eaa5ea6d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:41.484879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd7c0989-07db-4936-b538-2af8eaa5ea6d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.485362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd7c0989-07db-4936-b538-2af8eaa5ea6d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.485793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd7c0989-07db-4936-b538-2af8eaa5ea6d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.487635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd7c0989-07db-4936-b538-2af8eaa5ea6d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.487915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd7c0989-07db-4936-b538-2af8eaa5ea6d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.488355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd7c0989-07db-4936-b538-2af8eaa5ea6d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.706419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dd7c0989-07db-4936-b538-2af8eaa5ea6d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:41.713997 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dd7c0989-07db-4936-b538-2af8eaa5ea6d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1360 microversion: 2.1 time: 0.243765 Oct 11 19:44:41.714493 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 366/755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:41 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1360 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:41.718868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bee863c5-d734-486b-834a-7611e95cee8c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:41.719463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bee863c5-d734-486b-834a-7611e95cee8c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:41.727625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bee863c5-d734-486b-834a-7611e95cee8c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.728192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bee863c5-d734-486b-834a-7611e95cee8c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.728723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bee863c5-d734-486b-834a-7611e95cee8c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.729491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bee863c5-d734-486b-834a-7611e95cee8c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.729949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bee863c5-d734-486b-834a-7611e95cee8c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.730367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bee863c5-d734-486b-834a-7611e95cee8c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.889460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:44:41.889937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:44:41.890332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:44:41.890779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:44:41.891235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:44:41.900560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.901046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.901476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.902203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.902679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.903101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.912545 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bee863c5-d734-486b-834a-7611e95cee8c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1614 microversion: 2.1 time: 0.196856 Oct 11 19:44:41.913192 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 367/756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:41 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1614 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:41.921471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Getting quotas for project 21a886c8ddf44b77974321e34b2fad8a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:41.927375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Getting quotas for user 23b671bc2d4849be938178f53135af2d and project 21a886c8ddf44b77974321e34b2fad8a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:41.927777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-3", "block_migration": "auto"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:41.930414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:41.937122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.937605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.937756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:41.938337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.939097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:41.939792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:41.940223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:41.942668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:44:41.944987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:44:41.968672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'flavor' on Instance uuid fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:41.982989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Going to try to live migrate instance to n-h1-860864-3 {{(pid=126956) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 19:44:41.997331 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c9acde9a-f712-4dd1-91a7-f8bb044453d2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.692982 Oct 11 19:44:42.004120 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 390/757] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:44:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:44:42.004120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1147269396", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f392b558-6079-4c4d-88bd-a50aa499dce6"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:42.058580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:44:42.428951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:44:42.429553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:44:42.430713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:44:42.431230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:44:42.432148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:44:42.451046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:42.452828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:42.458753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:42.459851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:42.461723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:42.462855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:42.483895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:42.490341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Getting quotas for user d473bc95d6ea47978e08f9ceaebf2343 and project f8be7ff18ac24462858896eaf1e29fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:42.505715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:44:42.508282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:44:42.600122 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-642ccc16-e980-458d-8ec1-4ab497809059 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601030 Oct 11 19:44:42.612449 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 391/758] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:44:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:44:42.619400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-05bcbcf4-d569-49c9-b78b-5f814544391a req-eb080720-4326-4208-a45c-16f6ca3b6576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2bcc99-b3f9-47c2-bb34-4f3a24081296", "tag": "b2665c89-ac83-4c8b-9c20-01ff3ddcd688"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:42.642170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-05bcbcf4-d569-49c9-b78b-5f814544391a req-eb080720-4326-4208-a45c-16f6ca3b6576 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:42.642897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-05bcbcf4-d569-49c9-b78b-5f814544391a req-eb080720-4326-4208-a45c-16f6ca3b6576 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:42.643498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-05bcbcf4-d569-49c9-b78b-5f814544391a req-eb080720-4326-4208-a45c-16f6ca3b6576 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:42.689338 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-05bcbcf4-d569-49c9-b78b-5f814544391a req-eb080720-4326-4208-a45c-16f6ca3b6576 service nova] Creating event network-changed:b2665c89-ac83-4c8b-9c20-01ff3ddcd688 for instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 on n-h1-860864-3 Oct 11 19:44:42.706717 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-05bcbcf4-d569-49c9-b78b-5f814544391a req-eb080720-4326-4208-a45c-16f6ca3b6576 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089871 Oct 11 19:44:42.708511 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 392/759] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:42.724162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e9efd7a8-f836-4cee-b92b-9c719d54dce7 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:42.724871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e9efd7a8-f836-4cee-b92b-9c719d54dce7 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:42.739117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9efd7a8-f836-4cee-b92b-9c719d54dce7 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:42.740110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9efd7a8-f836-4cee-b92b-9c719d54dce7 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:42.740725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9efd7a8-f836-4cee-b92b-9c719d54dce7 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:42.741716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9efd7a8-f836-4cee-b92b-9c719d54dce7 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:42.742393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9efd7a8-f836-4cee-b92b-9c719d54dce7 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:42.742980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9efd7a8-f836-4cee-b92b-9c719d54dce7 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.031108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e9efd7a8-f836-4cee-b92b-9c719d54dce7 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:43.052084 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e9efd7a8-f836-4cee-b92b-9c719d54dce7 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1318 microversion: 2.1 time: 0.341661 Oct 11 19:44:43.052695 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 393/760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:42 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:43.059733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-96f7b21a-d5af-4c99-934a-a2048f3c1a0e req-9a627595-8cf3-4049-bed1-c13b6b4340d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecbdb6e-ccfd-4837-8e14-d316bbf156b9", "name": "network-vif-plugged", "status": "completed", "tag": "43f9af93-c53b-4d2a-a0b5-bc9140ac61f8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:43.081274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-96f7b21a-d5af-4c99-934a-a2048f3c1a0e req-9a627595-8cf3-4049-bed1-c13b6b4340d9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:43.081782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-96f7b21a-d5af-4c99-934a-a2048f3c1a0e req-9a627595-8cf3-4049-bed1-c13b6b4340d9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:43.082262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-96f7b21a-d5af-4c99-934a-a2048f3c1a0e req-9a627595-8cf3-4049-bed1-c13b6b4340d9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.097924 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-96f7b21a-d5af-4c99-934a-a2048f3c1a0e req-9a627595-8cf3-4049-bed1-c13b6b4340d9 service nova] Creating event network-vif-plugged:43f9af93-c53b-4d2a-a0b5-bc9140ac61f8 for instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 on n-h2-860864-3 Oct 11 19:44:43.107217 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-96f7b21a-d5af-4c99-934a-a2048f3c1a0e req-9a627595-8cf3-4049-bed1-c13b6b4340d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053111 Oct 11 19:44:43.108819 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 394/761] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:43.114962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-701b5405-080a-4f8a-8321-d00a758741af tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '.version_select at 0x7f83ccd834c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:43.119901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-701b5405-080a-4f8a-8321-d00a758741af tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:43.120408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-701b5405-080a-4f8a-8321-d00a758741af tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:43.121990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-701b5405-080a-4f8a-8321-d00a758741af tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.136434 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-701b5405-080a-4f8a-8321-d00a758741af tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1514 microversion: 2.1 time: 0.025349 Oct 11 19:44:43.138501 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 395/762] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:44:43 2022] GET /compute/v2.1/os-migrations => generated 1514 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:43.154204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-47e5cdcd-9200-4300-971e-5ddd087d953a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:43.163865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-47e5cdcd-9200-4300-971e-5ddd087d953a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:43.173034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e5cdcd-9200-4300-971e-5ddd087d953a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:43.173880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e5cdcd-9200-4300-971e-5ddd087d953a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:43.174209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e5cdcd-9200-4300-971e-5ddd087d953a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.174980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e5cdcd-9200-4300-971e-5ddd087d953a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:43.175437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e5cdcd-9200-4300-971e-5ddd087d953a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:43.175911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e5cdcd-9200-4300-971e-5ddd087d953a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.301190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-47e5cdcd-9200-4300-971e-5ddd087d953a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:43.326571 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-47e5cdcd-9200-4300-971e-5ddd087d953a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1276 microversion: 2.1 time: 0.185982 Oct 11 19:44:43.334697 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 396/763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:43 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:43.342065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c98e780-0a4b-4967-aad1-4815afbb3cfb tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:43.346564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5c98e780-0a4b-4967-aad1-4815afbb3cfb tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:43.353903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c98e780-0a4b-4967-aad1-4815afbb3cfb tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:43.354425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c98e780-0a4b-4967-aad1-4815afbb3cfb tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:43.354892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c98e780-0a4b-4967-aad1-4815afbb3cfb tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.355606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c98e780-0a4b-4967-aad1-4815afbb3cfb tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:43.356070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c98e780-0a4b-4967-aad1-4815afbb3cfb tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:43.356796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c98e780-0a4b-4967-aad1-4815afbb3cfb tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.538277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5c98e780-0a4b-4967-aad1-4815afbb3cfb tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:43.546356 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5c98e780-0a4b-4967-aad1-4815afbb3cfb tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1314 microversion: 2.1 time: 0.210378 Oct 11 19:44:43.546964 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 397/764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:43 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:43.552281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e34ccb9b-17a8-4793-8653-0f83eb8cadfd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:43.552894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e34ccb9b-17a8-4793-8653-0f83eb8cadfd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:43.559053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e34ccb9b-17a8-4793-8653-0f83eb8cadfd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:43.559545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e34ccb9b-17a8-4793-8653-0f83eb8cadfd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:43.559985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e34ccb9b-17a8-4793-8653-0f83eb8cadfd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.560679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e34ccb9b-17a8-4793-8653-0f83eb8cadfd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:43.561138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e34ccb9b-17a8-4793-8653-0f83eb8cadfd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:43.561572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e34ccb9b-17a8-4793-8653-0f83eb8cadfd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.626800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e34ccb9b-17a8-4793-8653-0f83eb8cadfd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:43.635183 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e34ccb9b-17a8-4793-8653-0f83eb8cadfd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1221 microversion: 2.1 time: 0.087226 Oct 11 19:44:43.635795 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 398/765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:43 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:43.640231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f87cf942-cbe3-4bee-a90b-4d8acf2cabd3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:43.641107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f87cf942-cbe3-4bee-a90b-4d8acf2cabd3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:43.647294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f87cf942-cbe3-4bee-a90b-4d8acf2cabd3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:43.647796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f87cf942-cbe3-4bee-a90b-4d8acf2cabd3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:43.648240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f87cf942-cbe3-4bee-a90b-4d8acf2cabd3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.648943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f87cf942-cbe3-4bee-a90b-4d8acf2cabd3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:43.649406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f87cf942-cbe3-4bee-a90b-4d8acf2cabd3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:43.649841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f87cf942-cbe3-4bee-a90b-4d8acf2cabd3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:43.790710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f87cf942-cbe3-4bee-a90b-4d8acf2cabd3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:43.799629 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f87cf942-cbe3-4bee-a90b-4d8acf2cabd3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1360 microversion: 2.1 time: 0.162108 Oct 11 19:44:43.800306 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 399/766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:43 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:43.804860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1764347752", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:43.859052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:44:44.077509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:44:44.078080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:44:44.078398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:44:44.080935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:44:44.081539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:44:44.090374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:44.090893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:44.091325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:44.092043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:44.092491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:44.092909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:44.109645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for project 33b91a834ad24c82805880555930825d. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:44:44.115274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for user 5c26541efd824c5ab866c2891adcd748 and project 33b91a834ad24c82805880555930825d. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:44:44.128390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:44:44.130743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:44:44.176611 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b5d3292a-ba3c-4cbc-a96c-cd6f651a3c70 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.375270 Oct 11 19:44:44.177267 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 400/767] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:44:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:44:44.181749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a7cfbfb-57fd-4d64-bff0-25c72cdc18cd tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:44.182353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a7cfbfb-57fd-4d64-bff0-25c72cdc18cd tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:44.188720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7cfbfb-57fd-4d64-bff0-25c72cdc18cd tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:44.189218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7cfbfb-57fd-4d64-bff0-25c72cdc18cd tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:44.190177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7cfbfb-57fd-4d64-bff0-25c72cdc18cd tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:44.190986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7cfbfb-57fd-4d64-bff0-25c72cdc18cd tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:44.191437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7cfbfb-57fd-4d64-bff0-25c72cdc18cd tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:44.191865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7cfbfb-57fd-4d64-bff0-25c72cdc18cd tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:44.202440 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bc8a4006-ed01-4aaa-a8cf-db777810d37c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337/action" status: 202 len: 0 microversion: 2.25 time: 2.288110 Oct 11 19:44:44.207035 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 368/768] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:44:41 2022] POST /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337/action => generated 0 bytes in 2293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:44:44.211883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-182b0bbb-2d42-45c3-a1b6-c9f4bdeb9bca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:44.212495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-182b0bbb-2d42-45c3-a1b6-c9f4bdeb9bca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:44.318024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-182b0bbb-2d42-45c3-a1b6-c9f4bdeb9bca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:44.326708 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-182b0bbb-2d42-45c3-a1b6-c9f4bdeb9bca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1213 microversion: 2.1 time: 0.118557 Oct 11 19:44:44.327457 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 369/769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:44 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:44.334008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:44.334951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:44.341301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:44.342137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:44.342688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:44.343452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:44.344082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:44.344573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:44.835816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a7cfbfb-57fd-4d64-bff0-25c72cdc18cd tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:44.844005 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a7cfbfb-57fd-4d64-bff0-25c72cdc18cd tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1318 microversion: 2.1 time: 0.665702 Oct 11 19:44:44.844581 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 401/770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:44 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:44.853187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-36264ebb-3a95-4265-8a53-d6b1c9c6edf9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:44.853805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-36264ebb-3a95-4265-8a53-d6b1c9c6edf9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:44.867946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36264ebb-3a95-4265-8a53-d6b1c9c6edf9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:44.868677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36264ebb-3a95-4265-8a53-d6b1c9c6edf9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:44.869283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36264ebb-3a95-4265-8a53-d6b1c9c6edf9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:44.870946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36264ebb-3a95-4265-8a53-d6b1c9c6edf9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:44.871693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36264ebb-3a95-4265-8a53-d6b1c9c6edf9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:44.872297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36264ebb-3a95-4265-8a53-d6b1c9c6edf9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.093335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-36264ebb-3a95-4265-8a53-d6b1c9c6edf9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:45.112536 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-36264ebb-3a95-4265-8a53-d6b1c9c6edf9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1294 microversion: 2.1 time: 0.262818 Oct 11 19:44:45.131469 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 402/771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:44 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1294 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:45.145465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:45.148216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-74f61521-ba37-4251-8a37-2a61283cc651 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:45.149056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-74f61521-ba37-4251-8a37-2a61283cc651 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:45.178042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74f61521-ba37-4251-8a37-2a61283cc651 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.178930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74f61521-ba37-4251-8a37-2a61283cc651 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.179561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74f61521-ba37-4251-8a37-2a61283cc651 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.181622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74f61521-ba37-4251-8a37-2a61283cc651 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.182137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74f61521-ba37-4251-8a37-2a61283cc651 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.182672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74f61521-ba37-4251-8a37-2a61283cc651 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.184314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:45.189928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:45.197054 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e3d32426-8897-4e6d-829f-103779e171ce tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.866412 Oct 11 19:44:45.199284 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 370/772] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:44 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:45.219447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-00a53359-c93c-48f6-bf94-8b637a7b9b93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:45.225171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-00a53359-c93c-48f6-bf94-8b637a7b9b93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:45.242621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a53359-c93c-48f6-bf94-8b637a7b9b93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.243384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a53359-c93c-48f6-bf94-8b637a7b9b93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.244006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a53359-c93c-48f6-bf94-8b637a7b9b93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.244891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a53359-c93c-48f6-bf94-8b637a7b9b93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.246322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a53359-c93c-48f6-bf94-8b637a7b9b93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.246987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a53359-c93c-48f6-bf94-8b637a7b9b93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.394039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-00a53359-c93c-48f6-bf94-8b637a7b9b93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:45.404826 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-00a53359-c93c-48f6-bf94-8b637a7b9b93 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1269 microversion: 2.1 time: 0.204250 Oct 11 19:44:45.405400 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 371/773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:45 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:45.423432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e7f16853-db27-4e1c-9e9f-1db8a2eacad5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:45.424220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e7f16853-db27-4e1c-9e9f-1db8a2eacad5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:45.431955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7f16853-db27-4e1c-9e9f-1db8a2eacad5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.442380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7f16853-db27-4e1c-9e9f-1db8a2eacad5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.442922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7f16853-db27-4e1c-9e9f-1db8a2eacad5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.443609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7f16853-db27-4e1c-9e9f-1db8a2eacad5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.444259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7f16853-db27-4e1c-9e9f-1db8a2eacad5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.444730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7f16853-db27-4e1c-9e9f-1db8a2eacad5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.716567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-74f61521-ba37-4251-8a37-2a61283cc651 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:45.724352 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-74f61521-ba37-4251-8a37-2a61283cc651 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1314 microversion: 2.1 time: 0.590941 Oct 11 19:44:45.725111 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 403/774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:45 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:45.729691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-2c645889-89a5-45eb-9e5f-6537a9ded025 req-cb5b8a47-28f5-4d41-82f8-905772c00e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba749f54-95af-4373-a6c8-c7e54b4091f3", "name": "network-vif-plugged", "status": "completed", "tag": "253f7484-d56b-4b0f-8146-b613fea588c9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:45.739647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2c645889-89a5-45eb-9e5f-6537a9ded025 req-cb5b8a47-28f5-4d41-82f8-905772c00e27 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.740426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2c645889-89a5-45eb-9e5f-6537a9ded025 req-cb5b8a47-28f5-4d41-82f8-905772c00e27 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.740856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2c645889-89a5-45eb-9e5f-6537a9ded025 req-cb5b8a47-28f5-4d41-82f8-905772c00e27 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.752763 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2c645889-89a5-45eb-9e5f-6537a9ded025 req-cb5b8a47-28f5-4d41-82f8-905772c00e27 service nova] Creating event network-vif-plugged:253f7484-d56b-4b0f-8146-b613fea588c9 for instance ba749f54-95af-4373-a6c8-c7e54b4091f3 on n-h1-860864-3 Oct 11 19:44:45.757641 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-2c645889-89a5-45eb-9e5f-6537a9ded025 req-cb5b8a47-28f5-4d41-82f8-905772c00e27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031425 Oct 11 19:44:45.758420 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 404/775] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:45.763672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f05f49e-bf8f-4026-9ee6-6a41d8d01a77 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:45.764364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f05f49e-bf8f-4026-9ee6-6a41d8d01a77 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:45.770410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f05f49e-bf8f-4026-9ee6-6a41d8d01a77 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.770922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f05f49e-bf8f-4026-9ee6-6a41d8d01a77 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.771355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f05f49e-bf8f-4026-9ee6-6a41d8d01a77 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.772067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f05f49e-bf8f-4026-9ee6-6a41d8d01a77 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.772689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f05f49e-bf8f-4026-9ee6-6a41d8d01a77 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.773352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f05f49e-bf8f-4026-9ee6-6a41d8d01a77 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.787050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e7f16853-db27-4e1c-9e9f-1db8a2eacad5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:45.798488 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e7f16853-db27-4e1c-9e9f-1db8a2eacad5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1360 microversion: 2.1 time: 0.385892 Oct 11 19:44:45.801041 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 372/776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:45 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1360 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:45.862344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2f05f49e-bf8f-4026-9ee6-6a41d8d01a77 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:45.868361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5ededf00-04f8-4e69-883a-16f1d4720550 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:45.868975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5ededf00-04f8-4e69-883a-16f1d4720550 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:45.871301 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f05f49e-bf8f-4026-9ee6-6a41d8d01a77 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1265 microversion: 2.1 time: 0.111647 Oct 11 19:44:45.871889 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 405/777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:45 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:45.893994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ededf00-04f8-4e69-883a-16f1d4720550 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.894490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ededf00-04f8-4e69-883a-16f1d4720550 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.894976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ededf00-04f8-4e69-883a-16f1d4720550 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:45.895738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ededf00-04f8-4e69-883a-16f1d4720550 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:45.896158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ededf00-04f8-4e69-883a-16f1d4720550 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:45.896558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ededf00-04f8-4e69-883a-16f1d4720550 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.159606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5c5615a-b215-447d-8e7f-8b3d8e3c5de5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:46.164249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f5c5615a-b215-447d-8e7f-8b3d8e3c5de5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:46.171659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c5615a-b215-447d-8e7f-8b3d8e3c5de5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.173122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c5615a-b215-447d-8e7f-8b3d8e3c5de5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.173596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c5615a-b215-447d-8e7f-8b3d8e3c5de5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.175461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c5615a-b215-447d-8e7f-8b3d8e3c5de5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.176146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c5615a-b215-447d-8e7f-8b3d8e3c5de5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.176932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c5615a-b215-447d-8e7f-8b3d8e3c5de5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.299871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f5c5615a-b215-447d-8e7f-8b3d8e3c5de5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:46.312702 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f5c5615a-b215-447d-8e7f-8b3d8e3c5de5 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1282 microversion: 2.1 time: 0.171131 Oct 11 19:44:46.313813 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 406/778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:46 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:46.323168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:46.324105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:46.337099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.337889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.339109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.340157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.340727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.341228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.360015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5ededf00-04f8-4e69-883a-16f1d4720550 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:46.382098 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5ededf00-04f8-4e69-883a-16f1d4720550 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1468 microversion: 2.1 time: 0.517455 Oct 11 19:44:46.385039 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 373/779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:45 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1468 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:46.407581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6f9b4e7c-bd3a-4461-9c38-81f3c65ee476 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:46.408623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6f9b4e7c-bd3a-4461-9c38-81f3c65ee476 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:46.415496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f9b4e7c-bd3a-4461-9c38-81f3c65ee476 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.415982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f9b4e7c-bd3a-4461-9c38-81f3c65ee476 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.416606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f9b4e7c-bd3a-4461-9c38-81f3c65ee476 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.417308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f9b4e7c-bd3a-4461-9c38-81f3c65ee476 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.417757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f9b4e7c-bd3a-4461-9c38-81f3c65ee476 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.418176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f9b4e7c-bd3a-4461-9c38-81f3c65ee476 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.449453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-6f9b4e7c-bd3a-4461-9c38-81f3c65ee476 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lazy-loading 'flavor' on Instance uuid 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:46.555415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6f9b4e7c-bd3a-4461-9c38-81f3c65ee476 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9/action" status: 202 len: 0 microversion: 2.1 time: 0.151341 Oct 11 19:44:46.559341 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 374/780] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:44:46 2022] POST /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:44:46.564720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:46.581052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:46.583204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:46.583871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e84cf582-cdf8-44ad-b4f5-3c4160ec6be0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:46.584657 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-40428077-49c4-449f-b3be-a1ec93d66836 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.269021 Oct 11 19:44:46.584904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e84cf582-cdf8-44ad-b4f5-3c4160ec6be0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:46.589151 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 407/781] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:46 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:46.594370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a9322b1b-08f0-49a4-8ac6-89ad49ee2a36 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:46.595254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e84cf582-cdf8-44ad-b4f5-3c4160ec6be0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.597067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e84cf582-cdf8-44ad-b4f5-3c4160ec6be0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.597660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e84cf582-cdf8-44ad-b4f5-3c4160ec6be0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.598561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e84cf582-cdf8-44ad-b4f5-3c4160ec6be0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.598924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a9322b1b-08f0-49a4-8ac6-89ad49ee2a36 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:46.599445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e84cf582-cdf8-44ad-b4f5-3c4160ec6be0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.603556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e84cf582-cdf8-44ad-b4f5-3c4160ec6be0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.610307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9322b1b-08f0-49a4-8ac6-89ad49ee2a36 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.611057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9322b1b-08f0-49a4-8ac6-89ad49ee2a36 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.611987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9322b1b-08f0-49a4-8ac6-89ad49ee2a36 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.612866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9322b1b-08f0-49a4-8ac6-89ad49ee2a36 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.613439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9322b1b-08f0-49a4-8ac6-89ad49ee2a36 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.614006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9322b1b-08f0-49a4-8ac6-89ad49ee2a36 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.635761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:46.750754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:46.762426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e84cf582-cdf8-44ad-b4f5-3c4160ec6be0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:46.778103 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e84cf582-cdf8-44ad-b4f5-3c4160ec6be0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1275 microversion: 2.1 time: 0.217177 Oct 11 19:44:46.784287 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 375/782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:46 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:46.805958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b34e80eb-20db-4684-8509-eb89eb5ffd63 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:46.810662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b34e80eb-20db-4684-8509-eb89eb5ffd63 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:46.828915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b34e80eb-20db-4684-8509-eb89eb5ffd63 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.830606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b34e80eb-20db-4684-8509-eb89eb5ffd63 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.831082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b34e80eb-20db-4684-8509-eb89eb5ffd63 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.831874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b34e80eb-20db-4684-8509-eb89eb5ffd63 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:46.832336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b34e80eb-20db-4684-8509-eb89eb5ffd63 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:46.835022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b34e80eb-20db-4684-8509-eb89eb5ffd63 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:46.957340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a9322b1b-08f0-49a4-8ac6-89ad49ee2a36 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:46.968608 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a9322b1b-08f0-49a4-8ac6-89ad49ee2a36 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1476 microversion: 2.1 time: 0.378002 Oct 11 19:44:46.969539 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 408/783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:46 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1476 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:46.998610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21c13261-3dbc-48b1-9d3a-112b3ca3a522 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:46.999414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-21c13261-3dbc-48b1-9d3a-112b3ca3a522 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:47.007308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c13261-3dbc-48b1-9d3a-112b3ca3a522 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.007786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c13261-3dbc-48b1-9d3a-112b3ca3a522 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.008222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c13261-3dbc-48b1-9d3a-112b3ca3a522 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.008974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c13261-3dbc-48b1-9d3a-112b3ca3a522 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.009433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c13261-3dbc-48b1-9d3a-112b3ca3a522 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.009858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c13261-3dbc-48b1-9d3a-112b3ca3a522 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.146259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b34e80eb-20db-4684-8509-eb89eb5ffd63 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:47.155334 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b34e80eb-20db-4684-8509-eb89eb5ffd63 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1314 microversion: 2.1 time: 0.369129 Oct 11 19:44:47.170769 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 376/784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:46 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:47.176503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-72f030c8-b090-41e9-b1bd-3f28a0a99047 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:47.200592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-72f030c8-b090-41e9-b1bd-3f28a0a99047 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:47.209540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72f030c8-b090-41e9-b1bd-3f28a0a99047 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.210137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72f030c8-b090-41e9-b1bd-3f28a0a99047 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.210612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72f030c8-b090-41e9-b1bd-3f28a0a99047 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.214960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72f030c8-b090-41e9-b1bd-3f28a0a99047 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.215145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72f030c8-b090-41e9-b1bd-3f28a0a99047 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.215529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72f030c8-b090-41e9-b1bd-3f28a0a99047 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.294912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-21c13261-3dbc-48b1-9d3a-112b3ca3a522 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:47.307040 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21c13261-3dbc-48b1-9d3a-112b3ca3a522 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1360 microversion: 2.1 time: 0.318826 Oct 11 19:44:47.309251 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 409/785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:46 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1360 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:47.315216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-6a311008-b791-4feb-88cf-85e2d793df04 req-915ffd07-a493-43b4-a0f4-1e22a1dcf8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337", "name": "network-vif-unplugged", "status": "completed", "tag": "8295ec70-df13-4a58-810c-672a4906086f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:47.322025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-72f030c8-b090-41e9-b1bd-3f28a0a99047 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:47.329185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6a311008-b791-4feb-88cf-85e2d793df04 req-915ffd07-a493-43b4-a0f4-1e22a1dcf8e3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.330981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6a311008-b791-4feb-88cf-85e2d793df04 req-915ffd07-a493-43b4-a0f4-1e22a1dcf8e3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.331647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6a311008-b791-4feb-88cf-85e2d793df04 req-915ffd07-a493-43b4-a0f4-1e22a1dcf8e3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.340630 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-72f030c8-b090-41e9-b1bd-3f28a0a99047 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1271 microversion: 2.1 time: 0.168532 Oct 11 19:44:47.347495 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 377/786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:47 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:47.349122 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6a311008-b791-4feb-88cf-85e2d793df04 req-915ffd07-a493-43b4-a0f4-1e22a1dcf8e3 service nova] Creating event network-vif-unplugged:8295ec70-df13-4a58-810c-672a4906086f for instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 on n-h2-860864-3 Oct 11 19:44:47.353844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe9af31c-8a99-4724-9058-0d4c31a09c5a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:47.354863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fe9af31c-8a99-4724-9058-0d4c31a09c5a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:47.355297 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-6a311008-b791-4feb-88cf-85e2d793df04 req-915ffd07-a493-43b4-a0f4-1e22a1dcf8e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044167 Oct 11 19:44:47.356768 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 410/787] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:47.362795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9af31c-8a99-4724-9058-0d4c31a09c5a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.363842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9af31c-8a99-4724-9058-0d4c31a09c5a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.364419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9af31c-8a99-4724-9058-0d4c31a09c5a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.365281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9af31c-8a99-4724-9058-0d4c31a09c5a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.365737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9af31c-8a99-4724-9058-0d4c31a09c5a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.366157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9af31c-8a99-4724-9058-0d4c31a09c5a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.607202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe9af31c-8a99-4724-9058-0d4c31a09c5a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:47.615162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:47.618000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:47.619260 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fe9af31c-8a99-4724-9058-0d4c31a09c5a tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1324 microversion: 2.1 time: 0.269360 Oct 11 19:44:47.630815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.631694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.633236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.634813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.635993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.636725 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 378/788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:47 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:47.637490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.643181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:47.791797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-e8b95f17-d81e-4b23-a67d-d83dbd43c4f8 req-fc699985-5585-41b6-bffc-b08c5b37d23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2bcc99-b3f9-47c2-bb34-4f3a24081296", "name": "network-vif-plugged", "status": "completed", "tag": "b2665c89-ac83-4c8b-9c20-01ff3ddcd688"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:47.817904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e8b95f17-d81e-4b23-a67d-d83dbd43c4f8 req-fc699985-5585-41b6-bffc-b08c5b37d23b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.819784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e8b95f17-d81e-4b23-a67d-d83dbd43c4f8 req-fc699985-5585-41b6-bffc-b08c5b37d23b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.821010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e8b95f17-d81e-4b23-a67d-d83dbd43c4f8 req-fc699985-5585-41b6-bffc-b08c5b37d23b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.855941 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-e8b95f17-d81e-4b23-a67d-d83dbd43c4f8 req-fc699985-5585-41b6-bffc-b08c5b37d23b service nova] Creating event network-vif-plugged:b2665c89-ac83-4c8b-9c20-01ff3ddcd688 for instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 on n-h1-860864-3 Oct 11 19:44:47.868496 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-e8b95f17-d81e-4b23-a67d-d83dbd43c4f8 req-fc699985-5585-41b6-bffc-b08c5b37d23b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089772 Oct 11 19:44:47.871349 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 379/789] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:44:47.888773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c6faa21c-cd4c-4124-a612-66646b095912 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:47.891802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c6faa21c-cd4c-4124-a612-66646b095912 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:47.909577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6faa21c-cd4c-4124-a612-66646b095912 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.911614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6faa21c-cd4c-4124-a612-66646b095912 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.914732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6faa21c-cd4c-4124-a612-66646b095912 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.916970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6faa21c-cd4c-4124-a612-66646b095912 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:47.918420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6faa21c-cd4c-4124-a612-66646b095912 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:47.920145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6faa21c-cd4c-4124-a612-66646b095912 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:47.967773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:47.997767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:48.008072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:48.013549 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-880abf69-bf03-4408-b2cf-57a16e6f27da tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.405266 Oct 11 19:44:48.015305 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 411/790] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:47 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:44:48.038160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b2e05cc7-0572-40c8-9485-73fd038b974b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:48.039195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b2e05cc7-0572-40c8-9485-73fd038b974b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:48.062351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2e05cc7-0572-40c8-9485-73fd038b974b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.066115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2e05cc7-0572-40c8-9485-73fd038b974b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.066874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2e05cc7-0572-40c8-9485-73fd038b974b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:48.067880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2e05cc7-0572-40c8-9485-73fd038b974b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.070236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2e05cc7-0572-40c8-9485-73fd038b974b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.071124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2e05cc7-0572-40c8-9485-73fd038b974b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:48.362391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c6faa21c-cd4c-4124-a612-66646b095912 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:48.371722 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c6faa21c-cd4c-4124-a612-66646b095912 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1317 microversion: 2.1 time: 0.497935 Oct 11 19:44:48.372331 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 380/791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:47 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:48.385180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b2e05cc7-0572-40c8-9485-73fd038b974b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:48.392397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4d64ca04-894a-49a7-94b1-216b67adf05b req-ed65922f-837b-4b0a-bb89-ea75e3b26a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce96652c-8276-41e4-b916-c39a8867c2bb", "tag": "408aa4ce-d9f4-4dfd-b98c-cd15018f5554"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:48.394543 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b2e05cc7-0572-40c8-9485-73fd038b974b tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1459 microversion: 2.1 time: 0.377730 Oct 11 19:44:48.395401 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 412/792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:48 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1459 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:48.411046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7deec547-51d4-4685-9cd7-299d43230d98 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:48.413349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4d64ca04-894a-49a7-94b1-216b67adf05b req-ed65922f-837b-4b0a-bb89-ea75e3b26a67 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.413839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4d64ca04-894a-49a7-94b1-216b67adf05b req-ed65922f-837b-4b0a-bb89-ea75e3b26a67 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.414273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4d64ca04-894a-49a7-94b1-216b67adf05b req-ed65922f-837b-4b0a-bb89-ea75e3b26a67 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:48.415290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7deec547-51d4-4685-9cd7-299d43230d98 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:48.421690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7deec547-51d4-4685-9cd7-299d43230d98 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.422469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7deec547-51d4-4685-9cd7-299d43230d98 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.423226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7deec547-51d4-4685-9cd7-299d43230d98 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:48.424071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7deec547-51d4-4685-9cd7-299d43230d98 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.424727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7deec547-51d4-4685-9cd7-299d43230d98 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.425155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7deec547-51d4-4685-9cd7-299d43230d98 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:48.429448 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4d64ca04-894a-49a7-94b1-216b67adf05b req-ed65922f-837b-4b0a-bb89-ea75e3b26a67 service nova] Creating event network-changed:408aa4ce-d9f4-4dfd-b98c-cd15018f5554 for instance ce96652c-8276-41e4-b916-c39a8867c2bb on n-h2-860864-3 Oct 11 19:44:48.434666 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4d64ca04-894a-49a7-94b1-216b67adf05b req-ed65922f-837b-4b0a-bb89-ea75e3b26a67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050732 Oct 11 19:44:48.435652 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 381/793] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:48.442236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ede81019-36f9-45f2-8cf0-7b6f761ac38e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:48.442984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ede81019-36f9-45f2-8cf0-7b6f761ac38e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:48.449690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ede81019-36f9-45f2-8cf0-7b6f761ac38e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.450192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ede81019-36f9-45f2-8cf0-7b6f761ac38e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.450664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ede81019-36f9-45f2-8cf0-7b6f761ac38e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:48.451375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ede81019-36f9-45f2-8cf0-7b6f761ac38e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.451837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ede81019-36f9-45f2-8cf0-7b6f761ac38e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.452416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ede81019-36f9-45f2-8cf0-7b6f761ac38e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:48.701114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ede81019-36f9-45f2-8cf0-7b6f761ac38e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:48.710255 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ede81019-36f9-45f2-8cf0-7b6f761ac38e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1360 microversion: 2.1 time: 0.273386 Oct 11 19:44:48.711200 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 382/794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:48 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1360 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:48.715689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4bd9b708-a8ba-4adf-a7f5-6af59ec83ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:48.716283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4bd9b708-a8ba-4adf-a7f5-6af59ec83ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:48.722462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bd9b708-a8ba-4adf-a7f5-6af59ec83ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.722981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bd9b708-a8ba-4adf-a7f5-6af59ec83ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.723420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bd9b708-a8ba-4adf-a7f5-6af59ec83ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:48.724108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bd9b708-a8ba-4adf-a7f5-6af59ec83ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.724561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bd9b708-a8ba-4adf-a7f5-6af59ec83ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.724989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bd9b708-a8ba-4adf-a7f5-6af59ec83ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:48.746304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7deec547-51d4-4685-9cd7-299d43230d98 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:48.755288 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7deec547-51d4-4685-9cd7-299d43230d98 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1464 microversion: 2.1 time: 0.352638 Oct 11 19:44:48.759564 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 413/795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:48 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:48.774360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-68ad2165-5882-47e8-a7c8-917547aefb0e tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:48.775593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-68ad2165-5882-47e8-a7c8-917547aefb0e tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:48.782956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ad2165-5882-47e8-a7c8-917547aefb0e tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.784295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ad2165-5882-47e8-a7c8-917547aefb0e tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.785129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ad2165-5882-47e8-a7c8-917547aefb0e tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:48.786111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ad2165-5882-47e8-a7c8-917547aefb0e tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:48.786827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ad2165-5882-47e8-a7c8-917547aefb0e tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:48.788036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ad2165-5882-47e8-a7c8-917547aefb0e tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.017645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4bd9b708-a8ba-4adf-a7f5-6af59ec83ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:49.034378 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4bd9b708-a8ba-4adf-a7f5-6af59ec83ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.320537 Oct 11 19:44:49.042693 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 383/796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:48 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:49.052178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-abaa019c-93b1-4a20-92d9-884f1f77615b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:49.053338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-abaa019c-93b1-4a20-92d9-884f1f77615b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:49.060098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abaa019c-93b1-4a20-92d9-884f1f77615b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.060866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abaa019c-93b1-4a20-92d9-884f1f77615b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.061498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abaa019c-93b1-4a20-92d9-884f1f77615b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.063271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abaa019c-93b1-4a20-92d9-884f1f77615b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.065008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abaa019c-93b1-4a20-92d9-884f1f77615b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.067573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abaa019c-93b1-4a20-92d9-884f1f77615b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.369613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-abaa019c-93b1-4a20-92d9-884f1f77615b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:49.378711 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-abaa019c-93b1-4a20-92d9-884f1f77615b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1324 microversion: 2.1 time: 0.334077 Oct 11 19:44:49.379305 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-68ad2165-5882-47e8-a7c8-917547aefb0e tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1610 microversion: 2.1 time: 0.617973 Oct 11 19:44:49.379613 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 384/797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:49 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:49.380026 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 414/798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:48 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1610 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:49.387098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:49.388402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:49.397204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.398090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.398840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.399721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.400372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.400964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.453852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66aa9619-3e8f-414b-bc50-3812b68d17c1 tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Calling method '.version_select at 0x7f83cc9acca0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:49.465346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66aa9619-3e8f-414b-bc50-3812b68d17c1 tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.465829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66aa9619-3e8f-414b-bc50-3812b68d17c1 tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.466251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66aa9619-3e8f-414b-bc50-3812b68d17c1 tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.486371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66aa9619-3e8f-414b-bc50-3812b68d17c1 tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.486943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66aa9619-3e8f-414b-bc50-3812b68d17c1 tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.487254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66aa9619-3e8f-414b-bc50-3812b68d17c1 tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.506497 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-66aa9619-3e8f-414b-bc50-3812b68d17c1 tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/1dc7fd4b21fb43a99990a513786fd9ec?start=2022-10-10T19%3A44%3A48.775541&end=2022-10-12T19%3A44%3A48.775541" status: 200 len: 695 microversion: 2.1 time: 0.125834 Oct 11 19:44:49.507302 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 385/799] 10.222.0.27 () {58 vars in 1412 bytes} [Tue Oct 11 19:44:49 2022] GET /compute/v2.1/os-simple-tenant-usage/1dc7fd4b21fb43a99990a513786fd9ec?start=2022-10-10T19%3A44%3A48.775541&end=2022-10-12T19%3A44%3A48.775541 => generated 695 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:49.512063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c9f117af-f858-4b7b-90b4-56777e31c5f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:49.512847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c9f117af-f858-4b7b-90b4-56777e31c5f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:49.520041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9f117af-f858-4b7b-90b4-56777e31c5f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.520544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9f117af-f858-4b7b-90b4-56777e31c5f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.522142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9f117af-f858-4b7b-90b4-56777e31c5f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.522314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9f117af-f858-4b7b-90b4-56777e31c5f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.522773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9f117af-f858-4b7b-90b4-56777e31c5f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.523200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9f117af-f858-4b7b-90b4-56777e31c5f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.558996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:49.567751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:49.569213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:49.570684 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f3ec882d-d8c1-4977-9dee-1e229d13d490 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.189381 Oct 11 19:44:49.571280 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 415/800] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:49 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:49.576097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8b00f26e-126c-40df-8888-de9b5dbb0e91 req-e03abd54-926c-4477-8861-371ae586795b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337", "tag": "8295ec70-df13-4a58-810c-672a4906086f"}, {"name": "network-changed", "server_uuid": "42bba293-5871-4552-b639-4f1e0fb137cf", "tag": "ea21aae9-abce-4446-a07a-83c7705b4edb"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:49.588871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8b00f26e-126c-40df-8888-de9b5dbb0e91 req-e03abd54-926c-4477-8861-371ae586795b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.589623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8b00f26e-126c-40df-8888-de9b5dbb0e91 req-e03abd54-926c-4477-8861-371ae586795b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.590266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8b00f26e-126c-40df-8888-de9b5dbb0e91 req-e03abd54-926c-4477-8861-371ae586795b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.606144 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8b00f26e-126c-40df-8888-de9b5dbb0e91 req-e03abd54-926c-4477-8861-371ae586795b service nova] Creating event network-changed:8295ec70-df13-4a58-810c-672a4906086f for instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 on n-h2-860864-3 Oct 11 19:44:49.606909 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8b00f26e-126c-40df-8888-de9b5dbb0e91 req-e03abd54-926c-4477-8861-371ae586795b service nova] Creating event network-changed:ea21aae9-abce-4446-a07a-83c7705b4edb for instance 42bba293-5871-4552-b639-4f1e0fb137cf on n-h2-860864-3 Oct 11 19:44:49.614188 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8b00f26e-126c-40df-8888-de9b5dbb0e91 req-e03abd54-926c-4477-8861-371ae586795b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041434 Oct 11 19:44:49.614861 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 416/801] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:49.620115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-18ef5d01-f5c8-4bff-90cf-236f1a92d878 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:49.625362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18ef5d01-f5c8-4bff-90cf-236f1a92d878 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.626119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18ef5d01-f5c8-4bff-90cf-236f1a92d878 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.627028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18ef5d01-f5c8-4bff-90cf-236f1a92d878 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.627876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18ef5d01-f5c8-4bff-90cf-236f1a92d878 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.628433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18ef5d01-f5c8-4bff-90cf-236f1a92d878 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.629081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18ef5d01-f5c8-4bff-90cf-236f1a92d878 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.654352 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-18ef5d01-f5c8-4bff-90cf-236f1a92d878 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038037 Oct 11 19:44:49.658743 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 417/802] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 11 19:44:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:49.664434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f2db6c5c-edfe-4e97-8809-e8878f53c387 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '.version_select at 0x7f83cc99b040>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:49.678378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2db6c5c-edfe-4e97-8809-e8878f53c387 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.678911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2db6c5c-edfe-4e97-8809-e8878f53c387 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.679358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2db6c5c-edfe-4e97-8809-e8878f53c387 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.696688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2db6c5c-edfe-4e97-8809-e8878f53c387 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.697564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2db6c5c-edfe-4e97-8809-e8878f53c387 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.697832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2db6c5c-edfe-4e97-8809-e8878f53c387 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.717157 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f2db6c5c-edfe-4e97-8809-e8878f53c387 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/1dc7fd4b21fb43a99990a513786fd9ec?start=2022-10-10T19%3A44%3A48.775541&end=2022-10-12T19%3A44%3A48.775541" status: 200 len: 695 microversion: 2.1 time: 0.056785 Oct 11 19:44:49.717758 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 418/803] 10.222.0.27 () {58 vars in 1412 bytes} [Tue Oct 11 19:44:49 2022] GET /compute/v2.1/os-simple-tenant-usage/1dc7fd4b21fb43a99990a513786fd9ec?start=2022-10-10T19%3A44%3A48.775541&end=2022-10-12T19%3A44%3A48.775541 => generated 695 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:49.722920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:49.725720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:49.732950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.733447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.733886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.734623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.735088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.735516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.817880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Lazy-loading 'flavor' on Instance uuid 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:49.866514 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 while it is in vm_state suspended Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Request method failure captured: Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9/action HTTP/1.1 Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 97 Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcd93CB7IPSgz6uB7RZC1AFDcZHOo43TX_hQNQpA_TmQil7T5j1MvuAyMOsXFRCSD0jyzHwCyn4riFSR29nl8R2RvdEv_TX1-czIe7tpws-NYVCTHPOz_WCFkpofJjYqZJaeTERyrIq063kgO3YIaMT84a_FamqVm25evPncLPEc_ow Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 525e861c8de141f0b285204354f3b4b2 Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-LiveMigrationNegativeTest-1254531373 Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:44:49.868629 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/525e861c8de141f0b285204354f3b4b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_525e861c8de141f0b285204354f3b4b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/525e861c8de141f0b285204354f3b4b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/525e861c8de141f0b285204354f3b4b2"}]}] Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-LiveMigrationNegativeTest-1254531373 Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 525e861c8de141f0b285204354f3b4b2 Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1254531373 Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-LiveMigrationNegativeTest-1254531373-project-admin Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e4929f6109af4b1888fb6a28d71f1d0c Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-LiveMigrationNegativeTest-1254531373-project-admin Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: {"os-migrateLive": {"host": "n-h1-860864-3", "block_migration": true, "disk_over_commit": false}} Oct 11 19:44:49.870116 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: exception: Cannot 'os-migrateLive' instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 while it is in vm_state suspended Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '6ecbdb6e-ccfd-4837-8e14-d316bbf156b9', 'body': {'os-migrateLive': {'host': 'n-h1-860864-3', 'block_migration': True, 'disk_over_commit': False}}} Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 19:44:49.871234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:44:49.872326 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 while it is in vm_state suspended Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 while it is in vm_state suspended Oct 11 19:44:49.879827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:49.882973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 while it is in vm_state suspended {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:49.882973 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-00938bc1-08b7-4817-890c-6f18bb68a660 tempest-LiveMigrationNegativeTest-1254531373 tempest-LiveMigrationNegativeTest-1254531373-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9/action" status: 409 len: 155 microversion: 2.1 time: 0.151173 Oct 11 19:44:49.882973 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 419/804] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:44:49 2022] POST /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9/action => generated 155 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:44:49.882973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e034c034-c105-4a2d-8b1c-06f0bea59bdd tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Calling method '.version_select at 0x7f83ccde81f0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:49.886804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c9f117af-f858-4b7b-90b4-56777e31c5f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:49.895184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e034c034-c105-4a2d-8b1c-06f0bea59bdd tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.896074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e034c034-c105-4a2d-8b1c-06f0bea59bdd tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.896862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e034c034-c105-4a2d-8b1c-06f0bea59bdd tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.896976 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c9f117af-f858-4b7b-90b4-56777e31c5f5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1317 microversion: 2.1 time: 0.388615 Oct 11 19:44:49.903973 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 386/805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:49 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:49.911068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a55d760f-c534-4c0c-a5be-ebb56d8a04b9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:49.911677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a55d760f-c534-4c0c-a5be-ebb56d8a04b9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:49.917112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e034c034-c105-4a2d-8b1c-06f0bea59bdd tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.917681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e034c034-c105-4a2d-8b1c-06f0bea59bdd tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.917791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a55d760f-c534-4c0c-a5be-ebb56d8a04b9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.918197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e034c034-c105-4a2d-8b1c-06f0bea59bdd tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.918317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a55d760f-c534-4c0c-a5be-ebb56d8a04b9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.918810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a55d760f-c534-4c0c-a5be-ebb56d8a04b9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.919498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a55d760f-c534-4c0c-a5be-ebb56d8a04b9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.919993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a55d760f-c534-4c0c-a5be-ebb56d8a04b9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.920409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a55d760f-c534-4c0c-a5be-ebb56d8a04b9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.971437 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e034c034-c105-4a2d-8b1c-06f0bea59bdd tempest-TenantUsagesTestJSON-1482533981 tempest-TenantUsagesTestJSON-1482533981-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T19%3A44%3A48.775541&end=2022-10-12T19%3A44%3A48.775541&detailed=1" status: 200 len: 10987 microversion: 2.1 time: 0.099189 Oct 11 19:44:49.972126 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 420/806] 10.222.0.27 () {58 vars in 1335 bytes} [Tue Oct 11 19:44:49 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T19%3A44%3A48.775541&end=2022-10-12T19%3A44%3A48.775541&detailed=1 => generated 10987 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:44:49.987859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-789b2979-edc2-47d8-b249-7808c674d236 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:49.988635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-789b2979-edc2-47d8-b249-7808c674d236 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:49.996509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-789b2979-edc2-47d8-b249-7808c674d236 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.997004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-789b2979-edc2-47d8-b249-7808c674d236 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.997675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-789b2979-edc2-47d8-b249-7808c674d236 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:49.998588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-789b2979-edc2-47d8-b249-7808c674d236 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:49.999017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-789b2979-edc2-47d8-b249-7808c674d236 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:49.999762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-789b2979-edc2-47d8-b249-7808c674d236 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.048195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-789b2979-edc2-47d8-b249-7808c674d236 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:44:50.108974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a55d760f-c534-4c0c-a5be-ebb56d8a04b9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:50.118761 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a55d760f-c534-4c0c-a5be-ebb56d8a04b9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1360 microversion: 2.1 time: 0.213596 Oct 11 19:44:50.119345 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 387/807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:49 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1360 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:50.124483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7c31f68-82f8-4d33-ace6-6eee185e0afa tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:50.125311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c7c31f68-82f8-4d33-ace6-6eee185e0afa tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:50.133128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7c31f68-82f8-4d33-ace6-6eee185e0afa tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.134016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7c31f68-82f8-4d33-ace6-6eee185e0afa tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.134766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7c31f68-82f8-4d33-ace6-6eee185e0afa tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.135753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7c31f68-82f8-4d33-ace6-6eee185e0afa tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.136450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7c31f68-82f8-4d33-ace6-6eee185e0afa tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.136997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7c31f68-82f8-4d33-ace6-6eee185e0afa tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.168682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c7c31f68-82f8-4d33-ace6-6eee185e0afa tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:44:50.175603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:50.184013 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-789b2979-edc2-47d8-b249-7808c674d236 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 204 len: 0 microversion: 2.1 time: 0.203355 Oct 11 19:44:50.188408 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 421/808] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:44:49 2022] DELETE /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:44:50.194076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e495f768-6736-49b1-8c61-f2f2dafb1e72 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:50.195143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e495f768-6736-49b1-8c61-f2f2dafb1e72 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:50.202789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e495f768-6736-49b1-8c61-f2f2dafb1e72 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.203372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e495f768-6736-49b1-8c61-f2f2dafb1e72 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.203884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e495f768-6736-49b1-8c61-f2f2dafb1e72 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.205493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e495f768-6736-49b1-8c61-f2f2dafb1e72 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.206764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e495f768-6736-49b1-8c61-f2f2dafb1e72 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.207555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e495f768-6736-49b1-8c61-f2f2dafb1e72 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.270611 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c7c31f68-82f8-4d33-ace6-6eee185e0afa tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 204 len: 0 microversion: 2.1 time: 0.149437 Oct 11 19:44:50.271437 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 388/809] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:44:50 2022] DELETE /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:44:50.279903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e6566faf-1dfb-4c6c-9ae1-90ff642134f5 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:50.280733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e6566faf-1dfb-4c6c-9ae1-90ff642134f5 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:50.287487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6566faf-1dfb-4c6c-9ae1-90ff642134f5 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.288030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6566faf-1dfb-4c6c-9ae1-90ff642134f5 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.288775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6566faf-1dfb-4c6c-9ae1-90ff642134f5 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.289887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6566faf-1dfb-4c6c-9ae1-90ff642134f5 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.290958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6566faf-1dfb-4c6c-9ae1-90ff642134f5 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.291213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6566faf-1dfb-4c6c-9ae1-90ff642134f5 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.364533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e495f768-6736-49b1-8c61-f2f2dafb1e72 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:50.373724 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e495f768-6736-49b1-8c61-f2f2dafb1e72 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.186854 Oct 11 19:44:50.378615 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 422/810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:50 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:50.379972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-647f5d40-f05c-412b-bfd8-0c3fa39290c6 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:50.380600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-647f5d40-f05c-412b-bfd8-0c3fa39290c6 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:50.393730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647f5d40-f05c-412b-bfd8-0c3fa39290c6 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.394393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647f5d40-f05c-412b-bfd8-0c3fa39290c6 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.394891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647f5d40-f05c-412b-bfd8-0c3fa39290c6 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.395615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647f5d40-f05c-412b-bfd8-0c3fa39290c6 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.396076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647f5d40-f05c-412b-bfd8-0c3fa39290c6 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.396504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647f5d40-f05c-412b-bfd8-0c3fa39290c6 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.582914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-647f5d40-f05c-412b-bfd8-0c3fa39290c6 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:50.592437 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-647f5d40-f05c-412b-bfd8-0c3fa39290c6 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1470 microversion: 2.1 time: 0.216554 Oct 11 19:44:50.593138 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 423/811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:50 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:50.612826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0ad5bf0-8d03-4074-ae43-d8bc9c561efd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:50.613680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a0ad5bf0-8d03-4074-ae43-d8bc9c561efd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:50.619958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0ad5bf0-8d03-4074-ae43-d8bc9c561efd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.620455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0ad5bf0-8d03-4074-ae43-d8bc9c561efd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.620885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0ad5bf0-8d03-4074-ae43-d8bc9c561efd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.621642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0ad5bf0-8d03-4074-ae43-d8bc9c561efd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.630066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0ad5bf0-8d03-4074-ae43-d8bc9c561efd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.630646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0ad5bf0-8d03-4074-ae43-d8bc9c561efd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.646668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e6566faf-1dfb-4c6c-9ae1-90ff642134f5 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:50.662039 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e6566faf-1dfb-4c6c-9ae1-90ff642134f5 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1465 microversion: 2.1 time: 0.385686 Oct 11 19:44:50.663562 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 389/812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:50 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1465 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:50.669800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:50.671290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:50.679952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.680523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.681223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.682163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.682741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.686751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.883234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a0ad5bf0-8d03-4074-ae43-d8bc9c561efd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:50.889887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:50.891847 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a0ad5bf0-8d03-4074-ae43-d8bc9c561efd tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1324 microversion: 2.1 time: 0.282921 Oct 11 19:44:50.892742 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 424/813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:50 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:50.898540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:50.899991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:50.901169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b452ac73-fac5-4d24-9858-445faa8b55d3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.236670 Oct 11 19:44:50.901700 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 390/814] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:50 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:50.918923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-149dcbcb-333c-48ab-ba91-d8d35c4e8ff3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:50.919534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-149dcbcb-333c-48ab-ba91-d8d35c4e8ff3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:50.926338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-149dcbcb-333c-48ab-ba91-d8d35c4e8ff3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.926867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-149dcbcb-333c-48ab-ba91-d8d35c4e8ff3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.927303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-149dcbcb-333c-48ab-ba91-d8d35c4e8ff3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:50.927990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-149dcbcb-333c-48ab-ba91-d8d35c4e8ff3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:50.928447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-149dcbcb-333c-48ab-ba91-d8d35c4e8ff3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:50.928873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-149dcbcb-333c-48ab-ba91-d8d35c4e8ff3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.061185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-149dcbcb-333c-48ab-ba91-d8d35c4e8ff3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:51.069020 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-149dcbcb-333c-48ab-ba91-d8d35c4e8ff3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1317 microversion: 2.1 time: 0.153873 Oct 11 19:44:51.069585 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 425/815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:50 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:51.143432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77ecb396-c0a2-4fbb-8adb-c36af14a48ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:51.143961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-77ecb396-c0a2-4fbb-8adb-c36af14a48ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:51.149963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77ecb396-c0a2-4fbb-8adb-c36af14a48ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.150427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77ecb396-c0a2-4fbb-8adb-c36af14a48ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.150908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77ecb396-c0a2-4fbb-8adb-c36af14a48ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.151587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77ecb396-c0a2-4fbb-8adb-c36af14a48ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.152067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77ecb396-c0a2-4fbb-8adb-c36af14a48ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.152489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77ecb396-c0a2-4fbb-8adb-c36af14a48ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.281059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-77ecb396-c0a2-4fbb-8adb-c36af14a48ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:51.289573 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-77ecb396-c0a2-4fbb-8adb-c36af14a48ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1543 microversion: 2.1 time: 0.150606 Oct 11 19:44:51.290152 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 391/816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:51 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1543 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:51.312489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8c9d3c0-536a-4539-a17b-97bde6491d3c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:51.313016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c8c9d3c0-536a-4539-a17b-97bde6491d3c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:51.319585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c9d3c0-536a-4539-a17b-97bde6491d3c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.320064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c9d3c0-536a-4539-a17b-97bde6491d3c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.320497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c9d3c0-536a-4539-a17b-97bde6491d3c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.321174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c9d3c0-536a-4539-a17b-97bde6491d3c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.321618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c9d3c0-536a-4539-a17b-97bde6491d3c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.322032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c9d3c0-536a-4539-a17b-97bde6491d3c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.396774 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8c9d3c0-536a-4539-a17b-97bde6491d3c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088132 Oct 11 19:44:51.397340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1275b65-f301-484c-8577-159fd920820a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:51.397645 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 426/817] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:44:51 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:51.398035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e1275b65-f301-484c-8577-159fd920820a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:51.403976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1275b65-f301-484c-8577-159fd920820a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.404587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1275b65-f301-484c-8577-159fd920820a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.405010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1275b65-f301-484c-8577-159fd920820a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.405692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1275b65-f301-484c-8577-159fd920820a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.406144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1275b65-f301-484c-8577-159fd920820a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.406585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1275b65-f301-484c-8577-159fd920820a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.409787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:51.616155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4c4432a1-27ff-4a00-b939-2413cd7ee080 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:51.616763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4c4432a1-27ff-4a00-b939-2413cd7ee080 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:51.622745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4432a1-27ff-4a00-b939-2413cd7ee080 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.623274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4432a1-27ff-4a00-b939-2413cd7ee080 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.623713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4432a1-27ff-4a00-b939-2413cd7ee080 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.624409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4432a1-27ff-4a00-b939-2413cd7ee080 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.624848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4432a1-27ff-4a00-b939-2413cd7ee080 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.625269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4432a1-27ff-4a00-b939-2413cd7ee080 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.673230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e1275b65-f301-484c-8577-159fd920820a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:51.683207 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e1275b65-f301-484c-8577-159fd920820a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.289835 Oct 11 19:44:51.683791 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 392/818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:51 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:51.688398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-de11991a-802c-4c01-aca3-dec0a9a1ddd0 req-7b6acfb7-7dd3-4cdd-8dec-57c4e73b49ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dee854-d900-44e9-8d2f-a34305c016ea", "tag": "bf229230-440b-48f9-9914-92cff8501f97"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:51.698738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-de11991a-802c-4c01-aca3-dec0a9a1ddd0 req-7b6acfb7-7dd3-4cdd-8dec-57c4e73b49ca service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.699237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-de11991a-802c-4c01-aca3-dec0a9a1ddd0 req-7b6acfb7-7dd3-4cdd-8dec-57c4e73b49ca service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.699784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-de11991a-802c-4c01-aca3-dec0a9a1ddd0 req-7b6acfb7-7dd3-4cdd-8dec-57c4e73b49ca service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.712144 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-de11991a-802c-4c01-aca3-dec0a9a1ddd0 req-7b6acfb7-7dd3-4cdd-8dec-57c4e73b49ca service nova] Creating event network-changed:bf229230-440b-48f9-9914-92cff8501f97 for instance 35dee854-d900-44e9-8d2f-a34305c016ea on n-h1-860864-3 Oct 11 19:44:51.716945 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-de11991a-802c-4c01-aca3-dec0a9a1ddd0 req-7b6acfb7-7dd3-4cdd-8dec-57c4e73b49ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031920 Oct 11 19:44:51.717551 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 393/819] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:51.724096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5ccac0a0-d18f-4ceb-b53f-a12082165f92 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:51.724804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5ccac0a0-d18f-4ceb-b53f-a12082165f92 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:51.731007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ccac0a0-d18f-4ceb-b53f-a12082165f92 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.731527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ccac0a0-d18f-4ceb-b53f-a12082165f92 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.731999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ccac0a0-d18f-4ceb-b53f-a12082165f92 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.732730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ccac0a0-d18f-4ceb-b53f-a12082165f92 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.733193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ccac0a0-d18f-4ceb-b53f-a12082165f92 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.733616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ccac0a0-d18f-4ceb-b53f-a12082165f92 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.945208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4c4432a1-27ff-4a00-b939-2413cd7ee080 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:51.953039 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4c4432a1-27ff-4a00-b939-2413cd7ee080 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1470 microversion: 2.1 time: 0.340727 Oct 11 19:44:51.953709 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 427/820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:51 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:51.958909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-92182942-aeae-468c-b866-52864742bf1d tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:51.959519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-92182942-aeae-468c-b866-52864742bf1d tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:51.965213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92182942-aeae-468c-b866-52864742bf1d tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.965711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92182942-aeae-468c-b866-52864742bf1d tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.966561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92182942-aeae-468c-b866-52864742bf1d tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:51.966937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92182942-aeae-468c-b866-52864742bf1d tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:51.967398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92182942-aeae-468c-b866-52864742bf1d tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:51.968042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92182942-aeae-468c-b866-52864742bf1d tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:52.034309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5ccac0a0-d18f-4ceb-b53f-a12082165f92 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:52.043134 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5ccac0a0-d18f-4ceb-b53f-a12082165f92 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1465 microversion: 2.1 time: 0.324423 Oct 11 19:44:52.051732 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 394/821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:51 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1465 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:52.051732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:52.052008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:52.065221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:52.065838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:52.066138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:52.066883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:52.067705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:52.068137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:52.345571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-92182942-aeae-468c-b866-52864742bf1d tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:52.357910 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-92182942-aeae-468c-b866-52864742bf1d tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1324 microversion: 2.1 time: 0.402184 Oct 11 19:44:52.360329 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 428/822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:51 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:52.369654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-63494578-e428-4df3-b083-2f172328ac27 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:52.370293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-63494578-e428-4df3-b083-2f172328ac27 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:52.384635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63494578-e428-4df3-b083-2f172328ac27 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:52.386776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63494578-e428-4df3-b083-2f172328ac27 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:52.387319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63494578-e428-4df3-b083-2f172328ac27 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:52.389119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63494578-e428-4df3-b083-2f172328ac27 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:52.389609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63494578-e428-4df3-b083-2f172328ac27 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:52.391282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63494578-e428-4df3-b083-2f172328ac27 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:52.397553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:52.688328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:52.698895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:52.702128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:52.703659 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fe9be78e-e9ee-4416-8205-3d94b28330f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.658373 Oct 11 19:44:52.704235 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 395/823] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:52 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:52.727782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-461d74dc-e67c-454e-8543-5552f749424a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:52.728399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-461d74dc-e67c-454e-8543-5552f749424a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:52.735050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-461d74dc-e67c-454e-8543-5552f749424a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:52.735542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-461d74dc-e67c-454e-8543-5552f749424a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:52.736193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-461d74dc-e67c-454e-8543-5552f749424a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:52.737092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-461d74dc-e67c-454e-8543-5552f749424a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:52.737549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-461d74dc-e67c-454e-8543-5552f749424a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:52.737972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-461d74dc-e67c-454e-8543-5552f749424a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:53.150273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63494578-e428-4df3-b083-2f172328ac27 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:53.159137 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-63494578-e428-4df3-b083-2f172328ac27 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1317 microversion: 2.1 time: 0.796560 Oct 11 19:44:53.159957 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 429/824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:52 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1317 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:53.164740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0055188-2a35-4540-80f8-c7ef5be9140b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:53.165344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f0055188-2a35-4540-80f8-c7ef5be9140b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:53.174402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0055188-2a35-4540-80f8-c7ef5be9140b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:53.175163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0055188-2a35-4540-80f8-c7ef5be9140b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:53.175606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0055188-2a35-4540-80f8-c7ef5be9140b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:53.176320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0055188-2a35-4540-80f8-c7ef5be9140b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:53.176776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0055188-2a35-4540-80f8-c7ef5be9140b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:53.177198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0055188-2a35-4540-80f8-c7ef5be9140b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:53.288445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-461d74dc-e67c-454e-8543-5552f749424a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:53.299214 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-461d74dc-e67c-454e-8543-5552f749424a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.578212 Oct 11 19:44:53.323994 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 396/825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:52 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:53.337766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7fdf5f44-2f5f-482d-9d72-643b919c29de tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:53.342749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7fdf5f44-2f5f-482d-9d72-643b919c29de tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:53.352690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f44-2f5f-482d-9d72-643b919c29de tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:53.353306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f44-2f5f-482d-9d72-643b919c29de tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:53.353879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f44-2f5f-482d-9d72-643b919c29de tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:53.354852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f44-2f5f-482d-9d72-643b919c29de tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:53.355852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f44-2f5f-482d-9d72-643b919c29de tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:53.356378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fdf5f44-2f5f-482d-9d72-643b919c29de tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:53.464875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f0055188-2a35-4540-80f8-c7ef5be9140b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:53.475571 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f0055188-2a35-4540-80f8-c7ef5be9140b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1470 microversion: 2.1 time: 0.314341 Oct 11 19:44:53.488550 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 430/826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:53 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1470 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:53.497182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-52842eb3-b25c-4262-a1f1-066bc30223a9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:53.498163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-52842eb3-b25c-4262-a1f1-066bc30223a9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:53.505133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52842eb3-b25c-4262-a1f1-066bc30223a9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:53.505827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52842eb3-b25c-4262-a1f1-066bc30223a9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:53.506558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52842eb3-b25c-4262-a1f1-066bc30223a9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:53.507465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52842eb3-b25c-4262-a1f1-066bc30223a9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:53.507759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52842eb3-b25c-4262-a1f1-066bc30223a9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:53.508172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52842eb3-b25c-4262-a1f1-066bc30223a9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:53.660452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7fdf5f44-2f5f-482d-9d72-643b919c29de tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:53.684146 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7fdf5f44-2f5f-482d-9d72-643b919c29de tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1465 microversion: 2.1 time: 0.357785 Oct 11 19:44:53.686914 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 397/827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:53 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1465 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:53.733224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:53.734588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:53.744946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:53.746755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:53.747243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:53.748877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:53.749599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:53.751136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:53.913175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-52842eb3-b25c-4262-a1f1-066bc30223a9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:53.921780 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-52842eb3-b25c-4262-a1f1-066bc30223a9 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1324 microversion: 2.1 time: 0.432018 Oct 11 19:44:53.934954 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 431/828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:53 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1324 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:53.942570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ceaed64e-ff38-402e-b714-0c364aea480e req-0bb94840-8d57-4282-8a13-5fd248afe7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba749f54-95af-4373-a6c8-c7e54b4091f3", "name": "network-vif-deleted", "tag": "253f7484-d56b-4b0f-8146-b613fea588c9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:53.963122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ceaed64e-ff38-402e-b714-0c364aea480e req-0bb94840-8d57-4282-8a13-5fd248afe7ec service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:53.964041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ceaed64e-ff38-402e-b714-0c364aea480e req-0bb94840-8d57-4282-8a13-5fd248afe7ec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:53.964480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ceaed64e-ff38-402e-b714-0c364aea480e req-0bb94840-8d57-4282-8a13-5fd248afe7ec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:53.978601 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ceaed64e-ff38-402e-b714-0c364aea480e req-0bb94840-8d57-4282-8a13-5fd248afe7ec service nova] Creating event network-vif-deleted:253f7484-d56b-4b0f-8146-b613fea588c9 for instance ba749f54-95af-4373-a6c8-c7e54b4091f3 on n-h1-860864-3 Oct 11 19:44:53.989379 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ceaed64e-ff38-402e-b714-0c364aea480e req-0bb94840-8d57-4282-8a13-5fd248afe7ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053001 Oct 11 19:44:53.990031 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 432/829] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:54.002337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-506571fb-7d99-4b3e-8087-4ea5dd062d1a req-3af0feae-74d0-4080-83fe-ebebfe4ec34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2bcc99-b3f9-47c2-bb34-4f3a24081296", "tag": "b2665c89-ac83-4c8b-9c20-01ff3ddcd688"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:54.029710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-506571fb-7d99-4b3e-8087-4ea5dd062d1a req-3af0feae-74d0-4080-83fe-ebebfe4ec34a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.032187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-506571fb-7d99-4b3e-8087-4ea5dd062d1a req-3af0feae-74d0-4080-83fe-ebebfe4ec34a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.033431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-506571fb-7d99-4b3e-8087-4ea5dd062d1a req-3af0feae-74d0-4080-83fe-ebebfe4ec34a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.066160 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-506571fb-7d99-4b3e-8087-4ea5dd062d1a req-3af0feae-74d0-4080-83fe-ebebfe4ec34a service nova] Creating event network-changed:b2665c89-ac83-4c8b-9c20-01ff3ddcd688 for instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 on n-h1-860864-3 Oct 11 19:44:54.074462 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-506571fb-7d99-4b3e-8087-4ea5dd062d1a req-3af0feae-74d0-4080-83fe-ebebfe4ec34a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079712 Oct 11 19:44:54.077942 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 433/830] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:54.184370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-509eb62c-b1f9-4c21-9a03-6f8f03521b86 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:54.185256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-509eb62c-b1f9-4c21-9a03-6f8f03521b86 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:54.188033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:54.196144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=38 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:54.198185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-509eb62c-b1f9-4c21-9a03-6f8f03521b86 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.198913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:54.201205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:54.201370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-509eb62c-b1f9-4c21-9a03-6f8f03521b86 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.201763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-509eb62c-b1f9-4c21-9a03-6f8f03521b86 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.206641 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-70817895-9474-4ac0-ad5e-d98a629c979a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.477137 Oct 11 19:44:54.207413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-509eb62c-b1f9-4c21-9a03-6f8f03521b86 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.208098 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 398/831] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:53 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:44:54.223000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-509eb62c-b1f9-4c21-9a03-6f8f03521b86 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.223575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-509eb62c-b1f9-4c21-9a03-6f8f03521b86 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.326088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54c2d105-33c4-4322-b566-d0f7d4de3c7d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:54.326939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-54c2d105-33c4-4322-b566-d0f7d4de3c7d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:54.331189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=18 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:54.341384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54c2d105-33c4-4322-b566-d0f7d4de3c7d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.343768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54c2d105-33c4-4322-b566-d0f7d4de3c7d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.344449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54c2d105-33c4-4322-b566-d0f7d4de3c7d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.346599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54c2d105-33c4-4322-b566-d0f7d4de3c7d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.347501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54c2d105-33c4-4322-b566-d0f7d4de3c7d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.348705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54c2d105-33c4-4322-b566-d0f7d4de3c7d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.631453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-509eb62c-b1f9-4c21-9a03-6f8f03521b86 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:54.645778 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-509eb62c-b1f9-4c21-9a03-6f8f03521b86 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1317 microversion: 2.1 time: 0.465886 Oct 11 19:44:54.659346 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 434/832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:54 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:54.667459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d60eb14a-a6ec-4454-8faa-4e71855a8a70 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:54.668195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d60eb14a-a6ec-4454-8faa-4e71855a8a70 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:54.675044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d60eb14a-a6ec-4454-8faa-4e71855a8a70 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.675801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d60eb14a-a6ec-4454-8faa-4e71855a8a70 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.676490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d60eb14a-a6ec-4454-8faa-4e71855a8a70 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.677412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d60eb14a-a6ec-4454-8faa-4e71855a8a70 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.678017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d60eb14a-a6ec-4454-8faa-4e71855a8a70 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.678680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d60eb14a-a6ec-4454-8faa-4e71855a8a70 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.696486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54c2d105-33c4-4322-b566-d0f7d4de3c7d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:54.706923 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-54c2d105-33c4-4322-b566-d0f7d4de3c7d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.384438 Oct 11 19:44:54.710643 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 399/833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:54 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:54.716715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:54.719252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:54.734542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.737658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.738288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.741424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.742305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.742960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.754220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d60eb14a-a6ec-4454-8faa-4e71855a8a70 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:44:54.828230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.831827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.832337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.832806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lazy-loading 'fault' on Instance uuid ba749f54-95af-4373-a6c8-c7e54b4091f3 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:54.916336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:54.927415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-38229e87-4508-4633-885d-e184c74f2b5e tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1304 microversion: 2.1 time: 0.215385 Oct 11 19:44:54.928030 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 400/834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:54 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1304 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:54.933944 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d60eb14a-a6ec-4454-8faa-4e71855a8a70 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 204 len: 0 microversion: 2.1 time: 0.273177 Oct 11 19:44:54.938644 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 435/835] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:44:54 2022] DELETE /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:44:54.942898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:54.950077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-d2fb36d5-b1d3-41a9-ad98-9dd37dd9fab1 req-8c5e9488-3c02-4b80-9c04-5c8bcf735800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce96652c-8276-41e4-b916-c39a8867c2bb", "name": "network-vif-plugged", "status": "completed", "tag": "408aa4ce-d9f4-4dfd-b98c-cd15018f5554"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:54.953679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:54.967758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d2fb36d5-b1d3-41a9-ad98-9dd37dd9fab1 req-8c5e9488-3c02-4b80-9c04-5c8bcf735800 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.968317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d2fb36d5-b1d3-41a9-ad98-9dd37dd9fab1 req-8c5e9488-3c02-4b80-9c04-5c8bcf735800 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.968810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d2fb36d5-b1d3-41a9-ad98-9dd37dd9fab1 req-8c5e9488-3c02-4b80-9c04-5c8bcf735800 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.969210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.969721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.970363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.977936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:54.978443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:54.978913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:54.985209 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-d2fb36d5-b1d3-41a9-ad98-9dd37dd9fab1 req-8c5e9488-3c02-4b80-9c04-5c8bcf735800 service nova] Creating event network-vif-plugged:408aa4ce-d9f4-4dfd-b98c-cd15018f5554 for instance ce96652c-8276-41e4-b916-c39a8867c2bb on n-h2-860864-3 Oct 11 19:44:54.993009 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-d2fb36d5-b1d3-41a9-ad98-9dd37dd9fab1 req-8c5e9488-3c02-4b80-9c04-5c8bcf735800 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051373 Oct 11 19:44:54.994009 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 436/836] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:55.004138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-28776114-b17f-432e-bfaf-b24179468ac9 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:55.005170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-28776114-b17f-432e-bfaf-b24179468ac9 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:55.024484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28776114-b17f-432e-bfaf-b24179468ac9 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.025467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28776114-b17f-432e-bfaf-b24179468ac9 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.025924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28776114-b17f-432e-bfaf-b24179468ac9 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.026677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28776114-b17f-432e-bfaf-b24179468ac9 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.029310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28776114-b17f-432e-bfaf-b24179468ac9 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.029747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28776114-b17f-432e-bfaf-b24179468ac9 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.047060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.047870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.048994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.050126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lazy-loading 'fault' on Instance uuid 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:55.142970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:55.151743 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-64398ba2-542e-4115-a6c8-2bd482c675ab tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 200 len: 1308 microversion: 2.1 time: 0.213799 Oct 11 19:44:55.153183 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 401/837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:54 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:55.159726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7c274edd-18e9-4010-b455-6047102e057c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:55.160653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7c274edd-18e9-4010-b455-6047102e057c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:55.167508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c274edd-18e9-4010-b455-6047102e057c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.168674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c274edd-18e9-4010-b455-6047102e057c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.169378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c274edd-18e9-4010-b455-6047102e057c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.170671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c274edd-18e9-4010-b455-6047102e057c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.171411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c274edd-18e9-4010-b455-6047102e057c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.172065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c274edd-18e9-4010-b455-6047102e057c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.465102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-28776114-b17f-432e-bfaf-b24179468ac9 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:55.477578 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-28776114-b17f-432e-bfaf-b24179468ac9 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1709 microversion: 2.1 time: 0.479597 Oct 11 19:44:55.479503 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 437/838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:54 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1709 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:55.486574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:55.487566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:55.504180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.505494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.505957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.506720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.508807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.509591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.532031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7c274edd-18e9-4010-b455-6047102e057c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:55.541918 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7c274edd-18e9-4010-b455-6047102e057c tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1324 microversion: 2.1 time: 0.387340 Oct 11 19:44:55.542494 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 402/839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:55 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:55.658862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:55.667095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:55.668552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:55.669735 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ccc5c97d-bb0b-4c09-9e5a-733776d8d852 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.189013 Oct 11 19:44:55.670355 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 438/840] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:55 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:55.673244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-df62c9f4-2167-4e8b-b1e1-5a4ed4885410 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:55.673763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-df62c9f4-2167-4e8b-b1e1-5a4ed4885410 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:55.679945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df62c9f4-2167-4e8b-b1e1-5a4ed4885410 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.680491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df62c9f4-2167-4e8b-b1e1-5a4ed4885410 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.680984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df62c9f4-2167-4e8b-b1e1-5a4ed4885410 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.681766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df62c9f4-2167-4e8b-b1e1-5a4ed4885410 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.682275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df62c9f4-2167-4e8b-b1e1-5a4ed4885410 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.682781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df62c9f4-2167-4e8b-b1e1-5a4ed4885410 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.737318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2a0254b9-76b8-4e37-86ec-52d7f9428627 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:55.737937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2a0254b9-76b8-4e37-86ec-52d7f9428627 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:55.744825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a0254b9-76b8-4e37-86ec-52d7f9428627 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.745320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a0254b9-76b8-4e37-86ec-52d7f9428627 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.745756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a0254b9-76b8-4e37-86ec-52d7f9428627 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.746463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a0254b9-76b8-4e37-86ec-52d7f9428627 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.746943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a0254b9-76b8-4e37-86ec-52d7f9428627 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.747366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a0254b9-76b8-4e37-86ec-52d7f9428627 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.858276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-df62c9f4-2167-4e8b-b1e1-5a4ed4885410 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:55.867291 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-df62c9f4-2167-4e8b-b1e1-5a4ed4885410 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1317 microversion: 2.1 time: 0.197940 Oct 11 19:44:55.867879 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 403/841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:55 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:55.908650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2a0254b9-76b8-4e37-86ec-52d7f9428627 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:55.916129 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2a0254b9-76b8-4e37-86ec-52d7f9428627 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.182865 Oct 11 19:44:55.916696 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 439/842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:55 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:55.957408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:55.958015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:55.959886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:55.964941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.965421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.965848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.966551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.966995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.967409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:55.998940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:55.999166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:55.999598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.000040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lazy-loading 'fault' on Instance uuid ba749f54-95af-4373-a6c8-c7e54b4091f3 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:56.003953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f0d75fd8-e45b-402d-9166-cf1f25520078 req-b2c2c9df-3f87-46e8-8ee3-383291a753e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecbdb6e-ccfd-4837-8e14-d316bbf156b9", "name": "network-vif-deleted", "tag": "43f9af93-c53b-4d2a-a0b5-bc9140ac61f8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:56.013437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0d75fd8-e45b-402d-9166-cf1f25520078 req-b2c2c9df-3f87-46e8-8ee3-383291a753e4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.013922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0d75fd8-e45b-402d-9166-cf1f25520078 req-b2c2c9df-3f87-46e8-8ee3-383291a753e4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.014358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0d75fd8-e45b-402d-9166-cf1f25520078 req-b2c2c9df-3f87-46e8-8ee3-383291a753e4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.028133 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f0d75fd8-e45b-402d-9166-cf1f25520078 req-b2c2c9df-3f87-46e8-8ee3-383291a753e4 service nova] Creating event network-vif-deleted:43f9af93-c53b-4d2a-a0b5-bc9140ac61f8 for instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 on n-h2-860864-3 Oct 11 19:44:56.033964 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f0d75fd8-e45b-402d-9166-cf1f25520078 req-b2c2c9df-3f87-46e8-8ee3-383291a753e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033471 Oct 11 19:44:56.034634 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 440/843] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:44:56.045776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:56.054158 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0fcfedf1-011e-4a5a-89d6-4422132ca5d9 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1304 microversion: 2.1 time: 0.100982 Oct 11 19:44:56.054749 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 404/844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:55 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:56.179594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:56.180303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:56.186507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.187023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.187464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.188156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.188619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.189056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.202152 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] HTTP exception thrown: Instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 could not be found. Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Request method failure captured: Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 HTTP/1.1 Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcd7vMMsi5FyUXnwXBq_QG0ZuzmtDRfvMxgpV4a0n-Dy6Amip78xkU2BkkWBW5rfyCSSB9YyAfHBn_mMdUSml84R2-nWwQAgS43HIUo10r6JLl4pwqDYOsHVkF4Lei0Pnw6PtciUBR8U1gAEBqWnTVjeWKL3S2U0FRDQakzWT0fyFUE Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 305f047e2a5b43df83b2ae40e448a1ab Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-LiveMigrationNegativeTest-904882904 Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:44:56.203795 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/305f047e2a5b43df83b2ae40e448a1ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_305f047e2a5b43df83b2ae40e448a1ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/305f047e2a5b43df83b2ae40e448a1ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/305f047e2a5b43df83b2ae40e448a1ab"}]}] Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-LiveMigrationNegativeTest-904882904 Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 305f047e2a5b43df83b2ae40e448a1ab Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-904882904 Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-LiveMigrationNegativeTest-904882904-project Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 78d551deb3024dc2969b3fc19c3cb42d Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-LiveMigrationNegativeTest-904882904-project Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 could not be found. Oct 11 19:44:56.206070 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '6ecbdb6e-ccfd-4837-8e14-d316bbf156b9'} Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 could not be found. Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:56.206983 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 could not be found. Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 could not be found. Oct 11 19:44:56.208325 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:44:56.209594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Returning 404 to user: Instance 6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:56.209594 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc7ba11b-fdb4-4353-8a48-e024b3e50af1 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9" status: 404 len: 111 microversion: 2.1 time: 0.030360 Oct 11 19:44:56.209594 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 441/845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:56 2022] GET /compute/v2.1/servers/6ecbdb6e-ccfd-4837-8e14-d316bbf156b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:44:56.214122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e1d28e3-aad6-485f-aae1-7b80d352279c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:56.214662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e1d28e3-aad6-485f-aae1-7b80d352279c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:56.221226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e1d28e3-aad6-485f-aae1-7b80d352279c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.221716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e1d28e3-aad6-485f-aae1-7b80d352279c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.222162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e1d28e3-aad6-485f-aae1-7b80d352279c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.222888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e1d28e3-aad6-485f-aae1-7b80d352279c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.223357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e1d28e3-aad6-485f-aae1-7b80d352279c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.223774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e1d28e3-aad6-485f-aae1-7b80d352279c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.251190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e1d28e3-aad6-485f-aae1-7b80d352279c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:44:56.333493 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e1d28e3-aad6-485f-aae1-7b80d352279c tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 204 len: 0 microversion: 2.1 time: 0.122778 Oct 11 19:44:56.334553 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 405/846] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:44:56 2022] DELETE /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:44:56.342187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5dde1fa6-32b3-42c0-86fc-8f7724355e1e tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:56.342854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5dde1fa6-32b3-42c0-86fc-8f7724355e1e tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:56.349684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dde1fa6-32b3-42c0-86fc-8f7724355e1e tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.350175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dde1fa6-32b3-42c0-86fc-8f7724355e1e tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.350643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dde1fa6-32b3-42c0-86fc-8f7724355e1e tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.351425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dde1fa6-32b3-42c0-86fc-8f7724355e1e tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.355176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dde1fa6-32b3-42c0-86fc-8f7724355e1e tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.355619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dde1fa6-32b3-42c0-86fc-8f7724355e1e tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.487879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5dde1fa6-32b3-42c0-86fc-8f7724355e1e tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:56.495659 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5dde1fa6-32b3-42c0-86fc-8f7724355e1e tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1474 microversion: 2.1 time: 0.157322 Oct 11 19:44:56.496227 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 442/847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:56 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1474 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:56.505274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6943fef-c527-4444-9193-9bd3e1c60bed tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:56.506198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6943fef-c527-4444-9193-9bd3e1c60bed tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:56.512573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6943fef-c527-4444-9193-9bd3e1c60bed tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.513068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6943fef-c527-4444-9193-9bd3e1c60bed tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.513513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6943fef-c527-4444-9193-9bd3e1c60bed tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.514214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6943fef-c527-4444-9193-9bd3e1c60bed tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.514707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6943fef-c527-4444-9193-9bd3e1c60bed tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.515136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6943fef-c527-4444-9193-9bd3e1c60bed tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.566001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5258b30-6014-45f9-afa1-a51518eedac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:56.566655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f5258b30-6014-45f9-afa1-a51518eedac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:56.572810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5258b30-6014-45f9-afa1-a51518eedac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.573500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5258b30-6014-45f9-afa1-a51518eedac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.573949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5258b30-6014-45f9-afa1-a51518eedac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.574685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5258b30-6014-45f9-afa1-a51518eedac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.575270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5258b30-6014-45f9-afa1-a51518eedac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.575703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5258b30-6014-45f9-afa1-a51518eedac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.718014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f6943fef-c527-4444-9193-9bd3e1c60bed tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:56.726024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:56.730508 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6943fef-c527-4444-9193-9bd3e1c60bed tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1709 microversion: 2.1 time: 0.229682 Oct 11 19:44:56.731305 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 406/848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:56 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1709 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:56.750280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f5258b30-6014-45f9-afa1-a51518eedac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:56.752980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:56.754292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:56.760580 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f5258b30-6014-45f9-afa1-a51518eedac4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1324 microversion: 2.1 time: 0.199054 Oct 11 19:44:56.760797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.761140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.761602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.761909 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 443/849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:56 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:56.762309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.762796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.763405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.890601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5dc12fa6-0904-43b9-95a2-11268d001bf7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:56.891558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5dc12fa6-0904-43b9-95a2-11268d001bf7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:56.898688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dc12fa6-0904-43b9-95a2-11268d001bf7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.899541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dc12fa6-0904-43b9-95a2-11268d001bf7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.900425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dc12fa6-0904-43b9-95a2-11268d001bf7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.901222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dc12fa6-0904-43b9-95a2-11268d001bf7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.901775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dc12fa6-0904-43b9-95a2-11268d001bf7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.902317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dc12fa6-0904-43b9-95a2-11268d001bf7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.903053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:56.929751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:56.939621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:56.944058 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d451f4a8-ecbd-493f-a7f6-1857d2363e97 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.199899 Oct 11 19:44:56.945395 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 407/850] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:56 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:56.957670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7eda743b-9c7d-46b1-8757-9f035eb8796f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:56.965522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7eda743b-9c7d-46b1-8757-9f035eb8796f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:56.979322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eda743b-9c7d-46b1-8757-9f035eb8796f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.979951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eda743b-9c7d-46b1-8757-9f035eb8796f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.980477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eda743b-9c7d-46b1-8757-9f035eb8796f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:56.981252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eda743b-9c7d-46b1-8757-9f035eb8796f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:56.981782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eda743b-9c7d-46b1-8757-9f035eb8796f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:56.982280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eda743b-9c7d-46b1-8757-9f035eb8796f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:57.098137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5dc12fa6-0904-43b9-95a2-11268d001bf7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:57.106065 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5dc12fa6-0904-43b9-95a2-11268d001bf7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1317 microversion: 2.1 time: 0.219340 Oct 11 19:44:57.107288 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 444/851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:56 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:44:57.128621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:57.129769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:57.141122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:57.142357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:57.143295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:57.144360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:57.145093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:57.145940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:57.189022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:57.190863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:57.191571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:57.192188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lazy-loading 'fault' on Instance uuid ba749f54-95af-4373-a6c8-c7e54b4091f3 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:44:57.234055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7eda743b-9c7d-46b1-8757-9f035eb8796f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:57.244353 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7eda743b-9c7d-46b1-8757-9f035eb8796f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.295006 Oct 11 19:44:57.245555 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 408/852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:56 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:57.252569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0465ef383d894553a8116adca7f4cf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc7fd4b21fb43a99990a513786fd9ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:57.261904 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-612fd24e-8990-41e6-869f-93d349a1a392 tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 200 len: 1304 microversion: 2.1 time: 0.153214 Oct 11 19:44:57.262517 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 445/853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:57 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:57.519992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee927036-dd34-4dc7-bc5e-3d1fe689d8af tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:57.520510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ee927036-dd34-4dc7-bc5e-3d1fe689d8af tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:57.526919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee927036-dd34-4dc7-bc5e-3d1fe689d8af tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:57.527409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee927036-dd34-4dc7-bc5e-3d1fe689d8af tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:57.527849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee927036-dd34-4dc7-bc5e-3d1fe689d8af tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:57.528542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee927036-dd34-4dc7-bc5e-3d1fe689d8af tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:57.529004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee927036-dd34-4dc7-bc5e-3d1fe689d8af tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:57.529434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee927036-dd34-4dc7-bc5e-3d1fe689d8af tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:57.665479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ee927036-dd34-4dc7-bc5e-3d1fe689d8af tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:57.674432 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ee927036-dd34-4dc7-bc5e-3d1fe689d8af tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1474 microversion: 2.1 time: 0.159034 Oct 11 19:44:57.675357 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 409/854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:57 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1474 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:57.762589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-68ec84bf-5bde-4f38-a5a6-a721cf853977 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:57.763755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-68ec84bf-5bde-4f38-a5a6-a721cf853977 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:57.777153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ec84bf-5bde-4f38-a5a6-a721cf853977 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:57.777584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ec84bf-5bde-4f38-a5a6-a721cf853977 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:57.778014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ec84bf-5bde-4f38-a5a6-a721cf853977 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:57.784799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ec84bf-5bde-4f38-a5a6-a721cf853977 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:57.785198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ec84bf-5bde-4f38-a5a6-a721cf853977 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:57.785677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68ec84bf-5bde-4f38-a5a6-a721cf853977 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:57.786338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e5e58c03-411a-44c5-a776-819652d8d1e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:57.787325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e5e58c03-411a-44c5-a776-819652d8d1e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:57.796467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5e58c03-411a-44c5-a776-819652d8d1e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:57.799543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5e58c03-411a-44c5-a776-819652d8d1e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:57.800267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5e58c03-411a-44c5-a776-819652d8d1e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:57.801638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5e58c03-411a-44c5-a776-819652d8d1e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:57.802590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5e58c03-411a-44c5-a776-819652d8d1e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:57.803326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5e58c03-411a-44c5-a776-819652d8d1e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.118907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e5e58c03-411a-44c5-a776-819652d8d1e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:58.130247 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e5e58c03-411a-44c5-a776-819652d8d1e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1519 microversion: 2.1 time: 0.348320 Oct 11 19:44:58.130887 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 410/855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:57 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:58.134211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68ec84bf-5bde-4f38-a5a6-a721cf853977 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:58.136987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:58.137613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:58.144669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.145345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.145955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.146854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.147499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.148116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.151990 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-68ec84bf-5bde-4f38-a5a6-a721cf853977 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1709 microversion: 2.1 time: 0.397052 Oct 11 19:44:58.152230 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 446/856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:57 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1709 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:58.165854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58d80303-9d8d-4425-a45f-d35fd7204778 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:58.166472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58d80303-9d8d-4425-a45f-d35fd7204778 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:58.176526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58d80303-9d8d-4425-a45f-d35fd7204778 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.177264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58d80303-9d8d-4425-a45f-d35fd7204778 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.177861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58d80303-9d8d-4425-a45f-d35fd7204778 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.178762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58d80303-9d8d-4425-a45f-d35fd7204778 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.179375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58d80303-9d8d-4425-a45f-d35fd7204778 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.180077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58d80303-9d8d-4425-a45f-d35fd7204778 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.185401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:58.462410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:58.475520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:58.478035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:58.481073 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-568c0e18-f5f0-45b9-a23a-1f09234490f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.348641 Oct 11 19:44:58.482918 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 411/857] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:58 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:44:58.498618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7143c652-79bd-4fda-80b8-d4944d0c4de0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:58.499417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7143c652-79bd-4fda-80b8-d4944d0c4de0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:58.504527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58d80303-9d8d-4425-a45f-d35fd7204778 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:58.512486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7143c652-79bd-4fda-80b8-d4944d0c4de0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.513575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7143c652-79bd-4fda-80b8-d4944d0c4de0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.515214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7143c652-79bd-4fda-80b8-d4944d0c4de0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.516284 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58d80303-9d8d-4425-a45f-d35fd7204778 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1317 microversion: 2.1 time: 0.358441 Oct 11 19:44:58.518610 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 447/858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:58 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:58.519025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7143c652-79bd-4fda-80b8-d4944d0c4de0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.520303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7143c652-79bd-4fda-80b8-d4944d0c4de0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.520978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7143c652-79bd-4fda-80b8-d4944d0c4de0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.526657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-390b971c-942f-4393-964d-8bbf101ce4fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:58.534422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-390b971c-942f-4393-964d-8bbf101ce4fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:58.547600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390b971c-942f-4393-964d-8bbf101ce4fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.548749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390b971c-942f-4393-964d-8bbf101ce4fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.549283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390b971c-942f-4393-964d-8bbf101ce4fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.560202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390b971c-942f-4393-964d-8bbf101ce4fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.560770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390b971c-942f-4393-964d-8bbf101ce4fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.561211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390b971c-942f-4393-964d-8bbf101ce4fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.562451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7143c652-79bd-4fda-80b8-d4944d0c4de0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:44:58.689266 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7143c652-79bd-4fda-80b8-d4944d0c4de0 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 204 len: 0 microversion: 2.1 time: 0.202696 Oct 11 19:44:58.689560 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 412/859] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:44:58 2022] DELETE /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:44:58.696416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:58.697598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] [instance: ba749f54-95af-4373-a6c8-c7e54b4091f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:58.715287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.716126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.716279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.716941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.717503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.717828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.743216 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] HTTP exception thrown: Instance ba749f54-95af-4373-a6c8-c7e54b4091f3 could not be found. Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Request method failure captured: Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 HTTP/1.1 Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcegfpI1ENmOJ97QrJoc0MVCIUSgyk6Q8FVsAXs_dHIyE2HtlSuZLLVQYdSOmtTtNi2raRojB4BJMklMRO3Osudr9ga4wWAaddcAK17bhiu0VnDDhuFSVS6zrtix9AT15XmeOHDHTsQ3f57Cp4vRvmj7N09nMUu_Z1qKdRtQUq8Fx48 Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1dc7fd4b21fb43a99990a513786fd9ec Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TenantUsagesTestJSON-112202782 Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:44:58.745830 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1dc7fd4b21fb43a99990a513786fd9ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1dc7fd4b21fb43a99990a513786fd9ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dc7fd4b21fb43a99990a513786fd9ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dc7fd4b21fb43a99990a513786fd9ec"}]}] Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TenantUsagesTestJSON-112202782 Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1dc7fd4b21fb43a99990a513786fd9ec Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TenantUsagesTestJSON-112202782 Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TenantUsagesTestJSON-112202782-project Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 0465ef383d894553a8116adca7f4cf0a Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TenantUsagesTestJSON-112202782-project Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance ba749f54-95af-4373-a6c8-c7e54b4091f3 could not be found. Oct 11 19:44:58.747980 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ba749f54-95af-4373-a6c8-c7e54b4091f3'} Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba749f54-95af-4373-a6c8-c7e54b4091f3 could not be found. Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:44:58.749584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba749f54-95af-4373-a6c8-c7e54b4091f3 could not be found. Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba749f54-95af-4373-a6c8-c7e54b4091f3 could not be found. Oct 11 19:44:58.751728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:44:58.755300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] Returning 404 to user: Instance ba749f54-95af-4373-a6c8-c7e54b4091f3 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:44:58.756577 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8b18735c-2d59-4e9a-8775-56f7e03b3f1b tempest-TenantUsagesTestJSON-112202782 tempest-TenantUsagesTestJSON-112202782-project] 10.222.0.27 "GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3" status: 404 len: 111 microversion: 2.1 time: 0.065823 Oct 11 19:44:58.757985 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 413/860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:58 2022] GET /compute/v2.1/servers/ba749f54-95af-4373-a6c8-c7e54b4091f3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:44:58.775065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-390b971c-942f-4393-964d-8bbf101ce4fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:58.780047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7dc9e480-1723-4367-9bfc-2fea7a56a834 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:58.780695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7dc9e480-1723-4367-9bfc-2fea7a56a834 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:58.789834 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-390b971c-942f-4393-964d-8bbf101ce4fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.267870 Oct 11 19:44:58.791973 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 448/861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:58 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:58.804481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-333c207d-a5d9-4167-a8cb-1f24cc444ff2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:58.804667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7dc9e480-1723-4367-9bfc-2fea7a56a834 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.805160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7dc9e480-1723-4367-9bfc-2fea7a56a834 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.805628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7dc9e480-1723-4367-9bfc-2fea7a56a834 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.806311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7dc9e480-1723-4367-9bfc-2fea7a56a834 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.807661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-333c207d-a5d9-4167-a8cb-1f24cc444ff2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:58.823058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7dc9e480-1723-4367-9bfc-2fea7a56a834 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.823381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-333c207d-a5d9-4167-a8cb-1f24cc444ff2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.823569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7dc9e480-1723-4367-9bfc-2fea7a56a834 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.824180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-333c207d-a5d9-4167-a8cb-1f24cc444ff2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.824806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-333c207d-a5d9-4167-a8cb-1f24cc444ff2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:58.825689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-333c207d-a5d9-4167-a8cb-1f24cc444ff2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:58.826142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-333c207d-a5d9-4167-a8cb-1f24cc444ff2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:58.826593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-333c207d-a5d9-4167-a8cb-1f24cc444ff2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.308890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7dc9e480-1723-4367-9bfc-2fea7a56a834 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:59.319657 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7dc9e480-1723-4367-9bfc-2fea7a56a834 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1474 microversion: 2.1 time: 0.560274 Oct 11 19:44:59.325853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-333c207d-a5d9-4167-a8cb-1f24cc444ff2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:59.335525 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-333c207d-a5d9-4167-a8cb-1f24cc444ff2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1525 microversion: 2.1 time: 0.542098 Oct 11 19:44:59.336055 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 414/862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:58 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1474 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:59.341475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-5d280fb1-482c-44fd-b729-6e8791d8d3a6 req-17268b1d-ef34-4880-ae85-fb99b1121f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bba293-5871-4552-b639-4f1e0fb137cf", "name": "network-vif-plugged", "status": "completed", "tag": "ea21aae9-abce-4446-a07a-83c7705b4edb"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:59.344041 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 449/863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:58 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1525 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:59.375152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dad20c5d-4768-414f-be8b-01aa52db46d6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:59.376157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dad20c5d-4768-414f-be8b-01aa52db46d6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:59.388923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5d280fb1-482c-44fd-b729-6e8791d8d3a6 req-17268b1d-ef34-4880-ae85-fb99b1121f3d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:59.389342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5d280fb1-482c-44fd-b729-6e8791d8d3a6 req-17268b1d-ef34-4880-ae85-fb99b1121f3d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:59.392193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dad20c5d-4768-414f-be8b-01aa52db46d6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:59.392795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dad20c5d-4768-414f-be8b-01aa52db46d6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:59.393598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dad20c5d-4768-414f-be8b-01aa52db46d6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.395967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5d280fb1-482c-44fd-b729-6e8791d8d3a6 req-17268b1d-ef34-4880-ae85-fb99b1121f3d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.398191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dad20c5d-4768-414f-be8b-01aa52db46d6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:59.403053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dad20c5d-4768-414f-be8b-01aa52db46d6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:59.404338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dad20c5d-4768-414f-be8b-01aa52db46d6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.434043 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-5d280fb1-482c-44fd-b729-6e8791d8d3a6 req-17268b1d-ef34-4880-ae85-fb99b1121f3d service nova] Creating event network-vif-plugged:ea21aae9-abce-4446-a07a-83c7705b4edb for instance 42bba293-5871-4552-b639-4f1e0fb137cf on n-h2-860864-3 Oct 11 19:44:59.440212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-5d280fb1-482c-44fd-b729-6e8791d8d3a6 req-17268b1d-ef34-4880-ae85-fb99b1121f3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102744 Oct 11 19:44:59.442975 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 415/864] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:59.514422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:59.515384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:59.518323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:44:59.525843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:59.526362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:59.526898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.527617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:59.528400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:59.528649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.580428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dad20c5d-4768-414f-be8b-01aa52db46d6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:59.591698 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dad20c5d-4768-414f-be8b-01aa52db46d6 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1642 microversion: 2.1 time: 0.236323 Oct 11 19:44:59.594056 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 450/865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:59 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1642 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:59.601377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-daa0e1e4-5fe0-4960-8440-024b5bd16007 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:59.602166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-daa0e1e4-5fe0-4960-8440-024b5bd16007 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:59.622957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa0e1e4-5fe0-4960-8440-024b5bd16007 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:59.623527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa0e1e4-5fe0-4960-8440-024b5bd16007 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:59.624072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa0e1e4-5fe0-4960-8440-024b5bd16007 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.624707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa0e1e4-5fe0-4960-8440-024b5bd16007 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:59.625195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa0e1e4-5fe0-4960-8440-024b5bd16007 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:59.625591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa0e1e4-5fe0-4960-8440-024b5bd16007 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.804179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:59.827597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:59.830551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:59.831249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-daa0e1e4-5fe0-4960-8440-024b5bd16007 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:44:59.831786 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d77108dc-3c26-4271-b254-a85bfc9f9dfd tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1568 microversion: 2.25 time: 0.324261 Oct 11 19:44:59.832366 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 416/866] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:44:59 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1568 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:44:59.839902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3f621b27-d7ad-476b-b596-19f72a2eb287 req-1f28fe7e-1324-43b0-bc30-01893e35ce77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbe5ea6-515a-45e2-9d56-2dae509d87ab", "name": "network-vif-deleted", "tag": "c7d714c2-cbed-4ffc-8bac-481c12889743"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:44:59.842749 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-daa0e1e4-5fe0-4960-8440-024b5bd16007 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1317 microversion: 2.1 time: 0.245739 Oct 11 19:44:59.851256 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 451/867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:59 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:44:59.853026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3f621b27-d7ad-476b-b596-19f72a2eb287 req-1f28fe7e-1324-43b0-bc30-01893e35ce77 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:59.853690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3f621b27-d7ad-476b-b596-19f72a2eb287 req-1f28fe7e-1324-43b0-bc30-01893e35ce77 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:59.854353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3f621b27-d7ad-476b-b596-19f72a2eb287 req-1f28fe7e-1324-43b0-bc30-01893e35ce77 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.869826 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3f621b27-d7ad-476b-b596-19f72a2eb287 req-1f28fe7e-1324-43b0-bc30-01893e35ce77 service nova] Creating event network-vif-deleted:c7d714c2-cbed-4ffc-8bac-481c12889743 for instance ccbe5ea6-515a-45e2-9d56-2dae509d87ab on n-h2-860864-3 Oct 11 19:44:59.873928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0ad2cff8-e985-4980-891c-522ef4e0ccf9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:44:59.874628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0ad2cff8-e985-4980-891c-522ef4e0ccf9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:44:59.882239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad2cff8-e985-4980-891c-522ef4e0ccf9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:59.883458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad2cff8-e985-4980-891c-522ef4e0ccf9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:59.884260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad2cff8-e985-4980-891c-522ef4e0ccf9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.885360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad2cff8-e985-4980-891c-522ef4e0ccf9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:44:59.886587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad2cff8-e985-4980-891c-522ef4e0ccf9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:44:59.887203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad2cff8-e985-4980-891c-522ef4e0ccf9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:44:59.896604 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3f621b27-d7ad-476b-b596-19f72a2eb287 req-1f28fe7e-1324-43b0-bc30-01893e35ce77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062412 Oct 11 19:44:59.900027 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 417/868] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:44:59.916547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=14 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:00.083779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0ad2cff8-e985-4980-891c-522ef4e0ccf9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:00.094426 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0ad2cff8-e985-4980-891c-522ef4e0ccf9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.242036 Oct 11 19:45:00.096043 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 452/869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:44:59 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:00.344123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:00.344755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:00.353625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.354122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.354579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:00.355281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.355739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.356166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:00.367270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-edce403a-cb6f-47a1-81a8-614d17f8c975 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:00.368512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-edce403a-cb6f-47a1-81a8-614d17f8c975 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:00.376974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edce403a-cb6f-47a1-81a8-614d17f8c975 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.379057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edce403a-cb6f-47a1-81a8-614d17f8c975 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.379850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edce403a-cb6f-47a1-81a8-614d17f8c975 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:00.382270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edce403a-cb6f-47a1-81a8-614d17f8c975 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.384025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edce403a-cb6f-47a1-81a8-614d17f8c975 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.387835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edce403a-cb6f-47a1-81a8-614d17f8c975 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:00.494625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.495122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.505458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:00.506053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lazy-loading 'fault' on Instance uuid ccbe5ea6-515a-45e2-9d56-2dae509d87ab {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:00.642584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:00.653419 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7499e38c-b203-4632-933c-1dc496496f08 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1308 microversion: 2.1 time: 0.311479 Oct 11 19:45:00.660622 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 418/870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:00 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:00.670714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-88b697d5-5c61-46f4-a7fe-a20b769f8a75 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:00.671335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-88b697d5-5c61-46f4-a7fe-a20b769f8a75 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:00.695882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b697d5-5c61-46f4-a7fe-a20b769f8a75 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.697842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b697d5-5c61-46f4-a7fe-a20b769f8a75 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.698515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b697d5-5c61-46f4-a7fe-a20b769f8a75 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:00.699425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b697d5-5c61-46f4-a7fe-a20b769f8a75 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.707811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b697d5-5c61-46f4-a7fe-a20b769f8a75 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.708501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b697d5-5c61-46f4-a7fe-a20b769f8a75 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:00.865872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-edce403a-cb6f-47a1-81a8-614d17f8c975 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:00.880181 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-edce403a-cb6f-47a1-81a8-614d17f8c975 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1525 microversion: 2.1 time: 0.516379 Oct 11 19:45:00.885886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-88b697d5-5c61-46f4-a7fe-a20b769f8a75 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:00.896037 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-88b697d5-5c61-46f4-a7fe-a20b769f8a75 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1346 microversion: 2.1 time: 0.234254 Oct 11 19:45:00.896422 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 453/871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:00 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1525 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:45:00.908058 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 419/872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:00 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1346 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:00.909037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:00.910020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:00.918864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.919664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.920316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:00.921242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.921943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.923340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:00.926773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a90b2ae8-9702-4330-8fdb-53b479fcffe6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:00.933695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a90b2ae8-9702-4330-8fdb-53b479fcffe6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:00.948896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a90b2ae8-9702-4330-8fdb-53b479fcffe6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.949499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a90b2ae8-9702-4330-8fdb-53b479fcffe6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.950034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a90b2ae8-9702-4330-8fdb-53b479fcffe6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:00.953532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a90b2ae8-9702-4330-8fdb-53b479fcffe6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:00.954480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a90b2ae8-9702-4330-8fdb-53b479fcffe6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:00.955071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a90b2ae8-9702-4330-8fdb-53b479fcffe6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.278480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:01.284663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a90b2ae8-9702-4330-8fdb-53b479fcffe6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:01.293754 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a90b2ae8-9702-4330-8fdb-53b479fcffe6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1317 microversion: 2.1 time: 0.372238 Oct 11 19:45:01.300730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:01.302087 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 420/873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:00 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:01.305844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:01.308253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9971775-6239-4808-b0e0-9881276776b9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:01.309208 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-73411836-e398-43e5-b3ad-594abc53d70f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1558 microversion: 2.25 time: 0.410938 Oct 11 19:45:01.310928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d9971775-6239-4808-b0e0-9881276776b9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:01.311422 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 454/874] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:00 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1558 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:01.322198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9971775-6239-4808-b0e0-9881276776b9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.327430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9971775-6239-4808-b0e0-9881276776b9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.328304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9971775-6239-4808-b0e0-9881276776b9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.329547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9971775-6239-4808-b0e0-9881276776b9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.330220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9971775-6239-4808-b0e0-9881276776b9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.330903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9971775-6239-4808-b0e0-9881276776b9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.350002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5771991c-0b62-492c-852c-5ecaa29f60bd tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '.version_select at 0x7f83cc5ff310>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:01.353813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5771991c-0b62-492c-852c-5ecaa29f60bd tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.354309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5771991c-0b62-492c-852c-5ecaa29f60bd tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.354783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5771991c-0b62-492c-852c-5ecaa29f60bd tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.373133 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5771991c-0b62-492c-852c-5ecaa29f60bd tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.028285 Oct 11 19:45:01.374485 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 455/875] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Oct 11 19:45:01 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:45:01.429806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d918b344-2fab-4932-a708-f28d45fd598c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:01.433718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d918b344-2fab-4932-a708-f28d45fd598c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:01.455870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d918b344-2fab-4932-a708-f28d45fd598c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.457019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d918b344-2fab-4932-a708-f28d45fd598c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.458032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d918b344-2fab-4932-a708-f28d45fd598c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.459724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d918b344-2fab-4932-a708-f28d45fd598c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.460713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d918b344-2fab-4932-a708-f28d45fd598c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.478279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d918b344-2fab-4932-a708-f28d45fd598c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.684498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d9971775-6239-4808-b0e0-9881276776b9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:01.697416 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9971775-6239-4808-b0e0-9881276776b9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.393905 Oct 11 19:45:01.711784 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 421/876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:01 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:01.722185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9c6f488c-0903-4532-b619-0e03e7d1039d req-a2737349-42b5-44a9-a806-5eb15979a60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee854-d900-44e9-8d2f-a34305c016ea", "name": "network-vif-plugged", "status": "completed", "tag": "bf229230-440b-48f9-9914-92cff8501f97"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:01.741964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9c6f488c-0903-4532-b619-0e03e7d1039d req-a2737349-42b5-44a9-a806-5eb15979a60c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.742704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9c6f488c-0903-4532-b619-0e03e7d1039d req-a2737349-42b5-44a9-a806-5eb15979a60c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.747244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9c6f488c-0903-4532-b619-0e03e7d1039d req-a2737349-42b5-44a9-a806-5eb15979a60c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.776030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9c6f488c-0903-4532-b619-0e03e7d1039d req-a2737349-42b5-44a9-a806-5eb15979a60c service nova] Creating event network-vif-plugged:bf229230-440b-48f9-9914-92cff8501f97 for instance 35dee854-d900-44e9-8d2f-a34305c016ea on n-h1-860864-3 Oct 11 19:45:01.781295 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9c6f488c-0903-4532-b619-0e03e7d1039d req-a2737349-42b5-44a9-a806-5eb15979a60c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068009 Oct 11 19:45:01.784065 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 422/877] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:01.792857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:01.793731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:01.802575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.803050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.803494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.804487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.804971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.805805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.847486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-d918b344-2fab-4932-a708-f28d45fd598c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:01.850807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.851535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.852229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.852913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lazy-loading 'fault' on Instance uuid ccbe5ea6-515a-45e2-9d56-2dae509d87ab {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:01.902909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78d551deb3024dc2969b3fc19c3cb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f047e2a5b43df83b2ae40e448a1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:01.911496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:01.926396 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-88da5e32-881d-43ac-a0c3-d14e262eaa71 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 200 len: 1308 microversion: 2.1 time: 0.132209 Oct 11 19:45:01.928899 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 423/878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:01 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:01.942607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:01.943483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:01.966194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.967147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.967861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.968916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:01.970418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:01.971129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:01.988556 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d918b344-2fab-4932-a708-f28d45fd598c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 2051 microversion: 2.25 time: 0.580610 Oct 11 19:45:01.990106 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 456/879] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:01 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 2051 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:02.003758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:02.005666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:02.034707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:02.038000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:02.040074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:02.047665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:02.049026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:02.049667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:02.050292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lazy-loading 'fault' on Instance uuid ce96652c-8276-41e4-b916-c39a8867c2bb {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:02.053260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:02.061428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:02.065507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:02.116675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:02.134909 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-471f1b42-186c-4d31-ac44-fbfcc084cfd2 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1314 microversion: 2.1 time: 0.203246 Oct 11 19:45:02.136063 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 424/880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:01 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:02.202030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a19aed1c-2009-4cba-8d8e-483110e13d1f req-ca9a0ec9-6aea-40d7-b365-522ed3b365ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9040218a-3ba8-4621-b4e7-20732e4cafd0", "name": "network-vif-deleted", "tag": "01598c88-4628-48c1-93e9-e3dada9b0918"}, {"server_uuid": "ce96652c-8276-41e4-b916-c39a8867c2bb", "name": "network-vif-deleted", "tag": "408aa4ce-d9f4-4dfd-b98c-cd15018f5554"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:02.231464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:02.237215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:02.245605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a19aed1c-2009-4cba-8d8e-483110e13d1f req-ca9a0ec9-6aea-40d7-b365-522ed3b365ea service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:02.246513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a19aed1c-2009-4cba-8d8e-483110e13d1f req-ca9a0ec9-6aea-40d7-b365-522ed3b365ea service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:02.247160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a19aed1c-2009-4cba-8d8e-483110e13d1f req-ca9a0ec9-6aea-40d7-b365-522ed3b365ea service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:02.251055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:02.254687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lazy-loading 'fault' on Instance uuid 9040218a-3ba8-4621-b4e7-20732e4cafd0 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:02.301315 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a19aed1c-2009-4cba-8d8e-483110e13d1f req-ca9a0ec9-6aea-40d7-b365-522ed3b365ea service nova] Creating event network-vif-deleted:01598c88-4628-48c1-93e9-e3dada9b0918 for instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 on n-h1-860864-3 Oct 11 19:45:02.302603 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a19aed1c-2009-4cba-8d8e-483110e13d1f req-ca9a0ec9-6aea-40d7-b365-522ed3b365ea service nova] Creating event network-vif-deleted:408aa4ce-d9f4-4dfd-b98c-cd15018f5554 for instance ce96652c-8276-41e4-b916-c39a8867c2bb on n-h2-860864-3 Oct 11 19:45:02.316912 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a19aed1c-2009-4cba-8d8e-483110e13d1f req-ca9a0ec9-6aea-40d7-b365-522ed3b365ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.118961 Oct 11 19:45:02.323248 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 425/881] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:02.332725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1884983814", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "80479427-085a-4dd2-8698-782034cdbfac"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:02.348424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603e5875618949c1998ea23bf0e954b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7b6535ad3d4f56b4483a9cde85691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:02.358543 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a28265b-1945-4ccd-a7dc-38d4188509b0 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 200 len: 1351 microversion: 2.1 time: 0.366691 Oct 11 19:45:02.359740 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 457/882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:01 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 1351 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:02.366125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5644f9a-28eb-41e0-ad45-f04c7124e782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:02.366843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f5644f9a-28eb-41e0-ad45-f04c7124e782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:02.374256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5644f9a-28eb-41e0-ad45-f04c7124e782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:02.375122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5644f9a-28eb-41e0-ad45-f04c7124e782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:02.376055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5644f9a-28eb-41e0-ad45-f04c7124e782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:02.377035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5644f9a-28eb-41e0-ad45-f04c7124e782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:02.377750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5644f9a-28eb-41e0-ad45-f04c7124e782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:02.378748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5644f9a-28eb-41e0-ad45-f04c7124e782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:02.475611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] validate_networks() for [('80479427-085a-4dd2-8698-782034cdbfac', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:45:02.680178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f5644f9a-28eb-41e0-ad45-f04c7124e782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:02.687991 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f5644f9a-28eb-41e0-ad45-f04c7124e782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1466 microversion: 2.1 time: 0.326302 Oct 11 19:45:02.689809 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 458/883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:02 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1466 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:02.711923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e65bd765-767e-401e-a819-4fe937b46180 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:02.712884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e65bd765-767e-401e-a819-4fe937b46180 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:02.718970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65bd765-767e-401e-a819-4fe937b46180 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:02.720176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65bd765-767e-401e-a819-4fe937b46180 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:02.720797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65bd765-767e-401e-a819-4fe937b46180 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:02.721569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65bd765-767e-401e-a819-4fe937b46180 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:02.722482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65bd765-767e-401e-a819-4fe937b46180 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:02.723003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65bd765-767e-401e-a819-4fe937b46180 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:02.985791 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e65bd765-767e-401e-a819-4fe937b46180 tempest-ServersOnMultiNodesTest-658855852 tempest-ServersOnMultiNodesTest-658855852-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1617 microversion: 2.1 time: 0.276987 Oct 11 19:45:02.986358 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 459/884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:02 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1617 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:45:03.003068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ceaac87d-fe16-460c-a9ea-d0061bc07d30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:03.004920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ceaac87d-fe16-460c-a9ea-d0061bc07d30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:03.014018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaac87d-fe16-460c-a9ea-d0061bc07d30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.014709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaac87d-fe16-460c-a9ea-d0061bc07d30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.015496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaac87d-fe16-460c-a9ea-d0061bc07d30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.017128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaac87d-fe16-460c-a9ea-d0061bc07d30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.017979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaac87d-fe16-460c-a9ea-d0061bc07d30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.019044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaac87d-fe16-460c-a9ea-d0061bc07d30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.213125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:45:03.213666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:45:03.214164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:45:03.214573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:45:03.215144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:45:03.224670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.225295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.225729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.227279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.227906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.228335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.246357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Getting quotas for project 0ac923f5632e40b2bd81aa5de2ed3f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:03.248671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ceaac87d-fe16-460c-a9ea-d0061bc07d30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:03.252182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Getting quotas for user 823a414535d04791844ab997869542b2 and project 0ac923f5632e40b2bd81aa5de2ed3f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:03.258204 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ceaac87d-fe16-460c-a9ea-d0061bc07d30 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1313 microversion: 2.1 time: 0.268015 Oct 11 19:45:03.258846 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 460/885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:02 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:03.263664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:03.264472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] [instance: ccbe5ea6-515a-45e2-9d56-2dae509d87ab] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:03.271083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.271564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.272004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.272699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.273152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.273573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.278456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:45:03.281018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:45:03.287350 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] HTTP exception thrown: Instance ccbe5ea6-515a-45e2-9d56-2dae509d87ab could not be found. Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Request method failure captured: Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab HTTP/1.1 Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcd7vMMsi5FyUXnwXBq_QG0ZuzmtDRfvMxgpV4a0n-Dy6Amip78xkU2BkkWBW5rfyCSSB9YyAfHBn_mMdUSml84R2-nWwQAgS43HIUo10r6JLl4pwqDYOsHVkF4Lei0Pnw6PtciUBR8U1gAEBqWnTVjeWKL3S2U0FRDQakzWT0fyFUE Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 305f047e2a5b43df83b2ae40e448a1ab Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-LiveMigrationNegativeTest-904882904 Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:03.288920 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/305f047e2a5b43df83b2ae40e448a1ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_305f047e2a5b43df83b2ae40e448a1ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/305f047e2a5b43df83b2ae40e448a1ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/305f047e2a5b43df83b2ae40e448a1ab"}]}] Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-LiveMigrationNegativeTest-904882904 Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 305f047e2a5b43df83b2ae40e448a1ab Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-904882904 Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-LiveMigrationNegativeTest-904882904-project Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 78d551deb3024dc2969b3fc19c3cb42d Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-LiveMigrationNegativeTest-904882904-project Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ccbe5ea6-515a-45e2-9d56-2dae509d87ab could not be found. Oct 11 19:45:03.290213 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ccbe5ea6-515a-45e2-9d56-2dae509d87ab'} Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccbe5ea6-515a-45e2-9d56-2dae509d87ab could not be found. Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:03.290967 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccbe5ea6-515a-45e2-9d56-2dae509d87ab could not be found. Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccbe5ea6-515a-45e2-9d56-2dae509d87ab could not be found. Oct 11 19:45:03.292087 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.293161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] Returning 404 to user: Instance ccbe5ea6-515a-45e2-9d56-2dae509d87ab could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:03.293161 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f7848e8d-6539-41f0-86b0-ab584273c6e4 tempest-LiveMigrationNegativeTest-904882904 tempest-LiveMigrationNegativeTest-904882904-project] 10.222.0.27 "GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab" status: 404 len: 111 microversion: 2.1 time: 0.031494 Oct 11 19:45:03.295801 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 461/886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:03 2022] GET /compute/v2.1/servers/ccbe5ea6-515a-45e2-9d56-2dae509d87ab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:03.301212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-427a8ce5-9c34-4ba5-8420-7c4c67683df3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:03.301745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-427a8ce5-9c34-4ba5-8420-7c4c67683df3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:03.307717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-427a8ce5-9c34-4ba5-8420-7c4c67683df3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.308207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-427a8ce5-9c34-4ba5-8420-7c4c67683df3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.308646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-427a8ce5-9c34-4ba5-8420-7c4c67683df3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.309341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-427a8ce5-9c34-4ba5-8420-7c4c67683df3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.309790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-427a8ce5-9c34-4ba5-8420-7c4c67683df3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.310378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-427a8ce5-9c34-4ba5-8420-7c4c67683df3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.341640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-427a8ce5-9c34-4ba5-8420-7c4c67683df3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:45:03.345211 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-97007293-2597-491b-b158-cde7622a3323 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.019271 Oct 11 19:45:03.352927 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 426/887] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:45:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 19:45:03.362016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:03.362720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:03.369601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.370097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.371263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.373090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.373803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.374771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.421747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.422922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.423399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.423957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lazy-loading 'fault' on Instance uuid ce96652c-8276-41e4-b916-c39a8867c2bb {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:03.428428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:03.511747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:03.514999 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-427a8ce5-9c34-4ba5-8420-7c4c67683df3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 204 len: 0 microversion: 2.1 time: 0.217358 Oct 11 19:45:03.520009 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 462/888] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:03 2022] DELETE /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:03.521787 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a1bd9247-01f3-4b9d-a6c2-265628204572 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1314 microversion: 2.1 time: 0.170011 Oct 11 19:45:03.522357 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 427/889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:03 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:03.529783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8bb82cd6-2226-4874-90d7-8d9457ccf586 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:03.534485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8bb82cd6-2226-4874-90d7-8d9457ccf586 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:03.535802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:03.540020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:03.550086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:03.550466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.551438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.552860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.554412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.555155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.555883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.585100 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] HTTP exception thrown: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Request method failure captured: Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 HTTP/1.1 Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccS1SWDlBUxDvbUQpDJXiOrpEhPRtLWnYu754SDmqlMkiEB_IaRHkxtOJ4KLbjXwjPCDA1Yb3i9HWsat4ibV3ONcOL39jcd3KsnazzrYCOd45GQ_gUp9epOjGWh6cgTRYIn-poBJICurkEldJRZF3Ikxw8Fu2bfENDBFwYb3BuX4Hk Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:03.586847 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a7b6535ad3d4f56b4483a9cde85691b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}] Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 603e5875618949c1998ea23bf0e954b5 Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:03.588432 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '9040218a-3ba8-4621-b4e7-20732e4cafd0'} Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:03.589320 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:03.590817 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.592184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Returning 404 to user: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:03.592184 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e1f427df-1a3c-4539-9fe8-b9be2699b102 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 404 len: 111 microversion: 2.1 time: 0.064953 Oct 11 19:45:03.592184 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 428/890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:03 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:03.593847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f63247d3-af1b-4f2b-baae-5fde557b3fbc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:03.594469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f63247d3-af1b-4f2b-baae-5fde557b3fbc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:03.602179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f63247d3-af1b-4f2b-baae-5fde557b3fbc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.602899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f63247d3-af1b-4f2b-baae-5fde557b3fbc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.603651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f63247d3-af1b-4f2b-baae-5fde557b3fbc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.604561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f63247d3-af1b-4f2b-baae-5fde557b3fbc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.605208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f63247d3-af1b-4f2b-baae-5fde557b3fbc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.605829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f63247d3-af1b-4f2b-baae-5fde557b3fbc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.641998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8bb82cd6-2226-4874-90d7-8d9457ccf586 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:03.650602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8bb82cd6-2226-4874-90d7-8d9457ccf586 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:03.656185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8bb82cd6-2226-4874-90d7-8d9457ccf586 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:03.670672 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8bb82cd6-2226-4874-90d7-8d9457ccf586 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1262 microversion: 2.25 time: 0.136691 Oct 11 19:45:03.671466 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 463/891] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:03 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:03.686674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:03.687506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:03.697857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.698833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.699929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.700649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.701269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.701711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.728639 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] HTTP exception thrown: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Request method failure captured: Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e HTTP/1.1 Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccS1SWDlBUxDvbUQpDJXiOrpEhPRtLWnYu754SDmqlMkiEB_IaRHkxtOJ4KLbjXwjPCDA1Yb3i9HWsat4ibV3ONcOL39jcd3KsnazzrYCOd45GQ_gUp9epOjGWh6cgTRYIn-poBJICurkEldJRZF3Ikxw8Fu2bfENDBFwYb3BuX4Hk Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:03.734316 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a7b6535ad3d4f56b4483a9cde85691b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}] Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 603e5875618949c1998ea23bf0e954b5 Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:03.737344 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '27956e70-3a33-46ba-98c8-f9dbfe444d2e'} Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:03.738129 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:03.739901 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.742201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Returning 404 to user: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:03.742201 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c411762-7f9f-4ef5-9e40-1bbdee79aacb tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "DELETE /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 404 len: 111 microversion: 2.1 time: 0.065702 Oct 11 19:45:03.742201 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 464/892] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:03 2022] DELETE /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:03.756513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:03.757168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:03.765763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.766850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.768515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.769568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:03.770113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:03.770962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:03.791765 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] HTTP exception thrown: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Request method failure captured: Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e HTTP/1.1 Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccS1SWDlBUxDvbUQpDJXiOrpEhPRtLWnYu754SDmqlMkiEB_IaRHkxtOJ4KLbjXwjPCDA1Yb3i9HWsat4ibV3ONcOL39jcd3KsnazzrYCOd45GQ_gUp9epOjGWh6cgTRYIn-poBJICurkEldJRZF3Ikxw8Fu2bfENDBFwYb3BuX4Hk Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:03.793485 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a7b6535ad3d4f56b4483a9cde85691b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}] Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 603e5875618949c1998ea23bf0e954b5 Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:03.795158 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '27956e70-3a33-46ba-98c8-f9dbfe444d2e'} Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:03.795882 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:03.797114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:03.800961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Returning 404 to user: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:03.802050 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c5cac063-6783-4c9b-b707-5a44191e6a8c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 404 len: 111 microversion: 2.1 time: 0.054408 Oct 11 19:45:03.802901 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 465/893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:03 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:03.814065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eacec848-db80-4089-8861-f9d43325215c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '.version_select at 0x7f83cc7d3dc0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:03.832250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f63247d3-af1b-4f2b-baae-5fde557b3fbc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:03.845968 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f63247d3-af1b-4f2b-baae-5fde557b3fbc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1472 microversion: 2.1 time: 0.255846 Oct 11 19:45:03.846986 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 429/894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:03 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:03.859805 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eacec848-db80-4089-8861-f9d43325215c tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-356615870" status: 202 len: 0 microversion: 2.1 time: 0.050647 Oct 11 19:45:03.862090 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 466/895] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 19:45:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-356615870 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:45:04.281635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-862b0d7f-0208-4494-9e87-bf4f361bea67 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:04.283224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-862b0d7f-0208-4494-9e87-bf4f361bea67 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:04.293691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-862b0d7f-0208-4494-9e87-bf4f361bea67 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:04.294788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-862b0d7f-0208-4494-9e87-bf4f361bea67 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:04.295643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-862b0d7f-0208-4494-9e87-bf4f361bea67 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:04.297201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-862b0d7f-0208-4494-9e87-bf4f361bea67 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:04.298133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-862b0d7f-0208-4494-9e87-bf4f361bea67 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:04.298795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-862b0d7f-0208-4494-9e87-bf4f361bea67 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:04.538407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-862b0d7f-0208-4494-9e87-bf4f361bea67 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:04.546344 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-862b0d7f-0208-4494-9e87-bf4f361bea67 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1463 microversion: 2.1 time: 0.268601 Oct 11 19:45:04.551526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:04.553357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:04.555454 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 430/896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:04 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1463 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:04.582982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:04.586353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:04.599160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:04.600251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:04.601967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:04.603891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:04.607310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:04.608535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:04.612872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:04.616028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:04.617049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:04.623758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:04.624906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:04.629271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:04.670161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:04.670952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:04.671730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:04.673259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lazy-loading 'fault' on Instance uuid ce96652c-8276-41e4-b916-c39a8867c2bb {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:04.791246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b671bc2d4849be938178f53135af2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a886c8ddf44b77974321e34b2fad8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:04.805123 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0897fa65-026a-4876-b283-605577f4471b tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 200 len: 1314 microversion: 2.1 time: 0.260799 Oct 11 19:45:04.806932 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 467/897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:04 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:04.817876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:04.819851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:04.830300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:04.830885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:04.831462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:04.832266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:04.832895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:04.833386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:04.884262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:04.892148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Old instance type m1.heat2, new instance type m1.heat {{(pid=126956) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 19:45:04.910491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:45:04.911956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:45:04.912557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:45:04.914110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:45:04.914562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:45:04.996622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:05.030517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:05.032306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:05.033453 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0f597a2e-7e7b-4ce7-bd0c-510068ab4c89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1258 microversion: 2.25 time: 0.224853 Oct 11 19:45:05.044993 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 468/898] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:04 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1258 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:05.052903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8468e645-abd5-43b2-9b3d-710cc77567b5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:05.059225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8468e645-abd5-43b2-9b3d-710cc77567b5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:05.090247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8468e645-abd5-43b2-9b3d-710cc77567b5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:05.093035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8468e645-abd5-43b2-9b3d-710cc77567b5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:05.093551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8468e645-abd5-43b2-9b3d-710cc77567b5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:05.096437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8468e645-abd5-43b2-9b3d-710cc77567b5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:05.096910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8468e645-abd5-43b2-9b3d-710cc77567b5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:05.101555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8468e645-abd5-43b2-9b3d-710cc77567b5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:05.110815 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-68d7c4b9-2d13-4cec-abe6-5a09d4c5a655 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea/action" status: 202 len: 0 microversion: 2.1 time: 0.533304 Oct 11 19:45:05.116992 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 431/899] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:45:04 2022] POST /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:45:05.126193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a545707c-602e-4299-9bdc-4b09ecaf2c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:05.127422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a545707c-602e-4299-9bdc-4b09ecaf2c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:05.138576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a545707c-602e-4299-9bdc-4b09ecaf2c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:05.140015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a545707c-602e-4299-9bdc-4b09ecaf2c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:05.142880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a545707c-602e-4299-9bdc-4b09ecaf2c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:05.144430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a545707c-602e-4299-9bdc-4b09ecaf2c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:05.145066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a545707c-602e-4299-9bdc-4b09ecaf2c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:05.145651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a545707c-602e-4299-9bdc-4b09ecaf2c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:05.771866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a545707c-602e-4299-9bdc-4b09ecaf2c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:05.788397 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a545707c-602e-4299-9bdc-4b09ecaf2c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1472 microversion: 2.1 time: 0.665462 Oct 11 19:45:05.790561 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 432/900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:05 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1472 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:05.822454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8468e645-abd5-43b2-9b3d-710cc77567b5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:05.833134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-28669048-d343-4673-a55b-e46ab7aab37c tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:05.856962 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8468e645-abd5-43b2-9b3d-710cc77567b5 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1472 microversion: 2.1 time: 0.810817 Oct 11 19:45:05.862027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:05.864110 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 469/901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:05 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1472 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:05.880187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:05.883979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: ce96652c-8276-41e4-b916-c39a8867c2bb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:05.892136 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-28669048-d343-4673-a55b-e46ab7aab37c tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/372895867" status: 202 len: 0 microversion: 2.1 time: 0.077494 Oct 11 19:45:05.896839 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 433/902] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:45:05 2022] DELETE /compute/v2.1/flavors/372895867 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:45:05.910203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e2bce97b-923e-4862-9d63-7d910516e842 tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:05.912161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:05.913106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:05.913720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:05.914634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:05.915255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:05.915862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:05.942604 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Instance ce96652c-8276-41e4-b916-c39a8867c2bb could not be found. Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb HTTP/1.1 Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:05.944384 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ce96652c-8276-41e4-b916-c39a8867c2bb could not be found. Oct 11 19:45:05.945958 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ce96652c-8276-41e4-b916-c39a8867c2bb'} Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce96652c-8276-41e4-b916-c39a8867c2bb could not be found. Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:05.946845 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce96652c-8276-41e4-b916-c39a8867c2bb could not be found. Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce96652c-8276-41e4-b916-c39a8867c2bb could not be found. Oct 11 19:45:05.948123 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:05.969055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 404 to user: Instance ce96652c-8276-41e4-b916-c39a8867c2bb could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:05.972996 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-57886c3a-fb82-4518-9206-92b11b28cab8 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb" status: 404 len: 111 microversion: 2.1 time: 0.107414 Oct 11 19:45:05.976173 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 470/903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:05 2022] GET /compute/v2.1/servers/ce96652c-8276-41e4-b916-c39a8867c2bb => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:05.984755 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e2bce97b-923e-4862-9d63-7d910516e842 tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.086448 Oct 11 19:45:05.989376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e88c9a16-c16b-4933-ab91-e157675575e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '.version_select at 0x7f83cc8791f0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.017104 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 434/904] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:45:05 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:06.034505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c62ac7b5-85eb-436e-8e2f-58ac7c902c32 tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.047590 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e88c9a16-c16b-4933-ab91-e157675575e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Image not found. Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e88c9a16-c16b-4933-ab91-e157675575e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/images/9ea9524b-bad6-4c87-bc2b-a5a331f5acf4 HTTP/1.1 Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:06.052764 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '9ea9524b-bad6-4c87-bc2b-a5a331f5acf4'} Oct 11 19:45:06.054131 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9ea9524b-bad6-4c87-bc2b-a5a331f5acf4 to delete Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.054974 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ea9524b-bad6-4c87-bc2b-a5a331f5acf4 could not be found. Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:06.056160 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e88c9a16-c16b-4933-ab91-e157675575e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:06.057402 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e88c9a16-c16b-4933-ab91-e157675575e3 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "DELETE /compute/v2.1/images/9ea9524b-bad6-4c87-bc2b-a5a331f5acf4" status: 404 len: 62 microversion: 2.1 time: 0.073836 Oct 11 19:45:06.060365 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 471/905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:05 2022] DELETE /compute/v2.1/images/9ea9524b-bad6-4c87-bc2b-a5a331f5acf4 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:45:06.068304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.069695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:06.080803 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c62ac7b5-85eb-436e-8e2f-58ac7c902c32 tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/384604654" status: 202 len: 0 microversion: 2.1 time: 0.062316 Oct 11 19:45:06.085150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.085901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.087844 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 435/906] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:45:06 2022] DELETE /compute/v2.1/flavors/384604654 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:45:06.096332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.097550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.102788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.103516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.107722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.111201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:06.136140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.136646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.137084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.137816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.138272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.146365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.156165 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f HTTP/1.1 Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:06.159044 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:45:06.160651 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f96af3c9-b2ae-4568-9aad-268b2595cf5f'} Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:06.161490 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:45:06.163194 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.165623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 404 to user: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:06.165924 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7ce27b85-215a-4690-b2a0-fdb20d95f803 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 404 len: 111 microversion: 2.1 time: 0.106131 Oct 11 19:45:06.170702 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 472/907] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:06 2022] DELETE /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:06.187934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-81a2b648-326d-4c0c-90d7-5d112ed842c1 tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.247975 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-81a2b648-326d-4c0c-90d7-5d112ed842c1 tempest-ServersWithSpecificFlavorTestJSON-1353763608 tempest-ServersWithSpecificFlavorTestJSON-1353763608-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076116 Oct 11 19:45:06.252639 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 473/908] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:45:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:06.272855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.274936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: f96af3c9-b2ae-4568-9aad-268b2595cf5f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:06.293524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.293957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.294401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.295204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.296061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.296694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.332705 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f HTTP/1.1 Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:06.336057 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:45:06.337354 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f96af3c9-b2ae-4568-9aad-268b2595cf5f'} Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:06.338045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. Oct 11 19:45:06.339568 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.340711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 404 to user: Instance f96af3c9-b2ae-4568-9aad-268b2595cf5f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:06.343285 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2e6b3289-da72-47fa-b850-f51cfbf35869 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f" status: 404 len: 111 microversion: 2.1 time: 0.087498 Oct 11 19:45:06.344028 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 474/909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:06 2022] GET /compute/v2.1/servers/f96af3c9-b2ae-4568-9aad-268b2595cf5f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:06.358428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.361257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:06.409580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.410123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.415851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.416911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.426911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.428324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.455997 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] HTTP exception thrown: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Request method failure captured: Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 HTTP/1.1 Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccS1SWDlBUxDvbUQpDJXiOrpEhPRtLWnYu754SDmqlMkiEB_IaRHkxtOJ4KLbjXwjPCDA1Yb3i9HWsat4ibV3ONcOL39jcd3KsnazzrYCOd45GQ_gUp9epOjGWh6cgTRYIn-poBJICurkEldJRZF3Ikxw8Fu2bfENDBFwYb3BuX4Hk Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:06.459380 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a7b6535ad3d4f56b4483a9cde85691b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}] Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 603e5875618949c1998ea23bf0e954b5 Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:06.460697 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '9040218a-3ba8-4621-b4e7-20732e4cafd0'} Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:06.461440 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:06.463381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.464916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Returning 404 to user: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:06.464916 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5df7aa16-779b-4f45-89ac-cb3417b4f6af tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 404 len: 111 microversion: 2.1 time: 0.109063 Oct 11 19:45:06.464916 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 475/910] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:06 2022] DELETE /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:06.466944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-36acffa7-80a3-47bf-813e-ceaa587fad52 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '.version_select at 0x7f83cc80d040>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.499910 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-36acffa7-80a3-47bf-813e-ceaa587fad52 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208620753" status: 202 len: 0 microversion: 2.1 time: 0.033376 Oct 11 19:45:06.504429 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 476/911] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 19:45:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208620753 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:45:06.509550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.510867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 9040218a-3ba8-4621-b4e7-20732e4cafd0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:06.521838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.522761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.523309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.524318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.525146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.525557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.543507 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] HTTP exception thrown: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Request method failure captured: Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 HTTP/1.1 Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccS1SWDlBUxDvbUQpDJXiOrpEhPRtLWnYu754SDmqlMkiEB_IaRHkxtOJ4KLbjXwjPCDA1Yb3i9HWsat4ibV3ONcOL39jcd3KsnazzrYCOd45GQ_gUp9epOjGWh6cgTRYIn-poBJICurkEldJRZF3Ikxw8Fu2bfENDBFwYb3BuX4Hk Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:06.546247 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a7b6535ad3d4f56b4483a9cde85691b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}] Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 603e5875618949c1998ea23bf0e954b5 Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:06.548083 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '9040218a-3ba8-4621-b4e7-20732e4cafd0'} Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:06.549106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. Oct 11 19:45:06.550444 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.551851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Returning 404 to user: Instance 9040218a-3ba8-4621-b4e7-20732e4cafd0 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:06.551851 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c46b26b9-c37d-4c65-a4be-11eaf2d9c60e tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0" status: 404 len: 111 microversion: 2.1 time: 0.044766 Oct 11 19:45:06.552288 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 477/912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:06 2022] GET /compute/v2.1/servers/9040218a-3ba8-4621-b4e7-20732e4cafd0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:06.562769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.570067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:06.582818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:06.585677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.586175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.586637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.595668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.596170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.596612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.597116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:06.603814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:06.606434 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-215ec51b-f408-4dd8-a11c-9e00af4989a0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1314 microversion: 2.25 time: 0.516128 Oct 11 19:45:06.610691 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 436/913] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:06 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:06.639966 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] HTTP exception thrown: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Request method failure captured: Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e HTTP/1.1 Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccS1SWDlBUxDvbUQpDJXiOrpEhPRtLWnYu754SDmqlMkiEB_IaRHkxtOJ4KLbjXwjPCDA1Yb3i9HWsat4ibV3ONcOL39jcd3KsnazzrYCOd45GQ_gUp9epOjGWh6cgTRYIn-poBJICurkEldJRZF3Ikxw8Fu2bfENDBFwYb3BuX4Hk Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:06.648498 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a7b6535ad3d4f56b4483a9cde85691b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}] Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 603e5875618949c1998ea23bf0e954b5 Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:06.650006 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '27956e70-3a33-46ba-98c8-f9dbfe444d2e'} Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:06.650775 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:06.651894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.660340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Returning 404 to user: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:06.660340 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a2a0df9a-b1a9-4f5f-9f79-08e7b1c3fa33 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "DELETE /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 404 len: 111 microversion: 2.1 time: 0.094159 Oct 11 19:45:06.660340 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 478/914] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:06 2022] DELETE /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:06.663612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.664241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] [instance: 27956e70-3a33-46ba-98c8-f9dbfe444d2e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:06.674498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.675018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.678725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.685495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.688566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.689070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.716849 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] HTTP exception thrown: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Request method failure captured: Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e HTTP/1.1 Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccS1SWDlBUxDvbUQpDJXiOrpEhPRtLWnYu754SDmqlMkiEB_IaRHkxtOJ4KLbjXwjPCDA1Yb3i9HWsat4ibV3ONcOL39jcd3KsnazzrYCOd45GQ_gUp9epOjGWh6cgTRYIn-poBJICurkEldJRZF3Ikxw8Fu2bfENDBFwYb3BuX4Hk Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:06.718869 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a7b6535ad3d4f56b4483a9cde85691b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a7b6535ad3d4f56b4483a9cde85691b"}]}] Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 2a7b6535ad3d4f56b4483a9cde85691b Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431 Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 603e5875618949c1998ea23bf0e954b5 Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811437431-project Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:06.720341 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '27956e70-3a33-46ba-98c8-f9dbfe444d2e'} Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:06.721068 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. Oct 11 19:45:06.724514 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:06.726350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] Returning 404 to user: Instance 27956e70-3a33-46ba-98c8-f9dbfe444d2e could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:06.726350 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6e477da-14ca-43b3-9576-444295f2aa64 tempest-ServersWithSpecificFlavorTestJSON-811437431 tempest-ServersWithSpecificFlavorTestJSON-811437431-project] 10.222.0.27 "GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e" status: 404 len: 111 microversion: 2.1 time: 0.062294 Oct 11 19:45:06.726350 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 437/915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:06 2022] GET /compute/v2.1/servers/27956e70-3a33-46ba-98c8-f9dbfe444d2e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:06.815214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9816f80-a0ba-4599-b861-d8f7a8f7cbdc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.816313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b9816f80-a0ba-4599-b861-d8f7a8f7cbdc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:06.831944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9816f80-a0ba-4599-b861-d8f7a8f7cbdc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.832596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9816f80-a0ba-4599-b861-d8f7a8f7cbdc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.832911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9816f80-a0ba-4599-b861-d8f7a8f7cbdc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.833785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9816f80-a0ba-4599-b861-d8f7a8f7cbdc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.834092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9816f80-a0ba-4599-b861-d8f7a8f7cbdc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.834580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9816f80-a0ba-4599-b861-d8f7a8f7cbdc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.881724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78993ef8-a66e-4a38-927d-5e5a6568447a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:06.882365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78993ef8-a66e-4a38-927d-5e5a6568447a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:06.894220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78993ef8-a66e-4a38-927d-5e5a6568447a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.906482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78993ef8-a66e-4a38-927d-5e5a6568447a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.907092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78993ef8-a66e-4a38-927d-5e5a6568447a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:06.907865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78993ef8-a66e-4a38-927d-5e5a6568447a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:06.911456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78993ef8-a66e-4a38-927d-5e5a6568447a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:06.911938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78993ef8-a66e-4a38-927d-5e5a6568447a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:07.263962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78993ef8-a66e-4a38-927d-5e5a6568447a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:07.286588 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78993ef8-a66e-4a38-927d-5e5a6568447a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1430 microversion: 2.1 time: 0.407479 Oct 11 19:45:07.302455 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 438/916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:06 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1430 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:45:07.323503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-82ef6ef9-e557-43f9-801f-1551ecdc8bfb req-d9b3ef33-1bf8-4df8-a463-8f1ab2b7eab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bba293-5871-4552-b639-4f1e0fb137cf", "name": "network-vif-deleted", "tag": "ea21aae9-abce-4446-a07a-83c7705b4edb"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:07.347114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-82ef6ef9-e557-43f9-801f-1551ecdc8bfb req-d9b3ef33-1bf8-4df8-a463-8f1ab2b7eab4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:07.348152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-82ef6ef9-e557-43f9-801f-1551ecdc8bfb req-d9b3ef33-1bf8-4df8-a463-8f1ab2b7eab4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:07.348749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-82ef6ef9-e557-43f9-801f-1551ecdc8bfb req-d9b3ef33-1bf8-4df8-a463-8f1ab2b7eab4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:07.372139 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-82ef6ef9-e557-43f9-801f-1551ecdc8bfb req-d9b3ef33-1bf8-4df8-a463-8f1ab2b7eab4 service nova] Creating event network-vif-deleted:ea21aae9-abce-4446-a07a-83c7705b4edb for instance 42bba293-5871-4552-b639-4f1e0fb137cf on n-h2-860864-3 Oct 11 19:45:07.381185 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-82ef6ef9-e557-43f9-801f-1551ecdc8bfb req-d9b3ef33-1bf8-4df8-a463-8f1ab2b7eab4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076833 Oct 11 19:45:07.382557 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 439/917] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:07.464781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b9816f80-a0ba-4599-b861-d8f7a8f7cbdc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:07.478430 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b9816f80-a0ba-4599-b861-d8f7a8f7cbdc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1472 microversion: 2.1 time: 0.667429 Oct 11 19:45:07.497902 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 479/918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:06 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1472 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:07.639515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:07.640597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:07.664466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:07.666894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:07.673769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:07.674842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:07.675508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:07.676890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:08.034507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:08.048857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:08.050407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:08.051564 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ef8a4822-6707-4abd-9c75-3aa9c72dade1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1320 microversion: 2.25 time: 0.417882 Oct 11 19:45:08.079626 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 440/919] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:07 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1320 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:08.319692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:08.320348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:08.342923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:08.347135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:08.348909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:08.350475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:08.355685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:08.357440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:08.486282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:08.486886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:08.489204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:08.489669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lazy-loading 'fault' on Instance uuid 42bba293-5871-4552-b639-4f1e0fb137cf {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:08.514652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-41b6c873-8656-499c-9e7d-30bfa8f5ed56 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:08.516517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-41b6c873-8656-499c-9e7d-30bfa8f5ed56 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:08.523975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b6c873-8656-499c-9e7d-30bfa8f5ed56 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:08.531896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b6c873-8656-499c-9e7d-30bfa8f5ed56 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:08.532595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b6c873-8656-499c-9e7d-30bfa8f5ed56 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:08.533536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b6c873-8656-499c-9e7d-30bfa8f5ed56 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:08.534158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b6c873-8656-499c-9e7d-30bfa8f5ed56 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:08.534780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b6c873-8656-499c-9e7d-30bfa8f5ed56 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:08.866232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:08.880543 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fb9dc186-0ea7-4332-8a0e-96eadb993ae2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 200 len: 1307 microversion: 2.1 time: 0.565341 Oct 11 19:45:08.882844 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 480/920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:08 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 1307 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:09.093693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:09.094649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:09.101732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.103801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.105659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.119108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.123404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.124459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.242052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-41b6c873-8656-499c-9e7d-30bfa8f5ed56 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:09.256264 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-41b6c873-8656-499c-9e7d-30bfa8f5ed56 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1472 microversion: 2.1 time: 0.750151 Oct 11 19:45:09.266620 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 441/921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:08 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1472 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:09.425211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a67d5afc-07a9-4d2b-aada-c4be8bee8b3b tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc9fc040>, body: {"quota_set": {"ram": "5120"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:09.491791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67d5afc-07a9-4d2b-aada-c4be8bee8b3b tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.492277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67d5afc-07a9-4d2b-aada-c4be8bee8b3b tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.492923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67d5afc-07a9-4d2b-aada-c4be8bee8b3b tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.493655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67d5afc-07a9-4d2b-aada-c4be8bee8b3b tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.494230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67d5afc-07a9-4d2b-aada-c4be8bee8b3b tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.494788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67d5afc-07a9-4d2b-aada-c4be8bee8b3b tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.563430 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a67d5afc-07a9-4d2b-aada-c4be8bee8b3b tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/705244c6491b4f5cb5af4f2c6a01d57e" status: 200 len: 148 microversion: 2.57 time: 0.294576 Oct 11 19:45:09.564333 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 442/922] 10.222.0.27 () {62 vars in 1303 bytes} [Tue Oct 11 19:45:09 2022] PUT /compute/v2.1/os-quota-sets/705244c6491b4f5cb5af4f2c6a01d57e => generated 148 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:45:09.570394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4e65703e-8699-4d64-8f9b-0f14282e5bf4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '.version_select at 0x7f83cc88ea60>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:09.598442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:09.604340 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4e65703e-8699-4d64-8f9b-0f14282e5bf4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Image not found. Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4e65703e-8699-4d64-8f9b-0f14282e5bf4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/images/a9494a38-3976-406d-956a-8e019283f2bf HTTP/1.1 Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:09.606576 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: exception: Image not found. Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a9494a38-3976-406d-956a-8e019283f2bf'} Oct 11 19:45:09.607839 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a9494a38-3976-406d-956a-8e019283f2bf to delete Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:09.608590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9494a38-3976-406d-956a-8e019283f2bf could not be found. Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:09.610049 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4e65703e-8699-4d64-8f9b-0f14282e5bf4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 404 to user: Image not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:09.611219 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4e65703e-8699-4d64-8f9b-0f14282e5bf4 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "DELETE /compute/v2.1/images/a9494a38-3976-406d-956a-8e019283f2bf" status: 404 len: 62 microversion: 2.1 time: 0.042635 Oct 11 19:45:09.613456 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 443/923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:09 2022] DELETE /compute/v2.1/images/a9494a38-3976-406d-956a-8e019283f2bf => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:45:09.618724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ea92db5e-ca64-4cdf-a39c-13ea3728a07f tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Calling method '.version_select at 0x7f83cc8c5b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:09.624143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:09.633060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:09.634470 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2b31a5a9-e020-4063-afb6-29280cae6841 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1362 microversion: 2.25 time: 0.544978 Oct 11 19:45:09.637378 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 481/924] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:09 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1362 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:09.650789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:09.650789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:09.665962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.669773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.673728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.674808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.675304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.675745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.695636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea92db5e-ca64-4cdf-a39c-13ea3728a07f tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.697077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea92db5e-ca64-4cdf-a39c-13ea3728a07f tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.697618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea92db5e-ca64-4cdf-a39c-13ea3728a07f tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.698623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea92db5e-ca64-4cdf-a39c-13ea3728a07f tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.699186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea92db5e-ca64-4cdf-a39c-13ea3728a07f tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.699709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea92db5e-ca64-4cdf-a39c-13ea3728a07f tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.725476 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ea92db5e-ca64-4cdf-a39c-13ea3728a07f tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/705244c6491b4f5cb5af4f2c6a01d57e/detail" status: 200 len: 463 microversion: 2.57 time: 0.111048 Oct 11 19:45:09.727245 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 444/925] 10.222.0.27 () {60 vars in 1304 bytes} [Tue Oct 11 19:45:09 2022] GET /compute/v2.1/os-quota-sets/705244c6491b4f5cb5af4f2c6a01d57e/detail => generated 463 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:45:09.731136 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 HTTP/1.1 Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:09.733448 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:45:09.735607 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '69bc7749-0f31-48b7-bf11-8fdc03fbb734'} Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:09.736402 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:45:09.737766 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.739336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 404 to user: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:09.745974 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-906a2496-9541-42b7-843c-1027e9ad1745 tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 404 len: 111 microversion: 2.1 time: 0.103874 Oct 11 19:45:09.746975 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 482/926] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:09 2022] DELETE /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:09.779197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:09.782555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] [instance: 69bc7749-0f31-48b7-bf11-8fdc03fbb734] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:09.804471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.805560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.807136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.808297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.810215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.811548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.851392 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] HTTP exception thrown: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Request method failure captured: Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 HTTP/1.1 Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcddlu6JIDBaOJLtyQ_EF5r5moNaFGMfR9AAtMlBu6-FVgcBlGsVk8USYDG1LPZAvyJdNXiwTQj2H_oAW9JAt17Ilkb7Xd_rRBnJZYRswWZM6wfg-NYZvO9yzPV31YSXLgNlz0lPGWQGam8pmX680gmEuOL6CAZMVY41ez-VFaMzXds Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:09.853348 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_21a886c8ddf44b77974321e34b2fad8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/21a886c8ddf44b77974321e34b2fad8a"}]}] Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 21a886c8ddf44b77974321e34b2fad8a Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371 Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 23b671bc2d4849be938178f53135af2d Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1918293371-project Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:45:09.854886 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '69bc7749-0f31-48b7-bf11-8fdc03fbb734'} Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:09.855629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. Oct 11 19:45:09.856748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.860626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] Returning 404 to user: Instance 69bc7749-0f31-48b7-bf11-8fdc03fbb734 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:09.860626 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bd659ab5-b0d2-497f-a8c9-6304b35da58f tempest-ImagesOneServerNegativeTestJSON-1918293371 tempest-ImagesOneServerNegativeTestJSON-1918293371-project] 10.222.0.27 "GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734" status: 404 len: 111 microversion: 2.1 time: 0.106602 Oct 11 19:45:09.862155 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 445/927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:09 2022] GET /compute/v2.1/servers/69bc7749-0f31-48b7-bf11-8fdc03fbb734 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:09.907337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:09.908639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 42bba293-5871-4552-b639-4f1e0fb137cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:09.920082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.924185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.924746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.925764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.929820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:09.930284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:09.971084 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] HTTP exception thrown: Instance 42bba293-5871-4552-b639-4f1e0fb137cf could not be found. Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Request method failure captured: Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf HTTP/1.1 Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccs9sbnuYTCEvs1E8xVkFpmpiKr31XvMnCjLikMyRDwddMOCJ5twa9agvxtxQLsTQRlIfwoM-H4LBkB4LZiYWe1PyGhE1Qc7sNPmCfaJ_2LctQlMWK5k8cSerwgLcsGMQk7PKl7CkU-UnOkIxt3qj2VLbs5fhYxxrZvl2Yv038Rotw Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:09.972822 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8be7ff18ac24462858896eaf1e29fbe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}] Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d473bc95d6ea47978e08f9ceaebf2343 Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 42bba293-5871-4552-b639-4f1e0fb137cf could not be found. Oct 11 19:45:09.974105 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '42bba293-5871-4552-b639-4f1e0fb137cf'} Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bba293-5871-4552-b639-4f1e0fb137cf could not be found. Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:09.974872 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bba293-5871-4552-b639-4f1e0fb137cf could not be found. Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bba293-5871-4552-b639-4f1e0fb137cf could not be found. Oct 11 19:45:09.976319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:09.977557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Returning 404 to user: Instance 42bba293-5871-4552-b639-4f1e0fb137cf could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:09.977557 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d3459510-b600-41e7-a7f3-e66b7fb32976 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf" status: 404 len: 111 microversion: 2.1 time: 0.070987 Oct 11 19:45:09.978862 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 483/928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:09 2022] GET /compute/v2.1/servers/42bba293-5871-4552-b639-4f1e0fb137cf => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:09.985442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7542df4-4314-40c2-84dd-76cbd82ec368 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:09.986535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7542df4-4314-40c2-84dd-76cbd82ec368 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:09.998054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7542df4-4314-40c2-84dd-76cbd82ec368 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:09.999912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7542df4-4314-40c2-84dd-76cbd82ec368 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.002011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7542df4-4314-40c2-84dd-76cbd82ec368 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.004846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7542df4-4314-40c2-84dd-76cbd82ec368 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.005230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7542df4-4314-40c2-84dd-76cbd82ec368 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.005676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7542df4-4314-40c2-84dd-76cbd82ec368 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.030974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc65b4c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:10.071577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7542df4-4314-40c2-84dd-76cbd82ec368 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:45:10.153909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:10.178883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.179578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.180338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.181096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.182893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.183310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.238703 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7542df4-4314-40c2-84dd-76cbd82ec368 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 204 len: 0 microversion: 2.1 time: 0.258238 Oct 11 19:45:10.242988 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 446/929] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:09 2022] DELETE /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:10.257840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7137daca-d64b-41df-bf19-61510d9ffd36 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:10.259401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7137daca-d64b-41df-bf19-61510d9ffd36 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:10.265686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.266832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.267554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.268518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.269313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.269953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.272029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7137daca-d64b-41df-bf19-61510d9ffd36 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.272529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7137daca-d64b-41df-bf19-61510d9ffd36 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.275437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7137daca-d64b-41df-bf19-61510d9ffd36 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.276188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7137daca-d64b-41df-bf19-61510d9ffd36 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.276657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7137daca-d64b-41df-bf19-61510d9ffd36 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.277084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7137daca-d64b-41df-bf19-61510d9ffd36 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.355864 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e8412422-09b8-4718-bdaf-824dbc6be817 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/705244c6491b4f5cb5af4f2c6a01d57e?user_id=71de4535fb094a10ac8556203fbe4e4b" status: 200 len: 148 microversion: 2.57 time: 0.330243 Oct 11 19:45:10.356817 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 484/930] 10.222.0.27 () {62 vars in 1384 bytes} [Tue Oct 11 19:45:10 2022] PUT /compute/v2.1/os-quota-sets/705244c6491b4f5cb5af4f2c6a01d57e?user_id=71de4535fb094a10ac8556203fbe4e4b => generated 148 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:45:10.361715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a98fd660-09f3-43b9-9b2b-b62710d0260a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:10.362542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a98fd660-09f3-43b9-9b2b-b62710d0260a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:10.368801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a98fd660-09f3-43b9-9b2b-b62710d0260a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.369524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a98fd660-09f3-43b9-9b2b-b62710d0260a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.370126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a98fd660-09f3-43b9-9b2b-b62710d0260a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.371103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a98fd660-09f3-43b9-9b2b-b62710d0260a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.371725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a98fd660-09f3-43b9-9b2b-b62710d0260a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.372394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a98fd660-09f3-43b9-9b2b-b62710d0260a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.651238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7137daca-d64b-41df-bf19-61510d9ffd36 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:10.659617 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7137daca-d64b-41df-bf19-61510d9ffd36 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1470 microversion: 2.1 time: 0.413130 Oct 11 19:45:10.660494 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 447/931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:10 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1470 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:10.678408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ca28ea02-e475-4023-ae1b-550b6cae69c8 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] Calling method '.version_select at 0x7f83cc84c0d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:10.734372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a98fd660-09f3-43b9-9b2b-b62710d0260a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:10.752404 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a98fd660-09f3-43b9-9b2b-b62710d0260a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1472 microversion: 2.1 time: 0.392655 Oct 11 19:45:10.776964 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 485/932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:10 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:10.789418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:10.803244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:10.816910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.817419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.817867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.818603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:10.826300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:10.827030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:10.836315 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ca28ea02-e475-4023-ae1b-550b6cae69c8 tempest-QuotasAdminTestV257-1883974371 tempest-QuotasAdminTestV257-1883974371-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/705244c6491b4f5cb5af4f2c6a01d57e?user_id=71de4535fb094a10ac8556203fbe4e4b" status: 200 len: 190 microversion: 2.57 time: 0.172571 Oct 11 19:45:10.837743 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 448/933] 10.222.0.27 () {60 vars in 1364 bytes} [Tue Oct 11 19:45:10 2022] GET /compute/v2.1/os-quota-sets/705244c6491b4f5cb5af4f2c6a01d57e?user_id=71de4535fb094a10ac8556203fbe4e4b => generated 190 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:45:11.107525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:11.116350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:11.117814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:11.118963 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-54840399-229b-4af4-97b9-d85774790c55 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1362 microversion: 2.25 time: 0.340615 Oct 11 19:45:11.135066 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 486/934] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:10 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:11.689397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9bba2af5-11a6-4216-bd72-98dc4fbdf788 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:11.690018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9bba2af5-11a6-4216-bd72-98dc4fbdf788 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:11.710363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bba2af5-11a6-4216-bd72-98dc4fbdf788 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:11.713330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bba2af5-11a6-4216-bd72-98dc4fbdf788 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:11.732664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bba2af5-11a6-4216-bd72-98dc4fbdf788 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:11.735131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bba2af5-11a6-4216-bd72-98dc4fbdf788 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:11.736847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bba2af5-11a6-4216-bd72-98dc4fbdf788 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:11.737496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bba2af5-11a6-4216-bd72-98dc4fbdf788 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:11.778716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f883bd5-0885-49e1-b55e-eac1024bda3b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:11.779835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f883bd5-0885-49e1-b55e-eac1024bda3b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:11.801391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f883bd5-0885-49e1-b55e-eac1024bda3b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:11.802536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f883bd5-0885-49e1-b55e-eac1024bda3b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:11.805495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f883bd5-0885-49e1-b55e-eac1024bda3b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:11.811583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f883bd5-0885-49e1-b55e-eac1024bda3b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:11.813766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f883bd5-0885-49e1-b55e-eac1024bda3b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:11.817874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f883bd5-0885-49e1-b55e-eac1024bda3b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:12.189409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9bba2af5-11a6-4216-bd72-98dc4fbdf788 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:12.207258 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9bba2af5-11a6-4216-bd72-98dc4fbdf788 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1470 microversion: 2.1 time: 0.517268 Oct 11 19:45:12.208220 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 449/935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:11 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1470 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:12.223332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:12.226402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:12.237708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2f883bd5-0885-49e1-b55e-eac1024bda3b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:12.242518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:12.246936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:12.247134 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f883bd5-0885-49e1-b55e-eac1024bda3b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1472 microversion: 2.1 time: 0.473013 Oct 11 19:45:12.247393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:12.247969 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 487/936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:11 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1472 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:12.248140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:12.248597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:12.249018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:12.663180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-46fc259b-bbb2-40a2-a168-7549103eec71 req-6ea3c3e6-856a-4f91-8fd9-f120731611ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e6fb34e-c435-436b-905d-3898c72acc34", "tag": "808efdac-6278-4889-b777-265334565eda"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:12.665286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:12.677668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:12.679429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:12.680798 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2ad19eab-d311-42e7-a460-3b26b83411fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1362 microversion: 2.25 time: 0.471403 Oct 11 19:45:12.681409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-46fc259b-bbb2-40a2-a168-7549103eec71 req-6ea3c3e6-856a-4f91-8fd9-f120731611ec service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:12.681892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-46fc259b-bbb2-40a2-a168-7549103eec71 req-6ea3c3e6-856a-4f91-8fd9-f120731611ec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:12.684366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-46fc259b-bbb2-40a2-a168-7549103eec71 req-6ea3c3e6-856a-4f91-8fd9-f120731611ec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:12.692751 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 450/937] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:12 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:12.715451 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-46fc259b-bbb2-40a2-a168-7549103eec71 req-6ea3c3e6-856a-4f91-8fd9-f120731611ec service nova] Creating event network-changed:808efdac-6278-4889-b777-265334565eda for instance 2e6fb34e-c435-436b-905d-3898c72acc34 on n-h2-860864-3 Oct 11 19:45:12.731263 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-46fc259b-bbb2-40a2-a168-7549103eec71 req-6ea3c3e6-856a-4f91-8fd9-f120731611ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070322 Oct 11 19:45:12.734700 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 488/938] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:45:13.240331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a13ad70a-945f-4dfe-9dd5-92cb5b43eca3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:13.242685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a13ad70a-945f-4dfe-9dd5-92cb5b43eca3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:13.277144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-245d1011-b91a-4c09-840e-c9ff8894758b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:13.278595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-245d1011-b91a-4c09-840e-c9ff8894758b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:13.291593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a13ad70a-945f-4dfe-9dd5-92cb5b43eca3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:13.296589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a13ad70a-945f-4dfe-9dd5-92cb5b43eca3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:13.304027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a13ad70a-945f-4dfe-9dd5-92cb5b43eca3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:13.305884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a13ad70a-945f-4dfe-9dd5-92cb5b43eca3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:13.307541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-245d1011-b91a-4c09-840e-c9ff8894758b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:13.311238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a13ad70a-945f-4dfe-9dd5-92cb5b43eca3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:13.314598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a13ad70a-945f-4dfe-9dd5-92cb5b43eca3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:13.318060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-245d1011-b91a-4c09-840e-c9ff8894758b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:13.323378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-245d1011-b91a-4c09-840e-c9ff8894758b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:13.325026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-245d1011-b91a-4c09-840e-c9ff8894758b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:13.326603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-245d1011-b91a-4c09-840e-c9ff8894758b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:13.327270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-245d1011-b91a-4c09-840e-c9ff8894758b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:13.659673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a13ad70a-945f-4dfe-9dd5-92cb5b43eca3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:13.661993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-245d1011-b91a-4c09-840e-c9ff8894758b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:13.689188 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-245d1011-b91a-4c09-840e-c9ff8894758b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1472 microversion: 2.1 time: 0.419461 Oct 11 19:45:13.690621 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 489/939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:13 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:45:13.691626 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a13ad70a-945f-4dfe-9dd5-92cb5b43eca3 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1470 microversion: 2.1 time: 0.462135 Oct 11 19:45:13.694228 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 451/940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:13 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1470 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:45:13.713813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:13.714698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:13.743075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:13.743921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:13.745335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:13.746364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:13.748065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:13.748774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:14.016865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:14.030115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:14.033754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:14.035527 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6360b08b-af22-4ae1-addc-4c21e709604f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1362 microversion: 2.25 time: 0.327625 Oct 11 19:45:14.051969 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 452/941] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:13 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:45:14.251386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-00c2b82a-6211-4ea6-bf18-9e3fd3270c2b tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] Calling method '.version_select at 0x7f83cc579700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:14.379389 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-00c2b82a-6211-4ea6-bf18-9e3fd3270c2b tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.686466 Oct 11 19:45:14.379957 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 490/942] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 11 19:45:13 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:45:14.394552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89ddf256-738b-4234-9979-efe83ca4e30c tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] Action: 'create', calling method: .version_select at 0x7f83cca18af0>, body: {"pool": "non_exist_pool"} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:14.557076 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-89ddf256-738b-4234-9979-efe83ca4e30c tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] HTTP exception thrown: Floating IP pool not found. Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89ddf256-738b-4234-9979-efe83ca4e30c tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] Request method failure captured: Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 26 Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfJSdA-py0WxQ-4-Rsx7o6WRsZjVCLiCvIgEGmeWyn3ZiKDPKlbjCfkdvtf7SAxPPSImR7OZ1SXvhssz_Lg4UOLDvg4S43q-VmYzReWwelRUUBpmAv_48OcStd5aQ4KEefAGfp4xYxxtvjicGJdwV6mS71dwwXp4bEhSDzKpzQU5fI Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f94f709c623c43ad8c07a68d5aa12f3c Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2134883773 Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:14.560724 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f94f709c623c43ad8c07a68d5aa12f3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f94f709c623c43ad8c07a68d5aa12f3c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f94f709c623c43ad8c07a68d5aa12f3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f94f709c623c43ad8c07a68d5aa12f3c"}]}] Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2134883773 Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f94f709c623c43ad8c07a68d5aa12f3c Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2134883773 Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-FloatingIPsNegativeTestJSON-2134883773-project Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d6b0218233404d48b807ea9b04f354c1 Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2134883773-project Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: {"pool": "non_exist_pool"} Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: exception: Floating IP pool not found. Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 11 19:45:14.562333 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:14.563535 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89ddf256-738b-4234-9979-efe83ca4e30c tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] Returning 404 to user: Floating IP pool not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:14.564728 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-89ddf256-738b-4234-9979-efe83ca4e30c tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.173082 Oct 11 19:45:14.565654 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 453/943] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:45:14 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:45:14.574302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3687d82d-ea0c-48a3-914a-d833404fb440 tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] Calling method '.version_select at 0x7f83cc579b80>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:14.654654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-3687d82d-ea0c-48a3-914a-d833404fb440 tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f50bbdab-5c4a-4421-8699-77df483a53e7 could not be found", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:45:14.655404 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-3687d82d-ea0c-48a3-914a-d833404fb440 tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] HTTP exception thrown: Floating IP not found for ID f50bbdab-5c4a-4421-8699-77df483a53e7 Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3687d82d-ea0c-48a3-914a-d833404fb440 tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] Request method failure captured: Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-floating-ips/f50bbdab-5c4a-4421-8699-77df483a53e7 HTTP/1.1 Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfJSdA-py0WxQ-4-Rsx7o6WRsZjVCLiCvIgEGmeWyn3ZiKDPKlbjCfkdvtf7SAxPPSImR7OZ1SXvhssz_Lg4UOLDvg4S43q-VmYzReWwelRUUBpmAv_48OcStd5aQ4KEefAGfp4xYxxtvjicGJdwV6mS71dwwXp4bEhSDzKpzQU5fI Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f94f709c623c43ad8c07a68d5aa12f3c Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2134883773 Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:14.674098 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f94f709c623c43ad8c07a68d5aa12f3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f94f709c623c43ad8c07a68d5aa12f3c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f94f709c623c43ad8c07a68d5aa12f3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f94f709c623c43ad8c07a68d5aa12f3c"}]}] Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2134883773 Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f94f709c623c43ad8c07a68d5aa12f3c Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2134883773 Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FloatingIPsNegativeTestJSON-2134883773-project Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d6b0218233404d48b807ea9b04f354c1 Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2134883773-project Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: exception: Floating IP not found for ID f50bbdab-5c4a-4421-8699-77df483a53e7 Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f50bbdab-5c4a-4421-8699-77df483a53e7'} Oct 11 19:45:14.675706 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:45:14.676616 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f50bbdab-5c4a-4421-8699-77df483a53e7 could not be found Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8d839a5-f89e-4f9e-941d-d4362a03608d'] Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f50bbdab-5c4a-4421-8699-77df483a53e7. Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:14.678025 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f50bbdab-5c4a-4421-8699-77df483a53e7 Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:14.681169 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:14.682590 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f50bbdab-5c4a-4421-8699-77df483a53e7 Oct 11 19:45:14.682590 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:14.685206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3687d82d-ea0c-48a3-914a-d833404fb440 tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] Returning 404 to user: Floating IP not found for ID f50bbdab-5c4a-4421-8699-77df483a53e7 {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:14.689103 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3687d82d-ea0c-48a3-914a-d833404fb440 tempest-FloatingIPsNegativeTestJSON-2134883773 tempest-FloatingIPsNegativeTestJSON-2134883773-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/f50bbdab-5c4a-4421-8699-77df483a53e7" status: 404 len: 111 microversion: 2.1 time: 0.117296 Oct 11 19:45:14.691472 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 491/944] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:45:14 2022] DELETE /compute/v2.1/os-floating-ips/f50bbdab-5c4a-4421-8699-77df483a53e7 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:14.716756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c353a6d7-a658-4ed6-bd6b-186f7f8b5338 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:14.723408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eeccd639-0df4-4bb9-83f0-9e0f8eaee88f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:14.724019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eeccd639-0df4-4bb9-83f0-9e0f8eaee88f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:14.724445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c353a6d7-a658-4ed6-bd6b-186f7f8b5338 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:14.739657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c353a6d7-a658-4ed6-bd6b-186f7f8b5338 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:14.747703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeccd639-0df4-4bb9-83f0-9e0f8eaee88f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:14.755306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeccd639-0df4-4bb9-83f0-9e0f8eaee88f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:14.755683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c353a6d7-a658-4ed6-bd6b-186f7f8b5338 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:14.756312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c353a6d7-a658-4ed6-bd6b-186f7f8b5338 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:14.756908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeccd639-0df4-4bb9-83f0-9e0f8eaee88f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:14.757817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c353a6d7-a658-4ed6-bd6b-186f7f8b5338 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:14.758725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeccd639-0df4-4bb9-83f0-9e0f8eaee88f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:14.759348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c353a6d7-a658-4ed6-bd6b-186f7f8b5338 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:14.759977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeccd639-0df4-4bb9-83f0-9e0f8eaee88f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:14.760573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c353a6d7-a658-4ed6-bd6b-186f7f8b5338 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:14.761168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeccd639-0df4-4bb9-83f0-9e0f8eaee88f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:15.016933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eeccd639-0df4-4bb9-83f0-9e0f8eaee88f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:15.033523 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eeccd639-0df4-4bb9-83f0-9e0f8eaee88f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 200 len: 1428 microversion: 2.1 time: 0.314791 Oct 11 19:45:15.037837 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 492/945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:14 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 1428 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:15.055691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f7693121-0105-4d1e-9386-3db840d3f8a3 req-3d4f13aa-ec47-4d1d-9f9a-731d8063543f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff847e4e-cee6-43c2-add2-c4ea051c71fe", "name": "network-vif-deleted", "tag": "4e1d87b7-e947-4cc8-8086-f1e31ac19bba"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:15.080565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f7693121-0105-4d1e-9386-3db840d3f8a3 req-3d4f13aa-ec47-4d1d-9f9a-731d8063543f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:15.081783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f7693121-0105-4d1e-9386-3db840d3f8a3 req-3d4f13aa-ec47-4d1d-9f9a-731d8063543f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:15.082386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f7693121-0105-4d1e-9386-3db840d3f8a3 req-3d4f13aa-ec47-4d1d-9f9a-731d8063543f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:15.108568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:15.115823 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f7693121-0105-4d1e-9386-3db840d3f8a3 req-3d4f13aa-ec47-4d1d-9f9a-731d8063543f service nova] Creating event network-vif-deleted:4e1d87b7-e947-4cc8-8086-f1e31ac19bba for instance ff847e4e-cee6-43c2-add2-c4ea051c71fe on n-h1-860864-3 Oct 11 19:45:15.129601 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f7693121-0105-4d1e-9386-3db840d3f8a3 req-3d4f13aa-ec47-4d1d-9f9a-731d8063543f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090015 Oct 11 19:45:15.130709 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 493/946] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:15.142693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:15.146052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:15.169387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:15.174609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:15.175456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:15.176365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:15.176990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:15.177586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:15.505958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c353a6d7-a658-4ed6-bd6b-186f7f8b5338 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:15.517383 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c353a6d7-a658-4ed6-bd6b-186f7f8b5338 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.802342 Oct 11 19:45:15.528481 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 454/947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:14 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:15.565350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:15.573956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:15.585070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:15.588616 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-244cd977-a015-46ac-b33b-da5d47c933f0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1362 microversion: 2.25 time: 0.456362 Oct 11 19:45:15.599221 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 494/948] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:15 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:16.084040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:16.086811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: ff847e4e-cee6-43c2-add2-c4ea051c71fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:16.101011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:16.101520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:16.101964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:16.105710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:16.111707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:16.112716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:16.147313 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] HTTP exception thrown: Instance ff847e4e-cee6-43c2-add2-c4ea051c71fe could not be found. Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Request method failure captured: Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe HTTP/1.1 Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccs9sbnuYTCEvs1E8xVkFpmpiKr31XvMnCjLikMyRDwddMOCJ5twa9agvxtxQLsTQRlIfwoM-H4LBkB4LZiYWe1PyGhE1Qc7sNPmCfaJ_2LctQlMWK5k8cSerwgLcsGMQk7PKl7CkU-UnOkIxt3qj2VLbs5fhYxxrZvl2Yv038Rotw Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:16.149238 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8be7ff18ac24462858896eaf1e29fbe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}] Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d473bc95d6ea47978e08f9ceaebf2343 Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance ff847e4e-cee6-43c2-add2-c4ea051c71fe could not be found. Oct 11 19:45:16.150471 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ff847e4e-cee6-43c2-add2-c4ea051c71fe'} Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff847e4e-cee6-43c2-add2-c4ea051c71fe could not be found. Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:16.151324 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff847e4e-cee6-43c2-add2-c4ea051c71fe could not be found. Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff847e4e-cee6-43c2-add2-c4ea051c71fe could not be found. Oct 11 19:45:16.152692 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:16.155279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Returning 404 to user: Instance ff847e4e-cee6-43c2-add2-c4ea051c71fe could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:16.157004 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a72c1722-0353-4380-979e-4f623090b31e tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe" status: 404 len: 111 microversion: 2.1 time: 0.089961 Oct 11 19:45:16.167107 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 455/949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:16 2022] GET /compute/v2.1/servers/ff847e4e-cee6-43c2-add2-c4ea051c71fe => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:16.171218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b2419127-d969-4ac4-b0f6-1210f54c71cf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:16.171841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b2419127-d969-4ac4-b0f6-1210f54c71cf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:16.191795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2419127-d969-4ac4-b0f6-1210f54c71cf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:16.192284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2419127-d969-4ac4-b0f6-1210f54c71cf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:16.192726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2419127-d969-4ac4-b0f6-1210f54c71cf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:16.193701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2419127-d969-4ac4-b0f6-1210f54c71cf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:16.194359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2419127-d969-4ac4-b0f6-1210f54c71cf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:16.195105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2419127-d969-4ac4-b0f6-1210f54c71cf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:16.248559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b2419127-d969-4ac4-b0f6-1210f54c71cf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:45:16.445517 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b2419127-d969-4ac4-b0f6-1210f54c71cf tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 204 len: 0 microversion: 2.1 time: 0.277792 Oct 11 19:45:16.447220 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 495/950] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:16 2022] DELETE /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:16.459427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-de07f08a-70d5-449e-9d28-737d505cd2fe tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:16.460523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-de07f08a-70d5-449e-9d28-737d505cd2fe tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:16.485415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de07f08a-70d5-449e-9d28-737d505cd2fe tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:16.496739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de07f08a-70d5-449e-9d28-737d505cd2fe tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:16.497349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de07f08a-70d5-449e-9d28-737d505cd2fe tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:16.499450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de07f08a-70d5-449e-9d28-737d505cd2fe tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:16.500371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de07f08a-70d5-449e-9d28-737d505cd2fe tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:16.500809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de07f08a-70d5-449e-9d28-737d505cd2fe tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:16.545830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-90fbdc6c-f91e-4a49-8b4f-882df740c96d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:16.547512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-90fbdc6c-f91e-4a49-8b4f-882df740c96d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:16.562995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90fbdc6c-f91e-4a49-8b4f-882df740c96d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:16.563596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90fbdc6c-f91e-4a49-8b4f-882df740c96d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:16.569128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90fbdc6c-f91e-4a49-8b4f-882df740c96d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:16.571876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90fbdc6c-f91e-4a49-8b4f-882df740c96d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:16.573818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90fbdc6c-f91e-4a49-8b4f-882df740c96d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:16.574284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90fbdc6c-f91e-4a49-8b4f-882df740c96d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:17.064325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-de07f08a-70d5-449e-9d28-737d505cd2fe tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:17.085095 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-de07f08a-70d5-449e-9d28-737d505cd2fe tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1473 microversion: 2.1 time: 0.633258 Oct 11 19:45:17.085922 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 456/951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:16 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1473 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:17.105051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:17.107643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:17.127912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:17.134724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:17.153435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:17.154462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:17.157768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:17.158224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:17.804517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-90fbdc6c-f91e-4a49-8b4f-882df740c96d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:17.819916 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-90fbdc6c-f91e-4a49-8b4f-882df740c96d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 1.278099 Oct 11 19:45:17.834553 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 496/952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:16 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:18.115029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f76aff42-bda4-4a2b-a735-8a3defe43bd2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:18.115650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f76aff42-bda4-4a2b-a735-8a3defe43bd2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:18.126701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76aff42-bda4-4a2b-a735-8a3defe43bd2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:18.127525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76aff42-bda4-4a2b-a735-8a3defe43bd2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:18.129618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76aff42-bda4-4a2b-a735-8a3defe43bd2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:18.130617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76aff42-bda4-4a2b-a735-8a3defe43bd2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:18.131311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76aff42-bda4-4a2b-a735-8a3defe43bd2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:18.132189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76aff42-bda4-4a2b-a735-8a3defe43bd2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:18.264015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:18.275155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:18.288497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:18.290144 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-defbbd09-b81e-4d92-a52a-e8348387bfa5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1362 microversion: 2.25 time: 1.202176 Oct 11 19:45:18.290889 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 457/953] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:17 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1362 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:18.630203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f76aff42-bda4-4a2b-a735-8a3defe43bd2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:18.648062 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f76aff42-bda4-4a2b-a735-8a3defe43bd2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1473 microversion: 2.1 time: 0.539007 Oct 11 19:45:18.652611 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 497/954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:18 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1473 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:18.857374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eff9b4df-66d8-44d7-b1e8-d75a9bfc1a89 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:18.858247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eff9b4df-66d8-44d7-b1e8-d75a9bfc1a89 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:18.867855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9b4df-66d8-44d7-b1e8-d75a9bfc1a89 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:18.875742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9b4df-66d8-44d7-b1e8-d75a9bfc1a89 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:18.877109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9b4df-66d8-44d7-b1e8-d75a9bfc1a89 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:18.879683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9b4df-66d8-44d7-b1e8-d75a9bfc1a89 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:18.881700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9b4df-66d8-44d7-b1e8-d75a9bfc1a89 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:18.882405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9b4df-66d8-44d7-b1e8-d75a9bfc1a89 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:18.939335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-07302c8c-f573-49a9-8a60-31182c58bc83 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Calling method '.version_select at 0x7f83cca180d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:19.039131 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-07302c8c-f573-49a9-8a60-31182c58bc83 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf" status: 200 len: 371 microversion: 2.1 time: 0.373926 Oct 11 19:45:19.049428 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 458/955] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 11 19:45:18 2022] GET /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf => generated 371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:45:19.056462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-237de40d-7d6d-4f0c-be5b-ef2d6af0ee8b tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Action: 'update', calling method: .version_select at 0x7f83ccf58310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:19.109394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eff9b4df-66d8-44d7-b1e8-d75a9bfc1a89 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:19.120550 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eff9b4df-66d8-44d7-b1e8-d75a9bfc1a89 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.273563 Oct 11 19:45:19.133801 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 498/956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:18 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:19.222419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-237de40d-7d6d-4f0c-be5b-ef2d6af0ee8b tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:19.224141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-237de40d-7d6d-4f0c-be5b-ef2d6af0ee8b tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:19.226872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-237de40d-7d6d-4f0c-be5b-ef2d6af0ee8b tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:19.229914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-237de40d-7d6d-4f0c-be5b-ef2d6af0ee8b tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:19.230714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-237de40d-7d6d-4f0c-be5b-ef2d6af0ee8b tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:19.231727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-237de40d-7d6d-4f0c-be5b-ef2d6af0ee8b tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:19.249157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-08fa850d-7d50-4344-8fde-00122fabedbb req-e07602e6-da21-47f8-a5d1-3bf212aec803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36452fd4-4ace-49b4-89b3-4872701681d6", "name": "network-vif-deleted", "tag": "b8c5011d-0676-464c-bd00-7980511354e5"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:19.269729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:19.276002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-08fa850d-7d50-4344-8fde-00122fabedbb req-e07602e6-da21-47f8-a5d1-3bf212aec803 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:19.277471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-08fa850d-7d50-4344-8fde-00122fabedbb req-e07602e6-da21-47f8-a5d1-3bf212aec803 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:19.278138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-08fa850d-7d50-4344-8fde-00122fabedbb req-e07602e6-da21-47f8-a5d1-3bf212aec803 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:19.331595 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-08fa850d-7d50-4344-8fde-00122fabedbb req-e07602e6-da21-47f8-a5d1-3bf212aec803 service nova] Creating event network-vif-deleted:b8c5011d-0676-464c-bd00-7980511354e5 for instance 36452fd4-4ace-49b4-89b3-4872701681d6 on n-h1-860864-3 Oct 11 19:45:19.341775 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-237de40d-7d6d-4f0c-be5b-ef2d6af0ee8b tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf" status: 200 len: 328 microversion: 2.1 time: 0.290442 Oct 11 19:45:19.346448 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-08fa850d-7d50-4344-8fde-00122fabedbb req-e07602e6-da21-47f8-a5d1-3bf212aec803 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099789 Oct 11 19:45:19.358835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 459/957] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 19:45:19 2022] PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf => generated 328 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:19.359708 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 499/958] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:19.359875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:19.359875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:19.359875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:19.360088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:19.360408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:19.361369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:19.362033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:19.362718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:19.722786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-77773866", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:19.840482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:45:20.127307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:20.137140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:20.138688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:20.139754 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ac91443-7efc-4bdf-8cc3-3e1836880512 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1362 microversion: 2.25 time: 0.791985 Oct 11 19:45:20.158572 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 460/959] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:19 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1362 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:20.181149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:20.184562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:20.186890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=92,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:20.205143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:20.205859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:20.206486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:20.211341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:20.212220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:20.213533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:20.288419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=5 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:20.304665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:20.305164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:20.305604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:20.306065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lazy-loading 'fault' on Instance uuid 36452fd4-4ace-49b4-89b3-4872701681d6 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:20.349212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=14 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:20.446087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:20.456301 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-95ff8699-ab2f-4964-a297-5ce0fd0295b2 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 200 len: 1307 microversion: 2.1 time: 0.287275 Oct 11 19:45:20.480505 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 461/960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:20 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 1307 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:20.487796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f71ab6e8-29f4-4878-b4d7-91d4f7926b8f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:20.489308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f71ab6e8-29f4-4878-b4d7-91d4f7926b8f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:20.495730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f71ab6e8-29f4-4878-b4d7-91d4f7926b8f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:20.496536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f71ab6e8-29f4-4878-b4d7-91d4f7926b8f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:20.497301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f71ab6e8-29f4-4878-b4d7-91d4f7926b8f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:20.498198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f71ab6e8-29f4-4878-b4d7-91d4f7926b8f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:20.499122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f71ab6e8-29f4-4878-b4d7-91d4f7926b8f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:20.501711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f71ab6e8-29f4-4878-b4d7-91d4f7926b8f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:20.678312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:45:20.680266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:45:20.685590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:45:20.689717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:45:20.694395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:45:20.714370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:20.715054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:20.715996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:20.717100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:20.718943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:20.720648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:20.760840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Getting quotas for project 3ea087b06b994a18a43ed33e6b024bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:20.775083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Getting quotas for user a9dc30e1ad854601b6fafa99a691cb70 and project 3ea087b06b994a18a43ed33e6b024bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:20.801031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.utils [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] cores quota exceeded for 3ea087b06b994a18a43ed33e6b024bcf, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126955) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 19:45:20.802255 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Request method failure captured: Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 143 Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfNrMjCEVW0nDNil0MRoM3hBqHjpKUYNLCrBgab2ZzbD4iBHK16XJpZh6VHGzgPItZEvsW4FsOnsUYJcUZrp8Mjvd9iKPxvd-3UGfAJQALL_5cJVqOOZgLDaQdRuwF1L7arLJBoKjssG5ukLhvY8oeKanaigJTw_GfgcpmQajlgTKY Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3ea087b06b994a18a43ed33e6b024bcf Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:20.807381 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3ea087b06b994a18a43ed33e6b024bcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3ea087b06b994a18a43ed33e6b024bcf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ea087b06b994a18a43ed33e6b024bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ea087b06b994a18a43ed33e6b024bcf"}]}] Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3ea087b06b994a18a43ed33e6b024bcf Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-QuotasAdminNegativeTest-400423616-project Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a9dc30e1ad854601b6fafa99a691cb70 Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-QuotasAdminNegativeTest-400423616-project Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-77773866", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} Oct 11 19:45:20.809018 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-77773866', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452'}}} Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 19:45:20.809950 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:20.811293 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:20.815141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:20.817591 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:20.817591 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:20.817591 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:20.817591 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:20.817591 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 19:45:20.817591 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:20.821779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:20.823384 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f42eff37-7136-42f6-82d0-79b6253e0bee tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.218926 Oct 11 19:45:20.824157 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 500/961] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:45:19 2022] POST /compute/v2.1/servers => generated 111 bytes in 1223 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:20.845023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f71ab6e8-29f4-4878-b4d7-91d4f7926b8f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:20.856221 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f71ab6e8-29f4-4878-b4d7-91d4f7926b8f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.374201 Oct 11 19:45:20.856881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51407e0f-bd7d-4e0e-b665-99a2e69c37a3 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc4a0b80>, body: {"quota_set": {"cores": 20}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:20.857581 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 462/962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:20 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:20.949467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51407e0f-bd7d-4e0e-b665-99a2e69c37a3 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:20.950257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51407e0f-bd7d-4e0e-b665-99a2e69c37a3 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:20.950879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51407e0f-bd7d-4e0e-b665-99a2e69c37a3 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:20.951798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51407e0f-bd7d-4e0e-b665-99a2e69c37a3 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:20.952258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51407e0f-bd7d-4e0e-b665-99a2e69c37a3 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:20.953440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51407e0f-bd7d-4e0e-b665-99a2e69c37a3 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:21.028848 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51407e0f-bd7d-4e0e-b665-99a2e69c37a3 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf" status: 200 len: 329 microversion: 2.1 time: 0.194823 Oct 11 19:45:21.039477 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 501/963] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 19:45:20 2022] PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf => generated 329 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:21.044241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a32aa43-6b8b-41c5-bc22-f85f1ab8c30e tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Calling method '.version_select at 0x7f83ccb004c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:21.177727 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a32aa43-6b8b-41c5-bc22-f85f1ab8c30e tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf" status: 200 len: 371 microversion: 2.1 time: 0.137099 Oct 11 19:45:21.177947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:21.180067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:21.183581 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 463/964] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 11 19:45:21 2022] GET /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:45:21.188878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:21.189582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:21.191379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:21.192285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:21.192948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:21.193564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:21.194907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b0f77d5b-5b15-4009-9106-b6923c71d643 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Action: 'update', calling method: .version_select at 0x7f83cca75d30>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:21.310950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0f77d5b-5b15-4009-9106-b6923c71d643 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:21.311565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0f77d5b-5b15-4009-9106-b6923c71d643 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:21.312088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0f77d5b-5b15-4009-9106-b6923c71d643 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:21.316390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0f77d5b-5b15-4009-9106-b6923c71d643 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:21.316889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0f77d5b-5b15-4009-9106-b6923c71d643 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:21.317336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0f77d5b-5b15-4009-9106-b6923c71d643 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:21.418868 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b0f77d5b-5b15-4009-9106-b6923c71d643 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf" status: 200 len: 328 microversion: 2.1 time: 0.227277 Oct 11 19:45:21.420738 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 464/965] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 19:45:21 2022] PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf => generated 328 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:45:21.488988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1042504066", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:21.570955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:45:22.286995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:22.305309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:22.309861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:22.311369 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a0c39ddf-960a-4b2e-9126-71d664a700a4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1362 microversion: 2.25 time: 1.138628 Oct 11 19:45:22.315281 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 502/966] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:21 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1362 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:22.323917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:22.329195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 36452fd4-4ace-49b4-89b3-4872701681d6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:22.344660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.345581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.346822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.348523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.349236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.349672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.388110 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] HTTP exception thrown: Instance 36452fd4-4ace-49b4-89b3-4872701681d6 could not be found. Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Request method failure captured: Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 HTTP/1.1 Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccs9sbnuYTCEvs1E8xVkFpmpiKr31XvMnCjLikMyRDwddMOCJ5twa9agvxtxQLsTQRlIfwoM-H4LBkB4LZiYWe1PyGhE1Qc7sNPmCfaJ_2LctQlMWK5k8cSerwgLcsGMQk7PKl7CkU-UnOkIxt3qj2VLbs5fhYxxrZvl2Yv038Rotw Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:22.391901 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8be7ff18ac24462858896eaf1e29fbe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}] Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d473bc95d6ea47978e08f9ceaebf2343 Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 36452fd4-4ace-49b4-89b3-4872701681d6 could not be found. Oct 11 19:45:22.393192 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '36452fd4-4ace-49b4-89b3-4872701681d6'} Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36452fd4-4ace-49b4-89b3-4872701681d6 could not be found. Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:22.394117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36452fd4-4ace-49b4-89b3-4872701681d6 could not be found. Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36452fd4-4ace-49b4-89b3-4872701681d6 could not be found. Oct 11 19:45:22.395292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.400637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Returning 404 to user: Instance 36452fd4-4ace-49b4-89b3-4872701681d6 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:22.401707 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-985a8adf-0653-4ea6-ab3a-2757c89df7b0 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6" status: 404 len: 111 microversion: 2.1 time: 0.085270 Oct 11 19:45:22.405602 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 503/967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:22 2022] GET /compute/v2.1/servers/36452fd4-4ace-49b4-89b3-4872701681d6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:22.413745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c01da93-dc5a-4fb0-9aec-1aabf2b1e70a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:22.415015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c01da93-dc5a-4fb0-9aec-1aabf2b1e70a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:22.419262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:45:22.419727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:45:22.420198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:45:22.420607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:45:22.421016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:45:22.424431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c01da93-dc5a-4fb0-9aec-1aabf2b1e70a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.425201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c01da93-dc5a-4fb0-9aec-1aabf2b1e70a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.425855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c01da93-dc5a-4fb0-9aec-1aabf2b1e70a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.426818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c01da93-dc5a-4fb0-9aec-1aabf2b1e70a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.427666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c01da93-dc5a-4fb0-9aec-1aabf2b1e70a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.428371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c01da93-dc5a-4fb0-9aec-1aabf2b1e70a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.440931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.441425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.441857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.442596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.443055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.443475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.489464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Getting quotas for project 3ea087b06b994a18a43ed33e6b024bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:22.495240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Getting quotas for user a9dc30e1ad854601b6fafa99a691cb70 and project 3ea087b06b994a18a43ed33e6b024bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:22.508548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.utils [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] instances quota exceeded for 3ea087b06b994a18a43ed33e6b024bcf, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126956) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 19:45:22.509400 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Request method failure captured: Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 145 Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfNrMjCEVW0nDNil0MRoM3hBqHjpKUYNLCrBgab2ZzbD4iBHK16XJpZh6VHGzgPItZEvsW4FsOnsUYJcUZrp8Mjvd9iKPxvd-3UGfAJQALL_5cJVqOOZgLDaQdRuwF1L7arLJBoKjssG5ukLhvY8oeKanaigJTw_GfgcpmQajlgTKY Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3ea087b06b994a18a43ed33e6b024bcf Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:22.513249 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3ea087b06b994a18a43ed33e6b024bcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3ea087b06b994a18a43ed33e6b024bcf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ea087b06b994a18a43ed33e6b024bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ea087b06b994a18a43ed33e6b024bcf"}]}] Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3ea087b06b994a18a43ed33e6b024bcf Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-QuotasAdminNegativeTest-400423616-project Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: a9dc30e1ad854601b6fafa99a691cb70 Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-QuotasAdminNegativeTest-400423616-project Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1042504066", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} Oct 11 19:45:22.514505 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1042504066', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452'}}} Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 19:45:22.515763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:22.516794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.517967 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:22.519144 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:22.519144 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:22.519144 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:22.519144 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:22.519144 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 19:45:22.519144 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:22.521579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:22.522712 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b540acad-6171-4cc8-b1eb-8ad612e9b359 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.039457 Oct 11 19:45:22.527068 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 465/968] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:45:21 2022] POST /compute/v2.1/servers => generated 119 bytes in 1046 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:45:22.532304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cad39de1-6147-4ac0-b55b-d4b08040c751 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:22.533091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cad39de1-6147-4ac0-b55b-d4b08040c751 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: b8f663a0-eedd-4d4f-934b-05c7bd72ce6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:22.540877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cad39de1-6147-4ac0-b55b-d4b08040c751 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.541446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cad39de1-6147-4ac0-b55b-d4b08040c751 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.541952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cad39de1-6147-4ac0-b55b-d4b08040c751 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.542773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cad39de1-6147-4ac0-b55b-d4b08040c751 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.543400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cad39de1-6147-4ac0-b55b-d4b08040c751 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.543824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cad39de1-6147-4ac0-b55b-d4b08040c751 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.581867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cad39de1-6147-4ac0-b55b-d4b08040c751 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: b8f663a0-eedd-4d4f-934b-05c7bd72ce6f] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:45:22.794219 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cad39de1-6147-4ac0-b55b-d4b08040c751 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f" status: 204 len: 0 microversion: 2.1 time: 0.255592 Oct 11 19:45:22.795517 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 466/969] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:22 2022] DELETE /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:22.804471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7f991a43-b3df-465b-b4d3-c5b4b891543d tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Action: 'update', calling method: .version_select at 0x7f83ccb46940>, body: {"quota_set": {"instances": 10}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:22.920567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6c01da93-dc5a-4fb0-9aec-1aabf2b1e70a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:22.929475 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c01da93-dc5a-4fb0-9aec-1aabf2b1e70a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.521430 Oct 11 19:45:22.930046 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 504/970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:22 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:22.938163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d8c6ac27-2a05-4de6-b4d3-9479ec617782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:22.938677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d8c6ac27-2a05-4de6-b4d3-9479ec617782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:22.945223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8c6ac27-2a05-4de6-b4d3-9479ec617782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.945947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8c6ac27-2a05-4de6-b4d3-9479ec617782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.946692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8c6ac27-2a05-4de6-b4d3-9479ec617782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.947641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8c6ac27-2a05-4de6-b4d3-9479ec617782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.948317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8c6ac27-2a05-4de6-b4d3-9479ec617782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.949297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8c6ac27-2a05-4de6-b4d3-9479ec617782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.959443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f991a43-b3df-465b-b4d3-c5b4b891543d tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.962205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f991a43-b3df-465b-b4d3-c5b4b891543d tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.962979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f991a43-b3df-465b-b4d3-c5b4b891543d tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.963941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f991a43-b3df-465b-b4d3-c5b4b891543d tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:22.964785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f991a43-b3df-465b-b4d3-c5b4b891543d tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:22.965387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f991a43-b3df-465b-b4d3-c5b4b891543d tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:22.979405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d8c6ac27-2a05-4de6-b4d3-9479ec617782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:45:23.087498 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7f991a43-b3df-465b-b4d3-c5b4b891543d tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf" status: 200 len: 329 microversion: 2.1 time: 0.289932 Oct 11 19:45:23.091344 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 467/971] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 19:45:22 2022] PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf => generated 329 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:23.105437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-289af9e3-e4db-4567-a105-1825bb1c96e6 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Calling method '.version_select at 0x7f83ccb46550>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:23.168725 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d8c6ac27-2a05-4de6-b4d3-9479ec617782 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 204 len: 0 microversion: 2.1 time: 0.234538 Oct 11 19:45:23.172886 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 505/972] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:22 2022] DELETE /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:23.179610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-348f5946-1184-452b-af22-c4b539679f10 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:23.181628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-348f5946-1184-452b-af22-c4b539679f10 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: b8f663a0-eedd-4d4f-934b-05c7bd72ce6f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:23.188876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-348f5946-1184-452b-af22-c4b539679f10 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:23.189592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-348f5946-1184-452b-af22-c4b539679f10 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:23.190216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-348f5946-1184-452b-af22-c4b539679f10 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:23.191124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-348f5946-1184-452b-af22-c4b539679f10 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:23.192501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-348f5946-1184-452b-af22-c4b539679f10 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:23.193274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-348f5946-1184-452b-af22-c4b539679f10 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:23.240307 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-289af9e3-e4db-4567-a105-1825bb1c96e6 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf" status: 200 len: 371 microversion: 2.1 time: 0.139106 Oct 11 19:45:23.244907 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 468/973] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 11 19:45:23 2022] GET /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf => generated 371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:23.257559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-65b9b8a0-afb7-4a64-b6ea-2e2cf4d3af73 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Action: 'update', calling method: .version_select at 0x7f83ccb46700>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:23.343302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65b9b8a0-afb7-4a64-b6ea-2e2cf4d3af73 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:23.344358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65b9b8a0-afb7-4a64-b6ea-2e2cf4d3af73 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:23.345114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65b9b8a0-afb7-4a64-b6ea-2e2cf4d3af73 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:23.346677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65b9b8a0-afb7-4a64-b6ea-2e2cf4d3af73 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:23.347498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65b9b8a0-afb7-4a64-b6ea-2e2cf4d3af73 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:23.348301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65b9b8a0-afb7-4a64-b6ea-2e2cf4d3af73 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:23.361893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:23.440056 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-65b9b8a0-afb7-4a64-b6ea-2e2cf4d3af73 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf" status: 200 len: 325 microversion: 2.1 time: 0.186672 Oct 11 19:45:23.457401 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 469/974] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 19:45:23 2022] PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf => generated 325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:45:23.463728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:23.464698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:23.480812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:23.484804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:23.484804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:23.487166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:23.488171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:23.489213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:23.755904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-348f5946-1184-452b-af22-c4b539679f10 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:23.801959 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-348f5946-1184-452b-af22-c4b539679f10 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f" status: 200 len: 1473 microversion: 2.1 time: 0.623389 Oct 11 19:45:23.805925 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 506/975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:23 2022] GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f => generated 1473 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:23.837839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8d1bd67e-6968-4b19-85e2-7d1006681c85 req-24c21455-2f16-4e28-acd8-45d97c8d8d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6fb34e-c435-436b-905d-3898c72acc34", "name": "network-vif-plugged", "status": "completed", "tag": "808efdac-6278-4889-b777-265334565eda"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:23.868454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8d1bd67e-6968-4b19-85e2-7d1006681c85 req-24c21455-2f16-4e28-acd8-45d97c8d8d3f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:23.869583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8d1bd67e-6968-4b19-85e2-7d1006681c85 req-24c21455-2f16-4e28-acd8-45d97c8d8d3f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:23.871642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8d1bd67e-6968-4b19-85e2-7d1006681c85 req-24c21455-2f16-4e28-acd8-45d97c8d8d3f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:23.907554 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8d1bd67e-6968-4b19-85e2-7d1006681c85 req-24c21455-2f16-4e28-acd8-45d97c8d8d3f service nova] Creating event network-vif-plugged:808efdac-6278-4889-b777-265334565eda for instance 2e6fb34e-c435-436b-905d-3898c72acc34 on n-h2-860864-3 Oct 11 19:45:23.931935 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8d1bd67e-6968-4b19-85e2-7d1006681c85 req-24c21455-2f16-4e28-acd8-45d97c8d8d3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109379 Oct 11 19:45:23.943046 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 507/976] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:23.956862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1945210571", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:24.128136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:45:24.587691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:24.600631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:24.602729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:24.604173 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-287c4bc7-0ffa-499a-ab1d-7749133a81d7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1362 microversion: 2.25 time: 1.144745 Oct 11 19:45:24.605728 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 470/977] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:23 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1362 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:24.620271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c354f17-f8d6-4be3-927c-fa37cb931941 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:24.621184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c354f17-f8d6-4be3-927c-fa37cb931941 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:24.631210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c354f17-f8d6-4be3-927c-fa37cb931941 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:24.631984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c354f17-f8d6-4be3-927c-fa37cb931941 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:24.632711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c354f17-f8d6-4be3-927c-fa37cb931941 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:24.633836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c354f17-f8d6-4be3-927c-fa37cb931941 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:24.634474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c354f17-f8d6-4be3-927c-fa37cb931941 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:24.635078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c354f17-f8d6-4be3-927c-fa37cb931941 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:25.304879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:45:25.305528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:45:25.306701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:45:25.307097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:45:25.307670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:45:25.331656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c354f17-f8d6-4be3-927c-fa37cb931941 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:25.336824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:25.337819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:25.338921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:25.339372 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c354f17-f8d6-4be3-927c-fa37cb931941 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.731583 Oct 11 19:45:25.340390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:25.342867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:25.343809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:25.350914 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 471/978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:24 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:25.355779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-678aa118-3bc5-4f98-b5e1-9505669d19fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:25.356560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-678aa118-3bc5-4f98-b5e1-9505669d19fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: b8f663a0-eedd-4d4f-934b-05c7bd72ce6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:25.373969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678aa118-3bc5-4f98-b5e1-9505669d19fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:25.375062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678aa118-3bc5-4f98-b5e1-9505669d19fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:25.375486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678aa118-3bc5-4f98-b5e1-9505669d19fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:25.376182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678aa118-3bc5-4f98-b5e1-9505669d19fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:25.376633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678aa118-3bc5-4f98-b5e1-9505669d19fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:25.377049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678aa118-3bc5-4f98-b5e1-9505669d19fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:25.380064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Getting quotas for project 3ea087b06b994a18a43ed33e6b024bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:25.398720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Getting quotas for user a9dc30e1ad854601b6fafa99a691cb70 and project 3ea087b06b994a18a43ed33e6b024bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:25.419706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.utils [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] ram quota exceeded for 3ea087b06b994a18a43ed33e6b024bcf, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126955) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 19:45:25.421539 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Request method failure captured: Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 145 Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfNrMjCEVW0nDNil0MRoM3hBqHjpKUYNLCrBgab2ZzbD4iBHK16XJpZh6VHGzgPItZEvsW4FsOnsUYJcUZrp8Mjvd9iKPxvd-3UGfAJQALL_5cJVqOOZgLDaQdRuwF1L7arLJBoKjssG5ukLhvY8oeKanaigJTw_GfgcpmQajlgTKY Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3ea087b06b994a18a43ed33e6b024bcf Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:25.425285 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3ea087b06b994a18a43ed33e6b024bcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3ea087b06b994a18a43ed33e6b024bcf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ea087b06b994a18a43ed33e6b024bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ea087b06b994a18a43ed33e6b024bcf"}]}] Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3ea087b06b994a18a43ed33e6b024bcf Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-QuotasAdminNegativeTest-400423616-project Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a9dc30e1ad854601b6fafa99a691cb70 Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-QuotasAdminNegativeTest-400423616-project Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1945210571", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} Oct 11 19:45:25.430392 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1945210571', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452'}}} Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 19:45:25.431308 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:25.432419 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:25.433754 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:25.435291 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:25.435291 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:25.435291 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:25.435291 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:25.435291 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 19:45:25.435291 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:25.436620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:25.439170 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d6f33840-0bb2-4d79-83de-185bc2026e6d tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.491601 Oct 11 19:45:25.440786 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 508/979] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:45:23 2022] POST /compute/v2.1/servers => generated 110 bytes in 1494 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:25.462688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e8aa43a1-203a-4adf-95cf-2af5e44e35f9 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc4a0430>, body: {"quota_set": {"ram": 51200}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:25.609617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-678aa118-3bc5-4f98-b5e1-9505669d19fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:25.619309 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-678aa118-3bc5-4f98-b5e1-9505669d19fb tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f" status: 200 len: 1473 microversion: 2.1 time: 0.267252 Oct 11 19:45:25.620558 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 472/980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:25 2022] GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f => generated 1473 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:25.640871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:25.641932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:25.653187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:25.654046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:25.654587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:25.655989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:25.656995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:25.657615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:25.863983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:25.889698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:25.891855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:25.893302 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-458d11df-7070-4369-8df5-c64fe2ecab51 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1362 microversion: 2.25 time: 0.267495 Oct 11 19:45:25.912218 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 473/981] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:25 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:25.956997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-400a52c5-91eb-47fb-b156-56f9d2e05c43 req-0e4cc51a-869f-45c0-b647-a57ade76fb11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f663a0-eedd-4d4f-934b-05c7bd72ce6f", "name": "network-vif-deleted", "tag": "3a7eecd6-579e-43b5-bdc4-004193387045"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:25.977151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-400a52c5-91eb-47fb-b156-56f9d2e05c43 req-0e4cc51a-869f-45c0-b647-a57ade76fb11 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:25.977981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-400a52c5-91eb-47fb-b156-56f9d2e05c43 req-0e4cc51a-869f-45c0-b647-a57ade76fb11 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:25.978768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-400a52c5-91eb-47fb-b156-56f9d2e05c43 req-0e4cc51a-869f-45c0-b647-a57ade76fb11 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:25.997895 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-400a52c5-91eb-47fb-b156-56f9d2e05c43 req-0e4cc51a-869f-45c0-b647-a57ade76fb11 service nova] Creating event network-vif-deleted:3a7eecd6-579e-43b5-bdc4-004193387045 for instance b8f663a0-eedd-4d4f-934b-05c7bd72ce6f on n-h2-860864-3 Oct 11 19:45:26.010820 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-400a52c5-91eb-47fb-b156-56f9d2e05c43 req-0e4cc51a-869f-45c0-b647-a57ade76fb11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059530 Oct 11 19:45:26.011767 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 474/982] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:26.089173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8aa43a1-203a-4adf-95cf-2af5e44e35f9 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:26.089704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8aa43a1-203a-4adf-95cf-2af5e44e35f9 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:26.090091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8aa43a1-203a-4adf-95cf-2af5e44e35f9 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:26.090840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8aa43a1-203a-4adf-95cf-2af5e44e35f9 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:26.091293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8aa43a1-203a-4adf-95cf-2af5e44e35f9 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:26.091712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8aa43a1-203a-4adf-95cf-2af5e44e35f9 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:26.270020 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e8aa43a1-203a-4adf-95cf-2af5e44e35f9 tempest-QuotasAdminNegativeTest-1928909899 tempest-QuotasAdminNegativeTest-1928909899-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf" status: 200 len: 329 microversion: 2.1 time: 0.824496 Oct 11 19:45:26.271884 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 509/983] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 19:45:25 2022] PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf => generated 329 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:26.290265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-284d4150-fbb6-4ffd-b3ac-c2ee7c6a8f17 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Action: 'update', calling method: .version_select at 0x7f83ccae6430>, body: {"quota_set": {"ram": 0}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:26.309588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-284d4150-fbb6-4ffd-b3ac-c2ee7c6a8f17 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'a9dc30e1ad854601b6fafa99a691cb70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea087b06b994a18a43ed33e6b024bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-284d4150-fbb6-4ffd-b3ac-c2ee7c6a8f17 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Request method failure captured: Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf HTTP/1.1 Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 25 Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfNrMjCEVW0nDNil0MRoM3hBqHjpKUYNLCrBgab2ZzbD4iBHK16XJpZh6VHGzgPItZEvsW4FsOnsUYJcUZrp8Mjvd9iKPxvd-3UGfAJQALL_5cJVqOOZgLDaQdRuwF1L7arLJBoKjssG5ukLhvY8oeKanaigJTw_GfgcpmQajlgTKY Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3ea087b06b994a18a43ed33e6b024bcf Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:26.322700 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3ea087b06b994a18a43ed33e6b024bcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3ea087b06b994a18a43ed33e6b024bcf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ea087b06b994a18a43ed33e6b024bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ea087b06b994a18a43ed33e6b024bcf"}]}] Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3ea087b06b994a18a43ed33e6b024bcf Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-400423616 Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-QuotasAdminNegativeTest-400423616-project Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: a9dc30e1ad854601b6fafa99a691cb70 Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-QuotasAdminNegativeTest-400423616-project Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: {"quota_set": {"ram": 0}} Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 19:45:26.324056 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '3ea087b06b994a18a43ed33e6b024bcf', 'body': {'quota_set': {'ram': 0}}} Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:26.325028 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:26.326407 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:26.328658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:26.328658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:26.328658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:45:26.328658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:45:26.328658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 19:45:26.328658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:26.334233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-284d4150-fbb6-4ffd-b3ac-c2ee7c6a8f17 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:26.341380 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-284d4150-fbb6-4ffd-b3ac-c2ee7c6a8f17 tempest-QuotasAdminNegativeTest-400423616 tempest-QuotasAdminNegativeTest-400423616-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf" status: 403 len: 116 microversion: 2.1 time: 0.052414 Oct 11 19:45:26.346902 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 475/984] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 19:45:26 2022] PUT /compute/v2.1/os-quota-sets/3ea087b06b994a18a43ed33e6b024bcf => generated 116 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:26.368760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a4ece98-f705-4946-aa8a-2d23aef02ba5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:26.369840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9a4ece98-f705-4946-aa8a-2d23aef02ba5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:26.401322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a4ece98-f705-4946-aa8a-2d23aef02ba5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:26.406880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a4ece98-f705-4946-aa8a-2d23aef02ba5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:26.409118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a4ece98-f705-4946-aa8a-2d23aef02ba5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:26.411962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a4ece98-f705-4946-aa8a-2d23aef02ba5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:26.414006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a4ece98-f705-4946-aa8a-2d23aef02ba5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:26.417963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a4ece98-f705-4946-aa8a-2d23aef02ba5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:26.647608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:26.648351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: b8f663a0-eedd-4d4f-934b-05c7bd72ce6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:26.667509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:26.668475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:26.668800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:26.669929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:26.670590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:26.671289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:26.707705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9a4ece98-f705-4946-aa8a-2d23aef02ba5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:26.721144 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a4ece98-f705-4946-aa8a-2d23aef02ba5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.358474 Oct 11 19:45:26.725169 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 510/985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:26 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:26.759786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:26.760297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:26.760739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:26.761673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lazy-loading 'fault' on Instance uuid b8f663a0-eedd-4d4f-934b-05c7bd72ce6f {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:26.836050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:26.845802 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ad676611-6c05-4b58-84b1-b33c2ee1b5f9 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f" status: 200 len: 1308 microversion: 2.1 time: 0.202461 Oct 11 19:45:26.849047 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 476/986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:26 2022] GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:26.923742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:26.924578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:26.936051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:26.938709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:26.939173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:26.940318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:26.940888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:26.941323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:27.282063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:27.286880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:27.294478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:27.299766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:27.307887 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-68f8854e-e064-4d27-bc57-baba79149f5d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1558 microversion: 2.25 time: 0.387699 Oct 11 19:45:27.322905 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 511/987] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:26 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1558 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:27.335297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-48fa64d4-6e63-4cde-aecb-c5a275d70476 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:27.335910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-48fa64d4-6e63-4cde-aecb-c5a275d70476 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:27.342222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48fa64d4-6e63-4cde-aecb-c5a275d70476 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:27.342749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48fa64d4-6e63-4cde-aecb-c5a275d70476 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:27.343745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48fa64d4-6e63-4cde-aecb-c5a275d70476 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:27.344458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48fa64d4-6e63-4cde-aecb-c5a275d70476 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:27.344905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48fa64d4-6e63-4cde-aecb-c5a275d70476 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:27.345327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48fa64d4-6e63-4cde-aecb-c5a275d70476 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:27.665702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-48fa64d4-6e63-4cde-aecb-c5a275d70476 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid 2e6fb34e-c435-436b-905d-3898c72acc34 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:27.696588 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-48fa64d4-6e63-4cde-aecb-c5a275d70476 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 2051 microversion: 2.25 time: 0.363347 Oct 11 19:45:27.702682 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 477/988] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:27 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 2051 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:27.726460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5f331918-cffc-484d-ba98-95138bf0b617 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:27.727232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5f331918-cffc-484d-ba98-95138bf0b617 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:27.734082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f331918-cffc-484d-ba98-95138bf0b617 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:27.737462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f331918-cffc-484d-ba98-95138bf0b617 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:27.738153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f331918-cffc-484d-ba98-95138bf0b617 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:27.746349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f331918-cffc-484d-ba98-95138bf0b617 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:27.747127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f331918-cffc-484d-ba98-95138bf0b617 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:27.753326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f331918-cffc-484d-ba98-95138bf0b617 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.029227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-5f331918-cffc-484d-ba98-95138bf0b617 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid 2e6fb34e-c435-436b-905d-3898c72acc34 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:28.047084 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5f331918-cffc-484d-ba98-95138bf0b617 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 2051 microversion: 2.25 time: 0.323547 Oct 11 19:45:28.048348 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 478/989] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:27 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 2051 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:28.067324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb3fa73e-ea82-4f59-ab41-ed75161b8ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:28.068190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eb3fa73e-ea82-4f59-ab41-ed75161b8ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:28.084850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb3fa73e-ea82-4f59-ab41-ed75161b8ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.085573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb3fa73e-ea82-4f59-ab41-ed75161b8ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.086288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb3fa73e-ea82-4f59-ab41-ed75161b8ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.087371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb3fa73e-ea82-4f59-ab41-ed75161b8ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.087990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb3fa73e-ea82-4f59-ab41-ed75161b8ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.088754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb3fa73e-ea82-4f59-ab41-ed75161b8ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.256080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-02413a78-aff9-40e6-a62f-c55a48386212 tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Calling method '.version_select at 0x7f83cc579f70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:28.274917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02413a78-aff9-40e6-a62f-c55a48386212 tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.275777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02413a78-aff9-40e6-a62f-c55a48386212 tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.276350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02413a78-aff9-40e6-a62f-c55a48386212 tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.277070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02413a78-aff9-40e6-a62f-c55a48386212 tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.277680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02413a78-aff9-40e6-a62f-c55a48386212 tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.278283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02413a78-aff9-40e6-a62f-c55a48386212 tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.335606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb3fa73e-ea82-4f59-ab41-ed75161b8ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:28.350061 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb3fa73e-ea82-4f59-ab41-ed75161b8ca5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.299412 Oct 11 19:45:28.353708 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 479/990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:28 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:28.364663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:28.365798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: b8f663a0-eedd-4d4f-934b-05c7bd72ce6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:28.371226 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-02413a78-aff9-40e6-a62f-c55a48386212 tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.775137 Oct 11 19:45:28.380976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.384399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.385668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.387368 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 512/991] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 11 19:45:27 2022] GET /compute/v2.1/limits => generated 511 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:28.388082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.389207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.394142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.398889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-508738d8-c5fd-470a-b34b-309b52b793a4 req-aae982a7-b494-4bfe-8570-6b92bac1da8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "997ed107-5049-429a-9611-ba2857048a40", "name": "network-vif-deleted", "tag": "07530b11-69b9-4de4-8e00-bad254f64145"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:28.413871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-508738d8-c5fd-470a-b34b-309b52b793a4 req-aae982a7-b494-4bfe-8570-6b92bac1da8e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.414352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-508738d8-c5fd-470a-b34b-309b52b793a4 req-aae982a7-b494-4bfe-8570-6b92bac1da8e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.415250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-508738d8-c5fd-470a-b34b-309b52b793a4 req-aae982a7-b494-4bfe-8570-6b92bac1da8e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.438395 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] HTTP exception thrown: Instance b8f663a0-eedd-4d4f-934b-05c7bd72ce6f could not be found. Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Request method failure captured: Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f HTTP/1.1 Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccs9sbnuYTCEvs1E8xVkFpmpiKr31XvMnCjLikMyRDwddMOCJ5twa9agvxtxQLsTQRlIfwoM-H4LBkB4LZiYWe1PyGhE1Qc7sNPmCfaJ_2LctQlMWK5k8cSerwgLcsGMQk7PKl7CkU-UnOkIxt3qj2VLbs5fhYxxrZvl2Yv038Rotw Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:28.440811 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8be7ff18ac24462858896eaf1e29fbe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}] Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d473bc95d6ea47978e08f9ceaebf2343 Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance b8f663a0-eedd-4d4f-934b-05c7bd72ce6f could not be found. Oct 11 19:45:28.442359 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'b8f663a0-eedd-4d4f-934b-05c7bd72ce6f'} Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f663a0-eedd-4d4f-934b-05c7bd72ce6f could not be found. Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:28.443258 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f663a0-eedd-4d4f-934b-05c7bd72ce6f could not be found. Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f663a0-eedd-4d4f-934b-05c7bd72ce6f could not be found. Oct 11 19:45:28.444623 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:28.445873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Returning 404 to user: Instance b8f663a0-eedd-4d4f-934b-05c7bd72ce6f could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:28.445960 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-508738d8-c5fd-470a-b34b-309b52b793a4 req-aae982a7-b494-4bfe-8570-6b92bac1da8e service nova] Creating event network-vif-deleted:07530b11-69b9-4de4-8e00-bad254f64145 for instance 997ed107-5049-429a-9611-ba2857048a40 on n-h1-860864-3 Oct 11 19:45:28.446052 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4d3102f6-ba69-43f2-983d-1036940f23a6 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f" status: 404 len: 111 microversion: 2.1 time: 0.089997 Oct 11 19:45:28.446517 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 480/992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:28 2022] GET /compute/v2.1/servers/b8f663a0-eedd-4d4f-934b-05c7bd72ce6f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:28.452512 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-508738d8-c5fd-470a-b34b-309b52b793a4 req-aae982a7-b494-4bfe-8570-6b92bac1da8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063573 Oct 11 19:45:28.456818 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 513/993] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:28.461674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7361fcc6-94d3-43db-ab7d-2a59adc0c8f4 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:28.464200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:28.465198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 997ed107-5049-429a-9611-ba2857048a40] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:28.473801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.474157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.474627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.475819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.476011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7361fcc6-94d3-43db-ab7d-2a59adc0c8f4 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.476282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.476829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.477005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7361fcc6-94d3-43db-ab7d-2a59adc0c8f4 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.477705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7361fcc6-94d3-43db-ab7d-2a59adc0c8f4 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.478639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7361fcc6-94d3-43db-ab7d-2a59adc0c8f4 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.479265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7361fcc6-94d3-43db-ab7d-2a59adc0c8f4 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.479698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7361fcc6-94d3-43db-ab7d-2a59adc0c8f4 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.494045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:28.498596 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] HTTP exception thrown: Instance 997ed107-5049-429a-9611-ba2857048a40 could not be found. Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Request method failure captured: Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 HTTP/1.1 Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccs9sbnuYTCEvs1E8xVkFpmpiKr31XvMnCjLikMyRDwddMOCJ5twa9agvxtxQLsTQRlIfwoM-H4LBkB4LZiYWe1PyGhE1Qc7sNPmCfaJ_2LctQlMWK5k8cSerwgLcsGMQk7PKl7CkU-UnOkIxt3qj2VLbs5fhYxxrZvl2Yv038Rotw Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:28.500861 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8be7ff18ac24462858896eaf1e29fbe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}] Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d473bc95d6ea47978e08f9ceaebf2343 Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 997ed107-5049-429a-9611-ba2857048a40 could not be found. Oct 11 19:45:28.502183 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '997ed107-5049-429a-9611-ba2857048a40'} Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 997ed107-5049-429a-9611-ba2857048a40 could not be found. Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:28.502986 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 997ed107-5049-429a-9611-ba2857048a40 could not be found. Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 997ed107-5049-429a-9611-ba2857048a40 could not be found. Oct 11 19:45:28.504210 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:28.505287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Returning 404 to user: Instance 997ed107-5049-429a-9611-ba2857048a40 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:28.505287 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e3532b1-11c5-4853-be39-8506301d9827 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40" status: 404 len: 111 microversion: 2.1 time: 0.045975 Oct 11 19:45:28.505287 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 514/994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:28 2022] GET /compute/v2.1/servers/997ed107-5049-429a-9611-ba2857048a40 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:28.516860 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7361fcc6-94d3-43db-ab7d-2a59adc0c8f4 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.061821 Oct 11 19:45:28.517778 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 481/995] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Oct 11 19:45:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:45:28.529958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9d5aad7e-d20f-439e-ba89-71a4601b80e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:28.530170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-932e0d86-4eef-4ed4-9cd3-6a08a5c3a61f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:28.531659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9d5aad7e-d20f-439e-ba89-71a4601b80e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:28.538199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d5aad7e-d20f-439e-ba89-71a4601b80e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.539017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d5aad7e-d20f-439e-ba89-71a4601b80e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.539674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d5aad7e-d20f-439e-ba89-71a4601b80e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.540570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d5aad7e-d20f-439e-ba89-71a4601b80e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.541215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d5aad7e-d20f-439e-ba89-71a4601b80e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.541823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d5aad7e-d20f-439e-ba89-71a4601b80e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.588336 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-932e0d86-4eef-4ed4-9cd3-6a08a5c3a61f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/286cb564-17fc-4291-a412-c93dfe1ca59e" status: 204 len: 0 microversion: 2.1 time: 0.070220 Oct 11 19:45:28.588978 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 515/996] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 19:45:28 2022] DELETE /compute/v2.1/os-server-groups/286cb564-17fc-4291-a412-c93dfe1ca59e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:28.600801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c431066-0baa-4ce2-8b1f-f17de8636e49 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:28.601393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c431066-0baa-4ce2-8b1f-f17de8636e49 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:28.608087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c431066-0baa-4ce2-8b1f-f17de8636e49 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.609901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c431066-0baa-4ce2-8b1f-f17de8636e49 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.610515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c431066-0baa-4ce2-8b1f-f17de8636e49 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.611428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c431066-0baa-4ce2-8b1f-f17de8636e49 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.612022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c431066-0baa-4ce2-8b1f-f17de8636e49 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.612477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c431066-0baa-4ce2-8b1f-f17de8636e49 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.621864 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9d5aad7e-d20f-439e-ba89-71a4601b80e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34/action" status: 202 len: 0 microversion: 2.25 time: 0.095369 Oct 11 19:45:28.626322 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 482/997] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:45:28 2022] POST /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:45:28.632076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d144da3a-954d-4b43-acd6-214523a3574f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:28.632991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d144da3a-954d-4b43-acd6-214523a3574f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:28.640447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d144da3a-954d-4b43-acd6-214523a3574f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.641280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d144da3a-954d-4b43-acd6-214523a3574f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.641974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d144da3a-954d-4b43-acd6-214523a3574f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.643052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d144da3a-954d-4b43-acd6-214523a3574f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.643779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d144da3a-954d-4b43-acd6-214523a3574f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.644384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c431066-0baa-4ce2-8b1f-f17de8636e49 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:45:28.644649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d144da3a-954d-4b43-acd6-214523a3574f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.721346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:28.745366 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c431066-0baa-4ce2-8b1f-f17de8636e49 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855" status: 204 len: 0 microversion: 2.1 time: 0.151952 Oct 11 19:45:28.748135 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 516/998] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:28 2022] DELETE /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:28.758314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cd97f732-ee48-4671-abcd-15a748157f02 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:28.759377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cd97f732-ee48-4671-abcd-15a748157f02 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:28.776223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd97f732-ee48-4671-abcd-15a748157f02 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.778796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd97f732-ee48-4671-abcd-15a748157f02 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.779261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd97f732-ee48-4671-abcd-15a748157f02 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.779988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd97f732-ee48-4671-abcd-15a748157f02 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.781208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd97f732-ee48-4671-abcd-15a748157f02 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.785012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd97f732-ee48-4671-abcd-15a748157f02 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.793735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-d144da3a-954d-4b43-acd6-214523a3574f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid 2e6fb34e-c435-436b-905d-3898c72acc34 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:28.818792 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d144da3a-954d-4b43-acd6-214523a3574f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 2056 microversion: 2.25 time: 0.190881 Oct 11 19:45:28.831832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cd97f732-ee48-4671-abcd-15a748157f02 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:45:28.832722 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 483/999] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:28 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 2056 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:28.837816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-04d39186-d116-40ea-81e9-d7036c255e3e tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1824772136", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:28.907982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-04d39186-d116-40ea-81e9-d7036c255e3e tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:45:28.944519 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cd97f732-ee48-4671-abcd-15a748157f02 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 204 len: 0 microversion: 2.1 time: 0.192229 Oct 11 19:45:28.946576 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 517/1000] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:28 2022] DELETE /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:28.957989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-859af82d-62b8-4449-b0f1-2d422abd009f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:28.958718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-859af82d-62b8-4449-b0f1-2d422abd009f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:28.964832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859af82d-62b8-4449-b0f1-2d422abd009f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.965315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859af82d-62b8-4449-b0f1-2d422abd009f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.965751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859af82d-62b8-4449-b0f1-2d422abd009f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:28.966437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859af82d-62b8-4449-b0f1-2d422abd009f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:28.967004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859af82d-62b8-4449-b0f1-2d422abd009f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:28.967310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-859af82d-62b8-4449-b0f1-2d422abd009f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:29.183399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-859af82d-62b8-4449-b0f1-2d422abd009f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:29.194324 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-859af82d-62b8-4449-b0f1-2d422abd009f tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855" status: 200 len: 1473 microversion: 2.1 time: 0.244743 Oct 11 19:45:29.195128 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 518/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:28 2022] GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 => generated 1473 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:45:29.243376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=65 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:29.250176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-04d39186-d116-40ea-81e9-d7036c255e3e tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Getting quotas for project f5a0c59a5b8a4ae5a9fdb85336061ee8. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:29.262894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-04d39186-d116-40ea-81e9-d7036c255e3e tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Getting quotas for user a62842f9349d4132b77aabf83d5243c3 and project f5a0c59a5b8a4ae5a9fdb85336061ee8. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:29.288620 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-04d39186-d116-40ea-81e9-d7036c255e3e tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-04d39186-d116-40ea-81e9-d7036c255e3e tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Request method failure captured: Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 1752 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfXSj0mCvgWRiW4I8-h8oR4ySsEHg9Dswsx57LYlbjOmLwYSmScpvuvER7sY7WSI84J7yH_9SVuniOuuX7vUC_a7QIdf9TYhsSvLWbODUCN41hLKYirl0nxrIVhZLoRO8mL5j38KUFwuAdwWLAM78052oOBA4v_j7pP0fYeJjgMwZc Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f5a0c59a5b8a4ae5a9fdb85336061ee8 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1636334981 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5a0c59a5b8a4ae5a9fdb85336061ee8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5a0c59a5b8a4ae5a9fdb85336061ee8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5a0c59a5b8a4ae5a9fdb85336061ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5a0c59a5b8a4ae5a9fdb85336061ee8"}]}] Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1636334981 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f5a0c59a5b8a4ae5a9fdb85336061ee8 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1636334981 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: a62842f9349d4132b77aabf83d5243c3 Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1824772136", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:45:29.292134 n-d-860864-3 devstack@n-api.service[126956]: exception: Maximum number of metadata items exceeds 128 Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1824772136', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:29.294288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-04d39186-d116-40ea-81e9-d7036c255e3e tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-04d39186-d116-40ea-81e9-d7036c255e3e tempest-AbsoluteLimitsNegativeTestJSON-1636334981 tempest-AbsoluteLimitsNegativeTestJSON-1636334981-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.463737 Oct 11 19:45:29.306338 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 484/1002] 10.222.0.27 () {60 vars in 1148 bytes} [Tue Oct 11 19:45:28 2022] POST /compute/v2.1/servers => generated 87 bytes in 465 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:45:29.377746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05c2f671-e4c8-4065-8245-4d4042111679 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:29.378363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05c2f671-e4c8-4065-8245-4d4042111679 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:29.384787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c2f671-e4c8-4065-8245-4d4042111679 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:29.385285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c2f671-e4c8-4065-8245-4d4042111679 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:29.385726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c2f671-e4c8-4065-8245-4d4042111679 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:29.386483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c2f671-e4c8-4065-8245-4d4042111679 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:29.387340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c2f671-e4c8-4065-8245-4d4042111679 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:29.387934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05c2f671-e4c8-4065-8245-4d4042111679 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:29.536900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-05c2f671-e4c8-4065-8245-4d4042111679 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:29.545570 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05c2f671-e4c8-4065-8245-4d4042111679 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.172258 Oct 11 19:45:29.549874 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 519/1003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:29 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:29.850240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9038ee4e-2e08-42c8-afd2-dab8551be635 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:29.851569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9038ee4e-2e08-42c8-afd2-dab8551be635 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:29.859296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9038ee4e-2e08-42c8-afd2-dab8551be635 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:29.860034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9038ee4e-2e08-42c8-afd2-dab8551be635 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:29.860961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9038ee4e-2e08-42c8-afd2-dab8551be635 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:29.862006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9038ee4e-2e08-42c8-afd2-dab8551be635 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:29.862691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9038ee4e-2e08-42c8-afd2-dab8551be635 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:29.863185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9038ee4e-2e08-42c8-afd2-dab8551be635 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:30.020409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-9038ee4e-2e08-42c8-afd2-dab8551be635 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid 2e6fb34e-c435-436b-905d-3898c72acc34 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:30.035782 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9038ee4e-2e08-42c8-afd2-dab8551be635 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 2036 microversion: 2.25 time: 0.188910 Oct 11 19:45:30.046704 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 485/1004] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:29 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 2036 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:30.062201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-3", "block_migration": "auto"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:30.065160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:30.071665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:30.072161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:30.072596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:30.073295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:30.073749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:30.074171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:30.103998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'flavor' on Instance uuid 2e6fb34e-c435-436b-905d-3898c72acc34 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:30.121489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Going to try to live migrate instance to n-h1-860864-3 {{(pid=126955) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 19:45:30.218607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c2a3c088-832c-4e78-9fe0-a98e881d28fd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:30.219696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c2a3c088-832c-4e78-9fe0-a98e881d28fd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:30.234823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a3c088-832c-4e78-9fe0-a98e881d28fd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:30.235329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a3c088-832c-4e78-9fe0-a98e881d28fd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:30.235767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a3c088-832c-4e78-9fe0-a98e881d28fd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:30.236477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a3c088-832c-4e78-9fe0-a98e881d28fd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:30.236933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a3c088-832c-4e78-9fe0-a98e881d28fd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:30.237357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a3c088-832c-4e78-9fe0-a98e881d28fd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:30.456965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c2a3c088-832c-4e78-9fe0-a98e881d28fd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:30.468800 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c2a3c088-832c-4e78-9fe0-a98e881d28fd tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855" status: 200 len: 1473 microversion: 2.1 time: 0.253715 Oct 11 19:45:30.469673 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 486/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:30 2022] GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 => generated 1473 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:30.753401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-55bf7a39-c2fd-4099-acc3-e97bcd1e1bc9 tempest-ListImageFiltersNegativeTestJSON-94415388 tempest-ListImageFiltersNegativeTestJSON-94415388-project] Calling method '.version_select at 0x7f83ccba7ca0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:30.779167 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-55bf7a39-c2fd-4099-acc3-e97bcd1e1bc9 tempest-ListImageFiltersNegativeTestJSON-94415388 tempest-ListImageFiltersNegativeTestJSON-94415388-project] HTTP exception thrown: Image not found. Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-55bf7a39-c2fd-4099-acc3-e97bcd1e1bc9 tempest-ListImageFiltersNegativeTestJSON-94415388 tempest-ListImageFiltersNegativeTestJSON-94415388-project] Request method failure captured: Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/images/5d4a9551-26cf-4518-959e-46d401277335 HTTP/1.1 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfabXgGCQGW02iS4uGCDXJylb2g9nx2ME_QbLwsF13iRsRmcTTLMcQY4CwxfmCM1N7f-Da9hHAP3Rcu2GZcVsLtfP30KJArISXG2tpUKMQhkzZPMtZVDujoC6BeWdccglRrMGA0NIXju6VVWis2M6K7xg4AdI0KG9m0R9qgmK8z1zQ Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bd3be988d1214630b3b4e169afc73a96 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-94415388 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd3be988d1214630b3b4e169afc73a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd3be988d1214630b3b4e169afc73a96", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd3be988d1214630b3b4e169afc73a96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd3be988d1214630b3b4e169afc73a96"}]}] Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-94415388 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bd3be988d1214630b3b4e169afc73a96 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-94415388 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ListImageFiltersNegativeTestJSON-94415388-project Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 35bfb94027824f429da5dc4c1b0024d1 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-94415388-project Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: exception: Image not found. Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5d4a9551-26cf-4518-959e-46d401277335'} Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5d4a9551-26cf-4518-959e-46d401277335 Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 19:45:30.780970 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5d4a9551-26cf-4518-959e-46d401277335 could not be found. Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-55bf7a39-c2fd-4099-acc3-e97bcd1e1bc9 tempest-ListImageFiltersNegativeTestJSON-94415388 tempest-ListImageFiltersNegativeTestJSON-94415388-project] Returning 404 to user: Image not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-55bf7a39-c2fd-4099-acc3-e97bcd1e1bc9 tempest-ListImageFiltersNegativeTestJSON-94415388 tempest-ListImageFiltersNegativeTestJSON-94415388-project] 10.222.0.27 "GET /compute/v2.1/images/5d4a9551-26cf-4518-959e-46d401277335" status: 404 len: 62 microversion: 2.1 time: 0.311488 Oct 11 19:45:30.784910 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 487/1006] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:45:30 2022] GET /compute/v2.1/images/5d4a9551-26cf-4518-959e-46d401277335 => generated 62 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:45:30.791080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3971cae-cc61-465f-9004-f3fa1e6b8a24 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:30.791609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3971cae-cc61-465f-9004-f3fa1e6b8a24 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:30.799602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3971cae-cc61-465f-9004-f3fa1e6b8a24 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:30.800131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3971cae-cc61-465f-9004-f3fa1e6b8a24 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:30.801168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3971cae-cc61-465f-9004-f3fa1e6b8a24 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:30.802914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3971cae-cc61-465f-9004-f3fa1e6b8a24 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:30.804762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3971cae-cc61-465f-9004-f3fa1e6b8a24 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:30.805211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3971cae-cc61-465f-9004-f3fa1e6b8a24 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:30.954842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c3971cae-cc61-465f-9004-f3fa1e6b8a24 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:30.957192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:30.965300 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3971cae-cc61-465f-9004-f3fa1e6b8a24 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.181324 Oct 11 19:45:30.966089 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 488/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:30 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:31.784785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-64b72e50-4640-4ade-80b8-9cd0e7b110dd tempest-FlavorMetadataValidation-1994550660 tempest-FlavorMetadataValidation-1994550660-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1525167569", "id": 1197240192, "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:31.819694 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-64b72e50-4640-4ade-80b8-9cd0e7b110dd tempest-FlavorMetadataValidation-1994550660 tempest-FlavorMetadataValidation-1994550660-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.392280 Oct 11 19:45:31.829533 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 489/1008] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:45:31 2022] POST /compute/v2.1/flavors => generated 471 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 19:45:31.834694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d63b660b-eab7-48db-8a63-eecc2ac11683 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:31.835573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d63b660b-eab7-48db-8a63-eecc2ac11683 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:31.842366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d63b660b-eab7-48db-8a63-eecc2ac11683 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:31.843762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d63b660b-eab7-48db-8a63-eecc2ac11683 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:31.844435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d63b660b-eab7-48db-8a63-eecc2ac11683 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:31.845478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d63b660b-eab7-48db-8a63-eecc2ac11683 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:31.846147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d63b660b-eab7-48db-8a63-eecc2ac11683 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:31.846845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d63b660b-eab7-48db-8a63-eecc2ac11683 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:32.059803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d63b660b-eab7-48db-8a63-eecc2ac11683 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:32.073629 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d63b660b-eab7-48db-8a63-eecc2ac11683 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855" status: 200 len: 1473 microversion: 2.1 time: 0.241863 Oct 11 19:45:32.089454 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 490/1009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:31 2022] GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:32.095710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ed9cb3f-b7ce-4f6c-9e31-86a8ab2778be tempest-FlavorMetadataValidation-1994550660 tempest-FlavorMetadataValidation-1994550660-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:32.308380 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1ed9cb3f-b7ce-4f6c-9e31-86a8ab2778be tempest-FlavorMetadataValidation-1994550660 tempest-FlavorMetadataValidation-1994550660-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1197240192/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.217330 Oct 11 19:45:32.314805 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 491/1010] 10.222.0.27 () {62 vars in 1265 bytes} [Tue Oct 11 19:45:32 2022] POST /compute/v2.1/flavors/1197240192/os-extra_specs => generated 62 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:32.323891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c84ad298-90b2-4ea3-85ad-c00aa21825f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:32.324503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c84ad298-90b2-4ea3-85ad-c00aa21825f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:32.333197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c84ad298-90b2-4ea3-85ad-c00aa21825f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:32.333699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c84ad298-90b2-4ea3-85ad-c00aa21825f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:32.334136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c84ad298-90b2-4ea3-85ad-c00aa21825f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:32.334877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c84ad298-90b2-4ea3-85ad-c00aa21825f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:32.335334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c84ad298-90b2-4ea3-85ad-c00aa21825f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:32.335751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c84ad298-90b2-4ea3-85ad-c00aa21825f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:32.741363 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e256c064-f07e-465b-b98c-61786606d615 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34/action" status: 202 len: 0 microversion: 2.25 time: 2.683151 Oct 11 19:45:32.742985 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 520/1011] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:45:30 2022] POST /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34/action => generated 0 bytes in 2685 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:32.753946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c477a716-8637-4e94-be8a-b3ad7c22bfa7 tempest-FlavorMetadataValidation-1994550660 tempest-FlavorMetadataValidation-1994550660-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:32.827019 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c477a716-8637-4e94-be8a-b3ad7c22bfa7 tempest-FlavorMetadataValidation-1994550660 tempest-FlavorMetadataValidation-1994550660-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1197240192" status: 202 len: 0 microversion: 2.86 time: 0.082597 Oct 11 19:45:32.828972 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 521/1012] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Oct 11 19:45:32 2022] DELETE /compute/v2.1/flavors/1197240192 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:32.854819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-17604aed-3ac6-4bb7-932a-5524765fc904 req-5d67e1dd-deca-4a86-a00d-244fe296c7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28f5e45d-a8da-4de0-b75a-3e8a3119d855", "name": "network-vif-deleted", "tag": "7e7af7a4-dce7-4f1b-924e-0a177b2ccdfc"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:32.884149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-17604aed-3ac6-4bb7-932a-5524765fc904 req-5d67e1dd-deca-4a86-a00d-244fe296c7f1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:32.884823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-17604aed-3ac6-4bb7-932a-5524765fc904 req-5d67e1dd-deca-4a86-a00d-244fe296c7f1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:32.885411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-17604aed-3ac6-4bb7-932a-5524765fc904 req-5d67e1dd-deca-4a86-a00d-244fe296c7f1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:32.903888 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-17604aed-3ac6-4bb7-932a-5524765fc904 req-5d67e1dd-deca-4a86-a00d-244fe296c7f1 service nova] Creating event network-vif-deleted:7e7af7a4-dce7-4f1b-924e-0a177b2ccdfc for instance 28f5e45d-a8da-4de0-b75a-3e8a3119d855 on n-h1-860864-3 Oct 11 19:45:32.910424 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-17604aed-3ac6-4bb7-932a-5524765fc904 req-5d67e1dd-deca-4a86-a00d-244fe296c7f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079999 Oct 11 19:45:32.911849 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 522/1013] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:32.925078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:32.925779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:32.935344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:32.936897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:32.946051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:32.946935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:32.954231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:32.954802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:33.000748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c84ad298-90b2-4ea3-85ad-c00aa21825f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:33.045053 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c84ad298-90b2-4ea3-85ad-c00aa21825f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.721768 Oct 11 19:45:33.050330 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 492/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:32 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:33.064916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e03e46cd-c4cc-4234-8a67-95e497e32e77 tempest-FlavorMetadataValidation-1994550660 tempest-FlavorMetadataValidation-1994550660-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:33.129451 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e03e46cd-c4cc-4234-8a67-95e497e32e77 tempest-FlavorMetadataValidation-1994550660 tempest-FlavorMetadataValidation-1994550660-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.077640 Oct 11 19:45:33.132913 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 493/1015] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 19:45:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:33.148709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:33.154197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:33.167009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:33.167512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:33.168050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:33.174828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:33.175323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:33.176114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:33.239286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:33.240187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:33.240788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:33.241397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lazy-loading 'fault' on Instance uuid 28f5e45d-a8da-4de0-b75a-3e8a3119d855 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:33.280808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:33.291560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:33.293506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:33.294964 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ed610764-7750-4a4e-8526-7665d5387a81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1568 microversion: 2.25 time: 0.380824 Oct 11 19:45:33.298762 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 523/1016] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:32 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1568 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:33.343556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:33.359353 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4ddf19ee-c5ed-4e89-b1c6-3df721d9a54d tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855" status: 200 len: 1307 microversion: 2.1 time: 0.221440 Oct 11 19:45:33.360644 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 494/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:33 2022] GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 => generated 1307 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:34.074212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0443ec39-d5e3-4947-a076-dab966bd1c2e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:34.075686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0443ec39-d5e3-4947-a076-dab966bd1c2e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:34.090644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0443ec39-d5e3-4947-a076-dab966bd1c2e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:34.091991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0443ec39-d5e3-4947-a076-dab966bd1c2e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:34.094798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0443ec39-d5e3-4947-a076-dab966bd1c2e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:34.095861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0443ec39-d5e3-4947-a076-dab966bd1c2e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:34.098665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0443ec39-d5e3-4947-a076-dab966bd1c2e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:34.099381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0443ec39-d5e3-4947-a076-dab966bd1c2e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:34.373424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0443ec39-d5e3-4947-a076-dab966bd1c2e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:34.387039 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0443ec39-d5e3-4947-a076-dab966bd1c2e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.317344 Oct 11 19:45:34.387640 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 495/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:34 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:34.398177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:34.398855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:34.426623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:34.428218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:34.428813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:34.430011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:34.430554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:34.431188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:34.540640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ad293055-1650-439c-8f53-6d27ff42e23c tempest-ListImagesTestJSON-1665247766 tempest-ListImagesTestJSON-1665247766-project] Calling method '.version_select at 0x7f83cc40d8b0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:34.616575 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ad293055-1650-439c-8f53-6d27ff42e23c tempest-ListImagesTestJSON-1665247766 tempest-ListImagesTestJSON-1665247766-project] 10.222.0.27 "GET /compute/v2.1/images/d10025cd-51f6-4b3b-a33d-5e8072e792b3" status: 200 len: 784 microversion: 2.1 time: 0.574808 Oct 11 19:45:34.617167 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 524/1019] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:45:34 2022] GET /compute/v2.1/images/d10025cd-51f6-4b3b-a33d-5e8072e792b3 => generated 784 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:34.625290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:34.625914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: 28f5e45d-a8da-4de0-b75a-3e8a3119d855] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:34.635067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:34.635915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:34.636819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:34.637977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:34.638695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:34.640211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:34.665452 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] HTTP exception thrown: Instance 28f5e45d-a8da-4de0-b75a-3e8a3119d855 could not be found. Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Request method failure captured: Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 HTTP/1.1 Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccs9sbnuYTCEvs1E8xVkFpmpiKr31XvMnCjLikMyRDwddMOCJ5twa9agvxtxQLsTQRlIfwoM-H4LBkB4LZiYWe1PyGhE1Qc7sNPmCfaJ_2LctQlMWK5k8cSerwgLcsGMQk7PKl7CkU-UnOkIxt3qj2VLbs5fhYxxrZvl2Yv038Rotw Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8be7ff18ac24462858896eaf1e29fbe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}] Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d473bc95d6ea47978e08f9ceaebf2343 Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 28f5e45d-a8da-4de0-b75a-3e8a3119d855 could not be found. Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '28f5e45d-a8da-4de0-b75a-3e8a3119d855'} Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28f5e45d-a8da-4de0-b75a-3e8a3119d855 could not be found. Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28f5e45d-a8da-4de0-b75a-3e8a3119d855 could not be found. Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:34.669221 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:34.673943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:34.673943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:34.673943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:34.673943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:34.673943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:34.673943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28f5e45d-a8da-4de0-b75a-3e8a3119d855 could not be found. Oct 11 19:45:34.673943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:34.676866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Returning 404 to user: Instance 28f5e45d-a8da-4de0-b75a-3e8a3119d855 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:34.678588 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9aca9086-59b3-4226-ac68-5d510462e307 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855" status: 404 len: 111 microversion: 2.1 time: 0.059791 Oct 11 19:45:34.679911 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 525/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:34 2022] GET /compute/v2.1/servers/28f5e45d-a8da-4de0-b75a-3e8a3119d855 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:34.688631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-18e910d5-7f39-44d9-baf8-44e31d387e16 tempest-ListImagesTestJSON-1665247766 tempest-ListImagesTestJSON-1665247766-project] Calling method '.version_select at 0x7f83cc4f0d30>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:34.714945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:34.739852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:34.741303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:34.742482 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c29db2f3-8d82-4417-ba52-3ba33b05817d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1568 microversion: 2.25 time: 0.353925 Oct 11 19:45:34.754715 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 496/1021] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:34 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1568 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:34.759783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:34.760397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: a3bfcd6d-640c-4cae-8025-09798db76580] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:34.785094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:34.785825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:34.788428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:34.789385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:34.791227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:34.792224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:34.815440 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-18e910d5-7f39-44d9-baf8-44e31d387e16 tempest-ListImagesTestJSON-1665247766 tempest-ListImagesTestJSON-1665247766-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.133317 Oct 11 19:45:34.817754 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 526/1022] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 11 19:45:34 2022] GET /compute/v2.1/images => generated 445 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:34.831374 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] HTTP exception thrown: Instance a3bfcd6d-640c-4cae-8025-09798db76580 could not be found. Oct 11 19:45:34.831960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-436eaf16-c5e2-4cd8-88c5-5b5a7aa6716c tempest-ListImagesTestJSON-1665247766 tempest-ListImagesTestJSON-1665247766-project] Calling method '.version_select at 0x7f83cc4224c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Request method failure captured: Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 HTTP/1.1 Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccs9sbnuYTCEvs1E8xVkFpmpiKr31XvMnCjLikMyRDwddMOCJ5twa9agvxtxQLsTQRlIfwoM-H4LBkB4LZiYWe1PyGhE1Qc7sNPmCfaJ_2LctQlMWK5k8cSerwgLcsGMQk7PKl7CkU-UnOkIxt3qj2VLbs5fhYxxrZvl2Yv038Rotw Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8be7ff18ac24462858896eaf1e29fbe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}] Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d473bc95d6ea47978e08f9ceaebf2343 Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance a3bfcd6d-640c-4cae-8025-09798db76580 could not be found. Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a3bfcd6d-640c-4cae-8025-09798db76580'} Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3bfcd6d-640c-4cae-8025-09798db76580 could not be found. Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3bfcd6d-640c-4cae-8025-09798db76580 could not be found. Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:34.836789 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:34.841109 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:34.841109 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:34.841109 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:34.841109 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:34.841109 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:34.841109 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3bfcd6d-640c-4cae-8025-09798db76580 could not be found. Oct 11 19:45:34.841109 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:45:34.844122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Returning 404 to user: Instance a3bfcd6d-640c-4cae-8025-09798db76580 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:34.846548 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8f294dff-960e-40e4-8150-3c18a5630265 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580" status: 404 len: 111 microversion: 2.1 time: 0.089552 Oct 11 19:45:34.848079 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 497/1023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:34 2022] GET /compute/v2.1/servers/a3bfcd6d-640c-4cae-8025-09798db76580 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:34.861919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-48cf41f6-26ca-4995-9860-83a361d635c7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:34.928510 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-436eaf16-c5e2-4cd8-88c5-5b5a7aa6716c tempest-ListImagesTestJSON-1665247766 tempest-ListImagesTestJSON-1665247766-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.100771 Oct 11 19:45:34.929123 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 527/1024] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:45:34 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:45:34.929701 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-48cf41f6-26ca-4995-9860-83a361d635c7 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/2b535411-8be5-410e-b035-f9000ef01694" status: 204 len: 0 microversion: 2.1 time: 0.075950 Oct 11 19:45:34.930564 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 498/1025] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 19:45:34 2022] DELETE /compute/v2.1/os-server-groups/2b535411-8be5-410e-b035-f9000ef01694 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:34.946289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-59815ed7-900a-48a8-946e-bbe92b88f6c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:34.947221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-59815ed7-900a-48a8-946e-bbe92b88f6c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:34.964981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59815ed7-900a-48a8-946e-bbe92b88f6c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:34.966343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59815ed7-900a-48a8-946e-bbe92b88f6c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:34.966966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59815ed7-900a-48a8-946e-bbe92b88f6c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:34.968418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59815ed7-900a-48a8-946e-bbe92b88f6c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:34.969041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59815ed7-900a-48a8-946e-bbe92b88f6c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:34.970431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59815ed7-900a-48a8-946e-bbe92b88f6c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:35.019275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-59815ed7-900a-48a8-946e-bbe92b88f6c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:45:35.152917 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-59815ed7-900a-48a8-946e-bbe92b88f6c8 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 204 len: 0 microversion: 2.1 time: 0.216569 Oct 11 19:45:35.153831 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 528/1026] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:45:34 2022] DELETE /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:35.164153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-27e32943-bdf1-4c49-8807-3a4cdfb2812a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:35.164756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-27e32943-bdf1-4c49-8807-3a4cdfb2812a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:35.179226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27e32943-bdf1-4c49-8807-3a4cdfb2812a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:35.179716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27e32943-bdf1-4c49-8807-3a4cdfb2812a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:35.180302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27e32943-bdf1-4c49-8807-3a4cdfb2812a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:35.182655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27e32943-bdf1-4c49-8807-3a4cdfb2812a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:35.183148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27e32943-bdf1-4c49-8807-3a4cdfb2812a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:35.188736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27e32943-bdf1-4c49-8807-3a4cdfb2812a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:35.298874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-0abd88d0-374f-4655-9017-69932626ebb5 req-b84e313c-7603-4296-98a8-7668139fa7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bfcd6d-640c-4cae-8025-09798db76580", "name": "network-vif-deleted", "tag": "20d5c53b-0385-4ec9-b7ac-f5872bfa0bb3"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:35.317917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0abd88d0-374f-4655-9017-69932626ebb5 req-b84e313c-7603-4296-98a8-7668139fa7f6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:35.321162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0abd88d0-374f-4655-9017-69932626ebb5 req-b84e313c-7603-4296-98a8-7668139fa7f6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:35.322933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0abd88d0-374f-4655-9017-69932626ebb5 req-b84e313c-7603-4296-98a8-7668139fa7f6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:35.346928 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-0abd88d0-374f-4655-9017-69932626ebb5 req-b84e313c-7603-4296-98a8-7668139fa7f6 service nova] Creating event network-vif-deleted:20d5c53b-0385-4ec9-b7ac-f5872bfa0bb3 for instance a3bfcd6d-640c-4cae-8025-09798db76580 on n-h1-860864-3 Oct 11 19:45:35.362140 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-0abd88d0-374f-4655-9017-69932626ebb5 req-b84e313c-7603-4296-98a8-7668139fa7f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064151 Oct 11 19:45:35.364272 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 529/1027] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:45:35.420272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc39c86a-113a-41de-8936-4e2a70c631d8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:35.421617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc39c86a-113a-41de-8936-4e2a70c631d8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:35.439297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc39c86a-113a-41de-8936-4e2a70c631d8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:35.439812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc39c86a-113a-41de-8936-4e2a70c631d8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:35.441812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc39c86a-113a-41de-8936-4e2a70c631d8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:35.442579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc39c86a-113a-41de-8936-4e2a70c631d8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:35.443050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc39c86a-113a-41de-8936-4e2a70c631d8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:35.443547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc39c86a-113a-41de-8936-4e2a70c631d8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:35.509359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:35.715120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-27e32943-bdf1-4c49-8807-3a4cdfb2812a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:35.730997 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-27e32943-bdf1-4c49-8807-3a4cdfb2812a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1473 microversion: 2.1 time: 0.571400 Oct 11 19:45:35.732334 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 499/1028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:35 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1473 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:35.776347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:35.778336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:35.791959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:35.792487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:35.792994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:35.793729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:35.801437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:35.802234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:35.840833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc39c86a-113a-41de-8936-4e2a70c631d8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:35.859173 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc39c86a-113a-41de-8936-4e2a70c631d8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.444390 Oct 11 19:45:35.860125 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 530/1029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:35 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:45:36.071543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:36.087890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:36.089349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:36.090565 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0e74761c-9345-4017-a122-9a3ebe079ff0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1568 microversion: 2.25 time: 0.321117 Oct 11 19:45:36.096982 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 500/1030] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:35 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:36.761779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-978c3207-78eb-4e49-85aa-5d017b07cf61 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:36.767720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-978c3207-78eb-4e49-85aa-5d017b07cf61 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:36.780351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-978c3207-78eb-4e49-85aa-5d017b07cf61 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:36.781170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-978c3207-78eb-4e49-85aa-5d017b07cf61 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:36.781832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-978c3207-78eb-4e49-85aa-5d017b07cf61 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:36.783301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-978c3207-78eb-4e49-85aa-5d017b07cf61 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:36.783972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-978c3207-78eb-4e49-85aa-5d017b07cf61 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:36.784602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-978c3207-78eb-4e49-85aa-5d017b07cf61 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:36.884845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4aba1052-c29e-4c86-8da9-54d24cc0aadf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:36.885624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4aba1052-c29e-4c86-8da9-54d24cc0aadf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:36.906179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aba1052-c29e-4c86-8da9-54d24cc0aadf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:36.906728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aba1052-c29e-4c86-8da9-54d24cc0aadf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:36.909125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aba1052-c29e-4c86-8da9-54d24cc0aadf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:36.912909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aba1052-c29e-4c86-8da9-54d24cc0aadf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:36.913748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aba1052-c29e-4c86-8da9-54d24cc0aadf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:36.916509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aba1052-c29e-4c86-8da9-54d24cc0aadf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:36.978671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-978c3207-78eb-4e49-85aa-5d017b07cf61 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:36.993374 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-978c3207-78eb-4e49-85aa-5d017b07cf61 tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1473 microversion: 2.1 time: 0.238300 Oct 11 19:45:37.007654 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 531/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:36 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1473 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:37.116343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:37.117830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:37.163798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:37.165793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:37.169414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4aba1052-c29e-4c86-8da9-54d24cc0aadf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:37.181920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:37.182735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:37.182854 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4aba1052-c29e-4c86-8da9-54d24cc0aadf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.301216 Oct 11 19:45:37.183215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:37.183652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:37.184327 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 501/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:36 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:37.397801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-46a65651-39cf-4c1a-9df9-aeb0c41d7c06 req-e813aa6a-2f76-4e39-96d9-db891ed4777d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6fb34e-c435-436b-905d-3898c72acc34", "name": "network-vif-unplugged", "status": "completed", "tag": "808efdac-6278-4889-b777-265334565eda"}, {"name": "network-changed", "server_uuid": "2e6fb34e-c435-436b-905d-3898c72acc34", "tag": "808efdac-6278-4889-b777-265334565eda"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:37.412999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-46a65651-39cf-4c1a-9df9-aeb0c41d7c06 req-e813aa6a-2f76-4e39-96d9-db891ed4777d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:37.414060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-46a65651-39cf-4c1a-9df9-aeb0c41d7c06 req-e813aa6a-2f76-4e39-96d9-db891ed4777d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:37.414932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-46a65651-39cf-4c1a-9df9-aeb0c41d7c06 req-e813aa6a-2f76-4e39-96d9-db891ed4777d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:37.438142 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-46a65651-39cf-4c1a-9df9-aeb0c41d7c06 req-e813aa6a-2f76-4e39-96d9-db891ed4777d service nova] Creating event network-vif-unplugged:808efdac-6278-4889-b777-265334565eda for instance 2e6fb34e-c435-436b-905d-3898c72acc34 on n-h2-860864-3 Oct 11 19:45:37.439495 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-46a65651-39cf-4c1a-9df9-aeb0c41d7c06 req-e813aa6a-2f76-4e39-96d9-db891ed4777d service nova] Creating event network-changed:808efdac-6278-4889-b777-265334565eda for instance 2e6fb34e-c435-436b-905d-3898c72acc34 on n-h2-860864-3 Oct 11 19:45:37.459220 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-46a65651-39cf-4c1a-9df9-aeb0c41d7c06 req-e813aa6a-2f76-4e39-96d9-db891ed4777d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.063487 Oct 11 19:45:37.462816 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 502/1033] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:37.486005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:37.500915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:37.503374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:37.506744 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-40669cb9-d14e-4ab8-88b6-61bd18a3e8d1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1568 microversion: 2.25 time: 0.392725 Oct 11 19:45:37.508547 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 532/1034] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:37 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1568 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:37.977665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d1edac47-0cd8-4f09-8eb9-9739df2ce977 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:37.978388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d1edac47-0cd8-4f09-8eb9-9739df2ce977 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:38.003076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1edac47-0cd8-4f09-8eb9-9739df2ce977 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.005625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1edac47-0cd8-4f09-8eb9-9739df2ce977 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.006154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1edac47-0cd8-4f09-8eb9-9739df2ce977 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.017047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1edac47-0cd8-4f09-8eb9-9739df2ce977 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.019115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1edac47-0cd8-4f09-8eb9-9739df2ce977 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.019732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1edac47-0cd8-4f09-8eb9-9739df2ce977 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.019855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:38.020406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:38.032789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.046512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.048218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.049100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.049586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.056672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.178105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.178623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.184411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.184987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lazy-loading 'fault' on Instance uuid f392b558-6079-4c4d-88bd-a50aa499dce6 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:38.273056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=30 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:38.290129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:38.392398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd473bc95d6ea47978e08f9ceaebf2343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8be7ff18ac24462858896eaf1e29fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:38.407032 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2185a508-2df2-4da1-a5c1-a8e98e3fdc6a tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 200 len: 1307 microversion: 2.1 time: 0.391367 Oct 11 19:45:38.412045 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 533/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:38 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:38.433538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ad6220dc-30bb-4cac-b8f2-4233669475e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:38.434469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ad6220dc-30bb-4cac-b8f2-4233669475e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:38.449804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad6220dc-30bb-4cac-b8f2-4233669475e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.454913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad6220dc-30bb-4cac-b8f2-4233669475e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.458566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad6220dc-30bb-4cac-b8f2-4233669475e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.467502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad6220dc-30bb-4cac-b8f2-4233669475e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.473069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad6220dc-30bb-4cac-b8f2-4233669475e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.474073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad6220dc-30bb-4cac-b8f2-4233669475e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.488904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=18 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:38.494372 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d1edac47-0cd8-4f09-8eb9-9739df2ce977 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1813 microversion: 2.1 time: 0.522259 Oct 11 19:45:38.495249 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 503/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:37 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1813 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:38.523387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d7ce8e53-903d-4294-9397-604560345b90 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:38.527629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7ce8e53-903d-4294-9397-604560345b90 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.528324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7ce8e53-903d-4294-9397-604560345b90 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.529500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7ce8e53-903d-4294-9397-604560345b90 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.531010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7ce8e53-903d-4294-9397-604560345b90 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.531659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7ce8e53-903d-4294-9397-604560345b90 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.532373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7ce8e53-903d-4294-9397-604560345b90 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.565547 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d7ce8e53-903d-4294-9397-604560345b90 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.047833 Oct 11 19:45:38.566781 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 504/1037] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 11 19:45:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:45:38.581528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:38.582646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:38.589123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.590200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.590902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.593244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:38.593999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:38.594813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:38.926160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ad6220dc-30bb-4cac-b8f2-4233669475e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:38.945001 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ad6220dc-30bb-4cac-b8f2-4233669475e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 0.521768 Oct 11 19:45:38.945727 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 534/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:38 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:39.029156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:39.042876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:39.050158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:39.051692 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b80ffdae-2cae-4118-8592-6064cf4561a7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1568 microversion: 2.25 time: 0.476572 Oct 11 19:45:39.052883 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 505/1039] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:38 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1568 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:39.435547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:39.437541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] [instance: f392b558-6079-4c4d-88bd-a50aa499dce6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:39.454057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:39.457138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:39.461751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:39.464036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:39.465866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:39.466541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:39.514351 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] HTTP exception thrown: Instance f392b558-6079-4c4d-88bd-a50aa499dce6 could not be found. Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Request method failure captured: Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 HTTP/1.1 Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRccs9sbnuYTCEvs1E8xVkFpmpiKr31XvMnCjLikMyRDwddMOCJ5twa9agvxtxQLsTQRlIfwoM-H4LBkB4LZiYWe1PyGhE1Qc7sNPmCfaJ_2LctQlMWK5k8cSerwgLcsGMQk7PKl7CkU-UnOkIxt3qj2VLbs5fhYxxrZvl2Yv038Rotw Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8be7ff18ac24462858896eaf1e29fbe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8be7ff18ac24462858896eaf1e29fbe"}]}] Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f8be7ff18ac24462858896eaf1e29fbe Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-187173206 Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d473bc95d6ea47978e08f9ceaebf2343 Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersOnMultiNodesTest-187173206-project Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f392b558-6079-4c4d-88bd-a50aa499dce6 could not be found. Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f392b558-6079-4c4d-88bd-a50aa499dce6'} Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f392b558-6079-4c4d-88bd-a50aa499dce6 could not be found. Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f392b558-6079-4c4d-88bd-a50aa499dce6 could not be found. Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:45:39.518563 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:39.523564 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:45:39.523564 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:45:39.523564 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:45:39.523564 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:45:39.523564 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:45:39.523564 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f392b558-6079-4c4d-88bd-a50aa499dce6 could not be found. Oct 11 19:45:39.523564 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:45:39.526840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] Returning 404 to user: Instance f392b558-6079-4c4d-88bd-a50aa499dce6 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:45:39.531159 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2e6855e5-2592-4548-85f0-84a65c01c2dc tempest-ServersOnMultiNodesTest-187173206 tempest-ServersOnMultiNodesTest-187173206-project] 10.222.0.27 "GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6" status: 404 len: 111 microversion: 2.1 time: 0.100706 Oct 11 19:45:39.533272 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 535/1040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:39 2022] GET /compute/v2.1/servers/f392b558-6079-4c4d-88bd-a50aa499dce6 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:45:39.570331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-7128a4cc-e601-41e8-b0f9-499ac5434177 req-899df8a2-44ce-450e-a550-08965bce5a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f392b558-6079-4c4d-88bd-a50aa499dce6", "name": "network-vif-deleted", "tag": "c17e735a-c9a1-4253-b84d-b15594905be3"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:39.578117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:39.596112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7128a4cc-e601-41e8-b0f9-499ac5434177 req-899df8a2-44ce-450e-a550-08965bce5a37 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:39.598047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7128a4cc-e601-41e8-b0f9-499ac5434177 req-899df8a2-44ce-450e-a550-08965bce5a37 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:39.598643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7128a4cc-e601-41e8-b0f9-499ac5434177 req-899df8a2-44ce-450e-a550-08965bce5a37 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:39.634682 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-7128a4cc-e601-41e8-b0f9-499ac5434177 req-899df8a2-44ce-450e-a550-08965bce5a37 service nova] Creating event network-vif-deleted:c17e735a-c9a1-4253-b84d-b15594905be3 for instance f392b558-6079-4c4d-88bd-a50aa499dce6 on n-h2-860864-3 Oct 11 19:45:39.640929 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-7128a4cc-e601-41e8-b0f9-499ac5434177 req-899df8a2-44ce-450e-a550-08965bce5a37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074498 Oct 11 19:45:39.642266 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 506/1041] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:39.975114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3e9fe5cd-bbcb-4b6f-b972-52b541c02918 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:39.976052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3e9fe5cd-bbcb-4b6f-b972-52b541c02918 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:39.987448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e9fe5cd-bbcb-4b6f-b972-52b541c02918 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:39.989873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e9fe5cd-bbcb-4b6f-b972-52b541c02918 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:39.990483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e9fe5cd-bbcb-4b6f-b972-52b541c02918 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:39.993679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e9fe5cd-bbcb-4b6f-b972-52b541c02918 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:39.994392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e9fe5cd-bbcb-4b6f-b972-52b541c02918 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:39.995027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e9fe5cd-bbcb-4b6f-b972-52b541c02918 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:40.079969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:40.090395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:40.104381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:40.105601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:40.108393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:40.111075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:40.114052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:40.115387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:41.013167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3e9fe5cd-bbcb-4b6f-b972-52b541c02918 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:41.027394 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3e9fe5cd-bbcb-4b6f-b972-52b541c02918 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1477 microversion: 2.1 time: 1.057403 Oct 11 19:45:41.042966 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 536/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:39 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1477 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:41.141942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:41.153785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:41.156014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:41.157341 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d4088cc8-4f4f-42fe-9bee-fa47d4bf3233 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1568 microversion: 2.25 time: 1.083622 Oct 11 19:45:41.159650 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 507/1043] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:40 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1568 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:45:41.329806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f587ee31-130d-412c-9103-7c85cb9977c3 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1191193800", "ram": 512, "vcpus": 1, "disk": 10, "id": 1215672108, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:41.377875 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f587ee31-130d-412c-9103-7c85cb9977c3 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.333675 Oct 11 19:45:41.378798 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 537/1044] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:45:41 2022] POST /compute/v2.1/flavors => generated 416 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:41.404445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f888c9d-af63-4829-8da7-d49f105048a5 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:41.479256 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6f888c9d-af63-4829-8da7-d49f105048a5 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1215672108/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080140 Oct 11 19:45:41.487794 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 538/1045] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Oct 11 19:45:41 2022] POST /compute/v2.1/flavors/1215672108/os-extra_specs => generated 66 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:45:41.513415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1678149107", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:41.708300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:45:41.901817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9cdde827-8ea3-48de-b118-7e06237c0e73 tempest-FlavorsExtraSpecsTestJSON-735791958 tempest-FlavorsExtraSpecsTestJSON-735791958-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:41.971594 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9cdde827-8ea3-48de-b118-7e06237c0e73 tempest-FlavorsExtraSpecsTestJSON-735791958 tempest-FlavorsExtraSpecsTestJSON-735791958-project] 10.222.0.27 "GET /compute/v2.1/flavors/1215672108/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.472473 Oct 11 19:45:41.986060 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 539/1046] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 11 19:45:41 2022] GET /compute/v2.1/flavors/1215672108/os-extra_specs => generated 66 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:45:41.996261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-20746f34-b1a1-430f-9fbe-37eef0e909e0 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:42.111661 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-20746f34-b1a1-430f-9fbe-37eef0e909e0 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1215672108/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.112897 Oct 11 19:45:42.120234 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 540/1047] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Oct 11 19:45:41 2022] POST /compute/v2.1/flavors/1215672108/os-extra_specs => generated 66 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:45:42.148407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0ce1e9d6-dcbd-460e-8654-877fe8fcee60 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:42.163372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0ce1e9d6-dcbd-460e-8654-877fe8fcee60 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:42.182908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ce1e9d6-dcbd-460e-8654-877fe8fcee60 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:42.183416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ce1e9d6-dcbd-460e-8654-877fe8fcee60 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:42.183862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ce1e9d6-dcbd-460e-8654-877fe8fcee60 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:42.184656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ce1e9d6-dcbd-460e-8654-877fe8fcee60 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:42.185126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ce1e9d6-dcbd-460e-8654-877fe8fcee60 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:42.185559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ce1e9d6-dcbd-460e-8654-877fe8fcee60 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:42.678121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0ce1e9d6-dcbd-460e-8654-877fe8fcee60 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:42.688390 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0ce1e9d6-dcbd-460e-8654-877fe8fcee60 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1476 microversion: 2.1 time: 0.566576 Oct 11 19:45:42.699345 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 541/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:42 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1476 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:42.711881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-00b5045f-00a9-4d85-8d74-949dc6db7608 tempest-FlavorsExtraSpecsTestJSON-735791958 tempest-FlavorsExtraSpecsTestJSON-735791958-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:42.727298 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-00b5045f-00a9-4d85-8d74-949dc6db7608 tempest-FlavorsExtraSpecsTestJSON-735791958 tempest-FlavorsExtraSpecsTestJSON-735791958-project] 10.222.0.27 "GET /compute/v2.1/flavors/1215672108/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.026561 Oct 11 19:45:42.728808 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 542/1049] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 19:45:42 2022] GET /compute/v2.1/flavors/1215672108/os-extra_specs/hw:numa_nodes => generated 22 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:45:42.744068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:42.744746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:42.757667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:42.758171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:42.758788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:42.759708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:42.760321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:42.761044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:42.801420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:45:42.803956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:45:42.804831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:45:42.806483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:45:42.807378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:45:42.831449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:42.832062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:42.832611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:42.833812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:42.835148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:42.839392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:42.897988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Getting quotas for project 25fb1c12e2fe4e30955c7509e90a2a44. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:42.913344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Getting quotas for user 7c0e5fa825034b299ccdbcb86b0e3d26 and project 25fb1c12e2fe4e30955c7509e90a2a44. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:42.940068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:45:42.950863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:45:43.040401 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9d359fa5-41cb-4d6c-a99b-e19061952b34 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.877414 Oct 11 19:45:43.048242 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 508/1050] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:45:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:45:43.088766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-17ca7c75-542e-4907-8119-b5318dc8295a tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:43.114067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:43.146884 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-17ca7c75-542e-4907-8119-b5318dc8295a tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1215672108/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.103192 Oct 11 19:45:43.148356 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 509/1051] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Oct 11 19:45:43 2022] POST /compute/v2.1/flavors/1215672108/os-extra_specs => generated 66 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:45:43.160962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-01b8a527-d72f-4ff2-bc23-fb5259ff8e08 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fc8d78d-90db-4e5a-85bb-6181d6826e52", "device": "/dev/xvdb"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:43.166368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-01b8a527-d72f-4ff2-bc23-fb5259ff8e08 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:43.177086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01b8a527-d72f-4ff2-bc23-fb5259ff8e08 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:43.178148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01b8a527-d72f-4ff2-bc23-fb5259ff8e08 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:43.179266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01b8a527-d72f-4ff2-bc23-fb5259ff8e08 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:43.180556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01b8a527-d72f-4ff2-bc23-fb5259ff8e08 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:43.187290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01b8a527-d72f-4ff2-bc23-fb5259ff8e08 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:43.188435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01b8a527-d72f-4ff2-bc23-fb5259ff8e08 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:43.275628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:43.293203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:43.295751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:43.300859 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-897dbff8-b284-4404-8ecf-d2c057761a82 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1568 microversion: 2.25 time: 0.570765 Oct 11 19:45:43.311866 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 543/1052] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:42 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1568 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:43.336022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3d8f1b51-5022-400a-b36c-f996dd20a5df tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:43.336844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3d8f1b51-5022-400a-b36c-f996dd20a5df tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:43.589670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3d8f1b51-5022-400a-b36c-f996dd20a5df tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:43.609884 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3d8f1b51-5022-400a-b36c-f996dd20a5df tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1222 microversion: 2.1 time: 0.285245 Oct 11 19:45:43.613021 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 544/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:43 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:43.630225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-22b1ac7a-503a-4f2a-95c2-e67a505dfa6b tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:43.650191 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-22b1ac7a-503a-4f2a-95c2-e67a505dfa6b tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1215672108/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035850 Oct 11 19:45:43.655980 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 545/1054] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 11 19:45:43 2022] GET /compute/v2.1/flavors/1215672108/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:45:43.658127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:43.664507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b5842ad1-dbf0-4779-8d80-82030674d59b req-2727cc54-c76d-4100-bc5d-b0c0293602fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee854-d900-44e9-8d2f-a34305c016ea", "name": "network-vif-unplugged", "status": "completed", "tag": "bf229230-440b-48f9-9914-92cff8501f97"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:43.692273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b5842ad1-dbf0-4779-8d80-82030674d59b req-2727cc54-c76d-4100-bc5d-b0c0293602fe service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:43.693347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b5842ad1-dbf0-4779-8d80-82030674d59b req-2727cc54-c76d-4100-bc5d-b0c0293602fe service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:43.696806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b5842ad1-dbf0-4779-8d80-82030674d59b req-2727cc54-c76d-4100-bc5d-b0c0293602fe service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:43.725583 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b5842ad1-dbf0-4779-8d80-82030674d59b req-2727cc54-c76d-4100-bc5d-b0c0293602fe service nova] Creating event network-vif-unplugged:bf229230-440b-48f9-9914-92cff8501f97 for instance 35dee854-d900-44e9-8d2f-a34305c016ea on n-h2-860864-3 Oct 11 19:45:43.742138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-b5842ad1-dbf0-4779-8d80-82030674d59b req-2727cc54-c76d-4100-bc5d-b0c0293602fe service nova] Instance 35dee854-d900-44e9-8d2f-a34305c016ea is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:45:43.782831 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b5842ad1-dbf0-4779-8d80-82030674d59b req-2727cc54-c76d-4100-bc5d-b0c0293602fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125001 Oct 11 19:45:43.785972 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 546/1055] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:43.793268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5014ead-919e-43a7-9bf0-c1b63126607c tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:43.905826 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-01b8a527-d72f-4ff2-bc23-fb5259ff8e08 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "POST /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752709 Oct 11 19:45:43.910863 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 510/1056] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 19:45:43 2022] POST /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:43.912591 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f5014ead-919e-43a7-9bf0-c1b63126607c tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1215672108/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.122603 Oct 11 19:45:43.913616 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 547/1057] 10.222.0.27 () {60 vars in 1265 bytes} [Tue Oct 11 19:45:43 2022] PUT /compute/v2.1/flavors/1215672108/os-extra_specs/hw:numa_nodes => generated 22 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:45:43.929391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe802384-c28b-46ea-916e-3e9a71de49a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:43.931964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fe802384-c28b-46ea-916e-3e9a71de49a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:43.963241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe802384-c28b-46ea-916e-3e9a71de49a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:43.965392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe802384-c28b-46ea-916e-3e9a71de49a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:43.968040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe802384-c28b-46ea-916e-3e9a71de49a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:43.969118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe802384-c28b-46ea-916e-3e9a71de49a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:43.977083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe802384-c28b-46ea-916e-3e9a71de49a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:43.978731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe802384-c28b-46ea-916e-3e9a71de49a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:44.597835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe802384-c28b-46ea-916e-3e9a71de49a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:44.601320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-246139764", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "50a85b7f-a8bb-479c-b121-72e05795de50"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:44.608402 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fe802384-c28b-46ea-916e-3e9a71de49a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1476 microversion: 2.1 time: 0.695992 Oct 11 19:45:44.609371 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 511/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:43 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1476 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:44.614993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4361d0c6-2ae7-451f-8411-6432676265e1 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:44.633725 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4361d0c6-2ae7-451f-8411-6432676265e1 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1215672108/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022705 Oct 11 19:45:44.635683 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 512/1059] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 11 19:45:44 2022] GET /compute/v2.1/flavors/1215672108/os-extra_specs => generated 66 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:45:44.649316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:44.651333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:44.668998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:44.669708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:44.670409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:44.671389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:44.672045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:44.672665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:44.688241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:44.735739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] validate_networks() for [('50a85b7f-a8bb-479c-b121-72e05795de50', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:45:45.247723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:45.267699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:45.279465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:45.281586 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-669715b2-40da-46b0-b136-f374c688cbaf tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1568 microversion: 2.25 time: 0.644511 Oct 11 19:45:45.297554 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 513/1060] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:44 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1568 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:45.297554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-74cfb983-d7ba-48f6-bd72-af0c5e9d6596 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:45.297554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-74cfb983-d7ba-48f6-bd72-af0c5e9d6596 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:45.312305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74cfb983-d7ba-48f6-bd72-af0c5e9d6596 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:45.312984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74cfb983-d7ba-48f6-bd72-af0c5e9d6596 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:45.313528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74cfb983-d7ba-48f6-bd72-af0c5e9d6596 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:45.314365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74cfb983-d7ba-48f6-bd72-af0c5e9d6596 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:45.314987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74cfb983-d7ba-48f6-bd72-af0c5e9d6596 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:45.315522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74cfb983-d7ba-48f6-bd72-af0c5e9d6596 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:45.527579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-74cfb983-d7ba-48f6-bd72-af0c5e9d6596 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:45.544623 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-74cfb983-d7ba-48f6-bd72-af0c5e9d6596 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1274 microversion: 2.1 time: 0.260628 Oct 11 19:45:45.546945 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 514/1061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:45 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:45.554337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6f416eae-0341-4685-af66-ce9a1f2ff6b9 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:45.664011 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6f416eae-0341-4685-af66-ce9a1f2ff6b9 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1215672108/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.114582 Oct 11 19:45:45.666555 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 515/1062] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 19:45:45 2022] DELETE /compute/v2.1/flavors/1215672108/os-extra_specs/hw:numa_nodes => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:45:45.688915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5357b82d-a60e-478c-a1c3-9ba1d93fef66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:45.694624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5357b82d-a60e-478c-a1c3-9ba1d93fef66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:45.723883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5357b82d-a60e-478c-a1c3-9ba1d93fef66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:45.726581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5357b82d-a60e-478c-a1c3-9ba1d93fef66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:45.727265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5357b82d-a60e-478c-a1c3-9ba1d93fef66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:45.730460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5357b82d-a60e-478c-a1c3-9ba1d93fef66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:45.734636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5357b82d-a60e-478c-a1c3-9ba1d93fef66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:45.736374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5357b82d-a60e-478c-a1c3-9ba1d93fef66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:46.187321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:45:46.187934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:45:46.188687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:45:46.189134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:45:46.189862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:45:46.210397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:46.215046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:46.220883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:46.222142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:46.224713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:46.225312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:46.297060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:46.320273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for user 8494488a13a3496eb59a8062479816bc and project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:46.378694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:45:46.385297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:45:46.509543 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d93bc9aa-b346-4d0d-86ed-5693ec4eba4e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.592981 Oct 11 19:45:46.511272 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 548/1063] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:45:46.526694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8753da24-5a19-48cb-8ed6-8cc60a078b36 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:46.617517 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8753da24-5a19-48cb-8ed6-8cc60a078b36 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1215672108/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.095232 Oct 11 19:45:46.626766 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 549/1064] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 19:45:46 2022] DELETE /compute/v2.1/flavors/1215672108/os-extra_specs/hw:cpu_policy => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 19:45:46.645844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-dd0d5507-9c59-4f26-9a99-671d392dfb8f req-38a6786f-3e38-4b2f-aa25-cd43d09466ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dee854-d900-44e9-8d2f-a34305c016ea", "tag": "bf229230-440b-48f9-9914-92cff8501f97"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:46.675761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dd0d5507-9c59-4f26-9a99-671d392dfb8f req-38a6786f-3e38-4b2f-aa25-cd43d09466ee service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:46.680833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dd0d5507-9c59-4f26-9a99-671d392dfb8f req-38a6786f-3e38-4b2f-aa25-cd43d09466ee service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:46.687265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dd0d5507-9c59-4f26-9a99-671d392dfb8f req-38a6786f-3e38-4b2f-aa25-cd43d09466ee service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:46.731736 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-dd0d5507-9c59-4f26-9a99-671d392dfb8f req-38a6786f-3e38-4b2f-aa25-cd43d09466ee service nova] Creating event network-changed:bf229230-440b-48f9-9914-92cff8501f97 for instance 35dee854-d900-44e9-8d2f-a34305c016ea on n-h2-860864-3 Oct 11 19:45:46.747993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-dd0d5507-9c59-4f26-9a99-671d392dfb8f req-38a6786f-3e38-4b2f-aa25-cd43d09466ee service nova] Instance 35dee854-d900-44e9-8d2f-a34305c016ea is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:45:46.781206 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-dd0d5507-9c59-4f26-9a99-671d392dfb8f req-38a6786f-3e38-4b2f-aa25-cd43d09466ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146093 Oct 11 19:45:46.782432 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 550/1065] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:46.788593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:46.799227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:46.819569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:46.820140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:46.823862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:46.824944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:46.827287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:46.829269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:46.875350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5357b82d-a60e-478c-a1c3-9ba1d93fef66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:46.890274 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5357b82d-a60e-478c-a1c3-9ba1d93fef66 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1476 microversion: 2.1 time: 1.220582 Oct 11 19:45:46.898764 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 516/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:45 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1476 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:46.923164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-35b9744c-ebee-4cfc-b115-6c90d88de7cc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:46.928556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-35b9744c-ebee-4cfc-b115-6c90d88de7cc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:47.604788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35b9744c-ebee-4cfc-b115-6c90d88de7cc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:47.613630 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-35b9744c-ebee-4cfc-b115-6c90d88de7cc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1214 microversion: 2.1 time: 0.713465 Oct 11 19:45:47.624489 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 517/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:46 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1214 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:47.639580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-475f0cc5-fa47-46d2-a99e-3e78ce853b32 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:47.640479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-475f0cc5-fa47-46d2-a99e-3e78ce853b32 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:47.652230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-475f0cc5-fa47-46d2-a99e-3e78ce853b32 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:47.655632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-475f0cc5-fa47-46d2-a99e-3e78ce853b32 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:47.657560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-475f0cc5-fa47-46d2-a99e-3e78ce853b32 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:47.661214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-475f0cc5-fa47-46d2-a99e-3e78ce853b32 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:47.662069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-475f0cc5-fa47-46d2-a99e-3e78ce853b32 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:47.662879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-475f0cc5-fa47-46d2-a99e-3e78ce853b32 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:47.955715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:47.978449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:47.980433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:47.985979 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c7b83cc1-2e12-4295-b1f2-46079127a823 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1543 microversion: 2.25 time: 1.201090 Oct 11 19:45:47.989837 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 551/1068] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:46 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1543 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:48.003911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c488e57e-3682-4d0c-8e95-9a25466ebf81 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:48.039511 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c488e57e-3682-4d0c-8e95-9a25466ebf81 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1215672108/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.047285 Oct 11 19:45:48.042092 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 552/1069] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 11 19:45:47 2022] GET /compute/v2.1/flavors/1215672108/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:45:48.311308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-475f0cc5-fa47-46d2-a99e-3e78ce853b32 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:48.323946 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-475f0cc5-fa47-46d2-a99e-3e78ce853b32 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1322 microversion: 2.1 time: 0.698096 Oct 11 19:45:48.335610 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 518/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:47 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1322 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:48.356010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d5b6bb57-ed2d-4999-b775-93068e0afe42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:48.356881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d5b6bb57-ed2d-4999-b775-93068e0afe42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:48.362690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-2049702941", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": "none"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:48.381013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5b6bb57-ed2d-4999-b775-93068e0afe42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:48.381832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5b6bb57-ed2d-4999-b775-93068e0afe42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:48.383057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5b6bb57-ed2d-4999-b775-93068e0afe42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:48.385807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5b6bb57-ed2d-4999-b775-93068e0afe42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:48.386578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5b6bb57-ed2d-4999-b775-93068e0afe42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:48.388052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5b6bb57-ed2d-4999-b775-93068e0afe42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:48.493621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:45:48.494671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:45:48.496253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:45:48.499555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:45:48.500135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:45:48.519145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:48.522295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:48.522899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:48.525373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:48.525969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:48.539699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:48.564902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Getting quotas for project d56e6a2a33df4160b8835bd8975186ea. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:48.571826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Getting quotas for user 644423219a0a496e9ec83ec1d8f2a8b4 and project d56e6a2a33df4160b8835bd8975186ea. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:48.605656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:45:48.608297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:45:48.716612 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-90699fa1-4162-4e70-9cfb-a0b09f69f836 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.673084 Oct 11 19:45:48.725057 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 553/1071] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:45:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 19:45:48.731826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6505f211-e214-4dd9-bd9b-7ae635134639 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '.version_select at 0x7f83cc381a60>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:48.747832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6505f211-e214-4dd9-bd9b-7ae635134639 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:48.761358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6505f211-e214-4dd9-bd9b-7ae635134639 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:48.762732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6505f211-e214-4dd9-bd9b-7ae635134639 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:48.792616 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6505f211-e214-4dd9-bd9b-7ae635134639 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2784 microversion: 2.25 time: 0.062938 Oct 11 19:45:48.794444 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 554/1072] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Oct 11 19:45:48 2022] GET /compute/v2.1/os-migrations => generated 2784 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:48.809873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f484c751-8cb2-4a71-9675-694bb9a95465 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:48.850360 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f484c751-8cb2-4a71-9675-694bb9a95465 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1215672108" status: 202 len: 0 microversion: 2.1 time: 0.053265 Oct 11 19:45:48.851765 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 555/1073] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:45:48 2022] DELETE /compute/v2.1/flavors/1215672108 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:45:48.859588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-02ad88fc-2140-432f-baa7-2d41cce2b1f2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:48.860933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-02ad88fc-2140-432f-baa7-2d41cce2b1f2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:48.875786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02ad88fc-2140-432f-baa7-2d41cce2b1f2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:48.879556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02ad88fc-2140-432f-baa7-2d41cce2b1f2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:48.883078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d5b6bb57-ed2d-4999-b775-93068e0afe42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:48.883688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02ad88fc-2140-432f-baa7-2d41cce2b1f2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:48.884559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02ad88fc-2140-432f-baa7-2d41cce2b1f2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:48.885150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02ad88fc-2140-432f-baa7-2d41cce2b1f2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:48.885689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02ad88fc-2140-432f-baa7-2d41cce2b1f2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:48.895229 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d5b6bb57-ed2d-4999-b775-93068e0afe42 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1471 microversion: 2.1 time: 0.553787 Oct 11 19:45:48.913494 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 519/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:48 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1471 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:48.936060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a795b93-1908-4257-8fe6-170159b861a9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:48.939097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5a795b93-1908-4257-8fe6-170159b861a9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:49.157169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-02ad88fc-2140-432f-baa7-2d41cce2b1f2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:49.171557 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-02ad88fc-2140-432f-baa7-2d41cce2b1f2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1210 microversion: 2.1 time: 0.318093 Oct 11 19:45:49.172158 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 556/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:48 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1210 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:49.193765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-152e8659-982a-4ef4-8061-4f480dff72f7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:49.194439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-152e8659-982a-4ef4-8061-4f480dff72f7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:49.217341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152e8659-982a-4ef4-8061-4f480dff72f7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:49.224921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152e8659-982a-4ef4-8061-4f480dff72f7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:49.225602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152e8659-982a-4ef4-8061-4f480dff72f7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:49.226617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152e8659-982a-4ef4-8061-4f480dff72f7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:49.227278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152e8659-982a-4ef4-8061-4f480dff72f7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:49.227401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a795b93-1908-4257-8fe6-170159b861a9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:49.228024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152e8659-982a-4ef4-8061-4f480dff72f7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:49.236867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a795b93-1908-4257-8fe6-170159b861a9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:49.238327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a795b93-1908-4257-8fe6-170159b861a9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:49.307212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a795b93-1908-4257-8fe6-170159b861a9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1454 microversion: 2.91 time: 0.391402 Oct 11 19:45:49.311914 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 520/1076] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:48 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1454 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:49.349263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0db52534-0e71-4e32-a46a-42eb5a92fad6 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:49.409875 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0db52534-0e71-4e32-a46a-42eb5a92fad6 tempest-FlavorsExtraSpecsTestJSON-771944259 tempest-FlavorsExtraSpecsTestJSON-771944259-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059902 Oct 11 19:45:49.413508 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 521/1077] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:45:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:49.447562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bdce4e51-73de-40df-a6ec-9afcce3774a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:49.448147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bdce4e51-73de-40df-a6ec-9afcce3774a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:49.481990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdce4e51-73de-40df-a6ec-9afcce3774a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:49.483283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdce4e51-73de-40df-a6ec-9afcce3774a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:49.483870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdce4e51-73de-40df-a6ec-9afcce3774a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:49.484731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdce4e51-73de-40df-a6ec-9afcce3774a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:49.485340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdce4e51-73de-40df-a6ec-9afcce3774a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:49.485912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdce4e51-73de-40df-a6ec-9afcce3774a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:49.675653 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bdce4e51-73de-40df-a6ec-9afcce3774a8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea/action" status: 204 len: 0 microversion: 2.1 time: 0.260656 Oct 11 19:45:49.679379 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 522/1078] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:45:49 2022] POST /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea/action => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:49.688885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-94320310-1f24-48d0-94a4-28eefab01cdb tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:49.689589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-94320310-1f24-48d0-94a4-28eefab01cdb tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:49.718854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94320310-1f24-48d0-94a4-28eefab01cdb tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:49.719365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94320310-1f24-48d0-94a4-28eefab01cdb tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:49.719809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94320310-1f24-48d0-94a4-28eefab01cdb tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:49.731285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94320310-1f24-48d0-94a4-28eefab01cdb tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:49.731844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94320310-1f24-48d0-94a4-28eefab01cdb tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:49.737281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94320310-1f24-48d0-94a4-28eefab01cdb tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:50.037954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-152e8659-982a-4ef4-8061-4f480dff72f7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid 2e6fb34e-c435-436b-905d-3898c72acc34 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:50.113282 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-152e8659-982a-4ef4-8061-4f480dff72f7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 2036 microversion: 2.25 time: 0.935088 Oct 11 19:45:50.115889 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 557/1079] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:49 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 2036 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:50.131244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5c0ee68-46e9-4d0f-b547-46ed3f4f8ec5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:50.132340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f5c0ee68-46e9-4d0f-b547-46ed3f4f8ec5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:50.158283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c0ee68-46e9-4d0f-b547-46ed3f4f8ec5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:50.163759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c0ee68-46e9-4d0f-b547-46ed3f4f8ec5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:50.164994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c0ee68-46e9-4d0f-b547-46ed3f4f8ec5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:50.168140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c0ee68-46e9-4d0f-b547-46ed3f4f8ec5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:50.169035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c0ee68-46e9-4d0f-b547-46ed3f4f8ec5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:50.172610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5c0ee68-46e9-4d0f-b547-46ed3f4f8ec5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:51.028720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-94320310-1f24-48d0-94a4-28eefab01cdb tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:51.046094 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-94320310-1f24-48d0-94a4-28eefab01cdb tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1322 microversion: 2.1 time: 1.363959 Oct 11 19:45:51.047275 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 523/1080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:49 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1322 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:51.052454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7750375f-a181-469c-9da2-5ad8f055eb0b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Action: 'create', calling method: .version_select at 0x7f83cc9f2160>, body: {"keypair": {"name": "tempest-keypair-453764179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME6GKV81uDZjnbmzydnY//raBj970VTLvh/2q+3bpHFxDFhriNZeNj9T4xGNXyaebNGoR4InDpWhG6SnIz+2IE9pYXu9+HgNgnyBF4Ve6TTsy/jORm8PDaqh5p8mdTALw=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:51.093840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7750375f-a181-469c-9da2-5ad8f055eb0b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Getting quotas for project 0ac923f5632e40b2bd81aa5de2ed3f5a. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:51.110371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7750375f-a181-469c-9da2-5ad8f055eb0b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Getting quotas for user 823a414535d04791844ab997869542b2 and project 0ac923f5632e40b2bd81aa5de2ed3f5a. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:51.160872 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7750375f-a181-469c-9da2-5ad8f055eb0b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.112420 Oct 11 19:45:51.162178 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 524/1081] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 11 19:45:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 19:45:51.167222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1bb759c-898f-4f83-a4b1-4f181726062d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:51.168634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e1bb759c-898f-4f83-a4b1-4f181726062d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:51.177010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1bb759c-898f-4f83-a4b1-4f181726062d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:51.178798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1bb759c-898f-4f83-a4b1-4f181726062d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:51.179499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1bb759c-898f-4f83-a4b1-4f181726062d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:51.180552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1bb759c-898f-4f83-a4b1-4f181726062d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:51.181386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1bb759c-898f-4f83-a4b1-4f181726062d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:51.182037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1bb759c-898f-4f83-a4b1-4f181726062d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:51.340739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f5c0ee68-46e9-4d0f-b547-46ed3f4f8ec5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:51.351213 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f5c0ee68-46e9-4d0f-b547-46ed3f4f8ec5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1471 microversion: 2.1 time: 1.234020 Oct 11 19:45:51.351808 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 558/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:50 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1471 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:51.363733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:51.364272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:51.370001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e1bb759c-898f-4f83-a4b1-4f181726062d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:51.380742 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e1bb759c-898f-4f83-a4b1-4f181726062d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1272 microversion: 2.1 time: 0.217243 Oct 11 19:45:51.386917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:51.387419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:51.387867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:51.388335 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 525/1083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:51 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:51.415782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:51.416303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:51.416751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:51.976070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:51.988070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:52.002564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:52.009434 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-30b385b0-1c76-4060-80f2-1f9951ca59a4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1514 microversion: 2.91 time: 0.648642 Oct 11 19:45:52.010046 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 559/1084] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:51 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1514 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:52.074126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-68873516-6e94-43ff-a224-817ff3ae7d8a tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:52.074805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68873516-6e94-43ff-a224-817ff3ae7d8a tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:52.086234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68873516-6e94-43ff-a224-817ff3ae7d8a tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:52.086383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68873516-6e94-43ff-a224-817ff3ae7d8a tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:52.086844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68873516-6e94-43ff-a224-817ff3ae7d8a tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:52.087541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68873516-6e94-43ff-a224-817ff3ae7d8a tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:52.087991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68873516-6e94-43ff-a224-817ff3ae7d8a tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:52.088410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68873516-6e94-43ff-a224-817ff3ae7d8a tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:52.381557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-95bc8a48-bb7e-4f66-ac72-bd7c9be1e006 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:52.382181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-95bc8a48-bb7e-4f66-ac72-bd7c9be1e006 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:52.389304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95bc8a48-bb7e-4f66-ac72-bd7c9be1e006 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:52.389810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95bc8a48-bb7e-4f66-ac72-bd7c9be1e006 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:52.390251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95bc8a48-bb7e-4f66-ac72-bd7c9be1e006 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:52.391040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95bc8a48-bb7e-4f66-ac72-bd7c9be1e006 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:52.391504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95bc8a48-bb7e-4f66-ac72-bd7c9be1e006 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:52.397212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95bc8a48-bb7e-4f66-ac72-bd7c9be1e006 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:52.870230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:53.535305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68873516-6e94-43ff-a224-817ff3ae7d8a tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:53.556238 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-68873516-6e94-43ff-a224-817ff3ae7d8a tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1322 microversion: 2.1 time: 1.485080 Oct 11 19:45:53.558510 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 526/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:52 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1322 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:53.586820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6bac0bae-a8bf-4a39-bdb0-25b2af7a76ec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:53.589238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6bac0bae-a8bf-4a39-bdb0-25b2af7a76ec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:53.602165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6bac0bae-a8bf-4a39-bdb0-25b2af7a76ec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:53.602885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6bac0bae-a8bf-4a39-bdb0-25b2af7a76ec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:53.603488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6bac0bae-a8bf-4a39-bdb0-25b2af7a76ec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:53.604773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6bac0bae-a8bf-4a39-bdb0-25b2af7a76ec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:53.606171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6bac0bae-a8bf-4a39-bdb0-25b2af7a76ec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:53.608256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6bac0bae-a8bf-4a39-bdb0-25b2af7a76ec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:53.865492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-95bc8a48-bb7e-4f66-ac72-bd7c9be1e006 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:53.870116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:53.886232 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-95bc8a48-bb7e-4f66-ac72-bd7c9be1e006 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1471 microversion: 2.1 time: 1.509153 Oct 11 19:45:53.886876 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 560/1086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:52 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1471 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:53.898779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:53.899391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:53.907048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6bac0bae-a8bf-4a39-bdb0-25b2af7a76ec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:53.908369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:53.909047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:53.909856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:53.911701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:53.912309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:53.912887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:53.916122 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6bac0bae-a8bf-4a39-bdb0-25b2af7a76ec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1272 microversion: 2.1 time: 0.347249 Oct 11 19:45:53.921305 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 527/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:53 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1272 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:53.933879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1ad1a100-33fa-475b-919b-4fb159e12fd4 req-7ac2f077-3251-43c2-8336-16f3627c7596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8bc215-3672-4c18-9441-8479acacc17d", "tag": "bf375cd3-0aab-4777-97b4-8ceb299e7800"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:53.950882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1ad1a100-33fa-475b-919b-4fb159e12fd4 req-7ac2f077-3251-43c2-8336-16f3627c7596 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:53.955532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1ad1a100-33fa-475b-919b-4fb159e12fd4 req-7ac2f077-3251-43c2-8336-16f3627c7596 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:53.960835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1ad1a100-33fa-475b-919b-4fb159e12fd4 req-7ac2f077-3251-43c2-8336-16f3627c7596 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:53.974275 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1ad1a100-33fa-475b-919b-4fb159e12fd4 req-7ac2f077-3251-43c2-8336-16f3627c7596 service nova] Creating event network-changed:bf375cd3-0aab-4777-97b4-8ceb299e7800 for instance ba8bc215-3672-4c18-9441-8479acacc17d on n-h1-860864-3 Oct 11 19:45:53.979827 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1ad1a100-33fa-475b-919b-4fb159e12fd4 req-7ac2f077-3251-43c2-8336-16f3627c7596 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056918 Oct 11 19:45:53.980787 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 528/1088] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:53.986880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c2b014b4-2974-4cb1-924a-fc2e296b6db0 req-848b987e-c927-4763-a1da-d549cd91dee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee854-d900-44e9-8d2f-a34305c016ea", "name": "network-vif-plugged", "status": "completed", "tag": "bf229230-440b-48f9-9914-92cff8501f97"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:53.998888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c2b014b4-2974-4cb1-924a-fc2e296b6db0 req-848b987e-c927-4763-a1da-d549cd91dee0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:53.999715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c2b014b4-2974-4cb1-924a-fc2e296b6db0 req-848b987e-c927-4763-a1da-d549cd91dee0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:54.000383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c2b014b4-2974-4cb1-924a-fc2e296b6db0 req-848b987e-c927-4763-a1da-d549cd91dee0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:54.014808 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c2b014b4-2974-4cb1-924a-fc2e296b6db0 req-848b987e-c927-4763-a1da-d549cd91dee0 service nova] Creating event network-vif-plugged:bf229230-440b-48f9-9914-92cff8501f97 for instance 35dee854-d900-44e9-8d2f-a34305c016ea on n-h2-860864-3 Oct 11 19:45:54.022020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-c2b014b4-2974-4cb1-924a-fc2e296b6db0 req-848b987e-c927-4763-a1da-d549cd91dee0 service nova] Instance 35dee854-d900-44e9-8d2f-a34305c016ea is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:45:54.043016 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c2b014b4-2974-4cb1-924a-fc2e296b6db0 req-848b987e-c927-4763-a1da-d549cd91dee0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060477 Oct 11 19:45:54.044680 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 529/1089] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:54.082807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:54.092029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:54.093751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:54.099930 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-875cb06c-3461-4929-bab9-f04aa1a79c6c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1512 microversion: 2.91 time: 0.211787 Oct 11 19:45:54.101202 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 561/1090] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:53 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:54.583024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b43d1737-27e1-4cbf-8dd3-126d32c2dca1 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:54.584431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b43d1737-27e1-4cbf-8dd3-126d32c2dca1 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:54.590736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b43d1737-27e1-4cbf-8dd3-126d32c2dca1 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:54.592156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b43d1737-27e1-4cbf-8dd3-126d32c2dca1 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:54.592788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b43d1737-27e1-4cbf-8dd3-126d32c2dca1 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:54.593663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b43d1737-27e1-4cbf-8dd3-126d32c2dca1 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:54.594288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b43d1737-27e1-4cbf-8dd3-126d32c2dca1 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:54.594920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b43d1737-27e1-4cbf-8dd3-126d32c2dca1 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:54.841241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b43d1737-27e1-4cbf-8dd3-126d32c2dca1 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:54.853488 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b43d1737-27e1-4cbf-8dd3-126d32c2dca1 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1322 microversion: 2.1 time: 0.275676 Oct 11 19:45:54.856435 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 530/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:54 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:54.917359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e3baf01-0e28-4747-a480-5a466d33fcae tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:54.918138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9e3baf01-0e28-4747-a480-5a466d33fcae tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:54.931208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e3baf01-0e28-4747-a480-5a466d33fcae tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:54.934379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e3baf01-0e28-4747-a480-5a466d33fcae tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:54.935433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e3baf01-0e28-4747-a480-5a466d33fcae tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:54.936331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e3baf01-0e28-4747-a480-5a466d33fcae tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:54.937389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e3baf01-0e28-4747-a480-5a466d33fcae tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:54.939835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e3baf01-0e28-4747-a480-5a466d33fcae tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:54.947631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa8efff5-6ba7-4dff-a9e9-555607c29920 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:54.948344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa8efff5-6ba7-4dff-a9e9-555607c29920 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:54.958693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8efff5-6ba7-4dff-a9e9-555607c29920 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:54.969306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8efff5-6ba7-4dff-a9e9-555607c29920 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:54.970125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8efff5-6ba7-4dff-a9e9-555607c29920 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:54.971201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8efff5-6ba7-4dff-a9e9-555607c29920 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:54.975071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8efff5-6ba7-4dff-a9e9-555607c29920 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:54.975702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8efff5-6ba7-4dff-a9e9-555607c29920 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:55.594365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa8efff5-6ba7-4dff-a9e9-555607c29920 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:55.617009 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa8efff5-6ba7-4dff-a9e9-555607c29920 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1314 microversion: 2.1 time: 0.666976 Oct 11 19:45:55.622073 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 531/1092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:54 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:55.627241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9e3baf01-0e28-4747-a480-5a466d33fcae tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:55.636655 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9e3baf01-0e28-4747-a480-5a466d33fcae tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1471 microversion: 2.1 time: 0.724035 Oct 11 19:45:55.642443 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 562/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:54 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1471 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:55.661093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:55.665589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:55.689126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:55.693316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:55.695631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:55.699739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:55.701956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:55.705591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:55.877259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51a170d6-f2db-4179-b01d-8554f5586a53 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:55.877857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51a170d6-f2db-4179-b01d-8554f5586a53 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:55.891466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51a170d6-f2db-4179-b01d-8554f5586a53 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:55.891970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51a170d6-f2db-4179-b01d-8554f5586a53 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:55.892414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51a170d6-f2db-4179-b01d-8554f5586a53 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:55.893121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51a170d6-f2db-4179-b01d-8554f5586a53 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:55.894452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51a170d6-f2db-4179-b01d-8554f5586a53 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:55.894830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51a170d6-f2db-4179-b01d-8554f5586a53 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:56.033402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:56.046862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:56.048546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:56.058605 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-94310165-6182-4016-b7db-e78a819bf6ea tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1533 microversion: 2.91 time: 0.432277 Oct 11 19:45:56.059136 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 532/1094] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:55 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1533 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:56.390894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51a170d6-f2db-4179-b01d-8554f5586a53 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:56.416791 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51a170d6-f2db-4179-b01d-8554f5586a53 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1322 microversion: 2.1 time: 0.543231 Oct 11 19:45:56.417378 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 563/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:55 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1322 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:45:56.621475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-460e3ce7-b948-492f-8d7e-d4543955e850 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:56.623544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-460e3ce7-b948-492f-8d7e-d4543955e850 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:56.636614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-460e3ce7-b948-492f-8d7e-d4543955e850 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:56.637760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-460e3ce7-b948-492f-8d7e-d4543955e850 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:56.638639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-460e3ce7-b948-492f-8d7e-d4543955e850 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:56.639616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-460e3ce7-b948-492f-8d7e-d4543955e850 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:56.640084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-460e3ce7-b948-492f-8d7e-d4543955e850 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:56.640507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-460e3ce7-b948-492f-8d7e-d4543955e850 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:56.644668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0afd8088-d07c-43c0-8122-3563466117a3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:56.645612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0afd8088-d07c-43c0-8122-3563466117a3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:56.653128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0afd8088-d07c-43c0-8122-3563466117a3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:56.663239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0afd8088-d07c-43c0-8122-3563466117a3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:56.667121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0afd8088-d07c-43c0-8122-3563466117a3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:56.670460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0afd8088-d07c-43c0-8122-3563466117a3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:56.670978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0afd8088-d07c-43c0-8122-3563466117a3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:56.671382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0afd8088-d07c-43c0-8122-3563466117a3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:56.857638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-460e3ce7-b948-492f-8d7e-d4543955e850 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lazy-loading 'services' on Instance uuid f30bdfac-1c61-4f61-876d-0922853f40c0 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:56.883266 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-460e3ce7-b948-492f-8d7e-d4543955e850 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1938 microversion: 2.91 time: 0.796177 Oct 11 19:45:56.885570 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 533/1096] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:56 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1938 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:56.891142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba92d475-5287-4d9a-a9f6-7443fced88f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:56.891863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba92d475-5287-4d9a-a9f6-7443fced88f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:56.910206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba92d475-5287-4d9a-a9f6-7443fced88f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:56.910744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba92d475-5287-4d9a-a9f6-7443fced88f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:56.912929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba92d475-5287-4d9a-a9f6-7443fced88f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:56.913671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba92d475-5287-4d9a-a9f6-7443fced88f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:56.914763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba92d475-5287-4d9a-a9f6-7443fced88f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:56.916262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba92d475-5287-4d9a-a9f6-7443fced88f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:56.924575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:57.097755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0afd8088-d07c-43c0-8122-3563466117a3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:57.106028 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0afd8088-d07c-43c0-8122-3563466117a3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1314 microversion: 2.1 time: 0.465080 Oct 11 19:45:57.121876 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 564/1097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:56 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:57.121876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1626c90d-8f4c-4407-94c4-76fe891450cb tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:57.121876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1626c90d-8f4c-4407-94c4-76fe891450cb tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:57.121876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1626c90d-8f4c-4407-94c4-76fe891450cb tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:57.121876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1626c90d-8f4c-4407-94c4-76fe891450cb tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:57.121876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1626c90d-8f4c-4407-94c4-76fe891450cb tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:57.121876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1626c90d-8f4c-4407-94c4-76fe891450cb tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:57.121876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1626c90d-8f4c-4407-94c4-76fe891450cb tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:57.121876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1626c90d-8f4c-4407-94c4-76fe891450cb tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:57.302969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-1626c90d-8f4c-4407-94c4-76fe891450cb tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lazy-loading 'services' on Instance uuid f30bdfac-1c61-4f61-876d-0922853f40c0 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:57.322179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba92d475-5287-4d9a-a9f6-7443fced88f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:57.331404 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba92d475-5287-4d9a-a9f6-7443fced88f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1463 microversion: 2.1 time: 0.444635 Oct 11 19:45:57.334622 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 534/1098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:56 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1463 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:57.339519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1083386845", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "80479427-085a-4dd2-8698-782034cdbfac"}], "security_groups": [{"name": "tempest-securitygroup--401852701"}], "key_name": "tempest-keypair-453764179", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:57.352715 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1626c90d-8f4c-4407-94c4-76fe891450cb tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1938 microversion: 2.91 time: 0.244138 Oct 11 19:45:57.364879 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 565/1099] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:57 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1938 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:57.380631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-072eb98d-0683-48e6-b76b-383c3a086969 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:57.381244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-072eb98d-0683-48e6-b76b-383c3a086969 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:57.389917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-072eb98d-0683-48e6-b76b-383c3a086969 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:57.390417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-072eb98d-0683-48e6-b76b-383c3a086969 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:57.390879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-072eb98d-0683-48e6-b76b-383c3a086969 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:57.397891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-072eb98d-0683-48e6-b76b-383c3a086969 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:57.399607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-072eb98d-0683-48e6-b76b-383c3a086969 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:57.402997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-072eb98d-0683-48e6-b76b-383c3a086969 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:57.615327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] validate_networks() for [('80479427-085a-4dd2-8698-782034cdbfac', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:45:58.028624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-072eb98d-0683-48e6-b76b-383c3a086969 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:58.040772 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-072eb98d-0683-48e6-b76b-383c3a086969 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1463 microversion: 2.1 time: 0.674316 Oct 11 19:45:58.053596 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 566/1100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:57 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1463 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:58.053596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-17b5a165-5065-4cdb-b889-b5b8e5625303 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:58.053596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b5a165-5065-4cdb-b889-b5b8e5625303 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:58.053596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b5a165-5065-4cdb-b889-b5b8e5625303 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:58.063775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b5a165-5065-4cdb-b889-b5b8e5625303 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:58.064968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b5a165-5065-4cdb-b889-b5b8e5625303 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:58.065548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b5a165-5065-4cdb-b889-b5b8e5625303 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:58.066081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b5a165-5065-4cdb-b889-b5b8e5625303 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:58.103716 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-17b5a165-5065-4cdb-b889-b5b8e5625303 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.060820 Oct 11 19:45:58.104323 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 567/1101] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Oct 11 19:45:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:45:58.109320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f89e55e4-9e21-4561-b4e0-7b0e96ca4a1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:58.109921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f89e55e4-9e21-4561-b4e0-7b0e96ca4a1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:58.116525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f89e55e4-9e21-4561-b4e0-7b0e96ca4a1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:58.117044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f89e55e4-9e21-4561-b4e0-7b0e96ca4a1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:58.117472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f89e55e4-9e21-4561-b4e0-7b0e96ca4a1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:58.118174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f89e55e4-9e21-4561-b4e0-7b0e96ca4a1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:58.118840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f89e55e4-9e21-4561-b4e0-7b0e96ca4a1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:58.119280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f89e55e4-9e21-4561-b4e0-7b0e96ca4a1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:58.426776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f89e55e4-9e21-4561-b4e0-7b0e96ca4a1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:58.435958 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f89e55e4-9e21-4561-b4e0-7b0e96ca4a1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1322 microversion: 2.1 time: 0.330364 Oct 11 19:45:58.436807 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 568/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:58 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:58.591286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=14 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:58.652800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-09cf9100-79ff-43db-a083-48087c2e39d5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: .version_select at 0x7f83cc363040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1817536763", "description": "tempest-description-621931989"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:58.736693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:45:58.737240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:45:58.737683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:45:58.738267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:45:58.738796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:45:58.751165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:58.752281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:58.752817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:58.753621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:58.754794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:58.755694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:58.779287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Getting quotas for project 0ac923f5632e40b2bd81aa5de2ed3f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:58.786597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Getting quotas for user 823a414535d04791844ab997869542b2 and project 0ac923f5632e40b2bd81aa5de2ed3f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:58.804045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=92,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:58.811340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:45:58.814072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:45:58.866974 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0354fd7a-6eb2-4979-8f3c-6fb27239a13e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.531036 Oct 11 19:45:58.867767 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 535/1103] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:45:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 19:45:58.879434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-bc54b720-9ce1-440e-800c-b20af19343ca req-71a7a496-c0d3-42da-9460-5b5cacdab074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8bc215-3672-4c18-9441-8479acacc17d", "name": "network-vif-plugged", "status": "completed", "tag": "bf375cd3-0aab-4777-97b4-8ceb299e7800"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:58.890381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc54b720-9ce1-440e-800c-b20af19343ca req-71a7a496-c0d3-42da-9460-5b5cacdab074 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:58.891137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc54b720-9ce1-440e-800c-b20af19343ca req-71a7a496-c0d3-42da-9460-5b5cacdab074 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:58.891646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc54b720-9ce1-440e-800c-b20af19343ca req-71a7a496-c0d3-42da-9460-5b5cacdab074 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:58.893123 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-09cf9100-79ff-43db-a083-48087c2e39d5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.455086 Oct 11 19:45:58.893885 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 569/1104] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:45:58 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:58.906257 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bc54b720-9ce1-440e-800c-b20af19343ca req-71a7a496-c0d3-42da-9460-5b5cacdab074 service nova] Creating event network-vif-plugged:bf375cd3-0aab-4777-97b4-8ceb299e7800 for instance ba8bc215-3672-4c18-9441-8479acacc17d on n-h1-860864-3 Oct 11 19:45:58.929205 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-bc54b720-9ce1-440e-800c-b20af19343ca req-71a7a496-c0d3-42da-9460-5b5cacdab074 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053205 Oct 11 19:45:58.930172 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 536/1105] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:58.938806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d0c812fa-332c-4249-8262-a9dc33c33a9b req-2812f224-9d0c-4f80-804c-edd1eb0b9a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add978ad-6324-4802-a5a1-29a549940439", "tag": "75748e5f-39c6-47ca-a09a-7abde414fd82"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:58.951755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d0c812fa-332c-4249-8262-a9dc33c33a9b req-2812f224-9d0c-4f80-804c-edd1eb0b9a6c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:58.952464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d0c812fa-332c-4249-8262-a9dc33c33a9b req-2812f224-9d0c-4f80-804c-edd1eb0b9a6c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:58.952862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d0c812fa-332c-4249-8262-a9dc33c33a9b req-2812f224-9d0c-4f80-804c-edd1eb0b9a6c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:58.959014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9cf7733-512d-44c1-8515-c8ecbf9d5749 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Action: 'create', calling method: .version_select at 0x7f83cc4f0f70>, body: {"keypair": {"name": "tempest-keypair-1298969444", "type": "ssh", "user_id": "70c767309b724d22b265c765336ba0d8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5GuTq9uk4KuOfUUSKC7o+ScAuWC1kIFE3sGZl9gwoDnCyn6+GsXgKg5/B4G4WZizP3tHlNzqcBshdnA9dGRnfIr2FjDCl15VA97S4PdNDAdrrdbuIkKHR2OltdctBF7Q=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:58.969912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:45:58.976876 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d0c812fa-332c-4249-8262-a9dc33c33a9b req-2812f224-9d0c-4f80-804c-edd1eb0b9a6c service nova] Creating event network-changed:75748e5f-39c6-47ca-a09a-7abde414fd82 for instance add978ad-6324-4802-a5a1-29a549940439 on n-h2-860864-3 Oct 11 19:45:58.979839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b9cf7733-512d-44c1-8515-c8ecbf9d5749 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Getting quotas for project 3676d7160a054e3daba31fda536e419d. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:58.981829 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d0c812fa-332c-4249-8262-a9dc33c33a9b req-2812f224-9d0c-4f80-804c-edd1eb0b9a6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050219 Oct 11 19:45:58.982779 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 537/1106] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:58.989065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c5a2828-7f34-4bcb-aab7-131b89dd428c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'create', calling method: .version_select at 0x7f83cc61e670>, body: {"keypair": {"name": "tempest-keypair-637683612", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4KjyAkIqWi8UL0zXHsBblcD3mWZMLvt44dmCGyWYw/iF9sW8Az03GkXyECKGiy8MH0KgSIpwc0jwwKjRHLt8MQh9EgZKXP3vvpWuccdeqRcfW7pfT0WqeCUoEovOQXvw=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:58.991885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b9cf7733-512d-44c1-8515-c8ecbf9d5749 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Getting quotas for user f1c98aceb9a940e9944130c802eef1d5 and project 3676d7160a054e3daba31fda536e419d. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:59.009729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-6c5a2828-7f34-4bcb-aab7-131b89dd428c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for project 33b91a834ad24c82805880555930825d. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:59.015049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-6c5a2828-7f34-4bcb-aab7-131b89dd428c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for user 5c26541efd824c5ab866c2891adcd748 and project 33b91a834ad24c82805880555930825d. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:59.021136 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b9cf7733-512d-44c1-8515-c8ecbf9d5749 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.125958 Oct 11 19:45:59.022128 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 570/1107] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 11 19:45:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 19:45:59.031725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a0017cb-51f7-4da7-bfcb-c9384bbc800b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:59.031725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a0017cb-51f7-4da7-bfcb-c9384bbc800b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:59.037965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a0017cb-51f7-4da7-bfcb-c9384bbc800b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:59.038378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a0017cb-51f7-4da7-bfcb-c9384bbc800b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:59.039264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a0017cb-51f7-4da7-bfcb-c9384bbc800b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:59.040350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a0017cb-51f7-4da7-bfcb-c9384bbc800b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:59.041128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a0017cb-51f7-4da7-bfcb-c9384bbc800b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:59.041775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a0017cb-51f7-4da7-bfcb-c9384bbc800b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:59.051724 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6c5a2828-7f34-4bcb-aab7-131b89dd428c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065851 Oct 11 19:45:59.058470 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 538/1108] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:45:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:59.080463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e6c9b673-6e06-48c0-a4c3-9d72e3cbad7c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:59.083798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e6c9b673-6e06-48c0-a4c3-9d72e3cbad7c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:59.093545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-4a0017cb-51f7-4da7-bfcb-c9384bbc800b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lazy-loading 'flavor' on Instance uuid f30bdfac-1c61-4f61-876d-0922853f40c0 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:45:59.098282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6c9b673-6e06-48c0-a4c3-9d72e3cbad7c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:59.101141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6c9b673-6e06-48c0-a4c3-9d72e3cbad7c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:59.102053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6c9b673-6e06-48c0-a4c3-9d72e3cbad7c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:59.102897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6c9b673-6e06-48c0-a4c3-9d72e3cbad7c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:59.104060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6c9b673-6e06-48c0-a4c3-9d72e3cbad7c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:59.104180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6c9b673-6e06-48c0-a4c3-9d72e3cbad7c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:59.402457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e6c9b673-6e06-48c0-a4c3-9d72e3cbad7c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:59.412666 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e6c9b673-6e06-48c0-a4c3-9d72e3cbad7c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1314 microversion: 2.1 time: 0.350835 Oct 11 19:45:59.416496 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 539/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:59 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:45:59.424923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6031326b-9837-422a-b11c-6a50f875d57e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:59.428760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6031326b-9837-422a-b11c-6a50f875d57e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:59.480844 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a0017cb-51f7-4da7-bfcb-c9384bbc800b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "POST /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0/action" status: 202 len: 0 microversion: 2.91 time: 0.457207 Oct 11 19:45:59.485796 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 571/1110] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:45:59 2022] POST /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:45:59.499995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc2a9c0a-a5f6-4184-9e88-ab1a828b2751 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: .version_select at 0x7f83cc332c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-430450329", "description": "tempest-description-1063225725"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:59.516436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6031326b-9837-422a-b11c-6a50f875d57e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:59.529939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6031326b-9837-422a-b11c-6a50f875d57e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:59.532216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6031326b-9837-422a-b11c-6a50f875d57e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:45:59.533446 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6031326b-9837-422a-b11c-6a50f875d57e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1285 microversion: 2.25 time: 0.115890 Oct 11 19:45:59.534566 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 540/1111] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:59 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:45:59.561883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dd3e98e6-3761-4c6f-bd20-712556867cd3 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Action: 'create', calling method: .version_select at 0x7f83cc5b2d30>, body: {"keypair": {"name": "tempest-keypair-366683981", "type": "ssh", "user_id": "70c767309b724d22b265c765336ba0d8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANSkwEXCeSSHUgF2ynaFDh49KIUB3dOu6+d0d7wvmTOZaMM/yK9aqwClAj2cI8YJM280/7IU7DiF5p5EdeGoi2wfmPYre3k/pnm2whu4tkeAxgafNu0zmePsMuIlpGw2g=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:45:59.586126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-dd3e98e6-3761-4c6f-bd20-712556867cd3 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Getting quotas for project 3676d7160a054e3daba31fda536e419d. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:45:59.595769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-dd3e98e6-3761-4c6f-bd20-712556867cd3 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Getting quotas for user f1c98aceb9a940e9944130c802eef1d5 and project 3676d7160a054e3daba31fda536e419d. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:45:59.632548 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dd3e98e6-3761-4c6f-bd20-712556867cd3 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.082706 Oct 11 19:45:59.633664 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 541/1112] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 11 19:45:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 19:45:59.645117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-655c0123-0ef4-4a98-b689-c3fdd3d32ca9 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:59.646457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-655c0123-0ef4-4a98-b689-c3fdd3d32ca9 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:59.656255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-655c0123-0ef4-4a98-b689-c3fdd3d32ca9 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:59.657090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-655c0123-0ef4-4a98-b689-c3fdd3d32ca9 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:59.657702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-655c0123-0ef4-4a98-b689-c3fdd3d32ca9 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:59.658716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-655c0123-0ef4-4a98-b689-c3fdd3d32ca9 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:59.659434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-655c0123-0ef4-4a98-b689-c3fdd3d32ca9 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:59.660138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-655c0123-0ef4-4a98-b689-c3fdd3d32ca9 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:59.805573 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc2a9c0a-a5f6-4184-9e88-ab1a828b2751 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.313470 Oct 11 19:45:59.806304 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 572/1113] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:45:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:45:59.816606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:45:59.818059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:45:59.855495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:59.858697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:59.859164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:45:59.865277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:45:59.866488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:45:59.866960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:00.018710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-655c0123-0ef4-4a98-b689-c3fdd3d32ca9 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:00.028102 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-655c0123-0ef4-4a98-b689-c3fdd3d32ca9 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1322 microversion: 2.1 time: 0.392826 Oct 11 19:46:00.030993 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 542/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:45:59 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:00.060086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e6b70bb7-6b70-46c6-ab5d-eee7f43ab9e2 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Calling method '.version_select at 0x7f83cc61ea60>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:00.074247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:00.079133 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e6b70bb7-6b70-46c6-ab5d-eee7f43ab9e2 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1298969444?user_id=70c767309b724d22b265c765336ba0d8" status: 200 len: 512 microversion: 2.10 time: 0.030487 Oct 11 19:46:00.080362 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 543/1115] 10.222.0.27 () {60 vars in 1340 bytes} [Tue Oct 11 19:46:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1298969444?user_id=70c767309b724d22b265c765336ba0d8 => generated 512 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:46:00.093844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:00.105955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1117230903", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "7b890429-7c90-4096-ba26-c9d60aef0c43"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:00.121260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:00.154706 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-63548c5a-ad4e-4f6e-968a-a0e1a341fea5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.341054 Oct 11 19:46:00.157658 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 573/1116] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:45:59 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:00.167523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1cf1f4c4-4580-420c-94b4-c898e9ce5608 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Action: 'create', calling method: .version_select at 0x7f83cc4a0430>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2115722208", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4z+rumuIyRxoHdV1u4MK/SzeRs0H5iEo9O9LUBSaZzEvcIalh0BngDbDRAt14n+IipuQRp3Fj2riuHLmVso0App/D++pOLgO9X7xD439UBOHJnj3S0MsQgg+nguOtsEg=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:00.217507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-1cf1f4c4-4580-420c-94b4-c898e9ce5608 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Getting quotas for project 3676d7160a054e3daba31fda536e419d. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:00.233629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-1cf1f4c4-4580-420c-94b4-c898e9ce5608 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Getting quotas for user f1c98aceb9a940e9944130c802eef1d5 and project 3676d7160a054e3daba31fda536e419d. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:00.234090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] validate_networks() for [('7b890429-7c90-4096-ba26-c9d60aef0c43', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:46:00.287812 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1cf1f4c4-4580-420c-94b4-c898e9ce5608 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.128250 Oct 11 19:46:00.289200 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 574/1117] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 11 19:46:00 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 19:46:00.301517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-44e99fbd-b59b-4d5d-ba58-b5555b5f1c71 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Calling method '.version_select at 0x7f83cc381820>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:00.313026 n-d-860864-3 devstack@n-api.service[126955]: WARNING oslo_db.sqlalchemy.utils [None req-44e99fbd-b59b-4d5d-ba58-b5555b5f1c71 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 19:46:00.329765 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-44e99fbd-b59b-4d5d-ba58-b5555b5f1c71 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=70c767309b724d22b265c765336ba0d8" status: 200 len: 725 microversion: 2.10 time: 0.030514 Oct 11 19:46:00.332294 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 575/1118] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Oct 11 19:46:00 2022] GET /compute/v2.1/os-keypairs?user_id=70c767309b724d22b265c765336ba0d8 => generated 725 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:46:00.344100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56db21a0-0630-49d4-91d1-a96ca0f839a9 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Calling method '.version_select at 0x7f83cc2f08b0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:00.394693 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56db21a0-0630-49d4-91d1-a96ca0f839a9 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2115722208" status: 204 len: 0 microversion: 2.10 time: 0.054806 Oct 11 19:46:00.395871 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 576/1119] 10.222.0.27 () {60 vars in 1325 bytes} [Tue Oct 11 19:46:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2115722208 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 19:46:00.406164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3bf1d037-2300-43c0-84a8-e89339426e77 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Calling method '.version_select at 0x7f83cc2f0d30>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:00.455482 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3bf1d037-2300-43c0-84a8-e89339426e77 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366683981?user_id=70c767309b724d22b265c765336ba0d8" status: 204 len: 0 microversion: 2.10 time: 0.054312 Oct 11 19:46:00.456744 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 577/1120] 10.222.0.27 () {60 vars in 1340 bytes} [Tue Oct 11 19:46:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366683981?user_id=70c767309b724d22b265c765336ba0d8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:46:00.464441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a524dc6-65ab-4bf7-ad30-ea4841bbca82 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:00.467848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a524dc6-65ab-4bf7-ad30-ea4841bbca82 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:00.486220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a524dc6-65ab-4bf7-ad30-ea4841bbca82 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:00.489293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a524dc6-65ab-4bf7-ad30-ea4841bbca82 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:00.490726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a524dc6-65ab-4bf7-ad30-ea4841bbca82 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:00.493295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a524dc6-65ab-4bf7-ad30-ea4841bbca82 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:00.495551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a524dc6-65ab-4bf7-ad30-ea4841bbca82 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:00.496805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a524dc6-65ab-4bf7-ad30-ea4841bbca82 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:00.868563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a524dc6-65ab-4bf7-ad30-ea4841bbca82 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:00.877928 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a524dc6-65ab-4bf7-ad30-ea4841bbca82 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1314 microversion: 2.1 time: 0.419810 Oct 11 19:46:00.878811 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 578/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:00 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:00.892888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7f54d0da-d2bb-4cb8-aac1-39b5a537e933 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] Calling method '.version_select at 0x7f83cc33b4c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:00.938576 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7f54d0da-d2bb-4cb8-aac1-39b5a537e933 tempest-KeyPairsV210TestJSON-2040465352 tempest-KeyPairsV210TestJSON-2040465352-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298969444?user_id=70c767309b724d22b265c765336ba0d8" status: 204 len: 0 microversion: 2.10 time: 0.056833 Oct 11 19:46:00.944449 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 579/1122] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 19:46:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298969444?user_id=70c767309b724d22b265c765336ba0d8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:46:00.955905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:00.956583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:00.970638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:00.971183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:00.971808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:00.972535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:00.972994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:00.973416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:01.088469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:01.108448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:01.109795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:01.110954 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-44d94073-6c47-48a2-9b1c-4cd6c821c149 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1337 microversion: 2.25 time: 0.165121 Oct 11 19:46:01.111884 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 580/1123] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:00 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1337 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:01.117165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1e018de2-2958-427e-a52e-c49f0946ad6c tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:01.118101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1e018de2-2958-427e-a52e-c49f0946ad6c tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:01.125784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e018de2-2958-427e-a52e-c49f0946ad6c tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:01.126560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e018de2-2958-427e-a52e-c49f0946ad6c tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:01.127174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e018de2-2958-427e-a52e-c49f0946ad6c tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:01.128039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e018de2-2958-427e-a52e-c49f0946ad6c tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:01.128711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e018de2-2958-427e-a52e-c49f0946ad6c tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:01.129317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e018de2-2958-427e-a52e-c49f0946ad6c tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:01.205677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:46:01.206330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:46:01.206930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:46:01.207610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:46:01.208117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:46:01.224594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:01.225453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:01.226112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:01.228590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:01.232288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:01.233721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:01.284092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Getting quotas for project ba60fc5cb0874d38897f0ed8d5580106. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:01.296156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Getting quotas for user e657b74c26d247cd896aa508c7aac5ca and project ba60fc5cb0874d38897f0ed8d5580106. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:01.316753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:46:01.322315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:46:01.400773 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3200be7-b482-4d43-a0ef-b63f17b212dd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.317412 Oct 11 19:46:01.411469 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 544/1124] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:46:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:46:01.417945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:01.418967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:01.426243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:01.427027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:01.427831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:01.429800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:01.431309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:01.432370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:01.567633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e018de2-2958-427e-a52e-c49f0946ad6c tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:01.584012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:01.590494 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1e018de2-2958-427e-a52e-c49f0946ad6c tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1471 microversion: 2.1 time: 0.476995 Oct 11 19:46:01.591252 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 581/1125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:01 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:01.617841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b660858e-3e25-407c-863a-f1121fd6edbc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:01.618455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b660858e-3e25-407c-863a-f1121fd6edbc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:01.621337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:01.623283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:01.633563 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e9d8ff70-839f-4998-8c7f-b993c997d13f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.220572 Oct 11 19:46:01.635748 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 545/1126] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:01 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:01.788683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b660858e-3e25-407c-863a-f1121fd6edbc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:01.801855 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b660858e-3e25-407c-863a-f1121fd6edbc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1216 microversion: 2.1 time: 0.186326 Oct 11 19:46:01.802595 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 582/1127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:01 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:01.901892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8aa40164-719c-44c9-8485-b4ad01d0f77a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:01.902639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8aa40164-719c-44c9-8485-b4ad01d0f77a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:01.914731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8aa40164-719c-44c9-8485-b4ad01d0f77a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:01.926240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8aa40164-719c-44c9-8485-b4ad01d0f77a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:01.929193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8aa40164-719c-44c9-8485-b4ad01d0f77a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:01.932951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8aa40164-719c-44c9-8485-b4ad01d0f77a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:01.935595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8aa40164-719c-44c9-8485-b4ad01d0f77a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:01.937577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8aa40164-719c-44c9-8485-b4ad01d0f77a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:02.126459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6cc34080-816d-401d-8b5a-7d169a2565cb tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:02.127262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6cc34080-816d-401d-8b5a-7d169a2565cb tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] [instance: 83fd6108-aa5b-4d7e-8ef4-12231f85154e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:02.139966 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-6cc34080-816d-401d-8b5a-7d169a2565cb tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] HTTP exception thrown: Instance 83fd6108-aa5b-4d7e-8ef4-12231f85154e could not be found. Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6cc34080-816d-401d-8b5a-7d169a2565cb tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Request method failure captured: Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/83fd6108-aa5b-4d7e-8ef4-12231f85154e/action HTTP/1.1 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 15 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfjM-ev_Veo-SIkjNmCnVshTQ1puEskARGnnYWl5JyGCV7czPiaNfp81l5uo-fwK27JIhkPi26G4A4bU4SjLuOQcs1PhpJtShb8xMLdKdkT8tk4rzDhv27CyCvTYPLwW35VwDLLF_vN3ocLqmThBt3NqfJA94toi15O-7ngy_KH9D0 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 7c735524b75642ac922a97068c6893c7 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c735524b75642ac922a97068c6893c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c735524b75642ac922a97068c6893c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c735524b75642ac922a97068c6893c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c735524b75642ac922a97068c6893c7"}]}] Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 7c735524b75642ac922a97068c6893c7 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAdminNegativeTestJSON-1673970645-project-admin Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: fd403072ddfa4b60acfd868b1b551145 Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1673970645-project-admin Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: {"migrate": {}} Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 83fd6108-aa5b-4d7e-8ef4-12231f85154e could not be found. Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '83fd6108-aa5b-4d7e-8ef4-12231f85154e', 'body': {'migrate': {}}} Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83fd6108-aa5b-4d7e-8ef4-12231f85154e could not be found. Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83fd6108-aa5b-4d7e-8ef4-12231f85154e could not be found. Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:02.141675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:02.147248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:02.147248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:02.147248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:02.147248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:02.147248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83fd6108-aa5b-4d7e-8ef4-12231f85154e could not be found. Oct 11 19:46:02.147248 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:02.147248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6cc34080-816d-401d-8b5a-7d169a2565cb tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Returning 404 to user: Instance 83fd6108-aa5b-4d7e-8ef4-12231f85154e could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:02.147248 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6cc34080-816d-401d-8b5a-7d169a2565cb tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/83fd6108-aa5b-4d7e-8ef4-12231f85154e/action" status: 404 len: 111 microversion: 2.1 time: 0.508460 Oct 11 19:46:02.147248 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 546/1128] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:01 2022] POST /compute/v2.1/servers/83fd6108-aa5b-4d7e-8ef4-12231f85154e/action => generated 111 bytes in 509 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:46:02.163363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5f729bbf-9f21-4eab-8c74-7944dcb63917 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '.version_select at 0x7f83cc4cfee0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:02.177594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f729bbf-9f21-4eab-8c74-7944dcb63917 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:02.178099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f729bbf-9f21-4eab-8c74-7944dcb63917 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:02.178635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f729bbf-9f21-4eab-8c74-7944dcb63917 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:02.208331 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5f729bbf-9f21-4eab-8c74-7944dcb63917 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.048080 Oct 11 19:46:02.224006 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 547/1129] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:46:02 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:02.235935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:02.252726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:02.262922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:02.263628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:02.264247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:02.264960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:02.265602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:02.266189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:02.298912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8aa40164-719c-44c9-8485-b4ad01d0f77a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:02.314283 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8aa40164-719c-44c9-8485-b4ad01d0f77a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1314 microversion: 2.1 time: 0.416698 Oct 11 19:46:02.315214 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 583/1130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:01 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:02.319770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11eb2ab4-7e48-4f73-b4de-3fa482545d1c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:02.334653 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11eb2ab4-7e48-4f73-b4de-3fa482545d1c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017227 Oct 11 19:46:02.343522 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 584/1131] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:46:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:02.351973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0b70128-a559-4965-8a54-dbadab70da2c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1579711021", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:02.376002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:02.385597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:02.387834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:02.389135 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1b46658d-a25d-42c4-ac86-166645c7f8ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1337 microversion: 2.25 time: 0.163830 Oct 11 19:46:02.389788 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 548/1132] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:02 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1337 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:02.394872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-92806085", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:02.397767 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c0b70128-a559-4965-8a54-dbadab70da2c tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.052864 Oct 11 19:46:02.398776 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 585/1133] 10.222.0.27 () {60 vars in 1146 bytes} [Tue Oct 11 19:46:02 2022] POST /compute/v2.1/flavors => generated 499 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:02.419739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fa6d1163-49bf-4ae8-81a9-33ce687fffd8 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:02.429900 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fa6d1163-49bf-4ae8-81a9-33ce687fffd8 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021960 Oct 11 19:46:02.439769 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 586/1134] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Oct 11 19:46:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:46:02.490932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:46:02.602326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1131515533", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "a16441dd-a497-462e-a030-05fdadab9305"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:02.739150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:46:02.931037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:46:02.931779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:46:02.932442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:46:02.933002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:46:02.933569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:46:02.953645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:02.954823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:02.955461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:02.959355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:02.960026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:02.960633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:03.004195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Getting quotas for project 25fb1c12e2fe4e30955c7509e90a2a44. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:03.012334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Getting quotas for user 7c0e5fa825034b299ccdbcb86b0e3d26 and project 25fb1c12e2fe4e30955c7509e90a2a44. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:03.088775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:46:03.094448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:46:03.177601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:46:03.178219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:46:03.179000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:46:03.179166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:46:03.179579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:46:03.205036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:03.205525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:03.205958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:03.206707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:03.207163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:03.207583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:03.213589 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0b9d821-d5db-440c-9b5f-2d0af814811e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822466 Oct 11 19:46:03.221645 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 549/1135] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:46:03.228366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:03.229769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:03.241855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:03.243234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:03.245084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:03.246121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:03.247004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:03.247736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:03.256787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for project 33b91a834ad24c82805880555930825d. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:03.262873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for user 5c26541efd824c5ab866c2891adcd748 and project 33b91a834ad24c82805880555930825d. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:03.278472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:46:03.281431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:46:03.367495 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9dcb9849-2d5c-4c7f-94d0-090bf84514f7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770123 Oct 11 19:46:03.372667 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 587/1136] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:46:03.385679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b944b155-5513-48d1-ae8d-805504328b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:03.386615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b944b155-5513-48d1-ae8d-805504328b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:03.401374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b944b155-5513-48d1-ae8d-805504328b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:03.401887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b944b155-5513-48d1-ae8d-805504328b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:03.402326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b944b155-5513-48d1-ae8d-805504328b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:03.406099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b944b155-5513-48d1-ae8d-805504328b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:03.406636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b944b155-5513-48d1-ae8d-805504328b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:03.407092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b944b155-5513-48d1-ae8d-805504328b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:03.456060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:03.777200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:03.788238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:03.797304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:03.806461 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-241ca805-6097-48b3-a311-74d57f4a076d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.583251 Oct 11 19:46:03.807817 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 550/1137] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:03 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:03.813202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8260f484-6df4-4a20-82a5-65140531dfde tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:03.824709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8260f484-6df4-4a20-82a5-65140531dfde tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:03.858580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b944b155-5513-48d1-ae8d-805504328b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:03.867667 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b944b155-5513-48d1-ae8d-805504328b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1268 microversion: 2.1 time: 0.493325 Oct 11 19:46:03.868311 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 588/1138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:03 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1268 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:03.909719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e018c8c-4011-41d1-a0a7-23f9997b67a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:03.910234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8260f484-6df4-4a20-82a5-65140531dfde tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:03.910566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e018c8c-4011-41d1-a0a7-23f9997b67a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:03.918434 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8260f484-6df4-4a20-82a5-65140531dfde tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1220 microversion: 2.1 time: 0.109180 Oct 11 19:46:03.923678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e018c8c-4011-41d1-a0a7-23f9997b67a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:03.929206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e018c8c-4011-41d1-a0a7-23f9997b67a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:03.930173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e018c8c-4011-41d1-a0a7-23f9997b67a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:03.931168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e018c8c-4011-41d1-a0a7-23f9997b67a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:03.931982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e018c8c-4011-41d1-a0a7-23f9997b67a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:03.933031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e018c8c-4011-41d1-a0a7-23f9997b67a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:03.935423 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 551/1139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:03 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1220 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:03.941064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ba5b78e-e03b-464b-a334-b31a006be222 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:03.941885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ba5b78e-e03b-464b-a334-b31a006be222 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:03.949890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba5b78e-e03b-464b-a334-b31a006be222 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:03.950841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba5b78e-e03b-464b-a334-b31a006be222 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:03.951511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba5b78e-e03b-464b-a334-b31a006be222 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:03.952739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba5b78e-e03b-464b-a334-b31a006be222 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:03.953451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba5b78e-e03b-464b-a334-b31a006be222 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:03.954078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba5b78e-e03b-464b-a334-b31a006be222 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:04.282473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e018c8c-4011-41d1-a0a7-23f9997b67a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:04.299684 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e018c8c-4011-41d1-a0a7-23f9997b67a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1314 microversion: 2.1 time: 0.430043 Oct 11 19:46:04.299994 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 589/1140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:03 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:04.304694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1f3ceb73-25b1-420d-89e0-0f6926aac593 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:04.305390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f3ceb73-25b1-420d-89e0-0f6926aac593 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:04.328896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f3ceb73-25b1-420d-89e0-0f6926aac593 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:04.329398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f3ceb73-25b1-420d-89e0-0f6926aac593 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:04.329831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f3ceb73-25b1-420d-89e0-0f6926aac593 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:04.330601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f3ceb73-25b1-420d-89e0-0f6926aac593 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:04.338457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f3ceb73-25b1-420d-89e0-0f6926aac593 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:04.338949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f3ceb73-25b1-420d-89e0-0f6926aac593 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:04.480887 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ba5b78e-e03b-464b-a334-b31a006be222 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1859 microversion: 2.1 time: 0.544266 Oct 11 19:46:04.483726 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 552/1141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:03 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1859 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:04.495585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:04.499687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:04.516757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1f3ceb73-25b1-420d-89e0-0f6926aac593 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:04.518032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:04.519118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:04.521050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:04.522392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:04.523238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:04.525954 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1f3ceb73-25b1-420d-89e0-0f6926aac593 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1275 microversion: 2.1 time: 0.224922 Oct 11 19:46:04.526404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:04.536360 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 590/1142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:04 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:04.554582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-fe4b660a-b267-461b-81c5-af918f24616f req-518181a9-cf3b-4a92-a9bb-629b9aca03c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add978ad-6324-4802-a5a1-29a549940439", "name": "network-vif-plugged", "status": "completed", "tag": "75748e5f-39c6-47ca-a09a-7abde414fd82"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:04.576475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fe4b660a-b267-461b-81c5-af918f24616f req-518181a9-cf3b-4a92-a9bb-629b9aca03c5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:04.580154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fe4b660a-b267-461b-81c5-af918f24616f req-518181a9-cf3b-4a92-a9bb-629b9aca03c5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:04.581583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fe4b660a-b267-461b-81c5-af918f24616f req-518181a9-cf3b-4a92-a9bb-629b9aca03c5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:04.609140 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-fe4b660a-b267-461b-81c5-af918f24616f req-518181a9-cf3b-4a92-a9bb-629b9aca03c5 service nova] Creating event network-vif-plugged:75748e5f-39c6-47ca-a09a-7abde414fd82 for instance add978ad-6324-4802-a5a1-29a549940439 on n-h2-860864-3 Oct 11 19:46:04.623406 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-fe4b660a-b267-461b-81c5-af918f24616f req-518181a9-cf3b-4a92-a9bb-629b9aca03c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085121 Oct 11 19:46:04.624301 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 591/1143] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:04.639332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:04.644503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:04.669220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:04.670117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:04.670843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:04.671790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:04.672630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:04.673250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:04.732184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lazy-loading 'flavor' on Instance uuid ab2bcc99-b3f9-47c2-bb34-4f3a24081296 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:46:04.771354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Going to try to live migrate instance to n-h2-860864-3 {{(pid=126955) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 19:46:05.002696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:05.012440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:05.016216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:05.019806 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98a6bd6b-3e45-478d-8ba4-c91fa20130bc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1410 microversion: 2.25 time: 0.534746 Oct 11 19:46:05.022646 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 553/1144] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:04 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1410 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:05.027454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:05.033466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:05.044817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:05.045316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:05.045750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:05.046450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:05.061333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:05.062013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:05.199378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:05.208795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:05.210354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:05.216638 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e6dbac1-2512-4a50-a82d-386445814ca2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.192723 Oct 11 19:46:05.223313 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 554/1145] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:05 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:05.228376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-68ff20e8-1e2e-4bb1-b9bf-6a22df73596b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:05.240239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68ff20e8-1e2e-4bb1-b9bf-6a22df73596b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:05.244908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:05.259133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68ff20e8-1e2e-4bb1-b9bf-6a22df73596b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:05.259683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68ff20e8-1e2e-4bb1-b9bf-6a22df73596b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:05.260122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68ff20e8-1e2e-4bb1-b9bf-6a22df73596b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:05.260849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68ff20e8-1e2e-4bb1-b9bf-6a22df73596b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:05.261301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68ff20e8-1e2e-4bb1-b9bf-6a22df73596b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:05.261802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68ff20e8-1e2e-4bb1-b9bf-6a22df73596b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:05.414695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68ff20e8-1e2e-4bb1-b9bf-6a22df73596b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:05.431042 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-68ff20e8-1e2e-4bb1-b9bf-6a22df73596b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1274 microversion: 2.1 time: 0.203191 Oct 11 19:46:05.433590 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 555/1146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:05 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:05.462179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-957ad252-e27f-44ee-a239-63988f271b1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:05.463414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-957ad252-e27f-44ee-a239-63988f271b1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:05.471657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957ad252-e27f-44ee-a239-63988f271b1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:05.472389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957ad252-e27f-44ee-a239-63988f271b1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:05.473059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957ad252-e27f-44ee-a239-63988f271b1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:05.474655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957ad252-e27f-44ee-a239-63988f271b1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:05.475427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957ad252-e27f-44ee-a239-63988f271b1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:05.476050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957ad252-e27f-44ee-a239-63988f271b1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:05.674313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-957ad252-e27f-44ee-a239-63988f271b1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:05.689380 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-957ad252-e27f-44ee-a239-63988f271b1f tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1272 microversion: 2.1 time: 0.231482 Oct 11 19:46:05.691399 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 556/1147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:05 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:05.698617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b30e43c7-3052-423a-a652-7e9db47336bc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:05.699368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b30e43c7-3052-423a-a652-7e9db47336bc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:05.726841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30e43c7-3052-423a-a652-7e9db47336bc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:05.727018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30e43c7-3052-423a-a652-7e9db47336bc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:05.727326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30e43c7-3052-423a-a652-7e9db47336bc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:05.728039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30e43c7-3052-423a-a652-7e9db47336bc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:05.733471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30e43c7-3052-423a-a652-7e9db47336bc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:05.733934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30e43c7-3052-423a-a652-7e9db47336bc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:05.958425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b30e43c7-3052-423a-a652-7e9db47336bc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:05.969502 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b30e43c7-3052-423a-a652-7e9db47336bc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1314 microversion: 2.1 time: 0.276756 Oct 11 19:46:05.975393 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 557/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:05 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:05.980882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-890e1ba3-5758-4fbc-b727-ac72980d7137 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:05.982514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-890e1ba3-5758-4fbc-b727-ac72980d7137 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:06.013657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890e1ba3-5758-4fbc-b727-ac72980d7137 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:06.014901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890e1ba3-5758-4fbc-b727-ac72980d7137 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:06.015599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890e1ba3-5758-4fbc-b727-ac72980d7137 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:06.016711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890e1ba3-5758-4fbc-b727-ac72980d7137 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:06.017424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890e1ba3-5758-4fbc-b727-ac72980d7137 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:06.018053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890e1ba3-5758-4fbc-b727-ac72980d7137 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:06.167422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-890e1ba3-5758-4fbc-b727-ac72980d7137 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:06.184355 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-890e1ba3-5758-4fbc-b727-ac72980d7137 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1331 microversion: 2.1 time: 0.204737 Oct 11 19:46:06.185104 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 558/1149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:05 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1331 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:06.195761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f7d99cef-ba5d-4315-9654-8ecd17901895 req-610a17ae-a6a1-4c38-8ef5-3710eb82fb9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72bf9d5c-d025-4705-828e-4e4e389f5681", "tag": "0d0ecc45-e711-4f9a-870b-ac48a8637962"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:06.214045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f7d99cef-ba5d-4315-9654-8ecd17901895 req-610a17ae-a6a1-4c38-8ef5-3710eb82fb9c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:06.214563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f7d99cef-ba5d-4315-9654-8ecd17901895 req-610a17ae-a6a1-4c38-8ef5-3710eb82fb9c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:06.215195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f7d99cef-ba5d-4315-9654-8ecd17901895 req-610a17ae-a6a1-4c38-8ef5-3710eb82fb9c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:06.228378 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f7d99cef-ba5d-4315-9654-8ecd17901895 req-610a17ae-a6a1-4c38-8ef5-3710eb82fb9c service nova] Creating event network-changed:0d0ecc45-e711-4f9a-870b-ac48a8637962 for instance 72bf9d5c-d025-4705-828e-4e4e389f5681 on n-h1-860864-3 Oct 11 19:46:06.234412 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f7d99cef-ba5d-4315-9654-8ecd17901895 req-610a17ae-a6a1-4c38-8ef5-3710eb82fb9c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046501 Oct 11 19:46:06.235057 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 559/1150] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:06.241068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:06.242327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:06.264199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:06.265058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:06.265869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:06.266941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:06.267617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:06.268238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:06.585042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:06.599901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:06.601895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:06.603638 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f054ef70-351a-4428-b6ac-3c2920f4408f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1410 microversion: 2.25 time: 0.367185 Oct 11 19:46:06.607658 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 560/1151] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:06 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1410 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:06.617731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:06.618858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:06.627317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:06.627910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:06.628434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:06.629260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:06.630223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:06.630831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:06.658317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:06.720895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:06.734601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:06.735463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:06.753293 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-17167f58-29e6-424d-b9c3-cf760676f1eb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.144274 Oct 11 19:46:06.753908 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 561/1152] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:06 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:06.758416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98f462b5-658c-44c6-890a-64847207d30e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:06.763322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-98f462b5-658c-44c6-890a-64847207d30e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:06.777222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f462b5-658c-44c6-890a-64847207d30e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:06.777781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f462b5-658c-44c6-890a-64847207d30e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:06.778235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f462b5-658c-44c6-890a-64847207d30e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:06.778971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f462b5-658c-44c6-890a-64847207d30e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:06.779431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f462b5-658c-44c6-890a-64847207d30e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:06.779855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f462b5-658c-44c6-890a-64847207d30e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:07.063332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-98f462b5-658c-44c6-890a-64847207d30e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:07.073263 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98f462b5-658c-44c6-890a-64847207d30e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1316 microversion: 2.1 time: 0.318230 Oct 11 19:46:07.074352 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 562/1153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:06 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:07.083138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-37658771-b529-4a36-9ecb-f1642e7475d2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:07.084018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-37658771-b529-4a36-9ecb-f1642e7475d2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:07.091148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37658771-b529-4a36-9ecb-f1642e7475d2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:07.092039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37658771-b529-4a36-9ecb-f1642e7475d2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:07.092555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37658771-b529-4a36-9ecb-f1642e7475d2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:07.093485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37658771-b529-4a36-9ecb-f1642e7475d2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:07.094008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37658771-b529-4a36-9ecb-f1642e7475d2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:07.094510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37658771-b529-4a36-9ecb-f1642e7475d2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:07.175774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-37658771-b529-4a36-9ecb-f1642e7475d2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:07.182847 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-37658771-b529-4a36-9ecb-f1642e7475d2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1278 microversion: 2.1 time: 0.107104 Oct 11 19:46:07.183435 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 563/1154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:07 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:07.363373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ed9139c-abb1-446e-ba23-b26eaf994bb3 tempest-NetworksTest-497618338 tempest-NetworksTest-497618338-project-admin] Calling method '.version_select at 0x7f83ccb46790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:07.664948 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2ed9139c-abb1-446e-ba23-b26eaf994bb3 tempest-NetworksTest-497618338 tempest-NetworksTest-497618338-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6045 microversion: 2.1 time: 0.480458 Oct 11 19:46:07.666475 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 564/1155] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:46:07 2022] GET /compute/v2.1/os-networks => generated 6045 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:07.678229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-17960038-24ca-4385-978b-e4562b76050d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:07.679157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-17960038-24ca-4385-978b-e4562b76050d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:07.686180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17960038-24ca-4385-978b-e4562b76050d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:07.686774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17960038-24ca-4385-978b-e4562b76050d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:07.687285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17960038-24ca-4385-978b-e4562b76050d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:07.688057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17960038-24ca-4385-978b-e4562b76050d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:07.688608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17960038-24ca-4385-978b-e4562b76050d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:07.689202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17960038-24ca-4385-978b-e4562b76050d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:07.927805 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8514eb6e-6c90-421f-9fa6-f7a881d1ee60 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/action" status: 202 len: 0 microversion: 2.1 time: 3.300094 Oct 11 19:46:07.931241 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 592/1156] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:04 2022] POST /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/action => generated 0 bytes in 3304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:07.940627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3729e5fb-dde0-4e3b-bb19-6840430ec949 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:07.941665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3729e5fb-dde0-4e3b-bb19-6840430ec949 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:07.951302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3729e5fb-dde0-4e3b-bb19-6840430ec949 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:07.952618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3729e5fb-dde0-4e3b-bb19-6840430ec949 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:07.953273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3729e5fb-dde0-4e3b-bb19-6840430ec949 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:07.954337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3729e5fb-dde0-4e3b-bb19-6840430ec949 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:07.955091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3729e5fb-dde0-4e3b-bb19-6840430ec949 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:07.955900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3729e5fb-dde0-4e3b-bb19-6840430ec949 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:07.994093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-17960038-24ca-4385-978b-e4562b76050d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:08.003960 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-17960038-24ca-4385-978b-e4562b76050d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1500 microversion: 2.1 time: 0.336103 Oct 11 19:46:08.005336 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 565/1157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:07 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1500 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:08.011197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9158d8db-34ec-44c2-b168-0d83cf663cc3 req-ea2a0705-12bf-4257-bdd3-c755b085b78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfe1637f-a670-4f41-8ab8-a80c168abe0e", "tag": "a0d00e7b-e522-4d4c-9ce3-652c535e3486"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:08.022697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9158d8db-34ec-44c2-b168-0d83cf663cc3 req-ea2a0705-12bf-4257-bdd3-c755b085b78a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.023653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9158d8db-34ec-44c2-b168-0d83cf663cc3 req-ea2a0705-12bf-4257-bdd3-c755b085b78a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.024243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9158d8db-34ec-44c2-b168-0d83cf663cc3 req-ea2a0705-12bf-4257-bdd3-c755b085b78a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.045367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3729e5fb-dde0-4e3b-bb19-6840430ec949 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:08.050483 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9158d8db-34ec-44c2-b168-0d83cf663cc3 req-ea2a0705-12bf-4257-bdd3-c755b085b78a service nova] Creating event network-changed:a0d00e7b-e522-4d4c-9ce3-652c535e3486 for instance dfe1637f-a670-4f41-8ab8-a80c168abe0e on n-h2-860864-3 Oct 11 19:46:08.055690 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9158d8db-34ec-44c2-b168-0d83cf663cc3 req-ea2a0705-12bf-4257-bdd3-c755b085b78a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048853 Oct 11 19:46:08.056601 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 566/1158] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:08.063160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:08.063964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:08.069790 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3729e5fb-dde0-4e3b-bb19-6840430ec949 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1337 microversion: 2.1 time: 0.133444 Oct 11 19:46:08.070827 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 593/1159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:07 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1337 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:08.071292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.071791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.072232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.073099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.073568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.074000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.077185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5a008e12-27da-42e1-af21-148ea193653d tempest-NetworksTest-497618338 tempest-NetworksTest-497618338-project-admin] Calling method '.version_select at 0x7f83cc2e4dc0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:08.250491 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5a008e12-27da-42e1-af21-148ea193653d tempest-NetworksTest-497618338 tempest-NetworksTest-497618338-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/e50c37a5-7b35-497b-af44-fdc0119017a2" status: 200 len: 652 microversion: 2.1 time: 0.177465 Oct 11 19:46:08.251409 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 594/1160] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 19:46:08 2022] GET /compute/v2.1/os-networks/e50c37a5-7b35-497b-af44-fdc0119017a2 => generated 652 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:08.256075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:08.256810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:08.265851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.266354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.266875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.267740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.268411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.268875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.295123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:08.304143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:08.305680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:08.306901 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6ae155e8-5cdf-4aa2-9a04-7190f5e934ed tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1410 microversion: 2.25 time: 0.249044 Oct 11 19:46:08.308236 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 567/1161] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:08 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1410 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:08.313364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-055c301d-5807-43c2-9519-6d72ac129982 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:08.313983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-055c301d-5807-43c2-9519-6d72ac129982 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:08.321124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-055c301d-5807-43c2-9519-6d72ac129982 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.321626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-055c301d-5807-43c2-9519-6d72ac129982 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.324369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-055c301d-5807-43c2-9519-6d72ac129982 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.325804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-055c301d-5807-43c2-9519-6d72ac129982 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.326280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-055c301d-5807-43c2-9519-6d72ac129982 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.326745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-055c301d-5807-43c2-9519-6d72ac129982 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.347130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:08.357707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:08.359546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:08.364876 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-10651c33-84da-4cf6-a569-381a2a7d68ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.112412 Oct 11 19:46:08.365442 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 595/1162] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:08 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:08.370924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-20283e90-d037-4c79-ada7-389fa818337c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:08.372413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-20283e90-d037-4c79-ada7-389fa818337c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:08.378902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20283e90-d037-4c79-ada7-389fa818337c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.379687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20283e90-d037-4c79-ada7-389fa818337c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.380209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20283e90-d037-4c79-ada7-389fa818337c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.380972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20283e90-d037-4c79-ada7-389fa818337c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.381509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20283e90-d037-4c79-ada7-389fa818337c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.382128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20283e90-d037-4c79-ada7-389fa818337c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.424037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-20283e90-d037-4c79-ada7-389fa818337c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:46:08.513719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:08.550061 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-20283e90-d037-4c79-ada7-389fa818337c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 204 len: 0 microversion: 2.1 time: 0.182065 Oct 11 19:46:08.555421 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 596/1163] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:46:08 2022] DELETE /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:46:08.563725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-adb2b8ba-8792-4590-b168-b249c0db2ee0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:08.565682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-adb2b8ba-8792-4590-b168-b249c0db2ee0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:08.579557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adb2b8ba-8792-4590-b168-b249c0db2ee0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.580562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adb2b8ba-8792-4590-b168-b249c0db2ee0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.581406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adb2b8ba-8792-4590-b168-b249c0db2ee0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.582323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adb2b8ba-8792-4590-b168-b249c0db2ee0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.582986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adb2b8ba-8792-4590-b168-b249c0db2ee0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.583589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adb2b8ba-8792-4590-b168-b249c0db2ee0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.834561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-055c301d-5807-43c2-9519-6d72ac129982 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:08.844415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-055c301d-5807-43c2-9519-6d72ac129982 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.535117 Oct 11 19:46:08.855891 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 568/1164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:08 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:08.867436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-132717a1-ab95-449f-a8f5-e5c820b153e2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:08.868380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-132717a1-ab95-449f-a8f5-e5c820b153e2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:08.875627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-132717a1-ab95-449f-a8f5-e5c820b153e2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.876498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-132717a1-ab95-449f-a8f5-e5c820b153e2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.877422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-132717a1-ab95-449f-a8f5-e5c820b153e2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.878506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-132717a1-ab95-449f-a8f5-e5c820b153e2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:08.879473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-132717a1-ab95-449f-a8f5-e5c820b153e2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:08.880117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-132717a1-ab95-449f-a8f5-e5c820b153e2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:08.901976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-adb2b8ba-8792-4590-b168-b249c0db2ee0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:08.911556 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-adb2b8ba-8792-4590-b168-b249c0db2ee0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1316 microversion: 2.1 time: 0.354604 Oct 11 19:46:08.917801 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 597/1165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:08 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:08.922665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1d0907c0-578d-4ab2-9f94-e38df6ca468c tempest-NetworksTest-497618338 tempest-NetworksTest-497618338-project-admin] Calling method '.version_select at 0x7f83cc332550>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:09.115851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-132717a1-ab95-449f-a8f5-e5c820b153e2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:09.126782 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-132717a1-ab95-449f-a8f5-e5c820b153e2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1320 microversion: 2.1 time: 0.263009 Oct 11 19:46:09.127565 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 569/1166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:08 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:09.127696 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1d0907c0-578d-4ab2-9f94-e38df6ca468c tempest-NetworksTest-497618338 tempest-NetworksTest-497618338-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6045 microversion: 2.1 time: 0.208019 Oct 11 19:46:09.128452 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 598/1167] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:46:08 2022] GET /compute/v2.1/os-networks => generated 6045 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:09.132061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dd911a59-d782-42be-9c7e-7d110850300f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:09.132664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dd911a59-d782-42be-9c7e-7d110850300f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:09.133290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e6836d4f-01e1-44f0-866d-4b4997675085 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:09.133891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e6836d4f-01e1-44f0-866d-4b4997675085 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:09.144185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6836d4f-01e1-44f0-866d-4b4997675085 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.144772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6836d4f-01e1-44f0-866d-4b4997675085 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.145035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd911a59-d782-42be-9c7e-7d110850300f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.145159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6836d4f-01e1-44f0-866d-4b4997675085 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.145463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd911a59-d782-42be-9c7e-7d110850300f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.145811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6836d4f-01e1-44f0-866d-4b4997675085 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.145930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd911a59-d782-42be-9c7e-7d110850300f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.146421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6836d4f-01e1-44f0-866d-4b4997675085 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.146562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd911a59-d782-42be-9c7e-7d110850300f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.146891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6836d4f-01e1-44f0-866d-4b4997675085 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.146998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd911a59-d782-42be-9c7e-7d110850300f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.147637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd911a59-d782-42be-9c7e-7d110850300f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.459147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e6836d4f-01e1-44f0-866d-4b4997675085 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:09.475896 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e6836d4f-01e1-44f0-866d-4b4997675085 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1379 microversion: 2.1 time: 0.346252 Oct 11 19:46:09.486676 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 599/1168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:09 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1379 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:09.500428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:09.502377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:09.509245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dd911a59-d782-42be-9c7e-7d110850300f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:09.511865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.514078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.519145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.519733 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dd911a59-d782-42be-9c7e-7d110850300f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1506 microversion: 2.1 time: 0.391253 Oct 11 19:46:09.520319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.521272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.523042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.535327 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 570/1169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:09 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:09.551284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:09.552626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:09.565148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.566150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.566855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.567830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.568498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.569103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.664552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:09.675333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:09.677185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:09.683290 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2832f0ad-c53a-4384-95b0-283b5a9d8c98 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.146534 Oct 11 19:46:09.688125 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 571/1170] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:09 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:09.705641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:09.717049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:09.718504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:09.719649 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58150683-b5f0-4b78-817e-9a633cebf7ac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1410 microversion: 2.25 time: 0.230717 Oct 11 19:46:09.720212 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 600/1171] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:09 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1410 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:09.870938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a25fe19c-acc8-4d42-ac36-de897d38435c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:09.871521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a25fe19c-acc8-4d42-ac36-de897d38435c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:09.878517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25fe19c-acc8-4d42-ac36-de897d38435c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.879204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25fe19c-acc8-4d42-ac36-de897d38435c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.879662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25fe19c-acc8-4d42-ac36-de897d38435c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.880364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25fe19c-acc8-4d42-ac36-de897d38435c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.880827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25fe19c-acc8-4d42-ac36-de897d38435c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.881256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25fe19c-acc8-4d42-ac36-de897d38435c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.937173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f61361a0-91a4-472b-8dd9-6682c079694c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:09.937821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f61361a0-91a4-472b-8dd9-6682c079694c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:09.943934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f61361a0-91a4-472b-8dd9-6682c079694c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.944427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f61361a0-91a4-472b-8dd9-6682c079694c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.944862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f61361a0-91a4-472b-8dd9-6682c079694c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:09.945843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f61361a0-91a4-472b-8dd9-6682c079694c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:09.946305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f61361a0-91a4-472b-8dd9-6682c079694c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:09.947000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f61361a0-91a4-472b-8dd9-6682c079694c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:10.091446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a25fe19c-acc8-4d42-ac36-de897d38435c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:10.100582 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a25fe19c-acc8-4d42-ac36-de897d38435c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.235184 Oct 11 19:46:10.115078 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 572/1172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:09 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:10.119046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f61361a0-91a4-472b-8dd9-6682c079694c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:10.127573 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f61361a0-91a4-472b-8dd9-6682c079694c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1316 microversion: 2.1 time: 0.194472 Oct 11 19:46:10.128141 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 601/1173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:09 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:10.149480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d997e953-8b53-44f8-bccc-1426fc6c56a4 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:10.150084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d997e953-8b53-44f8-bccc-1426fc6c56a4 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:10.156854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d997e953-8b53-44f8-bccc-1426fc6c56a4 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:10.157335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d997e953-8b53-44f8-bccc-1426fc6c56a4 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:10.157762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d997e953-8b53-44f8-bccc-1426fc6c56a4 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:10.158448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d997e953-8b53-44f8-bccc-1426fc6c56a4 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:10.158918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d997e953-8b53-44f8-bccc-1426fc6c56a4 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:10.159335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d997e953-8b53-44f8-bccc-1426fc6c56a4 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:10.296436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d997e953-8b53-44f8-bccc-1426fc6c56a4 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:10.305943 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d997e953-8b53-44f8-bccc-1426fc6c56a4 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1320 microversion: 2.1 time: 0.160559 Oct 11 19:46:10.306739 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 573/1174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:10 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:10.501843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-37a810ed-5826-4d11-87ab-2b21d61b836f req-2506091d-30b9-4d5f-86ff-9387e49e10c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ca279a-f051-4cc1-8b0e-86f2550947dc", "tag": "fbe7ab08-d9cb-479e-8e78-557e16f2a78b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:10.502839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7aa83088-ef07-41ac-9b4b-a5bd956bebfb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:10.505672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7aa83088-ef07-41ac-9b4b-a5bd956bebfb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:10.519602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa83088-ef07-41ac-9b4b-a5bd956bebfb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:10.520493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa83088-ef07-41ac-9b4b-a5bd956bebfb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:10.522443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa83088-ef07-41ac-9b4b-a5bd956bebfb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:10.523453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa83088-ef07-41ac-9b4b-a5bd956bebfb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:10.524690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-37a810ed-5826-4d11-87ab-2b21d61b836f req-2506091d-30b9-4d5f-86ff-9387e49e10c7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:10.525553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa83088-ef07-41ac-9b4b-a5bd956bebfb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:10.526065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-37a810ed-5826-4d11-87ab-2b21d61b836f req-2506091d-30b9-4d5f-86ff-9387e49e10c7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:10.526646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa83088-ef07-41ac-9b4b-a5bd956bebfb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:10.528233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-37a810ed-5826-4d11-87ab-2b21d61b836f req-2506091d-30b9-4d5f-86ff-9387e49e10c7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:10.554225 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-37a810ed-5826-4d11-87ab-2b21d61b836f req-2506091d-30b9-4d5f-86ff-9387e49e10c7 service nova] Creating event network-changed:fbe7ab08-d9cb-479e-8e78-557e16f2a78b for instance d3ca279a-f051-4cc1-8b0e-86f2550947dc on n-h1-860864-3 Oct 11 19:46:10.564652 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-37a810ed-5826-4d11-87ab-2b21d61b836f req-2506091d-30b9-4d5f-86ff-9387e49e10c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074835 Oct 11 19:46:10.568412 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 602/1175] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:10.584511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6951ca4e-9e2b-4043-8912-437da7df4df1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:10.585514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6951ca4e-9e2b-4043-8912-437da7df4df1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:10.594994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6951ca4e-9e2b-4043-8912-437da7df4df1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:10.595840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6951ca4e-9e2b-4043-8912-437da7df4df1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:10.596703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6951ca4e-9e2b-4043-8912-437da7df4df1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:10.598069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6951ca4e-9e2b-4043-8912-437da7df4df1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:10.599026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6951ca4e-9e2b-4043-8912-437da7df4df1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:10.600035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6951ca4e-9e2b-4043-8912-437da7df4df1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:11.037180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7aa83088-ef07-41ac-9b4b-a5bd956bebfb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:11.047924 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7aa83088-ef07-41ac-9b4b-a5bd956bebfb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1379 microversion: 2.1 time: 0.549816 Oct 11 19:46:11.048625 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 574/1176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:10 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1379 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:11.054079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6951ca4e-9e2b-4043-8912-437da7df4df1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:11.065479 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6951ca4e-9e2b-4043-8912-437da7df4df1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1506 microversion: 2.1 time: 0.493946 Oct 11 19:46:11.066497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:11.068085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:11.068759 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 603/1177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:10 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:11.077053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:11.080689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:11.081764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:11.085144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:11.085870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:11.086768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:11.087464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:11.089718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:11.097120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:11.097778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:11.098358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:11.099213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:11.099777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:11.100309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:11.289355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:11.309107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:11.311613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:11.327789 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-841f59d8-56ca-4295-b27d-467d7fe04e43 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.277788 Oct 11 19:46:11.348911 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 575/1178] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:11 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:11.354154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e7e57bc-b498-4cd9-a5bb-2e902437186f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:11.359181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e7e57bc-b498-4cd9-a5bb-2e902437186f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:11.365809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e7e57bc-b498-4cd9-a5bb-2e902437186f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:11.367401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e7e57bc-b498-4cd9-a5bb-2e902437186f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:11.369225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e7e57bc-b498-4cd9-a5bb-2e902437186f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:11.370186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e7e57bc-b498-4cd9-a5bb-2e902437186f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:11.370862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e7e57bc-b498-4cd9-a5bb-2e902437186f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:11.371744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e7e57bc-b498-4cd9-a5bb-2e902437186f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:11.650788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:11.655815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:11.674744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:11.676214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:11.677542 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9f1b33ad-34cd-465a-90a1-0ed5f8c80e9f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1410 microversion: 2.25 time: 0.607452 Oct 11 19:46:11.678712 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 604/1179] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:11 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1410 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:11.684459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-de0e30b7-0ae5-4e9d-94af-8ce1b5b64e18 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:11.693282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-de0e30b7-0ae5-4e9d-94af-8ce1b5b64e18 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:11.705158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de0e30b7-0ae5-4e9d-94af-8ce1b5b64e18 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:11.715440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de0e30b7-0ae5-4e9d-94af-8ce1b5b64e18 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:11.715919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de0e30b7-0ae5-4e9d-94af-8ce1b5b64e18 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:11.716692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de0e30b7-0ae5-4e9d-94af-8ce1b5b64e18 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:11.717162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de0e30b7-0ae5-4e9d-94af-8ce1b5b64e18 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:11.717593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de0e30b7-0ae5-4e9d-94af-8ce1b5b64e18 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:11.884134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e7e57bc-b498-4cd9-a5bb-2e902437186f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:11.893884 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e7e57bc-b498-4cd9-a5bb-2e902437186f tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.543610 Oct 11 19:46:11.895090 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 576/1180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:11 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:11.900437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee9281d9-687d-456e-b642-d3f0203352f0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:11.901203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ee9281d9-687d-456e-b642-d3f0203352f0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:11.909091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee9281d9-687d-456e-b642-d3f0203352f0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:11.910139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee9281d9-687d-456e-b642-d3f0203352f0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:11.910775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee9281d9-687d-456e-b642-d3f0203352f0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:11.912930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee9281d9-687d-456e-b642-d3f0203352f0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:11.913560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee9281d9-687d-456e-b642-d3f0203352f0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:11.914349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee9281d9-687d-456e-b642-d3f0203352f0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.103729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-de0e30b7-0ae5-4e9d-94af-8ce1b5b64e18 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:12.120349 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-de0e30b7-0ae5-4e9d-94af-8ce1b5b64e18 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1316 microversion: 2.1 time: 0.440249 Oct 11 19:46:12.121428 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 605/1181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:11 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:12.127682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e24824e1-0ac9-426e-a2eb-e0067e049d28 req-d501540c-a351-4a66-ae1c-74f04cc30178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bf9d5c-d025-4705-828e-4e4e389f5681", "name": "network-vif-plugged", "status": "completed", "tag": "0d0ecc45-e711-4f9a-870b-ac48a8637962"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:12.141913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e24824e1-0ac9-426e-a2eb-e0067e049d28 req-d501540c-a351-4a66-ae1c-74f04cc30178 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.142575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e24824e1-0ac9-426e-a2eb-e0067e049d28 req-d501540c-a351-4a66-ae1c-74f04cc30178 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.144007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e24824e1-0ac9-426e-a2eb-e0067e049d28 req-d501540c-a351-4a66-ae1c-74f04cc30178 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.156570 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e24824e1-0ac9-426e-a2eb-e0067e049d28 req-d501540c-a351-4a66-ae1c-74f04cc30178 service nova] Creating event network-vif-plugged:0d0ecc45-e711-4f9a-870b-ac48a8637962 for instance 72bf9d5c-d025-4705-828e-4e4e389f5681 on n-h1-860864-3 Oct 11 19:46:12.161697 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e24824e1-0ac9-426e-a2eb-e0067e049d28 req-d501540c-a351-4a66-ae1c-74f04cc30178 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038868 Oct 11 19:46:12.162763 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 606/1182] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:12.168605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ac846f9-590a-41c2-9818-68decc570136 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:12.169641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7ac846f9-590a-41c2-9818-68decc570136 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:12.176153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ac846f9-590a-41c2-9818-68decc570136 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.177257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ac846f9-590a-41c2-9818-68decc570136 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.177918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ac846f9-590a-41c2-9818-68decc570136 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.178897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ac846f9-590a-41c2-9818-68decc570136 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.179581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ac846f9-590a-41c2-9818-68decc570136 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.180227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ac846f9-590a-41c2-9818-68decc570136 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.242851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ee9281d9-687d-456e-b642-d3f0203352f0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:12.252157 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ee9281d9-687d-456e-b642-d3f0203352f0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1320 microversion: 2.1 time: 0.355653 Oct 11 19:46:12.253018 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 577/1183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:11 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:12.257504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70488f0d-3f21-4486-99b1-2834147b0605 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:12.258111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-70488f0d-3f21-4486-99b1-2834147b0605 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:12.271242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70488f0d-3f21-4486-99b1-2834147b0605 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.272073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70488f0d-3f21-4486-99b1-2834147b0605 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.272715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70488f0d-3f21-4486-99b1-2834147b0605 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.273486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70488f0d-3f21-4486-99b1-2834147b0605 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.274147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70488f0d-3f21-4486-99b1-2834147b0605 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.274778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70488f0d-3f21-4486-99b1-2834147b0605 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.444627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-70488f0d-3f21-4486-99b1-2834147b0605 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:12.458634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7ac846f9-590a-41c2-9818-68decc570136 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:12.467556 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7ac846f9-590a-41c2-9818-68decc570136 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1379 microversion: 2.1 time: 0.303324 Oct 11 19:46:12.468961 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 607/1184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:12 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1379 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:12.474253 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-70488f0d-3f21-4486-99b1-2834147b0605 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 200 len: 1464 microversion: 2.1 time: 0.220120 Oct 11 19:46:12.475831 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 578/1185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:12 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 1464 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:12.496759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:12.499839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:12.514396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.515530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.516766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.517729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.518581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.519020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.587846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-bc86392e-6d19-43cf-b37a-8b39b60e954c req-fbb2dcb0-0618-43fd-9335-7b29662bac26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffb0124-9fa9-4a38-ad03-7fece0c780fe", "tag": "7686bb0d-edf8-44e5-bb28-774c272e3719"}, {"server_uuid": "add978ad-6324-4802-a5a1-29a549940439", "name": "network-vif-deleted", "tag": "75748e5f-39c6-47ca-a09a-7abde414fd82"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:12.593684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:12.604065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:12.605555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc86392e-6d19-43cf-b37a-8b39b60e954c req-fbb2dcb0-0618-43fd-9335-7b29662bac26 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.606208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:12.607347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc86392e-6d19-43cf-b37a-8b39b60e954c req-fbb2dcb0-0618-43fd-9335-7b29662bac26 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.607793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc86392e-6d19-43cf-b37a-8b39b60e954c req-fbb2dcb0-0618-43fd-9335-7b29662bac26 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.614785 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51e73289-b1b6-40b8-a3fd-c6442adb0fa4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.143076 Oct 11 19:46:12.627388 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 608/1186] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:12 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:12.668649 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bc86392e-6d19-43cf-b37a-8b39b60e954c req-fbb2dcb0-0618-43fd-9335-7b29662bac26 service nova] Creating event network-changed:7686bb0d-edf8-44e5-bb28-774c272e3719 for instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe on n-h1-860864-3 Oct 11 19:46:12.671158 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bc86392e-6d19-43cf-b37a-8b39b60e954c req-fbb2dcb0-0618-43fd-9335-7b29662bac26 service nova] Creating event network-vif-deleted:75748e5f-39c6-47ca-a09a-7abde414fd82 for instance add978ad-6324-4802-a5a1-29a549940439 on n-h2-860864-3 Oct 11 19:46:12.683403 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-bc86392e-6d19-43cf-b37a-8b39b60e954c req-fbb2dcb0-0618-43fd-9335-7b29662bac26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.099664 Oct 11 19:46:12.686505 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 579/1187] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:12.704536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:12.705757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:12.711979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.712697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.713306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.714072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.714628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.715834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.868270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:12.878330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:12.880004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:12.881694 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-19d6b00f-a84b-4a88-941b-307b8475e71d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1410 microversion: 2.25 time: 0.181411 Oct 11 19:46:12.882752 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 609/1188] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:12 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1410 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:12.917699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-976a14e3-5966-4d0b-a06e-a1817ca85683 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:12.919058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-976a14e3-5966-4d0b-a06e-a1817ca85683 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:12.925300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-976a14e3-5966-4d0b-a06e-a1817ca85683 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.925904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-976a14e3-5966-4d0b-a06e-a1817ca85683 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.926430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-976a14e3-5966-4d0b-a06e-a1817ca85683 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.927394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-976a14e3-5966-4d0b-a06e-a1817ca85683 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:12.927953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-976a14e3-5966-4d0b-a06e-a1817ca85683 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:12.928470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-976a14e3-5966-4d0b-a06e-a1817ca85683 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:12.948257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:12.985035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:13.097524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-976a14e3-5966-4d0b-a06e-a1817ca85683 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:13.107800 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-976a14e3-5966-4d0b-a06e-a1817ca85683 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.194196 Oct 11 19:46:13.119938 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 580/1189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:12 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:13.147483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6ae353f4-898c-4781-98ec-4e2df16242ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:13.148008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6ae353f4-898c-4781-98ec-4e2df16242ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:13.156466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ae353f4-898c-4781-98ec-4e2df16242ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.156963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ae353f4-898c-4781-98ec-4e2df16242ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.157406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ae353f4-898c-4781-98ec-4e2df16242ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.158117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ae353f4-898c-4781-98ec-4e2df16242ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.158632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ae353f4-898c-4781-98ec-4e2df16242ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.159290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ae353f4-898c-4781-98ec-4e2df16242ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.230950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:13.273225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=16 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:13.279150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c9b9f559-b3db-40b3-a6ec-c736dff27be2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:13.280564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c9b9f559-b3db-40b3-a6ec-c736dff27be2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:13.288969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b9f559-b3db-40b3-a6ec-c736dff27be2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.290343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b9f559-b3db-40b3-a6ec-c736dff27be2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.291132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b9f559-b3db-40b3-a6ec-c736dff27be2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.292360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b9f559-b3db-40b3-a6ec-c736dff27be2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.293163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b9f559-b3db-40b3-a6ec-c736dff27be2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.293818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b9f559-b3db-40b3-a6ec-c736dff27be2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.363141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6ae353f4-898c-4781-98ec-4e2df16242ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:13.373529 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6ae353f4-898c-4781-98ec-4e2df16242ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1316 microversion: 2.1 time: 0.229953 Oct 11 19:46:13.374119 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 610/1190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:13 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:13.492136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f2a64b7-23f6-4e74-b73e-e76e3b692130 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:13.493273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8f2a64b7-23f6-4e74-b73e-e76e3b692130 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:13.506870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c9b9f559-b3db-40b3-a6ec-c736dff27be2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:13.507356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f2a64b7-23f6-4e74-b73e-e76e3b692130 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.507813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f2a64b7-23f6-4e74-b73e-e76e3b692130 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.508276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f2a64b7-23f6-4e74-b73e-e76e3b692130 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.509037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f2a64b7-23f6-4e74-b73e-e76e3b692130 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.509636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f2a64b7-23f6-4e74-b73e-e76e3b692130 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.510068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f2a64b7-23f6-4e74-b73e-e76e3b692130 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.520254 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c9b9f559-b3db-40b3-a6ec-c736dff27be2 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1320 microversion: 2.1 time: 0.246758 Oct 11 19:46:13.521009 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 581/1191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:13 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1320 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:13.534937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:13.534937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:13.550988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.553866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.554339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.555100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.555564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.557189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.590934 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 HTTP/1.1 Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'add978ad-6324-4802-a5a1-29a549940439'} Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:13.595540 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:13.600446 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:13.600446 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:13.600446 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:13.600446 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:13.600446 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:13.600446 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:46:13.600446 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:13.601851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:13.603274 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f307fc7-3328-48f5-9c29-b044bc058777 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 404 len: 111 microversion: 2.1 time: 0.080688 Oct 11 19:46:13.622136 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 582/1192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:13 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:46:13.643928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:13.644533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:13.659423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.663156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.663719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.664551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.665120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.665679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.690425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8f2a64b7-23f6-4e74-b73e-e76e3b692130 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:13.701504 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f2a64b7-23f6-4e74-b73e-e76e3b692130 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1379 microversion: 2.1 time: 0.213912 Oct 11 19:46:13.702364 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 611/1193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:13 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1379 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:13.768516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:13.772990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1759675974", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "50a85b7f-a8bb-479c-b121-72e05795de50"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:13.777732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:13.779436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:13.784848 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2663fc20-6b7c-4db3-924b-0b0f84fe7804 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.144702 Oct 11 19:46:13.785960 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 583/1194] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:13 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:46:13.863896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] validate_networks() for [('50a85b7f-a8bb-479c-b121-72e05795de50', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:46:13.907477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:13.908089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:13.914687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.915741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.916474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.917342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:13.918191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:13.918820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:13.919435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=44 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:14.181751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:14.200884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:14.203031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:14.204590 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-74558523-ef00-4cfc-99cb-e15dd50fa519 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1410 microversion: 2.25 time: 0.301880 Oct 11 19:46:14.205393 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 584/1195] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:13 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1410 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:14.219590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6e7bd3d-8b50-4814-aef6-fbb5469892bc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:14.220451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6e7bd3d-8b50-4814-aef6-fbb5469892bc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:14.239196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e7bd3d-8b50-4814-aef6-fbb5469892bc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.240040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e7bd3d-8b50-4814-aef6-fbb5469892bc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.241451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e7bd3d-8b50-4814-aef6-fbb5469892bc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:14.242365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e7bd3d-8b50-4814-aef6-fbb5469892bc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.243020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e7bd3d-8b50-4814-aef6-fbb5469892bc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.243612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e7bd3d-8b50-4814-aef6-fbb5469892bc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:14.596954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6e7bd3d-8b50-4814-aef6-fbb5469892bc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:14.609660 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6e7bd3d-8b50-4814-aef6-fbb5469892bc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.402966 Oct 11 19:46:14.611814 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 585/1196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:14 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:14.622851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-7ae24784-0932-4952-8cd1-0a6d96c42a02 req-e92b7d64-8dc1-42dd-b523-6afa005d3f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe1637f-a670-4f41-8ab8-a80c168abe0e", "name": "network-vif-plugged", "status": "completed", "tag": "a0d00e7b-e522-4d4c-9ce3-652c535e3486"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:14.636781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7ae24784-0932-4952-8cd1-0a6d96c42a02 req-e92b7d64-8dc1-42dd-b523-6afa005d3f2c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.637670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7ae24784-0932-4952-8cd1-0a6d96c42a02 req-e92b7d64-8dc1-42dd-b523-6afa005d3f2c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.638262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7ae24784-0932-4952-8cd1-0a6d96c42a02 req-e92b7d64-8dc1-42dd-b523-6afa005d3f2c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:14.651317 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-7ae24784-0932-4952-8cd1-0a6d96c42a02 req-e92b7d64-8dc1-42dd-b523-6afa005d3f2c service nova] Creating event network-vif-plugged:a0d00e7b-e522-4d4c-9ce3-652c535e3486 for instance dfe1637f-a670-4f41-8ab8-a80c168abe0e on n-h2-860864-3 Oct 11 19:46:14.663858 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-7ae24784-0932-4952-8cd1-0a6d96c42a02 req-e92b7d64-8dc1-42dd-b523-6afa005d3f2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050793 Oct 11 19:46:14.664915 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 586/1197] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:14.665666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:46:14.667457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:46:14.672716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13bb949d-b31d-4b09-90e9-a33121a94d20 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:14.673432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-13bb949d-b31d-4b09-90e9-a33121a94d20 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:14.678710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:46:14.679523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:46:14.680408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13bb949d-b31d-4b09-90e9-a33121a94d20 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.680909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13bb949d-b31d-4b09-90e9-a33121a94d20 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.681357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13bb949d-b31d-4b09-90e9-a33121a94d20 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:14.681653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:46:14.682463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13bb949d-b31d-4b09-90e9-a33121a94d20 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.682993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13bb949d-b31d-4b09-90e9-a33121a94d20 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.683427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13bb949d-b31d-4b09-90e9-a33121a94d20 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:14.701528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.702607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.703591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:14.704741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.705435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.706101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:14.749057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:14.757406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for user 8494488a13a3496eb59a8062479816bc and project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:14.772333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:46:14.775160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:46:14.840423 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d8d7120a-6136-4d9a-8eec-e2eb11bbad65 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070602 Oct 11 19:46:14.841835 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 612/1198] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:46:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 19:46:14.847318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-208ff3ed-0bbc-4562-a62a-2fa268bb5754 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:14.848169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-208ff3ed-0bbc-4562-a62a-2fa268bb5754 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:14.855359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-208ff3ed-0bbc-4562-a62a-2fa268bb5754 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.856139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-208ff3ed-0bbc-4562-a62a-2fa268bb5754 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.856898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-208ff3ed-0bbc-4562-a62a-2fa268bb5754 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:14.857888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-208ff3ed-0bbc-4562-a62a-2fa268bb5754 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.858514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-208ff3ed-0bbc-4562-a62a-2fa268bb5754 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.859129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-208ff3ed-0bbc-4562-a62a-2fa268bb5754 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:14.922463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13bb949d-b31d-4b09-90e9-a33121a94d20 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:14.932807 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13bb949d-b31d-4b09-90e9-a33121a94d20 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1316 microversion: 2.1 time: 0.266201 Oct 11 19:46:14.935139 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 587/1199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:14 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:14.942187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd2ad324-5f2f-4f8c-a98f-d7a6cc599dd4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:14.943784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fd2ad324-5f2f-4f8c-a98f-d7a6cc599dd4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:14.953725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd2ad324-5f2f-4f8c-a98f-d7a6cc599dd4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.954561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd2ad324-5f2f-4f8c-a98f-d7a6cc599dd4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.956347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd2ad324-5f2f-4f8c-a98f-d7a6cc599dd4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:14.959490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd2ad324-5f2f-4f8c-a98f-d7a6cc599dd4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:14.960217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd2ad324-5f2f-4f8c-a98f-d7a6cc599dd4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:14.962955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd2ad324-5f2f-4f8c-a98f-d7a6cc599dd4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:15.083804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-208ff3ed-0bbc-4562-a62a-2fa268bb5754 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:15.094941 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-208ff3ed-0bbc-4562-a62a-2fa268bb5754 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1320 microversion: 2.1 time: 0.251762 Oct 11 19:46:15.095411 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 613/1200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:14 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:15.177965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fd2ad324-5f2f-4f8c-a98f-d7a6cc599dd4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:15.189591 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fd2ad324-5f2f-4f8c-a98f-d7a6cc599dd4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1379 microversion: 2.1 time: 0.253196 Oct 11 19:46:15.190578 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 588/1201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:14 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1379 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:15.196600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:15.197399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:15.206029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:15.207001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:15.207654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:15.208357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:15.208825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:15.209448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:15.311453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:15.322715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:15.325407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:15.334010 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-33b4d526-a17f-432c-840c-2517f93fa154 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.140636 Oct 11 19:46:15.335481 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 589/1202] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:15 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:15.341614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-634cee9f-7283-4e56-9617-560ef49d1a01 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:15.342222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-634cee9f-7283-4e56-9617-560ef49d1a01 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:15.368650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9edc4a6b-c260-49d9-a960-3fdfde856be0 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Calling method '.version_select at 0x7f83cc2f04c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:15.443378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-634cee9f-7283-4e56-9617-560ef49d1a01 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:15.453872 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-634cee9f-7283-4e56-9617-560ef49d1a01 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1215 microversion: 2.1 time: 0.117166 Oct 11 19:46:15.462141 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 590/1203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:15 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:15.462141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:15.462557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:15.489254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:15.489806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:15.490252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:15.493282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:15.495190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:15.495946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:15.510563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9edc4a6b-c260-49d9-a960-3fdfde856be0 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/a3810173cfde43578ffd1d9b45590d1f" status: 200 len: 371 microversion: 2.1 time: 0.411304 Oct 11 19:46:15.511485 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 614/1204] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 11 19:46:15 2022] GET /compute/v2.1/os-quota-sets/a3810173cfde43578ffd1d9b45590d1f => generated 371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:15.523148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-36b9f2c4-64c6-4d6f-9214-8e566de5e398 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc2a6c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:15.650297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36b9f2c4-64c6-4d6f-9214-8e566de5e398 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:15.650818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36b9f2c4-64c6-4d6f-9214-8e566de5e398 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:15.651253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36b9f2c4-64c6-4d6f-9214-8e566de5e398 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:15.652106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36b9f2c4-64c6-4d6f-9214-8e566de5e398 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:15.653161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36b9f2c4-64c6-4d6f-9214-8e566de5e398 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:15.653654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36b9f2c4-64c6-4d6f-9214-8e566de5e398 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:15.787340 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-36b9f2c4-64c6-4d6f-9214-8e566de5e398 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/a3810173cfde43578ffd1d9b45590d1f" status: 200 len: 328 microversion: 2.1 time: 0.267295 Oct 11 19:46:15.797857 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 615/1205] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 19:46:15 2022] PUT /compute/v2.1/os-quota-sets/a3810173cfde43578ffd1d9b45590d1f => generated 328 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:46:15.803504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:15.806917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7d65fb88-11b9-459c-84dc-97f8c539a436 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:15.810042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7d65fb88-11b9-459c-84dc-97f8c539a436 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:15.815099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:15.817267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:15.818842 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4252bd6d-5396-4b13-a6b9-ac6b861e6cd6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1410 microversion: 2.25 time: 0.362333 Oct 11 19:46:15.819864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d65fb88-11b9-459c-84dc-97f8c539a436 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:15.820686 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 591/1206] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:15 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1410 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:15.828661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fadc48e1-0619-49d5-8d90-2b143b4a8058 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:15.840084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d65fb88-11b9-459c-84dc-97f8c539a436 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:15.841225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d65fb88-11b9-459c-84dc-97f8c539a436 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:15.842505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d65fb88-11b9-459c-84dc-97f8c539a436 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:15.843404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d65fb88-11b9-459c-84dc-97f8c539a436 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:15.843885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d65fb88-11b9-459c-84dc-97f8c539a436 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:15.846506 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fadc48e1-0619-49d5-8d90-2b143b4a8058 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/a3810173cfde43578ffd1d9b45590d1f" status: 202 len: 0 microversion: 2.1 time: 0.024181 Oct 11 19:46:15.847571 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 592/1207] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 19:46:15 2022] DELETE /compute/v2.1/os-quota-sets/a3810173cfde43578ffd1d9b45590d1f => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:15.860204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-76244330-c0d8-4f38-99dc-499e6570007c tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Calling method '.version_select at 0x7f83cc4ac3a0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:15.976519 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-76244330-c0d8-4f38-99dc-499e6570007c tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/a3810173cfde43578ffd1d9b45590d1f" status: 200 len: 371 microversion: 2.1 time: 0.120703 Oct 11 19:46:15.984652 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 593/1208] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 11 19:46:15 2022] GET /compute/v2.1/os-quota-sets/a3810173cfde43578ffd1d9b45590d1f => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:15.992707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-005bf09c-1795-4ac1-8ece-9c1f28f17fa0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:15.994414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-005bf09c-1795-4ac1-8ece-9c1f28f17fa0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:16.004042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-005bf09c-1795-4ac1-8ece-9c1f28f17fa0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.004981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-005bf09c-1795-4ac1-8ece-9c1f28f17fa0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.017685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-005bf09c-1795-4ac1-8ece-9c1f28f17fa0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.018801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-005bf09c-1795-4ac1-8ece-9c1f28f17fa0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.021027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-005bf09c-1795-4ac1-8ece-9c1f28f17fa0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.023805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-005bf09c-1795-4ac1-8ece-9c1f28f17fa0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.381105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d65fb88-11b9-459c-84dc-97f8c539a436 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:16.392725 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7d65fb88-11b9-459c-84dc-97f8c539a436 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.592291 Oct 11 19:46:16.394668 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 616/1209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:15 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:16.411142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6fcd8d3b-608a-4705-a884-aff13e69317e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:16.411767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6fcd8d3b-608a-4705-a884-aff13e69317e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:16.423382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fcd8d3b-608a-4705-a884-aff13e69317e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.423894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fcd8d3b-608a-4705-a884-aff13e69317e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.424335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fcd8d3b-608a-4705-a884-aff13e69317e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.426234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fcd8d3b-608a-4705-a884-aff13e69317e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.426737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fcd8d3b-608a-4705-a884-aff13e69317e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.427164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fcd8d3b-608a-4705-a884-aff13e69317e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.436600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-005bf09c-1795-4ac1-8ece-9c1f28f17fa0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:16.456605 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-005bf09c-1795-4ac1-8ece-9c1f28f17fa0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1316 microversion: 2.1 time: 0.474457 Oct 11 19:46:16.460563 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 594/1210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:15 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:16.474261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-72445dc9-bbd7-4c1b-bc25-af8694c93228 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Calling method '.version_select at 0x7f83ccc6a940>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:16.592771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6fcd8d3b-608a-4705-a884-aff13e69317e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:16.601269 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6fcd8d3b-608a-4705-a884-aff13e69317e tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1320 microversion: 2.1 time: 0.204718 Oct 11 19:46:16.602188 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 617/1211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:16 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1320 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:16.620487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-618c3f7e-0cea-418f-bedd-0d567b81eb0e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:16.621240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-618c3f7e-0cea-418f-bedd-0d567b81eb0e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:16.632280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618c3f7e-0cea-418f-bedd-0d567b81eb0e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.633117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618c3f7e-0cea-418f-bedd-0d567b81eb0e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.633793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618c3f7e-0cea-418f-bedd-0d567b81eb0e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.634766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618c3f7e-0cea-418f-bedd-0d567b81eb0e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.635470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618c3f7e-0cea-418f-bedd-0d567b81eb0e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.636144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618c3f7e-0cea-418f-bedd-0d567b81eb0e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.754791 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-72445dc9-bbd7-4c1b-bc25-af8694c93228 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/a159db7ebcd0487da5707abc5806ecf3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.284338 Oct 11 19:46:16.755730 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 595/1212] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:46:16 2022] GET /compute/v2.1/os-quota-sets/a159db7ebcd0487da5707abc5806ecf3/defaults => generated 371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:16.760825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:16.762352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:16.771661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.772290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.772841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.773782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.774350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.774949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.781200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-618c3f7e-0cea-418f-bedd-0d567b81eb0e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:16.790632 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-618c3f7e-0cea-418f-bedd-0d567b81eb0e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1379 microversion: 2.1 time: 0.187145 Oct 11 19:46:16.791775 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 618/1213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:16 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1379 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:16.798044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-785f559f-742d-4b96-ab58-52a885b7a711 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:16.799075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-785f559f-742d-4b96-ab58-52a885b7a711 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:16.814675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-785f559f-742d-4b96-ab58-52a885b7a711 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.816047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-785f559f-742d-4b96-ab58-52a885b7a711 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.816688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-785f559f-742d-4b96-ab58-52a885b7a711 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.817814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-785f559f-742d-4b96-ab58-52a885b7a711 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.818390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-785f559f-742d-4b96-ab58-52a885b7a711 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.818945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-785f559f-742d-4b96-ab58-52a885b7a711 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.849543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:16.859219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:16.860679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:16.867647 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6770dd6d-6156-4ea7-98e5-835926b4afb6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.110192 Oct 11 19:46:16.868668 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 596/1214] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:16 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:16.876464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2b7d5a4a-ff6a-4ce2-9758-5ff46fb7a817 req-aa2807c5-8787-44be-9bf3-c02c1f87d3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ca279a-f051-4cc1-8b0e-86f2550947dc", "name": "network-vif-plugged", "status": "completed", "tag": "fbe7ab08-d9cb-479e-8e78-557e16f2a78b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:16.893154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:16.900894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2b7d5a4a-ff6a-4ce2-9758-5ff46fb7a817 req-aa2807c5-8787-44be-9bf3-c02c1f87d3e6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.901387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2b7d5a4a-ff6a-4ce2-9758-5ff46fb7a817 req-aa2807c5-8787-44be-9bf3-c02c1f87d3e6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.901827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2b7d5a4a-ff6a-4ce2-9758-5ff46fb7a817 req-aa2807c5-8787-44be-9bf3-c02c1f87d3e6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.911526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-785f559f-742d-4b96-ab58-52a885b7a711 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:16.917956 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2b7d5a4a-ff6a-4ce2-9758-5ff46fb7a817 req-aa2807c5-8787-44be-9bf3-c02c1f87d3e6 service nova] Creating event network-vif-plugged:fbe7ab08-d9cb-479e-8e78-557e16f2a78b for instance d3ca279a-f051-4cc1-8b0e-86f2550947dc on n-h1-860864-3 Oct 11 19:46:16.920444 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-785f559f-742d-4b96-ab58-52a885b7a711 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1267 microversion: 2.1 time: 0.127299 Oct 11 19:46:16.921527 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 619/1215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:16 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1267 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:16.923621 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2b7d5a4a-ff6a-4ce2-9758-5ff46fb7a817 req-aa2807c5-8787-44be-9bf3-c02c1f87d3e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052667 Oct 11 19:46:16.926391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:16.927075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:16.928601 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 597/1216] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:16.938415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.939256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.943077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:16.944068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:16.944820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:16.945250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.059648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-76b7936b-24f3-43a4-9cd1-3f50d9a9efb5 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc470b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:17.144396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:17.156919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:17.159653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:17.161155 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a4dc397-1edd-4c1c-9848-c948b347956f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1606 microversion: 2.25 time: 0.238329 Oct 11 19:46:17.163015 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 620/1217] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:16 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1606 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:17.192595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2a6ba1a8-8d77-4236-84d3-1e9c78bdf5e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:17.193303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2a6ba1a8-8d77-4236-84d3-1e9c78bdf5e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:17.205409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a6ba1a8-8d77-4236-84d3-1e9c78bdf5e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.207677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a6ba1a8-8d77-4236-84d3-1e9c78bdf5e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.208386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a6ba1a8-8d77-4236-84d3-1e9c78bdf5e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.211848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a6ba1a8-8d77-4236-84d3-1e9c78bdf5e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.215777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a6ba1a8-8d77-4236-84d3-1e9c78bdf5e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.219374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a6ba1a8-8d77-4236-84d3-1e9c78bdf5e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.230971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76b7936b-24f3-43a4-9cd1-3f50d9a9efb5 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.231510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76b7936b-24f3-43a4-9cd1-3f50d9a9efb5 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.232023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76b7936b-24f3-43a4-9cd1-3f50d9a9efb5 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.235684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76b7936b-24f3-43a4-9cd1-3f50d9a9efb5 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.238851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76b7936b-24f3-43a4-9cd1-3f50d9a9efb5 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.239397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76b7936b-24f3-43a4-9cd1-3f50d9a9efb5 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.341049 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-76b7936b-24f3-43a4-9cd1-3f50d9a9efb5 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/056f71f0d42f4d98ab76b9cf4e0b6f14" status: 200 len: 328 microversion: 2.1 time: 0.285779 Oct 11 19:46:17.345194 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 598/1218] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 19:46:17 2022] PUT /compute/v2.1/os-quota-sets/056f71f0d42f4d98ab76b9cf4e0b6f14 => generated 328 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:46:17.354563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2a6ba1a8-8d77-4236-84d3-1e9c78bdf5e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.168758 Oct 11 19:46:17.363388 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 621/1219] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 11 19:46:17 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 19:46:17.368183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba56ac0c-e3ec-4b70-a0df-74bcd38229f1 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Calling method '.version_select at 0x7f83cc4ac1f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:17.418434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c4cde6e4-4dbe-4a7c-8d3d-59cbb71a64a5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:17.419462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4cde6e4-4dbe-4a7c-8d3d-59cbb71a64a5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:17.430197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cde6e4-4dbe-4a7c-8d3d-59cbb71a64a5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.433083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cde6e4-4dbe-4a7c-8d3d-59cbb71a64a5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.433757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cde6e4-4dbe-4a7c-8d3d-59cbb71a64a5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.435670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cde6e4-4dbe-4a7c-8d3d-59cbb71a64a5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.438132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cde6e4-4dbe-4a7c-8d3d-59cbb71a64a5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.438885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cde6e4-4dbe-4a7c-8d3d-59cbb71a64a5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.503945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56ac0c-e3ec-4b70-a0df-74bcd38229f1 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.507848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56ac0c-e3ec-4b70-a0df-74bcd38229f1 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.508341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56ac0c-e3ec-4b70-a0df-74bcd38229f1 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.509143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56ac0c-e3ec-4b70-a0df-74bcd38229f1 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.516611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56ac0c-e3ec-4b70-a0df-74bcd38229f1 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.517066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56ac0c-e3ec-4b70-a0df-74bcd38229f1 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.557249 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba56ac0c-e3ec-4b70-a0df-74bcd38229f1 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/056f71f0d42f4d98ab76b9cf4e0b6f14/detail" status: 200 len: 916 microversion: 2.1 time: 0.192732 Oct 11 19:46:17.558348 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 599/1220] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:46:17 2022] GET /compute/v2.1/os-quota-sets/056f71f0d42f4d98ab76b9cf4e0b6f14/detail => generated 916 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:17.577437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c28b5796-9e80-41b4-8f1f-025a971dde4d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:17.578170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c28b5796-9e80-41b4-8f1f-025a971dde4d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:17.606805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c28b5796-9e80-41b4-8f1f-025a971dde4d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.608224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c28b5796-9e80-41b4-8f1f-025a971dde4d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.608684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c28b5796-9e80-41b4-8f1f-025a971dde4d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.613033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c28b5796-9e80-41b4-8f1f-025a971dde4d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.613510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c28b5796-9e80-41b4-8f1f-025a971dde4d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.616608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c28b5796-9e80-41b4-8f1f-025a971dde4d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.781602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c4cde6e4-4dbe-4a7c-8d3d-59cbb71a64a5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:17.791605 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c4cde6e4-4dbe-4a7c-8d3d-59cbb71a64a5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.377868 Oct 11 19:46:17.794376 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 622/1221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:17 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:17.805677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65f9d404-e434-4fc4-ba1b-333b649f1fa0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:17.807794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-65f9d404-e434-4fc4-ba1b-333b649f1fa0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:17.823955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f9d404-e434-4fc4-ba1b-333b649f1fa0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.830625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f9d404-e434-4fc4-ba1b-333b649f1fa0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.831401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f9d404-e434-4fc4-ba1b-333b649f1fa0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:17.832325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f9d404-e434-4fc4-ba1b-333b649f1fa0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:17.833700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f9d404-e434-4fc4-ba1b-333b649f1fa0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:17.834219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f9d404-e434-4fc4-ba1b-333b649f1fa0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.123871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c28b5796-9e80-41b4-8f1f-025a971dde4d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:18.149045 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c28b5796-9e80-41b4-8f1f-025a971dde4d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1505 microversion: 2.1 time: 0.586670 Oct 11 19:46:18.155690 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 600/1222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:17 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1505 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:18.169106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-397f619e-4705-42ad-9fba-d08895a4e6e1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:18.171492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-397f619e-4705-42ad-9fba-d08895a4e6e1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:18.179793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397f619e-4705-42ad-9fba-d08895a4e6e1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.180303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397f619e-4705-42ad-9fba-d08895a4e6e1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.180910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397f619e-4705-42ad-9fba-d08895a4e6e1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.181613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397f619e-4705-42ad-9fba-d08895a4e6e1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.182235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397f619e-4705-42ad-9fba-d08895a4e6e1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.182848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397f619e-4705-42ad-9fba-d08895a4e6e1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.213414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-65f9d404-e434-4fc4-ba1b-333b649f1fa0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:18.227470 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-65f9d404-e434-4fc4-ba1b-333b649f1fa0 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1320 microversion: 2.1 time: 0.430684 Oct 11 19:46:18.229624 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 623/1223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:17 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:18.248511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc363f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:18.374128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.375229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.375933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.377152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.377815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.379448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.448399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.448962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.449420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.450163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.450650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.451283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.504329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:18.513702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-397f619e-4705-42ad-9fba-d08895a4e6e1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:18.532016 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-397f619e-4705-42ad-9fba-d08895a4e6e1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1379 microversion: 2.1 time: 0.372552 Oct 11 19:46:18.534210 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 601/1224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:18 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1379 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:18.546069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:18.546725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:18.565521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.566050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.566461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.567208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.567724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.568158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.579914 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f03fadfb-2d3b-4f96-baf2-3e4b9a3fc564 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/056f71f0d42f4d98ab76b9cf4e0b6f14?user_id=fe66766b4b414207a3cb9c0ee0542670" status: 200 len: 328 microversion: 2.1 time: 0.348544 Oct 11 19:46:18.584661 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 624/1225] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 19:46:18 2022] PUT /compute/v2.1/os-quota-sets/056f71f0d42f4d98ab76b9cf4e0b6f14?user_id=fe66766b4b414207a3cb9c0ee0542670 => generated 328 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:18.591717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7a6ae0fe-aee5-4490-be9e-47863d36cd9f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:18.592678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7a6ae0fe-aee5-4490-be9e-47863d36cd9f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:18.599318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a6ae0fe-aee5-4490-be9e-47863d36cd9f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.600057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a6ae0fe-aee5-4490-be9e-47863d36cd9f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.600768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a6ae0fe-aee5-4490-be9e-47863d36cd9f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.601771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a6ae0fe-aee5-4490-be9e-47863d36cd9f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.602406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a6ae0fe-aee5-4490-be9e-47863d36cd9f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.603031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a6ae0fe-aee5-4490-be9e-47863d36cd9f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.608502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:18.715713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:18.728197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:18.729955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:18.736078 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-433eac46-72ae-4714-bd93-d7873643bdb9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.199772 Oct 11 19:46:18.736666 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 602/1226] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:18 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:18.742036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-81badd67-a0d5-47b3-b4d2-df88af2070b0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1817536763"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:18.742258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-81badd67-a0d5-47b3-b4d2-df88af2070b0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:18.749148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81badd67-a0d5-47b3-b4d2-df88af2070b0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.749712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81badd67-a0d5-47b3-b4d2-df88af2070b0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.750143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81badd67-a0d5-47b3-b4d2-df88af2070b0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.750853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81badd67-a0d5-47b3-b4d2-df88af2070b0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:18.751440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81badd67-a0d5-47b3-b4d2-df88af2070b0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:18.751861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81badd67-a0d5-47b3-b4d2-df88af2070b0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:18.940110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7a6ae0fe-aee5-4490-be9e-47863d36cd9f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:18.950019 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7a6ae0fe-aee5-4490-be9e-47863d36cd9f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1315 microversion: 2.1 time: 0.363229 Oct 11 19:46:18.969867 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 625/1227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:18 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:18.974950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-99a358d4-0424-4efd-a4c5-e43d5c9fae1d tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Calling method '.version_select at 0x7f83cc4e89d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:19.056696 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.network.security_group_api [None req-81badd67-a0d5-47b3-b4d2-df88af2070b0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Adding security group 8be8ab06-c8c8-4314-8213-96df2a32c879 to port a0d00e7b-e522-4d4c-9ce3-652c535e3486 Oct 11 19:46:19.065564 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-99a358d4-0424-4efd-a4c5-e43d5c9fae1d tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/056f71f0d42f4d98ab76b9cf4e0b6f14?user_id=fe66766b4b414207a3cb9c0ee0542670" status: 200 len: 370 microversion: 2.1 time: 0.094343 Oct 11 19:46:19.074783 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 626/1228] 10.222.0.27 () {58 vars in 1323 bytes} [Tue Oct 11 19:46:18 2022] GET /compute/v2.1/os-quota-sets/056f71f0d42f4d98ab76b9cf4e0b6f14?user_id=fe66766b4b414207a3cb9c0ee0542670 => generated 370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:19.080567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1a468f84-43fa-4534-a26d-20fda17919ea tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:19.081388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1a468f84-43fa-4534-a26d-20fda17919ea tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:19.088788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a468f84-43fa-4534-a26d-20fda17919ea tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:19.090141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a468f84-43fa-4534-a26d-20fda17919ea tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:19.090970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a468f84-43fa-4534-a26d-20fda17919ea tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:19.092027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a468f84-43fa-4534-a26d-20fda17919ea tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:19.092710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a468f84-43fa-4534-a26d-20fda17919ea tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:19.093324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a468f84-43fa-4534-a26d-20fda17919ea tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:19.478164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a468f84-43fa-4534-a26d-20fda17919ea tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:19.489191 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1a468f84-43fa-4534-a26d-20fda17919ea tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.412992 Oct 11 19:46:19.498021 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 627/1229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:19 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:19.503094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-385911b0-d793-436d-a97d-be349cc9d09f req-e7298d14-28b2-4c71-9d03-babcd31bd972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffb0124-9fa9-4a38-ad03-7fece0c780fe", "name": "network-vif-plugged", "status": "completed", "tag": "7686bb0d-edf8-44e5-bb28-774c272e3719"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:19.515834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-385911b0-d793-436d-a97d-be349cc9d09f req-e7298d14-28b2-4c71-9d03-babcd31bd972 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:19.516418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-385911b0-d793-436d-a97d-be349cc9d09f req-e7298d14-28b2-4c71-9d03-babcd31bd972 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:19.516847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-385911b0-d793-436d-a97d-be349cc9d09f req-e7298d14-28b2-4c71-9d03-babcd31bd972 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:19.529712 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-385911b0-d793-436d-a97d-be349cc9d09f req-e7298d14-28b2-4c71-9d03-babcd31bd972 service nova] Creating event network-vif-plugged:7686bb0d-edf8-44e5-bb28-774c272e3719 for instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe on n-h1-860864-3 Oct 11 19:46:19.535442 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-385911b0-d793-436d-a97d-be349cc9d09f req-e7298d14-28b2-4c71-9d03-babcd31bd972 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035881 Oct 11 19:46:19.536210 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 628/1230] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:19.541568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e83d572c-9c79-4c8c-ab5f-e448990b1330 req-c84b9639-159f-4f7f-9fc4-c8bd3518e2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb63556-0909-48c6-b68a-edce831b629c", "tag": "d734d00f-181e-495b-8ad0-87864f3ae86d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:19.566202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e83d572c-9c79-4c8c-ab5f-e448990b1330 req-c84b9639-159f-4f7f-9fc4-c8bd3518e2dd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:19.567910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e83d572c-9c79-4c8c-ab5f-e448990b1330 req-c84b9639-159f-4f7f-9fc4-c8bd3518e2dd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:19.568622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e83d572c-9c79-4c8c-ab5f-e448990b1330 req-c84b9639-159f-4f7f-9fc4-c8bd3518e2dd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:19.589777 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e83d572c-9c79-4c8c-ab5f-e448990b1330 req-c84b9639-159f-4f7f-9fc4-c8bd3518e2dd service nova] Creating event network-changed:d734d00f-181e-495b-8ad0-87864f3ae86d for instance 5fb63556-0909-48c6-b68a-edce831b629c on n-h2-860864-3 Oct 11 19:46:19.597686 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e83d572c-9c79-4c8c-ab5f-e448990b1330 req-c84b9639-159f-4f7f-9fc4-c8bd3518e2dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059714 Oct 11 19:46:19.599635 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 629/1231] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:19.609946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e46e1fed-716a-411f-88ef-8f3baee01932 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:19.611252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e46e1fed-716a-411f-88ef-8f3baee01932 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:19.620449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e46e1fed-716a-411f-88ef-8f3baee01932 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:19.621802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e46e1fed-716a-411f-88ef-8f3baee01932 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:19.623282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e46e1fed-716a-411f-88ef-8f3baee01932 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:19.624028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e46e1fed-716a-411f-88ef-8f3baee01932 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:19.624490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e46e1fed-716a-411f-88ef-8f3baee01932 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:19.624919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e46e1fed-716a-411f-88ef-8f3baee01932 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.045809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e46e1fed-716a-411f-88ef-8f3baee01932 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:20.057177 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e46e1fed-716a-411f-88ef-8f3baee01932 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1469 microversion: 2.1 time: 0.455674 Oct 11 19:46:20.059954 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 630/1232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:19 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1469 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:20.066379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-46aa1161-316c-4cc9-8a14-75419181392d tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Calling method '.version_select at 0x7f83cc4f0c10>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:20.088965 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-81badd67-a0d5-47b3-b4d2-df88af2070b0 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e/action" status: 202 len: 0 microversion: 2.1 time: 1.351226 Oct 11 19:46:20.090511 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 603/1233] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:18 2022] POST /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e/action => generated 0 bytes in 1353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:20.096679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-80d30a22-e96c-49ff-a3f0-6a202ca83309 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:20.097452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-80d30a22-e96c-49ff-a3f0-6a202ca83309 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:20.107094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80d30a22-e96c-49ff-a3f0-6a202ca83309 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.107832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80d30a22-e96c-49ff-a3f0-6a202ca83309 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.109065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80d30a22-e96c-49ff-a3f0-6a202ca83309 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.110176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80d30a22-e96c-49ff-a3f0-6a202ca83309 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.111457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80d30a22-e96c-49ff-a3f0-6a202ca83309 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.112250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80d30a22-e96c-49ff-a3f0-6a202ca83309 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.296662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-80d30a22-e96c-49ff-a3f0-6a202ca83309 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:20.303182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:20.310251 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-80d30a22-e96c-49ff-a3f0-6a202ca83309 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1379 microversion: 2.1 time: 0.218239 Oct 11 19:46:20.311440 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 604/1234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:20 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1379 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:20.316182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:20.317064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:20.337683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.339683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.340486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.341402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.342224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.342829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.365394 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-46aa1161-316c-4cc9-8a14-75419181392d tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/a159db7ebcd0487da5707abc5806ecf3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.303471 Oct 11 19:46:20.374890 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 631/1235] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:46:20 2022] GET /compute/v2.1/os-quota-sets/a159db7ebcd0487da5707abc5806ecf3/defaults => generated 371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:20.380841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4e687c63-9981-421f-b006-8296adbe3b66 req-bfc5ad19-edde-433d-808a-03d59f46e6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72bf9d5c-d025-4705-828e-4e4e389f5681", "tag": "0d0ecc45-e711-4f9a-870b-ac48a8637962"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:20.392250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4e687c63-9981-421f-b006-8296adbe3b66 req-bfc5ad19-edde-433d-808a-03d59f46e6eb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.393056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4e687c63-9981-421f-b006-8296adbe3b66 req-bfc5ad19-edde-433d-808a-03d59f46e6eb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.393177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4e687c63-9981-421f-b006-8296adbe3b66 req-bfc5ad19-edde-433d-808a-03d59f46e6eb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.405664 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4e687c63-9981-421f-b006-8296adbe3b66 req-bfc5ad19-edde-433d-808a-03d59f46e6eb service nova] Creating event network-changed:0d0ecc45-e711-4f9a-870b-ac48a8637962 for instance 72bf9d5c-d025-4705-828e-4e4e389f5681 on n-h1-860864-3 Oct 11 19:46:20.414838 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4e687c63-9981-421f-b006-8296adbe3b66 req-bfc5ad19-edde-433d-808a-03d59f46e6eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038613 Oct 11 19:46:20.415837 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 632/1236] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:20.421526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-85e13e6e-42d2-426d-ab76-b2a6021c0eba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:20.422230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-85e13e6e-42d2-426d-ab76-b2a6021c0eba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:20.428729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85e13e6e-42d2-426d-ab76-b2a6021c0eba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.429221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85e13e6e-42d2-426d-ab76-b2a6021c0eba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.429673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85e13e6e-42d2-426d-ab76-b2a6021c0eba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.430385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85e13e6e-42d2-426d-ab76-b2a6021c0eba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.431047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85e13e6e-42d2-426d-ab76-b2a6021c0eba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.431486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85e13e6e-42d2-426d-ab76-b2a6021c0eba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.440333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:20.448614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:20.450213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:20.458986 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c4f9b185-7552-4160-9de3-6222ecb14cd2 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.146238 Oct 11 19:46:20.461117 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 605/1237] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:20 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:20.468051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d083fe16-7275-49c0-bc94-afffb366f61c tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:20.468910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d083fe16-7275-49c0-bc94-afffb366f61c tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:20.479293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d083fe16-7275-49c0-bc94-afffb366f61c tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.481513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d083fe16-7275-49c0-bc94-afffb366f61c tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.482088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d083fe16-7275-49c0-bc94-afffb366f61c tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.487171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d083fe16-7275-49c0-bc94-afffb366f61c tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.487926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d083fe16-7275-49c0-bc94-afffb366f61c tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.488091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d083fe16-7275-49c0-bc94-afffb366f61c tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.524202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-d083fe16-7275-49c0-bc94-afffb366f61c tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lazy-loading 'flavor' on Instance uuid d3ca279a-f051-4cc1-8b0e-86f2550947dc {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:46:20.594867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-85e13e6e-42d2-426d-ab76-b2a6021c0eba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:20.595076 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d083fe16-7275-49c0-bc94-afffb366f61c tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc/action" status: 202 len: 0 microversion: 2.1 time: 0.132227 Oct 11 19:46:20.595630 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 606/1238] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:20 2022] POST /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:20.603027 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-85e13e6e-42d2-426d-ab76-b2a6021c0eba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1315 microversion: 2.1 time: 0.185979 Oct 11 19:46:20.603156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d3d919b1-9e58-46b9-922a-30b56fbd0435 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-430450329"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:20.603611 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 633/1239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:20 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:20.603742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d3d919b1-9e58-46b9-922a-30b56fbd0435 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:20.608041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eafb80dd-a6c5-419e-8508-1eaaa6981be0 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Action: 'update', calling method: .version_select at 0x7f83d089bf70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:20.610238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3d919b1-9e58-46b9-922a-30b56fbd0435 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.610949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3d919b1-9e58-46b9-922a-30b56fbd0435 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.611550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3d919b1-9e58-46b9-922a-30b56fbd0435 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.612421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3d919b1-9e58-46b9-922a-30b56fbd0435 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.612886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3d919b1-9e58-46b9-922a-30b56fbd0435 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.613360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3d919b1-9e58-46b9-922a-30b56fbd0435 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.687236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eafb80dd-a6c5-419e-8508-1eaaa6981be0 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.688300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eafb80dd-a6c5-419e-8508-1eaaa6981be0 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.688954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eafb80dd-a6c5-419e-8508-1eaaa6981be0 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.690079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eafb80dd-a6c5-419e-8508-1eaaa6981be0 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.690959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eafb80dd-a6c5-419e-8508-1eaaa6981be0 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.691580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eafb80dd-a6c5-419e-8508-1eaaa6981be0 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.760499 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.network.security_group_api [None req-d3d919b1-9e58-46b9-922a-30b56fbd0435 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Adding security group 7038a674-90c6-4c50-bb6c-ba9f1c8ca7e8 to port a0d00e7b-e522-4d4c-9ce3-652c535e3486 Oct 11 19:46:20.961443 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eafb80dd-a6c5-419e-8508-1eaaa6981be0 tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/a159db7ebcd0487da5707abc5806ecf3" status: 200 len: 329 microversion: 2.1 time: 0.356776 Oct 11 19:46:20.962358 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 634/1240] 10.222.0.27 () {60 vars in 1263 bytes} [Tue Oct 11 19:46:20 2022] PUT /compute/v2.1/os-quota-sets/a159db7ebcd0487da5707abc5806ecf3 => generated 329 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:20.967701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-284474c5-8bf2-44a1-a9a6-079dbe946f37 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:20.968525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-284474c5-8bf2-44a1-a9a6-079dbe946f37 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:20.974912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-284474c5-8bf2-44a1-a9a6-079dbe946f37 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.975620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-284474c5-8bf2-44a1-a9a6-079dbe946f37 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.976205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-284474c5-8bf2-44a1-a9a6-079dbe946f37 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:20.977074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-284474c5-8bf2-44a1-a9a6-079dbe946f37 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:20.977673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-284474c5-8bf2-44a1-a9a6-079dbe946f37 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:20.978253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-284474c5-8bf2-44a1-a9a6-079dbe946f37 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:21.210876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-284474c5-8bf2-44a1-a9a6-079dbe946f37 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:21.224752 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-284474c5-8bf2-44a1-a9a6-079dbe946f37 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.261146 Oct 11 19:46:21.226563 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 635/1241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:20 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:21.248439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ee167806-3f68-4211-9694-51493ace4488 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:21.250590 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d3d919b1-9e58-46b9-922a-30b56fbd0435 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e/action" status: 202 len: 0 microversion: 2.1 time: 0.653372 Oct 11 19:46:21.254279 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 607/1242] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:20 2022] POST /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:21.254426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ee167806-3f68-4211-9694-51493ace4488 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:21.256643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-125da22e-dc85-49db-b397-26015461a1cb tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc4af4c0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:21.264489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee167806-3f68-4211-9694-51493ace4488 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:21.267117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee167806-3f68-4211-9694-51493ace4488 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:21.267647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee167806-3f68-4211-9694-51493ace4488 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:21.269295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee167806-3f68-4211-9694-51493ace4488 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:21.271941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee167806-3f68-4211-9694-51493ace4488 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:21.272462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee167806-3f68-4211-9694-51493ace4488 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:21.349856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-125da22e-dc85-49db-b397-26015461a1cb tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:21.350422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-125da22e-dc85-49db-b397-26015461a1cb tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:21.350974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-125da22e-dc85-49db-b397-26015461a1cb tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:21.351769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-125da22e-dc85-49db-b397-26015461a1cb tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:21.352605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-125da22e-dc85-49db-b397-26015461a1cb tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:21.353254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-125da22e-dc85-49db-b397-26015461a1cb tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:21.704267 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ee167806-3f68-4211-9694-51493ace4488 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1628 microversion: 2.1 time: 0.477318 Oct 11 19:46:21.720345 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 636/1243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:21 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1628 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:21.727937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-723be43b-bab7-45ab-97f5-18013f1bba8a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:21.732192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-723be43b-bab7-45ab-97f5-18013f1bba8a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:21.740770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-723be43b-bab7-45ab-97f5-18013f1bba8a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:21.741263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-723be43b-bab7-45ab-97f5-18013f1bba8a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:21.742517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-723be43b-bab7-45ab-97f5-18013f1bba8a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:21.743278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-723be43b-bab7-45ab-97f5-18013f1bba8a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:21.743738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-723be43b-bab7-45ab-97f5-18013f1bba8a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:21.744355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-723be43b-bab7-45ab-97f5-18013f1bba8a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:21.758565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=14,nova_api:UPDATE=13 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:21.828281 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-125da22e-dc85-49db-b397-26015461a1cb tempest-QuotasAdminTestJSON-1636789727 tempest-QuotasAdminTestJSON-1636789727-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/a159db7ebcd0487da5707abc5806ecf3" status: 200 len: 329 microversion: 2.1 time: 0.575720 Oct 11 19:46:21.837125 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 608/1244] 10.222.0.27 () {60 vars in 1263 bytes} [Tue Oct 11 19:46:21 2022] PUT /compute/v2.1/os-quota-sets/a159db7ebcd0487da5707abc5806ecf3 => generated 329 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:21.847144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ee1efd5-5115-4974-991b-026ca5ca4ffc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:21.847869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ee1efd5-5115-4974-991b-026ca5ca4ffc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:21.862603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ee1efd5-5115-4974-991b-026ca5ca4ffc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:21.863126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ee1efd5-5115-4974-991b-026ca5ca4ffc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:21.863568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ee1efd5-5115-4974-991b-026ca5ca4ffc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:21.864278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ee1efd5-5115-4974-991b-026ca5ca4ffc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:21.864794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ee1efd5-5115-4974-991b-026ca5ca4ffc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:21.865205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ee1efd5-5115-4974-991b-026ca5ca4ffc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.059993 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-723be43b-bab7-45ab-97f5-18013f1bba8a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.338055 Oct 11 19:46:22.061179 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 637/1245] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 11 19:46:21 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e/os-security-groups => generated 1157 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:22.066850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:22.067739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:22.088336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.092373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.092978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.094737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.096236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.099094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.209999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7ee1efd5-5115-4974-991b-026ca5ca4ffc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:22.222835 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ee1efd5-5115-4974-991b-026ca5ca4ffc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1528 microversion: 2.1 time: 0.384425 Oct 11 19:46:22.223055 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 609/1246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:21 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1528 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:22.233609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-081ccae0-1351-47bb-b271-9f1fc35b55c0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:22.234384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-081ccae0-1351-47bb-b271-9f1fc35b55c0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:22.243407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:22.257992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ccae0-1351-47bb-b271-9f1fc35b55c0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.258662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:22.260200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ccae0-1351-47bb-b271-9f1fc35b55c0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.260369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:22.260676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ccae0-1351-47bb-b271-9f1fc35b55c0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.262154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ccae0-1351-47bb-b271-9f1fc35b55c0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.262654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ccae0-1351-47bb-b271-9f1fc35b55c0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.263084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ccae0-1351-47bb-b271-9f1fc35b55c0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.268599 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0d1c2a9c-26e1-42b7-907c-85952857b288 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.206149 Oct 11 19:46:22.269213 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 638/1247] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:22 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:22.275296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58cde772-5cc1-4ed9-9520-54f75156fbee tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: .version_select at 0x7f83d089b310>, body: {"security_group": {"name": " tempest-securitygroup -786190561 ", "description": "tempest-description-846240280"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:22.475436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-081ccae0-1351-47bb-b271-9f1fc35b55c0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:22.484210 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-081ccae0-1351-47bb-b271-9f1fc35b55c0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1315 microversion: 2.1 time: 0.260137 Oct 11 19:46:22.497444 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 610/1248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:22 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:22.502123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5696a780-c231-4bc9-9861-04f7a1b27971 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:22.502845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5696a780-c231-4bc9-9861-04f7a1b27971 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:22.510344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5696a780-c231-4bc9-9861-04f7a1b27971 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.510953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5696a780-c231-4bc9-9861-04f7a1b27971 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.512159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5696a780-c231-4bc9-9861-04f7a1b27971 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.513104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5696a780-c231-4bc9-9861-04f7a1b27971 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.513565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5696a780-c231-4bc9-9861-04f7a1b27971 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.514027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5696a780-c231-4bc9-9861-04f7a1b27971 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.521207 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58cde772-5cc1-4ed9-9520-54f75156fbee tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.250472 Oct 11 19:46:22.521857 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 639/1249] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:46:22 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:22.530990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7cd3e971-c5d8-4207-9cc5-fec32730c640 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:22.531794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7cd3e971-c5d8-4207-9cc5-fec32730c640 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:22.539010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cd3e971-c5d8-4207-9cc5-fec32730c640 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.539906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cd3e971-c5d8-4207-9cc5-fec32730c640 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.542757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cd3e971-c5d8-4207-9cc5-fec32730c640 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.544220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cd3e971-c5d8-4207-9cc5-fec32730c640 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.545240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cd3e971-c5d8-4207-9cc5-fec32730c640 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.545874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cd3e971-c5d8-4207-9cc5-fec32730c640 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.723370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5696a780-c231-4bc9-9861-04f7a1b27971 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:22.726940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7cd3e971-c5d8-4207-9cc5-fec32730c640 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:22.732518 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5696a780-c231-4bc9-9861-04f7a1b27971 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1528 microversion: 2.1 time: 0.246693 Oct 11 19:46:22.734691 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 611/1250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:22 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1528 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:22.738292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d67d67c7-f669-42b5-975d-00c54a540862 req-667692e5-11db-47fa-b9d9-329f97ac27cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfe1637f-a670-4f41-8ab8-a80c168abe0e", "tag": "a0d00e7b-e522-4d4c-9ce3-652c535e3486"}, {"name": "network-changed", "server_uuid": "dfe1637f-a670-4f41-8ab8-a80c168abe0e", "tag": "a0d00e7b-e522-4d4c-9ce3-652c535e3486"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:22.738672 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7cd3e971-c5d8-4207-9cc5-fec32730c640 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.215352 Oct 11 19:46:22.739715 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 640/1251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:22 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:22.747535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-43a425bb-f6a7-4339-af73-2ddac6c0ef85 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc33b3a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:22.750338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d67d67c7-f669-42b5-975d-00c54a540862 req-667692e5-11db-47fa-b9d9-329f97ac27cd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.750968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d67d67c7-f669-42b5-975d-00c54a540862 req-667692e5-11db-47fa-b9d9-329f97ac27cd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.751499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d67d67c7-f669-42b5-975d-00c54a540862 req-667692e5-11db-47fa-b9d9-329f97ac27cd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.763107 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d67d67c7-f669-42b5-975d-00c54a540862 req-667692e5-11db-47fa-b9d9-329f97ac27cd service nova] Creating event network-changed:a0d00e7b-e522-4d4c-9ce3-652c535e3486 for instance dfe1637f-a670-4f41-8ab8-a80c168abe0e on n-h2-860864-3 Oct 11 19:46:22.763773 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d67d67c7-f669-42b5-975d-00c54a540862 req-667692e5-11db-47fa-b9d9-329f97ac27cd service nova] Creating event network-changed:a0d00e7b-e522-4d4c-9ce3-652c535e3486 for instance dfe1637f-a670-4f41-8ab8-a80c168abe0e on n-h2-860864-3 Oct 11 19:46:22.769150 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d67d67c7-f669-42b5-975d-00c54a540862 req-667692e5-11db-47fa-b9d9-329f97ac27cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034561 Oct 11 19:46:22.770195 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 612/1252] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:22.775096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-25dbaaf4-f28e-4f23-9f9b-460e9d5f98e2 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:22.775886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-25dbaaf4-f28e-4f23-9f9b-460e9d5f98e2 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:22.784979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25dbaaf4-f28e-4f23-9f9b-460e9d5f98e2 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.785594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25dbaaf4-f28e-4f23-9f9b-460e9d5f98e2 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.786104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25dbaaf4-f28e-4f23-9f9b-460e9d5f98e2 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.787243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25dbaaf4-f28e-4f23-9f9b-460e9d5f98e2 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:22.787576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25dbaaf4-f28e-4f23-9f9b-460e9d5f98e2 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:22.788098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25dbaaf4-f28e-4f23-9f9b-460e9d5f98e2 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:22.817669 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-43a425bb-f6a7-4339-af73-2ddac6c0ef85 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a" status: 200 len: 222 microversion: 2.1 time: 0.076664 Oct 11 19:46:22.818439 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 641/1253] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:46:22 2022] GET /compute/v2.1/os-security-groups/850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a => generated 222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:22.822964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a8ddde5f-a155-4ede-92e4-fca298652f78 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:22.851502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a8ddde5f-a155-4ede-92e4-fca298652f78 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/a16441dd-a497-462e-a030-05fdadab9305" status: 202 len: 0 microversion: 2.1 time: 0.031713 Oct 11 19:46:22.852649 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 642/1254] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:46:22 2022] DELETE /compute/v2.1/flavors/a16441dd-a497-462e-a030-05fdadab9305 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:22.857933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3e53604c-b96c-4bf7-8e36-c6e7ad562f75 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc4f0430>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:23.008529 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-25dbaaf4-f28e-4f23-9f9b-460e9d5f98e2 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1611 microversion: 2.1 time: 0.237140 Oct 11 19:46:23.009056 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 613/1255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:22 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1611 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:23.014603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3f9db9b4-5d69-4e0f-8bf3-b2afaa428023 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:23.042702 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3f9db9b4-5d69-4e0f-8bf3-b2afaa428023 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031705 Oct 11 19:46:23.043823 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 614/1256] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:46:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:23.050037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:23.050632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:23.057524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.058817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.058977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.059766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.060215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.060630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.140179 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] HTTP exception thrown: Cannot 'migrate' instance d3ca279a-f051-4cc1-8b0e-86f2550947dc while it is in vm_state suspended Oct 11 19:46:23.140782 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3e53604c-b96c-4bf7-8e36-c6e7ad562f75 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a" status: 202 len: 0 microversion: 2.1 time: 0.286765 Oct 11 19:46:23.141557 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 643/1257] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:46:22 2022] DELETE /compute/v2.1/os-security-groups/850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Request method failure captured: Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc/action HTTP/1.1 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 15 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfjM-ev_Veo-SIkjNmCnVshTQ1puEskARGnnYWl5JyGCV7czPiaNfp81l5uo-fwK27JIhkPi26G4A4bU4SjLuOQcs1PhpJtShb8xMLdKdkT8tk4rzDhv27CyCvTYPLwW35VwDLLF_vN3ocLqmThBt3NqfJA94toi15O-7ngy_KH9D0 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 7c735524b75642ac922a97068c6893c7 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c735524b75642ac922a97068c6893c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c735524b75642ac922a97068c6893c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c735524b75642ac922a97068c6893c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c735524b75642ac922a97068c6893c7"}]}] Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 7c735524b75642ac922a97068c6893c7 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAdminNegativeTestJSON-1673970645-project-admin Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: fd403072ddfa4b60acfd868b1b551145 Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1673970645-project-admin Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: {"migrate": {}} Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: exception: Cannot 'migrate' instance d3ca279a-f051-4cc1-8b0e-86f2550947dc while it is in vm_state suspended Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'd3ca279a-f051-4cc1-8b0e-86f2550947dc', 'body': {'migrate': {}}} Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d3ca279a-f051-4cc1-8b0e-86f2550947dc in vm_state suspended. Cannot resize while the instance is in this state. Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:23.141863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance d3ca279a-f051-4cc1-8b0e-86f2550947dc while it is in vm_state suspended Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance d3ca279a-f051-4cc1-8b0e-86f2550947dc while it is in vm_state suspended Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Returning 409 to user: Cannot 'migrate' instance d3ca279a-f051-4cc1-8b0e-86f2550947dc while it is in vm_state suspended {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b9a13c56-502c-4710-bb19-099ee0116893 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc/action" status: 409 len: 148 microversion: 2.1 time: 0.098609 Oct 11 19:46:23.145935 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 615/1258] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:23 2022] POST /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc/action => generated 148 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:46:23.154258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:23.156583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e401a23-819f-4acd-91c3-db95e16fb319 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:23.160191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e401a23-819f-4acd-91c3-db95e16fb319 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Request method failure captured: Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d/action HTTP/1.1 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 39 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfjM-ev_Veo-SIkjNmCnVshTQ1puEskARGnnYWl5JyGCV7czPiaNfp81l5uo-fwK27JIhkPi26G4A4bU4SjLuOQcs1PhpJtShb8xMLdKdkT8tk4rzDhv27CyCvTYPLwW35VwDLLF_vN3ocLqmThBt3NqfJA94toi15O-7ngy_KH9D0 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 7c735524b75642ac922a97068c6893c7 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c735524b75642ac922a97068c6893c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c735524b75642ac922a97068c6893c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c735524b75642ac922a97068c6893c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c735524b75642ac922a97068c6893c7"}]}] Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 7c735524b75642ac922a97068c6893c7 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAdminNegativeTestJSON-1673970645-project-admin Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: fd403072ddfa4b60acfd868b1b551145 Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1673970645-project-admin Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: {"os-resetState": {"state": "invalid"}} Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ba8bc215-3672-4c18-9441-8479acacc17d', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:46:23.160391 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e401a23-819f-4acd-91c3-db95e16fb319 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e401a23-819f-4acd-91c3-db95e16fb319 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d/action" status: 400 len: 144 microversion: 2.1 time: 0.010037 Oct 11 19:46:23.164459 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 616/1259] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:23 2022] POST /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d/action => generated 144 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:46:23.166877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6fd0713-0a01-47da-b07f-43a93b67f613 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc466d30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:23.179066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.179580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.180026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.180755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.181220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.181650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.223381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-d6fd0713-0a01-47da-b07f-43a93b67f613 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:46:23.223983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.security_group_api [None req-d6fd0713-0a01-47da-b07f-43a93b67f613 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Neutron security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a not found {{(pid=126956) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:46:23.224501 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-d6fd0713-0a01-47da-b07f-43a93b67f613 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:46:23.224501 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-d756affd-b41f-475b-97af-b8d3620b993d'] Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6fd0713-0a01-47da-b07f-43a93b67f613 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-security-groups/850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a HTTP/1.1 Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: exception: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-d756affd-b41f-475b-97af-b8d3620b993d'] Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a'} Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:46:23.228270 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d756affd-b41f-475b-97af-b8d3620b993d'] Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d756affd-b41f-475b-97af-b8d3620b993d'] Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d756affd-b41f-475b-97af-b8d3620b993d'] Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d756affd-b41f-475b-97af-b8d3620b993d'] Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6fd0713-0a01-47da-b07f-43a93b67f613 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-d756affd-b41f-475b-97af-b8d3620b993d'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6fd0713-0a01-47da-b07f-43a93b67f613 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a" status: 404 len: 194 microversion: 2.1 time: 0.066564 Oct 11 19:46:23.233036 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 617/1260] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:46:23 2022] GET /compute/v2.1/os-security-groups/850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:46:23.240123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe61ab2e-2feb-4f80-be47-fc25c3b08f5a tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe61ab2e-2feb-4f80-be47-fc25c3b08f5a tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Request method failure captured: Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d/action HTTP/1.1 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 31 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfjM-ev_Veo-SIkjNmCnVshTQ1puEskARGnnYWl5JyGCV7czPiaNfp81l5uo-fwK27JIhkPi26G4A4bU4SjLuOQcs1PhpJtShb8xMLdKdkT8tk4rzDhv27CyCvTYPLwW35VwDLLF_vN3ocLqmThBt3NqfJA94toi15O-7ngy_KH9D0 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 7c735524b75642ac922a97068c6893c7 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c735524b75642ac922a97068c6893c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c735524b75642ac922a97068c6893c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c735524b75642ac922a97068c6893c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c735524b75642ac922a97068c6893c7"}]}] Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 7c735524b75642ac922a97068c6893c7 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAdminNegativeTestJSON-1673970645-project-admin Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: fd403072ddfa4b60acfd868b1b551145 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1673970645-project-admin Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: {"os-resetState": {"state": 1}} Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ba8bc215-3672-4c18-9441-8479acacc17d', 'body': {'os-resetState': {'state': 1}}} Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 1 Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 19:46:23.240587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe61ab2e-2feb-4f80-be47-fc25c3b08f5a tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fe61ab2e-2feb-4f80-be47-fc25c3b08f5a tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d/action" status: 400 len: 120 microversion: 2.1 time: 0.009584 Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 618/1261] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:23 2022] POST /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:46:23.251367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a42e570c-34e4-4548-ac16-87d9c7c96481 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: .version_select at 0x7f83cc493700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1289366542", "description": "tempest-description-921444604"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:23.296023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:23.303442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Old instance type tempest-test_resize_flavor_-1579711021, new instance type m1.heat {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 19:46:23.314208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:46:23.317613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:46:23.318365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:46:23.318977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:46:23.319557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:46:23.466551 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ceed9791-d0f3-4072-b491-1d071d6ff917 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe/action" status: 202 len: 0 microversion: 2.1 time: 0.316829 Oct 11 19:46:23.467756 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 644/1262] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:23 2022] POST /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:23.474251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0a1caaa-09f1-4166-921d-581e5bd711a7 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:23.478009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c0a1caaa-09f1-4166-921d-581e5bd711a7 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Failed to fetch instance by id 999 {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 19:46:23.479235 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c0a1caaa-09f1-4166-921d-581e5bd711a7 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0a1caaa-09f1-4166-921d-581e5bd711a7 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Request method failure captured: Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 37 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfjM-ev_Veo-SIkjNmCnVshTQ1puEskARGnnYWl5JyGCV7czPiaNfp81l5uo-fwK27JIhkPi26G4A4bU4SjLuOQcs1PhpJtShb8xMLdKdkT8tk4rzDhv27CyCvTYPLwW35VwDLLF_vN3ocLqmThBt3NqfJA94toi15O-7ngy_KH9D0 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 7c735524b75642ac922a97068c6893c7 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c735524b75642ac922a97068c6893c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c735524b75642ac922a97068c6893c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c735524b75642ac922a97068c6893c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c735524b75642ac922a97068c6893c7"}]}] Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 7c735524b75642ac922a97068c6893c7 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1673970645 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersAdminNegativeTestJSON-1673970645-project-admin Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: fd403072ddfa4b60acfd868b1b551145 Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1673970645-project-admin Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: {"os-resetState": {"state": "error"}} Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 999 could not be found. Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:23.481929 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:23.486701 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:23.486701 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 11 19:46:23.486701 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:23.503293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0a1caaa-09f1-4166-921d-581e5bd711a7 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:23.504398 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c0a1caaa-09f1-4166-921d-581e5bd711a7 tempest-ServersAdminNegativeTestJSON-1673970645 tempest-ServersAdminNegativeTestJSON-1673970645-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.035381 Oct 11 19:46:23.506023 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 645/1263] 10.222.0.27 () {60 vars in 1179 bytes} [Tue Oct 11 19:46:23 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:46:23.516929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:23.519855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:23.534457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.536487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.537336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.538266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.539956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.540578 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a42e570c-34e4-4548-ac16-87d9c7c96481 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.297126 Oct 11 19:46:23.541060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.541181 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 619/1264] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:46:23 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:23.546790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-325c95ee-94d3-4361-8771-f5b49867c828 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:23.547462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-325c95ee-94d3-4361-8771-f5b49867c828 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:23.557095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325c95ee-94d3-4361-8771-f5b49867c828 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.557643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325c95ee-94d3-4361-8771-f5b49867c828 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.558289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325c95ee-94d3-4361-8771-f5b49867c828 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.559223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325c95ee-94d3-4361-8771-f5b49867c828 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.560243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325c95ee-94d3-4361-8771-f5b49867c828 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.560841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325c95ee-94d3-4361-8771-f5b49867c828 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.638228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:23.653291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:23.657436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:23.664425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=15,nova_api:DELETE=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:23.669664 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2815928b-ce2c-40a9-af21-985cc9437520 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.162131 Oct 11 19:46:23.670897 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 646/1265] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:23 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:23.676470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-91ff4c0e-6e24-45dd-95af-2ccd21a09cd0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:23.677268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-91ff4c0e-6e24-45dd-95af-2ccd21a09cd0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:23.688815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91ff4c0e-6e24-45dd-95af-2ccd21a09cd0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.690702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91ff4c0e-6e24-45dd-95af-2ccd21a09cd0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.691314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91ff4c0e-6e24-45dd-95af-2ccd21a09cd0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.692542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91ff4c0e-6e24-45dd-95af-2ccd21a09cd0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.693192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91ff4c0e-6e24-45dd-95af-2ccd21a09cd0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.693773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91ff4c0e-6e24-45dd-95af-2ccd21a09cd0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.843490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-325c95ee-94d3-4361-8771-f5b49867c828 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:23.852333 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-325c95ee-94d3-4361-8771-f5b49867c828 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1537 microversion: 2.1 time: 0.310042 Oct 11 19:46:23.855903 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 620/1266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:23 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1537 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:23.870342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0e18b909-d947-440c-b4f9-205bef778335 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:23.871470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0e18b909-d947-440c-b4f9-205bef778335 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:23.884900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e18b909-d947-440c-b4f9-205bef778335 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.885391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e18b909-d947-440c-b4f9-205bef778335 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.898151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e18b909-d947-440c-b4f9-205bef778335 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.903088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e18b909-d947-440c-b4f9-205bef778335 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:23.904719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e18b909-d947-440c-b4f9-205bef778335 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:23.905750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e18b909-d947-440c-b4f9-205bef778335 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:23.946879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0e18b909-d947-440c-b4f9-205bef778335 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:46:23.986697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-91ff4c0e-6e24-45dd-95af-2ccd21a09cd0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:24.002247 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-91ff4c0e-6e24-45dd-95af-2ccd21a09cd0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1315 microversion: 2.1 time: 0.329547 Oct 11 19:46:24.002847 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 647/1267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:23 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:24.020635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9024e4a9-f849-4203-bc68-d353620225b9 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: .version_select at 0x7f83cc363f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-497224106", "description": "tempest-description-1672133629"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:24.160556 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0e18b909-d947-440c-b4f9-205bef778335 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 204 len: 0 microversion: 2.1 time: 0.303232 Oct 11 19:46:24.161555 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 621/1268] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:46:23 2022] DELETE /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:46:24.171307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b1820988-545b-443a-8b2b-34a09b2ed6cc req-999a3b96-3866-4f14-8425-10edd11153cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb63556-0909-48c6-b68a-edce831b629c", "name": "network-vif-plugged", "status": "completed", "tag": "d734d00f-181e-495b-8ad0-87864f3ae86d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:24.191880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b1820988-545b-443a-8b2b-34a09b2ed6cc req-999a3b96-3866-4f14-8425-10edd11153cd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:24.194382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b1820988-545b-443a-8b2b-34a09b2ed6cc req-999a3b96-3866-4f14-8425-10edd11153cd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:24.195989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b1820988-545b-443a-8b2b-34a09b2ed6cc req-999a3b96-3866-4f14-8425-10edd11153cd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:24.219777 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b1820988-545b-443a-8b2b-34a09b2ed6cc req-999a3b96-3866-4f14-8425-10edd11153cd service nova] Creating event network-vif-plugged:d734d00f-181e-495b-8ad0-87864f3ae86d for instance 5fb63556-0909-48c6-b68a-edce831b629c on n-h2-860864-3 Oct 11 19:46:24.235054 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b1820988-545b-443a-8b2b-34a09b2ed6cc req-999a3b96-3866-4f14-8425-10edd11153cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062770 Oct 11 19:46:24.238148 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 622/1269] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:24.251224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-27379bd0-6bc7-4818-91af-129490cdc1b3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:24.252330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-27379bd0-6bc7-4818-91af-129490cdc1b3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:24.267249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27379bd0-6bc7-4818-91af-129490cdc1b3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:24.271999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27379bd0-6bc7-4818-91af-129490cdc1b3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:24.273396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27379bd0-6bc7-4818-91af-129490cdc1b3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:24.275034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27379bd0-6bc7-4818-91af-129490cdc1b3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:24.280836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27379bd0-6bc7-4818-91af-129490cdc1b3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:24.281295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27379bd0-6bc7-4818-91af-129490cdc1b3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:24.298452 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9024e4a9-f849-4203-bc68-d353620225b9 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.290399 Oct 11 19:46:24.307612 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 648/1270] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:46:24 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:24.314770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-621bb0e1-e4a9-4e89-9577-3c5f50c6d365 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:24.315579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-621bb0e1-e4a9-4e89-9577-3c5f50c6d365 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:24.331906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-621bb0e1-e4a9-4e89-9577-3c5f50c6d365 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:24.333018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-621bb0e1-e4a9-4e89-9577-3c5f50c6d365 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:24.333821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-621bb0e1-e4a9-4e89-9577-3c5f50c6d365 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:24.341661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-621bb0e1-e4a9-4e89-9577-3c5f50c6d365 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:24.342819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-621bb0e1-e4a9-4e89-9577-3c5f50c6d365 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:24.343053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-621bb0e1-e4a9-4e89-9577-3c5f50c6d365 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:24.576140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-27379bd0-6bc7-4818-91af-129490cdc1b3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:24.588603 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-27379bd0-6bc7-4818-91af-129490cdc1b3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.346091 Oct 11 19:46:24.590017 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 623/1271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:24 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:24.602835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-621bb0e1-e4a9-4e89-9577-3c5f50c6d365 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:24.604664 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-621bb0e1-e4a9-4e89-9577-3c5f50c6d365 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1466 microversion: 2.1 time: 0.294760 Oct 11 19:46:24.605967 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 649/1272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:24 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1466 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:24.611046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10ab4761-13af-44c3-8f41-2cbf19534f15 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: .version_select at 0x7f83cc3889d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-462086941", "description": "tempest-description-732852848"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:24.705460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:24.706424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:24.714194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:24.715691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:24.716315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:24.717200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:24.718089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:24.718781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:24.817797 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10ab4761-13af-44c3-8f41-2cbf19534f15 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.213322 Oct 11 19:46:24.818908 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 624/1273] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:46:24 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:24.819960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:24.829935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:24.831877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-afeebcf8-4a22-4018-812d-6c4c42df7236 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc4d6d30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:24.832484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:24.840477 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-03b57a1c-95d7-4c5f-9624-7804be2d25d1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.139867 Oct 11 19:46:24.853347 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 650/1274] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:24 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:46:24.877036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b3c0d82a-c95e-4b99-93eb-6af448cfd792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:24.877647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b3c0d82a-c95e-4b99-93eb-6af448cfd792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:24.893170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3c0d82a-c95e-4b99-93eb-6af448cfd792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:24.893665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3c0d82a-c95e-4b99-93eb-6af448cfd792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:24.894308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3c0d82a-c95e-4b99-93eb-6af448cfd792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:24.895191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3c0d82a-c95e-4b99-93eb-6af448cfd792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:24.895983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3c0d82a-c95e-4b99-93eb-6af448cfd792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:24.896570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3c0d82a-c95e-4b99-93eb-6af448cfd792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:24.922781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:25.099642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b3c0d82a-c95e-4b99-93eb-6af448cfd792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:25.109196 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b3c0d82a-c95e-4b99-93eb-6af448cfd792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1537 microversion: 2.1 time: 0.235900 Oct 11 19:46:25.110072 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 651/1275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:24 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:25.119172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b98b7b97-4040-4435-85bf-e65ab4624283 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:25.119991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b98b7b97-4040-4435-85bf-e65ab4624283 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:25.128253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b98b7b97-4040-4435-85bf-e65ab4624283 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:25.128750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b98b7b97-4040-4435-85bf-e65ab4624283 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:25.129244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b98b7b97-4040-4435-85bf-e65ab4624283 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:25.129936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b98b7b97-4040-4435-85bf-e65ab4624283 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:25.130621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b98b7b97-4040-4435-85bf-e65ab4624283 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:25.131087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b98b7b97-4040-4435-85bf-e65ab4624283 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:25.144327 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-afeebcf8-4a22-4018-812d-6c4c42df7236 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.316309 Oct 11 19:46:25.144919 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 625/1276] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:46:24 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:25.159830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5e637dd2-e5cf-4b5d-a7ef-985f9bda3aa3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc3a4a60>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:25.371368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b98b7b97-4040-4435-85bf-e65ab4624283 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:25.380828 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b98b7b97-4040-4435-85bf-e65ab4624283 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1315 microversion: 2.1 time: 0.269313 Oct 11 19:46:25.386604 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 652/1277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:25 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:25.476168 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5e637dd2-e5cf-4b5d-a7ef-985f9bda3aa3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0d69ef99-332f-43c2-bcc2-dd763e037ff0" status: 202 len: 0 microversion: 2.1 time: 0.319948 Oct 11 19:46:25.478671 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 626/1278] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:46:25 2022] DELETE /compute/v2.1/os-security-groups/0d69ef99-332f-43c2-bcc2-dd763e037ff0 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:46:25.485432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0cfd1d06-a26b-46b3-aaf6-cbe40870b3f1 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83d078fc10>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:25.514275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-0cfd1d06-a26b-46b3-aaf6-cbe40870b3f1 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:46:25.515102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.security_group_api [None req-0cfd1d06-a26b-46b3-aaf6-cbe40870b3f1 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Neutron security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 not found {{(pid=126955) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:46:25.515762 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-0cfd1d06-a26b-46b3-aaf6-cbe40870b3f1 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:46:25.515762 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-299982af-c671-44e7-9f25-bf63083bf352'] Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0cfd1d06-a26b-46b3-aaf6-cbe40870b3f1 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-security-groups/0d69ef99-332f-43c2-bcc2-dd763e037ff0 HTTP/1.1 Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: exception: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-299982af-c671-44e7-9f25-bf63083bf352'] Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '0d69ef99-332f-43c2-bcc2-dd763e037ff0'} Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:46:25.518620 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-299982af-c671-44e7-9f25-bf63083bf352'] Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-299982af-c671-44e7-9f25-bf63083bf352'] Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-299982af-c671-44e7-9f25-bf63083bf352'] Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-299982af-c671-44e7-9f25-bf63083bf352'] Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0cfd1d06-a26b-46b3-aaf6-cbe40870b3f1 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-299982af-c671-44e7-9f25-bf63083bf352'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0cfd1d06-a26b-46b3-aaf6-cbe40870b3f1 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/0d69ef99-332f-43c2-bcc2-dd763e037ff0" status: 404 len: 194 microversion: 2.1 time: 0.038680 Oct 11 19:46:25.523005 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 653/1279] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:46:25 2022] GET /compute/v2.1/os-security-groups/0d69ef99-332f-43c2-bcc2-dd763e037ff0 => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:46:25.530054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-51bba098-dec0-44c7-a3f9-b5b9ca31e23a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc3a4af0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:25.616547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-49e6ac39-6568-4ee2-8380-1bb869cc7ed9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:25.617166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-49e6ac39-6568-4ee2-8380-1bb869cc7ed9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:25.624613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49e6ac39-6568-4ee2-8380-1bb869cc7ed9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:25.625111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49e6ac39-6568-4ee2-8380-1bb869cc7ed9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:25.625545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49e6ac39-6568-4ee2-8380-1bb869cc7ed9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:25.626452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49e6ac39-6568-4ee2-8380-1bb869cc7ed9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:25.627108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49e6ac39-6568-4ee2-8380-1bb869cc7ed9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:25.627549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49e6ac39-6568-4ee2-8380-1bb869cc7ed9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:25.782096 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-51bba098-dec0-44c7-a3f9-b5b9ca31e23a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6b15a68e-93a5-44fb-bd9e-3ef90105b642" status: 202 len: 0 microversion: 2.1 time: 0.256932 Oct 11 19:46:25.787106 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 627/1280] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:46:25 2022] DELETE /compute/v2.1/os-security-groups/6b15a68e-93a5-44fb-bd9e-3ef90105b642 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:46:25.793906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bc7da9c6-f816-41d8-be0c-0f8db909b0ea tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:25.794801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bc7da9c6-f816-41d8-be0c-0f8db909b0ea tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:25.803913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc7da9c6-f816-41d8-be0c-0f8db909b0ea tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:25.805145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc7da9c6-f816-41d8-be0c-0f8db909b0ea tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:25.806476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc7da9c6-f816-41d8-be0c-0f8db909b0ea tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:25.808761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc7da9c6-f816-41d8-be0c-0f8db909b0ea tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:25.809470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc7da9c6-f816-41d8-be0c-0f8db909b0ea tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:25.810082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc7da9c6-f816-41d8-be0c-0f8db909b0ea tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:25.850196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-49e6ac39-6568-4ee2-8380-1bb869cc7ed9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:25.862319 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-49e6ac39-6568-4ee2-8380-1bb869cc7ed9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.249468 Oct 11 19:46:25.863593 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 654/1281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:25 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:25.869815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d38774ee-0d83-4c0c-9171-e84d717602b7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83d0803f70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:25.923280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-d38774ee-0d83-4c0c-9171-e84d717602b7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:46:25.924856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.security_group_api [None req-d38774ee-0d83-4c0c-9171-e84d717602b7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Neutron security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 not found {{(pid=126955) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:46:25.925691 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-d38774ee-0d83-4c0c-9171-e84d717602b7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:46:25.925691 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-2b8971cf-549e-4ef8-8d33-f920234420d7'] Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d38774ee-0d83-4c0c-9171-e84d717602b7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-security-groups/6b15a68e-93a5-44fb-bd9e-3ef90105b642 HTTP/1.1 Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: exception: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-2b8971cf-549e-4ef8-8d33-f920234420d7'] Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '6b15a68e-93a5-44fb-bd9e-3ef90105b642'} Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:46:25.928030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b8971cf-549e-4ef8-8d33-f920234420d7'] Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b8971cf-549e-4ef8-8d33-f920234420d7'] Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b8971cf-549e-4ef8-8d33-f920234420d7'] Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b8971cf-549e-4ef8-8d33-f920234420d7'] Oct 11 19:46:25.932426 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:25.937004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d38774ee-0d83-4c0c-9171-e84d717602b7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:46:25.937004 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-2b8971cf-549e-4ef8-8d33-f920234420d7'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:25.938007 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d38774ee-0d83-4c0c-9171-e84d717602b7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/6b15a68e-93a5-44fb-bd9e-3ef90105b642" status: 404 len: 194 microversion: 2.1 time: 0.073158 Oct 11 19:46:25.938759 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 655/1282] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:46:25 2022] GET /compute/v2.1/os-security-groups/6b15a68e-93a5-44fb-bd9e-3ef90105b642 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:46:25.944560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:25.945544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:25.956712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:25.957449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:25.958051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:25.959614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:25.960265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:25.960842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:26.060672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:26.065285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc7da9c6-f816-41d8-be0c-0f8db909b0ea tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:26.076140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:26.076641 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bc7da9c6-f816-41d8-be0c-0f8db909b0ea tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 200 len: 1466 microversion: 2.1 time: 0.287097 Oct 11 19:46:26.077810 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 628/1283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:25 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 1466 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:26.084721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:26.094748 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1d5f070b-b805-4a84-a8e1-e3c96508f744 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.154730 Oct 11 19:46:26.095649 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 656/1284] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:25 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:26.101228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ee20a70a-76af-42fd-a412-77fc8722af33 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83d07b9430>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:26.281036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d8fd61ac-6d40-4dd9-bc91-60d434f99bb1 tempest-SecurityGroupsTestAdminJSON-217854578 tempest-SecurityGroupsTestAdminJSON-217854578-project] Action: 'create', calling method: .version_select at 0x7f83cc4cf8b0>, body: {"security_group": {"name": "tempest-securitygroup-48003482", "description": "tempest-description-700572414"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:26.303838 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ee20a70a-76af-42fd-a412-77fc8722af33 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0f1550bb-b138-4b57-8c1b-2ed34f64fddc" status: 202 len: 0 microversion: 2.1 time: 0.207124 Oct 11 19:46:26.307527 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 657/1285] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:46:26 2022] DELETE /compute/v2.1/os-security-groups/0f1550bb-b138-4b57-8c1b-2ed34f64fddc => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:26.310401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ad93c900-0b0b-4de3-9d7c-47a949115a35 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:26.311198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ad93c900-0b0b-4de3-9d7c-47a949115a35 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:26.320540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad93c900-0b0b-4de3-9d7c-47a949115a35 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:26.321100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad93c900-0b0b-4de3-9d7c-47a949115a35 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:26.321677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad93c900-0b0b-4de3-9d7c-47a949115a35 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:26.322491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad93c900-0b0b-4de3-9d7c-47a949115a35 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:26.323072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad93c900-0b0b-4de3-9d7c-47a949115a35 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:26.323830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad93c900-0b0b-4de3-9d7c-47a949115a35 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:26.618914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ad93c900-0b0b-4de3-9d7c-47a949115a35 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:26.628145 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ad93c900-0b0b-4de3-9d7c-47a949115a35 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1537 microversion: 2.1 time: 0.322342 Oct 11 19:46:26.628721 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 658/1286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:26 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1537 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:26.634601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2d4f528-8dfb-4b9c-9bb9-365043220fd8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc2f0ee0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:26.691576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-d2d4f528-8dfb-4b9c-9bb9-365043220fd8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:46:26.692285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.security_group_api [None req-d2d4f528-8dfb-4b9c-9bb9-365043220fd8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Neutron security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc not found {{(pid=126955) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:46:26.692877 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-d2d4f528-8dfb-4b9c-9bb9-365043220fd8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:46:26.692877 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-3b204002-3ce4-4e1e-aefd-e0efad16a55f'] Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2d4f528-8dfb-4b9c-9bb9-365043220fd8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-security-groups/0f1550bb-b138-4b57-8c1b-2ed34f64fddc HTTP/1.1 Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: exception: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-3b204002-3ce4-4e1e-aefd-e0efad16a55f'] Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '0f1550bb-b138-4b57-8c1b-2ed34f64fddc'} Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:46:26.696043 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b204002-3ce4-4e1e-aefd-e0efad16a55f'] Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b204002-3ce4-4e1e-aefd-e0efad16a55f'] Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b204002-3ce4-4e1e-aefd-e0efad16a55f'] Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b204002-3ce4-4e1e-aefd-e0efad16a55f'] Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2d4f528-8dfb-4b9c-9bb9-365043220fd8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-3b204002-3ce4-4e1e-aefd-e0efad16a55f'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d2d4f528-8dfb-4b9c-9bb9-365043220fd8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/0f1550bb-b138-4b57-8c1b-2ed34f64fddc" status: 404 len: 194 microversion: 2.1 time: 0.067982 Oct 11 19:46:26.701058 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 659/1287] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:46:26 2022] GET /compute/v2.1/os-security-groups/0f1550bb-b138-4b57-8c1b-2ed34f64fddc => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:46:26.708758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d53989ac-5b8f-42f9-92c5-c2bca124f193 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:26.709794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d53989ac-5b8f-42f9-92c5-c2bca124f193 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:26.717472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d53989ac-5b8f-42f9-92c5-c2bca124f193 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:26.718333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d53989ac-5b8f-42f9-92c5-c2bca124f193 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:26.719105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d53989ac-5b8f-42f9-92c5-c2bca124f193 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:26.720180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d53989ac-5b8f-42f9-92c5-c2bca124f193 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:26.720860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d53989ac-5b8f-42f9-92c5-c2bca124f193 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:26.721727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d53989ac-5b8f-42f9-92c5-c2bca124f193 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:26.863521 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d8fd61ac-6d40-4dd9-bc91-60d434f99bb1 tempest-SecurityGroupsTestAdminJSON-217854578 tempest-SecurityGroupsTestAdminJSON-217854578-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.784057 Oct 11 19:46:26.864115 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 629/1288] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:46:26 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:26.869040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4ded0c05-6eae-4a66-a5b6-ec26b08ad343 req-0e809288-ea7a-489f-85a5-954bcc88a079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ca279a-f051-4cc1-8b0e-86f2550947dc", "name": "network-vif-deleted", "tag": "fbe7ab08-d9cb-479e-8e78-557e16f2a78b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:26.883173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4ded0c05-6eae-4a66-a5b6-ec26b08ad343 req-0e809288-ea7a-489f-85a5-954bcc88a079 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:26.884227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4ded0c05-6eae-4a66-a5b6-ec26b08ad343 req-0e809288-ea7a-489f-85a5-954bcc88a079 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:26.884227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4ded0c05-6eae-4a66-a5b6-ec26b08ad343 req-0e809288-ea7a-489f-85a5-954bcc88a079 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:26.894558 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4ded0c05-6eae-4a66-a5b6-ec26b08ad343 req-0e809288-ea7a-489f-85a5-954bcc88a079 service nova] Creating event network-vif-deleted:fbe7ab08-d9cb-479e-8e78-557e16f2a78b for instance d3ca279a-f051-4cc1-8b0e-86f2550947dc on n-h1-860864-3 Oct 11 19:46:26.899288 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4ded0c05-6eae-4a66-a5b6-ec26b08ad343 req-0e809288-ea7a-489f-85a5-954bcc88a079 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033934 Oct 11 19:46:26.902110 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 630/1289] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:26.908316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fad78f4f-95f8-4dfd-9e4e-210187d0975f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc339d30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:26.910516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d53989ac-5b8f-42f9-92c5-c2bca124f193 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:26.918465 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d53989ac-5b8f-42f9-92c5-c2bca124f193 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1315 microversion: 2.1 time: 0.213340 Oct 11 19:46:26.919058 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 660/1290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:26 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:26.923508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a9fbde9-75f6-43f0-a701-85f6b01f77e0 tempest-SecurityGroupsTestAdminJSON-217854578 tempest-SecurityGroupsTestAdminJSON-217854578-project] Action: 'create', calling method: .version_select at 0x7f83cc363f70>, body: {"security_group": {"name": "tempest-securitygroup-1176349572", "description": "tempest-description-1150534923"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:27.263426 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a9fbde9-75f6-43f0-a701-85f6b01f77e0 tempest-SecurityGroupsTestAdminJSON-217854578 tempest-SecurityGroupsTestAdminJSON-217854578-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.343284 Oct 11 19:46:27.264468 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 661/1291] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:46:26 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:27.269343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6e1a4b7-ff18-4d47-a464-3b46cd86f387 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:27.270221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a6e1a4b7-ff18-4d47-a464-3b46cd86f387 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:27.277998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e1a4b7-ff18-4d47-a464-3b46cd86f387 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:27.278588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e1a4b7-ff18-4d47-a464-3b46cd86f387 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:27.279198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e1a4b7-ff18-4d47-a464-3b46cd86f387 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:27.279892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e1a4b7-ff18-4d47-a464-3b46cd86f387 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:27.280343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e1a4b7-ff18-4d47-a464-3b46cd86f387 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:27.280761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e1a4b7-ff18-4d47-a464-3b46cd86f387 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:27.296380 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fad78f4f-95f8-4dfd-9e4e-210187d0975f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.391157 Oct 11 19:46:27.297943 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 631/1292] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:46:26 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:27.303826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:27.304551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: d3ca279a-f051-4cc1-8b0e-86f2550947dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:27.313974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:27.314468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:27.314926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:27.315719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:27.316392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:27.316815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:27.334175 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] HTTP exception thrown: Instance d3ca279a-f051-4cc1-8b0e-86f2550947dc could not be found. Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Request method failure captured: Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc HTTP/1.1 Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfhMQD20e-0G3jw8nJnATlEn0tE55s8fYc9D-E7Qo0FciMBqXgVbWZggaDTCq8DQs5oVgzqRcyyAqm_rK5FNlkMul7O5JYxq_8l-jV4MRJXJX04BI2U6hhnY7rDMiOIRyFsBwU4sBTH2hP3wUvHGwj50OwDiJfprMK-S_Tv1WBxQ_o Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 25fb1c12e2fe4e30955c7509e90a2a44 Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-293688915 Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25fb1c12e2fe4e30955c7509e90a2a44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25fb1c12e2fe4e30955c7509e90a2a44", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25fb1c12e2fe4e30955c7509e90a2a44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25fb1c12e2fe4e30955c7509e90a2a44"}]}] Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAdminNegativeTestJSON-293688915 Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 25fb1c12e2fe4e30955c7509e90a2a44 Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-293688915 Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAdminNegativeTestJSON-293688915-project Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 7c0e5fa825034b299ccdbcb86b0e3d26 Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAdminNegativeTestJSON-293688915-project Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance d3ca279a-f051-4cc1-8b0e-86f2550947dc could not be found. Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'd3ca279a-f051-4cc1-8b0e-86f2550947dc'} Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ca279a-f051-4cc1-8b0e-86f2550947dc could not be found. Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ca279a-f051-4cc1-8b0e-86f2550947dc could not be found. Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:27.335991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ca279a-f051-4cc1-8b0e-86f2550947dc could not be found. Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Returning 404 to user: Instance d3ca279a-f051-4cc1-8b0e-86f2550947dc could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0cdd826f-6dad-4a36-b7d4-ba26c124dbc7 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc" status: 404 len: 111 microversion: 2.1 time: 0.038096 Oct 11 19:46:27.341222 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 632/1293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:27 2022] GET /compute/v2.1/servers/d3ca279a-f051-4cc1-8b0e-86f2550947dc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:46:27.352392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:27.353006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:27.360776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:27.361382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:27.362275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:27.363256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:27.364059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:27.364641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:27.370709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:27.473480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:27.488961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:27.490459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:27.496281 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5b517ccc-e5db-43fd-be34-2682102103da tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.157211 Oct 11 19:46:27.496842 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 633/1294] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:27 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:27.559449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6e1a4b7-ff18-4d47-a464-3b46cd86f387 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:27.573075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9f052e9f-f7c0-494e-9573-e0e7dbb018e5 tempest-SecurityGroupsTestAdminJSON-1528212723 tempest-SecurityGroupsTestAdminJSON-1528212723-project-admin] Action: 'create', calling method: .version_select at 0x7f83cc466af0>, body: {"security_group": {"name": "tempest-securitygroup-991586155", "description": "tempest-description-1506841640"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:27.579944 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6e1a4b7-ff18-4d47-a464-3b46cd86f387 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.314283 Oct 11 19:46:27.580542 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 662/1295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:27 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:27.587297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-810231c3-3cb7-41eb-ad76-b5b696e90b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: .version_select at 0x7f83cc2a6ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1004832201", "description": "tempest-description-182373541"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:28.067084 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-810231c3-3cb7-41eb-ad76-b5b696e90b3d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.484107 Oct 11 19:46:28.067865 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 663/1296] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:46:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:28.072551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a168424-5e3a-4803-8a88-aa145483357d tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:28.073901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8a168424-5e3a-4803-8a88-aa145483357d tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:28.089914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a168424-5e3a-4803-8a88-aa145483357d tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:28.090644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a168424-5e3a-4803-8a88-aa145483357d tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:28.091277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a168424-5e3a-4803-8a88-aa145483357d tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:28.092568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a168424-5e3a-4803-8a88-aa145483357d tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:28.094030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a168424-5e3a-4803-8a88-aa145483357d tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:28.095383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a168424-5e3a-4803-8a88-aa145483357d tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:28.125694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8a168424-5e3a-4803-8a88-aa145483357d tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:46:28.219937 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a168424-5e3a-4803-8a88-aa145483357d tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 204 len: 0 microversion: 2.1 time: 0.150778 Oct 11 19:46:28.220851 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 664/1297] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:46:28 2022] DELETE /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:46:28.226369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-921fab17-3cea-40fe-9440-801494b06794 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:28.227355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-921fab17-3cea-40fe-9440-801494b06794 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:28.234398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921fab17-3cea-40fe-9440-801494b06794 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:28.234921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921fab17-3cea-40fe-9440-801494b06794 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:28.235358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921fab17-3cea-40fe-9440-801494b06794 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:28.236057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921fab17-3cea-40fe-9440-801494b06794 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:28.236509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921fab17-3cea-40fe-9440-801494b06794 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:28.236929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921fab17-3cea-40fe-9440-801494b06794 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:28.359787 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9f052e9f-f7c0-494e-9573-e0e7dbb018e5 tempest-SecurityGroupsTestAdminJSON-1528212723 tempest-SecurityGroupsTestAdminJSON-1528212723-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.861688 Oct 11 19:46:28.360400 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 634/1298] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:46:27 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:28.365420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-beb5f67c-e9f0-4754-b7b6-8b61231b4bc7 req-8809ff7f-bcee-4c9e-821a-747fbb4f475e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2bcc99-b3f9-47c2-bb34-4f3a24081296", "name": "network-vif-unplugged", "status": "completed", "tag": "b2665c89-ac83-4c8b-9c20-01ff3ddcd688"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:28.378609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-beb5f67c-e9f0-4754-b7b6-8b61231b4bc7 req-8809ff7f-bcee-4c9e-821a-747fbb4f475e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:28.379094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-beb5f67c-e9f0-4754-b7b6-8b61231b4bc7 req-8809ff7f-bcee-4c9e-821a-747fbb4f475e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:28.379732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-beb5f67c-e9f0-4754-b7b6-8b61231b4bc7 req-8809ff7f-bcee-4c9e-821a-747fbb4f475e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:28.391514 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-beb5f67c-e9f0-4754-b7b6-8b61231b4bc7 req-8809ff7f-bcee-4c9e-821a-747fbb4f475e service nova] Creating event network-vif-unplugged:b2665c89-ac83-4c8b-9c20-01ff3ddcd688 for instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 on n-h1-860864-3 Oct 11 19:46:28.396452 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-beb5f67c-e9f0-4754-b7b6-8b61231b4bc7 req-8809ff7f-bcee-4c9e-821a-747fbb4f475e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034940 Oct 11 19:46:28.397056 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 635/1299] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:28.402722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67028718-7420-4661-b5db-35e83b474210 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:28.403423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-67028718-7420-4661-b5db-35e83b474210 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:28.409761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67028718-7420-4661-b5db-35e83b474210 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:28.410225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67028718-7420-4661-b5db-35e83b474210 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:28.410696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67028718-7420-4661-b5db-35e83b474210 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:28.411389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67028718-7420-4661-b5db-35e83b474210 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:28.411843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67028718-7420-4661-b5db-35e83b474210 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:28.412273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67028718-7420-4661-b5db-35e83b474210 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:28.580577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-921fab17-3cea-40fe-9440-801494b06794 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:28.588458 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-921fab17-3cea-40fe-9440-801494b06794 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1537 microversion: 2.1 time: 0.366498 Oct 11 19:46:28.589736 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 665/1300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:28 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1537 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:28.594938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0531e8d7-10e8-486e-9166-117c894a3857 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: .version_select at 0x7f83d089bee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1973482890", "description": "tempest-description-1265687263"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:28.662390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-67028718-7420-4661-b5db-35e83b474210 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:28.679763 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-67028718-7420-4661-b5db-35e83b474210 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1501 microversion: 2.1 time: 0.281525 Oct 11 19:46:28.680498 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 636/1301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:28 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1501 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:28.685532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b19db047-04ee-4b7c-a15b-049f0851c965 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:28.686745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b19db047-04ee-4b7c-a15b-049f0851c965 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:28.693502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b19db047-04ee-4b7c-a15b-049f0851c965 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:28.694376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b19db047-04ee-4b7c-a15b-049f0851c965 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:28.695109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b19db047-04ee-4b7c-a15b-049f0851c965 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:28.696236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b19db047-04ee-4b7c-a15b-049f0851c965 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:28.697217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b19db047-04ee-4b7c-a15b-049f0851c965 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:28.698154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b19db047-04ee-4b7c-a15b-049f0851c965 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:28.904527 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0531e8d7-10e8-486e-9166-117c894a3857 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.313377 Oct 11 19:46:28.905532 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 666/1302] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:46:28 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:28.922955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8aa6403-b7c4-4b0f-a001-2bd610fd08c1 tempest-SecurityGroupsTestAdminJSON-1528212723 tempest-SecurityGroupsTestAdminJSON-1528212723-project-admin] Action: 'create', calling method: .version_select at 0x7f83d078fc10>, body: {"security_group": {"name": "tempest-securitygroup-1887086423", "description": "tempest-description-2064807627"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:29.008677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b19db047-04ee-4b7c-a15b-049f0851c965 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:29.017129 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b19db047-04ee-4b7c-a15b-049f0851c965 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1477 microversion: 2.1 time: 0.335376 Oct 11 19:46:29.021119 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 637/1303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:28 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:29.048620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:29.050575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:29.067959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:29.067959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:29.068850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:29.070489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:29.071261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:29.071909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:29.171000 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8aa6403-b7c4-4b0f-a001-2bd610fd08c1 tempest-SecurityGroupsTestAdminJSON-1528212723 tempest-SecurityGroupsTestAdminJSON-1528212723-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.263797 Oct 11 19:46:29.172679 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 667/1304] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:46:28 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:29.175534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:29.178823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-671497d1-e6b9-4f51-95e8-8d5a95e68561 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:29.179671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-671497d1-e6b9-4f51-95e8-8d5a95e68561 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:29.186061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:29.187497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:29.188717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-671497d1-e6b9-4f51-95e8-8d5a95e68561 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:29.189486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-671497d1-e6b9-4f51-95e8-8d5a95e68561 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:29.190047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-671497d1-e6b9-4f51-95e8-8d5a95e68561 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:29.191229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-671497d1-e6b9-4f51-95e8-8d5a95e68561 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:29.192002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-671497d1-e6b9-4f51-95e8-8d5a95e68561 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:29.192562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-671497d1-e6b9-4f51-95e8-8d5a95e68561 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:29.194290 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b3ba7553-1af7-4638-8017-862c70286b79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.171957 Oct 11 19:46:29.194898 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 638/1305] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:29 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:29.203279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1813759042", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "7b890429-7c90-4096-ba26-c9d60aef0c43"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:29.270747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] validate_networks() for [('7b890429-7c90-4096-ba26-c9d60aef0c43', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:46:29.398684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-671497d1-e6b9-4f51-95e8-8d5a95e68561 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:29.408416 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-671497d1-e6b9-4f51-95e8-8d5a95e68561 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.234067 Oct 11 19:46:29.408993 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 668/1306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:29 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:29.419360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-12fb3096-a8a9-4206-a528-f360d48b53e9 tempest-SecurityGroupsTestAdminJSON-1528212723 tempest-SecurityGroupsTestAdminJSON-1528212723-project-admin] Calling method '.version_select at 0x7f83cc332a60>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:30.113061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:46:30.113587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:46:30.114172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:46:30.114688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:46:30.115169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:46:30.124249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:30.124825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:30.125318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:30.126252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:30.126832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:30.127319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:30.146331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Getting quotas for project ba60fc5cb0874d38897f0ed8d5580106. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:30.151822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Getting quotas for user e657b74c26d247cd896aa508c7aac5ca and project ba60fc5cb0874d38897f0ed8d5580106. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:30.170378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:46:30.172734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:46:30.244570 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3609c55-68d8-4258-9254-49b1b4b39dc4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048389 Oct 11 19:46:30.251898 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 639/1307] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:46:30.257135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-49224595-f70b-44de-9500-73fc03e8463a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:30.257753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-49224595-f70b-44de-9500-73fc03e8463a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:30.266811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49224595-f70b-44de-9500-73fc03e8463a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:30.267316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49224595-f70b-44de-9500-73fc03e8463a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:30.267749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49224595-f70b-44de-9500-73fc03e8463a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:30.268449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49224595-f70b-44de-9500-73fc03e8463a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:30.268904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49224595-f70b-44de-9500-73fc03e8463a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:30.269485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49224595-f70b-44de-9500-73fc03e8463a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:30.498931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49224595-f70b-44de-9500-73fc03e8463a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:30.507160 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-49224595-f70b-44de-9500-73fc03e8463a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1537 microversion: 2.1 time: 0.254190 Oct 11 19:46:30.507733 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 640/1308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:30 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1537 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:30.513971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-411afb85-7443-4efe-ae69-487eb4ab0670 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:30.514802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-411afb85-7443-4efe-ae69-487eb4ab0670 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:30.521481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-411afb85-7443-4efe-ae69-487eb4ab0670 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:30.522141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-411afb85-7443-4efe-ae69-487eb4ab0670 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:30.522769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-411afb85-7443-4efe-ae69-487eb4ab0670 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:30.534895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-411afb85-7443-4efe-ae69-487eb4ab0670 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:30.535477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-411afb85-7443-4efe-ae69-487eb4ab0670 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:30.535919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-411afb85-7443-4efe-ae69-487eb4ab0670 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:30.704605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=11 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:30.767209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-411afb85-7443-4efe-ae69-487eb4ab0670 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e5fa825034b299ccdbcb86b0e3d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fb1c12e2fe4e30955c7509e90a2a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:30.786762 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-411afb85-7443-4efe-ae69-487eb4ab0670 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 200 len: 1477 microversion: 2.1 time: 0.276235 Oct 11 19:46:30.787379 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 641/1309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:30 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:30.798980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:30.802644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:30.820552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:30.821062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:30.824156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:30.825458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:30.825922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:30.826679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:30.918219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:30.926695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:30.928340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:30.933579 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5bf3ccd3-0d45-4fd0-bcb3-59d9c432c6d0 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.141913 Oct 11 19:46:30.934369 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 642/1310] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:30 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:30.939535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f9e65972-ec7f-4290-977e-d0c1fe0f30bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a69c614d-c35d-430c-ae99-f47ef6027aea"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:30.942450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f9e65972-ec7f-4290-977e-d0c1fe0f30bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:30.949433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e65972-ec7f-4290-977e-d0c1fe0f30bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:30.950118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e65972-ec7f-4290-977e-d0c1fe0f30bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:30.950782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e65972-ec7f-4290-977e-d0c1fe0f30bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:30.952057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e65972-ec7f-4290-977e-d0c1fe0f30bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:30.952708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e65972-ec7f-4290-977e-d0c1fe0f30bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:30.953327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9e65972-ec7f-4290-977e-d0c1fe0f30bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:30.955686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=66 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:31.332872 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f9e65972-ec7f-4290-977e-d0c1fe0f30bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397087 Oct 11 19:46:31.333829 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 643/1311] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 19:46:30 2022] POST /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:31.339592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c68091a1-8946-4268-920d-e7da2d639ee6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:31.340640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c68091a1-8946-4268-920d-e7da2d639ee6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:31.347902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c68091a1-8946-4268-920d-e7da2d639ee6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:31.348477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c68091a1-8946-4268-920d-e7da2d639ee6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:31.349112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c68091a1-8946-4268-920d-e7da2d639ee6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:31.349875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c68091a1-8946-4268-920d-e7da2d639ee6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:31.350518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c68091a1-8946-4268-920d-e7da2d639ee6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:31.351117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c68091a1-8946-4268-920d-e7da2d639ee6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:31.429916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c68091a1-8946-4268-920d-e7da2d639ee6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:31.439219 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c68091a1-8946-4268-920d-e7da2d639ee6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1212 microversion: 2.1 time: 0.104000 Oct 11 19:46:31.453356 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 644/1312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:31 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1212 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:31.453356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-74dbb4d6-1c56-4fb9-bb88-8dac1408c748 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:31.453356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-74dbb4d6-1c56-4fb9-bb88-8dac1408c748 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:31.453356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74dbb4d6-1c56-4fb9-bb88-8dac1408c748 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:31.453356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74dbb4d6-1c56-4fb9-bb88-8dac1408c748 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:31.453356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74dbb4d6-1c56-4fb9-bb88-8dac1408c748 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:31.453356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74dbb4d6-1c56-4fb9-bb88-8dac1408c748 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:31.454226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74dbb4d6-1c56-4fb9-bb88-8dac1408c748 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:31.454226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74dbb4d6-1c56-4fb9-bb88-8dac1408c748 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:31.655274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-74dbb4d6-1c56-4fb9-bb88-8dac1408c748 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:31.665867 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-74dbb4d6-1c56-4fb9-bb88-8dac1408c748 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.225044 Oct 11 19:46:31.668673 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 645/1313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:31 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:31.684071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-08bc234e-f867-4c1c-a55e-97571c7a201f req-45cd41b2-ae4a-48b7-9c21-b6d94aa46c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2bcc99-b3f9-47c2-bb34-4f3a24081296", "tag": "b2665c89-ac83-4c8b-9c20-01ff3ddcd688"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:31.707271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-08bc234e-f867-4c1c-a55e-97571c7a201f req-45cd41b2-ae4a-48b7-9c21-b6d94aa46c65 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:31.707772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-08bc234e-f867-4c1c-a55e-97571c7a201f req-45cd41b2-ae4a-48b7-9c21-b6d94aa46c65 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:31.708221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-08bc234e-f867-4c1c-a55e-97571c7a201f req-45cd41b2-ae4a-48b7-9c21-b6d94aa46c65 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:31.727227 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-08bc234e-f867-4c1c-a55e-97571c7a201f req-45cd41b2-ae4a-48b7-9c21-b6d94aa46c65 service nova] Creating event network-changed:b2665c89-ac83-4c8b-9c20-01ff3ddcd688 for instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 on n-h1-860864-3 Oct 11 19:46:31.733312 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-08bc234e-f867-4c1c-a55e-97571c7a201f req-45cd41b2-ae4a-48b7-9c21-b6d94aa46c65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063095 Oct 11 19:46:31.734640 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 646/1314] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:31.741370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fe60b977-4f29-4560-ad38-0ee17cf05040 req-8b863d7e-027e-4b0c-873d-a7ea6dc8f567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8bc215-3672-4c18-9441-8479acacc17d", "name": "network-vif-deleted", "tag": "bf375cd3-0aab-4777-97b4-8ceb299e7800"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:31.755267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fe60b977-4f29-4560-ad38-0ee17cf05040 req-8b863d7e-027e-4b0c-873d-a7ea6dc8f567 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:31.762697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fe60b977-4f29-4560-ad38-0ee17cf05040 req-8b863d7e-027e-4b0c-873d-a7ea6dc8f567 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:31.764713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fe60b977-4f29-4560-ad38-0ee17cf05040 req-8b863d7e-027e-4b0c-873d-a7ea6dc8f567 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:31.784991 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fe60b977-4f29-4560-ad38-0ee17cf05040 req-8b863d7e-027e-4b0c-873d-a7ea6dc8f567 service nova] Creating event network-vif-deleted:bf375cd3-0aab-4777-97b4-8ceb299e7800 for instance ba8bc215-3672-4c18-9441-8479acacc17d on n-h1-860864-3 Oct 11 19:46:31.789997 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fe60b977-4f29-4560-ad38-0ee17cf05040 req-8b863d7e-027e-4b0c-873d-a7ea6dc8f567 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053476 Oct 11 19:46:31.791233 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 647/1315] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:31.797545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ad8dd908-d6b9-477e-a57e-aeb1fc0301ac tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:31.798796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ad8dd908-d6b9-477e-a57e-aeb1fc0301ac tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:31.806344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad8dd908-d6b9-477e-a57e-aeb1fc0301ac tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:31.808105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad8dd908-d6b9-477e-a57e-aeb1fc0301ac tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:31.809286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad8dd908-d6b9-477e-a57e-aeb1fc0301ac tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:31.810151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad8dd908-d6b9-477e-a57e-aeb1fc0301ac tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:31.810659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad8dd908-d6b9-477e-a57e-aeb1fc0301ac tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:31.811143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad8dd908-d6b9-477e-a57e-aeb1fc0301ac tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:32.055678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ad8dd908-d6b9-477e-a57e-aeb1fc0301ac tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:32.080580 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ad8dd908-d6b9-477e-a57e-aeb1fc0301ac tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.287152 Oct 11 19:46:32.082839 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 648/1316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:31 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:32.089891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:32.090563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] [instance: ba8bc215-3672-4c18-9441-8479acacc17d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:32.100736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:32.101473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:32.102290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:32.103254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:32.103878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:32.104498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:32.124042 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] HTTP exception thrown: Instance ba8bc215-3672-4c18-9441-8479acacc17d could not be found. Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Request method failure captured: Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d HTTP/1.1 Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfhMQD20e-0G3jw8nJnATlEn0tE55s8fYc9D-E7Qo0FciMBqXgVbWZggaDTCq8DQs5oVgzqRcyyAqm_rK5FNlkMul7O5JYxq_8l-jV4MRJXJX04BI2U6hhnY7rDMiOIRyFsBwU4sBTH2hP3wUvHGwj50OwDiJfprMK-S_Tv1WBxQ_o Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 25fb1c12e2fe4e30955c7509e90a2a44 Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-293688915 Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25fb1c12e2fe4e30955c7509e90a2a44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25fb1c12e2fe4e30955c7509e90a2a44", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25fb1c12e2fe4e30955c7509e90a2a44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25fb1c12e2fe4e30955c7509e90a2a44"}]}] Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAdminNegativeTestJSON-293688915 Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 25fb1c12e2fe4e30955c7509e90a2a44 Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-293688915 Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAdminNegativeTestJSON-293688915-project Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 7c0e5fa825034b299ccdbcb86b0e3d26 Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAdminNegativeTestJSON-293688915-project Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance ba8bc215-3672-4c18-9441-8479acacc17d could not be found. Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ba8bc215-3672-4c18-9441-8479acacc17d'} Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba8bc215-3672-4c18-9441-8479acacc17d could not be found. Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba8bc215-3672-4c18-9441-8479acacc17d could not be found. Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:32.126257 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:32.130774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:32.130774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:32.130774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:32.130774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:32.130774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:32.130774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:32.130774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba8bc215-3672-4c18-9441-8479acacc17d could not be found. Oct 11 19:46:32.130774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:32.132366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] Returning 404 to user: Instance ba8bc215-3672-4c18-9441-8479acacc17d could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:32.133650 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6acac3bb-6c1e-4bc1-81d3-ade3b7a5dff8 tempest-ServersAdminNegativeTestJSON-293688915 tempest-ServersAdminNegativeTestJSON-293688915-project] 10.222.0.27 "GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d" status: 404 len: 111 microversion: 2.1 time: 0.049693 Oct 11 19:46:32.134243 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 649/1317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:32 2022] GET /compute/v2.1/servers/ba8bc215-3672-4c18-9441-8479acacc17d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:46:32.139359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:32.139929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:32.147184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:32.147772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:32.148317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:32.149148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:32.149834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:32.150321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:32.243676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:32.259631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:32.260259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:32.269053 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4b00506e-82dd-4c7b-95a0-79b2f5f31626 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1560 microversion: 2.91 time: 0.133559 Oct 11 19:46:32.270140 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 650/1318] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:32 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1560 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:32.382752 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-12fb3096-a8a9-4206-a528-f360d48b53e9 tempest-SecurityGroupsTestAdminJSON-1528212723 tempest-SecurityGroupsTestAdminJSON-1528212723-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13885 microversion: 2.1 time: 2.972340 Oct 11 19:46:32.383354 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 669/1319] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Oct 11 19:46:29 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13885 bytes in 2974 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:46:32.408712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cc6f468c-0d9a-4bd4-b2ef-2ff19ef08342 tempest-SecurityGroupsTestAdminJSON-217854578 tempest-SecurityGroupsTestAdminJSON-217854578-project] Calling method '.version_select at 0x7f83cc33b670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:32.469326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-61284eb8-6ddd-46ad-a433-a23f827f380c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:32.469956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-61284eb8-6ddd-46ad-a433-a23f827f380c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:32.486893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61284eb8-6ddd-46ad-a433-a23f827f380c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:32.488444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61284eb8-6ddd-46ad-a433-a23f827f380c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:32.491208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61284eb8-6ddd-46ad-a433-a23f827f380c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:32.497052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61284eb8-6ddd-46ad-a433-a23f827f380c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:32.497650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61284eb8-6ddd-46ad-a433-a23f827f380c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:32.498094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61284eb8-6ddd-46ad-a433-a23f827f380c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:32.628294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-61284eb8-6ddd-46ad-a433-a23f827f380c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:32.638745 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-61284eb8-6ddd-46ad-a433-a23f827f380c tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1276 microversion: 2.1 time: 0.177183 Oct 11 19:46:32.669957 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 670/1320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:32 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:32.693700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e3c78dbb-1fed-4f3c-90e1-20b31789b2e6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:32.694313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e3c78dbb-1fed-4f3c-90e1-20b31789b2e6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:32.710202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3c78dbb-1fed-4f3c-90e1-20b31789b2e6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:32.712309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3c78dbb-1fed-4f3c-90e1-20b31789b2e6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:32.712797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3c78dbb-1fed-4f3c-90e1-20b31789b2e6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:32.714991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3c78dbb-1fed-4f3c-90e1-20b31789b2e6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:32.722595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3c78dbb-1fed-4f3c-90e1-20b31789b2e6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:32.723232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3c78dbb-1fed-4f3c-90e1-20b31789b2e6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:32.752833 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cc6f468c-0d9a-4bd4-b2ef-2ff19ef08342 tempest-SecurityGroupsTestAdminJSON-217854578 tempest-SecurityGroupsTestAdminJSON-217854578-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.348121 Oct 11 19:46:32.753410 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 651/1321] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Oct 11 19:46:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:32.769573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99ca0ff1-1d4e-4984-886e-9afdc487a4b1 tempest-SecurityGroupsTestAdminJSON-1528212723 tempest-SecurityGroupsTestAdminJSON-1528212723-project-admin] Calling method '.version_select at 0x7f83cc365af0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:32.973599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e3c78dbb-1fed-4f3c-90e1-20b31789b2e6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:32.983292 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e3c78dbb-1fed-4f3c-90e1-20b31789b2e6 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.294540 Oct 11 19:46:32.994912 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 671/1322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:32 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:33.073905 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99ca0ff1-1d4e-4984-886e-9afdc487a4b1 tempest-SecurityGroupsTestAdminJSON-1528212723 tempest-SecurityGroupsTestAdminJSON-1528212723-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c84dd92f-9c92-41be-935b-8e5610203168" status: 202 len: 0 microversion: 2.1 time: 0.308710 Oct 11 19:46:33.078699 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 652/1323] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:46:32 2022] DELETE /compute/v2.1/os-security-groups/c84dd92f-9c92-41be-935b-8e5610203168 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:33.083607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-503d6413-4f58-42b7-ad00-eb809f35f2f9 tempest-SecurityGroupsTestAdminJSON-1528212723 tempest-SecurityGroupsTestAdminJSON-1528212723-project-admin] Calling method '.version_select at 0x7f83d089bd30>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:33.109910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99e66ab6-0d0e-4fc2-b519-6c7c496ed840 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:33.110815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-99e66ab6-0d0e-4fc2-b519-6c7c496ed840 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:33.125473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:33.127726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e66ab6-0d0e-4fc2-b519-6c7c496ed840 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:33.129622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e66ab6-0d0e-4fc2-b519-6c7c496ed840 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:33.130314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e66ab6-0d0e-4fc2-b519-6c7c496ed840 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:33.131234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e66ab6-0d0e-4fc2-b519-6c7c496ed840 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:33.131844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e66ab6-0d0e-4fc2-b519-6c7c496ed840 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:33.132421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e66ab6-0d0e-4fc2-b519-6c7c496ed840 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:33.365036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-99e66ab6-0d0e-4fc2-b519-6c7c496ed840 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:33.375795 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99e66ab6-0d0e-4fc2-b519-6c7c496ed840 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.271217 Oct 11 19:46:33.387890 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 653/1324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:33 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:33.398263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:33.399090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:33.406748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:33.407256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:33.407896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:33.408722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:33.409285 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-503d6413-4f58-42b7-ad00-eb809f35f2f9 tempest-SecurityGroupsTestAdminJSON-1528212723 tempest-SecurityGroupsTestAdminJSON-1528212723-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f9d88cc2-bdb9-4344-8663-b1e33523d3bc" status: 202 len: 0 microversion: 2.1 time: 0.329424 Oct 11 19:46:33.409641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:33.409641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:33.409984 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 672/1325] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:46:33 2022] DELETE /compute/v2.1/os-security-groups/f9d88cc2-bdb9-4344-8663-b1e33523d3bc => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:33.417986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-89b11eb2-c256-4b02-bb90-aa5e67c6e37c tempest-SecurityGroupsTestAdminJSON-217854578 tempest-SecurityGroupsTestAdminJSON-217854578-project] Calling method '.version_select at 0x7f83d07b91f0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:33.523539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:33.530992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:33.540698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:33.542939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:33.569363 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-831aee09-46ed-4213-9810-cecd10b31ddb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1560 microversion: 2.91 time: 0.178182 Oct 11 19:46:33.586239 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 654/1326] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:33 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:33.666151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-59403c75-5455-44d3-b15c-f1e1e035d0f2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:33.667184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59403c75-5455-44d3-b15c-f1e1e035d0f2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:33.681992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59403c75-5455-44d3-b15c-f1e1e035d0f2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:33.694809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59403c75-5455-44d3-b15c-f1e1e035d0f2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:33.696605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59403c75-5455-44d3-b15c-f1e1e035d0f2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:33.697786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59403c75-5455-44d3-b15c-f1e1e035d0f2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:33.700989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59403c75-5455-44d3-b15c-f1e1e035d0f2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:33.701953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59403c75-5455-44d3-b15c-f1e1e035d0f2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:33.820179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59403c75-5455-44d3-b15c-f1e1e035d0f2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:33.829739 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-59403c75-5455-44d3-b15c-f1e1e035d0f2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1274 microversion: 2.1 time: 0.167681 Oct 11 19:46:33.830318 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 655/1327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:33 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:33.835450 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-89b11eb2-c256-4b02-bb90-aa5e67c6e37c tempest-SecurityGroupsTestAdminJSON-217854578 tempest-SecurityGroupsTestAdminJSON-217854578-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ba499fd6-b925-42ad-adaa-99b015f842b1" status: 202 len: 0 microversion: 2.1 time: 0.421288 Oct 11 19:46:33.836192 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 673/1328] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:46:33 2022] DELETE /compute/v2.1/os-security-groups/ba499fd6-b925-42ad-adaa-99b015f842b1 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:46:33.853555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5cb9dd86-7a7d-4f54-a1bc-2e0e59bc5f1d tempest-SecurityGroupsTestAdminJSON-217854578 tempest-SecurityGroupsTestAdminJSON-217854578-project] Calling method '.version_select at 0x7f83ccf9d1f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:34.007504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dff073b9-54c3-4e79-a353-544d644136e3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:34.008135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dff073b9-54c3-4e79-a353-544d644136e3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:34.017935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff073b9-54c3-4e79-a353-544d644136e3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:34.020425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff073b9-54c3-4e79-a353-544d644136e3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:34.021059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff073b9-54c3-4e79-a353-544d644136e3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:34.025864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff073b9-54c3-4e79-a353-544d644136e3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:34.026768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff073b9-54c3-4e79-a353-544d644136e3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:34.027655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff073b9-54c3-4e79-a353-544d644136e3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:34.086774 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5cb9dd86-7a7d-4f54-a1bc-2e0e59bc5f1d tempest-SecurityGroupsTestAdminJSON-217854578 tempest-SecurityGroupsTestAdminJSON-217854578-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b936bfe2-5eb5-49ee-8fcb-a63577e44e4c" status: 202 len: 0 microversion: 2.1 time: 0.239131 Oct 11 19:46:34.088363 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 656/1329] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:46:33 2022] DELETE /compute/v2.1/os-security-groups/b936bfe2-5eb5-49ee-8fcb-a63577e44e4c => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:34.392909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dff073b9-54c3-4e79-a353-544d644136e3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:34.403395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89f5fa5c-7191-437d-b5b3-d5e5e2b6e4aa tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:34.407644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-89f5fa5c-7191-437d-b5b3-d5e5e2b6e4aa tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:34.409610 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dff073b9-54c3-4e79-a353-544d644136e3 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.406785 Oct 11 19:46:34.412909 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 674/1330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:34 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:34.419221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f5fa5c-7191-437d-b5b3-d5e5e2b6e4aa tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:34.419700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f5fa5c-7191-437d-b5b3-d5e5e2b6e4aa tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:34.420096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f5fa5c-7191-437d-b5b3-d5e5e2b6e4aa tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:34.420807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f5fa5c-7191-437d-b5b3-d5e5e2b6e4aa tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:34.421263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f5fa5c-7191-437d-b5b3-d5e5e2b6e4aa tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:34.421714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f5fa5c-7191-437d-b5b3-d5e5e2b6e4aa tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:34.600659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:34.601578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:34.614852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:34.616241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:34.617355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:34.623313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:34.623907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:34.624362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:34.835135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-89f5fa5c-7191-437d-b5b3-d5e5e2b6e4aa tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:34.849119 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-89f5fa5c-7191-437d-b5b3-d5e5e2b6e4aa tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.452780 Oct 11 19:46:34.853474 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 657/1331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:34 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:34.861839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff13ae95-4152-4a52-87a7-f7324c5892a3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:34.865937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ff13ae95-4152-4a52-87a7-f7324c5892a3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:34.880777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff13ae95-4152-4a52-87a7-f7324c5892a3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:34.885078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff13ae95-4152-4a52-87a7-f7324c5892a3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:34.885982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff13ae95-4152-4a52-87a7-f7324c5892a3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:34.888650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff13ae95-4152-4a52-87a7-f7324c5892a3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:34.890085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff13ae95-4152-4a52-87a7-f7324c5892a3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:34.892086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff13ae95-4152-4a52-87a7-f7324c5892a3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:34.895429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:34.906705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:34.908481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:34.915607 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6e8657cb-62c8-4827-adb1-75f9fe2d2fb1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.319259 Oct 11 19:46:34.917610 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 675/1332] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:34 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:35.132930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ff13ae95-4152-4a52-87a7-f7324c5892a3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:35.150785 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff13ae95-4152-4a52-87a7-f7324c5892a3 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1316 microversion: 2.1 time: 0.295404 Oct 11 19:46:35.152659 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 658/1333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:34 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:35.435315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-07f76eef-e481-4001-b0a5-7e00e4d03a40 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:35.436529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-07f76eef-e481-4001-b0a5-7e00e4d03a40 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:35.452352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f76eef-e481-4001-b0a5-7e00e4d03a40 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:35.453107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f76eef-e481-4001-b0a5-7e00e4d03a40 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:35.454190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f76eef-e481-4001-b0a5-7e00e4d03a40 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:35.455090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f76eef-e481-4001-b0a5-7e00e4d03a40 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:35.455700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f76eef-e481-4001-b0a5-7e00e4d03a40 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:35.457635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f76eef-e481-4001-b0a5-7e00e4d03a40 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:35.877178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c6f16ae3-28b8-47bb-99dc-62354b9b6184 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:35.878425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c6f16ae3-28b8-47bb-99dc-62354b9b6184 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:35.889690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f16ae3-28b8-47bb-99dc-62354b9b6184 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:35.890085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-07f76eef-e481-4001-b0a5-7e00e4d03a40 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:35.893316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f16ae3-28b8-47bb-99dc-62354b9b6184 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:35.893762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f16ae3-28b8-47bb-99dc-62354b9b6184 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:35.894472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f16ae3-28b8-47bb-99dc-62354b9b6184 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:35.894948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f16ae3-28b8-47bb-99dc-62354b9b6184 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:35.895613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f16ae3-28b8-47bb-99dc-62354b9b6184 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:35.912040 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-07f76eef-e481-4001-b0a5-7e00e4d03a40 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.482304 Oct 11 19:46:35.922559 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 676/1334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:35 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:35.922559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b4e57620-5ae9-46a5-9b1d-af0b974bc54c req-73a3064c-e57a-4006-af04-01ede906f07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0faeed-8955-458c-984f-2cf29c9fbba3", "tag": "f66e6991-c437-411f-8a95-e3e855f7a692"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:35.982108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b4e57620-5ae9-46a5-9b1d-af0b974bc54c req-73a3064c-e57a-4006-af04-01ede906f07e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:35.988814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b4e57620-5ae9-46a5-9b1d-af0b974bc54c req-73a3064c-e57a-4006-af04-01ede906f07e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:35.989915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b4e57620-5ae9-46a5-9b1d-af0b974bc54c req-73a3064c-e57a-4006-af04-01ede906f07e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:36.035171 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b4e57620-5ae9-46a5-9b1d-af0b974bc54c req-73a3064c-e57a-4006-af04-01ede906f07e service nova] Creating event network-changed:f66e6991-c437-411f-8a95-e3e855f7a692 for instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 on n-h1-860864-3 Oct 11 19:46:36.051987 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b4e57620-5ae9-46a5-9b1d-af0b974bc54c req-73a3064c-e57a-4006-af04-01ede906f07e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133966 Oct 11 19:46:36.056555 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 677/1335] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:36.092634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:36.093473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:36.116405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:36.117274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:36.126175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:36.128178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:36.130387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:36.131122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:36.137096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:36.202602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c6f16ae3-28b8-47bb-99dc-62354b9b6184 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:36.215876 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c6f16ae3-28b8-47bb-99dc-62354b9b6184 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.342625 Oct 11 19:46:36.216897 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 659/1336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:35 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:36.237528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-734d504b-df4b-4278-abf3-fc1ce62c3455 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:36.238317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-734d504b-df4b-4278-abf3-fc1ce62c3455 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:36.248668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-734d504b-df4b-4278-abf3-fc1ce62c3455 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:36.252750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-734d504b-df4b-4278-abf3-fc1ce62c3455 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:36.253538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-734d504b-df4b-4278-abf3-fc1ce62c3455 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:36.254519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-734d504b-df4b-4278-abf3-fc1ce62c3455 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:36.255121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-734d504b-df4b-4278-abf3-fc1ce62c3455 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:36.261053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-734d504b-df4b-4278-abf3-fc1ce62c3455 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:36.298675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:36.317320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:36.319118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:36.329774 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-547bde06-238f-4e2e-a278-6b9e88ed4c30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.266228 Oct 11 19:46:36.331801 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 678/1337] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:36 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:36.522010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-734d504b-df4b-4278-abf3-fc1ce62c3455 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:36.532031 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-734d504b-df4b-4278-abf3-fc1ce62c3455 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1316 microversion: 2.1 time: 0.313353 Oct 11 19:46:36.552368 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 660/1338] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:36 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:36.873342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65b4ccf2-c0f7-48da-8ed5-4f70f59ecda5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Action: 'create', calling method: .version_select at 0x7f83cc4f0e50>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUOpqH5Hdohw5d6eKzET2IGgYrJAKqppZsXsvkvscgDNNQPJIhfpGrWOv3W4Tqgsb9KNbwn/VgcNPnbvMYnvCiJO5GBc8DeQMr8kJHlKTS7O7BySppxx8o3Rd4PV/LKeg=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65b4ccf2-c0f7-48da-8ed5-4f70f59ecda5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Request method failure captured: Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 257 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcgbWsbTnhcdr49pNRwVofnbM-V8zR9SPOxSdk59t0Bl2Bpr_czXvYp4ge4RiBVRKpwoVjMeACbF-zcaDh248BOyJV8DAkJWDu7-UZQnP5F1oWub39953--ZZC_CuIg5ui3uo8uWSz_jbOhlCwwZWw4V1HI-mZKEs5ngVbdiFjYSWWo Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2d2ff0fa4a084b2f898e165b7e625300", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}] Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUOpqH5Hdohw5d6eKzET2IGgYrJAKqppZsXsvkvscgDNNQPJIhfpGrWOv3W4Tqgsb9KNbwn/VgcNPnbvMYnvCiJO5GBc8DeQMr8kJHlKTS7O7BySppxx8o3Rd4PV/LKeg=="}} Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUOpqH5Hdohw5d6eKzET2IGgYrJAKqppZsXsvkvscgDNNQPJIhfpGrWOv3W4Tqgsb9KNbwn/VgcNPnbvMYnvCiJO5GBc8DeQMr8kJHlKTS7O7BySppxx8o3Rd4PV/LKeg=='}}} Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 11 19:46:36.891156 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 19:46:36.896258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.901498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65b4ccf2-c0f7-48da-8ed5-4f70f59ecda5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:36.906874 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-65b4ccf2-c0f7-48da-8ed5-4f70f59ecda5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.573331 Oct 11 19:46:36.911614 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 679/1339] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:46:36 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 579 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:46:36.919836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe0f076a-65d0-4577-a680-b2755dfd87e5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Action: 'create', calling method: .version_select at 0x7f83cc388700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1423198557", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:36.941456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9966475a-15a2-4e1e-ab4a-52b9f280c08d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:36.942312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9966475a-15a2-4e1e-ab4a-52b9f280c08d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:36.945012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-fe0f076a-65d0-4577-a680-b2755dfd87e5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Getting quotas for project 2d2ff0fa4a084b2f898e165b7e625300. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:36.952902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-fe0f076a-65d0-4577-a680-b2755dfd87e5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Getting quotas for user 5fdbeb87f9f14971aeb49fb11436a1e4 and project 2d2ff0fa4a084b2f898e165b7e625300. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:36.963560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9966475a-15a2-4e1e-ab4a-52b9f280c08d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:36.964075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9966475a-15a2-4e1e-ab4a-52b9f280c08d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:36.964600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9966475a-15a2-4e1e-ab4a-52b9f280c08d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:36.965307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9966475a-15a2-4e1e-ab4a-52b9f280c08d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:36.965762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9966475a-15a2-4e1e-ab4a-52b9f280c08d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:36.966191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9966475a-15a2-4e1e-ab4a-52b9f280c08d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:36.974733 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-fe0f076a-65d0-4577-a680-b2755dfd87e5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe0f076a-65d0-4577-a680-b2755dfd87e5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Request method failure captured: Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 2167 Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcgbWsbTnhcdr49pNRwVofnbM-V8zR9SPOxSdk59t0Bl2Bpr_czXvYp4ge4RiBVRKpwoVjMeACbF-zcaDh248BOyJV8DAkJWDu7-UZQnP5F1oWub39953--ZZC_CuIg5ui3uo8uWSz_jbOhlCwwZWw4V1HI-mZKEs5ngVbdiFjYSWWo Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2d2ff0fa4a084b2f898e165b7e625300", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}] Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1423198557", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:46:36.983492 n-d-860864-3 devstack@n-api.service[126956]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1423198557', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:36.986090 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe0f076a-65d0-4577-a680-b2755dfd87e5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fe0f076a-65d0-4577-a680-b2755dfd87e5 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.070397 Oct 11 19:46:36.988777 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 661/1340] 10.222.0.27 () {60 vars in 1160 bytes} [Tue Oct 11 19:46:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 11 19:46:36.997973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc571f89-8a76-4cc4-817d-0ba57a3ed539 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Action: 'create', calling method: .version_select at 0x7f83cc2ff670>, body: {"keypair": {"name": "tempest-keypair-1537930747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3LxQA7aF73m7hLX0Wl/NEZSQpvjm9QzJb9PKn4B5WaDLGLffNLZtCqhFu34k9m4JyJulNB2jO0Oh3Z4C0s1lcg0fo/Qdwuae8CrANoHX4onhyaBxyXAFu1hLXdxbHY/g=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:37.034134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-dc571f89-8a76-4cc4-817d-0ba57a3ed539 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Getting quotas for project 2d2ff0fa4a084b2f898e165b7e625300. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:37.046755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-dc571f89-8a76-4cc4-817d-0ba57a3ed539 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Getting quotas for user 5fdbeb87f9f14971aeb49fb11436a1e4 and project 2d2ff0fa4a084b2f898e165b7e625300. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:37.098344 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc571f89-8a76-4cc4-817d-0ba57a3ed539 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102268 Oct 11 19:46:37.101670 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 662/1341] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:46:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:37.115741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb0415e6-ef02-4c17-91d1-5c1823213e54 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Action: 'create', calling method: .version_select at 0x7f83cc4d65e0>, body: {"keypair": {"name": "tempest-keypair-1537930747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXAnWkgL2ZsnJ0OVjSNjuMwDa3OSlars18sKFPa5HLiDeVdj9Phglkq0FmaATg1newDPqCDbRDk67Fn8fjPYp9RHeaTsEGpirqMgNzM/6Qda0tYqa+YWi3OxmOzgafGvQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:37.159722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-eb0415e6-ef02-4c17-91d1-5c1823213e54 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Getting quotas for project 2d2ff0fa4a084b2f898e165b7e625300. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:37.179948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-eb0415e6-ef02-4c17-91d1-5c1823213e54 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Getting quotas for user 5fdbeb87f9f14971aeb49fb11436a1e4 and project 2d2ff0fa4a084b2f898e165b7e625300. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:37.236505 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-eb0415e6-ef02-4c17-91d1-5c1823213e54 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] HTTP exception thrown: Key pair 'tempest-keypair-1537930747' already exists. Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb0415e6-ef02-4c17-91d1-5c1823213e54 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Request method failure captured: Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 273 Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcgbWsbTnhcdr49pNRwVofnbM-V8zR9SPOxSdk59t0Bl2Bpr_czXvYp4ge4RiBVRKpwoVjMeACbF-zcaDh248BOyJV8DAkJWDu7-UZQnP5F1oWub39953--ZZC_CuIg5ui3uo8uWSz_jbOhlCwwZWw4V1HI-mZKEs5ngVbdiFjYSWWo Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2d2ff0fa4a084b2f898e165b7e625300", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}] Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: {"keypair": {"name": "tempest-keypair-1537930747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXAnWkgL2ZsnJ0OVjSNjuMwDa3OSlars18sKFPa5HLiDeVdj9Phglkq0FmaATg1newDPqCDbRDk67Fn8fjPYp9RHeaTsEGpirqMgNzM/6Qda0tYqa+YWi3OxmOzgafGvQ=="}} Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: exception: Key pair 'tempest-keypair-1537930747' already exists. Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1537930747', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXAnWkgL2ZsnJ0OVjSNjuMwDa3OSlars18sKFPa5HLiDeVdj9Phglkq0FmaATg1newDPqCDbRDk67Fn8fjPYp9RHeaTsEGpirqMgNzM/6Qda0tYqa+YWi3OxmOzgafGvQ=='}}} Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result.read() Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '5fdbeb87f9f14971aeb49fb11436a1e4-tempest-keypair-1537930747' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 11 19:46:37.246632 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result.read() Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 19:46:37.251204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '5fdbeb87f9f14971aeb49fb11436a1e4-tempest-keypair-1537930747' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 19, 46, 37, 223867), 'updated_at': None, 'name': 'tempest-keypair-1537930747', 'user_id': '5fdbeb87f9f14971aeb49fb11436a1e4', 'fingerprint': 'e2:e2:32:1f:5e:34:97:b4:5f:fd:69:95:c5:08:a9:5a', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXAnWkgL2ZsnJ0OVjSNjuMwDa3OSlars18sKFPa5HLiDeVdj9Phglkq0FmaATg1newDPqCDbRDk67Fn8fjPYp9RHeaTsEGpirqMgNzM/6Qda0tYqa+YWi3OxmOzgafGvQ==', 'type': 'ssh'}] Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi keypair.create() Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._create() Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1537930747' already exists. Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 11 19:46:37.257294 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1537930747' already exists. Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1537930747' already exists. Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb0415e6-ef02-4c17-91d1-5c1823213e54 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Returning 409 to user: Key pair 'tempest-keypair-1537930747' already exists. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb0415e6-ef02-4c17-91d1-5c1823213e54 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.150126 Oct 11 19:46:37.267525 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 663/1342] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:46:37 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:46:37.275313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ccd3de9b-f2fa-4bb6-bc91-d8b8bab68687 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:37.276744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ccd3de9b-f2fa-4bb6-bc91-d8b8bab68687 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:37.286089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd3de9b-f2fa-4bb6-bc91-d8b8bab68687 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:37.287016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd3de9b-f2fa-4bb6-bc91-d8b8bab68687 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:37.287675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd3de9b-f2fa-4bb6-bc91-d8b8bab68687 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:37.288610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd3de9b-f2fa-4bb6-bc91-d8b8bab68687 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:37.289260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd3de9b-f2fa-4bb6-bc91-d8b8bab68687 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:37.289889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd3de9b-f2fa-4bb6-bc91-d8b8bab68687 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:37.296471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9966475a-15a2-4e1e-ab4a-52b9f280c08d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:37.314001 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9966475a-15a2-4e1e-ab4a-52b9f280c08d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.376275 Oct 11 19:46:37.326731 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 680/1343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:36 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:37.349783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-808d7abe-0043-42b3-9bcb-5d258130527f tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Calling method '.version_select at 0x7f83d0763ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:37.393314 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-808d7abe-0043-42b3-9bcb-5d258130527f tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1537930747" status: 202 len: 0 microversion: 2.1 time: 0.064060 Oct 11 19:46:37.395725 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 681/1344] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 19:46:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1537930747 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:37.405498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:37.413520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:37.427163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:37.429437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:37.430374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:37.431682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:37.440264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:37.440867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:37.496795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ccd3de9b-f2fa-4bb6-bc91-d8b8bab68687 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:37.505216 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ccd3de9b-f2fa-4bb6-bc91-d8b8bab68687 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.234341 Oct 11 19:46:37.506170 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 664/1345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:37 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:37.524796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ece7fa5-524e-4ad4-addb-39e03cc3962e tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Action: 'create', calling method: .version_select at 0x7f83cc2f85e0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKQHJsWMtxbrtncUNDXSzE3jWjGOmqh9QNsoV0sVX68ID7ayfvhsBN6I5pYjLw8MJTzocTPTcYHBuKmd2mZmoXkTSC8wykc/Ut8JkEjDUGdQJOYJStIzUgrWyne3vMBTw=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ece7fa5-524e-4ad4-addb-39e03cc3962e tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Request method failure captured: Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 247 Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcgbWsbTnhcdr49pNRwVofnbM-V8zR9SPOxSdk59t0Bl2Bpr_czXvYp4ge4RiBVRKpwoVjMeACbF-zcaDh248BOyJV8DAkJWDu7-UZQnP5F1oWub39953--ZZC_CuIg5ui3uo8uWSz_jbOhlCwwZWw4V1HI-mZKEs5ngVbdiFjYSWWo Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2d2ff0fa4a084b2f898e165b7e625300", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}] Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKQHJsWMtxbrtncUNDXSzE3jWjGOmqh9QNsoV0sVX68ID7ayfvhsBN6I5pYjLw8MJTzocTPTcYHBuKmd2mZmoXkTSC8wykc/Ut8JkEjDUGdQJOYJStIzUgrWyne3vMBTw=="}} Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKQHJsWMtxbrtncUNDXSzE3jWjGOmqh9QNsoV0sVX68ID7ayfvhsBN6I5pYjLw8MJTzocTPTcYHBuKmd2mZmoXkTSC8wykc/Ut8JkEjDUGdQJOYJStIzUgrWyne3vMBTw=='}}} Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi '' Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:46:37.530559 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:46:37.534708 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.537654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ece7fa5-524e-4ad4-addb-39e03cc3962e tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:37.538816 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ece7fa5-524e-4ad4-addb-39e03cc3962e tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.031622 Oct 11 19:46:37.539964 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 665/1346] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:46:37 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:46:37.550844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6f508a43-18e6-4450-988e-2b6cda105283 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Action: 'create', calling method: .version_select at 0x7f83cc388670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1643301740", "public_key": " "}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:37.572201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:37.584396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:37.586551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:37.589464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-6f508a43-18e6-4450-988e-2b6cda105283 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Getting quotas for project 2d2ff0fa4a084b2f898e165b7e625300. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:37.593530 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7afe7cac-286c-4279-83ff-f95d2ceab8ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.196200 Oct 11 19:46:37.606582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-6f508a43-18e6-4450-988e-2b6cda105283 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Getting quotas for user 5fdbeb87f9f14971aeb49fb11436a1e4 and project 2d2ff0fa4a084b2f898e165b7e625300. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:37.607614 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 682/1347] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:37 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:37.622884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b3803788-0ae5-4959-a6b1-f8485f064ba2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:37.628661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b3803788-0ae5-4959-a6b1-f8485f064ba2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:37.643454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3803788-0ae5-4959-a6b1-f8485f064ba2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:37.646018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3803788-0ae5-4959-a6b1-f8485f064ba2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:37.646667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3803788-0ae5-4959-a6b1-f8485f064ba2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:37.647504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3803788-0ae5-4959-a6b1-f8485f064ba2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:37.648635 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-6f508a43-18e6-4450-988e-2b6cda105283 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:37.649243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3803788-0ae5-4959-a6b1-f8485f064ba2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:37.649965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3803788-0ae5-4959-a6b1-f8485f064ba2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6f508a43-18e6-4450-988e-2b6cda105283 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Request method failure captured: Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 95 Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcgbWsbTnhcdr49pNRwVofnbM-V8zR9SPOxSdk59t0Bl2Bpr_czXvYp4ge4RiBVRKpwoVjMeACbF-zcaDh248BOyJV8DAkJWDu7-UZQnP5F1oWub39953--ZZC_CuIg5ui3uo8uWSz_jbOhlCwwZWw4V1HI-mZKEs5ngVbdiFjYSWWo Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2d2ff0fa4a084b2f898e165b7e625300", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}] Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1643301740", "public_key": " "}} Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1643301740', 'public_key': ' '}}} Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.653378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.663759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6f508a43-18e6-4450-988e-2b6cda105283 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:37.683109 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6f508a43-18e6-4450-988e-2b6cda105283 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.116713 Oct 11 19:46:37.695167 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 666/1348] 10.222.0.27 () {60 vars in 1158 bytes} [Tue Oct 11 19:46:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:46:37.708918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-18933da9-7b22-4f58-965f-ea308ec1b30b tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Action: 'create', calling method: .version_select at 0x7f83cc2ff4c0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlTFB4RnjTnQ4DZ1dqnVpHeb09eTViROisivQcyJeycXs2PXRPgKhwBsmJPW4RdM2zu4vwuDvqSa7WnHhKjIDPH/DKZsy9YpuzZqIk4pTt4nBFT1thOJGEZFBG4Ke+6+A=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-18933da9-7b22-4f58-965f-ea308ec1b30b tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Request method failure captured: Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 507 Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcgbWsbTnhcdr49pNRwVofnbM-V8zR9SPOxSdk59t0Bl2Bpr_czXvYp4ge4RiBVRKpwoVjMeACbF-zcaDh248BOyJV8DAkJWDu7-UZQnP5F1oWub39953--ZZC_CuIg5ui3uo8uWSz_jbOhlCwwZWw4V1HI-mZKEs5ngVbdiFjYSWWo Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2d2ff0fa4a084b2f898e165b7e625300", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}] Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlTFB4RnjTnQ4DZ1dqnVpHeb09eTViROisivQcyJeycXs2PXRPgKhwBsmJPW4RdM2zu4vwuDvqSa7WnHhKjIDPH/DKZsy9YpuzZqIk4pTt4nBFT1thOJGEZFBG4Ke+6+A=="}} Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlTFB4RnjTnQ4DZ1dqnVpHeb09eTViROisivQcyJeycXs2PXRPgKhwBsmJPW4RdM2zu4vwuDvqSa7WnHhKjIDPH/DKZsy9YpuzZqIk4pTt4nBFT1thOJGEZFBG4Ke+6+A=='}}} Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 11 19:46:37.717839 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 19:46:37.721486 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.725498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-18933da9-7b22-4f58-965f-ea308ec1b30b tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:37.727426 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-18933da9-7b22-4f58-965f-ea308ec1b30b tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.031095 Oct 11 19:46:37.735227 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 667/1349] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:46:37 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:46:37.744080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b50c696-9c17-4004-8ea8-954a3edd9844 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Action: 'create', calling method: .version_select at 0x7f83cc2f8ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1542395190", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:37.770519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-0b50c696-9c17-4004-8ea8-954a3edd9844 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Getting quotas for project 2d2ff0fa4a084b2f898e165b7e625300. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:37.799902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-0b50c696-9c17-4004-8ea8-954a3edd9844 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Getting quotas for user 5fdbeb87f9f14971aeb49fb11436a1e4 and project 2d2ff0fa4a084b2f898e165b7e625300. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:37.850678 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0b50c696-9c17-4004-8ea8-954a3edd9844 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b50c696-9c17-4004-8ea8-954a3edd9844 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Request method failure captured: Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 118 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcgbWsbTnhcdr49pNRwVofnbM-V8zR9SPOxSdk59t0Bl2Bpr_czXvYp4ge4RiBVRKpwoVjMeACbF-zcaDh248BOyJV8DAkJWDu7-UZQnP5F1oWub39953--ZZC_CuIg5ui3uo8uWSz_jbOhlCwwZWw4V1HI-mZKEs5ngVbdiFjYSWWo Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2d2ff0fa4a084b2f898e165b7e625300", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}] Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1542395190", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1542395190', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 11 19:46:37.852825 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.857753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b50c696-9c17-4004-8ea8-954a3edd9844 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:37.869169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b50c696-9c17-4004-8ea8-954a3edd9844 tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.114173 Oct 11 19:46:37.869708 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 668/1350] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:46:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 11 19:46:37.879498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4fe7d40d-43e6-4a38-819a-ba470fb29c4b tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Calling method '.version_select at 0x7f83cc388280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:37.934916 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4fe7d40d-43e6-4a38-819a-ba470fb29c4b tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-18351934 not found for user 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4fe7d40d-43e6-4a38-819a-ba470fb29c4b tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Request method failure captured: Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-18351934 HTTP/1.1 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcgbWsbTnhcdr49pNRwVofnbM-V8zR9SPOxSdk59t0Bl2Bpr_czXvYp4ge4RiBVRKpwoVjMeACbF-zcaDh248BOyJV8DAkJWDu7-UZQnP5F1oWub39953--ZZC_CuIg5ui3uo8uWSz_jbOhlCwwZWw4V1HI-mZKEs5ngVbdiFjYSWWo Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2d2ff0fa4a084b2f898e165b7e625300", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2d2ff0fa4a084b2f898e165b7e625300"}]}] Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 2d2ff0fa4a084b2f898e165b7e625300 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-445923727 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-KeyPairsNegativeTestJSON-445923727-project Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: exception: Keypair tempest-keypair-non-existent-18351934 not found for user 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'tempest-keypair-non-existent-18351934'} Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-18351934 not found for user 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.939016 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-18351934 not found for user 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-18351934 not found for user 5fdbeb87f9f14971aeb49fb11436a1e4 Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4fe7d40d-43e6-4a38-819a-ba470fb29c4b tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] Returning 404 to user: Keypair tempest-keypair-non-existent-18351934 not found for user 5fdbeb87f9f14971aeb49fb11436a1e4 {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4fe7d40d-43e6-4a38-819a-ba470fb29c4b tempest-KeyPairsNegativeTestJSON-445923727 tempest-KeyPairsNegativeTestJSON-445923727-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-18351934" status: 404 len: 143 microversion: 2.1 time: 0.064862 Oct 11 19:46:37.943099 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 669/1351] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 11 19:46:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-18351934 => generated 143 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:46:37.988225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b3803788-0ae5-4959-a6b1-f8485f064ba2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:37.999842 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b3803788-0ae5-4959-a6b1-f8485f064ba2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1316 microversion: 2.1 time: 0.390844 Oct 11 19:46:38.000819 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 683/1352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:37 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:38.342250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fc157a83-9031-4da7-b590-5f99fd169c7e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:38.342768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fc157a83-9031-4da7-b590-5f99fd169c7e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:38.353311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fc157a83-9031-4da7-b590-5f99fd169c7e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:38.354712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fc157a83-9031-4da7-b590-5f99fd169c7e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:38.355442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fc157a83-9031-4da7-b590-5f99fd169c7e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:38.356649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fc157a83-9031-4da7-b590-5f99fd169c7e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:38.357558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fc157a83-9031-4da7-b590-5f99fd169c7e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:38.358267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fc157a83-9031-4da7-b590-5f99fd169c7e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:38.530481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b5dfa515-ab04-4587-bfbb-b6c8cd8b1c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:38.531142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b5dfa515-ab04-4587-bfbb-b6c8cd8b1c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:38.545329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5dfa515-ab04-4587-bfbb-b6c8cd8b1c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:38.546108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5dfa515-ab04-4587-bfbb-b6c8cd8b1c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:38.546750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5dfa515-ab04-4587-bfbb-b6c8cd8b1c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:38.547771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5dfa515-ab04-4587-bfbb-b6c8cd8b1c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:38.548377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5dfa515-ab04-4587-bfbb-b6c8cd8b1c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:38.548960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5dfa515-ab04-4587-bfbb-b6c8cd8b1c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:38.710158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fc157a83-9031-4da7-b590-5f99fd169c7e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:38.730705 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fc157a83-9031-4da7-b590-5f99fd169c7e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.394561 Oct 11 19:46:38.742564 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 670/1353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:38 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:38.750272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:38.750272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:38.769509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:38.774071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:38.774618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:38.775392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:38.777118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:38.788170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:38.872697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b5dfa515-ab04-4587-bfbb-b6c8cd8b1c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:38.883329 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b5dfa515-ab04-4587-bfbb-b6c8cd8b1c91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.357298 Oct 11 19:46:38.900034 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 684/1354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:38 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:39.017129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:39.026368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2453e209-8e59-4327-bba9-32857075aff5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:39.027985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2453e209-8e59-4327-bba9-32857075aff5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:39.029198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:39.043134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:39.054510 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a9593281-592c-4e0c-b24b-7517998fc841 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.321884 Oct 11 19:46:39.055798 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 671/1355] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:38 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:39.062731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2453e209-8e59-4327-bba9-32857075aff5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:39.062731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2453e209-8e59-4327-bba9-32857075aff5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:39.062731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2453e209-8e59-4327-bba9-32857075aff5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:39.071630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2453e209-8e59-4327-bba9-32857075aff5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:39.072306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2453e209-8e59-4327-bba9-32857075aff5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:39.073982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2453e209-8e59-4327-bba9-32857075aff5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:39.311574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2453e209-8e59-4327-bba9-32857075aff5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:39.322352 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2453e209-8e59-4327-bba9-32857075aff5 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1316 microversion: 2.1 time: 0.298950 Oct 11 19:46:39.323037 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 685/1356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:39 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:39.759127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a6b05ad1-29d2-4ccb-86f9-82fea381b9d9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:39.760590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a6b05ad1-29d2-4ccb-86f9-82fea381b9d9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:39.775535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6b05ad1-29d2-4ccb-86f9-82fea381b9d9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:39.778372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6b05ad1-29d2-4ccb-86f9-82fea381b9d9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:39.779079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6b05ad1-29d2-4ccb-86f9-82fea381b9d9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:39.780021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6b05ad1-29d2-4ccb-86f9-82fea381b9d9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:39.782470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6b05ad1-29d2-4ccb-86f9-82fea381b9d9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:39.783252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6b05ad1-29d2-4ccb-86f9-82fea381b9d9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:40.124795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-911131905", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:40.135581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:40.202809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a6b05ad1-29d2-4ccb-86f9-82fea381b9d9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:40.218031 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a6b05ad1-29d2-4ccb-86f9-82fea381b9d9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.463858 Oct 11 19:46:40.219583 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 672/1357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:39 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:40.226054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc753a00-ff5b-4cfa-9858-f1070484d5e3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:40.226727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc753a00-ff5b-4cfa-9858-f1070484d5e3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:40.239541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:46:40.245884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc753a00-ff5b-4cfa-9858-f1070484d5e3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:40.246309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc753a00-ff5b-4cfa-9858-f1070484d5e3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:40.246773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc753a00-ff5b-4cfa-9858-f1070484d5e3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:40.256503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc753a00-ff5b-4cfa-9858-f1070484d5e3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:40.257094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc753a00-ff5b-4cfa-9858-f1070484d5e3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:40.257542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc753a00-ff5b-4cfa-9858-f1070484d5e3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:40.837108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dc753a00-ff5b-4cfa-9858-f1070484d5e3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:40.858751 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc753a00-ff5b-4cfa-9858-f1070484d5e3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.627899 Oct 11 19:46:40.859571 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 673/1358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:40 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:40.868107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:40.868783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:40.901355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:40.902027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:46:40.902662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:46:40.903457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:46:40.904751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:46:40.905875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:40.906442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:40.907040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:46:40.907549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:40.908070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:40.908615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:40.932502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:40.934222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:40.934983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:40.935904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:40.936552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:40.937376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:40.962832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Getting quotas for project 486d669d7170472da22189d6d7c6fd7d. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:40.969575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Getting quotas for user 868c158fc4d8483e90592f757197cad0 and project 486d669d7170472da22189d6d7c6fd7d. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:40.984907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:46:40.988051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:46:41.065090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:41.075065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:41.081076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:41.089241 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f938b4e-4f9e-4c9d-9bea-45443b25cdaf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.228427 Oct 11 19:46:41.090125 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 674/1359] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:40 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:41.129405 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fe1b4d90-8182-424d-9252-ff3a204001f4 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249835 Oct 11 19:46:41.130176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0dbf5b86-8e2c-45a2-b311-57c386a4168d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:41.131565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0dbf5b86-8e2c-45a2-b311-57c386a4168d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:41.133034 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 686/1360] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:46:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:46:41.144196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9ac1f489-f015-4870-aba6-75ec94e4d67d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:41.145142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9ac1f489-f015-4870-aba6-75ec94e4d67d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:41.145797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dbf5b86-8e2c-45a2-b311-57c386a4168d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:41.147953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dbf5b86-8e2c-45a2-b311-57c386a4168d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:41.149144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dbf5b86-8e2c-45a2-b311-57c386a4168d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:41.152874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dbf5b86-8e2c-45a2-b311-57c386a4168d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:41.154434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dbf5b86-8e2c-45a2-b311-57c386a4168d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:41.155163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dbf5b86-8e2c-45a2-b311-57c386a4168d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:41.313293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9ac1f489-f015-4870-aba6-75ec94e4d67d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:41.323294 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9ac1f489-f015-4870-aba6-75ec94e4d67d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1222 microversion: 2.1 time: 0.181498 Oct 11 19:46:41.329502 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 687/1361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:41 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1222 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:41.342145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c3bace3d-2643-460b-ab1e-20b2d8656c14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:41.343502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c3bace3d-2643-460b-ab1e-20b2d8656c14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:41.358374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3bace3d-2643-460b-ab1e-20b2d8656c14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:41.359905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3bace3d-2643-460b-ab1e-20b2d8656c14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:41.360516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3bace3d-2643-460b-ab1e-20b2d8656c14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:41.361082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3bace3d-2643-460b-ab1e-20b2d8656c14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:41.363951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3bace3d-2643-460b-ab1e-20b2d8656c14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:41.365157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3bace3d-2643-460b-ab1e-20b2d8656c14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:41.884380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0dbf5b86-8e2c-45a2-b311-57c386a4168d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:41.899191 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0dbf5b86-8e2c-45a2-b311-57c386a4168d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1316 microversion: 2.1 time: 0.797051 Oct 11 19:46:41.917145 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 675/1362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:41 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1316 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:41.925776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-85bfef62-b17c-4dd0-aaaf-36eae8576a47 req-403c96e6-1198-4696-bc81-fed9b4866ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b0faeed-8955-458c-984f-2cf29c9fbba3", "name": "network-vif-plugged", "status": "completed", "tag": "f66e6991-c437-411f-8a95-e3e855f7a692"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:41.939450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-85bfef62-b17c-4dd0-aaaf-36eae8576a47 req-403c96e6-1198-4696-bc81-fed9b4866ab5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:41.940667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-85bfef62-b17c-4dd0-aaaf-36eae8576a47 req-403c96e6-1198-4696-bc81-fed9b4866ab5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:41.942209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-85bfef62-b17c-4dd0-aaaf-36eae8576a47 req-403c96e6-1198-4696-bc81-fed9b4866ab5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:41.973417 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-85bfef62-b17c-4dd0-aaaf-36eae8576a47 req-403c96e6-1198-4696-bc81-fed9b4866ab5 service nova] Creating event network-vif-plugged:f66e6991-c437-411f-8a95-e3e855f7a692 for instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 on n-h1-860864-3 Oct 11 19:46:41.980988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-85bfef62-b17c-4dd0-aaaf-36eae8576a47 req-403c96e6-1198-4696-bc81-fed9b4866ab5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062139 Oct 11 19:46:41.989799 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 676/1363] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:42.001119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77a5e1d0-c2f8-4a63-9234-0803aaac2237 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:42.002638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-77a5e1d0-c2f8-4a63-9234-0803aaac2237 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:42.011375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77a5e1d0-c2f8-4a63-9234-0803aaac2237 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:42.012237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77a5e1d0-c2f8-4a63-9234-0803aaac2237 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:42.013210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77a5e1d0-c2f8-4a63-9234-0803aaac2237 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:42.014303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77a5e1d0-c2f8-4a63-9234-0803aaac2237 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:42.015073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77a5e1d0-c2f8-4a63-9234-0803aaac2237 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:42.015762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77a5e1d0-c2f8-4a63-9234-0803aaac2237 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:42.020517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c3bace3d-2643-460b-ab1e-20b2d8656c14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:42.034219 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c3bace3d-2643-460b-ab1e-20b2d8656c14 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.701738 Oct 11 19:46:42.035061 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 688/1364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:41 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:42.132097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:42.133648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:42.155993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:42.156590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:42.157049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:42.157880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:42.158330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:42.162593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:42.445148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:42.471828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:42.477802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:42.505546 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-96ea96fa-7c4f-4849-a126-86ae414a2c55 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.386142 Oct 11 19:46:42.506705 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 689/1365] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:42 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:42.518502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9971c321-42a1-4be8-a49f-09b241ff9ff1 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:42.519138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9971c321-42a1-4be8-a49f-09b241ff9ff1 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:42.526814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9971c321-42a1-4be8-a49f-09b241ff9ff1 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:42.527540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9971c321-42a1-4be8-a49f-09b241ff9ff1 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:42.528626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9971c321-42a1-4be8-a49f-09b241ff9ff1 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:42.529752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9971c321-42a1-4be8-a49f-09b241ff9ff1 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:42.530371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9971c321-42a1-4be8-a49f-09b241ff9ff1 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:42.530908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9971c321-42a1-4be8-a49f-09b241ff9ff1 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:42.756696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-77a5e1d0-c2f8-4a63-9234-0803aaac2237 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:42.761934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9971c321-42a1-4be8-a49f-09b241ff9ff1 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:42.769765 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-77a5e1d0-c2f8-4a63-9234-0803aaac2237 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.777824 Oct 11 19:46:42.773043 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9971c321-42a1-4be8-a49f-09b241ff9ff1 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1274 microversion: 2.1 time: 0.264194 Oct 11 19:46:42.774295 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 677/1366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:41 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:42.777346 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 690/1367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:42 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:42.930671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f399f231-c13d-402e-bcaa-913b479e542a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:42.932745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f399f231-c13d-402e-bcaa-913b479e542a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:42.948220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f399f231-c13d-402e-bcaa-913b479e542a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:42.949162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f399f231-c13d-402e-bcaa-913b479e542a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:42.949804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f399f231-c13d-402e-bcaa-913b479e542a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:42.951013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f399f231-c13d-402e-bcaa-913b479e542a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:42.952045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f399f231-c13d-402e-bcaa-913b479e542a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:42.952689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f399f231-c13d-402e-bcaa-913b479e542a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:43.061040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f70506cd-d80c-4f3d-99bc-935119c9eb2d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:43.063071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f70506cd-d80c-4f3d-99bc-935119c9eb2d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:43.074668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:43.102319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f70506cd-d80c-4f3d-99bc-935119c9eb2d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:43.103564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f70506cd-d80c-4f3d-99bc-935119c9eb2d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:43.104252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f70506cd-d80c-4f3d-99bc-935119c9eb2d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:43.105194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f70506cd-d80c-4f3d-99bc-935119c9eb2d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:43.105929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f70506cd-d80c-4f3d-99bc-935119c9eb2d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:43.106665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f70506cd-d80c-4f3d-99bc-935119c9eb2d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:43.262619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f399f231-c13d-402e-bcaa-913b479e542a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:43.273633 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f399f231-c13d-402e-bcaa-913b479e542a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1316 microversion: 2.1 time: 0.348040 Oct 11 19:46:43.274818 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 678/1368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:42 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:43.398661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f70506cd-d80c-4f3d-99bc-935119c9eb2d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:43.412509 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f70506cd-d80c-4f3d-99bc-935119c9eb2d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1718 microversion: 2.1 time: 0.356444 Oct 11 19:46:43.414161 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 691/1369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:43 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1718 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:43.537185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:43.538491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:43.555557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:43.558936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:43.559702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:43.560688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:43.561404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:43.565279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:43.814377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06a67b3a-9c8a-4f34-8678-40119c837743 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:43.816531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-06a67b3a-9c8a-4f34-8678-40119c837743 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:43.831797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a67b3a-9c8a-4f34-8678-40119c837743 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:43.835199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a67b3a-9c8a-4f34-8678-40119c837743 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:43.837039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a67b3a-9c8a-4f34-8678-40119c837743 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:43.840152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a67b3a-9c8a-4f34-8678-40119c837743 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:43.841105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a67b3a-9c8a-4f34-8678-40119c837743 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:43.841758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a67b3a-9c8a-4f34-8678-40119c837743 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:44.132608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:44.148262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:44.151854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:44.158864 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a8843d0-58eb-4166-b4d0-d55037e4a603 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.625917 Oct 11 19:46:44.160205 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 679/1370] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:43 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:44.186243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99e12fbc-7ffc-402b-b9c3-043e0a81d5af tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:44.187140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-99e12fbc-7ffc-402b-b9c3-043e0a81d5af tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:44.192874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:44.196077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e12fbc-7ffc-402b-b9c3-043e0a81d5af tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:44.196824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e12fbc-7ffc-402b-b9c3-043e0a81d5af tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:44.199097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e12fbc-7ffc-402b-b9c3-043e0a81d5af tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:44.200243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e12fbc-7ffc-402b-b9c3-043e0a81d5af tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:44.201129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e12fbc-7ffc-402b-b9c3-043e0a81d5af tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:44.202609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99e12fbc-7ffc-402b-b9c3-043e0a81d5af tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:44.394310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-99e12fbc-7ffc-402b-b9c3-043e0a81d5af tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:44.409516 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99e12fbc-7ffc-402b-b9c3-043e0a81d5af tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1280 microversion: 2.1 time: 0.247993 Oct 11 19:46:44.413392 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 680/1371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:44 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:44.423228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-73d2a70e-b626-47b4-a8d3-c0e327656bd4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:44.424107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-73d2a70e-b626-47b4-a8d3-c0e327656bd4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:44.434049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73d2a70e-b626-47b4-a8d3-c0e327656bd4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:44.434858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73d2a70e-b626-47b4-a8d3-c0e327656bd4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:44.435467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73d2a70e-b626-47b4-a8d3-c0e327656bd4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:44.437905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73d2a70e-b626-47b4-a8d3-c0e327656bd4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:44.438588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73d2a70e-b626-47b4-a8d3-c0e327656bd4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:44.439186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73d2a70e-b626-47b4-a8d3-c0e327656bd4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:44.475679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:44.647598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-06a67b3a-9c8a-4f34-8678-40119c837743 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:44.657022 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-06a67b3a-9c8a-4f34-8678-40119c837743 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.851550 Oct 11 19:46:44.664735 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 692/1372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:43 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:44.669984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-94711817-d684-462e-8243-f1bfcd644902 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:44.675853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-94711817-d684-462e-8243-f1bfcd644902 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:44.702582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94711817-d684-462e-8243-f1bfcd644902 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:44.703673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94711817-d684-462e-8243-f1bfcd644902 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:44.704321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94711817-d684-462e-8243-f1bfcd644902 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:44.714086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94711817-d684-462e-8243-f1bfcd644902 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:44.720085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94711817-d684-462e-8243-f1bfcd644902 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:44.720888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94711817-d684-462e-8243-f1bfcd644902 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:44.833587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-73d2a70e-b626-47b4-a8d3-c0e327656bd4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:44.844213 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-73d2a70e-b626-47b4-a8d3-c0e327656bd4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1504 microversion: 2.1 time: 0.427225 Oct 11 19:46:44.850009 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 681/1373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:44 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:44.874349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-161e95ac-8fd2-466b-9fcd-3fd72f2d2c2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1004832201"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:44.875777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-161e95ac-8fd2-466b-9fcd-3fd72f2d2c2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:44.917844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-161e95ac-8fd2-466b-9fcd-3fd72f2d2c2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:44.919253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-161e95ac-8fd2-466b-9fcd-3fd72f2d2c2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:44.921510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-161e95ac-8fd2-466b-9fcd-3fd72f2d2c2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:44.924924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-161e95ac-8fd2-466b-9fcd-3fd72f2d2c2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:44.929080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-161e95ac-8fd2-466b-9fcd-3fd72f2d2c2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:44.932891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-161e95ac-8fd2-466b-9fcd-3fd72f2d2c2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:45.093645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-94711817-d684-462e-8243-f1bfcd644902 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:45.118053 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-94711817-d684-462e-8243-f1bfcd644902 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1708 microversion: 2.1 time: 0.451877 Oct 11 19:46:45.119120 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 693/1374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:44 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1708 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:45.141979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11a422d3-9e5b-4abc-81a6-6ba7086dcc30 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '.version_select at 0x7f83d08ae940>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:45.147380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a422d3-9e5b-4abc-81a6-6ba7086dcc30 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:45.147886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a422d3-9e5b-4abc-81a6-6ba7086dcc30 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:45.156084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a422d3-9e5b-4abc-81a6-6ba7086dcc30 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:45.182191 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11a422d3-9e5b-4abc-81a6-6ba7086dcc30 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3113 microversion: 2.1 time: 0.043713 Oct 11 19:46:45.183801 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 694/1375] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:46:45 2022] GET /compute/v2.1/os-migrations => generated 3113 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:45.200187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:45.201342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:45.207731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:45.208450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:45.213921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:45.215013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:45.215657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:45.216257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:45.418164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:45.439085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:45.441539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:45.457414 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-971620a2-c72c-49a1-ae2d-883264cb8145 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.261621 Oct 11 19:46:45.486368 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 695/1376] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:45 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:45.499058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-92059e83-6f80-47a8-a552-0ba18feade53 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:45.503982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-92059e83-6f80-47a8-a552-0ba18feade53 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:45.516367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92059e83-6f80-47a8-a552-0ba18feade53 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:45.517910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92059e83-6f80-47a8-a552-0ba18feade53 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:45.519329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92059e83-6f80-47a8-a552-0ba18feade53 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:45.520492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92059e83-6f80-47a8-a552-0ba18feade53 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:45.521849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92059e83-6f80-47a8-a552-0ba18feade53 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:45.523024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92059e83-6f80-47a8-a552-0ba18feade53 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:45.636407 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.network.security_group_api [None req-161e95ac-8fd2-466b-9fcd-3fd72f2d2c2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Adding security group 48883837-b190-4a31-a551-d606ff50cea3 to port f66e6991-c437-411f-8a95-e3e855f7a692 Oct 11 19:46:46.634858 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-92059e83-6f80-47a8-a552-0ba18feade53 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1859 microversion: 2.1 time: 1.142773 Oct 11 19:46:46.637142 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 696/1377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:45 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1859 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:46.651048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-75f1a4ea-8eb1-4226-bf9a-da56a712450d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:46.652397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-75f1a4ea-8eb1-4226-bf9a-da56a712450d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:46.680267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75f1a4ea-8eb1-4226-bf9a-da56a712450d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:46.687872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75f1a4ea-8eb1-4226-bf9a-da56a712450d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:46.690329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75f1a4ea-8eb1-4226-bf9a-da56a712450d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:46.691504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75f1a4ea-8eb1-4226-bf9a-da56a712450d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:46.692182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75f1a4ea-8eb1-4226-bf9a-da56a712450d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:46.692977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75f1a4ea-8eb1-4226-bf9a-da56a712450d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:46.742356 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-161e95ac-8fd2-466b-9fcd-3fd72f2d2c2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3/action" status: 202 len: 0 microversion: 2.1 time: 1.873551 Oct 11 19:46:46.746671 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 682/1378] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:44 2022] POST /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3/action => generated 0 bytes in 1875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:46.755798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b39fcaa9-ba74-4558-a2d6-8ab550cebb87 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:46.756555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b39fcaa9-ba74-4558-a2d6-8ab550cebb87 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:46.771908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b39fcaa9-ba74-4558-a2d6-8ab550cebb87 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:46.777416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b39fcaa9-ba74-4558-a2d6-8ab550cebb87 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:46.777971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b39fcaa9-ba74-4558-a2d6-8ab550cebb87 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:46.779051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b39fcaa9-ba74-4558-a2d6-8ab550cebb87 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:46.780199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b39fcaa9-ba74-4558-a2d6-8ab550cebb87 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:46.789702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b39fcaa9-ba74-4558-a2d6-8ab550cebb87 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:47.330091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b39fcaa9-ba74-4558-a2d6-8ab550cebb87 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:47.338544 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b39fcaa9-ba74-4558-a2d6-8ab550cebb87 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.593842 Oct 11 19:46:47.346960 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 683/1379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:46 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:47.352843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:47.357714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:47.376166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:47.376953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:47.377552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:47.378427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:47.379062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:47.380601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:47.401759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-75f1a4ea-8eb1-4226-bf9a-da56a712450d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:47.416220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-75f1a4ea-8eb1-4226-bf9a-da56a712450d tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1322 microversion: 2.1 time: 0.777388 Oct 11 19:46:47.417006 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 697/1380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:46 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1322 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:47.435943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5515c063-d4c1-441a-ba3f-23432e51e719 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:47.436567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5515c063-d4c1-441a-ba3f-23432e51e719 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:47.455238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5515c063-d4c1-441a-ba3f-23432e51e719 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:47.455744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5515c063-d4c1-441a-ba3f-23432e51e719 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:47.456299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5515c063-d4c1-441a-ba3f-23432e51e719 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:47.468063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5515c063-d4c1-441a-ba3f-23432e51e719 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:47.468624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5515c063-d4c1-441a-ba3f-23432e51e719 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:47.469073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5515c063-d4c1-441a-ba3f-23432e51e719 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:47.634847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:47.651430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:47.653279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:47.681284 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d3f13864-56cc-476f-a782-61a5498560b6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.323247 Oct 11 19:46:47.683178 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 684/1381] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:47 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:47.694892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61083cce-66e0-47f1-a6aa-599151444cf7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc2cdca0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:47.823220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=74 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:48.210008 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5515c063-d4c1-441a-ba3f-23432e51e719 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1859 microversion: 2.1 time: 0.792082 Oct 11 19:46:48.213305 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 698/1382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:47 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1859 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:48.252099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-33e6a123-1682-4d8d-a68a-66cda4a8cc51 req-0a3ea5d0-2f73-4e1c-bed0-52ab274911c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0faeed-8955-458c-984f-2cf29c9fbba3", "tag": "f66e6991-c437-411f-8a95-e3e855f7a692"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:48.274843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-33e6a123-1682-4d8d-a68a-66cda4a8cc51 req-0a3ea5d0-2f73-4e1c-bed0-52ab274911c0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:48.275601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-33e6a123-1682-4d8d-a68a-66cda4a8cc51 req-0a3ea5d0-2f73-4e1c-bed0-52ab274911c0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:48.276241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-33e6a123-1682-4d8d-a68a-66cda4a8cc51 req-0a3ea5d0-2f73-4e1c-bed0-52ab274911c0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:48.281356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:48.294273 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-33e6a123-1682-4d8d-a68a-66cda4a8cc51 req-0a3ea5d0-2f73-4e1c-bed0-52ab274911c0 service nova] Creating event network-changed:f66e6991-c437-411f-8a95-e3e855f7a692 for instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 on n-h1-860864-3 Oct 11 19:46:48.295573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-61083cce-66e0-47f1-a6aa-599151444cf7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 48883837-b190-4a31-a551-d606ff50cea3 in use.", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:46:48.296255 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-61083cce-66e0-47f1-a6aa-599151444cf7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security Group 48883837-b190-4a31-a551-d606ff50cea3 in use. Oct 11 19:46:48.296255 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-5aed3b4a-e93a-4158-9561-19d48d3b3328'] Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61083cce-66e0-47f1-a6aa-599151444cf7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-security-groups/48883837-b190-4a31-a551-d606ff50cea3 HTTP/1.1 Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: exception: Security Group 48883837-b190-4a31-a551-d606ff50cea3 in use. Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-5aed3b4a-e93a-4158-9561-19d48d3b3328'] Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '48883837-b190-4a31-a551-d606ff50cea3'} Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:46:48.299182 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 48883837-b190-4a31-a551-d606ff50cea3 in use. Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5aed3b4a-e93a-4158-9561-19d48d3b3328'] Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 48883837-b190-4a31-a551-d606ff50cea3 in use. Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5aed3b4a-e93a-4158-9561-19d48d3b3328'] Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 48883837-b190-4a31-a551-d606ff50cea3 in use. Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5aed3b4a-e93a-4158-9561-19d48d3b3328'] Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 48883837-b190-4a31-a551-d606ff50cea3 in use. Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5aed3b4a-e93a-4158-9561-19d48d3b3328'] Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61083cce-66e0-47f1-a6aa-599151444cf7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 400 to user: Security Group 48883837-b190-4a31-a551-d606ff50cea3 in use. Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-5aed3b4a-e93a-4158-9561-19d48d3b3328'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-61083cce-66e0-47f1-a6aa-599151444cf7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/48883837-b190-4a31-a551-d606ff50cea3" status: 400 len: 185 microversion: 2.1 time: 0.613983 Oct 11 19:46:48.304308 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 685/1383] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:46:47 2022] DELETE /compute/v2.1/os-security-groups/48883837-b190-4a31-a551-d606ff50cea3 => generated 185 bytes in 618 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:46:48.312432 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-33e6a123-1682-4d8d-a68a-66cda4a8cc51 req-0a3ea5d0-2f73-4e1c-bed0-52ab274911c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095975 Oct 11 19:46:48.314401 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 699/1384] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:48.317328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8f42e6df-0439-40ff-b4a8-f3c108a1fec2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:48.331157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8f42e6df-0439-40ff-b4a8-f3c108a1fec2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:48.371397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-45be88b2-945e-4f00-b56a-7e1b862b4f91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:48.372389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f42e6df-0439-40ff-b4a8-f3c108a1fec2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:48.372626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-45be88b2-945e-4f00-b56a-7e1b862b4f91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:48.372983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f42e6df-0439-40ff-b4a8-f3c108a1fec2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:48.373392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f42e6df-0439-40ff-b4a8-f3c108a1fec2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:48.374126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f42e6df-0439-40ff-b4a8-f3c108a1fec2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:48.387697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f42e6df-0439-40ff-b4a8-f3c108a1fec2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:48.388160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f42e6df-0439-40ff-b4a8-f3c108a1fec2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:48.400433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45be88b2-945e-4f00-b56a-7e1b862b4f91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:48.401406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45be88b2-945e-4f00-b56a-7e1b862b4f91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:48.402071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45be88b2-945e-4f00-b56a-7e1b862b4f91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:48.403410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45be88b2-945e-4f00-b56a-7e1b862b4f91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:48.404071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45be88b2-945e-4f00-b56a-7e1b862b4f91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:48.404715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45be88b2-945e-4f00-b56a-7e1b862b4f91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:48.723767 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8f42e6df-0439-40ff-b4a8-f3c108a1fec2 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3/action" status: 202 len: 0 microversion: 2.1 time: 0.412343 Oct 11 19:46:48.724424 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 686/1385] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:48 2022] POST /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:46:48.735952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38773d28-542b-44c6-9a0d-ca8fecb02e5b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:48.740117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-38773d28-542b-44c6-9a0d-ca8fecb02e5b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:48.758817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38773d28-542b-44c6-9a0d-ca8fecb02e5b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:48.766442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38773d28-542b-44c6-9a0d-ca8fecb02e5b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:48.776443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38773d28-542b-44c6-9a0d-ca8fecb02e5b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:48.777228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38773d28-542b-44c6-9a0d-ca8fecb02e5b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:48.779227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38773d28-542b-44c6-9a0d-ca8fecb02e5b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:48.779668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38773d28-542b-44c6-9a0d-ca8fecb02e5b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:48.862684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-45be88b2-945e-4f00-b56a-7e1b862b4f91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:48.876310 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-45be88b2-945e-4f00-b56a-7e1b862b4f91 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.512233 Oct 11 19:46:48.882058 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 700/1386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:48 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:48.902179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-41bd3bc9-1195-4954-92b2-61ed38acf062 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:48.903962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-41bd3bc9-1195-4954-92b2-61ed38acf062 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:48.927273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41bd3bc9-1195-4954-92b2-61ed38acf062 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:48.930034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41bd3bc9-1195-4954-92b2-61ed38acf062 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:48.930560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41bd3bc9-1195-4954-92b2-61ed38acf062 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:48.933895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41bd3bc9-1195-4954-92b2-61ed38acf062 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:48.937918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41bd3bc9-1195-4954-92b2-61ed38acf062 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:48.953537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41bd3bc9-1195-4954-92b2-61ed38acf062 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:49.268955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-41bd3bc9-1195-4954-92b2-61ed38acf062 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:49.280634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-38773d28-542b-44c6-9a0d-ca8fecb02e5b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lazy-loading 'services' on Instance uuid ab2bcc99-b3f9-47c2-bb34-4f3a24081296 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:46:49.284224 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-41bd3bc9-1195-4954-92b2-61ed38acf062 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1322 microversion: 2.1 time: 0.400944 Oct 11 19:46:49.300270 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 701/1387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:48 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:49.310145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:49.313640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:49.330967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:49.333273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:49.336269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:49.360289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:49.361251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:49.361975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:49.525847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:49.536772 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-38773d28-542b-44c6-9a0d-ca8fecb02e5b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments/8fc8d78d-90db-4e5a-85bb-6181d6826e52" status: 202 len: 0 microversion: 2.1 time: 0.809420 Oct 11 19:46:49.538334 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 687/1388] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 19:46:48 2022] DELETE /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments/8fc8d78d-90db-4e5a-85bb-6181d6826e52 => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:49.546809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7bbbd20e-347b-447e-8b16-b5b0477c6709 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:49.548067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7bbbd20e-347b-447e-8b16-b5b0477c6709 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:49.561916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bbbd20e-347b-447e-8b16-b5b0477c6709 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:49.562800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bbbd20e-347b-447e-8b16-b5b0477c6709 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:49.563450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bbbd20e-347b-447e-8b16-b5b0477c6709 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:49.564450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bbbd20e-347b-447e-8b16-b5b0477c6709 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:49.564960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:49.565668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bbbd20e-347b-447e-8b16-b5b0477c6709 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:49.566286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bbbd20e-347b-447e-8b16-b5b0477c6709 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:49.574827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:49.597019 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d9a6309d-952f-40c6-b703-a60d6f705c90 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.291577 Oct 11 19:46:49.599323 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 702/1389] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:49 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:49.612162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5f8cf2ea-d8fc-4657-98b1-31c6d8312754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:49.614628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f8cf2ea-d8fc-4657-98b1-31c6d8312754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:49.633827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f8cf2ea-d8fc-4657-98b1-31c6d8312754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:49.634884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f8cf2ea-d8fc-4657-98b1-31c6d8312754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:49.635326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f8cf2ea-d8fc-4657-98b1-31c6d8312754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:49.636206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f8cf2ea-d8fc-4657-98b1-31c6d8312754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:49.636676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f8cf2ea-d8fc-4657-98b1-31c6d8312754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:49.637107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f8cf2ea-d8fc-4657-98b1-31c6d8312754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:49.741369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f8cf2ea-d8fc-4657-98b1-31c6d8312754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:46:49.876133 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5f8cf2ea-d8fc-4657-98b1-31c6d8312754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 204 len: 0 microversion: 2.1 time: 0.273757 Oct 11 19:46:49.877175 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 703/1390] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:46:49 2022] DELETE /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:46:49.896497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-132fbb89-eed2-4043-b1ab-06c6d2ce8362 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:49.905350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-132fbb89-eed2-4043-b1ab-06c6d2ce8362 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:49.934273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-132fbb89-eed2-4043-b1ab-06c6d2ce8362 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:49.935230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-132fbb89-eed2-4043-b1ab-06c6d2ce8362 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:49.935703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-132fbb89-eed2-4043-b1ab-06c6d2ce8362 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:49.941514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-132fbb89-eed2-4043-b1ab-06c6d2ce8362 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:49.942097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-132fbb89-eed2-4043-b1ab-06c6d2ce8362 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:49.943686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-132fbb89-eed2-4043-b1ab-06c6d2ce8362 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:49.968657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7bbbd20e-347b-447e-8b16-b5b0477c6709 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:49.984883 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7bbbd20e-347b-447e-8b16-b5b0477c6709 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1575 microversion: 2.1 time: 0.444591 Oct 11 19:46:49.985611 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 688/1391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:49 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1575 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:49.993953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b779253b-1cb5-4c94-92af-e9af8abdbc23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:49.994570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b779253b-1cb5-4c94-92af-e9af8abdbc23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:50.010096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b779253b-1cb5-4c94-92af-e9af8abdbc23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:50.011670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b779253b-1cb5-4c94-92af-e9af8abdbc23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:50.013173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b779253b-1cb5-4c94-92af-e9af8abdbc23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:50.015341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b779253b-1cb5-4c94-92af-e9af8abdbc23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:50.016013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b779253b-1cb5-4c94-92af-e9af8abdbc23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:50.019059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b779253b-1cb5-4c94-92af-e9af8abdbc23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:50.027609 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-132fbb89-eed2-4043-b1ab-06c6d2ce8362 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143791 Oct 11 19:46:50.036685 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 704/1392] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:46:49 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:50.053503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-271f8be0-ce99-4bfb-b1fe-60cbd4df0fca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:50.059604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-271f8be0-ce99-4bfb-b1fe-60cbd4df0fca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:50.084072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-271f8be0-ce99-4bfb-b1fe-60cbd4df0fca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:50.084720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-271f8be0-ce99-4bfb-b1fe-60cbd4df0fca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:50.085286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-271f8be0-ce99-4bfb-b1fe-60cbd4df0fca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:50.086745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-271f8be0-ce99-4bfb-b1fe-60cbd4df0fca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:50.088023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-271f8be0-ce99-4bfb-b1fe-60cbd4df0fca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:50.088707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-271f8be0-ce99-4bfb-b1fe-60cbd4df0fca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:50.518736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b779253b-1cb5-4c94-92af-e9af8abdbc23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:50.527900 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b779253b-1cb5-4c94-92af-e9af8abdbc23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1553 microversion: 2.1 time: 0.540462 Oct 11 19:46:50.528479 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 689/1393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:49 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1553 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:50.541992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5e27097b-82cf-484b-a6d6-8a422958fba3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:50.552331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5e27097b-82cf-484b-a6d6-8a422958fba3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:50.569052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e27097b-82cf-484b-a6d6-8a422958fba3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:50.569568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e27097b-82cf-484b-a6d6-8a422958fba3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:50.570014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e27097b-82cf-484b-a6d6-8a422958fba3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:50.571098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e27097b-82cf-484b-a6d6-8a422958fba3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:50.571248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e27097b-82cf-484b-a6d6-8a422958fba3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:50.571616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e27097b-82cf-484b-a6d6-8a422958fba3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:50.591776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-271f8be0-ce99-4bfb-b1fe-60cbd4df0fca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:50.600844 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-271f8be0-ce99-4bfb-b1fe-60cbd4df0fca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.558703 Oct 11 19:46:50.614587 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 705/1394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:50 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:50.614587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5ab32ab0-d103-4e71-b630-f0ba3035510e req-43e1ace5-b5ba-4555-89ec-f0f60823a9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccfac528-a6be-45a6-914f-53d90ee124a0", "tag": "9f016a48-46b6-4f37-bbf6-b267cb70a8ab"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:50.627985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ab32ab0-d103-4e71-b630-f0ba3035510e req-43e1ace5-b5ba-4555-89ec-f0f60823a9b7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:50.628516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ab32ab0-d103-4e71-b630-f0ba3035510e req-43e1ace5-b5ba-4555-89ec-f0f60823a9b7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:50.628957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ab32ab0-d103-4e71-b630-f0ba3035510e req-43e1ace5-b5ba-4555-89ec-f0f60823a9b7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:50.649483 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5ab32ab0-d103-4e71-b630-f0ba3035510e req-43e1ace5-b5ba-4555-89ec-f0f60823a9b7 service nova] Creating event network-changed:9f016a48-46b6-4f37-bbf6-b267cb70a8ab for instance ccfac528-a6be-45a6-914f-53d90ee124a0 on n-h2-860864-3 Oct 11 19:46:50.655789 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5ab32ab0-d103-4e71-b630-f0ba3035510e req-43e1ace5-b5ba-4555-89ec-f0f60823a9b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051539 Oct 11 19:46:50.657261 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 706/1395] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:50.667829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:50.688310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:50.701864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:50.702370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:50.713770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:50.714553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:50.715100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:50.715545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:50.853943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:50.863411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:50.872886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:50.889559 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d335df43-9baa-4994-9ee8-918aa2a207a7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.228036 Oct 11 19:46:50.896188 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 707/1396] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:50 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:50.905179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5e27097b-82cf-484b-a6d6-8a422958fba3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:50.916372 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5e27097b-82cf-484b-a6d6-8a422958fba3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1322 microversion: 2.1 time: 0.380104 Oct 11 19:46:50.917170 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 690/1397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:50 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:51.012420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-87945cb5-e6cf-4bd0-9c96-77db4657e982 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:51.013438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-87945cb5-e6cf-4bd0-9c96-77db4657e982 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:51.016221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:51.022166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87945cb5-e6cf-4bd0-9c96-77db4657e982 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:51.022980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87945cb5-e6cf-4bd0-9c96-77db4657e982 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:51.023658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87945cb5-e6cf-4bd0-9c96-77db4657e982 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:51.024540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87945cb5-e6cf-4bd0-9c96-77db4657e982 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:51.026470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87945cb5-e6cf-4bd0-9c96-77db4657e982 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:51.027116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87945cb5-e6cf-4bd0-9c96-77db4657e982 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:51.045960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1267645b-162b-43cc-919a-ace5d15c5abe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:51.049244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1267645b-162b-43cc-919a-ace5d15c5abe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:51.062929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1267645b-162b-43cc-919a-ace5d15c5abe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:51.067284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1267645b-162b-43cc-919a-ace5d15c5abe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:51.068205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1267645b-162b-43cc-919a-ace5d15c5abe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:51.069403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1267645b-162b-43cc-919a-ace5d15c5abe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:51.070130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1267645b-162b-43cc-919a-ace5d15c5abe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:51.071438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1267645b-162b-43cc-919a-ace5d15c5abe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:51.274562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-87945cb5-e6cf-4bd0-9c96-77db4657e982 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:51.285089 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-87945cb5-e6cf-4bd0-9c96-77db4657e982 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1575 microversion: 2.1 time: 0.277788 Oct 11 19:46:51.294623 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 708/1398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:51 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1575 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:51.500763 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1267645b-162b-43cc-919a-ace5d15c5abe tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.461879 Oct 11 19:46:51.501843 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 691/1399] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:46:51 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments => generated 197 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:51.553500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d3d2b9b0-3355-4b19-9931-db6321c826a6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:51.559068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d3d2b9b0-3355-4b19-9931-db6321c826a6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:51.565019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:51.573469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3d2b9b0-3355-4b19-9931-db6321c826a6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:51.574182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3d2b9b0-3355-4b19-9931-db6321c826a6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:51.574770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3d2b9b0-3355-4b19-9931-db6321c826a6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:51.581209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3d2b9b0-3355-4b19-9931-db6321c826a6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:51.584048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3d2b9b0-3355-4b19-9931-db6321c826a6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:51.584613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3d2b9b0-3355-4b19-9931-db6321c826a6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:51.893794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-703962984", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "412cbda9-d9a6-437a-9a83-87a92464cf0c"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:52.015583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] validate_networks() for [('412cbda9-d9a6-437a-9a83-87a92464cf0c', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:46:52.374747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d3d2b9b0-3355-4b19-9931-db6321c826a6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:52.391433 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d3d2b9b0-3355-4b19-9931-db6321c826a6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1553 microversion: 2.1 time: 0.841565 Oct 11 19:46:52.392224 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 709/1400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:51 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1553 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:52.398254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-240b0d26-7e40-4d39-9962-34932c17775c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:52.407993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-240b0d26-7e40-4d39-9962-34932c17775c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:52.421067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240b0d26-7e40-4d39-9962-34932c17775c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:52.427229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240b0d26-7e40-4d39-9962-34932c17775c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:52.428034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240b0d26-7e40-4d39-9962-34932c17775c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:52.429046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240b0d26-7e40-4d39-9962-34932c17775c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:52.433353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240b0d26-7e40-4d39-9962-34932c17775c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:52.434123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-240b0d26-7e40-4d39-9962-34932c17775c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:52.844176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-240b0d26-7e40-4d39-9962-34932c17775c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:52.854477 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-240b0d26-7e40-4d39-9962-34932c17775c tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.460984 Oct 11 19:46:52.870193 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 710/1401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:52 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:52.882659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:52.883276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:52.915163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:52.916120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:52.916753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:52.917685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:52.922221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:52.923879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.237445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:53.262379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:53.268123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:53.283286 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9eae9481-777e-478c-8368-ad7d7f616f4c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.411369 Oct 11 19:46:53.284173 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 711/1402] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:52 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:53.289805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c16805a9-2a7b-4201-ac20-feee38093dd9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:53.290448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c16805a9-2a7b-4201-ac20-feee38093dd9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:53.302801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c16805a9-2a7b-4201-ac20-feee38093dd9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.303598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c16805a9-2a7b-4201-ac20-feee38093dd9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.304040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c16805a9-2a7b-4201-ac20-feee38093dd9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.304748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c16805a9-2a7b-4201-ac20-feee38093dd9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.305204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c16805a9-2a7b-4201-ac20-feee38093dd9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.305625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c16805a9-2a7b-4201-ac20-feee38093dd9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.476118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:46:53.476651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:46:53.477087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:46:53.477596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:46:53.478107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:46:53.499857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.501145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.502071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.502920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.503379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.504039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.558807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Getting quotas for project cd6c2139c019469d8d6a41e036595765. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:46:53.578407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Getting quotas for user add987fef80d49318742f2c38793cf7a and project cd6c2139c019469d8d6a41e036595765. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:46:53.625782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:46:53.629044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:46:53.630773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c16805a9-2a7b-4201-ac20-feee38093dd9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:53.641576 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c16805a9-2a7b-4201-ac20-feee38093dd9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1322 microversion: 2.1 time: 0.355971 Oct 11 19:46:53.642289 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 712/1403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:53 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:53.647988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-81909102-3aa4-4992-a66e-3a1c6ab52190 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:53.648779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-81909102-3aa4-4992-a66e-3a1c6ab52190 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:53.666368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81909102-3aa4-4992-a66e-3a1c6ab52190 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.671206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81909102-3aa4-4992-a66e-3a1c6ab52190 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.673765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81909102-3aa4-4992-a66e-3a1c6ab52190 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.674798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81909102-3aa4-4992-a66e-3a1c6ab52190 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.675420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81909102-3aa4-4992-a66e-3a1c6ab52190 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.676219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81909102-3aa4-4992-a66e-3a1c6ab52190 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.715870 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98522c6e-ee3e-46e1-ae5b-31ee20575d91 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.167812 Oct 11 19:46:53.717067 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 692/1404] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:46:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:46:53.736521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77027761-6f62-4eb4-9245-5b3c4d60b122 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:53.739292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-77027761-6f62-4eb4-9245-5b3c4d60b122 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:53.753088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77027761-6f62-4eb4-9245-5b3c4d60b122 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.754865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77027761-6f62-4eb4-9245-5b3c4d60b122 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.755527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77027761-6f62-4eb4-9245-5b3c4d60b122 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.756846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77027761-6f62-4eb4-9245-5b3c4d60b122 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.757618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77027761-6f62-4eb4-9245-5b3c4d60b122 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.758239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77027761-6f62-4eb4-9245-5b3c4d60b122 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.818155 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-77027761-6f62-4eb4-9245-5b3c4d60b122 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087937 Oct 11 19:46:53.819453 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 693/1405] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:46:53 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:53.825026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2356c645-2ea1-4ccc-8d1d-a29dcc556c67 req-7d8c09d1-ee6d-4ed2-b416-5aa28ee43919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb63556-0909-48c6-b68a-edce831b629c", "name": "network-vif-deleted", "tag": "d734d00f-181e-495b-8ad0-87864f3ae86d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:53.841301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2356c645-2ea1-4ccc-8d1d-a29dcc556c67 req-7d8c09d1-ee6d-4ed2-b416-5aa28ee43919 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.842026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2356c645-2ea1-4ccc-8d1d-a29dcc556c67 req-7d8c09d1-ee6d-4ed2-b416-5aa28ee43919 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.843483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2356c645-2ea1-4ccc-8d1d-a29dcc556c67 req-7d8c09d1-ee6d-4ed2-b416-5aa28ee43919 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.881643 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2356c645-2ea1-4ccc-8d1d-a29dcc556c67 req-7d8c09d1-ee6d-4ed2-b416-5aa28ee43919 service nova] Creating event network-vif-deleted:d734d00f-181e-495b-8ad0-87864f3ae86d for instance 5fb63556-0909-48c6-b68a-edce831b629c on n-h2-860864-3 Oct 11 19:46:53.897820 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2356c645-2ea1-4ccc-8d1d-a29dcc556c67 req-7d8c09d1-ee6d-4ed2-b416-5aa28ee43919 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076846 Oct 11 19:46:53.901797 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 694/1406] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:53.910618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-82d3bbb8-7801-4d01-b3d6-17985bd147c9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:53.919604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-82d3bbb8-7801-4d01-b3d6-17985bd147c9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:53.932614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82d3bbb8-7801-4d01-b3d6-17985bd147c9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.933127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82d3bbb8-7801-4d01-b3d6-17985bd147c9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.933573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82d3bbb8-7801-4d01-b3d6-17985bd147c9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:53.934557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82d3bbb8-7801-4d01-b3d6-17985bd147c9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:53.935487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82d3bbb8-7801-4d01-b3d6-17985bd147c9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:53.935487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82d3bbb8-7801-4d01-b3d6-17985bd147c9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:54.364309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82d3bbb8-7801-4d01-b3d6-17985bd147c9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:54.374357 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-82d3bbb8-7801-4d01-b3d6-17985bd147c9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1346 microversion: 2.1 time: 0.471276 Oct 11 19:46:54.380434 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 695/1407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:53 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1346 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:54.388390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7c317447-0f34-4168-901d-c601712449d6 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:54.389028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7c317447-0f34-4168-901d-c601712449d6 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:54.437736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-81909102-3aa4-4992-a66e-3a1c6ab52190 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:54.447771 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-81909102-3aa4-4992-a66e-3a1c6ab52190 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1573 microversion: 2.1 time: 0.804252 Oct 11 19:46:54.449370 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 713/1408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:53 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1573 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:54.455277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b71f40e2-33a9-4dad-8ff9-54487f0d301b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:54.456214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b71f40e2-33a9-4dad-8ff9-54487f0d301b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:54.464623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b71f40e2-33a9-4dad-8ff9-54487f0d301b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:54.465567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b71f40e2-33a9-4dad-8ff9-54487f0d301b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:54.466302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b71f40e2-33a9-4dad-8ff9-54487f0d301b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:54.467516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b71f40e2-33a9-4dad-8ff9-54487f0d301b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:54.468188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b71f40e2-33a9-4dad-8ff9-54487f0d301b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:54.474746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b71f40e2-33a9-4dad-8ff9-54487f0d301b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:54.520573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7c317447-0f34-4168-901d-c601712449d6 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:54.528980 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7c317447-0f34-4168-901d-c601712449d6 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1217 microversion: 2.1 time: 0.147338 Oct 11 19:46:54.542921 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 696/1409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:54 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:54.548137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:54.548993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:54.559010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:54.559520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:54.559973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:54.560705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:54.561174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:54.561616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:54.739882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:54.753550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:54.755341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:54.769216 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a56e08b-6866-4a8c-aa49-b8172bc8c999 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.224850 Oct 11 19:46:54.773236 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 697/1410] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:54 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:54.782972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d2597046-c898-4a74-80e8-6fd297cd8c80 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1973482890"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:54.786369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d2597046-c898-4a74-80e8-6fd297cd8c80 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:54.798945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2597046-c898-4a74-80e8-6fd297cd8c80 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:54.799824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2597046-c898-4a74-80e8-6fd297cd8c80 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:54.801182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2597046-c898-4a74-80e8-6fd297cd8c80 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:54.801997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2597046-c898-4a74-80e8-6fd297cd8c80 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:54.807995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2597046-c898-4a74-80e8-6fd297cd8c80 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:54.808604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2597046-c898-4a74-80e8-6fd297cd8c80 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:54.909323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b71f40e2-33a9-4dad-8ff9-54487f0d301b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:54.942476 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b71f40e2-33a9-4dad-8ff9-54487f0d301b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.491743 Oct 11 19:46:54.965327 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 714/1411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:54 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:54.974715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c6bf22fa-447e-45c4-a1fc-6936773ec9a9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:54.980341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c6bf22fa-447e-45c4-a1fc-6936773ec9a9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:54.992342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bf22fa-447e-45c4-a1fc-6936773ec9a9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:54.993154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bf22fa-447e-45c4-a1fc-6936773ec9a9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:54.994765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bf22fa-447e-45c4-a1fc-6936773ec9a9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:54.995842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bf22fa-447e-45c4-a1fc-6936773ec9a9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:54.996535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bf22fa-447e-45c4-a1fc-6936773ec9a9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:54.997188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bf22fa-447e-45c4-a1fc-6936773ec9a9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:55.027700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:55.233298 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.network.security_group_api [None req-d2597046-c898-4a74-80e8-6fd297cd8c80 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Adding security group a4939ec5-1d92-4f68-8324-cec51965b997 to port f66e6991-c437-411f-8a95-e3e855f7a692 Oct 11 19:46:55.755931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c6bf22fa-447e-45c4-a1fc-6936773ec9a9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:55.764687 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c6bf22fa-447e-45c4-a1fc-6936773ec9a9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1322 microversion: 2.1 time: 0.797799 Oct 11 19:46:55.767188 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 715/1412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:54 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1322 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:55.775780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30228398-afdd-4de1-a1d2-18321ed2c667 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:55.787857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30228398-afdd-4de1-a1d2-18321ed2c667 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:55.797804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30228398-afdd-4de1-a1d2-18321ed2c667 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:55.798297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30228398-afdd-4de1-a1d2-18321ed2c667 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:55.798771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30228398-afdd-4de1-a1d2-18321ed2c667 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:55.802606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30228398-afdd-4de1-a1d2-18321ed2c667 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:55.803182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30228398-afdd-4de1-a1d2-18321ed2c667 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:55.803627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30228398-afdd-4de1-a1d2-18321ed2c667 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:55.893502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-30228398-afdd-4de1-a1d2-18321ed2c667 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118584 Oct 11 19:46:55.896424 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 716/1413] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:46:55 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:55.905358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d35f151c-5d67-48fc-a19f-47e3a6a0ea38 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:55.910488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d35f151c-5d67-48fc-a19f-47e3a6a0ea38 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:55.929958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f151c-5d67-48fc-a19f-47e3a6a0ea38 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:55.931191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f151c-5d67-48fc-a19f-47e3a6a0ea38 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:55.932425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f151c-5d67-48fc-a19f-47e3a6a0ea38 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:55.935412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f151c-5d67-48fc-a19f-47e3a6a0ea38 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:55.937719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f151c-5d67-48fc-a19f-47e3a6a0ea38 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:55.938932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f151c-5d67-48fc-a19f-47e3a6a0ea38 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:56.285447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d2597046-c898-4a74-80e8-6fd297cd8c80 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3/action" status: 202 len: 0 microversion: 2.1 time: 1.511010 Oct 11 19:46:56.286572 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 698/1414] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:46:54 2022] POST /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3/action => generated 0 bytes in 1513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:46:56.292976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-338e991f-f4d3-4303-bfeb-827e363e0943 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:56.293767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-338e991f-f4d3-4303-bfeb-827e363e0943 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:56.309002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-338e991f-f4d3-4303-bfeb-827e363e0943 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:56.309517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-338e991f-f4d3-4303-bfeb-827e363e0943 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:56.309962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-338e991f-f4d3-4303-bfeb-827e363e0943 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:56.313528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-338e991f-f4d3-4303-bfeb-827e363e0943 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:56.314067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-338e991f-f4d3-4303-bfeb-827e363e0943 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:56.314516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-338e991f-f4d3-4303-bfeb-827e363e0943 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:56.526378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-338e991f-f4d3-4303-bfeb-827e363e0943 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:56.539043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d35f151c-5d67-48fc-a19f-47e3a6a0ea38 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:56.545304 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-338e991f-f4d3-4303-bfeb-827e363e0943 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1287 microversion: 2.1 time: 0.257357 Oct 11 19:46:56.558933 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 699/1415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:56 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1287 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:56.558933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:56.558933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:56.568218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:56.568686 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d35f151c-5d67-48fc-a19f-47e3a6a0ea38 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1346 microversion: 2.1 time: 0.670843 Oct 11 19:46:56.568974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:56.569285 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 717/1416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:55 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1346 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:56.570263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:56.572063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:56.572645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:56.573320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:56.574194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4e39e655-e50c-4652-9ca8-c63215984486 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:56.574912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4e39e655-e50c-4652-9ca8-c63215984486 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:56.583916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:46:56.600385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e39e655-e50c-4652-9ca8-c63215984486 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:56.606084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e39e655-e50c-4652-9ca8-c63215984486 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:56.606674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e39e655-e50c-4652-9ca8-c63215984486 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:56.607888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e39e655-e50c-4652-9ca8-c63215984486 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:56.608615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e39e655-e50c-4652-9ca8-c63215984486 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:56.610037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e39e655-e50c-4652-9ca8-c63215984486 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:56.726101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:56.736585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:56.738260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:56.744727 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-49c32c4b-444d-4cb0-b4a3-a6842d67f6c5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.197778 Oct 11 19:46:56.757873 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 700/1417] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:56 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:56.772345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-47a6a622-c0b9-4d15-b012-bedcc8f5c6a6 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:56.773077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-47a6a622-c0b9-4d15-b012-bedcc8f5c6a6 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:56.811954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47a6a622-c0b9-4d15-b012-bedcc8f5c6a6 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:56.821010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47a6a622-c0b9-4d15-b012-bedcc8f5c6a6 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:56.822357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47a6a622-c0b9-4d15-b012-bedcc8f5c6a6 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:56.823380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47a6a622-c0b9-4d15-b012-bedcc8f5c6a6 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:56.823968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47a6a622-c0b9-4d15-b012-bedcc8f5c6a6 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:56.824511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47a6a622-c0b9-4d15-b012-bedcc8f5c6a6 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:56.949331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4e39e655-e50c-4652-9ca8-c63215984486 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:56.959905 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4e39e655-e50c-4652-9ca8-c63215984486 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.389559 Oct 11 19:46:56.965084 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 718/1418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:56 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:56.973984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6412e7be-26d7-448e-881a-ec69f2a0e2d6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc2a6280>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:57.151973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-6412e7be-26d7-448e-881a-ec69f2a0e2d6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a4939ec5-1d92-4f68-8324-cec51965b997 in use.", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:46:57.152988 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6412e7be-26d7-448e-881a-ec69f2a0e2d6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security Group a4939ec5-1d92-4f68-8324-cec51965b997 in use. Oct 11 19:46:57.152988 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-15f54c46-9b42-44f4-a57f-2b1d0f131123'] Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6412e7be-26d7-448e-881a-ec69f2a0e2d6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-security-groups/a4939ec5-1d92-4f68-8324-cec51965b997 HTTP/1.1 Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: exception: Security Group a4939ec5-1d92-4f68-8324-cec51965b997 in use. Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-15f54c46-9b42-44f4-a57f-2b1d0f131123'] Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a4939ec5-1d92-4f68-8324-cec51965b997'} Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:46:57.155279 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a4939ec5-1d92-4f68-8324-cec51965b997 in use. Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15f54c46-9b42-44f4-a57f-2b1d0f131123'] Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a4939ec5-1d92-4f68-8324-cec51965b997 in use. Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15f54c46-9b42-44f4-a57f-2b1d0f131123'] Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a4939ec5-1d92-4f68-8324-cec51965b997 in use. Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15f54c46-9b42-44f4-a57f-2b1d0f131123'] Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a4939ec5-1d92-4f68-8324-cec51965b997 in use. Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15f54c46-9b42-44f4-a57f-2b1d0f131123'] Oct 11 19:46:57.159952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:46:57.163547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6412e7be-26d7-448e-881a-ec69f2a0e2d6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 400 to user: Security Group a4939ec5-1d92-4f68-8324-cec51965b997 in use. Oct 11 19:46:57.163547 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-15f54c46-9b42-44f4-a57f-2b1d0f131123'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:46:57.164642 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6412e7be-26d7-448e-881a-ec69f2a0e2d6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a4939ec5-1d92-4f68-8324-cec51965b997" status: 400 len: 185 microversion: 2.1 time: 0.198523 Oct 11 19:46:57.165371 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 719/1419] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:46:56 2022] DELETE /compute/v2.1/os-security-groups/a4939ec5-1d92-4f68-8324-cec51965b997 => generated 185 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:46:57.174232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e5f219c1-0911-45dc-bcf4-cbee6f4f8a24 req-9604b6f4-99fe-4a99-a085-25025810a76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0faeed-8955-458c-984f-2cf29c9fbba3", "tag": "f66e6991-c437-411f-8a95-e3e855f7a692"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:46:57.185756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e5f219c1-0911-45dc-bcf4-cbee6f4f8a24 req-9604b6f4-99fe-4a99-a085-25025810a76d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.185973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-47a6a622-c0b9-4d15-b012-bedcc8f5c6a6 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid 72bf9d5c-d025-4705-828e-4e4e389f5681 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:46:57.186649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e5f219c1-0911-45dc-bcf4-cbee6f4f8a24 req-9604b6f4-99fe-4a99-a085-25025810a76d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.187251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e5f219c1-0911-45dc-bcf4-cbee6f4f8a24 req-9604b6f4-99fe-4a99-a085-25025810a76d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.199026 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e5f219c1-0911-45dc-bcf4-cbee6f4f8a24 req-9604b6f4-99fe-4a99-a085-25025810a76d service nova] Creating event network-changed:f66e6991-c437-411f-8a95-e3e855f7a692 for instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 on n-h1-860864-3 Oct 11 19:46:57.204623 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e5f219c1-0911-45dc-bcf4-cbee6f4f8a24 req-9604b6f4-99fe-4a99-a085-25025810a76d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037983 Oct 11 19:46:57.213339 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 720/1420] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:57.216969 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-47a6a622-c0b9-4d15-b012-bedcc8f5c6a6 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 2344 microversion: 2.25 time: 0.457663 Oct 11 19:46:57.219445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec34ad10-2adc-4059-a961-7e49a84625e9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:57.220327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ec34ad10-2adc-4059-a961-7e49a84625e9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:57.234606 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 701/1421] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:56 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 2344 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:57.236839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f99989b6-db05-49ea-aab3-81e091cd9bff tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:57.244669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f99989b6-db05-49ea-aab3-81e091cd9bff tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:57.248856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec34ad10-2adc-4059-a961-7e49a84625e9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.249557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec34ad10-2adc-4059-a961-7e49a84625e9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.262556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec34ad10-2adc-4059-a961-7e49a84625e9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.262976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f99989b6-db05-49ea-aab3-81e091cd9bff tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.262976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f99989b6-db05-49ea-aab3-81e091cd9bff tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.262976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f99989b6-db05-49ea-aab3-81e091cd9bff tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.262976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f99989b6-db05-49ea-aab3-81e091cd9bff tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.262976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f99989b6-db05-49ea-aab3-81e091cd9bff tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.262976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f99989b6-db05-49ea-aab3-81e091cd9bff tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.268061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec34ad10-2adc-4059-a961-7e49a84625e9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.268776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec34ad10-2adc-4059-a961-7e49a84625e9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.269379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec34ad10-2adc-4059-a961-7e49a84625e9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.354131 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f99989b6-db05-49ea-aab3-81e091cd9bff tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120291 Oct 11 19:46:57.355787 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 702/1422] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:46:57 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:57.362631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0dd4617a-d4c0-4302-96a3-e146c15cd901 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:57.363448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0dd4617a-d4c0-4302-96a3-e146c15cd901 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:57.372241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dd4617a-d4c0-4302-96a3-e146c15cd901 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.373193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dd4617a-d4c0-4302-96a3-e146c15cd901 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.373800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dd4617a-d4c0-4302-96a3-e146c15cd901 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.374864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dd4617a-d4c0-4302-96a3-e146c15cd901 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.376050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dd4617a-d4c0-4302-96a3-e146c15cd901 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.376640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dd4617a-d4c0-4302-96a3-e146c15cd901 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.479256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0dd4617a-d4c0-4302-96a3-e146c15cd901 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:46:57.625791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec34ad10-2adc-4059-a961-7e49a84625e9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:57.642553 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ec34ad10-2adc-4059-a961-7e49a84625e9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1322 microversion: 2.1 time: 0.427518 Oct 11 19:46:57.646393 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 721/1423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:57 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:57.667749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-303e293e-b86f-4aed-8a31-2e71beaff613 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:57.677909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-303e293e-b86f-4aed-8a31-2e71beaff613 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.687275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-303e293e-b86f-4aed-8a31-2e71beaff613 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.687757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-303e293e-b86f-4aed-8a31-2e71beaff613 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.688596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-303e293e-b86f-4aed-8a31-2e71beaff613 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.691290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-303e293e-b86f-4aed-8a31-2e71beaff613 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.691903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-303e293e-b86f-4aed-8a31-2e71beaff613 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.722508 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0dd4617a-d4c0-4302-96a3-e146c15cd901 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 204 len: 0 microversion: 2.1 time: 0.364163 Oct 11 19:46:57.723890 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 703/1424] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:46:57 2022] DELETE /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:46:57.725298 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-303e293e-b86f-4aed-8a31-2e71beaff613 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.076965 Oct 11 19:46:57.733606 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 722/1425] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Oct 11 19:46:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:46:57.733606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e3393cda-0893-47f1-9018-9b43d5b192e0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:57.733606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e3393cda-0893-47f1-9018-9b43d5b192e0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:57.740216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3393cda-0893-47f1-9018-9b43d5b192e0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.740725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3393cda-0893-47f1-9018-9b43d5b192e0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.741849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b820928c-3fb1-4cbf-9ca0-fb5168b3f9ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:57.742496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3393cda-0893-47f1-9018-9b43d5b192e0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.746955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b820928c-3fb1-4cbf-9ca0-fb5168b3f9ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:57.747380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3393cda-0893-47f1-9018-9b43d5b192e0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.749137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3393cda-0893-47f1-9018-9b43d5b192e0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.749436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3393cda-0893-47f1-9018-9b43d5b192e0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.762363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b820928c-3fb1-4cbf-9ca0-fb5168b3f9ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.763281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b820928c-3fb1-4cbf-9ca0-fb5168b3f9ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.766635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b820928c-3fb1-4cbf-9ca0-fb5168b3f9ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.767812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b820928c-3fb1-4cbf-9ca0-fb5168b3f9ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:57.768510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b820928c-3fb1-4cbf-9ca0-fb5168b3f9ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:57.769507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b820928c-3fb1-4cbf-9ca0-fb5168b3f9ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:57.935023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e3393cda-0893-47f1-9018-9b43d5b192e0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:57.957172 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e3393cda-0893-47f1-9018-9b43d5b192e0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1346 microversion: 2.1 time: 0.229409 Oct 11 19:46:57.962997 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 723/1426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:57 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1346 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:57.979994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b820928c-3fb1-4cbf-9ca0-fb5168b3f9ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:57.986230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-40448444-609c-4583-bb55-7f0d7a50a1cc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:57.987807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-40448444-609c-4583-bb55-7f0d7a50a1cc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:58.004502 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b820928c-3fb1-4cbf-9ca0-fb5168b3f9ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1275 microversion: 2.1 time: 0.278867 Oct 11 19:46:58.014791 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 704/1427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:57 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1275 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:58.014973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40448444-609c-4583-bb55-7f0d7a50a1cc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:58.014973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40448444-609c-4583-bb55-7f0d7a50a1cc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:58.014973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40448444-609c-4583-bb55-7f0d7a50a1cc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:58.015257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:58.015367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40448444-609c-4583-bb55-7f0d7a50a1cc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:58.015462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:58.015560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40448444-609c-4583-bb55-7f0d7a50a1cc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:58.023647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40448444-609c-4583-bb55-7f0d7a50a1cc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:58.027949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:58.028538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:58.029741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:58.029741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:58.030610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:58.030788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:58.233035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:58.242718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:58.253841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:58.276117 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-315066a7-019d-45c4-921f-5f347387a350 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.269701 Oct 11 19:46:58.279368 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 705/1428] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:58 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:58.285782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-48e02edf-690e-4865-aaa9-e80458e8f6f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:58.286832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-48e02edf-690e-4865-aaa9-e80458e8f6f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:58.308790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48e02edf-690e-4865-aaa9-e80458e8f6f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:58.312413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48e02edf-690e-4865-aaa9-e80458e8f6f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:58.313479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48e02edf-690e-4865-aaa9-e80458e8f6f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:58.314560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48e02edf-690e-4865-aaa9-e80458e8f6f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:58.315202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48e02edf-690e-4865-aaa9-e80458e8f6f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:58.315827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48e02edf-690e-4865-aaa9-e80458e8f6f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:58.482764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-40448444-609c-4583-bb55-7f0d7a50a1cc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:58.503512 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-40448444-609c-4583-bb55-7f0d7a50a1cc tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1648 microversion: 2.1 time: 0.538949 Oct 11 19:46:58.514551 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 724/1429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:57 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1648 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:58.514551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-35495d35-1b8a-4cef-b37e-27ba2aa65927 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:58.523166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35495d35-1b8a-4cef-b37e-27ba2aa65927 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:58.542152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35495d35-1b8a-4cef-b37e-27ba2aa65927 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:58.544506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35495d35-1b8a-4cef-b37e-27ba2aa65927 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:58.546321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35495d35-1b8a-4cef-b37e-27ba2aa65927 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:58.547252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35495d35-1b8a-4cef-b37e-27ba2aa65927 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:58.549249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35495d35-1b8a-4cef-b37e-27ba2aa65927 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:58.551000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35495d35-1b8a-4cef-b37e-27ba2aa65927 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:58.585440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-48e02edf-690e-4865-aaa9-e80458e8f6f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:58.598629 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-48e02edf-690e-4865-aaa9-e80458e8f6f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1542 microversion: 2.1 time: 0.313225 Oct 11 19:46:58.599506 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 706/1430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:58 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1542 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:58.611494 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-35495d35-1b8a-4cef-b37e-27ba2aa65927 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105193 Oct 11 19:46:58.616054 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 725/1431] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:46:58 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:46:58.673609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ce227fd-071d-472e-a4ed-0aae5fc25137 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:58.674274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6ce227fd-071d-472e-a4ed-0aae5fc25137 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:58.687576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce227fd-071d-472e-a4ed-0aae5fc25137 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:58.688121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce227fd-071d-472e-a4ed-0aae5fc25137 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:58.688564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce227fd-071d-472e-a4ed-0aae5fc25137 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:58.691999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce227fd-071d-472e-a4ed-0aae5fc25137 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:58.693875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce227fd-071d-472e-a4ed-0aae5fc25137 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:58.694387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce227fd-071d-472e-a4ed-0aae5fc25137 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:58.991414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-546dd5a1-2cbc-4234-9c1f-2797557bceeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:58.992168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-546dd5a1-2cbc-4234-9c1f-2797557bceeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:59.004231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-546dd5a1-2cbc-4234-9c1f-2797557bceeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:59.004764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-546dd5a1-2cbc-4234-9c1f-2797557bceeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:59.007061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-546dd5a1-2cbc-4234-9c1f-2797557bceeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:59.010001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-546dd5a1-2cbc-4234-9c1f-2797557bceeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:59.012066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-546dd5a1-2cbc-4234-9c1f-2797557bceeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:59.012882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-546dd5a1-2cbc-4234-9c1f-2797557bceeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:59.019560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6ce227fd-071d-472e-a4ed-0aae5fc25137 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:59.035893 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6ce227fd-071d-472e-a4ed-0aae5fc25137 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1322 microversion: 2.1 time: 0.365999 Oct 11 19:46:59.036516 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 707/1432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:58 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:59.048790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3389bcf2-7e33-469f-984f-9841c5bac5df tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:59.049807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3389bcf2-7e33-469f-984f-9841c5bac5df tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:59.068186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3389bcf2-7e33-469f-984f-9841c5bac5df tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:59.071921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3389bcf2-7e33-469f-984f-9841c5bac5df tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:59.074870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3389bcf2-7e33-469f-984f-9841c5bac5df tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:59.077059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3389bcf2-7e33-469f-984f-9841c5bac5df tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:59.087931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3389bcf2-7e33-469f-984f-9841c5bac5df tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:59.088893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3389bcf2-7e33-469f-984f-9841c5bac5df tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:59.311616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-546dd5a1-2cbc-4234-9c1f-2797557bceeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:59.320983 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-546dd5a1-2cbc-4234-9c1f-2797557bceeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1346 microversion: 2.1 time: 0.333360 Oct 11 19:46:59.327529 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 726/1433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:58 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1346 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:46:59.338189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:59.345017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:59.355647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:59.363834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:59.364297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:59.365183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:59.365526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:59.365914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:59.643703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:59.657314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:59.658799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:59.677963 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4d73066e-a2f8-4af3-a776-c0d0354c4929 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1537 microversion: 2.91 time: 0.349102 Oct 11 19:46:59.694557 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 727/1434] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:46:59 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1537 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:46:59.694557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-264f6013-1d6c-424b-9f7b-42ab45a6f15e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:59.694878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-264f6013-1d6c-424b-9f7b-42ab45a6f15e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:59.719100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-264f6013-1d6c-424b-9f7b-42ab45a6f15e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:59.719615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-264f6013-1d6c-424b-9f7b-42ab45a6f15e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:59.720056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-264f6013-1d6c-424b-9f7b-42ab45a6f15e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:59.720772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-264f6013-1d6c-424b-9f7b-42ab45a6f15e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:59.725357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-264f6013-1d6c-424b-9f7b-42ab45a6f15e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:59.725867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-264f6013-1d6c-424b-9f7b-42ab45a6f15e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:46:59.948880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3389bcf2-7e33-469f-984f-9841c5bac5df tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:46:59.961035 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3389bcf2-7e33-469f-984f-9841c5bac5df tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1317 microversion: 2.1 time: 0.917381 Oct 11 19:46:59.963750 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 708/1435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:59 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1317 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:46:59.970317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a2effe0-eeff-41b1-8198-2ae13a907f8e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:46:59.984346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5a2effe0-eeff-41b1-8198-2ae13a907f8e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:46:59.996424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a2effe0-eeff-41b1-8198-2ae13a907f8e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:46:59.996934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a2effe0-eeff-41b1-8198-2ae13a907f8e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:46:59.997376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a2effe0-eeff-41b1-8198-2ae13a907f8e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:00.001309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a2effe0-eeff-41b1-8198-2ae13a907f8e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:00.005552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a2effe0-eeff-41b1-8198-2ae13a907f8e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:00.006022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a2effe0-eeff-41b1-8198-2ae13a907f8e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:00.073808 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a2effe0-eeff-41b1-8198-2ae13a907f8e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108667 Oct 11 19:47:00.074406 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 709/1436] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:46:59 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:47:00.089299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c1f252c6-d1ea-4419-a1ea-b26c8d8aaf32 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:00.090168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1f252c6-d1ea-4419-a1ea-b26c8d8aaf32 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:00.108520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1f252c6-d1ea-4419-a1ea-b26c8d8aaf32 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:00.109359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1f252c6-d1ea-4419-a1ea-b26c8d8aaf32 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:00.110028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1f252c6-d1ea-4419-a1ea-b26c8d8aaf32 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:00.111016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1f252c6-d1ea-4419-a1ea-b26c8d8aaf32 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:00.111691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1f252c6-d1ea-4419-a1ea-b26c8d8aaf32 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:00.112323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1f252c6-d1ea-4419-a1ea-b26c8d8aaf32 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:00.128974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-264f6013-1d6c-424b-9f7b-42ab45a6f15e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:00.154175 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-264f6013-1d6c-424b-9f7b-42ab45a6f15e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1648 microversion: 2.1 time: 0.467354 Oct 11 19:47:00.161323 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 728/1437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:46:59 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1648 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:00.185232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e0e0ff1d-def4-4351-a4fe-e7ccc9ef2a4b req-1b2875d8-6c2a-4273-9db2-7a47250dd241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffb0124-9fa9-4a38-ad03-7fece0c780fe", "name": "network-vif-unplugged", "status": "completed", "tag": "7686bb0d-edf8-44e5-bb28-774c272e3719"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:00.245036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e0e0ff1d-def4-4351-a4fe-e7ccc9ef2a4b req-1b2875d8-6c2a-4273-9db2-7a47250dd241 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:00.248199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e0e0ff1d-def4-4351-a4fe-e7ccc9ef2a4b req-1b2875d8-6c2a-4273-9db2-7a47250dd241 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:00.248829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e0e0ff1d-def4-4351-a4fe-e7ccc9ef2a4b req-1b2875d8-6c2a-4273-9db2-7a47250dd241 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:00.311458 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e0e0ff1d-def4-4351-a4fe-e7ccc9ef2a4b req-1b2875d8-6c2a-4273-9db2-7a47250dd241 service nova] Creating event network-vif-unplugged:7686bb0d-edf8-44e5-bb28-774c272e3719 for instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe on n-h2-860864-3 Oct 11 19:47:00.329129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-e0e0ff1d-def4-4351-a4fe-e7ccc9ef2a4b req-1b2875d8-6c2a-4273-9db2-7a47250dd241 service nova] Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:47:00.361720 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e0e0ff1d-def4-4351-a4fe-e7ccc9ef2a4b req-1b2875d8-6c2a-4273-9db2-7a47250dd241 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.196737 Oct 11 19:47:00.365152 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 729/1438] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:00.381196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fa365384-3a35-4ea1-833c-a7b874896ea3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:00.381962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fa365384-3a35-4ea1-833c-a7b874896ea3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:00.401166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa365384-3a35-4ea1-833c-a7b874896ea3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:00.402186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa365384-3a35-4ea1-833c-a7b874896ea3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:00.403752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa365384-3a35-4ea1-833c-a7b874896ea3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:00.404855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa365384-3a35-4ea1-833c-a7b874896ea3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:00.406823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa365384-3a35-4ea1-833c-a7b874896ea3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:00.407861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa365384-3a35-4ea1-833c-a7b874896ea3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:00.670434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c1f252c6-d1ea-4419-a1ea-b26c8d8aaf32 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:00.684148 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c1f252c6-d1ea-4419-a1ea-b26c8d8aaf32 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1541 microversion: 2.1 time: 0.605798 Oct 11 19:47:00.688008 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 710/1439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:00 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1541 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:00.709475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61b40d41-75a0-4875-a235-2d2f4f72d4a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:00.718349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-61b40d41-75a0-4875-a235-2d2f4f72d4a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:00.757519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61b40d41-75a0-4875-a235-2d2f4f72d4a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:00.761942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61b40d41-75a0-4875-a235-2d2f4f72d4a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:00.762668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61b40d41-75a0-4875-a235-2d2f4f72d4a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:00.767057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61b40d41-75a0-4875-a235-2d2f4f72d4a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:00.773225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61b40d41-75a0-4875-a235-2d2f4f72d4a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:00.773926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61b40d41-75a0-4875-a235-2d2f4f72d4a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:00.912470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fa365384-3a35-4ea1-833c-a7b874896ea3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:00.943763 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fa365384-3a35-4ea1-833c-a7b874896ea3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1322 microversion: 2.1 time: 0.568596 Oct 11 19:47:00.969080 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 730/1440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:00 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:00.975586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:00.976209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:00.993094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:00.993447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:00.994156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:00.994834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:00.995300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:00.995725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:01.026639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-61b40d41-75a0-4875-a235-2d2f4f72d4a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:01.042816 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-61b40d41-75a0-4875-a235-2d2f4f72d4a4 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1346 microversion: 2.1 time: 0.348417 Oct 11 19:47:01.043786 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 711/1441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:00 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1346 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:01.054551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-7a45bdde-6948-4cdb-89be-2f091c18ed38 req-2a7d1d12-cd1c-43e8-a2a8-bd698755898b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b0faeed-8955-458c-984f-2cf29c9fbba3", "name": "network-vif-deleted", "tag": "f66e6991-c437-411f-8a95-e3e855f7a692"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:01.090999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7a45bdde-6948-4cdb-89be-2f091c18ed38 req-2a7d1d12-cd1c-43e8-a2a8-bd698755898b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:01.093832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7a45bdde-6948-4cdb-89be-2f091c18ed38 req-2a7d1d12-cd1c-43e8-a2a8-bd698755898b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:01.094305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7a45bdde-6948-4cdb-89be-2f091c18ed38 req-2a7d1d12-cd1c-43e8-a2a8-bd698755898b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:01.174818 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-7a45bdde-6948-4cdb-89be-2f091c18ed38 req-2a7d1d12-cd1c-43e8-a2a8-bd698755898b service nova] Creating event network-vif-deleted:f66e6991-c437-411f-8a95-e3e855f7a692 for instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 on n-h1-860864-3 Oct 11 19:47:01.203468 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-7a45bdde-6948-4cdb-89be-2f091c18ed38 req-2a7d1d12-cd1c-43e8-a2a8-bd698755898b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144165 Oct 11 19:47:01.203468 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 712/1442] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:01.203643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:01.217128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-76c15d07-3027-4d7a-8ee5-899c7a1e91cb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:01.218323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-76c15d07-3027-4d7a-8ee5-899c7a1e91cb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:01.219962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:01.221624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:01.238148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76c15d07-3027-4d7a-8ee5-899c7a1e91cb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:01.239052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76c15d07-3027-4d7a-8ee5-899c7a1e91cb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:01.242463 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e648073-9aa0-4077-a617-2d0d74e43c6a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1537 microversion: 2.91 time: 0.271939 Oct 11 19:47:01.249496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76c15d07-3027-4d7a-8ee5-899c7a1e91cb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:01.250894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76c15d07-3027-4d7a-8ee5-899c7a1e91cb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:01.252944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76c15d07-3027-4d7a-8ee5-899c7a1e91cb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:01.253614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76c15d07-3027-4d7a-8ee5-899c7a1e91cb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:01.258656 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 731/1443] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:00 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:01.273792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:01.275612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:01.284607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:01.285375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:01.285973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:01.286857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:01.287466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:01.288475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:01.343815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:01.356547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:01.360679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:01.361415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:01.362107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lazy-loading 'fault' on Instance uuid 1b0faeed-8955-458c-984f-2cf29c9fbba3 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:01.454675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:01.486212 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-91dd0624-0110-494a-823d-ba2617f2fad6 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 200 len: 1306 microversion: 2.1 time: 0.206782 Oct 11 19:47:01.507047 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 732/1444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:01 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 1306 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:01.554989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-103e05f8-9615-4f92-a2d6-a7d879d29ab0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e7072e7-9e4b-47ec-969d-03d0fa80db44", "device": "/dev/xvdb"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:01.560038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-103e05f8-9615-4f92-a2d6-a7d879d29ab0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:01.578112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-103e05f8-9615-4f92-a2d6-a7d879d29ab0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:01.584964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-103e05f8-9615-4f92-a2d6-a7d879d29ab0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:01.588201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-103e05f8-9615-4f92-a2d6-a7d879d29ab0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:01.589059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-103e05f8-9615-4f92-a2d6-a7d879d29ab0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:01.590122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-103e05f8-9615-4f92-a2d6-a7d879d29ab0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:01.592479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-103e05f8-9615-4f92-a2d6-a7d879d29ab0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:01.639449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-76c15d07-3027-4d7a-8ee5-899c7a1e91cb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:01.648091 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-76c15d07-3027-4d7a-8ee5-899c7a1e91cb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1317 microversion: 2.1 time: 0.456628 Oct 11 19:47:01.648681 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 713/1445] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:01 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:01.718312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c64cb7b3-2842-4290-9b76-aee4c1834c25 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:01.719218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c64cb7b3-2842-4290-9b76-aee4c1834c25 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:01.732358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c64cb7b3-2842-4290-9b76-aee4c1834c25 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:01.734967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c64cb7b3-2842-4290-9b76-aee4c1834c25 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:01.735747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c64cb7b3-2842-4290-9b76-aee4c1834c25 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:01.738414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c64cb7b3-2842-4290-9b76-aee4c1834c25 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:01.740907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c64cb7b3-2842-4290-9b76-aee4c1834c25 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:01.741533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c64cb7b3-2842-4290-9b76-aee4c1834c25 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.031350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:02.042140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c64cb7b3-2842-4290-9b76-aee4c1834c25 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:02.053252 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c64cb7b3-2842-4290-9b76-aee4c1834c25 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1541 microversion: 2.1 time: 0.340464 Oct 11 19:47:02.053867 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 714/1446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:01 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1541 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:02.076999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-09ba693d-841f-4f00-b27c-92a2850661f8 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:02.077616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-09ba693d-841f-4f00-b27c-92a2850661f8 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:02.113471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ba693d-841f-4f00-b27c-92a2850661f8 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.114009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ba693d-841f-4f00-b27c-92a2850661f8 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.114457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ba693d-841f-4f00-b27c-92a2850661f8 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.129458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ba693d-841f-4f00-b27c-92a2850661f8 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.129953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ba693d-841f-4f00-b27c-92a2850661f8 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.130488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ba693d-841f-4f00-b27c-92a2850661f8 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.168833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:02.244912 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-103e05f8-9615-4f92-a2d6-a7d879d29ab0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "POST /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.736400 Oct 11 19:47:02.245836 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 733/1447] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Oct 11 19:47:01 2022] POST /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:47:02.270479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8007a83b-b03b-447e-9380-e46ccc255919 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:02.272957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8007a83b-b03b-447e-9380-e46ccc255919 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:02.288574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8007a83b-b03b-447e-9380-e46ccc255919 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.293548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8007a83b-b03b-447e-9380-e46ccc255919 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.295048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8007a83b-b03b-447e-9380-e46ccc255919 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.297086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8007a83b-b03b-447e-9380-e46ccc255919 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.297792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8007a83b-b03b-447e-9380-e46ccc255919 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.298681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8007a83b-b03b-447e-9380-e46ccc255919 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.396109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8007a83b-b03b-447e-9380-e46ccc255919 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:02.413481 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8007a83b-b03b-447e-9380-e46ccc255919 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1346 microversion: 2.1 time: 0.154784 Oct 11 19:47:02.427384 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 734/1448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:02 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1346 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:02.441011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:02.447486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:02.458553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.459047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.459483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.463059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.464366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.467815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.497549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-09ba693d-841f-4f00-b27c-92a2850661f8 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:02.514324 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-09ba693d-841f-4f00-b27c-92a2850661f8 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1322 microversion: 2.1 time: 0.459421 Oct 11 19:47:02.515435 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 715/1449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:02 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:02.525724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-02baf072-1abb-4276-8067-6bc0c13a106a req-8fbf4674-026d-4177-9e36-4232b45de58a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccfac528-a6be-45a6-914f-53d90ee124a0", "name": "network-vif-plugged", "status": "completed", "tag": "9f016a48-46b6-4f37-bbf6-b267cb70a8ab"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:02.549180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:02.551594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-02baf072-1abb-4276-8067-6bc0c13a106a req-8fbf4674-026d-4177-9e36-4232b45de58a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.553262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-02baf072-1abb-4276-8067-6bc0c13a106a req-8fbf4674-026d-4177-9e36-4232b45de58a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.556144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-02baf072-1abb-4276-8067-6bc0c13a106a req-8fbf4674-026d-4177-9e36-4232b45de58a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.599885 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-02baf072-1abb-4276-8067-6bc0c13a106a req-8fbf4674-026d-4177-9e36-4232b45de58a service nova] Creating event network-vif-plugged:9f016a48-46b6-4f37-bbf6-b267cb70a8ab for instance ccfac528-a6be-45a6-914f-53d90ee124a0 on n-h2-860864-3 Oct 11 19:47:02.619107 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-02baf072-1abb-4276-8067-6bc0c13a106a req-8fbf4674-026d-4177-9e36-4232b45de58a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098511 Oct 11 19:47:02.621114 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 716/1450] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:02.634285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:02.644807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:02.648900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:02.652266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:02.652668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:02.661279 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4580cea1-875e-43fd-8447-6e3877af5fc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1540 microversion: 2.91 time: 0.232238 Oct 11 19:47:02.662463 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 735/1451] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:02 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1540 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:02.664378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.666519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.667417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.668920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.669785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.670466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.674187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d37a36d0-2a13-4851-90b0-f6cc61686787 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:02.674998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d37a36d0-2a13-4851-90b0-f6cc61686787 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:02.682202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d37a36d0-2a13-4851-90b0-f6cc61686787 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.682867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d37a36d0-2a13-4851-90b0-f6cc61686787 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.683455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d37a36d0-2a13-4851-90b0-f6cc61686787 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.684315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d37a36d0-2a13-4851-90b0-f6cc61686787 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.684909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d37a36d0-2a13-4851-90b0-f6cc61686787 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.685504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d37a36d0-2a13-4851-90b0-f6cc61686787 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.707416 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 HTTP/1.1 Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '1b0faeed-8955-458c-984f-2cf29c9fbba3'} Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:02.709112 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:02.719341 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:02.719341 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:02.719341 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:02.719341 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:02.719341 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:02.719341 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:02.719341 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:02.719341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:02.719341 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b6c99462-9638-4e1a-acb2-4a400babc2eb tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 404 len: 111 microversion: 2.1 time: 0.092345 Oct 11 19:47:02.719341 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 717/1452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:02 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:02.732405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-41022796-baf0-4e71-a302-fdbc645210ee tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860864-3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:02.734928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-41022796-baf0-4e71-a302-fdbc645210ee tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:02.745465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41022796-baf0-4e71-a302-fdbc645210ee tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.746016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41022796-baf0-4e71-a302-fdbc645210ee tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.746591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41022796-baf0-4e71-a302-fdbc645210ee tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.747306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41022796-baf0-4e71-a302-fdbc645210ee tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:02.747759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41022796-baf0-4e71-a302-fdbc645210ee tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:02.748184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41022796-baf0-4e71-a302-fdbc645210ee tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:02.818723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-41022796-baf0-4e71-a302-fdbc645210ee tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860864-3". {{(pid=126956) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 19:47:02.937772 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-41022796-baf0-4e71-a302-fdbc645210ee tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0/action" status: 202 len: 0 microversion: 2.91 time: 0.218468 Oct 11 19:47:02.942131 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 718/1453] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:47:02 2022] POST /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:47:02.951104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8a4f44f5-da85-4736-b9fd-b1e8e65b845e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc339e50>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:03.125680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d37a36d0-2a13-4851-90b0-f6cc61686787 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:03.139922 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d37a36d0-2a13-4851-90b0-f6cc61686787 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1317 microversion: 2.1 time: 0.470451 Oct 11 19:47:03.146497 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 736/1454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:02 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:03.159153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:03.159868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:03.174280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:03.176214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:03.176903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:03.177805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:03.179548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:03.181841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:03.322120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:03.337186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:03.345241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:03.354348 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-121a7470-740a-4322-9853-538df5609eef tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1548 microversion: 2.91 time: 0.206650 Oct 11 19:47:03.355457 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 737/1455] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:03 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1548 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:03.372734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9f0daee3-0ebb-4b16-8bde-4445d78839e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:03.373617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9f0daee3-0ebb-4b16-8bde-4445d78839e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:03.392515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f0daee3-0ebb-4b16-8bde-4445d78839e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:03.394591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f0daee3-0ebb-4b16-8bde-4445d78839e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:03.395181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f0daee3-0ebb-4b16-8bde-4445d78839e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:03.396113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f0daee3-0ebb-4b16-8bde-4445d78839e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:03.396748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f0daee3-0ebb-4b16-8bde-4445d78839e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:03.397359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f0daee3-0ebb-4b16-8bde-4445d78839e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:03.516356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:03.962463 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8a4f44f5-da85-4736-b9fd-b1e8e65b845e tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/48883837-b190-4a31-a551-d606ff50cea3" status: 202 len: 0 microversion: 2.1 time: 1.018742 Oct 11 19:47:03.964050 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 719/1456] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:02 2022] DELETE /compute/v2.1/os-security-groups/48883837-b190-4a31-a551-d606ff50cea3 => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:47:03.977413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a5b4c95-9f80-4aa4-b1f1-29703c1ed498 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:03.978359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a5b4c95-9f80-4aa4-b1f1-29703c1ed498 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:03.993552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a5b4c95-9f80-4aa4-b1f1-29703c1ed498 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:03.994353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a5b4c95-9f80-4aa4-b1f1-29703c1ed498 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:03.995006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a5b4c95-9f80-4aa4-b1f1-29703c1ed498 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:04.000026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a5b4c95-9f80-4aa4-b1f1-29703c1ed498 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:04.004059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a5b4c95-9f80-4aa4-b1f1-29703c1ed498 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:04.009486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a5b4c95-9f80-4aa4-b1f1-29703c1ed498 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:04.016966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9f0daee3-0ebb-4b16-8bde-4445d78839e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:04.032103 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9f0daee3-0ebb-4b16-8bde-4445d78839e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1541 microversion: 2.1 time: 0.675314 Oct 11 19:47:04.035183 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 738/1457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:03 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1541 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:04.047450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b629bbbe-523b-4c2f-8649-062999a4d2f9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:04.048351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b629bbbe-523b-4c2f-8649-062999a4d2f9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:04.088570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b629bbbe-523b-4c2f-8649-062999a4d2f9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:04.103704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b629bbbe-523b-4c2f-8649-062999a4d2f9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:04.104553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b629bbbe-523b-4c2f-8649-062999a4d2f9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:04.105778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b629bbbe-523b-4c2f-8649-062999a4d2f9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:04.106470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b629bbbe-523b-4c2f-8649-062999a4d2f9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:04.107157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b629bbbe-523b-4c2f-8649-062999a4d2f9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:04.173045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a5b4c95-9f80-4aa4-b1f1-29703c1ed498 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:04.186099 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a5b4c95-9f80-4aa4-b1f1-29703c1ed498 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1346 microversion: 2.1 time: 0.220207 Oct 11 19:47:04.194942 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 720/1458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:03 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1346 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:04.200714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8c7ec0af-125c-4ba6-9005-a0b6aa565d42 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc2c3ee0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:04.529386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:04.540170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b629bbbe-523b-4c2f-8649-062999a4d2f9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:04.551125 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b629bbbe-523b-4c2f-8649-062999a4d2f9 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1322 microversion: 2.1 time: 0.514638 Oct 11 19:47:04.552562 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 739/1459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:04 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:04.564328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c474d488-22ab-44cd-bc4a-4a16dea5d928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:04.565214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c474d488-22ab-44cd-bc4a-4a16dea5d928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:04.582798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c474d488-22ab-44cd-bc4a-4a16dea5d928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:04.584918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c474d488-22ab-44cd-bc4a-4a16dea5d928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:04.585678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c474d488-22ab-44cd-bc4a-4a16dea5d928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:04.588333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c474d488-22ab-44cd-bc4a-4a16dea5d928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:04.589622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c474d488-22ab-44cd-bc4a-4a16dea5d928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:04.591106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c474d488-22ab-44cd-bc4a-4a16dea5d928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:04.708552 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8c7ec0af-125c-4ba6-9005-a0b6aa565d42 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a4939ec5-1d92-4f68-8324-cec51965b997" status: 202 len: 0 microversion: 2.1 time: 0.512424 Oct 11 19:47:04.709746 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 721/1460] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:04 2022] DELETE /compute/v2.1/os-security-groups/a4939ec5-1d92-4f68-8324-cec51965b997 => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:47:04.717187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:04.718160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:04.731460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:04.733796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:04.735598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:04.738360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:04.739122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:04.739773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:04.959694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:04.973657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:04.975979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:04.991830 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-59468345-a5f8-4ca0-a71c-f1832a54ebc3 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1488 microversion: 2.91 time: 0.278990 Oct 11 19:47:04.993161 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 722/1461] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:04 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1488 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:05.004482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fde8f506-18fd-457c-a7e0-72bf2fbf5dc5 req-8cdba6fc-6705-406d-a741-93bf7d01a598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0ed4c2-43b2-4097-853d-fc6d93d63a1d", "tag": "61a67b5b-ced0-4c9e-9b0e-636a615fdb5a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:05.034321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fde8f506-18fd-457c-a7e0-72bf2fbf5dc5 req-8cdba6fc-6705-406d-a741-93bf7d01a598 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:05.037216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fde8f506-18fd-457c-a7e0-72bf2fbf5dc5 req-8cdba6fc-6705-406d-a741-93bf7d01a598 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:05.039100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fde8f506-18fd-457c-a7e0-72bf2fbf5dc5 req-8cdba6fc-6705-406d-a741-93bf7d01a598 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:05.067506 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fde8f506-18fd-457c-a7e0-72bf2fbf5dc5 req-8cdba6fc-6705-406d-a741-93bf7d01a598 service nova] Creating event network-changed:61a67b5b-ced0-4c9e-9b0e-636a615fdb5a for instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d on n-h1-860864-3 Oct 11 19:47:05.080030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fde8f506-18fd-457c-a7e0-72bf2fbf5dc5 req-8cdba6fc-6705-406d-a741-93bf7d01a598 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079886 Oct 11 19:47:05.081352 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 723/1462] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:05.088714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4f111253-6f5a-4112-b3ba-4640bac38d8b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'create', calling method: .version_select at 0x7f83cc3650d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2053848096", "description": "tempest-description-887396992"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:05.134941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c474d488-22ab-44cd-bc4a-4a16dea5d928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:05.145395 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c474d488-22ab-44cd-bc4a-4a16dea5d928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1317 microversion: 2.1 time: 0.590962 Oct 11 19:47:05.151513 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 740/1463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:04 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:05.158292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f664719-852c-47fd-9d50-3acfe424a6e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:05.159138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f664719-852c-47fd-9d50-3acfe424a6e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:05.208779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f664719-852c-47fd-9d50-3acfe424a6e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:05.209993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f664719-852c-47fd-9d50-3acfe424a6e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:05.216780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f664719-852c-47fd-9d50-3acfe424a6e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:05.223167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f664719-852c-47fd-9d50-3acfe424a6e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:05.223934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f664719-852c-47fd-9d50-3acfe424a6e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:05.225774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f664719-852c-47fd-9d50-3acfe424a6e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:05.972188 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4f111253-6f5a-4112-b3ba-4640bac38d8b tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.889362 Oct 11 19:47:05.972848 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 724/1464] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:47:05 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:05.987258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44bcc368-753b-4c2b-9548-44ebb16b6422 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:05.988181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-44bcc368-753b-4c2b-9548-44ebb16b6422 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:06.017903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44bcc368-753b-4c2b-9548-44ebb16b6422 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.019549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44bcc368-753b-4c2b-9548-44ebb16b6422 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.019549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44bcc368-753b-4c2b-9548-44ebb16b6422 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.019877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44bcc368-753b-4c2b-9548-44ebb16b6422 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.020436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44bcc368-753b-4c2b-9548-44ebb16b6422 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.020973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44bcc368-753b-4c2b-9548-44ebb16b6422 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.123673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2f664719-852c-47fd-9d50-3acfe424a6e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:06.133808 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f664719-852c-47fd-9d50-3acfe424a6e7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1541 microversion: 2.1 time: 0.979425 Oct 11 19:47:06.135126 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 741/1465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:05 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1541 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:06.140890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4058cb9b-e01f-46c2-b505-318e2e9f7985 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:06.142336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4058cb9b-e01f-46c2-b505-318e2e9f7985 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:06.149251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4058cb9b-e01f-46c2-b505-318e2e9f7985 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.150596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4058cb9b-e01f-46c2-b505-318e2e9f7985 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.155399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4058cb9b-e01f-46c2-b505-318e2e9f7985 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.156424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4058cb9b-e01f-46c2-b505-318e2e9f7985 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.157341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4058cb9b-e01f-46c2-b505-318e2e9f7985 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.158168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4058cb9b-e01f-46c2-b505-318e2e9f7985 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.206356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-44bcc368-753b-4c2b-9548-44ebb16b6422 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:06.219922 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-44bcc368-753b-4c2b-9548-44ebb16b6422 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1346 microversion: 2.1 time: 0.237492 Oct 11 19:47:06.231794 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 725/1466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:05 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1346 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:06.244673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4e7902c4-55e8-418c-99b2-8e46467ee415 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Action: 'update', calling method: .version_select at 0x7f83cc31de50>, body: {"security_group": {"name": "tempest-sg-hth-168859636", "description": "tempest-description-hth-901225847"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:06.539617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4058cb9b-e01f-46c2-b505-318e2e9f7985 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:06.549645 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4058cb9b-e01f-46c2-b505-318e2e9f7985 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1472 microversion: 2.1 time: 0.413225 Oct 11 19:47:06.550269 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 742/1467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:06 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:06.557608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:06.558421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:06.571498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.572274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.572897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.573932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.574702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.575545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.655712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:06.666310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:06.669223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:06.689088 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4e7902c4-55e8-418c-99b2-8e46467ee415 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/481abc65-adff-425e-9610-2b58e672fe0d" status: 200 len: 216 microversion: 2.1 time: 0.440828 Oct 11 19:47:06.689212 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0507d669-f47c-44dc-993a-5c4073763f53 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.123154 Oct 11 19:47:06.689328 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 726/1468] 10.222.0.27 () {60 vars in 1290 bytes} [Tue Oct 11 19:47:06 2022] PUT /compute/v2.1/os-security-groups/481abc65-adff-425e-9610-2b58e672fe0d => generated 216 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:06.689428 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 743/1469] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:06 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:06.689527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9b1c53ce-6fba-40a0-a418-4633e5a9043d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:06.689527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9b1c53ce-6fba-40a0-a418-4633e5a9043d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:06.689714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:06.689714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:06.693288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b1c53ce-6fba-40a0-a418-4633e5a9043d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.697333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b1c53ce-6fba-40a0-a418-4633e5a9043d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.702823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b1c53ce-6fba-40a0-a418-4633e5a9043d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.703764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b1c53ce-6fba-40a0-a418-4633e5a9043d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.704403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b1c53ce-6fba-40a0-a418-4633e5a9043d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.704979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b1c53ce-6fba-40a0-a418-4633e5a9043d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.705192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.705713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.706200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.715791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.716313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.716774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.763023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Request method failure captured: Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0/diagnostics HTTP/1.1 Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcgeZ8GscmXkc1EUitpJARJTs-LCbTZGx7JVLvYAk0CXtoUQ8QgX7QTerAVAC2OaCvtMUTT7FUGYtX_hZ1MJX4VxEBS6NnpxAczSdFgb1vG_s35AwsYOjW3aZRhrrFYWYXUXjrGFsonVrVj-4_JmP4o-eSagZs5saQc6hRUwkkIetug Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 486d669d7170472da22189d6d7c6fd7d Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-633852060 Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/486d669d7170472da22189d6d7c6fd7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_486d669d7170472da22189d6d7c6fd7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/486d669d7170472da22189d6d7c6fd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/486d669d7170472da22189d6d7c6fd7d"}]}] Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-633852060 Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 486d669d7170472da22189d6d7c6fd7d Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-633852060 Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerDiagnosticsNegativeTest-633852060-project Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 868c158fc4d8483e90592f757197cad0 Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-633852060-project Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'server_id': 'ccfac528-a6be-45a6-914f-53d90ee124a0'} Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:06.765225 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:06.775502 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:06.775502 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:06.775502 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:47:06.775502 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:47:06.775502 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 19:47:06.775502 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:06.775502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:06.775502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ee81323d-a44e-40ff-94ef-fe571df4edc7 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.090744 Oct 11 19:47:06.775502 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 744/1470] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:06 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0/diagnostics => generated 117 bytes in 92 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:06.775502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b7818eb-2753-473a-a489-b96c798f66ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83d0783ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:06.877648 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2b7818eb-2753-473a-a489-b96c798f66ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/481abc65-adff-425e-9610-2b58e672fe0d" status: 200 len: 216 microversion: 2.1 time: 0.108654 Oct 11 19:47:06.887212 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 745/1471] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:47:06 2022] GET /compute/v2.1/os-security-groups/481abc65-adff-425e-9610-2b58e672fe0d => generated 216 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:06.887212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5307e1b-5853-4423-914e-32b8d03b2e40 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:06.887212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c5307e1b-5853-4423-914e-32b8d03b2e40 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:06.900151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5307e1b-5853-4423-914e-32b8d03b2e40 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.901917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5307e1b-5853-4423-914e-32b8d03b2e40 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.902603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5307e1b-5853-4423-914e-32b8d03b2e40 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.903866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5307e1b-5853-4423-914e-32b8d03b2e40 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:06.904346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5307e1b-5853-4423-914e-32b8d03b2e40 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:06.904942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5307e1b-5853-4423-914e-32b8d03b2e40 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:06.957992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c5307e1b-5853-4423-914e-32b8d03b2e40 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:47:06.962462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9b1c53ce-6fba-40a0-a418-4633e5a9043d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:06.975447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9b1c53ce-6fba-40a0-a418-4633e5a9043d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1317 microversion: 2.1 time: 0.299256 Oct 11 19:47:06.976146 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 727/1472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:06 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:06.984751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8e0afad4-5fa2-415e-9e67-fec0ea90e6d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc365670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:07.119399 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c5307e1b-5853-4423-914e-32b8d03b2e40 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 204 len: 0 microversion: 2.1 time: 0.239344 Oct 11 19:47:07.120581 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 746/1473] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:47:06 2022] DELETE /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:47:07.142041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d52c1eba-eb34-4df6-b342-74dd71c2c775 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:07.145703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d52c1eba-eb34-4df6-b342-74dd71c2c775 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:07.159748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c1eba-eb34-4df6-b342-74dd71c2c775 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.159748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c1eba-eb34-4df6-b342-74dd71c2c775 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.160180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c1eba-eb34-4df6-b342-74dd71c2c775 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.170452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c1eba-eb34-4df6-b342-74dd71c2c775 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.172459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c1eba-eb34-4df6-b342-74dd71c2c775 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.172913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c1eba-eb34-4df6-b342-74dd71c2c775 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.394904 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8e0afad4-5fa2-415e-9e67-fec0ea90e6d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/481abc65-adff-425e-9610-2b58e672fe0d" status: 202 len: 0 microversion: 2.1 time: 0.416577 Oct 11 19:47:07.396422 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 728/1474] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:06 2022] DELETE /compute/v2.1/os-security-groups/481abc65-adff-425e-9610-2b58e672fe0d => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:47:07.403553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d6da094f-bec6-455e-83ea-83f28865a4b3 req-78020bae-7509-4d44-82fc-00e9fed18075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffb0124-9fa9-4a38-ad03-7fece0c780fe", "tag": "7686bb0d-edf8-44e5-bb28-774c272e3719"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:07.419625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d6da094f-bec6-455e-83ea-83f28865a4b3 req-78020bae-7509-4d44-82fc-00e9fed18075 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.421726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d6da094f-bec6-455e-83ea-83f28865a4b3 req-78020bae-7509-4d44-82fc-00e9fed18075 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.422867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d6da094f-bec6-455e-83ea-83f28865a4b3 req-78020bae-7509-4d44-82fc-00e9fed18075 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.432917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d52c1eba-eb34-4df6-b342-74dd71c2c775 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:07.465991 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d52c1eba-eb34-4df6-b342-74dd71c2c775 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1478 microversion: 2.1 time: 0.330275 Oct 11 19:47:07.468755 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 747/1475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:07 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1478 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:07.474571 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d6da094f-bec6-455e-83ea-83f28865a4b3 req-78020bae-7509-4d44-82fc-00e9fed18075 service nova] Creating event network-changed:7686bb0d-edf8-44e5-bb28-774c272e3719 for instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe on n-h2-860864-3 Oct 11 19:47:07.487658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bd4cefde-97d4-47ef-aa90-d6d864a0c792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:07.488513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bd4cefde-97d4-47ef-aa90-d6d864a0c792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:07.497815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-d6da094f-bec6-455e-83ea-83f28865a4b3 req-78020bae-7509-4d44-82fc-00e9fed18075 service nova] Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:47:07.500732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd4cefde-97d4-47ef-aa90-d6d864a0c792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.503221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd4cefde-97d4-47ef-aa90-d6d864a0c792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.507574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd4cefde-97d4-47ef-aa90-d6d864a0c792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.509143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd4cefde-97d4-47ef-aa90-d6d864a0c792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.511967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd4cefde-97d4-47ef-aa90-d6d864a0c792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.515209 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d6da094f-bec6-455e-83ea-83f28865a4b3 req-78020bae-7509-4d44-82fc-00e9fed18075 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116948 Oct 11 19:47:07.516109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd4cefde-97d4-47ef-aa90-d6d864a0c792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.516329 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 729/1476] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:07.521792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b0cdcecf-20d5-4f1b-ad36-9c691ef5324b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:07.522787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b0cdcecf-20d5-4f1b-ad36-9c691ef5324b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:07.532997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0cdcecf-20d5-4f1b-ad36-9c691ef5324b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.533888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0cdcecf-20d5-4f1b-ad36-9c691ef5324b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.534508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0cdcecf-20d5-4f1b-ad36-9c691ef5324b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.536694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0cdcecf-20d5-4f1b-ad36-9c691ef5324b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.537334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0cdcecf-20d5-4f1b-ad36-9c691ef5324b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.537938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0cdcecf-20d5-4f1b-ad36-9c691ef5324b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.655282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b0cdcecf-20d5-4f1b-ad36-9c691ef5324b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:07.669242 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b0cdcecf-20d5-4f1b-ad36-9c691ef5324b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1346 microversion: 2.1 time: 0.151595 Oct 11 19:47:07.683385 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 730/1477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:07 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:07.692175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:07.696870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:07.704795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:07.711655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.712163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.712604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.721647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.722063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.722552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.756713 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 HTTP/1.1 Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '1b0faeed-8955-458c-984f-2cf29c9fbba3'} Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:47:07.761256 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:07.765931 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bcb33630-4c87-4065-8c6a-c218fc77b333 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 404 len: 111 microversion: 2.1 time: 0.076006 Oct 11 19:47:07.767151 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 731/1478] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:47:07 2022] DELETE /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:07.779409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:07.780053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:07.796623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.797214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.797694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.799925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:07.800509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:07.800995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:07.959592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:07.974958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:07.979836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:07.982014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bd4cefde-97d4-47ef-aa90-d6d864a0c792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:07.990938 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bd4cefde-97d4-47ef-aa90-d6d864a0c792 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1473 microversion: 2.1 time: 0.520815 Oct 11 19:47:07.993188 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7c66fd0-6c10-457b-9edc-5d8ce716ab1e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.222315 Oct 11 19:47:07.994061 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 732/1479] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:07 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:08.007873 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 748/1480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:07 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1473 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:08.017999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6644bd0b-a6e6-4f09-94aa-ef042401e92a tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.019062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6644bd0b-a6e6-4f09-94aa-ef042401e92a tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:08.020293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.021570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: 1b0faeed-8955-458c-984f-2cf29c9fbba3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:08.029745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6644bd0b-a6e6-4f09-94aa-ef042401e92a tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.030029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.030730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6644bd0b-a6e6-4f09-94aa-ef042401e92a tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.031521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6644bd0b-a6e6-4f09-94aa-ef042401e92a tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.032531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.032839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6644bd0b-a6e6-4f09-94aa-ef042401e92a tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.032995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.033609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6644bd0b-a6e6-4f09-94aa-ef042401e92a tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.034374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6644bd0b-a6e6-4f09-94aa-ef042401e92a tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.034868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.035526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.036195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.068550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:08.075784 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 HTTP/1.1 Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '1b0faeed-8955-458c-984f-2cf29c9fbba3'} Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.082866 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.088307 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.088307 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.088307 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.088307 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:08.088307 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:08.088307 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. Oct 11 19:47:08.088307 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.092756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Instance 1b0faeed-8955-458c-984f-2cf29c9fbba3 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:08.094975 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ae69edb-49ad-49f5-858c-25ca401550a8 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3" status: 404 len: 111 microversion: 2.1 time: 0.090924 Oct 11 19:47:08.097372 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 733/1481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:08 2022] GET /compute/v2.1/servers/1b0faeed-8955-458c-984f-2cf29c9fbba3 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:08.113336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9dbe809-1014-4aa1-9a66-5688738e8079 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc3fe310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.214845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-d9dbe809-1014-4aa1-9a66-5688738e8079 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a4939ec5-1d92-4f68-8324-cec51965b997 does not exist", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:47:08.215764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.security_group_api [None req-d9dbe809-1014-4aa1-9a66-5688738e8079 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Neutron security group a4939ec5-1d92-4f68-8324-cec51965b997 not found {{(pid=126956) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:47:08.217954 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-d9dbe809-1014-4aa1-9a66-5688738e8079 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security group a4939ec5-1d92-4f68-8324-cec51965b997 does not exist Oct 11 19:47:08.217954 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-31aef9f9-5eee-4919-8618-f4b63de69e86'] Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9dbe809-1014-4aa1-9a66-5688738e8079 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-security-groups/a4939ec5-1d92-4f68-8324-cec51965b997 HTTP/1.1 Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: exception: Security group a4939ec5-1d92-4f68-8324-cec51965b997 does not exist Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-31aef9f9-5eee-4919-8618-f4b63de69e86'] Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a4939ec5-1d92-4f68-8324-cec51965b997'} Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:47:08.220714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a4939ec5-1d92-4f68-8324-cec51965b997 does not exist Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31aef9f9-5eee-4919-8618-f4b63de69e86'] Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a4939ec5-1d92-4f68-8324-cec51965b997 does not exist Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31aef9f9-5eee-4919-8618-f4b63de69e86'] Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a4939ec5-1d92-4f68-8324-cec51965b997 does not exist Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31aef9f9-5eee-4919-8618-f4b63de69e86'] Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a4939ec5-1d92-4f68-8324-cec51965b997 does not exist Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31aef9f9-5eee-4919-8618-f4b63de69e86'] Oct 11 19:47:08.225412 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.231971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9dbe809-1014-4aa1-9a66-5688738e8079 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Security group a4939ec5-1d92-4f68-8324-cec51965b997 does not exist Oct 11 19:47:08.231971 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-31aef9f9-5eee-4919-8618-f4b63de69e86'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:08.233655 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9dbe809-1014-4aa1-9a66-5688738e8079 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a4939ec5-1d92-4f68-8324-cec51965b997" status: 404 len: 194 microversion: 2.1 time: 0.130386 Oct 11 19:47:08.234238 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 734/1482] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:08 2022] DELETE /compute/v2.1/os-security-groups/a4939ec5-1d92-4f68-8324-cec51965b997 => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:08.242770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d3db2df-8a63-4099-b152-a46d5b2b3bfd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc44e820>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.308323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-8d3db2df-8a63-4099-b152-a46d5b2b3bfd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 48883837-b190-4a31-a551-d606ff50cea3 does not exist", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:47:08.308974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.security_group_api [None req-8d3db2df-8a63-4099-b152-a46d5b2b3bfd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Neutron security group 48883837-b190-4a31-a551-d606ff50cea3 not found {{(pid=126956) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:47:08.309979 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-8d3db2df-8a63-4099-b152-a46d5b2b3bfd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security group 48883837-b190-4a31-a551-d606ff50cea3 does not exist Oct 11 19:47:08.309979 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-d20eb572-6ad9-4a52-99c4-046e115e6c8c'] Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d3db2df-8a63-4099-b152-a46d5b2b3bfd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-security-groups/48883837-b190-4a31-a551-d606ff50cea3 HTTP/1.1 Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: exception: Security group 48883837-b190-4a31-a551-d606ff50cea3 does not exist Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-d20eb572-6ad9-4a52-99c4-046e115e6c8c'] Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '48883837-b190-4a31-a551-d606ff50cea3'} Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:47:08.312792 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 48883837-b190-4a31-a551-d606ff50cea3 does not exist Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d20eb572-6ad9-4a52-99c4-046e115e6c8c'] Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 48883837-b190-4a31-a551-d606ff50cea3 does not exist Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d20eb572-6ad9-4a52-99c4-046e115e6c8c'] Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 48883837-b190-4a31-a551-d606ff50cea3 does not exist Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d20eb572-6ad9-4a52-99c4-046e115e6c8c'] Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 48883837-b190-4a31-a551-d606ff50cea3 does not exist Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d20eb572-6ad9-4a52-99c4-046e115e6c8c'] Oct 11 19:47:08.317667 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.323052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d3db2df-8a63-4099-b152-a46d5b2b3bfd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Security group 48883837-b190-4a31-a551-d606ff50cea3 does not exist Oct 11 19:47:08.323052 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-d20eb572-6ad9-4a52-99c4-046e115e6c8c'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:08.328735 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8d3db2df-8a63-4099-b152-a46d5b2b3bfd tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/48883837-b190-4a31-a551-d606ff50cea3" status: 404 len: 194 microversion: 2.1 time: 0.089916 Oct 11 19:47:08.335597 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 735/1483] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:08 2022] DELETE /compute/v2.1/os-security-groups/48883837-b190-4a31-a551-d606ff50cea3 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:47:08.344523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1b6f2e90-6482-4ba4-b6e1-efd3c84b884f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc3fe4c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.377220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-1b6f2e90-6482-4ba4-b6e1-efd3c84b884f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:47:08.377820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.security_group_api [None req-1b6f2e90-6482-4ba4-b6e1-efd3c84b884f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Neutron security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc not found {{(pid=126956) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:47:08.378711 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1b6f2e90-6482-4ba4-b6e1-efd3c84b884f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:47:08.378711 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-30845db8-0ccb-47c9-86e8-304add90adb9'] Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1b6f2e90-6482-4ba4-b6e1-efd3c84b884f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-security-groups/0f1550bb-b138-4b57-8c1b-2ed34f64fddc HTTP/1.1 Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: exception: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-30845db8-0ccb-47c9-86e8-304add90adb9'] Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '0f1550bb-b138-4b57-8c1b-2ed34f64fddc'} Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:47:08.385228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30845db8-0ccb-47c9-86e8-304add90adb9'] Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30845db8-0ccb-47c9-86e8-304add90adb9'] Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30845db8-0ccb-47c9-86e8-304add90adb9'] Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30845db8-0ccb-47c9-86e8-304add90adb9'] Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1b6f2e90-6482-4ba4-b6e1-efd3c84b884f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Security group 0f1550bb-b138-4b57-8c1b-2ed34f64fddc does not exist Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-30845db8-0ccb-47c9-86e8-304add90adb9'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1b6f2e90-6482-4ba4-b6e1-efd3c84b884f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0f1550bb-b138-4b57-8c1b-2ed34f64fddc" status: 404 len: 194 microversion: 2.1 time: 0.048914 Oct 11 19:47:08.389169 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 736/1484] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:08 2022] DELETE /compute/v2.1/os-security-groups/0f1550bb-b138-4b57-8c1b-2ed34f64fddc => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:08.397126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-19d5e69e-4925-43f2-8f06-814bb89c94ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc44e1f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.409930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6644bd0b-a6e6-4f09-94aa-ef042401e92a tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:08.424906 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6644bd0b-a6e6-4f09-94aa-ef042401e92a tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1317 microversion: 2.1 time: 0.415284 Oct 11 19:47:08.428087 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 749/1485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:08 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:08.463926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-19d5e69e-4925-43f2-8f06-814bb89c94ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:47:08.465391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.security_group_api [None req-19d5e69e-4925-43f2-8f06-814bb89c94ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Neutron security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 not found {{(pid=126956) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:47:08.466077 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-19d5e69e-4925-43f2-8f06-814bb89c94ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:47:08.466077 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-a48e790c-68a2-40d6-b3c5-6f200c8d46bb'] Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-19d5e69e-4925-43f2-8f06-814bb89c94ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-security-groups/6b15a68e-93a5-44fb-bd9e-3ef90105b642 HTTP/1.1 Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: exception: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-a48e790c-68a2-40d6-b3c5-6f200c8d46bb'] Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '6b15a68e-93a5-44fb-bd9e-3ef90105b642'} Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:47:08.469991 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a48e790c-68a2-40d6-b3c5-6f200c8d46bb'] Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a48e790c-68a2-40d6-b3c5-6f200c8d46bb'] Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a48e790c-68a2-40d6-b3c5-6f200c8d46bb'] Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a48e790c-68a2-40d6-b3c5-6f200c8d46bb'] Oct 11 19:47:08.475864 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.482744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-19d5e69e-4925-43f2-8f06-814bb89c94ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Security group 6b15a68e-93a5-44fb-bd9e-3ef90105b642 does not exist Oct 11 19:47:08.482744 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-a48e790c-68a2-40d6-b3c5-6f200c8d46bb'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:08.482744 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-19d5e69e-4925-43f2-8f06-814bb89c94ef tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6b15a68e-93a5-44fb-bd9e-3ef90105b642" status: 404 len: 194 microversion: 2.1 time: 0.090544 Oct 11 19:47:08.483377 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 737/1486] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:08 2022] DELETE /compute/v2.1/os-security-groups/6b15a68e-93a5-44fb-bd9e-3ef90105b642 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:08.494601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e44605c-a898-45b7-a3db-3d918056339d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83d076b790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.513637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-922a7f2c-1017-4e06-8e42-a253e30c61f3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.514818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-922a7f2c-1017-4e06-8e42-a253e30c61f3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:08.524258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-922a7f2c-1017-4e06-8e42-a253e30c61f3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.525206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-922a7f2c-1017-4e06-8e42-a253e30c61f3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.525962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-922a7f2c-1017-4e06-8e42-a253e30c61f3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.527260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-922a7f2c-1017-4e06-8e42-a253e30c61f3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.527906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-922a7f2c-1017-4e06-8e42-a253e30c61f3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.528487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-922a7f2c-1017-4e06-8e42-a253e30c61f3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.536975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-7e44605c-a898-45b7-a3db-3d918056339d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:47:08.539175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.security_group_api [None req-7e44605c-a898-45b7-a3db-3d918056339d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Neutron security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 not found {{(pid=126955) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:47:08.541237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7e44605c-a898-45b7-a3db-3d918056339d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:47:08.541237 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-4e4bb2d5-64bb-4ba5-92ab-ca470fccf63e'] Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e44605c-a898-45b7-a3db-3d918056339d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-security-groups/0d69ef99-332f-43c2-bcc2-dd763e037ff0 HTTP/1.1 Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: exception: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-4e4bb2d5-64bb-4ba5-92ab-ca470fccf63e'] Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '0d69ef99-332f-43c2-bcc2-dd763e037ff0'} Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:47:08.544304 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e4bb2d5-64bb-4ba5-92ab-ca470fccf63e'] Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e4bb2d5-64bb-4ba5-92ab-ca470fccf63e'] Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e4bb2d5-64bb-4ba5-92ab-ca470fccf63e'] Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e4bb2d5-64bb-4ba5-92ab-ca470fccf63e'] Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e44605c-a898-45b7-a3db-3d918056339d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Security group 0d69ef99-332f-43c2-bcc2-dd763e037ff0 does not exist Oct 11 19:47:08.548871 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-4e4bb2d5-64bb-4ba5-92ab-ca470fccf63e'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:08.552373 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e44605c-a898-45b7-a3db-3d918056339d tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0d69ef99-332f-43c2-bcc2-dd763e037ff0" status: 404 len: 194 microversion: 2.1 time: 0.064705 Oct 11 19:47:08.556885 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 750/1487] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:08 2022] DELETE /compute/v2.1/os-security-groups/0d69ef99-332f-43c2-bcc2-dd763e037ff0 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:08.573036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b618eab-1188-4ff9-91ac-2f71640fb499 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83d0789670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.636195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-3b618eab-1188-4ff9-91ac-2f71640fb499 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:47:08.636811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.security_group_api [None req-3b618eab-1188-4ff9-91ac-2f71640fb499 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Neutron security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a not found {{(pid=126955) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:47:08.637329 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-3b618eab-1188-4ff9-91ac-2f71640fb499 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:47:08.637329 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-132bfdab-3c9b-4553-8de4-cd3c694fdd08'] Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b618eab-1188-4ff9-91ac-2f71640fb499 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-security-groups/850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a HTTP/1.1 Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: exception: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-132bfdab-3c9b-4553-8de4-cd3c694fdd08'] Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a'} Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:47:08.642970 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-132bfdab-3c9b-4553-8de4-cd3c694fdd08'] Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-132bfdab-3c9b-4553-8de4-cd3c694fdd08'] Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-132bfdab-3c9b-4553-8de4-cd3c694fdd08'] Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-132bfdab-3c9b-4553-8de4-cd3c694fdd08'] Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b618eab-1188-4ff9-91ac-2f71640fb499 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Security group 850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a does not exist Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-132bfdab-3c9b-4553-8de4-cd3c694fdd08'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b618eab-1188-4ff9-91ac-2f71640fb499 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a" status: 404 len: 194 microversion: 2.1 time: 0.081507 Oct 11 19:47:08.647603 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 751/1488] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:08 2022] DELETE /compute/v2.1/os-security-groups/850e1fe5-7c9e-40a6-ae1a-c78ff7b3226a => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:08.662982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8963758c-6bef-4603-b2d1-7b142e94fe00 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.663550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8963758c-6bef-4603-b2d1-7b142e94fe00 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:08.678173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8963758c-6bef-4603-b2d1-7b142e94fe00 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.678741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8963758c-6bef-4603-b2d1-7b142e94fe00 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.679193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8963758c-6bef-4603-b2d1-7b142e94fe00 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.680526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8963758c-6bef-4603-b2d1-7b142e94fe00 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.681413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8963758c-6bef-4603-b2d1-7b142e94fe00 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.682053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8963758c-6bef-4603-b2d1-7b142e94fe00 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.716488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8963758c-6bef-4603-b2d1-7b142e94fe00 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:47:08.763282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-922a7f2c-1017-4e06-8e42-a253e30c61f3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:08.772633 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-922a7f2c-1017-4e06-8e42-a253e30c61f3 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1478 microversion: 2.1 time: 0.273559 Oct 11 19:47:08.773630 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 738/1489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:08 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1478 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:08.784863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.795299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:08.802516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.803066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.803518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.804240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.804697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.806293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.837730 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8963758c-6bef-4603-b2d1-7b142e94fe00 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 204 len: 0 microversion: 2.1 time: 0.186538 Oct 11 19:47:08.838775 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 752/1490] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:47:08 2022] DELETE /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:47:08.852377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.852865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a28482ee-711d-45b3-a1a7-6b6138e612d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:08.853680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.854021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a28482ee-711d-45b3-a1a7-6b6138e612d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:08.855554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.857056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lazy-loading 'fault' on Instance uuid 5fb63556-0909-48c6-b68a-edce831b629c {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:08.879120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a28482ee-711d-45b3-a1a7-6b6138e612d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.881756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a28482ee-711d-45b3-a1a7-6b6138e612d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.885301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a28482ee-711d-45b3-a1a7-6b6138e612d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:08.886386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a28482ee-711d-45b3-a1a7-6b6138e612d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:08.886965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a28482ee-711d-45b3-a1a7-6b6138e612d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:08.887471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a28482ee-711d-45b3-a1a7-6b6138e612d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:09.014120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:09.031906 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6505df9-78aa-47fc-9cf5-b5feed30c7fd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1351 microversion: 2.1 time: 0.254212 Oct 11 19:47:09.034292 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 739/1491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:08 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1351 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:09.040410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ef147e1f-d31c-4711-8e40-29c88db65452 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:09.041523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef147e1f-d31c-4711-8e40-29c88db65452 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:09.054938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef147e1f-d31c-4711-8e40-29c88db65452 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:09.055796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef147e1f-d31c-4711-8e40-29c88db65452 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:09.056566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef147e1f-d31c-4711-8e40-29c88db65452 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:09.057726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef147e1f-d31c-4711-8e40-29c88db65452 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:09.058750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef147e1f-d31c-4711-8e40-29c88db65452 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:09.059357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef147e1f-d31c-4711-8e40-29c88db65452 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:09.277149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a28482ee-711d-45b3-a1a7-6b6138e612d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:09.297510 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a28482ee-711d-45b3-a1a7-6b6138e612d4 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1648 microversion: 2.1 time: 0.451574 Oct 11 19:47:09.312667 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 753/1492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:08 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1648 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:09.329142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:09.330711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:09.332034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ef147e1f-d31c-4711-8e40-29c88db65452 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:09.342928 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ef147e1f-d31c-4711-8e40-29c88db65452 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1473 microversion: 2.1 time: 0.307169 Oct 11 19:47:09.344460 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 740/1493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:09 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1473 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:09.346122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:09.346649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:09.352339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:09.353322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:09.353800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:09.354229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:09.443141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:09.453321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13a18da3-a4a6-451c-a477-8112b4876c7b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:09.454133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-13a18da3-a4a6-451c-a477-8112b4876c7b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:09.460435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:09.461842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a18da3-a4a6-451c-a477-8112b4876c7b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:09.462693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a18da3-a4a6-451c-a477-8112b4876c7b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:09.463075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:09.463239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a18da3-a4a6-451c-a477-8112b4876c7b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:09.463846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a18da3-a4a6-451c-a477-8112b4876c7b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:09.464301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a18da3-a4a6-451c-a477-8112b4876c7b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:09.464725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13a18da3-a4a6-451c-a477-8112b4876c7b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:09.470268 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b7f31106-b7b7-4472-8cd7-7773632e133a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.155826 Oct 11 19:47:09.473691 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 754/1494] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:09 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:09.718492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13a18da3-a4a6-451c-a477-8112b4876c7b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:09.729061 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13a18da3-a4a6-451c-a477-8112b4876c7b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1317 microversion: 2.1 time: 0.280791 Oct 11 19:47:09.730505 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 741/1495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:09 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:09.799201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71624c49-ce2a-40e4-9386-663641ff67b2 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:09.799906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-71624c49-ce2a-40e4-9386-663641ff67b2 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:09.810353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71624c49-ce2a-40e4-9386-663641ff67b2 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:09.811233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71624c49-ce2a-40e4-9386-663641ff67b2 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:09.811876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71624c49-ce2a-40e4-9386-663641ff67b2 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:09.812921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71624c49-ce2a-40e4-9386-663641ff67b2 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:09.813618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71624c49-ce2a-40e4-9386-663641ff67b2 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:09.814048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71624c49-ce2a-40e4-9386-663641ff67b2 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:09.891151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-50908944-e84c-49cb-8e6e-136ee2bfd3b3 req-2434929d-7fee-4a0b-b485-21f2f05d88c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0ed4c2-43b2-4097-853d-fc6d93d63a1d", "name": "network-vif-plugged", "status": "completed", "tag": "61a67b5b-ced0-4c9e-9b0e-636a615fdb5a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:09.904962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-50908944-e84c-49cb-8e6e-136ee2bfd3b3 req-2434929d-7fee-4a0b-b485-21f2f05d88c3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:09.905551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-50908944-e84c-49cb-8e6e-136ee2bfd3b3 req-2434929d-7fee-4a0b-b485-21f2f05d88c3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:09.906121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-50908944-e84c-49cb-8e6e-136ee2bfd3b3 req-2434929d-7fee-4a0b-b485-21f2f05d88c3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:09.926326 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-50908944-e84c-49cb-8e6e-136ee2bfd3b3 req-2434929d-7fee-4a0b-b485-21f2f05d88c3 service nova] Creating event network-vif-plugged:61a67b5b-ced0-4c9e-9b0e-636a615fdb5a for instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d on n-h1-860864-3 Oct 11 19:47:09.941843 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-50908944-e84c-49cb-8e6e-136ee2bfd3b3 req-2434929d-7fee-4a0b-b485-21f2f05d88c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055562 Oct 11 19:47:09.942798 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 742/1496] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:09.991231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-71624c49-ce2a-40e4-9386-663641ff67b2 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:10.002401 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-71624c49-ce2a-40e4-9386-663641ff67b2 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1478 microversion: 2.1 time: 0.206915 Oct 11 19:47:10.003871 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 755/1497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:09 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1478 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:10.061439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:10.063271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:10.073130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:10.074179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:10.075070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:10.075925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:10.076545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:10.077070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:10.216970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:10.220083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:10.224242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:10.231978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lazy-loading 'fault' on Instance uuid 5fb63556-0909-48c6-b68a-edce831b629c {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:10.239426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:10.326473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-29dacc40-569c-4116-8802-af9e1d5062ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:10.328013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-29dacc40-569c-4116-8802-af9e1d5062ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:10.335591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29dacc40-569c-4116-8802-af9e1d5062ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:10.337148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29dacc40-569c-4116-8802-af9e1d5062ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:10.337830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29dacc40-569c-4116-8802-af9e1d5062ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:10.338799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29dacc40-569c-4116-8802-af9e1d5062ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:10.339499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29dacc40-569c-4116-8802-af9e1d5062ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:10.340152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29dacc40-569c-4116-8802-af9e1d5062ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:10.358886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:10.378215 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-838524aa-dd47-49f2-b247-fe9336e8d30e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1351 microversion: 2.1 time: 0.320123 Oct 11 19:47:10.380845 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 743/1498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:10 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1351 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:10.387167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-180f1817-acb1-45af-adb8-fbc714f87c3d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:10.388036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-180f1817-acb1-45af-adb8-fbc714f87c3d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:10.394509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-180f1817-acb1-45af-adb8-fbc714f87c3d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:10.395308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-180f1817-acb1-45af-adb8-fbc714f87c3d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:10.395962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-180f1817-acb1-45af-adb8-fbc714f87c3d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:10.396874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-180f1817-acb1-45af-adb8-fbc714f87c3d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:10.397527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-180f1817-acb1-45af-adb8-fbc714f87c3d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:10.398149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-180f1817-acb1-45af-adb8-fbc714f87c3d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:10.885533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-180f1817-acb1-45af-adb8-fbc714f87c3d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:10.903917 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-180f1817-acb1-45af-adb8-fbc714f87c3d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1470 microversion: 2.1 time: 0.519246 Oct 11 19:47:10.904845 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 744/1499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:10 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1470 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:10.912227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:10.912839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:10.931005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:10.931527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:10.932033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:10.932769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:10.933277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:10.933708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:10.986077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-29dacc40-569c-4116-8802-af9e1d5062ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:10.997609 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-29dacc40-569c-4116-8802-af9e1d5062ae tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1648 microversion: 2.1 time: 0.675625 Oct 11 19:47:11.005779 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 756/1500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:10 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1648 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:11.013878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1166c9e6-8179-4f5b-ba32-957c051506ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:11.015685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1166c9e6-8179-4f5b-ba32-957c051506ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:11.036137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1166c9e6-8179-4f5b-ba32-957c051506ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:11.040752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1166c9e6-8179-4f5b-ba32-957c051506ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:11.041859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1166c9e6-8179-4f5b-ba32-957c051506ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:11.044827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1166c9e6-8179-4f5b-ba32-957c051506ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:11.046556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1166c9e6-8179-4f5b-ba32-957c051506ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:11.046556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1166c9e6-8179-4f5b-ba32-957c051506ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:11.124450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:11.150050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:11.151547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:11.160463 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-93ea9c5c-a716-463e-966c-c0750f74adc7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.252966 Oct 11 19:47:11.161278 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 745/1501] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:10 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:11.178140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:11.179081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:11.202572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:11.203404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:11.204334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:11.233070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:11.239794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:11.241119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:11.373985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:11.374811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:11.375263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:11.375995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:11.376663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:11.377070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:11.519702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for project 33b91a834ad24c82805880555930825d. Resources: {'cores', 'ram'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:47:11.546458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for user 5c26541efd824c5ab866c2891adcd748 and project 33b91a834ad24c82805880555930825d. Resources: {'cores', 'ram'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:47:11.874880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1166c9e6-8179-4f5b-ba32-957c051506ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:11.896841 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1166c9e6-8179-4f5b-ba32-957c051506ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1317 microversion: 2.1 time: 0.888688 Oct 11 19:47:11.910631 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 757/1502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:11 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1317 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:11.911209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71b6dd94-cbb6-474f-83c0-09ac1e60999f tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:11.911840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-71b6dd94-cbb6-474f-83c0-09ac1e60999f tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:11.936082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71b6dd94-cbb6-474f-83c0-09ac1e60999f tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:11.939062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71b6dd94-cbb6-474f-83c0-09ac1e60999f tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:11.939526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71b6dd94-cbb6-474f-83c0-09ac1e60999f tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:11.940265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71b6dd94-cbb6-474f-83c0-09ac1e60999f tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:11.943823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71b6dd94-cbb6-474f-83c0-09ac1e60999f tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:11.944288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71b6dd94-cbb6-474f-83c0-09ac1e60999f tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:11.960212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ef68851e-d2f4-45fd-bce2-8b76c00633e5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe/action" status: 202 len: 0 microversion: 2.1 time: 0.797456 Oct 11 19:47:11.963128 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 746/1503] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:47:11 2022] POST /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:47:11.972757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:11.978983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:11.995543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:11.996540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:11.997235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:11.998289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:12.003585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:12.004437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:12.119137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:12.119654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:12.120106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:12.120570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lazy-loading 'fault' on Instance uuid 5fb63556-0909-48c6-b68a-edce831b629c {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:12.650620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:12.677223 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-914e411d-efc9-4440-91d9-fe4f79ec3f71 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 200 len: 1351 microversion: 2.1 time: 0.709519 Oct 11 19:47:12.687117 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 747/1504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:11 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 1351 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:12.709350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40e72ec5-0669-42c2-a2dc-0b978c06fcd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:12.715351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-40e72ec5-0669-42c2-a2dc-0b978c06fcd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:12.747913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e72ec5-0669-42c2-a2dc-0b978c06fcd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:12.751440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e72ec5-0669-42c2-a2dc-0b978c06fcd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:12.751924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e72ec5-0669-42c2-a2dc-0b978c06fcd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:12.758634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e72ec5-0669-42c2-a2dc-0b978c06fcd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:12.764307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e72ec5-0669-42c2-a2dc-0b978c06fcd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:12.766803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e72ec5-0669-42c2-a2dc-0b978c06fcd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.031831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-71b6dd94-cbb6-474f-83c0-09ac1e60999f tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:13.047681 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-71b6dd94-cbb6-474f-83c0-09ac1e60999f tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1478 microversion: 2.1 time: 1.146219 Oct 11 19:47:13.051419 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 758/1505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:11 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1478 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:13.075407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:13.081567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:13.110610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.111427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.111958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.117086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.118091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.118484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.252695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.253348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.253656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.254245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lazy-loading 'fault' on Instance uuid dfe1637f-a670-4f41-8ab8-a80c168abe0e {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:13.405251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e657b74c26d247cd896aa508c7aac5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60fc5cb0874d38897f0ed8d5580106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:13.418504 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3e1cbd7d-acdc-4730-82a8-6e4bc7e395f7 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 200 len: 1306 microversion: 2.1 time: 0.365703 Oct 11 19:47:13.419699 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 759/1506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:13 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 1306 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:13.432862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e123eee3-bd2f-4f80-9edc-2ec43dd04879 req-63f78aec-5b7a-44bf-9f08-833a4c47d690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffb0124-9fa9-4a38-ad03-7fece0c780fe", "name": "network-vif-plugged", "status": "completed", "tag": "7686bb0d-edf8-44e5-bb28-774c272e3719"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:13.460584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e123eee3-bd2f-4f80-9edc-2ec43dd04879 req-63f78aec-5b7a-44bf-9f08-833a4c47d690 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.461659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e123eee3-bd2f-4f80-9edc-2ec43dd04879 req-63f78aec-5b7a-44bf-9f08-833a4c47d690 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.462272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e123eee3-bd2f-4f80-9edc-2ec43dd04879 req-63f78aec-5b7a-44bf-9f08-833a4c47d690 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.519040 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e123eee3-bd2f-4f80-9edc-2ec43dd04879 req-63f78aec-5b7a-44bf-9f08-833a4c47d690 service nova] Creating event network-vif-plugged:7686bb0d-edf8-44e5-bb28-774c272e3719 for instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe on n-h2-860864-3 Oct 11 19:47:13.555096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-e123eee3-bd2f-4f80-9edc-2ec43dd04879 req-63f78aec-5b7a-44bf-9f08-833a4c47d690 service nova] Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:47:13.555418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-40e72ec5-0669-42c2-a2dc-0b978c06fcd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:13.568480 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40e72ec5-0669-42c2-a2dc-0b978c06fcd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1469 microversion: 2.1 time: 0.875463 Oct 11 19:47:13.584113 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 748/1507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:12 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1469 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:13.599621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:13.600522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:13.613158 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e123eee3-bd2f-4f80-9edc-2ec43dd04879 req-63f78aec-5b7a-44bf-9f08-833a4c47d690 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191083 Oct 11 19:47:13.618796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.620758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.622470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.622644 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 760/1508] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:13.629317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.630094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.631131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.636985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f5bb1d38-5775-450b-b7f7-88d8e4608563 req-70b86fdb-dfc7-46b2-9946-59d9be6b2bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe1637f-a670-4f41-8ab8-a80c168abe0e", "name": "network-vif-deleted", "tag": "a0d00e7b-e522-4d4c-9ce3-652c535e3486"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:13.669572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f5bb1d38-5775-450b-b7f7-88d8e4608563 req-70b86fdb-dfc7-46b2-9946-59d9be6b2bfb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.671386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f5bb1d38-5775-450b-b7f7-88d8e4608563 req-70b86fdb-dfc7-46b2-9946-59d9be6b2bfb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.673509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f5bb1d38-5775-450b-b7f7-88d8e4608563 req-70b86fdb-dfc7-46b2-9946-59d9be6b2bfb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.734862 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f5bb1d38-5775-450b-b7f7-88d8e4608563 req-70b86fdb-dfc7-46b2-9946-59d9be6b2bfb service nova] Creating event network-vif-deleted:a0d00e7b-e522-4d4c-9ce3-652c535e3486 for instance dfe1637f-a670-4f41-8ab8-a80c168abe0e on n-h2-860864-3 Oct 11 19:47:13.751885 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f5bb1d38-5775-450b-b7f7-88d8e4608563 req-70b86fdb-dfc7-46b2-9946-59d9be6b2bfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126850 Oct 11 19:47:13.766629 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 761/1509] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:13.786007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-96523c50-ab87-4ae0-84c8-131fd7170b9d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:13.789026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-96523c50-ab87-4ae0-84c8-131fd7170b9d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:13.801407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:13.803702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96523c50-ab87-4ae0-84c8-131fd7170b9d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.805457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96523c50-ab87-4ae0-84c8-131fd7170b9d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.806380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96523c50-ab87-4ae0-84c8-131fd7170b9d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.808149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96523c50-ab87-4ae0-84c8-131fd7170b9d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.809186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96523c50-ab87-4ae0-84c8-131fd7170b9d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.809920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96523c50-ab87-4ae0-84c8-131fd7170b9d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.818386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:13.819965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:13.834101 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-28d4635b-8543-457e-b04f-5e37cb536b5b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.248807 Oct 11 19:47:13.836740 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 749/1510] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:13 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:13.844378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:13.847188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:13.860518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.862212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.864092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.864970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:13.865444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:13.865883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:13.904237 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c HTTP/1.1 Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5fb63556-0909-48c6-b68a-edce831b629c'} Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:13.906187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:13.911070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:13.911070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:13.911070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:13.911070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:13.911070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:13.911070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:47:13.911070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:13.916071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:13.919037 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-014e5255-a46d-46b7-9d96-19d001ac5c36 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 404 len: 111 microversion: 2.1 time: 0.081049 Oct 11 19:47:13.921765 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 750/1511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:13 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:14.077089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5756a76f-65d7-4745-8a77-b0cf09ee620c tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:14.077950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5756a76f-65d7-4745-8a77-b0cf09ee620c tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:14.096444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5756a76f-65d7-4745-8a77-b0cf09ee620c tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:14.097494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5756a76f-65d7-4745-8a77-b0cf09ee620c tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:14.100941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5756a76f-65d7-4745-8a77-b0cf09ee620c tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:14.101989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5756a76f-65d7-4745-8a77-b0cf09ee620c tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:14.102469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5756a76f-65d7-4745-8a77-b0cf09ee620c tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:14.102934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5756a76f-65d7-4745-8a77-b0cf09ee620c tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:14.755482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5756a76f-65d7-4745-8a77-b0cf09ee620c tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:14.767221 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5756a76f-65d7-4745-8a77-b0cf09ee620c tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1478 microversion: 2.1 time: 0.694162 Oct 11 19:47:14.770067 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 751/1512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:14 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1478 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:14.779306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:14.783389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:14.808495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:14.811456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:14.812233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:14.814612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:14.816676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:14.817574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:14.850980 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c/os-volume_attachments HTTP/1.1 Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': '5fb63556-0909-48c6-b68a-edce831b629c'} Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:47:14.862224 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:14.867776 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c7bfa477-ad25-43f7-8043-4b46bd2ffa51 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.092606 Oct 11 19:47:14.886863 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 752/1513] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:47:14 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c/os-volume_attachments => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:14.903129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:14.903769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] [instance: dfe1637f-a670-4f41-8ab8-a80c168abe0e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:14.924889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:14.925397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:14.925836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:14.926566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:14.941473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:14.941931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:15.004988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] HTTP exception thrown: Instance dfe1637f-a670-4f41-8ab8-a80c168abe0e could not be found. Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Request method failure captured: Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e HTTP/1.1 Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcf1xdM9cjYhvQcaCvdRFgmt_Ks8f3hQ_bS1b8ELKGmRDWj_pDkGrltMf2Lfz2s--_ksws3TPEFyMfhWpgLkmqObSlDv2TB20VUo9t8ZLaI93hBDPMclIP1qOzyqCxaBdZMcSoPjuvwAEP7crqi6NtJTTwUcc2go9_MEBDkZxMv8o8E Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba60fc5cb0874d38897f0ed8d5580106", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba60fc5cb0874d38897f0ed8d5580106"}]}] Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ba60fc5cb0874d38897f0ed8d5580106 Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246216797 Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e657b74c26d247cd896aa508c7aac5ca Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsTestJSON-246216797-project Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance dfe1637f-a670-4f41-8ab8-a80c168abe0e could not be found. Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'dfe1637f-a670-4f41-8ab8-a80c168abe0e'} Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfe1637f-a670-4f41-8ab8-a80c168abe0e could not be found. Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfe1637f-a670-4f41-8ab8-a80c168abe0e could not be found. Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:15.019094 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:15.023622 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:15.023622 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:15.023622 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:15.023622 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:15.023622 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:15.023622 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfe1637f-a670-4f41-8ab8-a80c168abe0e could not be found. Oct 11 19:47:15.023622 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:47:15.023622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Returning 404 to user: Instance dfe1637f-a670-4f41-8ab8-a80c168abe0e could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:15.023622 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-86a210eb-d694-4c98-8e3d-ce9da58f1932 tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e" status: 404 len: 111 microversion: 2.1 time: 0.132872 Oct 11 19:47:15.023622 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 753/1514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:14 2022] GET /compute/v2.1/servers/dfe1637f-a670-4f41-8ab8-a80c168abe0e => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:15.042553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c795a8f0-c5ad-4b7c-aaf5-6f989f7ac550 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:15.043172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c795a8f0-c5ad-4b7c-aaf5-6f989f7ac550 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:15.062461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c795a8f0-c5ad-4b7c-aaf5-6f989f7ac550 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:15.067170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c795a8f0-c5ad-4b7c-aaf5-6f989f7ac550 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:15.070890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c795a8f0-c5ad-4b7c-aaf5-6f989f7ac550 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:15.071824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c795a8f0-c5ad-4b7c-aaf5-6f989f7ac550 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:15.072465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c795a8f0-c5ad-4b7c-aaf5-6f989f7ac550 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:15.074045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c795a8f0-c5ad-4b7c-aaf5-6f989f7ac550 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:15.387047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96523c50-ab87-4ae0-84c8-131fd7170b9d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:15.408552 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-96523c50-ab87-4ae0-84c8-131fd7170b9d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1506 microversion: 2.1 time: 1.635835 Oct 11 19:47:15.410544 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 762/1515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:13 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1506 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:15.423273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:15.424072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:15.444335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:15.445293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:15.446107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:15.447088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:15.450256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:15.460181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:15.519323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c795a8f0-c5ad-4b7c-aaf5-6f989f7ac550 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:15.544022 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c795a8f0-c5ad-4b7c-aaf5-6f989f7ac550 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1469 microversion: 2.1 time: 0.517213 Oct 11 19:47:15.567390 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 754/1516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:15 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1469 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:15.576244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5c9313b-810c-4967-b60b-393b1676b41f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc4aeca0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:15.663415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:15.677023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:15.678864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:15.694725 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ec1ac31a-d9d7-4d1f-a9b8-bd2084dce82a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.281935 Oct 11 19:47:15.696248 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 763/1517] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:15 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:15.724989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-882943989", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "50a85b7f-a8bb-479c-b121-72e05795de50"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:15.892040 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5c9313b-810c-4967-b60b-393b1676b41f tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7038a674-90c6-4c50-bb6c-ba9f1c8ca7e8" status: 202 len: 0 microversion: 2.1 time: 0.323360 Oct 11 19:47:15.893732 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 755/1518] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:15 2022] DELETE /compute/v2.1/os-security-groups/7038a674-90c6-4c50-bb6c-ba9f1c8ca7e8 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:47:15.900175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d055a73e-ce8c-4a41-b058-ed07f46f72b1 req-c813fe93-610c-4144-9510-58e162bb7e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccfac528-a6be-45a6-914f-53d90ee124a0", "name": "network-vif-deleted", "tag": "9f016a48-46b6-4f37-bbf6-b267cb70a8ab"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:15.937000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d055a73e-ce8c-4a41-b058-ed07f46f72b1 req-c813fe93-610c-4144-9510-58e162bb7e84 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:15.937841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d055a73e-ce8c-4a41-b058-ed07f46f72b1 req-c813fe93-610c-4144-9510-58e162bb7e84 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:15.938645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d055a73e-ce8c-4a41-b058-ed07f46f72b1 req-c813fe93-610c-4144-9510-58e162bb7e84 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:15.962998 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d055a73e-ce8c-4a41-b058-ed07f46f72b1 req-c813fe93-610c-4144-9510-58e162bb7e84 service nova] Creating event network-vif-deleted:9f016a48-46b6-4f37-bbf6-b267cb70a8ab for instance ccfac528-a6be-45a6-914f-53d90ee124a0 on n-h2-860864-3 Oct 11 19:47:15.980406 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d055a73e-ce8c-4a41-b058-ed07f46f72b1 req-c813fe93-610c-4144-9510-58e162bb7e84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080978 Oct 11 19:47:15.985732 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 756/1519] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:15.991474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0cfa289-8af1-4a7d-82bf-2ac23c64ab7e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:15.993446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a0cfa289-8af1-4a7d-82bf-2ac23c64ab7e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:16.000914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0cfa289-8af1-4a7d-82bf-2ac23c64ab7e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:16.002051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0cfa289-8af1-4a7d-82bf-2ac23c64ab7e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:16.002839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0cfa289-8af1-4a7d-82bf-2ac23c64ab7e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:16.003752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0cfa289-8af1-4a7d-82bf-2ac23c64ab7e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:16.004697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0cfa289-8af1-4a7d-82bf-2ac23c64ab7e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:16.005371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0cfa289-8af1-4a7d-82bf-2ac23c64ab7e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:16.266272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a0cfa289-8af1-4a7d-82bf-2ac23c64ab7e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:16.306283 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a0cfa289-8af1-4a7d-82bf-2ac23c64ab7e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1506 microversion: 2.1 time: 0.294661 Oct 11 19:47:16.308489 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 757/1520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:15 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:16.315255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ace3d58e-30e3-46c5-bd88-afdb5e373110 req-28c5d726-151a-4a6e-8a46-1390655548ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccfac528-a6be-45a6-914f-53d90ee124a0", "name": "network-vif-unplugged", "status": "completed", "tag": "9f016a48-46b6-4f37-bbf6-b267cb70a8ab"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:16.350094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ace3d58e-30e3-46c5-bd88-afdb5e373110 req-28c5d726-151a-4a6e-8a46-1390655548ca service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:16.353592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ace3d58e-30e3-46c5-bd88-afdb5e373110 req-28c5d726-151a-4a6e-8a46-1390655548ca service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:16.354464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ace3d58e-30e3-46c5-bd88-afdb5e373110 req-28c5d726-151a-4a6e-8a46-1390655548ca service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:16.374954 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ace3d58e-30e3-46c5-bd88-afdb5e373110 req-28c5d726-151a-4a6e-8a46-1390655548ca service nova] Creating event network-vif-unplugged:9f016a48-46b6-4f37-bbf6-b267cb70a8ab for instance ccfac528-a6be-45a6-914f-53d90ee124a0 on n-h2-860864-3 Oct 11 19:47:16.382360 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ace3d58e-30e3-46c5-bd88-afdb5e373110 req-28c5d726-151a-4a6e-8a46-1390655548ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071340 Oct 11 19:47:16.384376 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 758/1521] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:16.399975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:16.401342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:16.409140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:16.411916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:16.413292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:16.415217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:16.416248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:16.417301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:16.417985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:16.475100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:16.476987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:16.477933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:16.478738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lazy-loading 'fault' on Instance uuid ccfac528-a6be-45a6-914f-53d90ee124a0 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:16.547512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:16.559486 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2d1d4518-ce79-4941-980d-3fcfb2f665f5 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1312 microversion: 2.1 time: 0.171427 Oct 11 19:47:16.563833 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 759/1522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:16 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:16.575862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a826c30-c5f3-4423-a2b7-387d4141eb2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] Calling method '.version_select at 0x7f83cc4ace50>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:16.841158 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a826c30-c5f3-4423-a2b7-387d4141eb2a tempest-SecurityGroupsTestJSON-246216797 tempest-SecurityGroupsTestJSON-246216797-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/8be8ab06-c8c8-4314-8213-96df2a32c879" status: 202 len: 0 microversion: 2.1 time: 0.275943 Oct 11 19:47:16.841918 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 760/1523] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:47:16 2022] DELETE /compute/v2.1/os-security-groups/8be8ab06-c8c8-4314-8213-96df2a32c879 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:47:16.849490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:16.856870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:16.878747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:16.879250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:16.879690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:16.880406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:16.880861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:16.881285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:20.117380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] validate_networks() for [('50a85b7f-a8bb-479c-b121-72e05795de50', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:47:20.127463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:20.140269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:47:20.140683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:47:20.141373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:47:20.141789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:47:20.142553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:47:20.221560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:20.231978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:20.232996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:20.233640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:20.234814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:20.235435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:20.236026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:20.284730 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3e15b24-d1ce-4c8a-8103-4725998ba0a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "POST /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d/action" status: 202 len: 1108 microversion: 2.1 time: 3.441386 Oct 11 19:47:20.286372 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 761/1524] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:47:16 2022] POST /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d/action => generated 1108 bytes in 3444 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 19:47:20.292755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bf78219d-9511-4c63-9a13-4ec0ab4dbd8d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:20.293907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bf78219d-9511-4c63-9a13-4ec0ab4dbd8d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:20.301337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf78219d-9511-4c63-9a13-4ec0ab4dbd8d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:20.301945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf78219d-9511-4c63-9a13-4ec0ab4dbd8d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:20.302390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf78219d-9511-4c63-9a13-4ec0ab4dbd8d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:20.303412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf78219d-9511-4c63-9a13-4ec0ab4dbd8d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:20.304308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf78219d-9511-4c63-9a13-4ec0ab4dbd8d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:20.304698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf78219d-9511-4c63-9a13-4ec0ab4dbd8d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:20.761317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bf78219d-9511-4c63-9a13-4ec0ab4dbd8d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:20.774575 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bf78219d-9511-4c63-9a13-4ec0ab4dbd8d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1469 microversion: 2.1 time: 0.486988 Oct 11 19:47:20.788963 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 762/1525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:20 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:20.797609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:20.798516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:20.820332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:20.821174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:20.821961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:20.823412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:20.824048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:20.825018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:20.991072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:21.008885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:21.017423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:21.041108 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2fe28ed4-eff3-416b-81eb-c04d680bb44c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.249869 Oct 11 19:47:21.042094 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 763/1526] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:20 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:21.049716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:21.050469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:21.051689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:47:21.052747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:47:21.063618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:47:21.063767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:47:21.064140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:47:21.067383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:21.067881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:21.068317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:21.069021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:21.069466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:21.070431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:21.106237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:21.111624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:21.112433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:21.113585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:21.116116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:21.118766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:21.122938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:21.123503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:21.123956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:21.124422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lazy-loading 'fault' on Instance uuid ccfac528-a6be-45a6-914f-53d90ee124a0 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:21.157375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:47:21.163042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for user 8494488a13a3496eb59a8062479816bc and project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:47:21.180050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:47:21.189945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 16e5939a-3567-4863-af67-b6e6833e8220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:47:21.202079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868c158fc4d8483e90592f757197cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d669d7170472da22189d6d7c6fd7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:21.216964 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8527997a-9972-4bb0-af85-6e9fe5634af6 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 200 len: 1312 microversion: 2.1 time: 0.172760 Oct 11 19:47:21.233466 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 764/1527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:21 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:21.249644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba9eb445-7389-47f7-ac21-04cf696e5527 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:21.250108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba9eb445-7389-47f7-ac21-04cf696e5527 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:21.271361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba9eb445-7389-47f7-ac21-04cf696e5527 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:21.272285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba9eb445-7389-47f7-ac21-04cf696e5527 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:21.272773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba9eb445-7389-47f7-ac21-04cf696e5527 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:21.274492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba9eb445-7389-47f7-ac21-04cf696e5527 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:21.274983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba9eb445-7389-47f7-ac21-04cf696e5527 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:21.289049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba9eb445-7389-47f7-ac21-04cf696e5527 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:21.294669 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7d5cb338-9d62-43ff-abc2-cd2664bc1796 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.578759 Oct 11 19:47:21.295972 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 764/1528] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:47:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 5599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:47:21.309578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ffaafc70-abcf-4f98-be6d-37cef829c693 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:21.310470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ffaafc70-abcf-4f98-be6d-37cef829c693 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 16e5939a-3567-4863-af67-b6e6833e8220] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:21.337306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:21.394164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:21.451310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ffaafc70-abcf-4f98-be6d-37cef829c693 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:21.468381 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ffaafc70-abcf-4f98-be6d-37cef829c693 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220" status: 200 len: 1214 microversion: 2.1 time: 0.161135 Oct 11 19:47:21.469677 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 765/1529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:21 2022] GET /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:21.490574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e235c5c-0064-4211-868b-3b835038aa6b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:21.496463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9e235c5c-0064-4211-868b-3b835038aa6b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 16e5939a-3567-4863-af67-b6e6833e8220] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:21.530045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9e235c5c-0064-4211-868b-3b835038aa6b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 16e5939a-3567-4863-af67-b6e6833e8220] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:47:21.619687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba9eb445-7389-47f7-ac21-04cf696e5527 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:21.633399 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba9eb445-7389-47f7-ac21-04cf696e5527 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.403710 Oct 11 19:47:21.646551 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 765/1530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:21 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:21.799789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-02b45091-15f5-41ca-989e-92cef940ad88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:21.800665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-02b45091-15f5-41ca-989e-92cef940ad88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:21.812696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b45091-15f5-41ca-989e-92cef940ad88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:21.817226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b45091-15f5-41ca-989e-92cef940ad88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:21.818669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b45091-15f5-41ca-989e-92cef940ad88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:21.822634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b45091-15f5-41ca-989e-92cef940ad88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:21.823626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b45091-15f5-41ca-989e-92cef940ad88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:21.825230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b45091-15f5-41ca-989e-92cef940ad88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:22.010410 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9e235c5c-0064-4211-868b-3b835038aa6b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220" status: 204 len: 0 microversion: 2.1 time: 0.523166 Oct 11 19:47:22.011063 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 766/1531] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:47:21 2022] DELETE /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:47:22.033538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-894169df-8021-4903-9976-3e7b36c332c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:22.034182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-894169df-8021-4903-9976-3e7b36c332c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 16e5939a-3567-4863-af67-b6e6833e8220] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:22.097941 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-894169df-8021-4903-9976-3e7b36c332c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-894169df-8021-4903-9976-3e7b36c332c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220 HTTP/1.1 Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '16e5939a-3567-4863-af67-b6e6833e8220'} Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 16e5939a-3567-4863-af67-b6e6833e8220 Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:22.108542 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-894169df-8021-4903-9976-3e7b36c332c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:22.113019 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-894169df-8021-4903-9976-3e7b36c332c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220" status: 404 len: 111 microversion: 2.1 time: 0.083444 Oct 11 19:47:22.116086 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 767/1532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:22 2022] GET /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:22.141002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:22.141667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:22.155434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:22.155925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:22.162131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:22.162924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:22.163428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:22.163912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:22.537457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:22.559709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:22.561464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:22.568573 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c9c0dfd4-a02f-44b7-9e9e-d5f5f5aacaf6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.452361 Oct 11 19:47:22.570167 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 768/1533] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:22 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:22.577231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-332a27c7-044a-45ce-9021-4577b3791e94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:22.578666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-332a27c7-044a-45ce-9021-4577b3791e94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:22.582466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-02b45091-15f5-41ca-989e-92cef940ad88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:22.586797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-332a27c7-044a-45ce-9021-4577b3791e94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:22.588125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-332a27c7-044a-45ce-9021-4577b3791e94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:22.588851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-332a27c7-044a-45ce-9021-4577b3791e94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:22.589684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-332a27c7-044a-45ce-9021-4577b3791e94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:22.590202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-332a27c7-044a-45ce-9021-4577b3791e94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:22.590749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-332a27c7-044a-45ce-9021-4577b3791e94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:22.605031 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-02b45091-15f5-41ca-989e-92cef940ad88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1469 microversion: 2.1 time: 0.806284 Oct 11 19:47:22.605798 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 766/1534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:21 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1469 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:22.619287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1673230155", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "50a85b7f-a8bb-479c-b121-72e05795de50"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:22.691419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] validate_networks() for [('50a85b7f-a8bb-479c-b121-72e05795de50', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:47:22.877717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-332a27c7-044a-45ce-9021-4577b3791e94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid 72bf9d5c-d025-4705-828e-4e4e389f5681 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:22.900431 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-332a27c7-044a-45ce-9021-4577b3791e94 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 2422 microversion: 2.25 time: 0.328308 Oct 11 19:47:22.915528 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 769/1535] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:22 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 2422 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:22.924428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:22.925634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] [instance: ccfac528-a6be-45a6-914f-53d90ee124a0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:22.933708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:22.934215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:22.934815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:22.935613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:22.936632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:22.937111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:22.966007 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] HTTP exception thrown: Instance ccfac528-a6be-45a6-914f-53d90ee124a0 could not be found. Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Request method failure captured: Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 HTTP/1.1 Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcgeZ8GscmXkc1EUitpJARJTs-LCbTZGx7JVLvYAk0CXtoUQ8QgX7QTerAVAC2OaCvtMUTT7FUGYtX_hZ1MJX4VxEBS6NnpxAczSdFgb1vG_s35AwsYOjW3aZRhrrFYWYXUXjrGFsonVrVj-4_JmP4o-eSagZs5saQc6hRUwkkIetug Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 486d669d7170472da22189d6d7c6fd7d Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-633852060 Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/486d669d7170472da22189d6d7c6fd7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_486d669d7170472da22189d6d7c6fd7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/486d669d7170472da22189d6d7c6fd7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/486d669d7170472da22189d6d7c6fd7d"}]}] Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-633852060 Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 486d669d7170472da22189d6d7c6fd7d Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-633852060 Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerDiagnosticsNegativeTest-633852060-project Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 868c158fc4d8483e90592f757197cad0 Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-633852060-project Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ccfac528-a6be-45a6-914f-53d90ee124a0 could not be found. Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ccfac528-a6be-45a6-914f-53d90ee124a0'} Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccfac528-a6be-45a6-914f-53d90ee124a0 could not be found. Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccfac528-a6be-45a6-914f-53d90ee124a0 could not be found. Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.967662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:22.971645 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.971645 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:22.971645 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:22.971645 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:22.971645 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:22.971645 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:22.971645 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccfac528-a6be-45a6-914f-53d90ee124a0 could not be found. Oct 11 19:47:22.971645 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:22.973449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] Returning 404 to user: Instance ccfac528-a6be-45a6-914f-53d90ee124a0 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:22.974513 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8f66912-1dfb-41de-b96a-278d8481e055 tempest-ServerDiagnosticsNegativeTest-633852060 tempest-ServerDiagnosticsNegativeTest-633852060-project] 10.222.0.27 "GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0" status: 404 len: 111 microversion: 2.1 time: 0.057654 Oct 11 19:47:22.979709 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 770/1536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:22 2022] GET /compute/v2.1/servers/ccfac528-a6be-45a6-914f-53d90ee124a0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:22.985231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7690326a-ee86-437c-83bc-4e6fa5d0f0fa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:22.985973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7690326a-ee86-437c-83bc-4e6fa5d0f0fa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:22.995281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7690326a-ee86-437c-83bc-4e6fa5d0f0fa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:22.995726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7690326a-ee86-437c-83bc-4e6fa5d0f0fa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:22.998448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7690326a-ee86-437c-83bc-4e6fa5d0f0fa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:22.999234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7690326a-ee86-437c-83bc-4e6fa5d0f0fa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:22.999703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7690326a-ee86-437c-83bc-4e6fa5d0f0fa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:23.002902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7690326a-ee86-437c-83bc-4e6fa5d0f0fa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:23.006113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:23.296615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7690326a-ee86-437c-83bc-4e6fa5d0f0fa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:23.306700 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7690326a-ee86-437c-83bc-4e6fa5d0f0fa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.325038 Oct 11 19:47:23.322564 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 771/1537] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:22 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:23.322564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-3", "block_migration": "auto"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:23.322564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:23.329705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:23.330276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:23.331161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:23.332498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:23.332966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:23.333399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:23.346691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:47:23.347126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:47:23.347612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:47:23.349115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:47:23.350022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:47:23.366600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:23.367167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'flavor' on Instance uuid 72bf9d5c-d025-4705-828e-4e4e389f5681 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:23.367435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:23.367892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:23.369044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:23.369520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:23.369954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:23.384519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Going to try to live migrate instance to n-h2-860864-3 {{(pid=126955) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 19:47:23.392249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:47:23.404571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for user 8494488a13a3496eb59a8062479816bc and project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:47:23.427897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:47:23.431070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:47:23.514012 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1721184-d425-45eb-9f1a-d199533c93c5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904235 Oct 11 19:47:23.517105 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 767/1538] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:47:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:47:23.531330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f0915e0c-bab8-4bed-a0cf-fda5a2c6212f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:23.532118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f0915e0c-bab8-4bed-a0cf-fda5a2c6212f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:23.635969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f0915e0c-bab8-4bed-a0cf-fda5a2c6212f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:23.647481 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f0915e0c-bab8-4bed-a0cf-fda5a2c6212f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1215 microversion: 2.1 time: 0.122289 Oct 11 19:47:23.650708 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 768/1539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:23 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:23.665161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:23.673368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:23.688879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:23.689496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:23.691105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:23.692718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:23.696160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:23.703763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:24.338869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:24.362007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:24.372373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:24.385320 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b4dadd35-1095-4762-8faa-4feea6007065 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.727131 Oct 11 19:47:24.385966 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 769/1540] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:23 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:24.393467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-82ec9429-db9b-4347-89c4-de33b2448fe9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:24.394078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-82ec9429-db9b-4347-89c4-de33b2448fe9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:24.408591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ec9429-db9b-4347-89c4-de33b2448fe9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:24.409094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ec9429-db9b-4347-89c4-de33b2448fe9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:24.410312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ec9429-db9b-4347-89c4-de33b2448fe9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:24.415143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ec9429-db9b-4347-89c4-de33b2448fe9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:24.415857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ec9429-db9b-4347-89c4-de33b2448fe9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:24.416877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ec9429-db9b-4347-89c4-de33b2448fe9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:24.604165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82ec9429-db9b-4347-89c4-de33b2448fe9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:24.615367 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-82ec9429-db9b-4347-89c4-de33b2448fe9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1469 microversion: 2.1 time: 0.228283 Oct 11 19:47:24.619881 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 770/1541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:24 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:24.630668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-35c9e622-7655-49d0-8368-53355b796f83 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:24.647175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-35c9e622-7655-49d0-8368-53355b796f83 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:24.658886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35c9e622-7655-49d0-8368-53355b796f83 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:24.659803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35c9e622-7655-49d0-8368-53355b796f83 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:24.666000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35c9e622-7655-49d0-8368-53355b796f83 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:24.668448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35c9e622-7655-49d0-8368-53355b796f83 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:24.669179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35c9e622-7655-49d0-8368-53355b796f83 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:24.669837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35c9e622-7655-49d0-8368-53355b796f83 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:25.012717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35c9e622-7655-49d0-8368-53355b796f83 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:25.032339 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-35c9e622-7655-49d0-8368-53355b796f83 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.408480 Oct 11 19:47:25.034058 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 771/1542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:24 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:25.557413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fb743b3b-ee8d-4d0b-802f-e9e0a3d598e6 tempest-AZV2TestJSON-487189159 tempest-AZV2TestJSON-487189159-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:25.560978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb743b3b-ee8d-4d0b-802f-e9e0a3d598e6 tempest-AZV2TestJSON-487189159 tempest-AZV2TestJSON-487189159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:25.563482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb743b3b-ee8d-4d0b-802f-e9e0a3d598e6 tempest-AZV2TestJSON-487189159 tempest-AZV2TestJSON-487189159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:25.566852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb743b3b-ee8d-4d0b-802f-e9e0a3d598e6 tempest-AZV2TestJSON-487189159 tempest-AZV2TestJSON-487189159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:25.567881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb743b3b-ee8d-4d0b-802f-e9e0a3d598e6 tempest-AZV2TestJSON-487189159 tempest-AZV2TestJSON-487189159-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:25.568744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb743b3b-ee8d-4d0b-802f-e9e0a3d598e6 tempest-AZV2TestJSON-487189159 tempest-AZV2TestJSON-487189159-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:25.570622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb743b3b-ee8d-4d0b-802f-e9e0a3d598e6 tempest-AZV2TestJSON-487189159 tempest-AZV2TestJSON-487189159-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:25.617898 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fb743b3b-ee8d-4d0b-802f-e9e0a3d598e6 tempest-AZV2TestJSON-487189159 tempest-AZV2TestJSON-487189159-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.581192 Oct 11 19:47:25.630823 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 772/1543] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Oct 11 19:47:25 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:47:25.642004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5c2907ec-3eaa-4524-b15e-f87fe12785c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:25.645379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5c2907ec-3eaa-4524-b15e-f87fe12785c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:25.654162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2907ec-3eaa-4524-b15e-f87fe12785c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:25.655494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2907ec-3eaa-4524-b15e-f87fe12785c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:25.656308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2907ec-3eaa-4524-b15e-f87fe12785c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:25.657289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2907ec-3eaa-4524-b15e-f87fe12785c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:25.657967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2907ec-3eaa-4524-b15e-f87fe12785c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:25.658661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2907ec-3eaa-4524-b15e-f87fe12785c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:25.826103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5c2907ec-3eaa-4524-b15e-f87fe12785c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:25.851222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5c2907ec-3eaa-4524-b15e-f87fe12785c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1211 microversion: 2.1 time: 0.204855 Oct 11 19:47:25.852694 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 773/1544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:25 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1211 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:25.873918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:25.878626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:25.889680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:25.892594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:25.893277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:25.899615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:25.900418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:25.901105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:25.938817 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e44f3d21-f068-4d14-b854-34149796dd0f tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/action" status: 202 len: 0 microversion: 2.25 time: 2.629122 Oct 11 19:47:25.942638 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 772/1545] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:47:23 2022] POST /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/action => generated 0 bytes in 2632 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:47:25.946087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-622214f8-10b3-4756-a655-d00b08f3d1f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:25.948048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-622214f8-10b3-4756-a655-d00b08f3d1f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:25.971544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622214f8-10b3-4756-a655-d00b08f3d1f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:25.981271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622214f8-10b3-4756-a655-d00b08f3d1f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:25.981729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622214f8-10b3-4756-a655-d00b08f3d1f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:25.982476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622214f8-10b3-4756-a655-d00b08f3d1f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:25.983908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622214f8-10b3-4756-a655-d00b08f3d1f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:25.984355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622214f8-10b3-4756-a655-d00b08f3d1f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:26.043501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:26.069337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:26.081268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:26.095619 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c462c884-cf0c-4f68-8a94-5064740144b1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.226691 Oct 11 19:47:26.096201 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 774/1546] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:25 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:26.107608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:26.108674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:26.120677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:26.121515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:26.122204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:26.124077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:26.129110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:26.129869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:26.535722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:26.559259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-622214f8-10b3-4756-a655-d00b08f3d1f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:26.572834 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-622214f8-10b3-4756-a655-d00b08f3d1f8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1535 microversion: 2.1 time: 0.627281 Oct 11 19:47:26.577079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:26.577480 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 773/1547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:25 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1535 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:26.580311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:26.582835 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba56b759-5ece-4709-9d86-6435fdaf1c66 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.479062 Oct 11 19:47:26.583669 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 775/1548] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:26 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:26.587896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eddbb0f9-ab66-4056-a864-85d1c0a81cbc tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:26.597048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eddbb0f9-ab66-4056-a864-85d1c0a81cbc tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:26.615360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eddbb0f9-ab66-4056-a864-85d1c0a81cbc tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:26.616847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eddbb0f9-ab66-4056-a864-85d1c0a81cbc tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:26.617677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eddbb0f9-ab66-4056-a864-85d1c0a81cbc tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:26.618827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eddbb0f9-ab66-4056-a864-85d1c0a81cbc tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:26.619734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eddbb0f9-ab66-4056-a864-85d1c0a81cbc tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:26.620736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eddbb0f9-ab66-4056-a864-85d1c0a81cbc tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:26.881284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd7544b2-7287-40cd-837e-e025174fdd1c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:26.884335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bd7544b2-7287-40cd-837e-e025174fdd1c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:26.894214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd7544b2-7287-40cd-837e-e025174fdd1c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:26.899456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd7544b2-7287-40cd-837e-e025174fdd1c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:26.900334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd7544b2-7287-40cd-837e-e025174fdd1c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:26.901256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd7544b2-7287-40cd-837e-e025174fdd1c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:26.901888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd7544b2-7287-40cd-837e-e025174fdd1c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:26.903078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd7544b2-7287-40cd-837e-e025174fdd1c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:27.059615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd7544b2-7287-40cd-837e-e025174fdd1c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:27.070044 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bd7544b2-7287-40cd-837e-e025174fdd1c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1267 microversion: 2.1 time: 0.192117 Oct 11 19:47:27.084569 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 776/1549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:26 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:27.096865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eddbb0f9-ab66-4056-a864-85d1c0a81cbc tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:27.111283 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eddbb0f9-ab66-4056-a864-85d1c0a81cbc tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.531955 Oct 11 19:47:27.127318 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 774/1550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:26 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:27.129077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:27.129886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:27.144391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:27.144910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:27.145352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:27.146336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:27.147242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:27.148059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:27.324726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:27.338785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:27.344733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:27.359383 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3eb3daa4-e8a7-4264-aae1-09d158dcf7ac tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1533 microversion: 2.91 time: 0.234062 Oct 11 19:47:27.361610 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 777/1551] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:27 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1533 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:47:27.390606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d4e839e4-a555-40c0-a09d-a0457c0836cf tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:27.391226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d4e839e4-a555-40c0-a09d-a0457c0836cf tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:27.398371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e839e4-a555-40c0-a09d-a0457c0836cf tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:27.410496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e839e4-a555-40c0-a09d-a0457c0836cf tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:27.411137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e839e4-a555-40c0-a09d-a0457c0836cf tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:27.415088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e839e4-a555-40c0-a09d-a0457c0836cf tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:27.415605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e839e4-a555-40c0-a09d-a0457c0836cf tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:27.416256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e839e4-a555-40c0-a09d-a0457c0836cf tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:27.597613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-d4e839e4-a555-40c0-a09d-a0457c0836cf tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lazy-loading 'services' on Instance uuid f30bdfac-1c61-4f61-876d-0922853f40c0 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:27.608971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a7b89c0f-ae0e-440e-b127-37ac6da021b1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:27.609864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a7b89c0f-ae0e-440e-b127-37ac6da021b1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:27.629043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b89c0f-ae0e-440e-b127-37ac6da021b1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:27.632407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b89c0f-ae0e-440e-b127-37ac6da021b1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:27.633032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b89c0f-ae0e-440e-b127-37ac6da021b1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:27.634677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b89c0f-ae0e-440e-b127-37ac6da021b1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:27.636674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b89c0f-ae0e-440e-b127-37ac6da021b1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:27.637291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b89c0f-ae0e-440e-b127-37ac6da021b1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:27.655132 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d4e839e4-a555-40c0-a09d-a0457c0836cf tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1938 microversion: 2.91 time: 0.268688 Oct 11 19:47:27.657149 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 775/1552] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:27 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1938 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:27.669406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:27.670035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:27.678128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:27.716190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:27.716849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:27.717298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:27.719129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:27.719937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:27.722275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:28.181255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a7b89c0f-ae0e-440e-b127-37ac6da021b1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:28.192890 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a7b89c0f-ae0e-440e-b127-37ac6da021b1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1535 microversion: 2.1 time: 0.592100 Oct 11 19:47:28.196307 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 778/1553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:27 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1535 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:28.210398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-07d97d8d-c51e-49c3-97d7-979b21eb876a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:28.216021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-07d97d8d-c51e-49c3-97d7-979b21eb876a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:28.228906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07d97d8d-c51e-49c3-97d7-979b21eb876a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:28.231311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07d97d8d-c51e-49c3-97d7-979b21eb876a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:28.232176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07d97d8d-c51e-49c3-97d7-979b21eb876a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:28.233645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07d97d8d-c51e-49c3-97d7-979b21eb876a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:28.238752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07d97d8d-c51e-49c3-97d7-979b21eb876a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:28.239595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07d97d8d-c51e-49c3-97d7-979b21eb876a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:28.263264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:28.277037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:28.280788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:28.286604 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca139c76-43ef-4723-9cec-16e664af0dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.623561 Oct 11 19:47:28.287505 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 776/1554] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:27 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:28.296996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-07d97d8d-c51e-49c3-97d7-979b21eb876a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lazy-loading 'flavor' on Instance uuid f30bdfac-1c61-4f61-876d-0922853f40c0 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:28.297309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-d11c3934-3143-43cb-9913-0bb47c4b1a55 req-2fec4145-2ee1-454e-bb88-079cbd44f4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffb0124-9fa9-4a38-ad03-7fece0c780fe", "name": "network-vif-unplugged", "status": "completed", "tag": "7686bb0d-edf8-44e5-bb28-774c272e3719"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:28.318570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d11c3934-3143-43cb-9913-0bb47c4b1a55 req-2fec4145-2ee1-454e-bb88-079cbd44f4b9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:28.319056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d11c3934-3143-43cb-9913-0bb47c4b1a55 req-2fec4145-2ee1-454e-bb88-079cbd44f4b9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:28.321550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d11c3934-3143-43cb-9913-0bb47c4b1a55 req-2fec4145-2ee1-454e-bb88-079cbd44f4b9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:28.356365 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-d11c3934-3143-43cb-9913-0bb47c4b1a55 req-2fec4145-2ee1-454e-bb88-079cbd44f4b9 service nova] Creating event network-vif-unplugged:7686bb0d-edf8-44e5-bb28-774c272e3719 for instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe on n-h1-860864-3 Oct 11 19:47:28.370730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-d11c3934-3143-43cb-9913-0bb47c4b1a55 req-2fec4145-2ee1-454e-bb88-079cbd44f4b9 service nova] Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:47:28.396260 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-d11c3934-3143-43cb-9913-0bb47c4b1a55 req-2fec4145-2ee1-454e-bb88-079cbd44f4b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107198 Oct 11 19:47:28.398040 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 777/1555] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:28.409152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-800a0ac4-6713-42be-a3de-a659ce937154 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:28.410239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-800a0ac4-6713-42be-a3de-a659ce937154 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:28.425131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-800a0ac4-6713-42be-a3de-a659ce937154 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:28.429101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-800a0ac4-6713-42be-a3de-a659ce937154 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:28.429810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-800a0ac4-6713-42be-a3de-a659ce937154 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:28.430932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-800a0ac4-6713-42be-a3de-a659ce937154 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:28.431557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-800a0ac4-6713-42be-a3de-a659ce937154 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:28.432841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-800a0ac4-6713-42be-a3de-a659ce937154 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:28.567266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-800a0ac4-6713-42be-a3de-a659ce937154 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:28.585868 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-800a0ac4-6713-42be-a3de-a659ce937154 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1273 microversion: 2.1 time: 0.178952 Oct 11 19:47:28.586865 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 778/1556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:28 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:28.607876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b2de4a17-409e-4077-82ef-93206aa494e2 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:28.611913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b2de4a17-409e-4077-82ef-93206aa494e2 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:28.622624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2de4a17-409e-4077-82ef-93206aa494e2 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:28.631064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2de4a17-409e-4077-82ef-93206aa494e2 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:28.631518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2de4a17-409e-4077-82ef-93206aa494e2 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:28.632844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2de4a17-409e-4077-82ef-93206aa494e2 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:28.633307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2de4a17-409e-4077-82ef-93206aa494e2 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:28.633738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2de4a17-409e-4077-82ef-93206aa494e2 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:28.878632 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-07d97d8d-c51e-49c3-97d7-979b21eb876a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "POST /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0/action" status: 202 len: 0 microversion: 2.91 time: 0.680944 Oct 11 19:47:28.880839 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 779/1557] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:47:28 2022] POST /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:47:29.219712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2625adf8-0f69-4179-840e-050bf45c1ad5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:29.223477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2625adf8-0f69-4179-840e-050bf45c1ad5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.225344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2625adf8-0f69-4179-840e-050bf45c1ad5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.227035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2625adf8-0f69-4179-840e-050bf45c1ad5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.228051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2625adf8-0f69-4179-840e-050bf45c1ad5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.228707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2625adf8-0f69-4179-840e-050bf45c1ad5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.229321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2625adf8-0f69-4179-840e-050bf45c1ad5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.262838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b2de4a17-409e-4077-82ef-93206aa494e2 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:29.271950 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b2de4a17-409e-4077-82ef-93206aa494e2 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.671927 Oct 11 19:47:29.275046 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 779/1558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:28 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:29.283131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:29.289506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:29.305595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.306764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.308145 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2625adf8-0f69-4179-840e-050bf45c1ad5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.422918 Oct 11 19:47:29.308417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.309073 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 780/1559] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:47:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:29.315681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1351ec14-5d3e-4ea4-94f6-8e8c4d437586 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:29.316417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1351ec14-5d3e-4ea4-94f6-8e8c4d437586 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:29.320195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.320821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.322773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.336243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1351ec14-5d3e-4ea4-94f6-8e8c4d437586 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.336744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1351ec14-5d3e-4ea4-94f6-8e8c4d437586 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.337199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1351ec14-5d3e-4ea4-94f6-8e8c4d437586 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.337912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1351ec14-5d3e-4ea4-94f6-8e8c4d437586 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.342030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1351ec14-5d3e-4ea4-94f6-8e8c4d437586 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.342876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1351ec14-5d3e-4ea4-94f6-8e8c4d437586 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.558688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:29.581197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:29.583539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:29.593768 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d0b0704c-b00e-4726-90e0-9a0083504c32 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.315529 Oct 11 19:47:29.595176 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 780/1560] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:29 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:29.603006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:29.603880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:29.611570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.612356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.613013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.613949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.614868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.615291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.806580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1351ec14-5d3e-4ea4-94f6-8e8c4d437586 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:29.825507 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1351ec14-5d3e-4ea4-94f6-8e8c4d437586 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1535 microversion: 2.1 time: 0.513817 Oct 11 19:47:29.827211 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 781/1561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:29 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1535 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:29.832797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8f1e27fc-f59e-42b1-9830-12d37d7893a4 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:29.839989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1e27fc-f59e-42b1-9830-12d37d7893a4 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.840895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1e27fc-f59e-42b1-9830-12d37d7893a4 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.841842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1e27fc-f59e-42b1-9830-12d37d7893a4 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.842857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1e27fc-f59e-42b1-9830-12d37d7893a4 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.844464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1e27fc-f59e-42b1-9830-12d37d7893a4 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.845099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1e27fc-f59e-42b1-9830-12d37d7893a4 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.895851 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8f1e27fc-f59e-42b1-9830-12d37d7893a4 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-860864-3" status: 200 len: 578 microversion: 2.1 time: 0.067051 Oct 11 19:47:29.896527 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 782/1562] 10.222.0.27 () {58 vars in 1172 bytes} [Tue Oct 11 19:47:29 2022] GET /compute/v2.1/os-services?host=n-d-860864-3 => generated 578 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:29.911153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6d22697-a4c9-40c8-b83d-6827923e0c2c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:29.911809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6d22697-a4c9-40c8-b83d-6827923e0c2c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:29.919915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d22697-a4c9-40c8-b83d-6827923e0c2c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.920689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d22697-a4c9-40c8-b83d-6827923e0c2c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.921344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d22697-a4c9-40c8-b83d-6827923e0c2c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:29.922269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d22697-a4c9-40c8-b83d-6827923e0c2c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:29.922957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d22697-a4c9-40c8-b83d-6827923e0c2c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:29.923585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d22697-a4c9-40c8-b83d-6827923e0c2c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.102950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:30.126798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:30.130169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:30.132901 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b80bbc58-1761-426d-b4c2-edd98060f704 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.536236 Oct 11 19:47:30.134491 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 781/1563] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:29 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:30.143370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-82178d88-91e1-4fea-bdb3-cd73dde10bb9 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:30.150191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82178d88-91e1-4fea-bdb3-cd73dde10bb9 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.151382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82178d88-91e1-4fea-bdb3-cd73dde10bb9 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.152646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82178d88-91e1-4fea-bdb3-cd73dde10bb9 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.154074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82178d88-91e1-4fea-bdb3-cd73dde10bb9 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.154795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82178d88-91e1-4fea-bdb3-cd73dde10bb9 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.156074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82178d88-91e1-4fea-bdb3-cd73dde10bb9 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.191745 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-82178d88-91e1-4fea-bdb3-cd73dde10bb9 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055285 Oct 11 19:47:30.193267 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 782/1564] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 11 19:47:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:30.207877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-161be35f-761c-4cba-8836-bd224749eeb5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:30.213030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-161be35f-761c-4cba-8836-bd224749eeb5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.213949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-161be35f-761c-4cba-8836-bd224749eeb5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.214833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-161be35f-761c-4cba-8836-bd224749eeb5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.216065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-161be35f-761c-4cba-8836-bd224749eeb5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.216802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-161be35f-761c-4cba-8836-bd224749eeb5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.217598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-161be35f-761c-4cba-8836-bd224749eeb5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.251074 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-161be35f-761c-4cba-8836-bd224749eeb5 tempest-ServicesAdminTestJSON-781804184 tempest-ServicesAdminTestJSON-781804184-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047095 Oct 11 19:47:30.263517 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 783/1565] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:47:30 2022] GET /compute/v2.1/os-services => generated 944 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:47:30.302024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c9c76a7-c390-435b-b542-3d2716cd1eac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:30.302716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5c9c76a7-c390-435b-b542-3d2716cd1eac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:30.320993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c9c76a7-c390-435b-b542-3d2716cd1eac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.322476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c9c76a7-c390-435b-b542-3d2716cd1eac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.323533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c9c76a7-c390-435b-b542-3d2716cd1eac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.326170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c9c76a7-c390-435b-b542-3d2716cd1eac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.326951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c9c76a7-c390-435b-b542-3d2716cd1eac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.330125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c9c76a7-c390-435b-b542-3d2716cd1eac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.480644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6d22697-a4c9-40c8-b83d-6827923e0c2c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:30.495618 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6d22697-a4c9-40c8-b83d-6827923e0c2c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1315 microversion: 2.1 time: 0.592857 Oct 11 19:47:30.498447 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 783/1566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:29 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:30.640650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1fb2f80a-5b6a-44d1-957d-ac368944f965 req-aad5b5b7-956f-4b44-9a04-1cf993a7a5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffb0124-9fa9-4a38-ad03-7fece0c780fe", "tag": "7686bb0d-edf8-44e5-bb28-774c272e3719"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:30.659595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1fb2f80a-5b6a-44d1-957d-ac368944f965 req-aad5b5b7-956f-4b44-9a04-1cf993a7a5ba service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.662228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1fb2f80a-5b6a-44d1-957d-ac368944f965 req-aad5b5b7-956f-4b44-9a04-1cf993a7a5ba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.662971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1fb2f80a-5b6a-44d1-957d-ac368944f965 req-aad5b5b7-956f-4b44-9a04-1cf993a7a5ba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.695525 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1fb2f80a-5b6a-44d1-957d-ac368944f965 req-aad5b5b7-956f-4b44-9a04-1cf993a7a5ba service nova] Creating event network-changed:7686bb0d-edf8-44e5-bb28-774c272e3719 for instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe on n-h1-860864-3 Oct 11 19:47:30.714269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-1fb2f80a-5b6a-44d1-957d-ac368944f965 req-aad5b5b7-956f-4b44-9a04-1cf993a7a5ba service nova] Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:47:30.737696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5c9c76a7-c390-435b-b542-3d2716cd1eac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:30.743352 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1fb2f80a-5b6a-44d1-957d-ac368944f965 req-aad5b5b7-956f-4b44-9a04-1cf993a7a5ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241045 Oct 11 19:47:30.745806 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 784/1567] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:30.748587 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5c9c76a7-c390-435b-b542-3d2716cd1eac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.455016 Oct 11 19:47:30.752838 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 784/1568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:30 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:30.759095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:30.761465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:30.791297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.792566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.798988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.799965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.802832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.803580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.854646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a3c8d03e-8d8a-47aa-8b70-385eaee38f5f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:30.855403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a3c8d03e-8d8a-47aa-8b70-385eaee38f5f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:30.866120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3c8d03e-8d8a-47aa-8b70-385eaee38f5f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.866819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3c8d03e-8d8a-47aa-8b70-385eaee38f5f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.870176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3c8d03e-8d8a-47aa-8b70-385eaee38f5f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:30.871893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3c8d03e-8d8a-47aa-8b70-385eaee38f5f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:30.872646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3c8d03e-8d8a-47aa-8b70-385eaee38f5f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:30.873311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a3c8d03e-8d8a-47aa-8b70-385eaee38f5f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:31.074885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:31.094701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:31.097151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:31.109354 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-42f215fc-cab3-401b-843f-f933851c86b5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.361361 Oct 11 19:47:31.110367 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 785/1569] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:30 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:31.163475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:31.164362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:31.175884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:31.176939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:31.177643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:31.179241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:31.187422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:31.188178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:31.716946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:32.221604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a3c8d03e-8d8a-47aa-8b70-385eaee38f5f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:32.239034 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a3c8d03e-8d8a-47aa-8b70-385eaee38f5f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1535 microversion: 2.1 time: 1.389004 Oct 11 19:47:32.241453 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 785/1570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:30 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1535 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:32.252000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-da8c21bd-4711-450b-ac0e-537b43b89e98 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:32.254351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-da8c21bd-4711-450b-ac0e-537b43b89e98 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:32.266630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da8c21bd-4711-450b-ac0e-537b43b89e98 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:32.267577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da8c21bd-4711-450b-ac0e-537b43b89e98 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:32.268262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da8c21bd-4711-450b-ac0e-537b43b89e98 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:32.269228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da8c21bd-4711-450b-ac0e-537b43b89e98 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:32.269913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da8c21bd-4711-450b-ac0e-537b43b89e98 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:32.270575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da8c21bd-4711-450b-ac0e-537b43b89e98 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:32.486517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:32.500670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:32.502605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:32.504048 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4abaeeec-079c-4446-8d81-703bb54d5851 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 1.345002 Oct 11 19:47:32.505129 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 786/1571] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:31 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:47:32.510901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f9a0b92e-57d0-4057-b864-f7b0074a41c3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:32.511701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f9a0b92e-57d0-4057-b864-f7b0074a41c3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:32.518056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9a0b92e-57d0-4057-b864-f7b0074a41c3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:32.518788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9a0b92e-57d0-4057-b864-f7b0074a41c3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:32.519411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9a0b92e-57d0-4057-b864-f7b0074a41c3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:32.520310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9a0b92e-57d0-4057-b864-f7b0074a41c3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:32.521035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9a0b92e-57d0-4057-b864-f7b0074a41c3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:32.521641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9a0b92e-57d0-4057-b864-f7b0074a41c3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:32.791309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-da8c21bd-4711-450b-ac0e-537b43b89e98 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:32.801612 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-da8c21bd-4711-450b-ac0e-537b43b89e98 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1315 microversion: 2.1 time: 0.557987 Oct 11 19:47:32.805713 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 786/1572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:32 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:32.815853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:32.820122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:32.829829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:32.830649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:32.831363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:32.832327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:32.833009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:32.833674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:32.838790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:32.966701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:32.976847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:32.979629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:32.986618 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eefe5daf-ea83-4757-aed9-bb1b22821460 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.179471 Oct 11 19:47:32.998607 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 787/1573] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:32 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:33.005233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-502645827", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "12e7d5a8-d39a-440c-a1be-ed5e1c015008"}], "block_device_mapping_v2": [{"uuid": "e761b1ce-a96e-4ca3-aafd-e1c67305c450", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:33.090299 n-d-860864-3 devstack@n-api.service[126955]: Exception ignored in: . at 0x7f83d06faca0> Oct 11 19:47:33.090299 n-d-860864-3 devstack@n-api.service[126955]: Traceback (most recent call last): Oct 11 19:47:33.090299 n-d-860864-3 devstack@n-api.service[126955]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 11 19:47:33.097321 n-d-860864-3 devstack@n-api.service[126955]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 11 19:47:33.097753 n-d-860864-3 devstack@n-api.service[126955]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 11 19:47:33.098323 n-d-860864-3 devstack@n-api.service[126955]: connection_record.checkin() Oct 11 19:47:33.098511 n-d-860864-3 devstack@n-api.service[126955]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 11 19:47:33.099034 n-d-860864-3 devstack@n-api.service[126955]: pool.dispatch.checkin(connection, self) Oct 11 19:47:33.099034 n-d-860864-3 devstack@n-api.service[126955]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 11 19:47:33.103671 n-d-860864-3 devstack@n-api.service[126955]: fn(*args, **kw) Oct 11 19:47:33.103671 n-d-860864-3 devstack@n-api.service[126955]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 11 19:47:33.109330 n-d-860864-3 devstack@n-api.service[126955]: time.sleep(0) Oct 11 19:47:33.109330 n-d-860864-3 devstack@n-api.service[126955]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 11 19:47:33.113006 n-d-860864-3 devstack@n-api.service[126955]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 11 19:47:33.113006 n-d-860864-3 devstack@n-api.service[126955]: AssertionError: do not call blocking functions from the mainloop Oct 11 19:47:33.116271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] validate_networks() for [('12e7d5a8-d39a-440c-a1be-ed5e1c015008', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:47:33.148223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f9a0b92e-57d0-4057-b864-f7b0074a41c3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:33.157322 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f9a0b92e-57d0-4057-b864-f7b0074a41c3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.650989 Oct 11 19:47:33.157917 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 787/1574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:32 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:33.268035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54bb2605-04ea-469d-bbc7-012115d203c0 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:33.268664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-54bb2605-04ea-469d-bbc7-012115d203c0 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:33.275819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bb2605-04ea-469d-bbc7-012115d203c0 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:33.276324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bb2605-04ea-469d-bbc7-012115d203c0 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:33.277161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bb2605-04ea-469d-bbc7-012115d203c0 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:33.277978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bb2605-04ea-469d-bbc7-012115d203c0 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:33.278468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bb2605-04ea-469d-bbc7-012115d203c0 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:33.278951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bb2605-04ea-469d-bbc7-012115d203c0 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:33.652392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:33.859116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54bb2605-04ea-469d-bbc7-012115d203c0 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:33.871787 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-54bb2605-04ea-469d-bbc7-012115d203c0 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1528 microversion: 2.1 time: 0.607441 Oct 11 19:47:33.872877 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 788/1575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:33 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1528 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:34.190303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9fbd9ff1-9283-4772-9bae-3997a27256a5 req-5b05625d-d011-4812-8fdf-2afff74bb4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff982cd-411a-407e-8fd9-070fd3c3a298", "tag": "f77564c3-0ed5-4ee8-9f38-ab0b10362082"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:34.211549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9fbd9ff1-9283-4772-9bae-3997a27256a5 req-5b05625d-d011-4812-8fdf-2afff74bb4ac service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:34.226590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9fbd9ff1-9283-4772-9bae-3997a27256a5 req-5b05625d-d011-4812-8fdf-2afff74bb4ac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:34.227442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9fbd9ff1-9283-4772-9bae-3997a27256a5 req-5b05625d-d011-4812-8fdf-2afff74bb4ac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:34.258992 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9fbd9ff1-9283-4772-9bae-3997a27256a5 req-5b05625d-d011-4812-8fdf-2afff74bb4ac service nova] Creating event network-changed:f77564c3-0ed5-4ee8-9f38-ab0b10362082 for instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 on n-h2-860864-3 Oct 11 19:47:34.267674 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9fbd9ff1-9283-4772-9bae-3997a27256a5 req-5b05625d-d011-4812-8fdf-2afff74bb4ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393348 Oct 11 19:47:34.273749 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 789/1576] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:34.284006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:34.285083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:34.301082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:34.310901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:34.311771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:34.312454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:34.313899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:34.317385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:34.317970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:34.827840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:34.840097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:47:34.840790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:47:34.841282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:47:34.841770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:47:34.842194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:47:34.847200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:34.858188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:34.858718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:34.859155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:34.862549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:34.863029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:34.863474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:34.870836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:34.874124 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bfab2ccf-bad6-4936-88d0-be1d57305b20 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.598717 Oct 11 19:47:34.886126 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 790/1577] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:34 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:34.909448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fb727633-fa9e-4099-a892-35114882ca86 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:34.910286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fb727633-fa9e-4099-a892-35114882ca86 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:34.915594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Getting quotas for project 947af1a9d24f4e19a59ec820ba1a65e4. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:47:34.930425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb727633-fa9e-4099-a892-35114882ca86 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:34.931246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb727633-fa9e-4099-a892-35114882ca86 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:34.931854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb727633-fa9e-4099-a892-35114882ca86 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:34.932205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Getting quotas for user 4e2460b9a8f34662b802709a91907510 and project 947af1a9d24f4e19a59ec820ba1a65e4. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:47:34.932962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb727633-fa9e-4099-a892-35114882ca86 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:34.933593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb727633-fa9e-4099-a892-35114882ca86 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:34.934188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb727633-fa9e-4099-a892-35114882ca86 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:35.049031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:47:35.051309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e761b1ce-a96e-4ca3-aafd-e1c67305c450',volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:47:35.271227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fb727633-fa9e-4099-a892-35114882ca86 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:35.295937 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fb727633-fa9e-4099-a892-35114882ca86 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1315 microversion: 2.1 time: 0.393690 Oct 11 19:47:35.310553 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 791/1578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:34 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:35.312978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-556cadd4-54b4-439a-9699-41c21df18a83 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:35.313830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-556cadd4-54b4-439a-9699-41c21df18a83 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:35.331576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-556cadd4-54b4-439a-9699-41c21df18a83 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:35.332256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-556cadd4-54b4-439a-9699-41c21df18a83 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:35.332881 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-55638ef0-311c-43da-9265-1e77e54d594d tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.331409 Oct 11 19:47:35.333552 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 788/1579] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:47:35.339464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-556cadd4-54b4-439a-9699-41c21df18a83 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:35.341151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-556cadd4-54b4-439a-9699-41c21df18a83 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:35.341642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-556cadd4-54b4-439a-9699-41c21df18a83 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:35.342101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-556cadd4-54b4-439a-9699-41c21df18a83 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:35.347281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:35.347900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:35.364610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:35.365419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:35.366170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:35.367141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:35.372126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:35.372769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:35.555812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:35.572672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:35.577302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:35.590825 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1aa2568f-83cf-416d-907b-7f23be3021e6 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.252552 Oct 11 19:47:35.593667 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 789/1580] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:35 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:35.603195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-286eae0f-e259-4442-9c6a-397db89ceaa0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:35.604068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-286eae0f-e259-4442-9c6a-397db89ceaa0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:35.615458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-286eae0f-e259-4442-9c6a-397db89ceaa0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:35.616851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-286eae0f-e259-4442-9c6a-397db89ceaa0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:35.622124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-286eae0f-e259-4442-9c6a-397db89ceaa0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:35.634627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-286eae0f-e259-4442-9c6a-397db89ceaa0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:35.637435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-286eae0f-e259-4442-9c6a-397db89ceaa0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:35.638775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-286eae0f-e259-4442-9c6a-397db89ceaa0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:36.030475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-556cadd4-54b4-439a-9699-41c21df18a83 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:36.044774 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-556cadd4-54b4-439a-9699-41c21df18a83 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1528 microversion: 2.1 time: 0.742790 Oct 11 19:47:36.048212 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 792/1581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:35 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1528 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:36.059572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-5175a6ec-d5f2-422a-a752-101e9c012343 req-d621334f-bc8f-4128-a964-907f25905552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffb0124-9fa9-4a38-ad03-7fece0c780fe", "name": "network-vif-plugged", "status": "completed", "tag": "7686bb0d-edf8-44e5-bb28-774c272e3719"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:36.079216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5175a6ec-d5f2-422a-a752-101e9c012343 req-d621334f-bc8f-4128-a964-907f25905552 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:36.079872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5175a6ec-d5f2-422a-a752-101e9c012343 req-d621334f-bc8f-4128-a964-907f25905552 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:36.080217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5175a6ec-d5f2-422a-a752-101e9c012343 req-d621334f-bc8f-4128-a964-907f25905552 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:36.120057 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-5175a6ec-d5f2-422a-a752-101e9c012343 req-d621334f-bc8f-4128-a964-907f25905552 service nova] Creating event network-vif-plugged:7686bb0d-edf8-44e5-bb28-774c272e3719 for instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe on n-h1-860864-3 Oct 11 19:47:36.129666 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-5175a6ec-d5f2-422a-a752-101e9c012343 req-d621334f-bc8f-4128-a964-907f25905552 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080484 Oct 11 19:47:36.130322 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 793/1582] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:36.136874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cc7ffc8b-bbb4-428a-8427-f05f786c4bb0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:36.143206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cc7ffc8b-bbb4-428a-8427-f05f786c4bb0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:36.377801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cc7ffc8b-bbb4-428a-8427-f05f786c4bb0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:36.389835 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cc7ffc8b-bbb4-428a-8427-f05f786c4bb0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1052 microversion: 2.1 time: 0.258131 Oct 11 19:47:36.402549 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 794/1583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:36 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1052 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:36.404065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:36.404733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:36.421130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:36.422867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:36.425940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:36.426916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:36.429966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:36.430639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:36.469570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-286eae0f-e259-4442-9c6a-397db89ceaa0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:36.487815 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-286eae0f-e259-4442-9c6a-397db89ceaa0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.883246 Oct 11 19:47:36.491746 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 790/1584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:35 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:36.504666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c9f363d-06ff-400a-b962-39635aba3614 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:36.532522 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6c9f363d-06ff-400a-b962-39635aba3614 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] HTTP exception thrown: Flavor a16441dd-a497-462e-a030-05fdadab9305 could not be found. Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c9f363d-06ff-400a-b962-39635aba3614 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Request method failure captured: Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/flavors/a16441dd-a497-462e-a030-05fdadab9305 HTTP/1.1 Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdkBwGv_JL9Ih01i_wlfhdmaIGbjvkaCFsPHyIHA-TbGpOR4HrivRpS8eAGiQHcLepTvSwtwzw8Cpk88m2cmVC24hmr-CMlr_fssKI7-MzWKMiCA1w5j-CFzOBpLaiNPYWaiM0IYAqc6tehw1_kvMDRXeCzVnQXPlu8lIoSZC1figY Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 69937da30873420eae45ebcc276a3501 Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-MigrationsAdminTest-2138859350 Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69937da30873420eae45ebcc276a3501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69937da30873420eae45ebcc276a3501", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69937da30873420eae45ebcc276a3501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69937da30873420eae45ebcc276a3501"}]}] Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-MigrationsAdminTest-2138859350 Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 69937da30873420eae45ebcc276a3501 Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-MigrationsAdminTest-2138859350 Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-MigrationsAdminTest-2138859350-project-admin Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: c8cff5826fdb465489829b5e796836a5 Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-MigrationsAdminTest-2138859350-project-admin Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: exception: Flavor a16441dd-a497-462e-a030-05fdadab9305 could not be found. Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a16441dd-a497-462e-a030-05fdadab9305'} Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor a16441dd-a497-462e-a030-05fdadab9305 could not be found. Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor a16441dd-a497-462e-a030-05fdadab9305 could not be found. Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:36.542110 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:36.547266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:36.547266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:36.547266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:36.547266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:36.547266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:36.547266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:36.547266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor a16441dd-a497-462e-a030-05fdadab9305 could not be found. Oct 11 19:47:36.547266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:36.551306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c9f363d-06ff-400a-b962-39635aba3614 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Returning 404 to user: Flavor a16441dd-a497-462e-a030-05fdadab9305 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:36.552597 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c9f363d-06ff-400a-b962-39635aba3614 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/a16441dd-a497-462e-a030-05fdadab9305" status: 404 len: 109 microversion: 2.1 time: 0.055007 Oct 11 19:47:36.554308 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 791/1585] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:47:36 2022] DELETE /compute/v2.1/flavors/a16441dd-a497-462e-a030-05fdadab9305 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:36.566706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-46afa927-3285-46cf-88b7-c58b2a8f909d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:36.569926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-46afa927-3285-46cf-88b7-c58b2a8f909d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:36.588139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:36.593478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46afa927-3285-46cf-88b7-c58b2a8f909d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:36.594979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46afa927-3285-46cf-88b7-c58b2a8f909d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:36.595783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46afa927-3285-46cf-88b7-c58b2a8f909d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:36.596802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46afa927-3285-46cf-88b7-c58b2a8f909d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:36.597602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46afa927-3285-46cf-88b7-c58b2a8f909d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:36.598478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46afa927-3285-46cf-88b7-c58b2a8f909d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:37.195861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:37.205461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:37.206929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:37.215332 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-22d300be-0ce7-4174-91de-cd1f9b998cb1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.820532 Oct 11 19:47:37.218198 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 795/1586] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:36 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:37.237129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:37.237987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:37.248504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:37.249148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:37.250845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:37.251821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:37.255506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:37.256165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:37.409132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-46afa927-3285-46cf-88b7-c58b2a8f909d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:37.431231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:37.436413 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-46afa927-3285-46cf-88b7-c58b2a8f909d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1315 microversion: 2.1 time: 0.880601 Oct 11 19:47:37.440151 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 792/1587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:36 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1315 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:37.456339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:37.459072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-330105084", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:37.459305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:37.471555 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c7034c6e-f411-4336-93db-6e634f5c0877 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.252013 Oct 11 19:47:37.488277 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 796/1588] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:37 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:37.505112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a538ed7a-a474-4664-acfa-26dae73ee675 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:37.507858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a538ed7a-a474-4664-acfa-26dae73ee675 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:37.520413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a538ed7a-a474-4664-acfa-26dae73ee675 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:37.521162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a538ed7a-a474-4664-acfa-26dae73ee675 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:37.521912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a538ed7a-a474-4664-acfa-26dae73ee675 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:37.525015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a538ed7a-a474-4664-acfa-26dae73ee675 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:37.525720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a538ed7a-a474-4664-acfa-26dae73ee675 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:37.526157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a538ed7a-a474-4664-acfa-26dae73ee675 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:37.537102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:37.542838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:47:37.963436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a538ed7a-a474-4664-acfa-26dae73ee675 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:37.971748 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a538ed7a-a474-4664-acfa-26dae73ee675 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1150 microversion: 2.1 time: 0.480738 Oct 11 19:47:37.977357 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 797/1589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:37 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1150 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:37.984456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-12ff3ad6-d888-41c7-b25a-1ebe815b22a4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:37.984927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-12ff3ad6-d888-41c7-b25a-1ebe815b22a4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:38.007366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12ff3ad6-d888-41c7-b25a-1ebe815b22a4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:38.008528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12ff3ad6-d888-41c7-b25a-1ebe815b22a4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:38.009340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12ff3ad6-d888-41c7-b25a-1ebe815b22a4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:38.012996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12ff3ad6-d888-41c7-b25a-1ebe815b22a4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:38.013490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12ff3ad6-d888-41c7-b25a-1ebe815b22a4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:38.015005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12ff3ad6-d888-41c7-b25a-1ebe815b22a4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:38.318212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-12ff3ad6-d888-41c7-b25a-1ebe815b22a4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:38.330074 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-12ff3ad6-d888-41c7-b25a-1ebe815b22a4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.350991 Oct 11 19:47:38.330703 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 798/1590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:37 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:38.352611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:38.353250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:38.367911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:38.368421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:38.370568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:38.371337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:38.371923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:38.372561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:38.544121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:47:38.545086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:47:38.545767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:47:38.546363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:47:38.547131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:47:38.565904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:38.570232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:38.570936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:38.571961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:38.572623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:38.573242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:38.615371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for project 33b91a834ad24c82805880555930825d. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:47:38.626206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Getting quotas for user 5c26541efd824c5ab866c2891adcd748 and project 33b91a834ad24c82805880555930825d. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:47:38.641555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:47:38.644145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:47:38.708447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:38.722647 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58b204bd-4554-41aa-a42b-eddac3fb24ec tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.276370 Oct 11 19:47:38.723899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:38.725647 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 793/1591] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:47:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:47:38.728837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:38.732356 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f1b0687-72ce-4460-995d-ef02b7c126c5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.387798 Oct 11 19:47:38.734990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e6b8d88e-9b2a-4499-87b0-af9ebc26b1b7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:38.736169 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 799/1592] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:38 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:38.738750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e6b8d88e-9b2a-4499-87b0-af9ebc26b1b7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:38.745371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:38.746302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:38.746915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6b8d88e-9b2a-4499-87b0-af9ebc26b1b7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:38.747684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6b8d88e-9b2a-4499-87b0-af9ebc26b1b7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:38.748560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6b8d88e-9b2a-4499-87b0-af9ebc26b1b7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:38.749604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6b8d88e-9b2a-4499-87b0-af9ebc26b1b7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:38.750173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6b8d88e-9b2a-4499-87b0-af9ebc26b1b7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:38.751022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6b8d88e-9b2a-4499-87b0-af9ebc26b1b7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:38.755337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:38.755895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:38.756476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:38.757316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:38.758012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:38.758629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:38.974272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:39.008667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:39.012739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e6b8d88e-9b2a-4499-87b0-af9ebc26b1b7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:39.023208 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e6b8d88e-9b2a-4499-87b0-af9ebc26b1b7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1315 microversion: 2.1 time: 0.296152 Oct 11 19:47:39.027949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:39.030231 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 794/1593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:38 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:39.045140 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4bf03724-57e1-4ba8-a604-4e1e072b4c16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.307665 Oct 11 19:47:39.052661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dce4b7b1-b459-4f49-ac05-26df22898507 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:39.053481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dce4b7b1-b459-4f49-ac05-26df22898507 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:39.055255 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 800/1594] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:38 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:39.067207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee95be8c-2ca8-4a68-8067-78a721a15459 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:39.067763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ee95be8c-2ca8-4a68-8067-78a721a15459 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:39.085008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee95be8c-2ca8-4a68-8067-78a721a15459 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:39.085443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee95be8c-2ca8-4a68-8067-78a721a15459 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:39.085879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee95be8c-2ca8-4a68-8067-78a721a15459 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:39.086637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee95be8c-2ca8-4a68-8067-78a721a15459 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:39.092153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee95be8c-2ca8-4a68-8067-78a721a15459 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:39.092665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee95be8c-2ca8-4a68-8067-78a721a15459 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:39.158737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dce4b7b1-b459-4f49-ac05-26df22898507 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:39.174339 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dce4b7b1-b459-4f49-ac05-26df22898507 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1212 microversion: 2.1 time: 0.142758 Oct 11 19:47:39.175200 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 795/1595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:39 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1212 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:39.225812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ee95be8c-2ca8-4a68-8067-78a721a15459 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:39.234488 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ee95be8c-2ca8-4a68-8067-78a721a15459 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1168 microversion: 2.1 time: 0.177924 Oct 11 19:47:39.235436 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 801/1596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:39 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1168 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:39.369909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-82ce41ee-d644-4a9e-9806-d097672d70a7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:39.370752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-82ce41ee-d644-4a9e-9806-d097672d70a7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:39.383943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ce41ee-d644-4a9e-9806-d097672d70a7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:39.384541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ce41ee-d644-4a9e-9806-d097672d70a7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:39.386189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ce41ee-d644-4a9e-9806-d097672d70a7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:39.389010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ce41ee-d644-4a9e-9806-d097672d70a7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:39.389561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ce41ee-d644-4a9e-9806-d097672d70a7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:39.392660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82ce41ee-d644-4a9e-9806-d097672d70a7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:39.445306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-471913549", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "44e27f22-3af6-459a-89df-c5d307fd8d8b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:39.516078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] validate_networks() for [('44e27f22-3af6-459a-89df-c5d307fd8d8b', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:47:39.741971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82ce41ee-d644-4a9e-9806-d097672d70a7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:39.756913 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-82ce41ee-d644-4a9e-9806-d097672d70a7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.402920 Oct 11 19:47:39.757846 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 802/1597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:39 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:39.769957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:39.771256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:39.803559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:39.807167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:39.810105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:39.813184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:39.814738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:39.817265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:39.861205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:40.146506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:40.162446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:40.164836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:40.166516 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae2176fc-ef09-4fef-902f-575a758d4819 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.403705 Oct 11 19:47:40.179490 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 803/1598] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:39 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:40.184820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb20ad6e-0c0e-40b1-b4df-864b45276afc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:40.185909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eb20ad6e-0c0e-40b1-b4df-864b45276afc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:40.195829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb20ad6e-0c0e-40b1-b4df-864b45276afc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:40.196251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb20ad6e-0c0e-40b1-b4df-864b45276afc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:40.199402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb20ad6e-0c0e-40b1-b4df-864b45276afc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:40.200698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb20ad6e-0c0e-40b1-b4df-864b45276afc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:40.201251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb20ad6e-0c0e-40b1-b4df-864b45276afc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:40.203659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb20ad6e-0c0e-40b1-b4df-864b45276afc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:40.656109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb20ad6e-0c0e-40b1-b4df-864b45276afc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:40.672415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb20ad6e-0c0e-40b1-b4df-864b45276afc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1315 microversion: 2.1 time: 0.492381 Oct 11 19:47:40.678211 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 804/1599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:40 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:40.683686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:40.684642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:40.702949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:40.708659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:40.709572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:40.710612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:40.711319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:40.712124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:40.832640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:40.842968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:40.847097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:40.860449 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ed4dc82c-5d4a-40a6-85f1-e688e82c5e02 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.180817 Oct 11 19:47:40.880108 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 805/1600] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:40 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:40.885616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ef202195-a902-40e1-a66d-980a5e651efd tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:40.887811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef202195-a902-40e1-a66d-980a5e651efd tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:40.895400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef202195-a902-40e1-a66d-980a5e651efd tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:40.898496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef202195-a902-40e1-a66d-980a5e651efd tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:40.899606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef202195-a902-40e1-a66d-980a5e651efd tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:40.903351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef202195-a902-40e1-a66d-980a5e651efd tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:40.904083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef202195-a902-40e1-a66d-980a5e651efd tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:40.904763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef202195-a902-40e1-a66d-980a5e651efd tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:40.941147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:47:40.941669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:47:40.942129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:47:40.942697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:47:40.943302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:47:40.958867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:40.960562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:40.961491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:40.962460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:40.963107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:40.963764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:41.011076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Getting quotas for project d7be6f749c98452eae3b5367ba1e0568. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:47:41.020936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Getting quotas for user 58152de0760641ac8de26c69ce577ad2 and project d7be6f749c98452eae3b5367ba1e0568. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:47:41.046679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:47:41.049722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:47:41.051967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ef202195-a902-40e1-a66d-980a5e651efd tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:41.067759 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ef202195-a902-40e1-a66d-980a5e651efd tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1264 microversion: 2.1 time: 0.197060 Oct 11 19:47:41.070606 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 806/1601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:40 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:41.091176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b24c232c-e8ee-483e-94e2-26c01fcb18fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:41.092776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b24c232c-e8ee-483e-94e2-26c01fcb18fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:41.112072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b24c232c-e8ee-483e-94e2-26c01fcb18fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:41.114581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b24c232c-e8ee-483e-94e2-26c01fcb18fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:41.115976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b24c232c-e8ee-483e-94e2-26c01fcb18fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:41.117901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b24c232c-e8ee-483e-94e2-26c01fcb18fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:41.123715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b24c232c-e8ee-483e-94e2-26c01fcb18fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:41.125689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b24c232c-e8ee-483e-94e2-26c01fcb18fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:41.161843 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-378acb92-72cf-4db9-b996-f4b4df550c92 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.984935 Oct 11 19:47:41.171490 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 796/1602] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:47:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:47:41.177478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ec967d3-e127-478f-b9bd-3353ee91405c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:41.179171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1ec967d3-e127-478f-b9bd-3353ee91405c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:41.186955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ec967d3-e127-478f-b9bd-3353ee91405c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:41.187705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ec967d3-e127-478f-b9bd-3353ee91405c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:41.188393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ec967d3-e127-478f-b9bd-3353ee91405c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:41.189343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ec967d3-e127-478f-b9bd-3353ee91405c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:41.190031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ec967d3-e127-478f-b9bd-3353ee91405c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:41.191197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ec967d3-e127-478f-b9bd-3353ee91405c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:41.997189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b24c232c-e8ee-483e-94e2-26c01fcb18fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:42.007558 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b24c232c-e8ee-483e-94e2-26c01fcb18fd tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1210 microversion: 2.1 time: 0.933816 Oct 11 19:47:42.015329 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 807/1603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:41 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1210 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:42.032117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c4017619-10b7-4d9c-a94f-95c8c662cf99 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:42.033584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c4017619-10b7-4d9c-a94f-95c8c662cf99 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:42.041230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1ec967d3-e127-478f-b9bd-3353ee91405c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:42.042356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4017619-10b7-4d9c-a94f-95c8c662cf99 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:42.043942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4017619-10b7-4d9c-a94f-95c8c662cf99 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:42.044586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4017619-10b7-4d9c-a94f-95c8c662cf99 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:42.045601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4017619-10b7-4d9c-a94f-95c8c662cf99 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:42.046474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4017619-10b7-4d9c-a94f-95c8c662cf99 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:42.047132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4017619-10b7-4d9c-a94f-95c8c662cf99 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:42.050787 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1ec967d3-e127-478f-b9bd-3353ee91405c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1513 microversion: 2.1 time: 0.877297 Oct 11 19:47:42.055471 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 797/1604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:41 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1513 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:42.072305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:42.073252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:42.089708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:42.090620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:42.091759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:42.093007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:42.093686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:42.094334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:42.207873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c4017619-10b7-4d9c-a94f-95c8c662cf99 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:42.216365 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c4017619-10b7-4d9c-a94f-95c8c662cf99 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1220 microversion: 2.1 time: 0.199306 Oct 11 19:47:42.219028 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 808/1605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:42 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1220 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:42.367478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-bb1a322d-fbe9-470c-83b8-4112a146f8c9 req-1af927ac-d985-4be3-a24a-400ac7df8cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff982cd-411a-407e-8fd9-070fd3c3a298", "name": "network-vif-plugged", "status": "completed", "tag": "f77564c3-0ed5-4ee8-9f38-ab0b10362082"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:42.386345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bb1a322d-fbe9-470c-83b8-4112a146f8c9 req-1af927ac-d985-4be3-a24a-400ac7df8cd3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:42.399183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bb1a322d-fbe9-470c-83b8-4112a146f8c9 req-1af927ac-d985-4be3-a24a-400ac7df8cd3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:42.399683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bb1a322d-fbe9-470c-83b8-4112a146f8c9 req-1af927ac-d985-4be3-a24a-400ac7df8cd3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:42.442305 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bb1a322d-fbe9-470c-83b8-4112a146f8c9 req-1af927ac-d985-4be3-a24a-400ac7df8cd3 service nova] Creating event network-vif-plugged:f77564c3-0ed5-4ee8-9f38-ab0b10362082 for instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 on n-h2-860864-3 Oct 11 19:47:42.465843 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-bb1a322d-fbe9-470c-83b8-4112a146f8c9 req-1af927ac-d985-4be3-a24a-400ac7df8cd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236778 Oct 11 19:47:42.466548 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 809/1606] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:42.482004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c9a7098-a34a-472f-9d01-4e685983a1f9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:42.482796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c9a7098-a34a-472f-9d01-4e685983a1f9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:42.496172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c9a7098-a34a-472f-9d01-4e685983a1f9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:42.498081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c9a7098-a34a-472f-9d01-4e685983a1f9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:42.500475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c9a7098-a34a-472f-9d01-4e685983a1f9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:42.503016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c9a7098-a34a-472f-9d01-4e685983a1f9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:42.503715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c9a7098-a34a-472f-9d01-4e685983a1f9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:42.505551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c9a7098-a34a-472f-9d01-4e685983a1f9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:42.784034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:42.804311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:42.810403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:42.812633 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c767a884-c913-4e9d-89f9-c5edba0b61e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.755877 Oct 11 19:47:42.815659 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 798/1607] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:42 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:42.839387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:42.842353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:42.861249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:42.861775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:42.862225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:42.863293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:42.863756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:42.864191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.055570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:43.077703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:43.097215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c9a7098-a34a-472f-9d01-4e685983a1f9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:43.097807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:43.109044 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c9a7098-a34a-472f-9d01-4e685983a1f9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1315 microversion: 2.1 time: 0.641173 Oct 11 19:47:43.111215 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 810/1608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:42 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:43.126108 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1e89a603-c324-4b51-a342-f7cbd1b0d97e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.296079 Oct 11 19:47:43.126108 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 799/1609] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:42 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:43.135368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-68f6ee76-05e5-4f11-8f0d-0a670ed844a9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:43.135991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-68f6ee76-05e5-4f11-8f0d-0a670ed844a9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:43.139599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6f6d83dc-2674-4320-b92a-44e9461c4717 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:43.140717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6f6d83dc-2674-4320-b92a-44e9461c4717 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:43.152032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f6ee76-05e5-4f11-8f0d-0a670ed844a9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.154542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f6ee76-05e5-4f11-8f0d-0a670ed844a9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.156899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f6ee76-05e5-4f11-8f0d-0a670ed844a9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.158855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f6ee76-05e5-4f11-8f0d-0a670ed844a9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.159292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6d83dc-2674-4320-b92a-44e9461c4717 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.159410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f6ee76-05e5-4f11-8f0d-0a670ed844a9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.160050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6d83dc-2674-4320-b92a-44e9461c4717 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.161188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68f6ee76-05e5-4f11-8f0d-0a670ed844a9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.161894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6d83dc-2674-4320-b92a-44e9461c4717 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.163595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6d83dc-2674-4320-b92a-44e9461c4717 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.164234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6d83dc-2674-4320-b92a-44e9461c4717 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.165769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6d83dc-2674-4320-b92a-44e9461c4717 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.374906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68f6ee76-05e5-4f11-8f0d-0a670ed844a9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:43.383340 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-68f6ee76-05e5-4f11-8f0d-0a670ed844a9 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1270 microversion: 2.1 time: 0.261839 Oct 11 19:47:43.391069 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 800/1610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:43 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1270 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:43.396985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2d6772ef-c07b-45ac-b2ab-0edb319a7f1e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:43.401053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2d6772ef-c07b-45ac-b2ab-0edb319a7f1e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:43.415424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d6772ef-c07b-45ac-b2ab-0edb319a7f1e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.416360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d6772ef-c07b-45ac-b2ab-0edb319a7f1e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.417232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d6772ef-c07b-45ac-b2ab-0edb319a7f1e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.418175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d6772ef-c07b-45ac-b2ab-0edb319a7f1e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.418927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d6772ef-c07b-45ac-b2ab-0edb319a7f1e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.419983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d6772ef-c07b-45ac-b2ab-0edb319a7f1e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.469734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6f6d83dc-2674-4320-b92a-44e9461c4717 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:43.484051 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6f6d83dc-2674-4320-b92a-44e9461c4717 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1210 microversion: 2.1 time: 0.350370 Oct 11 19:47:43.485256 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 811/1611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:43 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1210 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:43.499880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f28f0e43-e3b4-4185-99ad-6eb1d9c97732 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:43.500978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f28f0e43-e3b4-4185-99ad-6eb1d9c97732 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:43.510691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f28f0e43-e3b4-4185-99ad-6eb1d9c97732 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.511504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f28f0e43-e3b4-4185-99ad-6eb1d9c97732 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.513021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f28f0e43-e3b4-4185-99ad-6eb1d9c97732 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.514401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f28f0e43-e3b4-4185-99ad-6eb1d9c97732 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.516480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f28f0e43-e3b4-4185-99ad-6eb1d9c97732 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.522580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f28f0e43-e3b4-4185-99ad-6eb1d9c97732 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.704610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f28f0e43-e3b4-4185-99ad-6eb1d9c97732 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:43.718266 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f28f0e43-e3b4-4185-99ad-6eb1d9c97732 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1268 microversion: 2.1 time: 0.231690 Oct 11 19:47:43.722673 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 812/1612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:43 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1268 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:43.744316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b1643ed7-b27c-47bc-a76d-3e9400a5d5e8 req-66bc6fb7-9abd-4dfd-9bae-7106dc280e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d", "tag": "469331a7-5446-4a38-be81-b82560e149f6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:43.786558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b1643ed7-b27c-47bc-a76d-3e9400a5d5e8 req-66bc6fb7-9abd-4dfd-9bae-7106dc280e46 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.788302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b1643ed7-b27c-47bc-a76d-3e9400a5d5e8 req-66bc6fb7-9abd-4dfd-9bae-7106dc280e46 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.788449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b1643ed7-b27c-47bc-a76d-3e9400a5d5e8 req-66bc6fb7-9abd-4dfd-9bae-7106dc280e46 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.859175 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b1643ed7-b27c-47bc-a76d-3e9400a5d5e8 req-66bc6fb7-9abd-4dfd-9bae-7106dc280e46 service nova] Creating event network-changed:469331a7-5446-4a38-be81-b82560e149f6 for instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d on n-h1-860864-3 Oct 11 19:47:43.881752 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b1643ed7-b27c-47bc-a76d-3e9400a5d5e8 req-66bc6fb7-9abd-4dfd-9bae-7106dc280e46 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157716 Oct 11 19:47:43.889459 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 813/1613] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:43.907069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:43.907796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:43.929955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.933353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.934950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:43.938443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:43.940448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:43.942432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:44.492922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2d6772ef-c07b-45ac-b2ab-0edb319a7f1e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:44.513544 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2d6772ef-c07b-45ac-b2ab-0edb319a7f1e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1519 microversion: 2.1 time: 1.110138 Oct 11 19:47:44.519551 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 801/1614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:43 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1519 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:44.537131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aa0ef2e6-f2fb-4bb3-ae64-7869ba7008f5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:44.538368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aa0ef2e6-f2fb-4bb3-ae64-7869ba7008f5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:44.565638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa0ef2e6-f2fb-4bb3-ae64-7869ba7008f5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:44.566351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa0ef2e6-f2fb-4bb3-ae64-7869ba7008f5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:44.566906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa0ef2e6-f2fb-4bb3-ae64-7869ba7008f5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:44.568179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa0ef2e6-f2fb-4bb3-ae64-7869ba7008f5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:44.570875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa0ef2e6-f2fb-4bb3-ae64-7869ba7008f5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:44.573314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa0ef2e6-f2fb-4bb3-ae64-7869ba7008f5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:44.780547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:44.793539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:44.796987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:44.800860 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-14ef93bd-d8f8-426b-be2a-3030b3a4a0b1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.910012 Oct 11 19:47:44.803595 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 814/1615] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:43 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:44.815183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:44.819412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:44.832932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:44.839135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:44.839870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:44.841397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:44.842175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:44.842834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:44.848320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:44.991329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:45.003268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:45.010773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:45.026836 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-80b8914a-c9cc-49c4-8f88-b61ea8eae6cf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.214253 Oct 11 19:47:45.028154 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 815/1616] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:44 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:45.044117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-18421db5-3140-4b78-83fe-f07bc419a6f2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:45.045238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-18421db5-3140-4b78-83fe-f07bc419a6f2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:45.072522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18421db5-3140-4b78-83fe-f07bc419a6f2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:45.073270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18421db5-3140-4b78-83fe-f07bc419a6f2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:45.074177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18421db5-3140-4b78-83fe-f07bc419a6f2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:45.075153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18421db5-3140-4b78-83fe-f07bc419a6f2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:45.075772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18421db5-3140-4b78-83fe-f07bc419a6f2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:45.077033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18421db5-3140-4b78-83fe-f07bc419a6f2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:45.646110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aa0ef2e6-f2fb-4bb3-ae64-7869ba7008f5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:45.663375 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aa0ef2e6-f2fb-4bb3-ae64-7869ba7008f5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1315 microversion: 2.1 time: 1.142223 Oct 11 19:47:45.667962 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 802/1617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:44 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1315 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:45.697813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-965d6a6d-e788-4231-8778-1630ed3c2f2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:45.699451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-965d6a6d-e788-4231-8778-1630ed3c2f2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:45.723285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-965d6a6d-e788-4231-8778-1630ed3c2f2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:45.724033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-965d6a6d-e788-4231-8778-1630ed3c2f2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:45.725196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-965d6a6d-e788-4231-8778-1630ed3c2f2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:45.727261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-965d6a6d-e788-4231-8778-1630ed3c2f2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:45.731478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-965d6a6d-e788-4231-8778-1630ed3c2f2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:45.732348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-965d6a6d-e788-4231-8778-1630ed3c2f2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:46.383593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:46.678971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-965d6a6d-e788-4231-8778-1630ed3c2f2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:46.679729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-18421db5-3140-4b78-83fe-f07bc419a6f2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:46.712866 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-18421db5-3140-4b78-83fe-f07bc419a6f2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1312 microversion: 2.1 time: 1.682280 Oct 11 19:47:46.715202 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-965d6a6d-e788-4231-8778-1630ed3c2f2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1210 microversion: 2.1 time: 1.024350 Oct 11 19:47:46.736923 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 816/1618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:45 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1312 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:46.742137 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 803/1619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:45 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1210 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:46.745305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b1bc61ef-41d3-440f-ae40-fed3a1b47399 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:46.746261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b1bc61ef-41d3-440f-ae40-fed3a1b47399 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:46.752567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5905a497-b6ef-49fa-be5d-a8869c1a8fcb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:46.753185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5905a497-b6ef-49fa-be5d-a8869c1a8fcb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:46.757490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1bc61ef-41d3-440f-ae40-fed3a1b47399 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:46.759125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1bc61ef-41d3-440f-ae40-fed3a1b47399 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:46.760394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1bc61ef-41d3-440f-ae40-fed3a1b47399 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:46.761378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1bc61ef-41d3-440f-ae40-fed3a1b47399 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:46.762758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1bc61ef-41d3-440f-ae40-fed3a1b47399 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:46.764914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1bc61ef-41d3-440f-ae40-fed3a1b47399 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:46.789080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5905a497-b6ef-49fa-be5d-a8869c1a8fcb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:46.789577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5905a497-b6ef-49fa-be5d-a8869c1a8fcb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:46.790014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5905a497-b6ef-49fa-be5d-a8869c1a8fcb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:46.796093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5905a497-b6ef-49fa-be5d-a8869c1a8fcb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:46.796796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5905a497-b6ef-49fa-be5d-a8869c1a8fcb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:46.798539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5905a497-b6ef-49fa-be5d-a8869c1a8fcb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:47.178023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b1bc61ef-41d3-440f-ae40-fed3a1b47399 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:47.195448 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b1bc61ef-41d3-440f-ae40-fed3a1b47399 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1316 microversion: 2.1 time: 0.456179 Oct 11 19:47:47.207148 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 817/1620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:46 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:47.207148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6daddd55-48c5-4522-8f72-6e3f12c72ecc req-a10bde02-6931-4bb4-a44d-6257750934db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bf9d5c-d025-4705-828e-4e4e389f5681", "name": "network-vif-unplugged", "status": "completed", "tag": "0d0ecc45-e711-4f9a-870b-ac48a8637962"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:47.224081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6daddd55-48c5-4522-8f72-6e3f12c72ecc req-a10bde02-6931-4bb4-a44d-6257750934db service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:47.225134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6daddd55-48c5-4522-8f72-6e3f12c72ecc req-a10bde02-6931-4bb4-a44d-6257750934db service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:47.225571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6daddd55-48c5-4522-8f72-6e3f12c72ecc req-a10bde02-6931-4bb4-a44d-6257750934db service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:47.238230 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6daddd55-48c5-4522-8f72-6e3f12c72ecc req-a10bde02-6931-4bb4-a44d-6257750934db service nova] Creating event network-vif-unplugged:0d0ecc45-e711-4f9a-870b-ac48a8637962 for instance 72bf9d5c-d025-4705-828e-4e4e389f5681 on n-h1-860864-3 Oct 11 19:47:47.249244 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6daddd55-48c5-4522-8f72-6e3f12c72ecc req-a10bde02-6931-4bb4-a44d-6257750934db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049212 Oct 11 19:47:47.250792 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 818/1621] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:47.260009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5905a497-b6ef-49fa-be5d-a8869c1a8fcb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:47.263064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:47.267421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:47.271996 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5905a497-b6ef-49fa-be5d-a8869c1a8fcb tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1519 microversion: 2.1 time: 0.521153 Oct 11 19:47:47.272623 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 804/1622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:46 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1519 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:47.281728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:47.282224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:47.282692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:47.283396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:47.283850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:47.284270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:47.286060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:47.287237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:47.298056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:47.298575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:47.299015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:47.299717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:47.300170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:47.300591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:47.468531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:47.510179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:47.512071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:47.533609 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-50587836-eb5f-4b63-beb8-db6bc8ddba83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.252055 Oct 11 19:47:47.537288 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 805/1623] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:47 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:47.545848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-39172bc8-6e80-4b98-9adb-4c861ef1abce tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:47.547928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-39172bc8-6e80-4b98-9adb-4c861ef1abce tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:47.561158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39172bc8-6e80-4b98-9adb-4c861ef1abce tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:47.562920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39172bc8-6e80-4b98-9adb-4c861ef1abce tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:47.563617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39172bc8-6e80-4b98-9adb-4c861ef1abce tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:47.564853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39172bc8-6e80-4b98-9adb-4c861ef1abce tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:47.567463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39172bc8-6e80-4b98-9adb-4c861ef1abce tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:47.568016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39172bc8-6e80-4b98-9adb-4c861ef1abce tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:47.726872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:47.741038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:47.742950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:47.746134 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b6cd3695-4324-49a5-97ee-b54d5949f0e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.490373 Oct 11 19:47:47.763521 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 819/1624] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:47 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:47.777262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66a98196-b399-4a50-861f-4db65634e925 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:47.778374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-66a98196-b399-4a50-861f-4db65634e925 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:47.787863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a98196-b399-4a50-861f-4db65634e925 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:47.788701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a98196-b399-4a50-861f-4db65634e925 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:47.789319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a98196-b399-4a50-861f-4db65634e925 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:47.790259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a98196-b399-4a50-861f-4db65634e925 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:47.790915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a98196-b399-4a50-861f-4db65634e925 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:47.791507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a98196-b399-4a50-861f-4db65634e925 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.044403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-39172bc8-6e80-4b98-9adb-4c861ef1abce tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:48.076490 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-39172bc8-6e80-4b98-9adb-4c861ef1abce tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1501 microversion: 2.1 time: 0.524302 Oct 11 19:47:48.107848 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 806/1625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:47 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1501 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:48.127034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b25d2e8-f0dc-4de0-b8e5-fcec52c06908 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:48.128359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7b25d2e8-f0dc-4de0-b8e5-fcec52c06908 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:48.148867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b25d2e8-f0dc-4de0-b8e5-fcec52c06908 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.151128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b25d2e8-f0dc-4de0-b8e5-fcec52c06908 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.152788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b25d2e8-f0dc-4de0-b8e5-fcec52c06908 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.153784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b25d2e8-f0dc-4de0-b8e5-fcec52c06908 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.155549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b25d2e8-f0dc-4de0-b8e5-fcec52c06908 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.156160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b25d2e8-f0dc-4de0-b8e5-fcec52c06908 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.176024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-66a98196-b399-4a50-861f-4db65634e925 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:48.187886 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-66a98196-b399-4a50-861f-4db65634e925 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1312 microversion: 2.1 time: 0.420372 Oct 11 19:47:48.188486 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 820/1626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:47 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1312 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:48.197861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2f14527-8a23-4e8c-b0b7-6490caedd13f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:48.201637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2f14527-8a23-4e8c-b0b7-6490caedd13f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:48.216095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2f14527-8a23-4e8c-b0b7-6490caedd13f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.218028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2f14527-8a23-4e8c-b0b7-6490caedd13f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.219049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2f14527-8a23-4e8c-b0b7-6490caedd13f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.223431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2f14527-8a23-4e8c-b0b7-6490caedd13f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.224882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2f14527-8a23-4e8c-b0b7-6490caedd13f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.225846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2f14527-8a23-4e8c-b0b7-6490caedd13f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.315723 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2f14527-8a23-4e8c-b0b7-6490caedd13f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298/action" status: 202 len: 0 microversion: 2.1 time: 0.124823 Oct 11 19:47:48.317615 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 821/1627] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:47:48 2022] POST /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:47:48.340336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c9b558a8-b324-463b-a304-358ca36e115e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:48.341528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c9b558a8-b324-463b-a304-358ca36e115e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:48.358296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b558a8-b324-463b-a304-358ca36e115e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.368586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b558a8-b324-463b-a304-358ca36e115e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.369657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b558a8-b324-463b-a304-358ca36e115e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.370664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b558a8-b324-463b-a304-358ca36e115e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.371348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b558a8-b324-463b-a304-358ca36e115e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.371939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9b558a8-b324-463b-a304-358ca36e115e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.523832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7b25d2e8-f0dc-4de0-b8e5-fcec52c06908 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:48.526678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:48.542780 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7b25d2e8-f0dc-4de0-b8e5-fcec52c06908 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1198 microversion: 2.1 time: 0.432033 Oct 11 19:47:48.546922 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 807/1628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:48 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1198 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:48.561840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-665e4e4b-d62a-4b7c-b867-7af351429618 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:48.563955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-665e4e4b-d62a-4b7c-b867-7af351429618 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:48.582090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-665e4e4b-d62a-4b7c-b867-7af351429618 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.582553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-665e4e4b-d62a-4b7c-b867-7af351429618 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.583139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-665e4e4b-d62a-4b7c-b867-7af351429618 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.584416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-665e4e4b-d62a-4b7c-b867-7af351429618 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.584886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-665e4e4b-d62a-4b7c-b867-7af351429618 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.585722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-665e4e4b-d62a-4b7c-b867-7af351429618 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.731589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c9b558a8-b324-463b-a304-358ca36e115e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:48.740739 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c9b558a8-b324-463b-a304-358ca36e115e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1316 microversion: 2.1 time: 0.408631 Oct 11 19:47:48.743783 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 822/1629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:48 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:48.754597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bfaca26e-55ff-42a8-aaba-1d954dd51021 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:48.756981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bfaca26e-55ff-42a8-aaba-1d954dd51021 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:48.770711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaca26e-55ff-42a8-aaba-1d954dd51021 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.771585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaca26e-55ff-42a8-aaba-1d954dd51021 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.772210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaca26e-55ff-42a8-aaba-1d954dd51021 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.772919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaca26e-55ff-42a8-aaba-1d954dd51021 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.773374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaca26e-55ff-42a8-aaba-1d954dd51021 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.774208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaca26e-55ff-42a8-aaba-1d954dd51021 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.936609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-665e4e4b-d62a-4b7c-b867-7af351429618 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:48.945827 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-665e4e4b-d62a-4b7c-b867-7af351429618 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1519 microversion: 2.1 time: 0.397317 Oct 11 19:47:48.947015 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 808/1630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:48 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1519 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:48.952094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:48.952972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:48.959415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.960171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.960849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:48.961782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:48.962457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:48.963125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.039225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bfaca26e-55ff-42a8-aaba-1d954dd51021 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:49.056913 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bfaca26e-55ff-42a8-aaba-1d954dd51021 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1486 microversion: 2.1 time: 0.311838 Oct 11 19:47:49.058155 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 823/1631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:48 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1486 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:49.069990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:49.070998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:49.086695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.087906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.088791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.091034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.095683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.098111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.124140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:49.133096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:49.135132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:49.141343 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-17b0c6cd-ccc2-487f-a9d8-009ab4a5d7e7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.193081 Oct 11 19:47:49.142492 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 809/1632] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:48 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:49.148153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f91d32ce-c645-406a-8862-801e615dc821 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:49.148863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f91d32ce-c645-406a-8862-801e615dc821 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:49.175239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f91d32ce-c645-406a-8862-801e615dc821 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.176108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f91d32ce-c645-406a-8862-801e615dc821 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.176729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f91d32ce-c645-406a-8862-801e615dc821 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.180020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f91d32ce-c645-406a-8862-801e615dc821 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.182034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f91d32ce-c645-406a-8862-801e615dc821 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.185651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f91d32ce-c645-406a-8862-801e615dc821 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.231961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f91d32ce-c645-406a-8862-801e615dc821 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:47:49.340078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:49.354356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:49.357669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:49.363702 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8474d9bd-c4ef-4181-bd04-93485e88d429 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.304286 Oct 11 19:47:49.364624 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 824/1633] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:49 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:49.374715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b1a4dd39-0fd5-4a8b-86b4-54d6dc58eed7 req-a75385f0-32b4-42a8-a0bc-3d67ce54b52d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a01c87c3-6ef8-45c0-91bf-c6636c909731", "tag": "689c23c9-50f8-4f32-b0a9-4b20cffbba48"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:49.385204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b1a4dd39-0fd5-4a8b-86b4-54d6dc58eed7 req-a75385f0-32b4-42a8-a0bc-3d67ce54b52d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.386060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b1a4dd39-0fd5-4a8b-86b4-54d6dc58eed7 req-a75385f0-32b4-42a8-a0bc-3d67ce54b52d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.386797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b1a4dd39-0fd5-4a8b-86b4-54d6dc58eed7 req-a75385f0-32b4-42a8-a0bc-3d67ce54b52d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.389444 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f91d32ce-c645-406a-8862-801e615dc821 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 204 len: 0 microversion: 2.1 time: 0.243662 Oct 11 19:47:49.393622 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 810/1634] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:47:49 2022] DELETE /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:47:49.400477 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b1a4dd39-0fd5-4a8b-86b4-54d6dc58eed7 req-a75385f0-32b4-42a8-a0bc-3d67ce54b52d service nova] Creating event network-changed:689c23c9-50f8-4f32-b0a9-4b20cffbba48 for instance a01c87c3-6ef8-45c0-91bf-c6636c909731 on n-h1-860864-3 Oct 11 19:47:49.402921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8677b22b-86fd-4bd1-943e-a2b615ed18d3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:49.405737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8677b22b-86fd-4bd1-943e-a2b615ed18d3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:49.406883 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b1a4dd39-0fd5-4a8b-86b4-54d6dc58eed7 req-a75385f0-32b4-42a8-a0bc-3d67ce54b52d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039969 Oct 11 19:47:49.408314 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 825/1635] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:49.413123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8677b22b-86fd-4bd1-943e-a2b615ed18d3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.413680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8677b22b-86fd-4bd1-943e-a2b615ed18d3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.414983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8677b22b-86fd-4bd1-943e-a2b615ed18d3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.415339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-652ebbf6-964d-4d8d-9c6d-8b303d1af9b9 req-a3ec3bd7-b3af-4621-a05b-9a838569e00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b02ac4-7e82-46ed-b657-ed8e7a88fddc", "tag": "6ff5fc05-e17c-4b5f-969c-e27ed352f61c"}, {"name": "network-changed", "server_uuid": "72bf9d5c-d025-4705-828e-4e4e389f5681", "tag": "0d0ecc45-e711-4f9a-870b-ac48a8637962"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:49.415751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8677b22b-86fd-4bd1-943e-a2b615ed18d3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.416204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8677b22b-86fd-4bd1-943e-a2b615ed18d3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.416783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8677b22b-86fd-4bd1-943e-a2b615ed18d3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.427872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-652ebbf6-964d-4d8d-9c6d-8b303d1af9b9 req-a3ec3bd7-b3af-4621-a05b-9a838569e00f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.428896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-652ebbf6-964d-4d8d-9c6d-8b303d1af9b9 req-a3ec3bd7-b3af-4621-a05b-9a838569e00f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.429561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-652ebbf6-964d-4d8d-9c6d-8b303d1af9b9 req-a3ec3bd7-b3af-4621-a05b-9a838569e00f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.446055 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-652ebbf6-964d-4d8d-9c6d-8b303d1af9b9 req-a3ec3bd7-b3af-4621-a05b-9a838569e00f service nova] Creating event network-changed:6ff5fc05-e17c-4b5f-969c-e27ed352f61c for instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc on n-h2-860864-3 Oct 11 19:47:49.446961 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-652ebbf6-964d-4d8d-9c6d-8b303d1af9b9 req-a3ec3bd7-b3af-4621-a05b-9a838569e00f service nova] Creating event network-changed:0d0ecc45-e711-4f9a-870b-ac48a8637962 for instance 72bf9d5c-d025-4705-828e-4e4e389f5681 on n-h1-860864-3 Oct 11 19:47:49.456450 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-652ebbf6-964d-4d8d-9c6d-8b303d1af9b9 req-a3ec3bd7-b3af-4621-a05b-9a838569e00f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046569 Oct 11 19:47:49.457696 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 826/1636] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:49.465702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-620f455f-88fe-4d43-83fa-8de7b0a040f6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:49.466797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-620f455f-88fe-4d43-83fa-8de7b0a040f6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:49.475278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-620f455f-88fe-4d43-83fa-8de7b0a040f6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.476176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-620f455f-88fe-4d43-83fa-8de7b0a040f6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.477516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-620f455f-88fe-4d43-83fa-8de7b0a040f6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.478519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-620f455f-88fe-4d43-83fa-8de7b0a040f6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.479218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-620f455f-88fe-4d43-83fa-8de7b0a040f6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.480113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-620f455f-88fe-4d43-83fa-8de7b0a040f6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.683324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-620f455f-88fe-4d43-83fa-8de7b0a040f6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:49.692514 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-620f455f-88fe-4d43-83fa-8de7b0a040f6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1492 microversion: 2.1 time: 0.233141 Oct 11 19:47:49.694033 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 827/1637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:49 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1492 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:49.695040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8677b22b-86fd-4bd1-943e-a2b615ed18d3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:49.699628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6d75a66d-3e9a-4f71-8128-21ac531357f0 req-a9bc7355-b20b-4266-9cf5-6ec757df65bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0ed4c2-43b2-4097-853d-fc6d93d63a1d", "name": "network-vif-plugged", "status": "completed", "tag": "61a67b5b-ced0-4c9e-9b0e-636a615fdb5a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:49.713398 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8677b22b-86fd-4bd1-943e-a2b615ed18d3 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1312 microversion: 2.1 time: 0.318401 Oct 11 19:47:49.714204 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 811/1638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:49 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1312 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:49.715249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6d75a66d-3e9a-4f71-8128-21ac531357f0 req-a9bc7355-b20b-4266-9cf5-6ec757df65bc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.715983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6d75a66d-3e9a-4f71-8128-21ac531357f0 req-a9bc7355-b20b-4266-9cf5-6ec757df65bc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.716900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6d75a66d-3e9a-4f71-8128-21ac531357f0 req-a9bc7355-b20b-4266-9cf5-6ec757df65bc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.718752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fb7f7102-367d-4380-baca-6d450dfc8224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:49.719355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fb7f7102-367d-4380-baca-6d450dfc8224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:49.730283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb7f7102-367d-4380-baca-6d450dfc8224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.730894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb7f7102-367d-4380-baca-6d450dfc8224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.731495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb7f7102-367d-4380-baca-6d450dfc8224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.732199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb7f7102-367d-4380-baca-6d450dfc8224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.732675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb7f7102-367d-4380-baca-6d450dfc8224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.733098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb7f7102-367d-4380-baca-6d450dfc8224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.735241 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6d75a66d-3e9a-4f71-8128-21ac531357f0 req-a9bc7355-b20b-4266-9cf5-6ec757df65bc service nova] Creating event network-vif-plugged:61a67b5b-ced0-4c9e-9b0e-636a615fdb5a for instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d on n-h1-860864-3 Oct 11 19:47:49.743124 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6d75a66d-3e9a-4f71-8128-21ac531357f0 req-a9bc7355-b20b-4266-9cf5-6ec757df65bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047466 Oct 11 19:47:49.743925 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 828/1639] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:49.778644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b64bf8bb-a01d-4bc1-8735-1e2698c6f5ab tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:49.779780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b64bf8bb-a01d-4bc1-8735-1e2698c6f5ab tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:49.791609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b64bf8bb-a01d-4bc1-8735-1e2698c6f5ab tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.792438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b64bf8bb-a01d-4bc1-8735-1e2698c6f5ab tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.795301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b64bf8bb-a01d-4bc1-8735-1e2698c6f5ab tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.796275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b64bf8bb-a01d-4bc1-8735-1e2698c6f5ab tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:49.796919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b64bf8bb-a01d-4bc1-8735-1e2698c6f5ab tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:49.797836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b64bf8bb-a01d-4bc1-8735-1e2698c6f5ab tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:49.984974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fb7f7102-367d-4380-baca-6d450dfc8224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:50.002573 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fb7f7102-367d-4380-baca-6d450dfc8224 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1198 microversion: 2.1 time: 0.286946 Oct 11 19:47:50.002768 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 812/1640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:49 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1198 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:50.034832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b08c32e3-a89a-4f03-a01d-4231cb4f8b50 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:50.035936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b08c32e3-a89a-4f03-a01d-4231cb4f8b50 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:50.046471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b08c32e3-a89a-4f03-a01d-4231cb4f8b50 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:50.064522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b08c32e3-a89a-4f03-a01d-4231cb4f8b50 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:50.066066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b08c32e3-a89a-4f03-a01d-4231cb4f8b50 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:50.082963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b08c32e3-a89a-4f03-a01d-4231cb4f8b50 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:50.083359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b08c32e3-a89a-4f03-a01d-4231cb4f8b50 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:50.086614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b08c32e3-a89a-4f03-a01d-4231cb4f8b50 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:50.102191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b64bf8bb-a01d-4bc1-8735-1e2698c6f5ab tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:50.111290 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b64bf8bb-a01d-4bc1-8735-1e2698c6f5ab tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1316 microversion: 2.1 time: 0.346770 Oct 11 19:47:50.112228 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 829/1641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:49 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:50.170845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:50.171829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:50.183845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:50.184612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:50.185336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:50.187571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:50.189740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:50.192336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:50.336531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:50.347647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:50.350114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:50.359689 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eca1f3e2-75d5-4f27-8ee3-1ea1dd891af9 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.193200 Oct 11 19:47:50.360922 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 830/1642] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:50 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:47:50.375225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b08c32e3-a89a-4f03-a01d-4231cb4f8b50 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:50.391560 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b08c32e3-a89a-4f03-a01d-4231cb4f8b50 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1519 microversion: 2.1 time: 0.364645 Oct 11 19:47:50.391773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:50.392269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:50.393152 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 813/1643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:50 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1519 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:50.402910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:50.403518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:50.406006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:50.406847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:50.407385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:50.409046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:50.566427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:50.578869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:50.581058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:50.583186 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7086afb9-926e-480d-93a8-fa164f6cd6ef tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.195634 Oct 11 19:47:50.584921 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 831/1644] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:50 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:47:50.719873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e18d541-5ae2-4223-aff2-1d19a00a5754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:50.721000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e18d541-5ae2-4223-aff2-1d19a00a5754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:50.728167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e18d541-5ae2-4223-aff2-1d19a00a5754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:50.728855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e18d541-5ae2-4223-aff2-1d19a00a5754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:50.729455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e18d541-5ae2-4223-aff2-1d19a00a5754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:50.730322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e18d541-5ae2-4223-aff2-1d19a00a5754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:50.730824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e18d541-5ae2-4223-aff2-1d19a00a5754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:50.731236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e18d541-5ae2-4223-aff2-1d19a00a5754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:50.743723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98e530e4-4dc1-4b83-94f2-ca14f1c98f96 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:50.744550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-98e530e4-4dc1-4b83-94f2-ca14f1c98f96 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:50.755567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98e530e4-4dc1-4b83-94f2-ca14f1c98f96 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:50.763148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98e530e4-4dc1-4b83-94f2-ca14f1c98f96 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:50.763545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98e530e4-4dc1-4b83-94f2-ca14f1c98f96 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:50.764215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98e530e4-4dc1-4b83-94f2-ca14f1c98f96 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:50.764667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98e530e4-4dc1-4b83-94f2-ca14f1c98f96 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:50.765088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98e530e4-4dc1-4b83-94f2-ca14f1c98f96 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:50.989398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=12 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:51.037926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=20 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:51.087597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-98e530e4-4dc1-4b83-94f2-ca14f1c98f96 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:51.096402 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98e530e4-4dc1-4b83-94f2-ca14f1c98f96 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1312 microversion: 2.1 time: 0.359737 Oct 11 19:47:51.099433 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 832/1645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:50 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1312 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:47:51.113306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e18d541-5ae2-4223-aff2-1d19a00a5754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:51.125000 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e18d541-5ae2-4223-aff2-1d19a00a5754 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1492 microversion: 2.1 time: 0.409783 Oct 11 19:47:51.127530 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 814/1646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:50 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1492 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:51.134592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1de6a85a-1bb1-4c1a-bbc1-c8020fbf33bd tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:51.135469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1de6a85a-1bb1-4c1a-bbc1-c8020fbf33bd tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:51.143518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1de6a85a-1bb1-4c1a-bbc1-c8020fbf33bd tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:51.144004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1de6a85a-1bb1-4c1a-bbc1-c8020fbf33bd tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:51.144439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1de6a85a-1bb1-4c1a-bbc1-c8020fbf33bd tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:51.145137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1de6a85a-1bb1-4c1a-bbc1-c8020fbf33bd tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:51.145994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1de6a85a-1bb1-4c1a-bbc1-c8020fbf33bd tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:51.146425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1de6a85a-1bb1-4c1a-bbc1-c8020fbf33bd tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:51.280181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1cedce03-d4fd-4149-a2ce-0e95dc0c58b2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:51.280794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1cedce03-d4fd-4149-a2ce-0e95dc0c58b2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:51.289819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cedce03-d4fd-4149-a2ce-0e95dc0c58b2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:51.291873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cedce03-d4fd-4149-a2ce-0e95dc0c58b2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:51.292840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cedce03-d4fd-4149-a2ce-0e95dc0c58b2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:51.293826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cedce03-d4fd-4149-a2ce-0e95dc0c58b2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:51.295099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cedce03-d4fd-4149-a2ce-0e95dc0c58b2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:51.296695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cedce03-d4fd-4149-a2ce-0e95dc0c58b2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:51.297960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1de6a85a-1bb1-4c1a-bbc1-c8020fbf33bd tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:51.308059 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1de6a85a-1bb1-4c1a-bbc1-c8020fbf33bd tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1316 microversion: 2.1 time: 0.177589 Oct 11 19:47:51.309464 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 815/1647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:51 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:51.328154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:51.392929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:51.394156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:51.422042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:51.424168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:51.425028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:51.426556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:51.427263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:51.427968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:51.539735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:51.548578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:51.550348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:51.560077 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b5954ae-8fc3-4ea1-abb6-f901643df55e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.171291 Oct 11 19:47:51.575039 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 816/1648] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:51 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:51.581933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-effceb6a-4475-4fc4-a9fd-2b9218902d67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:51.583125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-effceb6a-4475-4fc4-a9fd-2b9218902d67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:51.592567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effceb6a-4475-4fc4-a9fd-2b9218902d67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:51.593632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effceb6a-4475-4fc4-a9fd-2b9218902d67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:51.594629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1cedce03-d4fd-4149-a2ce-0e95dc0c58b2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:51.594958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effceb6a-4475-4fc4-a9fd-2b9218902d67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:51.595670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effceb6a-4475-4fc4-a9fd-2b9218902d67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:51.596305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effceb6a-4475-4fc4-a9fd-2b9218902d67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:51.596733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effceb6a-4475-4fc4-a9fd-2b9218902d67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:51.610065 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1cedce03-d4fd-4149-a2ce-0e95dc0c58b2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1198 microversion: 2.1 time: 0.498275 Oct 11 19:47:51.610786 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 833/1649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:51 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1198 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:51.623847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:51.624773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:51.631020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:51.633234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:51.634201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:51.634787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:51.636320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:51.637516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:51.638250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:52.017495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:52.054801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-effceb6a-4475-4fc4-a9fd-2b9218902d67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:52.061274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:52.068849 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-effceb6a-4475-4fc4-a9fd-2b9218902d67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1519 microversion: 2.1 time: 0.490447 Oct 11 19:47:52.070550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:52.074634 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 817/1650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:51 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1519 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:52.087555 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8765d990-051c-4832-9f83-2377680beef8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.475486 Oct 11 19:47:52.093705 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 834/1651] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:51 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:52.127652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a80a77d2-5e63-4928-8b0f-171a97dea485 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:52.128553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a80a77d2-5e63-4928-8b0f-171a97dea485 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:52.141510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a80a77d2-5e63-4928-8b0f-171a97dea485 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:52.147847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a80a77d2-5e63-4928-8b0f-171a97dea485 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:52.148411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a80a77d2-5e63-4928-8b0f-171a97dea485 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:52.149737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a80a77d2-5e63-4928-8b0f-171a97dea485 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:52.151197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e8488c5b-41d9-4ebd-9558-d59eaa4c13aa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:52.151825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e8488c5b-41d9-4ebd-9558-d59eaa4c13aa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:52.152250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a80a77d2-5e63-4928-8b0f-171a97dea485 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:52.155546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a80a77d2-5e63-4928-8b0f-171a97dea485 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:52.161286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8488c5b-41d9-4ebd-9558-d59eaa4c13aa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:52.162202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8488c5b-41d9-4ebd-9558-d59eaa4c13aa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:52.164451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8488c5b-41d9-4ebd-9558-d59eaa4c13aa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:52.165681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8488c5b-41d9-4ebd-9558-d59eaa4c13aa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:52.167821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8488c5b-41d9-4ebd-9558-d59eaa4c13aa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:52.168528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8488c5b-41d9-4ebd-9558-d59eaa4c13aa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:52.855803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a80a77d2-5e63-4928-8b0f-171a97dea485 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:52.865020 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a80a77d2-5e63-4928-8b0f-171a97dea485 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1312 microversion: 2.1 time: 0.743083 Oct 11 19:47:52.866489 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 818/1652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:52 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1312 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:52.874821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0754e7e-6266-4e45-a094-819c7b8696a1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:52.875449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e0754e7e-6266-4e45-a094-819c7b8696a1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:52.885941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0754e7e-6266-4e45-a094-819c7b8696a1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:52.886928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0754e7e-6266-4e45-a094-819c7b8696a1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:52.887541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0754e7e-6266-4e45-a094-819c7b8696a1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:52.888397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0754e7e-6266-4e45-a094-819c7b8696a1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:52.889022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0754e7e-6266-4e45-a094-819c7b8696a1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:52.889699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0754e7e-6266-4e45-a094-819c7b8696a1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:52.939963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e8488c5b-41d9-4ebd-9558-d59eaa4c13aa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:52.950151 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e8488c5b-41d9-4ebd-9558-d59eaa4c13aa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1492 microversion: 2.1 time: 0.802611 Oct 11 19:47:52.972242 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 835/1653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:52 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1492 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:52.984262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:52.985643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:52.997503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:52.998350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:52.999464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:53.000401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:53.002126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:53.002935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:53.149544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:53.166391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:53.170612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:53.186086 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bc6d7806-794f-44de-8060-3147450cc31c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.206894 Oct 11 19:47:53.187173 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 836/1654] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:52 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:53.203040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-916ca446-fb8c-448a-981a-8ffbe800bbad tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:53.203953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-916ca446-fb8c-448a-981a-8ffbe800bbad tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:53.227179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-916ca446-fb8c-448a-981a-8ffbe800bbad tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:53.228170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-916ca446-fb8c-448a-981a-8ffbe800bbad tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:53.229126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-916ca446-fb8c-448a-981a-8ffbe800bbad tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:53.233247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-916ca446-fb8c-448a-981a-8ffbe800bbad tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:53.234076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-916ca446-fb8c-448a-981a-8ffbe800bbad tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:53.235112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-916ca446-fb8c-448a-981a-8ffbe800bbad tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:53.347564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e0754e7e-6266-4e45-a094-819c7b8696a1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:53.361714 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e0754e7e-6266-4e45-a094-819c7b8696a1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1316 microversion: 2.1 time: 0.493344 Oct 11 19:47:53.363740 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 819/1655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:52 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:53.383777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b4033f0e-a808-4426-ba0a-2b9e3fa0c2e3 req-2edcef58-8508-49e8-adef-0816dd2b0dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b02ac4-7e82-46ed-b657-ed8e7a88fddc", "name": "network-vif-plugged", "status": "completed", "tag": "6ff5fc05-e17c-4b5f-969c-e27ed352f61c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:53.397032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:53.399792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b4033f0e-a808-4426-ba0a-2b9e3fa0c2e3 req-2edcef58-8508-49e8-adef-0816dd2b0dc3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:53.400333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b4033f0e-a808-4426-ba0a-2b9e3fa0c2e3 req-2edcef58-8508-49e8-adef-0816dd2b0dc3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:53.400775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b4033f0e-a808-4426-ba0a-2b9e3fa0c2e3 req-2edcef58-8508-49e8-adef-0816dd2b0dc3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:53.418831 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b4033f0e-a808-4426-ba0a-2b9e3fa0c2e3 req-2edcef58-8508-49e8-adef-0816dd2b0dc3 service nova] Creating event network-vif-plugged:6ff5fc05-e17c-4b5f-969c-e27ed352f61c for instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc on n-h2-860864-3 Oct 11 19:47:53.426352 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b4033f0e-a808-4426-ba0a-2b9e3fa0c2e3 req-2edcef58-8508-49e8-adef-0816dd2b0dc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058428 Oct 11 19:47:53.428972 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 820/1656] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:53.437562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e45e4d1e-0213-4c29-9cca-11a231232d76 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:53.438672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e45e4d1e-0213-4c29-9cca-11a231232d76 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:53.449032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e45e4d1e-0213-4c29-9cca-11a231232d76 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:53.449912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e45e4d1e-0213-4c29-9cca-11a231232d76 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:53.450855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e45e4d1e-0213-4c29-9cca-11a231232d76 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:53.452018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e45e4d1e-0213-4c29-9cca-11a231232d76 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:53.453052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e45e4d1e-0213-4c29-9cca-11a231232d76 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:53.453685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e45e4d1e-0213-4c29-9cca-11a231232d76 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.142059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-916ca446-fb8c-448a-981a-8ffbe800bbad tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:54.146202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e45e4d1e-0213-4c29-9cca-11a231232d76 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:54.155006 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e45e4d1e-0213-4c29-9cca-11a231232d76 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1504 microversion: 2.1 time: 0.724327 Oct 11 19:47:54.156478 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-916ca446-fb8c-448a-981a-8ffbe800bbad tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1198 microversion: 2.1 time: 0.967807 Oct 11 19:47:54.157517 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 837/1657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:53 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1198 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:54.166418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:54.167098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:54.175695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:54.176599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:54.178051 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 821/1658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:53 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1504 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:54.178708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.179769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:54.183398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:54.184403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.190069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-521598ec-0bb0-4b13-8bd2-a323ee570f38 req-f888bf09-9c75-4ffc-b540-ace11b0fc914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff982cd-411a-407e-8fd9-070fd3c3a298", "name": "network-vif-deleted", "tag": "f77564c3-0ed5-4ee8-9f38-ab0b10362082"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:54.213247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-521598ec-0bb0-4b13-8bd2-a323ee570f38 req-f888bf09-9c75-4ffc-b540-ace11b0fc914 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:54.219390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-521598ec-0bb0-4b13-8bd2-a323ee570f38 req-f888bf09-9c75-4ffc-b540-ace11b0fc914 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:54.220251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-521598ec-0bb0-4b13-8bd2-a323ee570f38 req-f888bf09-9c75-4ffc-b540-ace11b0fc914 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.240522 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-521598ec-0bb0-4b13-8bd2-a323ee570f38 req-f888bf09-9c75-4ffc-b540-ace11b0fc914 service nova] Creating event network-vif-deleted:f77564c3-0ed5-4ee8-9f38-ab0b10362082 for instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 on n-h2-860864-3 Oct 11 19:47:54.258592 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-521598ec-0bb0-4b13-8bd2-a323ee570f38 req-f888bf09-9c75-4ffc-b540-ace11b0fc914 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072308 Oct 11 19:47:54.260044 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 822/1659] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:54.271306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f185485c-628a-4807-83f7-61db2827c5bc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:54.272049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f185485c-628a-4807-83f7-61db2827c5bc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:54.285612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f185485c-628a-4807-83f7-61db2827c5bc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:54.286099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f185485c-628a-4807-83f7-61db2827c5bc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:54.291357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f185485c-628a-4807-83f7-61db2827c5bc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.292114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f185485c-628a-4807-83f7-61db2827c5bc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:54.292588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f185485c-628a-4807-83f7-61db2827c5bc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:54.293018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f185485c-628a-4807-83f7-61db2827c5bc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.733271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:54.751611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:54.753685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:54.756983 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3909e0a6-0b15-4d4f-a2ce-d890fdc33dac tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.598456 Oct 11 19:47:54.762564 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 838/1660] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:54 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:54.773512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:54.789856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f185485c-628a-4807-83f7-61db2827c5bc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:54.800434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:54.806392 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f185485c-628a-4807-83f7-61db2827c5bc tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1312 microversion: 2.1 time: 0.544901 Oct 11 19:47:54.807776 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 823/1661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:54 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1312 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:54.814937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dfff1777-2037-4371-91c5-637ee6068450 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:54.816089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dfff1777-2037-4371-91c5-637ee6068450 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:54.827119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:54.828266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfff1777-2037-4371-91c5-637ee6068450 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:54.828576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:54.828762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfff1777-2037-4371-91c5-637ee6068450 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:54.829394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.829591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfff1777-2037-4371-91c5-637ee6068450 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.830267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:54.830802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfff1777-2037-4371-91c5-637ee6068450 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:54.830934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:54.831402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.831752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfff1777-2037-4371-91c5-637ee6068450 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:54.832443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfff1777-2037-4371-91c5-637ee6068450 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.837562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:54.877321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:54.879109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:54.879779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:54.888556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lazy-loading 'fault' on Instance uuid 8ff982cd-411a-407e-8fd9-070fd3c3a298 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:47:55.064340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:55.077444 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-666dc406-0c4c-4940-ad52-46cdb1c469b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 200 len: 1305 microversion: 2.1 time: 0.309886 Oct 11 19:47:55.078345 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 839/1662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:54 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 1305 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:55.084551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:55.085175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:55.103142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:55.103651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:55.104086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:55.104801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:55.111041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:55.111725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:55.247716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:55.258843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:55.264688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:55.279237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dfff1777-2037-4371-91c5-637ee6068450 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:55.288285 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dfff1777-2037-4371-91c5-637ee6068450 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 200 len: 1504 microversion: 2.1 time: 0.479185 Oct 11 19:47:55.290988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4602a290-e0a2-49f1-9763-b60adb025e79 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.211452 Oct 11 19:47:55.291800 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 824/1663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:54 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:55.302840 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 840/1664] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:55 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:55.302998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b53aa068-c56c-4bbe-9e03-412dffc880b2 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:55.302998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b53aa068-c56c-4bbe-9e03-412dffc880b2 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:55.315715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b9282cfd-476e-4af3-84eb-730ddb362d9a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:55.315715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b9282cfd-476e-4af3-84eb-730ddb362d9a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:55.320208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9282cfd-476e-4af3-84eb-730ddb362d9a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:55.320794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9282cfd-476e-4af3-84eb-730ddb362d9a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:55.321304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9282cfd-476e-4af3-84eb-730ddb362d9a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:55.322086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9282cfd-476e-4af3-84eb-730ddb362d9a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:55.322425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b53aa068-c56c-4bbe-9e03-412dffc880b2 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:55.322728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9282cfd-476e-4af3-84eb-730ddb362d9a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:55.323915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b53aa068-c56c-4bbe-9e03-412dffc880b2 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:55.324462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9282cfd-476e-4af3-84eb-730ddb362d9a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:55.325121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b53aa068-c56c-4bbe-9e03-412dffc880b2 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:55.326552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b53aa068-c56c-4bbe-9e03-412dffc880b2 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:55.330785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b53aa068-c56c-4bbe-9e03-412dffc880b2 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:55.331522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b53aa068-c56c-4bbe-9e03-412dffc880b2 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:55.737610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b9282cfd-476e-4af3-84eb-730ddb362d9a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:55.753143 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b9282cfd-476e-4af3-84eb-730ddb362d9a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1198 microversion: 2.1 time: 0.457499 Oct 11 19:47:55.754595 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 841/1665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:55 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1198 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:55.757859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b53aa068-c56c-4bbe-9e03-412dffc880b2 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:55.761396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d595265-1a5b-46c5-a5d3-90c8dad8b7d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:55.762102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4d595265-1a5b-46c5-a5d3-90c8dad8b7d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:55.769147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d595265-1a5b-46c5-a5d3-90c8dad8b7d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:55.769821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d595265-1a5b-46c5-a5d3-90c8dad8b7d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:55.770498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d595265-1a5b-46c5-a5d3-90c8dad8b7d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:55.771404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d595265-1a5b-46c5-a5d3-90c8dad8b7d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:55.772334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d595265-1a5b-46c5-a5d3-90c8dad8b7d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:55.772587 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b53aa068-c56c-4bbe-9e03-412dffc880b2 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1316 microversion: 2.1 time: 0.479627 Oct 11 19:47:55.773340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d595265-1a5b-46c5-a5d3-90c8dad8b7d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:55.773559 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 825/1666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:55 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:55.799272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:55.800343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:55.808443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:55.809265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:55.810762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:55.811693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:55.812864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:55.813603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:55.845830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4d595265-1a5b-46c5-a5d3-90c8dad8b7d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:47:56.006096 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4d595265-1a5b-46c5-a5d3-90c8dad8b7d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 204 len: 0 microversion: 2.1 time: 0.249594 Oct 11 19:47:56.011834 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 842/1667] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:47:55 2022] DELETE /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:47:56.027118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b48effe1-da9e-4009-a936-ea98a95931b8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:56.028279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b48effe1-da9e-4009-a936-ea98a95931b8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:56.038446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b48effe1-da9e-4009-a936-ea98a95931b8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:56.039151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b48effe1-da9e-4009-a936-ea98a95931b8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:56.039795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b48effe1-da9e-4009-a936-ea98a95931b8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:56.040872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b48effe1-da9e-4009-a936-ea98a95931b8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:56.042245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b48effe1-da9e-4009-a936-ea98a95931b8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:56.043472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b48effe1-da9e-4009-a936-ea98a95931b8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:56.342983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:56.352975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:56.354937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:56.356798 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ba75c9f7-ce85-423f-ada8-616adc7ad06c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.564815 Oct 11 19:47:56.357541 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 826/1668] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:55 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:47:56.362305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:56.363157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:56.369990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:56.371562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:56.372213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:56.373128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:56.373817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:56.374451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:56.397413 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 HTTP/1.1 Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '8ff982cd-411a-407e-8fd9-070fd3c3a298'} Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:47:56.402260 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:56.408686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:47:56.408686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:47:56.408686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:47:56.408686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:47:56.408686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:47:56.408686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:47:56.408686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:47:56.412612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:47:56.416096 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d507bac7-e6bf-4202-a689-8d990802dbee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 404 len: 111 microversion: 2.1 time: 0.057459 Oct 11 19:47:56.428132 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 827/1669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:56 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:47:56.435392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-110273749", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "412cbda9-d9a6-437a-9a83-87a92464cf0c"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:56.537256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] validate_networks() for [('412cbda9-d9a6-437a-9a83-87a92464cf0c', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:47:56.666468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b48effe1-da9e-4009-a936-ea98a95931b8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:56.680555 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b48effe1-da9e-4009-a936-ea98a95931b8 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1462 microversion: 2.1 time: 0.666019 Oct 11 19:47:56.682105 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 843/1670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:56 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1462 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:56.690354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:56.691927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:56.701736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:56.702837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:56.703698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:56.704730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:56.706451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:56.707164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:56.865601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:56.886101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:56.887917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:56.895878 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cb003309-ad39-433d-8c97-1fff177ddacf tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.212033 Oct 11 19:47:56.897138 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 844/1671] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:56 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:56.902386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-508249781", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "50a85b7f-a8bb-479c-b121-72e05795de50"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:56.991870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] validate_networks() for [('50a85b7f-a8bb-479c-b121-72e05795de50', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:47:57.842652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:47:57.843697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:47:57.844723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:47:57.845358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:47:57.847106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:47:57.882851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:57.884698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:57.886634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:57.887491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:57.887963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:57.890861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:57.922482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Getting quotas for project cd6c2139c019469d8d6a41e036595765. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:47:57.928066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Getting quotas for user add987fef80d49318742f2c38793cf7a and project cd6c2139c019469d8d6a41e036595765. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:47:57.941622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:47:57.944622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:47:58.003585 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8d4e5a7-9189-4db5-bbec-96b7e3874c67 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.572216 Oct 11 19:47:58.004895 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 828/1672] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:47:58.009973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ad1a3ede-aa6e-4935-953e-ca15026d8783 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:58.010669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ad1a3ede-aa6e-4935-953e-ca15026d8783 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:58.019866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad1a3ede-aa6e-4935-953e-ca15026d8783 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:58.020662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad1a3ede-aa6e-4935-953e-ca15026d8783 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:58.021368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad1a3ede-aa6e-4935-953e-ca15026d8783 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:58.022306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad1a3ede-aa6e-4935-953e-ca15026d8783 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:58.023062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad1a3ede-aa6e-4935-953e-ca15026d8783 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:58.024413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad1a3ede-aa6e-4935-953e-ca15026d8783 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:58.351864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:47:58.352328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:47:58.352768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:47:58.353338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:47:58.353820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:47:58.375451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:58.375975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:58.376508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:58.377192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:58.377600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:58.378190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:58.421490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:47:58.437222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for user 8494488a13a3496eb59a8062479816bc and project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:47:58.469817 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ad1a3ede-aa6e-4935-953e-ca15026d8783 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1613 microversion: 2.1 time: 0.462262 Oct 11 19:47:58.472113 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 829/1673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:58 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1613 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:58.496324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:47:58.498353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-961a8303-4ce6-4d6d-a158-d1a835c5292a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:58.499249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-961a8303-4ce6-4d6d-a158-d1a835c5292a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:58.502441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:47:58.524269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961a8303-4ce6-4d6d-a158-d1a835c5292a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:58.525020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961a8303-4ce6-4d6d-a158-d1a835c5292a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:58.525461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961a8303-4ce6-4d6d-a158-d1a835c5292a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:58.526397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961a8303-4ce6-4d6d-a158-d1a835c5292a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:58.526898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961a8303-4ce6-4d6d-a158-d1a835c5292a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:58.527345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961a8303-4ce6-4d6d-a158-d1a835c5292a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:58.600135 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d18e2dc3-fab4-4e18-8556-2fb867edd106 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.701625 Oct 11 19:47:58.601597 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 845/1674] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:47:58.609064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e44fa212-d51c-4d1b-9dbc-7a8dbd7afba6 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:58.609959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e44fa212-d51c-4d1b-9dbc-7a8dbd7afba6 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:58.619416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e44fa212-d51c-4d1b-9dbc-7a8dbd7afba6 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:58.620606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e44fa212-d51c-4d1b-9dbc-7a8dbd7afba6 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:58.621395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e44fa212-d51c-4d1b-9dbc-7a8dbd7afba6 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:58.622734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e44fa212-d51c-4d1b-9dbc-7a8dbd7afba6 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:58.623851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e44fa212-d51c-4d1b-9dbc-7a8dbd7afba6 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:58.624489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e44fa212-d51c-4d1b-9dbc-7a8dbd7afba6 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.100430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-961a8303-4ce6-4d6d-a158-d1a835c5292a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.113031 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-961a8303-4ce6-4d6d-a158-d1a835c5292a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1198 microversion: 2.1 time: 0.639470 Oct 11 19:47:59.136099 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 830/1675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:58 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1198 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:59.136356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e44fa212-d51c-4d1b-9dbc-7a8dbd7afba6 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.145109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:59.147495 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e44fa212-d51c-4d1b-9dbc-7a8dbd7afba6 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1316 microversion: 2.1 time: 0.544361 Oct 11 19:47:59.147973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:59.148621 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 846/1676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:58 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:59.170833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:59.177850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:59.182482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.183081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.183540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.184308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.188556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.189950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.193642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.197297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.197982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.199378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.201635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.202291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.451420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.465858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.470276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.508226 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-af54194f-31de-4e36-8616-2f56600a3e83 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.358172 Oct 11 19:47:59.509411 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 847/1677] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:59 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:59.517414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9dda38de-514d-4316-ad32-9f2868b1401f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:59.518405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9dda38de-514d-4316-ad32-9f2868b1401f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:59.528253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dda38de-514d-4316-ad32-9f2868b1401f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.529082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dda38de-514d-4316-ad32-9f2868b1401f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.530027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dda38de-514d-4316-ad32-9f2868b1401f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.532292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dda38de-514d-4316-ad32-9f2868b1401f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.533113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dda38de-514d-4316-ad32-9f2868b1401f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.534315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dda38de-514d-4316-ad32-9f2868b1401f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.625901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.651501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.654473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.655733 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1b2e6c15-c007-464a-b3ed-f45364e7f87d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.516174 Oct 11 19:47:59.661678 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 831/1678] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:47:59 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:47:59.674398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c6170be9-44e3-4f9c-8014-3a136640d1ca req-26036b45-61ca-4923-ab88-3ee986c9bf83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0ed4c2-43b2-4097-853d-fc6d93d63a1d", "name": "network-vif-deleted", "tag": "61a67b5b-ced0-4c9e-9b0e-636a615fdb5a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:59.702403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c6170be9-44e3-4f9c-8014-3a136640d1ca req-26036b45-61ca-4923-ab88-3ee986c9bf83 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.707092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c6170be9-44e3-4f9c-8014-3a136640d1ca req-26036b45-61ca-4923-ab88-3ee986c9bf83 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.708375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c6170be9-44e3-4f9c-8014-3a136640d1ca req-26036b45-61ca-4923-ab88-3ee986c9bf83 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.720108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9dda38de-514d-4316-ad32-9f2868b1401f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.725933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:47:59.736942 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c6170be9-44e3-4f9c-8014-3a136640d1ca req-26036b45-61ca-4923-ab88-3ee986c9bf83 service nova] Creating event network-vif-deleted:61a67b5b-ced0-4c9e-9b0e-636a615fdb5a for instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d on n-h1-860864-3 Oct 11 19:47:59.737889 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9dda38de-514d-4316-ad32-9f2868b1401f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1269 microversion: 2.1 time: 0.227072 Oct 11 19:47:59.743955 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c6170be9-44e3-4f9c-8014-3a136640d1ca req-26036b45-61ca-4923-ab88-3ee986c9bf83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080545 Oct 11 19:47:59.745633 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 832/1679] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:59.751717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:59.752657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:59.760318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.761027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.761654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.762555 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 848/1680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:59 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1269 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:47:59.762862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.763497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.764093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.768037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-30e61af3-c305-4e61-b396-3572c9e6f850 req-81833171-4bc6-4bd7-a072-e0e2b490f918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d", "name": "network-vif-plugged", "status": "completed", "tag": "469331a7-5446-4a38-be81-b82560e149f6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:47:59.789489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-30e61af3-c305-4e61-b396-3572c9e6f850 req-81833171-4bc6-4bd7-a072-e0e2b490f918 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.789887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-30e61af3-c305-4e61-b396-3572c9e6f850 req-81833171-4bc6-4bd7-a072-e0e2b490f918 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.793313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-30e61af3-c305-4e61-b396-3572c9e6f850 req-81833171-4bc6-4bd7-a072-e0e2b490f918 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.807992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c8cff5826fdb465489829b5e796836a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69937da30873420eae45ebcc276a3501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.809005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] flavor_id is None. Assuming migration. {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 19:47:59.809688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 19:47:59.824050 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-30e61af3-c305-4e61-b396-3572c9e6f850 req-81833171-4bc6-4bd7-a072-e0e2b490f918 service nova] Creating event network-vif-plugged:469331a7-5446-4a38-be81-b82560e149f6 for instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d on n-h1-860864-3 Oct 11 19:47:59.836823 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-30e61af3-c305-4e61-b396-3572c9e6f850 req-81833171-4bc6-4bd7-a072-e0e2b490f918 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068983 Oct 11 19:47:59.840157 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 849/1681] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:47:59.866422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-15da6808-1671-4913-b5e7-513bca2b0f84 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:47:59.868121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-15da6808-1671-4913-b5e7-513bca2b0f84 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:47:59.878593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15da6808-1671-4913-b5e7-513bca2b0f84 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.879098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15da6808-1671-4913-b5e7-513bca2b0f84 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.879537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15da6808-1671-4913-b5e7-513bca2b0f84 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.883802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15da6808-1671-4913-b5e7-513bca2b0f84 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:47:59.885069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15da6808-1671-4913-b5e7-513bca2b0f84 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:47:59.885515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15da6808-1671-4913-b5e7-513bca2b0f84 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:47:59.981661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-15da6808-1671-4913-b5e7-513bca2b0f84 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:47:59.985181 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-30e1ae65-fc38-400e-afa2-c5494f9e1c9b tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc/action" status: 202 len: 0 microversion: 2.1 time: 0.237628 Oct 11 19:47:59.987306 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 833/1682] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:47:59 2022] POST /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:47:59.999772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d120510f-5de7-4446-88bd-7f30a6e6dc40 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:00.000256 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-15da6808-1671-4913-b5e7-513bca2b0f84 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1210 microversion: 2.1 time: 0.158511 Oct 11 19:48:00.000668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d120510f-5de7-4446-88bd-7f30a6e6dc40 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:00.002929 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 850/1683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:59 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1210 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:00.026088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d120510f-5de7-4446-88bd-7f30a6e6dc40 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:00.026990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d120510f-5de7-4446-88bd-7f30a6e6dc40 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:00.027589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d120510f-5de7-4446-88bd-7f30a6e6dc40 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:00.028457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d120510f-5de7-4446-88bd-7f30a6e6dc40 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:00.029387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d120510f-5de7-4446-88bd-7f30a6e6dc40 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:00.029968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d120510f-5de7-4446-88bd-7f30a6e6dc40 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:00.141458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2a51985e-ac03-4cbf-b7d9-b6fbbd355c88 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:00.142717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2a51985e-ac03-4cbf-b7d9-b6fbbd355c88 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:00.153700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a51985e-ac03-4cbf-b7d9-b6fbbd355c88 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:00.155632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a51985e-ac03-4cbf-b7d9-b6fbbd355c88 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:00.158420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a51985e-ac03-4cbf-b7d9-b6fbbd355c88 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:00.159443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a51985e-ac03-4cbf-b7d9-b6fbbd355c88 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:00.160088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a51985e-ac03-4cbf-b7d9-b6fbbd355c88 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:00.160758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a51985e-ac03-4cbf-b7d9-b6fbbd355c88 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:00.492296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d120510f-5de7-4446-88bd-7f30a6e6dc40 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:00.506063 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d120510f-5de7-4446-88bd-7f30a6e6dc40 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1471 microversion: 2.1 time: 0.511734 Oct 11 19:48:00.522782 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 834/1684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:47:59 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1471 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:00.530239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3d88816d-df47-454a-a2b3-a15de8de2a5f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:00.531142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3d88816d-df47-454a-a2b3-a15de8de2a5f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:00.539859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d88816d-df47-454a-a2b3-a15de8de2a5f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:00.545702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d88816d-df47-454a-a2b3-a15de8de2a5f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:00.546565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d88816d-df47-454a-a2b3-a15de8de2a5f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:00.547785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d88816d-df47-454a-a2b3-a15de8de2a5f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:00.548451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d88816d-df47-454a-a2b3-a15de8de2a5f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:00.555920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d88816d-df47-454a-a2b3-a15de8de2a5f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:00.804352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2a51985e-ac03-4cbf-b7d9-b6fbbd355c88 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:00.812991 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2a51985e-ac03-4cbf-b7d9-b6fbbd355c88 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1198 microversion: 2.1 time: 0.676430 Oct 11 19:48:00.827349 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 851/1685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:00 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1198 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:00.837826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:00.838783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:00.845871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:00.846849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:00.847630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:00.849257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:00.850007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:00.850759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:00.982232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:00.983439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3d88816d-df47-454a-a2b3-a15de8de2a5f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:00.992468 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3d88816d-df47-454a-a2b3-a15de8de2a5f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1316 microversion: 2.1 time: 0.467750 Oct 11 19:48:00.995507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:00.996311 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 835/1686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:00 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:01.001589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:01.003840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:01.007766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:01.011046 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5285df5e-152b-4649-ad6c-d7a9df80496b tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1560 microversion: 2.91 time: 0.181587 Oct 11 19:48:01.014784 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 852/1687] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:00 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:01.023611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:01.024409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:01.025050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:01.026104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:01.027646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:01.028154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:01.039556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9d9249ed-6e4f-4e41-a074-c79006c22fac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:01.040171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9d9249ed-6e4f-4e41-a074-c79006c22fac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:01.047306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d9249ed-6e4f-4e41-a074-c79006c22fac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:01.048101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d9249ed-6e4f-4e41-a074-c79006c22fac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:01.048915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d9249ed-6e4f-4e41-a074-c79006c22fac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:01.051082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d9249ed-6e4f-4e41-a074-c79006c22fac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:01.052074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d9249ed-6e4f-4e41-a074-c79006c22fac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:01.052725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d9249ed-6e4f-4e41-a074-c79006c22fac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:01.218965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9d9249ed-6e4f-4e41-a074-c79006c22fac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:01.231527 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9d9249ed-6e4f-4e41-a074-c79006c22fac tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1275 microversion: 2.1 time: 0.196340 Oct 11 19:48:01.248254 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 853/1688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:01 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:01.256081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a8d959d3-6f8e-4b6e-b157-c16d3acfd980 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:01.256993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a8d959d3-6f8e-4b6e-b157-c16d3acfd980 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:01.264560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8d959d3-6f8e-4b6e-b157-c16d3acfd980 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:01.265297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8d959d3-6f8e-4b6e-b157-c16d3acfd980 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:01.265893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8d959d3-6f8e-4b6e-b157-c16d3acfd980 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:01.266884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8d959d3-6f8e-4b6e-b157-c16d3acfd980 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:01.268334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8d959d3-6f8e-4b6e-b157-c16d3acfd980 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:01.268951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8d959d3-6f8e-4b6e-b157-c16d3acfd980 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:01.381512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a8d959d3-6f8e-4b6e-b157-c16d3acfd980 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:01.393549 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a8d959d3-6f8e-4b6e-b157-c16d3acfd980 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1266 microversion: 2.1 time: 0.144092 Oct 11 19:48:01.406887 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 854/1689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:01 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:01.488207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:01.502793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:01.508842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:01.510459 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a2faec2-5229-4a79-a922-66da7dca39b7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1813 microversion: 2.25 time: 0.512992 Oct 11 19:48:01.511298 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 836/1690] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:00 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1813 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:01.530240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-629bf4ed-2179-4f1e-8039-910c17ff4cee tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:01.530893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-629bf4ed-2179-4f1e-8039-910c17ff4cee tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:01.545675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-629bf4ed-2179-4f1e-8039-910c17ff4cee tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:01.548110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-629bf4ed-2179-4f1e-8039-910c17ff4cee tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:01.548747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-629bf4ed-2179-4f1e-8039-910c17ff4cee tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:01.549497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-629bf4ed-2179-4f1e-8039-910c17ff4cee tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:01.549942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-629bf4ed-2179-4f1e-8039-910c17ff4cee tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:01.550463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-629bf4ed-2179-4f1e-8039-910c17ff4cee tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:01.841125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a7806e2-2d88-4fae-adf3-ba314166f8ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:01.841778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a7806e2-2d88-4fae-adf3-ba314166f8ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:01.860652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7806e2-2d88-4fae-adf3-ba314166f8ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:01.861168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7806e2-2d88-4fae-adf3-ba314166f8ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:01.861817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7806e2-2d88-4fae-adf3-ba314166f8ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:01.862751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7806e2-2d88-4fae-adf3-ba314166f8ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:01.863385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7806e2-2d88-4fae-adf3-ba314166f8ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:01.864511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a7806e2-2d88-4fae-adf3-ba314166f8ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:02.453428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-629bf4ed-2179-4f1e-8039-910c17ff4cee tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:02.465181 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-629bf4ed-2179-4f1e-8039-910c17ff4cee tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1471 microversion: 2.1 time: 0.939545 Oct 11 19:48:02.466138 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 855/1691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:01 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1471 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:02.482710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2065b941-ebf9-4797-b518-3ad737bb8956 req-1868264a-63eb-4ef2-b4a4-faf456cd4cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01c87c3-6ef8-45c0-91bf-c6636c909731", "name": "network-vif-plugged", "status": "completed", "tag": "689c23c9-50f8-4f32-b0a9-4b20cffbba48"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:02.514837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2065b941-ebf9-4797-b518-3ad737bb8956 req-1868264a-63eb-4ef2-b4a4-faf456cd4cb7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:02.515331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2065b941-ebf9-4797-b518-3ad737bb8956 req-1868264a-63eb-4ef2-b4a4-faf456cd4cb7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:02.519104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2065b941-ebf9-4797-b518-3ad737bb8956 req-1868264a-63eb-4ef2-b4a4-faf456cd4cb7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:02.561261 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2065b941-ebf9-4797-b518-3ad737bb8956 req-1868264a-63eb-4ef2-b4a4-faf456cd4cb7 service nova] Creating event network-vif-plugged:689c23c9-50f8-4f32-b0a9-4b20cffbba48 for instance a01c87c3-6ef8-45c0-91bf-c6636c909731 on n-h1-860864-3 Oct 11 19:48:02.566944 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2065b941-ebf9-4797-b518-3ad737bb8956 req-1868264a-63eb-4ef2-b4a4-faf456cd4cb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099248 Oct 11 19:48:02.567995 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 856/1692] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:02.585760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-71d5fdbb-7cfd-4b5f-9254-23a33217e11f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:02.587420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-71d5fdbb-7cfd-4b5f-9254-23a33217e11f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:02.628304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71d5fdbb-7cfd-4b5f-9254-23a33217e11f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:02.630581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71d5fdbb-7cfd-4b5f-9254-23a33217e11f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:02.632204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71d5fdbb-7cfd-4b5f-9254-23a33217e11f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:02.633192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71d5fdbb-7cfd-4b5f-9254-23a33217e11f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:02.633838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71d5fdbb-7cfd-4b5f-9254-23a33217e11f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:02.635022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71d5fdbb-7cfd-4b5f-9254-23a33217e11f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:02.798013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a7806e2-2d88-4fae-adf3-ba314166f8ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:02.822570 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a7806e2-2d88-4fae-adf3-ba314166f8ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1198 microversion: 2.1 time: 0.985128 Oct 11 19:48:02.847505 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 837/1693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:01 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1198 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:02.861737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:02.863304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:02.885677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:02.886804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:02.891560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:02.892414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:02.892955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:02.893406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:03.068740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:03.093614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:03.099088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:03.115410 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e5957f27-8912-4462-b131-261ee42149e1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.266479 Oct 11 19:48:03.116603 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 838/1694] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:02 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:03.129137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8d0ffb37-872f-4e00-aab0-89ae7de14e5c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:03.130781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8d0ffb37-872f-4e00-aab0-89ae7de14e5c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:03.142732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d0ffb37-872f-4e00-aab0-89ae7de14e5c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:03.143412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d0ffb37-872f-4e00-aab0-89ae7de14e5c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:03.144018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d0ffb37-872f-4e00-aab0-89ae7de14e5c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:03.144926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d0ffb37-872f-4e00-aab0-89ae7de14e5c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:03.146177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d0ffb37-872f-4e00-aab0-89ae7de14e5c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:03.149310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d0ffb37-872f-4e00-aab0-89ae7de14e5c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:03.284178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8d0ffb37-872f-4e00-aab0-89ae7de14e5c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:03.299568 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8d0ffb37-872f-4e00-aab0-89ae7de14e5c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1275 microversion: 2.1 time: 0.180902 Oct 11 19:48:03.300735 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 839/1695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:03 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:03.343475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-467747f0-7e5f-4007-9f11-4c22f5c05997 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:03.345035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-467747f0-7e5f-4007-9f11-4c22f5c05997 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:03.380191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-467747f0-7e5f-4007-9f11-4c22f5c05997 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:03.381717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-467747f0-7e5f-4007-9f11-4c22f5c05997 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:03.385351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-467747f0-7e5f-4007-9f11-4c22f5c05997 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:03.386918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-467747f0-7e5f-4007-9f11-4c22f5c05997 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:03.387390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-467747f0-7e5f-4007-9f11-4c22f5c05997 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:03.387829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-467747f0-7e5f-4007-9f11-4c22f5c05997 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:03.391894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-71d5fdbb-7cfd-4b5f-9254-23a33217e11f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:03.407799 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-71d5fdbb-7cfd-4b5f-9254-23a33217e11f tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1316 microversion: 2.1 time: 0.838560 Oct 11 19:48:03.408389 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 857/1696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:02 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1316 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:03.413363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:03.417073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:03.437079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:03.437848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:03.438459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:03.439442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:03.441677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:03.442593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:03.745065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-467747f0-7e5f-4007-9f11-4c22f5c05997 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:03.763125 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-467747f0-7e5f-4007-9f11-4c22f5c05997 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1272 microversion: 2.1 time: 0.459503 Oct 11 19:48:03.768095 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 840/1697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:03 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1272 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:03.785401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e9cc3658-a8f2-4a60-9bb4-a8af0d3a7007 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:03.787121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e9cc3658-a8f2-4a60-9bb4-a8af0d3a7007 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:03.821220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9cc3658-a8f2-4a60-9bb4-a8af0d3a7007 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:03.836053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9cc3658-a8f2-4a60-9bb4-a8af0d3a7007 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:03.836950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9cc3658-a8f2-4a60-9bb4-a8af0d3a7007 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:03.839593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9cc3658-a8f2-4a60-9bb4-a8af0d3a7007 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:03.842766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9cc3658-a8f2-4a60-9bb4-a8af0d3a7007 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:03.844783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9cc3658-a8f2-4a60-9bb4-a8af0d3a7007 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:03.851931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:04.702505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:04.719460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:04.721508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:04.729041 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-07f53b60-64e8-4837-bc8e-1654bb655304 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1803 microversion: 2.25 time: 1.317732 Oct 11 19:48:04.731120 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 858/1698] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:03 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1803 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:04.743653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2296fb0-0c6f-43e1-bf13-053fd555704c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:04.746642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2296fb0-0c6f-43e1-bf13-053fd555704c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:04.779818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2296fb0-0c6f-43e1-bf13-053fd555704c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:04.780823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2296fb0-0c6f-43e1-bf13-053fd555704c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:04.781944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2296fb0-0c6f-43e1-bf13-053fd555704c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:04.787875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2296fb0-0c6f-43e1-bf13-053fd555704c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:04.793083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2296fb0-0c6f-43e1-bf13-053fd555704c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:04.795037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2296fb0-0c6f-43e1-bf13-053fd555704c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:04.997435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e9cc3658-a8f2-4a60-9bb4-a8af0d3a7007 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:05.015978 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e9cc3658-a8f2-4a60-9bb4-a8af0d3a7007 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1471 microversion: 2.1 time: 1.246505 Oct 11 19:48:05.032006 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 841/1699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:03 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1471 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:05.044897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:05.046395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:05.060466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:05.061381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:05.062266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:05.063290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:05.063979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:05.064634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:05.304840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:05.341983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:05.344210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:05.374219 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-49c1939f-ab58-4ba7-bff9-df225206316c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.337662 Oct 11 19:48:05.375162 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 842/1700] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:05 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:05.405501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3ae4fc41-2c84-4884-96c2-4e9f73e74928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:05.407247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3ae4fc41-2c84-4884-96c2-4e9f73e74928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:05.431854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ae4fc41-2c84-4884-96c2-4e9f73e74928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:05.433796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ae4fc41-2c84-4884-96c2-4e9f73e74928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:05.436598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ae4fc41-2c84-4884-96c2-4e9f73e74928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:05.437566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ae4fc41-2c84-4884-96c2-4e9f73e74928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:05.438374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ae4fc41-2c84-4884-96c2-4e9f73e74928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:05.439077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ae4fc41-2c84-4884-96c2-4e9f73e74928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:06.034100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a2296fb0-0c6f-43e1-bf13-053fd555704c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:06.061480 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2296fb0-0c6f-43e1-bf13-053fd555704c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1382 microversion: 2.1 time: 1.328987 Oct 11 19:48:06.087007 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 859/1701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:04 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1382 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:06.103383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-29cfa473-afc6-4a31-bfd0-e1d2d74401f4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:06.104158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-29cfa473-afc6-4a31-bfd0-e1d2d74401f4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:06.120300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29cfa473-afc6-4a31-bfd0-e1d2d74401f4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:06.121272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29cfa473-afc6-4a31-bfd0-e1d2d74401f4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:06.121941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29cfa473-afc6-4a31-bfd0-e1d2d74401f4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:06.122932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29cfa473-afc6-4a31-bfd0-e1d2d74401f4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:06.123626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29cfa473-afc6-4a31-bfd0-e1d2d74401f4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:06.124295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29cfa473-afc6-4a31-bfd0-e1d2d74401f4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:06.169025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3ae4fc41-2c84-4884-96c2-4e9f73e74928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:06.181719 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3ae4fc41-2c84-4884-96c2-4e9f73e74928 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1317 microversion: 2.1 time: 0.798386 Oct 11 19:48:06.191358 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 843/1702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:05 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1317 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:06.198975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9752b40b-d992-40d3-88f2-e24da753a2e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '.version_select at 0x7f83d069fee0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:06.225431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9752b40b-d992-40d3-88f2-e24da753a2e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:06.236255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9752b40b-d992-40d3-88f2-e24da753a2e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:06.237591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9752b40b-d992-40d3-88f2-e24da753a2e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:06.266221 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9752b40b-d992-40d3-88f2-e24da753a2e8 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 4470 microversion: 2.25 time: 0.071063 Oct 11 19:48:06.267050 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 844/1703] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Oct 11 19:48:06 2022] GET /compute/v2.1/os-migrations => generated 4470 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:06.286283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8d9a2cb-b987-4981-b154-9135cb1a9f58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:06.287718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c8d9a2cb-b987-4981-b154-9135cb1a9f58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:06.300708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d9a2cb-b987-4981-b154-9135cb1a9f58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:06.318880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d9a2cb-b987-4981-b154-9135cb1a9f58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:06.328367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d9a2cb-b987-4981-b154-9135cb1a9f58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:06.334480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d9a2cb-b987-4981-b154-9135cb1a9f58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:06.338493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d9a2cb-b987-4981-b154-9135cb1a9f58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:06.339249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d9a2cb-b987-4981-b154-9135cb1a9f58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:07.016497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c8d9a2cb-b987-4981-b154-9135cb1a9f58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:07.029492 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8d9a2cb-b987-4981-b154-9135cb1a9f58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1314 microversion: 2.1 time: 0.750963 Oct 11 19:48:07.031682 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 845/1704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:06 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:07.045282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7355fbef-8b52-4e02-9706-6548640563d4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:07.046195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7355fbef-8b52-4e02-9706-6548640563d4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:07.068614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7355fbef-8b52-4e02-9706-6548640563d4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:07.069486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7355fbef-8b52-4e02-9706-6548640563d4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:07.070406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7355fbef-8b52-4e02-9706-6548640563d4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:07.079625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7355fbef-8b52-4e02-9706-6548640563d4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:07.080603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7355fbef-8b52-4e02-9706-6548640563d4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:07.081225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7355fbef-8b52-4e02-9706-6548640563d4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:07.216970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-29cfa473-afc6-4a31-bfd0-e1d2d74401f4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:07.267024 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-29cfa473-afc6-4a31-bfd0-e1d2d74401f4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1504 microversion: 2.1 time: 1.176974 Oct 11 19:48:07.267734 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 860/1705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:06 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1504 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:07.305304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-27b33ffd-63da-4309-aafb-8c722fb08539 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:07.305951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-27b33ffd-63da-4309-aafb-8c722fb08539 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:07.343169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27b33ffd-63da-4309-aafb-8c722fb08539 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:07.356048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27b33ffd-63da-4309-aafb-8c722fb08539 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:07.356697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27b33ffd-63da-4309-aafb-8c722fb08539 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:07.359331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27b33ffd-63da-4309-aafb-8c722fb08539 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:07.359931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27b33ffd-63da-4309-aafb-8c722fb08539 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:07.360476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27b33ffd-63da-4309-aafb-8c722fb08539 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:07.517176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7355fbef-8b52-4e02-9706-6548640563d4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:07.628059 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7355fbef-8b52-4e02-9706-6548640563d4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 0.592899 Oct 11 19:48:07.636443 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 846/1706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:07 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:07.653851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-41c10a02-7cac-4ad1-b9bd-b8db894220a0 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:07.665017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-41c10a02-7cac-4ad1-b9bd-b8db894220a0 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:07.691137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41c10a02-7cac-4ad1-b9bd-b8db894220a0 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:07.701824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41c10a02-7cac-4ad1-b9bd-b8db894220a0 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:07.703397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41c10a02-7cac-4ad1-b9bd-b8db894220a0 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:07.706601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41c10a02-7cac-4ad1-b9bd-b8db894220a0 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:07.710384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41c10a02-7cac-4ad1-b9bd-b8db894220a0 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:07.715313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41c10a02-7cac-4ad1-b9bd-b8db894220a0 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:07.914142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:07.940115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:08.399152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:08.454063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:08.690421 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-27b33ffd-63da-4309-aafb-8c722fb08539 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1533 microversion: 2.1 time: 1.421619 Oct 11 19:48:08.720806 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 861/1707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:07 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1533 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:08.733228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:08.735409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:08.752448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:08.753312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:08.753943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:08.756544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:08.757762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:08.759878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:09.249909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:09.272831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:09.280143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:09.319686 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8588c1fc-af50-4260-9fe1-47f52e39811a tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.569394 Oct 11 19:48:09.323076 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 862/1708] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:08 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:09.331887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f161ef5e-c732-4174-8e1c-af575590d1a0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:09.333636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f161ef5e-c732-4174-8e1c-af575590d1a0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:09.357210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f161ef5e-c732-4174-8e1c-af575590d1a0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:09.366139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f161ef5e-c732-4174-8e1c-af575590d1a0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:09.367860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f161ef5e-c732-4174-8e1c-af575590d1a0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:09.369759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f161ef5e-c732-4174-8e1c-af575590d1a0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:09.371568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f161ef5e-c732-4174-8e1c-af575590d1a0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:09.372306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f161ef5e-c732-4174-8e1c-af575590d1a0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:09.514993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-41c10a02-7cac-4ad1-b9bd-b8db894220a0 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid 72bf9d5c-d025-4705-828e-4e4e389f5681 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:48:09.552945 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-41c10a02-7cac-4ad1-b9bd-b8db894220a0 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 2422 microversion: 2.25 time: 1.915092 Oct 11 19:48:09.554412 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 847/1709] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:07 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 2422 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:09.564986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4aa9f036-4dce-4f62-b3c5-75340e1cf24a tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:09.568271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4aa9f036-4dce-4f62-b3c5-75340e1cf24a tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:09.591473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4aa9f036-4dce-4f62-b3c5-75340e1cf24a tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:09.592205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4aa9f036-4dce-4f62-b3c5-75340e1cf24a tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:09.592724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4aa9f036-4dce-4f62-b3c5-75340e1cf24a tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:09.593546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4aa9f036-4dce-4f62-b3c5-75340e1cf24a tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:09.594099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4aa9f036-4dce-4f62-b3c5-75340e1cf24a tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:09.594567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4aa9f036-4dce-4f62-b3c5-75340e1cf24a tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:09.658587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4aa9f036-4dce-4f62-b3c5-75340e1cf24a tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:09.659998 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4aa9f036-4dce-4f62-b3c5-75340e1cf24a tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731/os-instance-actions/req-378acb92-72cf-4db9-b996-f4b4df550c92" status: 200 len: 313 microversion: 2.1 time: 0.104161 Oct 11 19:48:09.667078 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 848/1710] 10.222.0.27 () {58 vars in 1419 bytes} [Tue Oct 11 19:48:09 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731/os-instance-actions/req-378acb92-72cf-4db9-b996-f4b4df550c92 => generated 313 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:09.677228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71c11fa4-b3a2-4024-ad0c-7f23d832fc16 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:09.677876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-71c11fa4-b3a2-4024-ad0c-7f23d832fc16 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:09.684905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71c11fa4-b3a2-4024-ad0c-7f23d832fc16 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:09.685650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71c11fa4-b3a2-4024-ad0c-7f23d832fc16 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:09.685984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71c11fa4-b3a2-4024-ad0c-7f23d832fc16 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:09.686794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71c11fa4-b3a2-4024-ad0c-7f23d832fc16 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:09.687326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71c11fa4-b3a2-4024-ad0c-7f23d832fc16 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:09.687909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71c11fa4-b3a2-4024-ad0c-7f23d832fc16 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:09.893366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f161ef5e-c732-4174-8e1c-af575590d1a0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:09.911745 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f161ef5e-c732-4174-8e1c-af575590d1a0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1317 microversion: 2.1 time: 0.585954 Oct 11 19:48:09.921490 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 863/1711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:09 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:09.933597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2cb46209-fc48-4706-bca4-c07328cb1582 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:09.943758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2cb46209-fc48-4706-bca4-c07328cb1582 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:09.952091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cb46209-fc48-4706-bca4-c07328cb1582 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:09.952967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cb46209-fc48-4706-bca4-c07328cb1582 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:09.953658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cb46209-fc48-4706-bca4-c07328cb1582 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:09.955328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cb46209-fc48-4706-bca4-c07328cb1582 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:09.956039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cb46209-fc48-4706-bca4-c07328cb1582 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:09.958509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cb46209-fc48-4706-bca4-c07328cb1582 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:10.356215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2cb46209-fc48-4706-bca4-c07328cb1582 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:10.385391 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2cb46209-fc48-4706-bca4-c07328cb1582 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 0.455198 Oct 11 19:48:10.399480 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 864/1712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:09 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:10.429206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-397c780c-d697-45f3-b095-0745b19f4d3d tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:10.430927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-397c780c-d697-45f3-b095-0745b19f4d3d tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:10.452072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397c780c-d697-45f3-b095-0745b19f4d3d tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:10.452969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397c780c-d697-45f3-b095-0745b19f4d3d tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:10.453712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397c780c-d697-45f3-b095-0745b19f4d3d tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:10.455258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397c780c-d697-45f3-b095-0745b19f4d3d tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:10.455951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397c780c-d697-45f3-b095-0745b19f4d3d tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:10.456603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-397c780c-d697-45f3-b095-0745b19f4d3d tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:10.669361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-71c11fa4-b3a2-4024-ad0c-7f23d832fc16 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:10.683524 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-71c11fa4-b3a2-4024-ad0c-7f23d832fc16 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1314 microversion: 2.1 time: 1.014759 Oct 11 19:48:10.685426 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 849/1713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:09 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1314 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:10.699481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e65d2b5e-c4a1-4072-b38f-866bd551abb7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:10.701351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e65d2b5e-c4a1-4072-b38f-866bd551abb7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:10.733138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65d2b5e-c4a1-4072-b38f-866bd551abb7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:10.733649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65d2b5e-c4a1-4072-b38f-866bd551abb7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:10.734095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65d2b5e-c4a1-4072-b38f-866bd551abb7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:10.734854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65d2b5e-c4a1-4072-b38f-866bd551abb7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:10.735334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65d2b5e-c4a1-4072-b38f-866bd551abb7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:10.735749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e65d2b5e-c4a1-4072-b38f-866bd551abb7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.334358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-e65d2b5e-c4a1-4072-b38f-866bd551abb7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid 72bf9d5c-d025-4705-828e-4e4e389f5681 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:48:11.340278 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-397c780c-d697-45f3-b095-0745b19f4d3d tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1533 microversion: 2.1 time: 0.933320 Oct 11 19:48:11.346900 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 865/1714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:10 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1533 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:11.358584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6f979f0-860f-49e5-a22e-c240e5762dcb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:11.363852 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e65d2b5e-c4a1-4072-b38f-866bd551abb7 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 2422 microversion: 2.25 time: 0.676587 Oct 11 19:48:11.366269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6f979f0-860f-49e5-a22e-c240e5762dcb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:11.378608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6f979f0-860f-49e5-a22e-c240e5762dcb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.379935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6f979f0-860f-49e5-a22e-c240e5762dcb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.380548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6f979f0-860f-49e5-a22e-c240e5762dcb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.381457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6f979f0-860f-49e5-a22e-c240e5762dcb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.382087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6f979f0-860f-49e5-a22e-c240e5762dcb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.382718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6f979f0-860f-49e5-a22e-c240e5762dcb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.401203 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 850/1715] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:10 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 2422 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:11.413304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:11.413928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:11.424060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.425225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.426553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.427830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.428517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.430470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.468936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:11.567297 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6f979f0-860f-49e5-a22e-c240e5762dcb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "POST /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731/action" status: 202 len: 0 microversion: 2.1 time: 0.224712 Oct 11 19:48:11.568668 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 866/1716] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:48:11 2022] POST /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:48:11.575679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d3512007-71a6-4704-b6bc-f887e0163463 req-e1bd1428-1488-4cac-9a35-64977f76eb52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1ceed5-0490-4d64-8d97-e0684bd7f05f", "tag": "c0a9bf59-035c-4a1e-8ebc-eeb631b03c41"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:11.586041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:11.589145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d3512007-71a6-4704-b6bc-f887e0163463 req-e1bd1428-1488-4cac-9a35-64977f76eb52 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.590269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d3512007-71a6-4704-b6bc-f887e0163463 req-e1bd1428-1488-4cac-9a35-64977f76eb52 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.591084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d3512007-71a6-4704-b6bc-f887e0163463 req-e1bd1428-1488-4cac-9a35-64977f76eb52 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.603938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:11.627099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:11.630265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:11.640015 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d3512007-71a6-4704-b6bc-f887e0163463 req-e1bd1428-1488-4cac-9a35-64977f76eb52 service nova] Creating event network-changed:c0a9bf59-035c-4a1e-8ebc-eeb631b03c41 for instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f on n-h2-860864-3 Oct 11 19:48:11.642516 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1ba958a3-9700-4e29-a219-aba044c36363 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.238979 Oct 11 19:48:11.648443 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d3512007-71a6-4704-b6bc-f887e0163463 req-e1bd1428-1488-4cac-9a35-64977f76eb52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077891 Oct 11 19:48:11.651091 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 851/1717] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:11 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:11.655433 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 867/1718] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:11.663604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c44aa1e1-9536-483e-aa7b-b6d4007548b3 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:11.678998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c44aa1e1-9536-483e-aa7b-b6d4007548b3 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.682260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c44aa1e1-9536-483e-aa7b-b6d4007548b3 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.682260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c44aa1e1-9536-483e-aa7b-b6d4007548b3 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.682260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c44aa1e1-9536-483e-aa7b-b6d4007548b3 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.683702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c44aa1e1-9536-483e-aa7b-b6d4007548b3 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.684146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c44aa1e1-9536-483e-aa7b-b6d4007548b3 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.685163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5fd60a38-b25a-4025-bcb4-5a1ca3c1268f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:11.686438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5fd60a38-b25a-4025-bcb4-5a1ca3c1268f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:11.702196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd60a38-b25a-4025-bcb4-5a1ca3c1268f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.702789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd60a38-b25a-4025-bcb4-5a1ca3c1268f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.703342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd60a38-b25a-4025-bcb4-5a1ca3c1268f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.704038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd60a38-b25a-4025-bcb4-5a1ca3c1268f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.704557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd60a38-b25a-4025-bcb4-5a1ca3c1268f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.704990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd60a38-b25a-4025-bcb4-5a1ca3c1268f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.725722 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c44aa1e1-9536-483e-aa7b-b6d4007548b3 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.068743 Oct 11 19:48:11.726910 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 868/1719] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 11 19:48:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:11.731784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a6e84e9-6e5d-4690-8a62-e3b6fd1e7dc7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:11.732787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a6e84e9-6e5d-4690-8a62-e3b6fd1e7dc7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:11.739798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e84e9-6e5d-4690-8a62-e3b6fd1e7dc7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.741020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e84e9-6e5d-4690-8a62-e3b6fd1e7dc7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.741698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e84e9-6e5d-4690-8a62-e3b6fd1e7dc7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:11.742726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e84e9-6e5d-4690-8a62-e3b6fd1e7dc7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:11.743484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e84e9-6e5d-4690-8a62-e3b6fd1e7dc7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:11.744213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e84e9-6e5d-4690-8a62-e3b6fd1e7dc7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:12.141226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a6e84e9-6e5d-4690-8a62-e3b6fd1e7dc7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:12.149918 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a6e84e9-6e5d-4690-8a62-e3b6fd1e7dc7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 0.421681 Oct 11 19:48:12.161844 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 869/1720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:11 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:12.167061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-80ea83d5-76cf-4fcb-99fd-decf8c492639 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:12.167645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-80ea83d5-76cf-4fcb-99fd-decf8c492639 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:12.184833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80ea83d5-76cf-4fcb-99fd-decf8c492639 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:12.185349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80ea83d5-76cf-4fcb-99fd-decf8c492639 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:12.185789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80ea83d5-76cf-4fcb-99fd-decf8c492639 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:12.186516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80ea83d5-76cf-4fcb-99fd-decf8c492639 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:12.187006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80ea83d5-76cf-4fcb-99fd-decf8c492639 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:12.187435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80ea83d5-76cf-4fcb-99fd-decf8c492639 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:12.227027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5fd60a38-b25a-4025-bcb4-5a1ca3c1268f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:12.242850 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5fd60a38-b25a-4025-bcb4-5a1ca3c1268f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1317 microversion: 2.1 time: 0.588814 Oct 11 19:48:12.253251 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 852/1721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:11 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:12.270338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9eb96f06-8add-4a29-a630-183461b5aff1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:12.271279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9eb96f06-8add-4a29-a630-183461b5aff1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:12.280174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eb96f06-8add-4a29-a630-183461b5aff1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:12.280852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eb96f06-8add-4a29-a630-183461b5aff1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:12.281488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eb96f06-8add-4a29-a630-183461b5aff1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:12.282427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eb96f06-8add-4a29-a630-183461b5aff1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:12.284022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eb96f06-8add-4a29-a630-183461b5aff1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:12.284683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9eb96f06-8add-4a29-a630-183461b5aff1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:12.333836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-80ea83d5-76cf-4fcb-99fd-decf8c492639 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lazy-loading 'services' on Instance uuid 72bf9d5c-d025-4705-828e-4e4e389f5681 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:48:12.486083 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-80ea83d5-76cf-4fcb-99fd-decf8c492639 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "DELETE /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments/5e7072e7-9e4b-47ec-969d-03d0fa80db44" status: 202 len: 0 microversion: 2.25 time: 0.322840 Oct 11 19:48:12.488943 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 870/1722] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Oct 11 19:48:12 2022] DELETE /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments/5e7072e7-9e4b-47ec-969d-03d0fa80db44 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:48:12.511491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e28c3af3-aa1d-4265-b951-b0b6bf37ba58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:12.513955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e28c3af3-aa1d-4265-b951-b0b6bf37ba58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:12.540597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28c3af3-aa1d-4265-b951-b0b6bf37ba58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:12.541707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28c3af3-aa1d-4265-b951-b0b6bf37ba58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:12.544578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28c3af3-aa1d-4265-b951-b0b6bf37ba58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:12.547180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28c3af3-aa1d-4265-b951-b0b6bf37ba58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:12.549555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28c3af3-aa1d-4265-b951-b0b6bf37ba58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:12.552651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28c3af3-aa1d-4265-b951-b0b6bf37ba58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:12.662721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9eb96f06-8add-4a29-a630-183461b5aff1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:12.676520 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9eb96f06-8add-4a29-a630-183461b5aff1 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1506 microversion: 2.1 time: 0.415031 Oct 11 19:48:12.690606 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 853/1723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:12 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:12.865802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e28c3af3-aa1d-4265-b951-b0b6bf37ba58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:12.875372 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e28c3af3-aa1d-4265-b951-b0b6bf37ba58 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1314 microversion: 2.1 time: 0.383478 Oct 11 19:48:12.888373 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 871/1724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:12 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:12.888373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-08eb7fc4-9e04-444a-8398-7aa5d3744c7f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:12.889098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-08eb7fc4-9e04-444a-8398-7aa5d3744c7f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:12.896412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08eb7fc4-9e04-444a-8398-7aa5d3744c7f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:12.897043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08eb7fc4-9e04-444a-8398-7aa5d3744c7f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:12.897593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08eb7fc4-9e04-444a-8398-7aa5d3744c7f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:12.898764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08eb7fc4-9e04-444a-8398-7aa5d3744c7f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:12.899544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08eb7fc4-9e04-444a-8398-7aa5d3744c7f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:12.900085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08eb7fc4-9e04-444a-8398-7aa5d3744c7f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:12.943155 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-08eb7fc4-9e04-444a-8398-7aa5d3744c7f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061313 Oct 11 19:48:12.944223 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 872/1725] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 19:48:12 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:48:12.949427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:12.950328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:12.958425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:12.959375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:12.960634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:12.961170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:12.966586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:12.966586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:13.094338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:13.104896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:13.106974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:13.113984 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-35be29d6-f9b1-4ec8-9c06-a09ccd158fcd tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.167489 Oct 11 19:48:13.126428 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 873/1726] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:12 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:13.187507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66bbaa90-4c39-4742-98b4-e580e5fe9be7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:13.188147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-66bbaa90-4c39-4742-98b4-e580e5fe9be7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:13.197813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66bbaa90-4c39-4742-98b4-e580e5fe9be7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:13.200577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66bbaa90-4c39-4742-98b4-e580e5fe9be7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:13.201036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66bbaa90-4c39-4742-98b4-e580e5fe9be7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:13.201750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66bbaa90-4c39-4742-98b4-e580e5fe9be7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:13.202233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66bbaa90-4c39-4742-98b4-e580e5fe9be7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:13.202713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66bbaa90-4c39-4742-98b4-e580e5fe9be7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:13.256715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-3", "block_migration": false, "disk_over_commit": false}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:13.260135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:13.269709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:13.270821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:13.271442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:13.272539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:13.273225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:13.273820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:13.312108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lazy-loading 'flavor' on Instance uuid 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:48:13.327932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Going to try to live migrate instance to n-h2-860864-3 {{(pid=126955) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 19:48:13.508533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-66bbaa90-4c39-4742-98b4-e580e5fe9be7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:13.522204 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-66bbaa90-4c39-4742-98b4-e580e5fe9be7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 0.338551 Oct 11 19:48:13.523653 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 874/1727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:13 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:13.530122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a038f74a-13ed-4918-be76-b485ea0d31d5 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:13.531062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a038f74a-13ed-4918-be76-b485ea0d31d5 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:13.539891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a038f74a-13ed-4918-be76-b485ea0d31d5 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:13.540694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a038f74a-13ed-4918-be76-b485ea0d31d5 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:13.541390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a038f74a-13ed-4918-be76-b485ea0d31d5 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:13.542261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a038f74a-13ed-4918-be76-b485ea0d31d5 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:13.542937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a038f74a-13ed-4918-be76-b485ea0d31d5 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:13.543561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a038f74a-13ed-4918-be76-b485ea0d31d5 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:13.768908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a038f74a-13ed-4918-be76-b485ea0d31d5 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:13.783632 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a038f74a-13ed-4918-be76-b485ea0d31d5 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1317 microversion: 2.1 time: 0.258039 Oct 11 19:48:13.795761 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 875/1728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:13 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:13.812724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3a3792b-8436-4a14-b315-65a366a1cc2e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:13.813557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3a3792b-8436-4a14-b315-65a366a1cc2e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:13.841225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3a3792b-8436-4a14-b315-65a366a1cc2e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:13.841868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3a3792b-8436-4a14-b315-65a366a1cc2e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:13.842328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3a3792b-8436-4a14-b315-65a366a1cc2e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:13.843203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3a3792b-8436-4a14-b315-65a366a1cc2e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:13.846053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3a3792b-8436-4a14-b315-65a366a1cc2e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:13.846053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3a3792b-8436-4a14-b315-65a366a1cc2e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.045025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c3a3792b-8436-4a14-b315-65a366a1cc2e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:14.064867 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3a3792b-8436-4a14-b315-65a366a1cc2e tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1504 microversion: 2.1 time: 0.267911 Oct 11 19:48:14.065784 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 876/1729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:13 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:14.073098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-13753a46-42ca-4c8a-96d7-675bd9eaf9c8 req-f1806c68-24fc-40b8-b3ff-c5c291fbd2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f64eed-776b-4aaf-b46c-cb1f73e5500f", "tag": "bb9a377d-62a3-40e1-bbc3-8342947e2944"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:14.085676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-13753a46-42ca-4c8a-96d7-675bd9eaf9c8 req-f1806c68-24fc-40b8-b3ff-c5c291fbd2b8 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.086426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-13753a46-42ca-4c8a-96d7-675bd9eaf9c8 req-f1806c68-24fc-40b8-b3ff-c5c291fbd2b8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.087093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-13753a46-42ca-4c8a-96d7-675bd9eaf9c8 req-f1806c68-24fc-40b8-b3ff-c5c291fbd2b8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.103701 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-13753a46-42ca-4c8a-96d7-675bd9eaf9c8 req-f1806c68-24fc-40b8-b3ff-c5c291fbd2b8 service nova] Creating event network-changed:bb9a377d-62a3-40e1-bbc3-8342947e2944 for instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f on n-h2-860864-3 Oct 11 19:48:14.111628 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-13753a46-42ca-4c8a-96d7-675bd9eaf9c8 req-f1806c68-24fc-40b8-b3ff-c5c291fbd2b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042597 Oct 11 19:48:14.113338 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 877/1730] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:14.146993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f344b94d-41b7-4a11-a647-81f9027f08a7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:14.148968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f344b94d-41b7-4a11-a647-81f9027f08a7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:14.155939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f344b94d-41b7-4a11-a647-81f9027f08a7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.156468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f344b94d-41b7-4a11-a647-81f9027f08a7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.156916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f344b94d-41b7-4a11-a647-81f9027f08a7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.157811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f344b94d-41b7-4a11-a647-81f9027f08a7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.159414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f344b94d-41b7-4a11-a647-81f9027f08a7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.159965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f344b94d-41b7-4a11-a647-81f9027f08a7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.352065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f344b94d-41b7-4a11-a647-81f9027f08a7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:14.373106 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f344b94d-41b7-4a11-a647-81f9027f08a7 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1314 microversion: 2.1 time: 0.257592 Oct 11 19:48:14.383336 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 878/1731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:14 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:14.391173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1cd75a59-7cad-4a89-994d-1c5f9119d682 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:14.397049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1cd75a59-7cad-4a89-994d-1c5f9119d682 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:14.424862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cd75a59-7cad-4a89-994d-1c5f9119d682 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.425311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cd75a59-7cad-4a89-994d-1c5f9119d682 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.431092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cd75a59-7cad-4a89-994d-1c5f9119d682 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.431956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cd75a59-7cad-4a89-994d-1c5f9119d682 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.432446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cd75a59-7cad-4a89-994d-1c5f9119d682 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.432880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cd75a59-7cad-4a89-994d-1c5f9119d682 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.531183 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1cd75a59-7cad-4a89-994d-1c5f9119d682 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.150800 Oct 11 19:48:14.535141 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 879/1732] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 19:48:14 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:48:14.548709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0721a1da-fabd-4abc-9954-0c60cb6cee40 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '.version_select at 0x7f83cc61ef70>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:14.549649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0721a1da-fabd-4abc-9954-0c60cb6cee40 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:14.576620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0721a1da-fabd-4abc-9954-0c60cb6cee40 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.577130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0721a1da-fabd-4abc-9954-0c60cb6cee40 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.577577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0721a1da-fabd-4abc-9954-0c60cb6cee40 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.585252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0721a1da-fabd-4abc-9954-0c60cb6cee40 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.589407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0721a1da-fabd-4abc-9954-0c60cb6cee40 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.589916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0721a1da-fabd-4abc-9954-0c60cb6cee40 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.653886 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0721a1da-fabd-4abc-9954-0c60cb6cee40 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.116127 Oct 11 19:48:14.662520 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 880/1733] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Oct 11 19:48:14 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731/os-instance-actions => generated 611 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:14.669296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:14.670371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:14.679312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.680126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.680796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.682108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.683047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.684054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.810561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:14.811170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:14.816875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:14.820164 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1ccce716-d5c8-4463-9699-e40a34647e46 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.154447 Oct 11 19:48:14.820987 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 881/1734] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:14 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:14.825843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ab7ae75c-6672-4e2c-8a09-cfb1466d1a57 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:14.826762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ab7ae75c-6672-4e2c-8a09-cfb1466d1a57 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:14.839849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab7ae75c-6672-4e2c-8a09-cfb1466d1a57 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.841333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab7ae75c-6672-4e2c-8a09-cfb1466d1a57 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.842046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab7ae75c-6672-4e2c-8a09-cfb1466d1a57 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:14.843019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab7ae75c-6672-4e2c-8a09-cfb1466d1a57 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:14.843496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab7ae75c-6672-4e2c-8a09-cfb1466d1a57 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:14.844848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab7ae75c-6672-4e2c-8a09-cfb1466d1a57 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:15.781897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ab7ae75c-6672-4e2c-8a09-cfb1466d1a57 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:15.795497 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ab7ae75c-6672-4e2c-8a09-cfb1466d1a57 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 0.973344 Oct 11 19:48:15.799390 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 882/1735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:14 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:15.813120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f915418d-82e9-4954-9e25-e93dee665ddb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:15.815428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f915418d-82e9-4954-9e25-e93dee665ddb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:15.844392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f915418d-82e9-4954-9e25-e93dee665ddb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:15.846330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f915418d-82e9-4954-9e25-e93dee665ddb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:15.850132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f915418d-82e9-4954-9e25-e93dee665ddb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:15.851055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f915418d-82e9-4954-9e25-e93dee665ddb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:15.851493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f915418d-82e9-4954-9e25-e93dee665ddb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:15.856708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f915418d-82e9-4954-9e25-e93dee665ddb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:15.940867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f915418d-82e9-4954-9e25-e93dee665ddb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:48:15.951409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:16.217020 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f915418d-82e9-4954-9e25-e93dee665ddb tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 204 len: 0 microversion: 2.1 time: 0.409608 Oct 11 19:48:16.218569 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 883/1736] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:48:15 2022] DELETE /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:48:16.241623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-71a865c8-107e-4344-9fb4-6dcb6bde6a12 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:16.259001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-71a865c8-107e-4344-9fb4-6dcb6bde6a12 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:16.291437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a865c8-107e-4344-9fb4-6dcb6bde6a12 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:16.292644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a865c8-107e-4344-9fb4-6dcb6bde6a12 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:16.296627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a865c8-107e-4344-9fb4-6dcb6bde6a12 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:16.298939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a865c8-107e-4344-9fb4-6dcb6bde6a12 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:16.312476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a865c8-107e-4344-9fb4-6dcb6bde6a12 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:16.313360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a865c8-107e-4344-9fb4-6dcb6bde6a12 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:16.457756 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8ccb10cc-05f4-45fe-bd01-52fc4ff26831 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d/action" status: 202 len: 0 microversion: 2.1 time: 3.754465 Oct 11 19:48:16.458766 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 854/1737] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:48:12 2022] POST /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d/action => generated 0 bytes in 3765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:48:16.464094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03ebe7c4-60d1-47f1-b030-9aab481e51ee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:16.465107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-03ebe7c4-60d1-47f1-b030-9aab481e51ee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:16.483176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03ebe7c4-60d1-47f1-b030-9aab481e51ee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:16.484121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03ebe7c4-60d1-47f1-b030-9aab481e51ee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:16.484863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03ebe7c4-60d1-47f1-b030-9aab481e51ee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:16.485972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03ebe7c4-60d1-47f1-b030-9aab481e51ee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:16.491576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03ebe7c4-60d1-47f1-b030-9aab481e51ee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:16.492432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03ebe7c4-60d1-47f1-b030-9aab481e51ee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:17.403458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-03ebe7c4-60d1-47f1-b030-9aab481e51ee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:17.415213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:17.418287 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-03ebe7c4-60d1-47f1-b030-9aab481e51ee tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1314 microversion: 2.1 time: 0.957916 Oct 11 19:48:17.418929 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 855/1738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:16 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:17.429327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c427ae3a-403f-484f-9867-bb4bdff9c684 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:17.432172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c427ae3a-403f-484f-9867-bb4bdff9c684 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:17.461030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c427ae3a-403f-484f-9867-bb4bdff9c684 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:17.462691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c427ae3a-403f-484f-9867-bb4bdff9c684 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:17.463587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c427ae3a-403f-484f-9867-bb4bdff9c684 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:17.464493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c427ae3a-403f-484f-9867-bb4bdff9c684 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:17.465115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c427ae3a-403f-484f-9867-bb4bdff9c684 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:17.467102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c427ae3a-403f-484f-9867-bb4bdff9c684 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:17.468974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-71a865c8-107e-4344-9fb4-6dcb6bde6a12 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:17.501441 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-71a865c8-107e-4344-9fb4-6dcb6bde6a12 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1317 microversion: 2.1 time: 1.281052 Oct 11 19:48:17.502995 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 884/1739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:16 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1317 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:17.512314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:17.513272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:17.535045 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c427ae3a-403f-484f-9867-bb4bdff9c684 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112379 Oct 11 19:48:17.536250 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 856/1740] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 19:48:17 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:48:17.541607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eb19a162-1c8d-40f8-9a20-c722ccf4928b tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:17.542458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eb19a162-1c8d-40f8-9a20-c722ccf4928b tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:17.544584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:17.545257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:17.546361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:17.546925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:17.548390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:17.549163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:17.552239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb19a162-1c8d-40f8-9a20-c722ccf4928b tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:17.552953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb19a162-1c8d-40f8-9a20-c722ccf4928b tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:17.553961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb19a162-1c8d-40f8-9a20-c722ccf4928b tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:17.554906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb19a162-1c8d-40f8-9a20-c722ccf4928b tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:17.555768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb19a162-1c8d-40f8-9a20-c722ccf4928b tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:17.556485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb19a162-1c8d-40f8-9a20-c722ccf4928b tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:17.910879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:17.923471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:17.933539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:17.945365 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-415dc0ad-70e8-4182-adaa-c2bee947ea30 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.439347 Oct 11 19:48:17.958553 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 885/1741] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:17 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:17.972744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cee650e0-05db-4ee0-b56a-c206cfc73791 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:17.972744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cee650e0-05db-4ee0-b56a-c206cfc73791 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:17.979303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee650e0-05db-4ee0-b56a-c206cfc73791 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:17.979811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee650e0-05db-4ee0-b56a-c206cfc73791 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:17.980380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee650e0-05db-4ee0-b56a-c206cfc73791 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:17.981842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee650e0-05db-4ee0-b56a-c206cfc73791 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:17.982315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee650e0-05db-4ee0-b56a-c206cfc73791 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:17.983258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee650e0-05db-4ee0-b56a-c206cfc73791 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:18.048565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eb19a162-1c8d-40f8-9a20-c722ccf4928b tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:18.061712 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eb19a162-1c8d-40f8-9a20-c722ccf4928b tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1510 microversion: 2.1 time: 0.523671 Oct 11 19:48:18.084335 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 857/1742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:17 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1510 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:18.092742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae1a4556-f982-466f-a991-2b8a9c3c9a62 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:18.093618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae1a4556-f982-466f-a991-2b8a9c3c9a62 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:18.101551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae1a4556-f982-466f-a991-2b8a9c3c9a62 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:18.102841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae1a4556-f982-466f-a991-2b8a9c3c9a62 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:18.104189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae1a4556-f982-466f-a991-2b8a9c3c9a62 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:18.105438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae1a4556-f982-466f-a991-2b8a9c3c9a62 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:18.106096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae1a4556-f982-466f-a991-2b8a9c3c9a62 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:18.106784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae1a4556-f982-466f-a991-2b8a9c3c9a62 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:18.305488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cee650e0-05db-4ee0-b56a-c206cfc73791 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:18.317726 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cee650e0-05db-4ee0-b56a-c206cfc73791 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.368488 Oct 11 19:48:18.330552 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 886/1743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:17 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:18.330552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6ea81481-cee0-48ae-83a7-2c13468ad665 req-011d2102-26da-49df-a567-61dfb88cb5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1ceed5-0490-4d64-8d97-e0684bd7f05f", "name": "network-vif-plugged", "status": "completed", "tag": "c0a9bf59-035c-4a1e-8ebc-eeb631b03c41"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:18.338286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ea81481-cee0-48ae-83a7-2c13468ad665 req-011d2102-26da-49df-a567-61dfb88cb5a7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:18.338286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ea81481-cee0-48ae-83a7-2c13468ad665 req-011d2102-26da-49df-a567-61dfb88cb5a7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:18.338286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ea81481-cee0-48ae-83a7-2c13468ad665 req-011d2102-26da-49df-a567-61dfb88cb5a7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:18.354753 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6ea81481-cee0-48ae-83a7-2c13468ad665 req-011d2102-26da-49df-a567-61dfb88cb5a7 service nova] Creating event network-vif-plugged:c0a9bf59-035c-4a1e-8ebc-eeb631b03c41 for instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f on n-h2-860864-3 Oct 11 19:48:18.364537 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6ea81481-cee0-48ae-83a7-2c13468ad665 req-011d2102-26da-49df-a567-61dfb88cb5a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044339 Oct 11 19:48:18.392250 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 887/1744] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:18.451907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b9c3c701-1c0c-44ba-a646-ed75512d26de tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:18.452815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b9c3c701-1c0c-44ba-a646-ed75512d26de tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:18.473945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9c3c701-1c0c-44ba-a646-ed75512d26de tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:18.474695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9c3c701-1c0c-44ba-a646-ed75512d26de tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:18.474919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9c3c701-1c0c-44ba-a646-ed75512d26de tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:18.475637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9c3c701-1c0c-44ba-a646-ed75512d26de tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:18.486857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9c3c701-1c0c-44ba-a646-ed75512d26de tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:18.487340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9c3c701-1c0c-44ba-a646-ed75512d26de tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.239124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ae1a4556-f982-466f-a991-2b8a9c3c9a62 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:19.252949 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ae1a4556-f982-466f-a991-2b8a9c3c9a62 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 1.163321 Oct 11 19:48:19.271619 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 858/1745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:18 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:19.280563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2505916-510f-493d-9ae3-136c03e8d6ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:19.284258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a2505916-510f-493d-9ae3-136c03e8d6ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:19.297373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:19.299488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2505916-510f-493d-9ae3-136c03e8d6ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.301741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2505916-510f-493d-9ae3-136c03e8d6ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.302513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2505916-510f-493d-9ae3-136c03e8d6ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.307624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2505916-510f-493d-9ae3-136c03e8d6ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.308764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2505916-510f-493d-9ae3-136c03e8d6ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.309447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2505916-510f-493d-9ae3-136c03e8d6ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.354894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b9c3c701-1c0c-44ba-a646-ed75512d26de tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:19.364496 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b9c3c701-1c0c-44ba-a646-ed75512d26de tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1314 microversion: 2.1 time: 0.917543 Oct 11 19:48:19.368172 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 888/1746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:18 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1314 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:19.380556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2287fd5-4679-495d-aaa3-438565cf9363 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:19.383199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2287fd5-4679-495d-aaa3-438565cf9363 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:19.400600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2287fd5-4679-495d-aaa3-438565cf9363 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.401488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2287fd5-4679-495d-aaa3-438565cf9363 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.402169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2287fd5-4679-495d-aaa3-438565cf9363 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.403156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2287fd5-4679-495d-aaa3-438565cf9363 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.403837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2287fd5-4679-495d-aaa3-438565cf9363 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.404485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2287fd5-4679-495d-aaa3-438565cf9363 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.479716 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2287fd5-4679-495d-aaa3-438565cf9363 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103023 Oct 11 19:48:19.488646 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 889/1747] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 19:48:19 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:48:19.493771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a234ac70-78e1-48b2-a6b7-7b2d499c22d3 req-88ded9a5-a11c-4d11-853a-db2545443283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01c87c3-6ef8-45c0-91bf-c6636c909731", "name": "network-vif-deleted", "tag": "689c23c9-50f8-4f32-b0a9-4b20cffbba48"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:19.517194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a234ac70-78e1-48b2-a6b7-7b2d499c22d3 req-88ded9a5-a11c-4d11-853a-db2545443283 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.517941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a234ac70-78e1-48b2-a6b7-7b2d499c22d3 req-88ded9a5-a11c-4d11-853a-db2545443283 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.519961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a234ac70-78e1-48b2-a6b7-7b2d499c22d3 req-88ded9a5-a11c-4d11-853a-db2545443283 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.545872 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a234ac70-78e1-48b2-a6b7-7b2d499c22d3 req-88ded9a5-a11c-4d11-853a-db2545443283 service nova] Creating event network-vif-deleted:689c23c9-50f8-4f32-b0a9-4b20cffbba48 for instance a01c87c3-6ef8-45c0-91bf-c6636c909731 on n-h1-860864-3 Oct 11 19:48:19.554998 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a234ac70-78e1-48b2-a6b7-7b2d499c22d3 req-88ded9a5-a11c-4d11-853a-db2545443283 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064577 Oct 11 19:48:19.558137 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 890/1748] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:19.565117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:19.570430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:19.585137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.585766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.586320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.590654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.591261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.591794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.724775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a2505916-510f-493d-9ae3-136c03e8d6ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:19.733741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:19.744247 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a2505916-510f-493d-9ae3-136c03e8d6ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1317 microversion: 2.1 time: 0.471263 Oct 11 19:48:19.746036 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 859/1749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:19 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:19.748059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:19.753495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:19.754114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:19.756004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:19.771014 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-39221098-5210-40a7-8ccc-b6220834d795 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.211257 Oct 11 19:48:19.772291 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 891/1750] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:19 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:19.775059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.775568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.777963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10e710c4-6d4d-4c6e-8fa8-98e24bd43cca tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:19.778230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.778991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.779459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.779887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.783663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10e710c4-6d4d-4c6e-8fa8-98e24bd43cca tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:19.798103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10e710c4-6d4d-4c6e-8fa8-98e24bd43cca tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.798969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10e710c4-6d4d-4c6e-8fa8-98e24bd43cca tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.799658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10e710c4-6d4d-4c6e-8fa8-98e24bd43cca tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.801221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10e710c4-6d4d-4c6e-8fa8-98e24bd43cca tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.803066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10e710c4-6d4d-4c6e-8fa8-98e24bd43cca tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.805114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10e710c4-6d4d-4c6e-8fa8-98e24bd43cca tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.887795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:19.888813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:19.889514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:19.890229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lazy-loading 'fault' on Instance uuid a01c87c3-6ef8-45c0-91bf-c6636c909731 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:48:20.041632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58152de0760641ac8de26c69ce577ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be6f749c98452eae3b5367ba1e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:20.052834 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3026624d-a4de-46b7-ae32-cb98f2bf8ce4 tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 200 len: 1306 microversion: 2.1 time: 0.303232 Oct 11 19:48:20.069344 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 860/1751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:19 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 1306 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:20.282106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-81be14ca-07f8-4147-a632-a649dbe0866a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:20.283230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-81be14ca-07f8-4147-a632-a649dbe0866a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:20.295226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81be14ca-07f8-4147-a632-a649dbe0866a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:20.296120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81be14ca-07f8-4147-a632-a649dbe0866a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:20.298015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81be14ca-07f8-4147-a632-a649dbe0866a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:20.299132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81be14ca-07f8-4147-a632-a649dbe0866a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:20.301741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81be14ca-07f8-4147-a632-a649dbe0866a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:20.302506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81be14ca-07f8-4147-a632-a649dbe0866a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:20.348530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-10e710c4-6d4d-4c6e-8fa8-98e24bd43cca tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:20.366544 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10e710c4-6d4d-4c6e-8fa8-98e24bd43cca tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.592786 Oct 11 19:48:20.369253 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 892/1752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:19 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:20.397279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-92549abd-bd3e-4f4f-aff9-6db227e9937e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:20.397921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-92549abd-bd3e-4f4f-aff9-6db227e9937e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:20.408630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-92549abd-bd3e-4f4f-aff9-6db227e9937e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:20.409120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-92549abd-bd3e-4f4f-aff9-6db227e9937e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:20.410166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-92549abd-bd3e-4f4f-aff9-6db227e9937e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:20.415645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-92549abd-bd3e-4f4f-aff9-6db227e9937e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:20.416252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-92549abd-bd3e-4f4f-aff9-6db227e9937e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:20.416718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-92549abd-bd3e-4f4f-aff9-6db227e9937e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:20.644321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-81be14ca-07f8-4147-a632-a649dbe0866a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:20.659452 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-81be14ca-07f8-4147-a632-a649dbe0866a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 0.378681 Oct 11 19:48:20.684021 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 861/1753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:20 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:48:20.698364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e1ccb2f-0a09-453d-a9fc-e5a7db19cf8f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:20.714861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7e1ccb2f-0a09-453d-a9fc-e5a7db19cf8f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:20.734957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e1ccb2f-0a09-453d-a9fc-e5a7db19cf8f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:20.747734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e1ccb2f-0a09-453d-a9fc-e5a7db19cf8f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:20.748471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-92549abd-bd3e-4f4f-aff9-6db227e9937e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:20.748972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e1ccb2f-0a09-453d-a9fc-e5a7db19cf8f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:20.757701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e1ccb2f-0a09-453d-a9fc-e5a7db19cf8f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:20.758403 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-92549abd-bd3e-4f4f-aff9-6db227e9937e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1314 microversion: 2.1 time: 0.365536 Oct 11 19:48:20.758655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e1ccb2f-0a09-453d-a9fc-e5a7db19cf8f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:20.759214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e1ccb2f-0a09-453d-a9fc-e5a7db19cf8f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:20.770301 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 893/1754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:20 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:48:20.776616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e2615873-d373-4d4c-b065-61e58160e1a3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:20.777188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e2615873-d373-4d4c-b065-61e58160e1a3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:20.807062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2615873-d373-4d4c-b065-61e58160e1a3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:20.807648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2615873-d373-4d4c-b065-61e58160e1a3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:20.808097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2615873-d373-4d4c-b065-61e58160e1a3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:20.808835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2615873-d373-4d4c-b065-61e58160e1a3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:20.809416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2615873-d373-4d4c-b065-61e58160e1a3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:20.809844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2615873-d373-4d4c-b065-61e58160e1a3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:20.848135 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e1ccb2f-0a09-453d-a9fc-e5a7db19cf8f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.162608 Oct 11 19:48:20.853845 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 862/1755] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 19:48:20 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:48:20.859230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:20.860192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:20.868555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:20.869488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:20.870184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:20.871229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:20.872009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:20.872714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:21.077896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:21.099363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:21.101850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:21.139255 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8c496583-3446-4de5-abb5-7036be706b52 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.276178 Oct 11 19:48:21.140726 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 863/1756] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:20 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:21.145866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:21.146866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] [instance: a01c87c3-6ef8-45c0-91bf-c6636c909731] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:21.174223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:21.177401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:21.183354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:21.184500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:21.185086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:21.185671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:21.214910 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] HTTP exception thrown: Instance a01c87c3-6ef8-45c0-91bf-c6636c909731 could not be found. Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Request method failure captured: Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 HTTP/1.1 Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRchavLL0-8oS_QBd7SavGCi8fJgSmFHAaYwg4xtjQerxL8jXJxU7wjuNPEa3VY_GOdWFSQZ4sVKSkVxaiAfE-F4dIYNA6341FAY9On3rkyBMtzzXehJYahGTZEDOrPzARXKO3B7xcuXZGzlpXQjlRFe7_iZOvMgrkvCpnJu4WdmUUsw Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: d7be6f749c98452eae3b5367ba1e0568 Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-InstanceActionsTestJSON-946384436 Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7be6f749c98452eae3b5367ba1e0568"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7be6f749c98452eae3b5367ba1e0568", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7be6f749c98452eae3b5367ba1e0568"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7be6f749c98452eae3b5367ba1e0568"}]}] Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-InstanceActionsTestJSON-946384436 Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: d7be6f749c98452eae3b5367ba1e0568 Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-InstanceActionsTestJSON-946384436 Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-InstanceActionsTestJSON-946384436-project Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 58152de0760641ac8de26c69ce577ad2 Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-InstanceActionsTestJSON-946384436-project Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance a01c87c3-6ef8-45c0-91bf-c6636c909731 could not be found. Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a01c87c3-6ef8-45c0-91bf-c6636c909731'} Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a01c87c3-6ef8-45c0-91bf-c6636c909731 could not be found. Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a01c87c3-6ef8-45c0-91bf-c6636c909731 could not be found. Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:48:21.220478 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:48:21.227436 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:48:21.227436 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:48:21.227436 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:48:21.227436 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:48:21.227436 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:48:21.227436 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a01c87c3-6ef8-45c0-91bf-c6636c909731 could not be found. Oct 11 19:48:21.227436 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:48:21.227436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] Returning 404 to user: Instance a01c87c3-6ef8-45c0-91bf-c6636c909731 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:48:21.229757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e2615873-d373-4d4c-b065-61e58160e1a3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:21.230258 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c656b012-78f7-488c-9415-bd6c610413aa tempest-InstanceActionsTestJSON-946384436 tempest-InstanceActionsTestJSON-946384436-project] 10.222.0.27 "GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731" status: 404 len: 111 microversion: 2.1 time: 0.084266 Oct 11 19:48:21.235805 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 864/1757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:21 2022] GET /compute/v2.1/servers/a01c87c3-6ef8-45c0-91bf-c6636c909731 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:48:21.248709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c542b733-a835-4930-b98e-aff892d5052b req-c6e5a8ce-5db9-4c18-91e3-c27aa76061a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f64eed-776b-4aaf-b46c-cb1f73e5500f", "name": "network-vif-plugged", "status": "completed", "tag": "bb9a377d-62a3-40e1-bbc3-8342947e2944"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:21.253359 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e2615873-d373-4d4c-b065-61e58160e1a3 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1317 microversion: 2.1 time: 0.481860 Oct 11 19:48:21.270011 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 894/1758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:20 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:21.270246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c542b733-a835-4930-b98e-aff892d5052b req-c6e5a8ce-5db9-4c18-91e3-c27aa76061a9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:21.270246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c542b733-a835-4930-b98e-aff892d5052b req-c6e5a8ce-5db9-4c18-91e3-c27aa76061a9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:21.270246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c542b733-a835-4930-b98e-aff892d5052b req-c6e5a8ce-5db9-4c18-91e3-c27aa76061a9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:21.308525 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c542b733-a835-4930-b98e-aff892d5052b req-c6e5a8ce-5db9-4c18-91e3-c27aa76061a9 service nova] Creating event network-vif-plugged:bb9a377d-62a3-40e1-bbc3-8342947e2944 for instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f on n-h2-860864-3 Oct 11 19:48:21.332406 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c542b733-a835-4930-b98e-aff892d5052b req-c6e5a8ce-5db9-4c18-91e3-c27aa76061a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094352 Oct 11 19:48:21.335246 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 865/1759] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:21.389815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba878327-28de-4421-b3e7-a86c01c3c6fb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:21.390429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba878327-28de-4421-b3e7-a86c01c3c6fb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:21.400084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba878327-28de-4421-b3e7-a86c01c3c6fb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:21.405915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba878327-28de-4421-b3e7-a86c01c3c6fb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:21.406588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba878327-28de-4421-b3e7-a86c01c3c6fb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:21.408713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba878327-28de-4421-b3e7-a86c01c3c6fb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:21.409210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba878327-28de-4421-b3e7-a86c01c3c6fb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:21.409789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba878327-28de-4421-b3e7-a86c01c3c6fb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:21.692291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7a1b8fea-ca0d-4541-9a5b-cff3d93cbf17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:21.693112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7a1b8fea-ca0d-4541-9a5b-cff3d93cbf17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:21.708055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:21.711665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a1b8fea-ca0d-4541-9a5b-cff3d93cbf17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:21.714638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a1b8fea-ca0d-4541-9a5b-cff3d93cbf17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:21.715206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a1b8fea-ca0d-4541-9a5b-cff3d93cbf17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:21.719827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a1b8fea-ca0d-4541-9a5b-cff3d93cbf17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:21.720454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a1b8fea-ca0d-4541-9a5b-cff3d93cbf17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:21.721638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a1b8fea-ca0d-4541-9a5b-cff3d93cbf17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:21.834276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba878327-28de-4421-b3e7-a86c01c3c6fb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:21.853629 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba878327-28de-4421-b3e7-a86c01c3c6fb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.464724 Oct 11 19:48:21.854194 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 895/1760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:21 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:21.869515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9702a227-aadc-45f8-b0c0-e7294940fd96 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:21.872468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9702a227-aadc-45f8-b0c0-e7294940fd96 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:21.888265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9702a227-aadc-45f8-b0c0-e7294940fd96 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:21.888764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9702a227-aadc-45f8-b0c0-e7294940fd96 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:21.891533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9702a227-aadc-45f8-b0c0-e7294940fd96 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:21.892302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9702a227-aadc-45f8-b0c0-e7294940fd96 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:21.892767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9702a227-aadc-45f8-b0c0-e7294940fd96 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:21.893196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9702a227-aadc-45f8-b0c0-e7294940fd96 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:22.138657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7a1b8fea-ca0d-4541-9a5b-cff3d93cbf17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:22.148910 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7a1b8fea-ca0d-4541-9a5b-cff3d93cbf17 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 0.461831 Oct 11 19:48:22.149731 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 866/1761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:21 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:22.172605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a88a1adb-918e-426b-8629-0bfbe31cfa2c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:22.174830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a88a1adb-918e-426b-8629-0bfbe31cfa2c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:22.206082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88a1adb-918e-426b-8629-0bfbe31cfa2c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:22.211496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88a1adb-918e-426b-8629-0bfbe31cfa2c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:22.212257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88a1adb-918e-426b-8629-0bfbe31cfa2c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:22.214253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88a1adb-918e-426b-8629-0bfbe31cfa2c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:22.214854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88a1adb-918e-426b-8629-0bfbe31cfa2c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:22.217366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88a1adb-918e-426b-8629-0bfbe31cfa2c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:22.309135 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a88a1adb-918e-426b-8629-0bfbe31cfa2c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.158525 Oct 11 19:48:22.318504 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 867/1762] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 19:48:22 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:48:22.323625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:22.324243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:22.343359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:22.344158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:22.346452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:22.347818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:22.352661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:22.354280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:22.419602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9702a227-aadc-45f8-b0c0-e7294940fd96 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:22.430579 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9702a227-aadc-45f8-b0c0-e7294940fd96 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1500 microversion: 2.1 time: 0.575228 Oct 11 19:48:22.431947 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 896/1763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:21 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1500 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:22.455238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-12a3170a-036c-4f96-999a-11fa0705742d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:22.456282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-12a3170a-036c-4f96-999a-11fa0705742d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:22.484264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12a3170a-036c-4f96-999a-11fa0705742d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:22.485160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12a3170a-036c-4f96-999a-11fa0705742d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:22.486032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12a3170a-036c-4f96-999a-11fa0705742d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:22.487188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12a3170a-036c-4f96-999a-11fa0705742d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:22.488981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12a3170a-036c-4f96-999a-11fa0705742d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:22.490148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12a3170a-036c-4f96-999a-11fa0705742d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:22.539741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:22.548763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:22.550280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:22.570321 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-69c23e94-2106-47d9-a4a3-3f22540dd3b4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.250615 Oct 11 19:48:22.584436 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 868/1764] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:22 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:22.610412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e05336d3-8e5f-4973-97d6-e5046e07ba50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:22.610992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e05336d3-8e5f-4973-97d6-e5046e07ba50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:22.624588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e05336d3-8e5f-4973-97d6-e5046e07ba50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:22.626646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e05336d3-8e5f-4973-97d6-e5046e07ba50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:22.627656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e05336d3-8e5f-4973-97d6-e5046e07ba50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:22.633465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e05336d3-8e5f-4973-97d6-e5046e07ba50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:22.634428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e05336d3-8e5f-4973-97d6-e5046e07ba50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:22.636337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e05336d3-8e5f-4973-97d6-e5046e07ba50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:22.699613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-e05336d3-8e5f-4973-97d6-e5046e07ba50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lazy-loading 'flavor' on Instance uuid 7d1ceed5-0490-4d64-8d97-e0684bd7f05f {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:48:22.844431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-12a3170a-036c-4f96-999a-11fa0705742d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:22.855905 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-12a3170a-036c-4f96-999a-11fa0705742d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1317 microversion: 2.1 time: 0.416258 Oct 11 19:48:22.857190 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 897/1765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:22 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:22.884101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7edd3872-078b-438c-9276-a8dfead5636b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:22.885112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7edd3872-078b-438c-9276-a8dfead5636b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:22.911572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7edd3872-078b-438c-9276-a8dfead5636b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:22.912110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7edd3872-078b-438c-9276-a8dfead5636b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:22.912812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7edd3872-078b-438c-9276-a8dfead5636b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:22.913525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7edd3872-078b-438c-9276-a8dfead5636b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:22.915097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7edd3872-078b-438c-9276-a8dfead5636b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:22.916536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7edd3872-078b-438c-9276-a8dfead5636b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:23.286059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7edd3872-078b-438c-9276-a8dfead5636b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:23.302954 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7edd3872-078b-438c-9276-a8dfead5636b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.422830 Oct 11 19:48:23.307174 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 898/1766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:22 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:48:23.319608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78ede39d-7d6b-462f-af6d-5409e975d8a7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:23.323343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78ede39d-7d6b-462f-af6d-5409e975d8a7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:23.339538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ede39d-7d6b-462f-af6d-5409e975d8a7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:23.342379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ede39d-7d6b-462f-af6d-5409e975d8a7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:23.343025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ede39d-7d6b-462f-af6d-5409e975d8a7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:23.347582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ede39d-7d6b-462f-af6d-5409e975d8a7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:23.348291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ede39d-7d6b-462f-af6d-5409e975d8a7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:23.348848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ede39d-7d6b-462f-af6d-5409e975d8a7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:23.706889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78ede39d-7d6b-462f-af6d-5409e975d8a7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:23.715267 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78ede39d-7d6b-462f-af6d-5409e975d8a7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 0.406178 Oct 11 19:48:23.739749 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 899/1767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:23 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:23.761349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1aa0110-fcb9-400e-9b45-4569016f3430 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:23.770883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1aa0110-fcb9-400e-9b45-4569016f3430 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:23.787155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aa0110-fcb9-400e-9b45-4569016f3430 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:23.792878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aa0110-fcb9-400e-9b45-4569016f3430 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:23.793702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aa0110-fcb9-400e-9b45-4569016f3430 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:23.794618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aa0110-fcb9-400e-9b45-4569016f3430 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:23.795334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aa0110-fcb9-400e-9b45-4569016f3430 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:23.795987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aa0110-fcb9-400e-9b45-4569016f3430 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:23.807463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:23.848914 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1aa0110-fcb9-400e-9b45-4569016f3430 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098837 Oct 11 19:48:23.850591 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 900/1768] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 19:48:23 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:48:23.855706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:23.856588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:23.865596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:23.866328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:23.866988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:23.868297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:23.868950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:23.869569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:24.002210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:24.030938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:24.039452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:24.072715 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2709ef71-cb49-4f26-90b2-668f4ea73a95 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.220443 Oct 11 19:48:24.088194 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 901/1769] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:23 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:24.101805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fdf2c171-56ad-4e83-a6cf-410f154c99d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:24.102482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fdf2c171-56ad-4e83-a6cf-410f154c99d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:24.109096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf2c171-56ad-4e83-a6cf-410f154c99d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:24.109736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf2c171-56ad-4e83-a6cf-410f154c99d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:24.110284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf2c171-56ad-4e83-a6cf-410f154c99d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:24.111124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf2c171-56ad-4e83-a6cf-410f154c99d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:24.111689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf2c171-56ad-4e83-a6cf-410f154c99d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:24.112218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf2c171-56ad-4e83-a6cf-410f154c99d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:24.429452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fdf2c171-56ad-4e83-a6cf-410f154c99d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:24.451423 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fdf2c171-56ad-4e83-a6cf-410f154c99d1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1507 microversion: 2.1 time: 0.360284 Oct 11 19:48:24.454007 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 902/1770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:24 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:24.466194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-edbb7886-0b2a-49b4-9ba4-ba0b72c455ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:24.472209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-edbb7886-0b2a-49b4-9ba4-ba0b72c455ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:24.489038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edbb7886-0b2a-49b4-9ba4-ba0b72c455ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:24.491802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edbb7886-0b2a-49b4-9ba4-ba0b72c455ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:24.492590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edbb7886-0b2a-49b4-9ba4-ba0b72c455ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:24.494685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edbb7886-0b2a-49b4-9ba4-ba0b72c455ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:24.500084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edbb7886-0b2a-49b4-9ba4-ba0b72c455ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:24.502429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edbb7886-0b2a-49b4-9ba4-ba0b72c455ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:24.809981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-edbb7886-0b2a-49b4-9ba4-ba0b72c455ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:24.820768 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-edbb7886-0b2a-49b4-9ba4-ba0b72c455ac tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.363580 Oct 11 19:48:24.821946 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 903/1771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:24 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:24.833877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-25fdbc0a-3b16-42f5-b07c-630f7f909c24 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:24.833877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-25fdbc0a-3b16-42f5-b07c-630f7f909c24 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:24.835183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25fdbc0a-3b16-42f5-b07c-630f7f909c24 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:24.836119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25fdbc0a-3b16-42f5-b07c-630f7f909c24 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:24.836844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25fdbc0a-3b16-42f5-b07c-630f7f909c24 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:24.837878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25fdbc0a-3b16-42f5-b07c-630f7f909c24 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:24.838820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25fdbc0a-3b16-42f5-b07c-630f7f909c24 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:24.839474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25fdbc0a-3b16-42f5-b07c-630f7f909c24 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:25.171920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-25fdbc0a-3b16-42f5-b07c-630f7f909c24 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:25.189644 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-25fdbc0a-3b16-42f5-b07c-630f7f909c24 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1507 microversion: 2.1 time: 0.361361 Oct 11 19:48:25.190770 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 904/1772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:24 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:25.201543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0ffb986-aa5a-4b58-95a8-b7a603d58508 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:25.210860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0ffb986-aa5a-4b58-95a8-b7a603d58508 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:25.245348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0ffb986-aa5a-4b58-95a8-b7a603d58508 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:25.245942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0ffb986-aa5a-4b58-95a8-b7a603d58508 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:25.246397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0ffb986-aa5a-4b58-95a8-b7a603d58508 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:25.249414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0ffb986-aa5a-4b58-95a8-b7a603d58508 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:25.250317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0ffb986-aa5a-4b58-95a8-b7a603d58508 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:25.261539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0ffb986-aa5a-4b58-95a8-b7a603d58508 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:26.019972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e0ffb986-aa5a-4b58-95a8-b7a603d58508 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:26.032537 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0ffb986-aa5a-4b58-95a8-b7a603d58508 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 0.839641 Oct 11 19:48:26.040406 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 905/1773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:25 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:26.051721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-110b7feb-578e-4247-ac55-4cecc8421349 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:26.071590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-110b7feb-578e-4247-ac55-4cecc8421349 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:26.091618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-110b7feb-578e-4247-ac55-4cecc8421349 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:26.101869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-110b7feb-578e-4247-ac55-4cecc8421349 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:26.102469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-110b7feb-578e-4247-ac55-4cecc8421349 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:26.105007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-110b7feb-578e-4247-ac55-4cecc8421349 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:26.106086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-110b7feb-578e-4247-ac55-4cecc8421349 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:26.115389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-110b7feb-578e-4247-ac55-4cecc8421349 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:26.260498 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-110b7feb-578e-4247-ac55-4cecc8421349 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.209212 Oct 11 19:48:26.267079 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 906/1774] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 19:48:26 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681/os-volume_attachments => generated 25 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:26.286331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:26.292995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:26.310138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:26.323542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:26.324494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:26.325431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:26.329009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:26.330175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:26.549361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:26.568435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:26.572941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:26.598645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:26.600852 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a30bf94-43aa-4f0d-b353-24d2a39d6d8d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.332691 Oct 11 19:48:26.619834 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 907/1775] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:26 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:26.635644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d1f9f73c-6949-4646-a9ea-de9bd6e9dbb4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:26.638326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d1f9f73c-6949-4646-a9ea-de9bd6e9dbb4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:26.657833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1f9f73c-6949-4646-a9ea-de9bd6e9dbb4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:26.658535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1f9f73c-6949-4646-a9ea-de9bd6e9dbb4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:26.660747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1f9f73c-6949-4646-a9ea-de9bd6e9dbb4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:26.663749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1f9f73c-6949-4646-a9ea-de9bd6e9dbb4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:26.664372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1f9f73c-6949-4646-a9ea-de9bd6e9dbb4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:26.666716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1f9f73c-6949-4646-a9ea-de9bd6e9dbb4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:26.791408 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d1f9f73c-6949-4646-a9ea-de9bd6e9dbb4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "PUT /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1079 microversion: 2.1 time: 0.169677 Oct 11 19:48:26.802836 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 908/1776] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 11 19:48:26 2022] PUT /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1079 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:26.802836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c34a0c5-45f6-4e50-ae9f-281579fe03ce tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:26.802836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c34a0c5-45f6-4e50-ae9f-281579fe03ce tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:26.811448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c34a0c5-45f6-4e50-ae9f-281579fe03ce tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:26.812144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c34a0c5-45f6-4e50-ae9f-281579fe03ce tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:26.818732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c34a0c5-45f6-4e50-ae9f-281579fe03ce tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:26.819702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c34a0c5-45f6-4e50-ae9f-281579fe03ce tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:26.820474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c34a0c5-45f6-4e50-ae9f-281579fe03ce tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:26.821391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c34a0c5-45f6-4e50-ae9f-281579fe03ce tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:27.385736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c34a0c5-45f6-4e50-ae9f-281579fe03ce tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:27.401937 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c34a0c5-45f6-4e50-ae9f-281579fe03ce tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.608399 Oct 11 19:48:27.415556 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 909/1777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:26 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:27.431382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e1a481c-2151-48e1-99f2-96d9aebe3112 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:27.432022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1e1a481c-2151-48e1-99f2-96d9aebe3112 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:27.463201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e1a481c-2151-48e1-99f2-96d9aebe3112 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:27.465326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e1a481c-2151-48e1-99f2-96d9aebe3112 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:27.468733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e1a481c-2151-48e1-99f2-96d9aebe3112 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:27.473356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e1a481c-2151-48e1-99f2-96d9aebe3112 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:27.475336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e1a481c-2151-48e1-99f2-96d9aebe3112 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:27.475969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e1a481c-2151-48e1-99f2-96d9aebe3112 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:28.105609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1e1a481c-2151-48e1-99f2-96d9aebe3112 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:28.120749 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1e1a481c-2151-48e1-99f2-96d9aebe3112 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1505 microversion: 2.1 time: 0.706569 Oct 11 19:48:28.125946 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 910/1778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:27 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1505 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:28.148629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d341cb2c-f2da-47ed-b88b-5225d4e1d50f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:28.149591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d341cb2c-f2da-47ed-b88b-5225d4e1d50f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:28.164724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d341cb2c-f2da-47ed-b88b-5225d4e1d50f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:28.165302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d341cb2c-f2da-47ed-b88b-5225d4e1d50f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:28.165878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d341cb2c-f2da-47ed-b88b-5225d4e1d50f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:28.166745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d341cb2c-f2da-47ed-b88b-5225d4e1d50f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:28.167313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d341cb2c-f2da-47ed-b88b-5225d4e1d50f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:28.167848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d341cb2c-f2da-47ed-b88b-5225d4e1d50f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:28.481369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d341cb2c-f2da-47ed-b88b-5225d4e1d50f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:28.511006 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d341cb2c-f2da-47ed-b88b-5225d4e1d50f tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1476 microversion: 2.1 time: 0.382871 Oct 11 19:48:28.526967 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 911/1779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:28 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:28.533679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:28.534578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:28.541399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:28.541963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:28.542326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:28.543079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:28.543532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:28.543953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:28.655777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:28.665926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:28.667515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:28.674285 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c914adf1-e7f1-43ee-b635-256bbe580148 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1555 microversion: 2.91 time: 0.146142 Oct 11 19:48:28.676489 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 912/1780] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:28 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:28.681538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-32ada63d-087e-4bce-816c-717a1247dbb0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:28.682400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-32ada63d-087e-4bce-816c-717a1247dbb0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:28.695267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ada63d-087e-4bce-816c-717a1247dbb0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:28.696003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ada63d-087e-4bce-816c-717a1247dbb0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:28.703836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ada63d-087e-4bce-816c-717a1247dbb0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:28.704963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ada63d-087e-4bce-816c-717a1247dbb0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:28.706031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ada63d-087e-4bce-816c-717a1247dbb0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:28.706717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ada63d-087e-4bce-816c-717a1247dbb0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:29.016138 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e05336d3-8e5f-4973-97d6-e5046e07ba50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f/action" status: 202 len: 0 microversion: 2.1 time: 6.430324 Oct 11 19:48:29.017089 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 869/1781] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:48:22 2022] POST /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f/action => generated 0 bytes in 6432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:48:29.028978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0b00b148-1f8e-4004-aec5-cbde4d8510e0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:29.030694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0b00b148-1f8e-4004-aec5-cbde4d8510e0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:29.044807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-32ada63d-087e-4bce-816c-717a1247dbb0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:29.059361 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-32ada63d-087e-4bce-816c-717a1247dbb0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1505 microversion: 2.1 time: 0.381390 Oct 11 19:48:29.064649 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 913/1782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:28 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:29.072941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6d8e1048-bcd6-4dac-a9f2-ef67d1590ea6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:29.073639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6d8e1048-bcd6-4dac-a9f2-ef67d1590ea6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:29.076073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b00b148-1f8e-4004-aec5-cbde4d8510e0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:29.076584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b00b148-1f8e-4004-aec5-cbde4d8510e0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:29.077034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b00b148-1f8e-4004-aec5-cbde4d8510e0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:29.077879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b00b148-1f8e-4004-aec5-cbde4d8510e0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:29.078340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b00b148-1f8e-4004-aec5-cbde4d8510e0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:29.078803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b00b148-1f8e-4004-aec5-cbde4d8510e0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:29.126919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d8e1048-bcd6-4dac-a9f2-ef67d1590ea6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:29.129052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d8e1048-bcd6-4dac-a9f2-ef67d1590ea6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:29.141325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d8e1048-bcd6-4dac-a9f2-ef67d1590ea6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:29.142799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d8e1048-bcd6-4dac-a9f2-ef67d1590ea6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:29.151692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d8e1048-bcd6-4dac-a9f2-ef67d1590ea6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:29.152981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d8e1048-bcd6-4dac-a9f2-ef67d1590ea6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:29.798164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0b00b148-1f8e-4004-aec5-cbde4d8510e0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:29.809296 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0b00b148-1f8e-4004-aec5-cbde4d8510e0 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.790759 Oct 11 19:48:29.811552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6d8e1048-bcd6-4dac-a9f2-ef67d1590ea6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:29.834593 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 870/1783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:29 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:29.844256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:29.852350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:29.859681 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6d8e1048-bcd6-4dac-a9f2-ef67d1590ea6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1506 microversion: 2.1 time: 0.789758 Oct 11 19:48:29.869606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:29.871380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:29.876961 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 914/1784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:29 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1506 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:29.878881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:29.882912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:29.882912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:29.882912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:29.901420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a03aebda-4ffb-4148-867f-0e22420c97b7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:29.902236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a03aebda-4ffb-4148-867f-0e22420c97b7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:29.921542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a03aebda-4ffb-4148-867f-0e22420c97b7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:29.923247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a03aebda-4ffb-4148-867f-0e22420c97b7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:29.925852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a03aebda-4ffb-4148-867f-0e22420c97b7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:29.927607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a03aebda-4ffb-4148-867f-0e22420c97b7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:29.929141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a03aebda-4ffb-4148-867f-0e22420c97b7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:29.929726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a03aebda-4ffb-4148-867f-0e22420c97b7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:29.935413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:30.083036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:48:30.084225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:48:30.084970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:48:30.085626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:48:30.086290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:48:30.309453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:30.322985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:30.327696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:30.330413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:30.333739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:30.334446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:30.335825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:30.404160 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-36fb5f85-a33a-44a1-9396-9ed87076d00f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "POST /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f/action" status: 202 len: 1111 microversion: 2.1 time: 0.565830 Oct 11 19:48:30.407973 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 871/1785] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:48:29 2022] POST /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f/action => generated 1111 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 19:48:30.417319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:30.418269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:30.436149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:30.436980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:30.438836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:30.442636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:30.444672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:30.447904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:30.782851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:30.797119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:30.808232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:30.829477 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a247c1eb-3c66-4d4b-b7c2-c6ebc014dbbb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1537 microversion: 2.91 time: 0.420207 Oct 11 19:48:30.836860 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 872/1786] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:30 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1537 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:30.867751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-63a9ac8f-120d-45d2-aa76-bce4a5a49c17 req-a61fb884-cdd8-4348-a796-f5bbb524b400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b02ac4-7e82-46ed-b657-ed8e7a88fddc", "name": "network-vif-unplugged", "status": "completed", "tag": "6ff5fc05-e17c-4b5f-969c-e27ed352f61c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:30.907804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-63a9ac8f-120d-45d2-aa76-bce4a5a49c17 req-a61fb884-cdd8-4348-a796-f5bbb524b400 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:30.911351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-63a9ac8f-120d-45d2-aa76-bce4a5a49c17 req-a61fb884-cdd8-4348-a796-f5bbb524b400 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:30.914596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-63a9ac8f-120d-45d2-aa76-bce4a5a49c17 req-a61fb884-cdd8-4348-a796-f5bbb524b400 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:30.964463 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-63a9ac8f-120d-45d2-aa76-bce4a5a49c17 req-a61fb884-cdd8-4348-a796-f5bbb524b400 service nova] Creating event network-vif-unplugged:6ff5fc05-e17c-4b5f-969c-e27ed352f61c for instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc on n-h1-860864-3 Oct 11 19:48:30.997222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-63a9ac8f-120d-45d2-aa76-bce4a5a49c17 req-a61fb884-cdd8-4348-a796-f5bbb524b400 service nova] Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:48:31.035264 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-63a9ac8f-120d-45d2-aa76-bce4a5a49c17 req-a61fb884-cdd8-4348-a796-f5bbb524b400 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.192123 Oct 11 19:48:31.038337 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 873/1787] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:31.086013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-645f46fb-ad0c-40dc-8fd8-107381a80b71 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:31.088236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-645f46fb-ad0c-40dc-8fd8-107381a80b71 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:31.110639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-645f46fb-ad0c-40dc-8fd8-107381a80b71 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:31.115627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-645f46fb-ad0c-40dc-8fd8-107381a80b71 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:31.123218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-645f46fb-ad0c-40dc-8fd8-107381a80b71 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:31.126093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-645f46fb-ad0c-40dc-8fd8-107381a80b71 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:31.131758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-645f46fb-ad0c-40dc-8fd8-107381a80b71 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:31.132498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-645f46fb-ad0c-40dc-8fd8-107381a80b71 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:31.572414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a03aebda-4ffb-4148-867f-0e22420c97b7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:31.583282 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a03aebda-4ffb-4148-867f-0e22420c97b7 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1475 microversion: 2.1 time: 1.698757 Oct 11 19:48:31.606566 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 915/1788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:29 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1475 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:31.624140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-acf0f8de-eec6-4452-87d3-ca6f477fa650 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:31.624808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-acf0f8de-eec6-4452-87d3-ca6f477fa650 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:31.644935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-acf0f8de-eec6-4452-87d3-ca6f477fa650 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:31.654953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-acf0f8de-eec6-4452-87d3-ca6f477fa650 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:31.655591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-acf0f8de-eec6-4452-87d3-ca6f477fa650 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:31.656586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-acf0f8de-eec6-4452-87d3-ca6f477fa650 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:31.657249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-acf0f8de-eec6-4452-87d3-ca6f477fa650 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:31.657887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-acf0f8de-eec6-4452-87d3-ca6f477fa650 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:31.663623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:31.898500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-645f46fb-ad0c-40dc-8fd8-107381a80b71 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:31.913168 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-645f46fb-ad0c-40dc-8fd8-107381a80b71 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.869566 Oct 11 19:48:31.917816 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 874/1789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:31 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:31.928555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0cb43c8b-9afb-4ccf-a399-8f43f506e51e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:31.929800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0cb43c8b-9afb-4ccf-a399-8f43f506e51e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:31.958951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb43c8b-9afb-4ccf-a399-8f43f506e51e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:31.962406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb43c8b-9afb-4ccf-a399-8f43f506e51e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:31.963866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb43c8b-9afb-4ccf-a399-8f43f506e51e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:31.968335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb43c8b-9afb-4ccf-a399-8f43f506e51e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:31.969020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb43c8b-9afb-4ccf-a399-8f43f506e51e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:31.972559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cb43c8b-9afb-4ccf-a399-8f43f506e51e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:32.132232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-acf0f8de-eec6-4452-87d3-ca6f477fa650 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:32.149418 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-acf0f8de-eec6-4452-87d3-ca6f477fa650 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.540855 Oct 11 19:48:32.159509 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 916/1790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:31 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:32.180516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:32.181869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:32.197497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:32.198765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:32.201237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:32.202023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:32.202493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:32.205071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:32.366391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:32.392164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:32.399171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0cb43c8b-9afb-4ccf-a399-8f43f506e51e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:32.399748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:32.408258 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0cb43c8b-9afb-4ccf-a399-8f43f506e51e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1506 microversion: 2.1 time: 0.487513 Oct 11 19:48:32.417846 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 875/1791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:31 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:32.430296 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-85c016c0-a4af-4158-a2f1-5e6971aaae80 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1537 microversion: 2.91 time: 0.265905 Oct 11 19:48:32.432078 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 917/1792] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:32 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1537 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:32.625265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0a1b95c-6db9-4ac6-ae2c-eb1ad8b3eee5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:32.626235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f0a1b95c-6db9-4ac6-ae2c-eb1ad8b3eee5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:32.634878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a1b95c-6db9-4ac6-ae2c-eb1ad8b3eee5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:32.644671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a1b95c-6db9-4ac6-ae2c-eb1ad8b3eee5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:32.645525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a1b95c-6db9-4ac6-ae2c-eb1ad8b3eee5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:32.646369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a1b95c-6db9-4ac6-ae2c-eb1ad8b3eee5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:32.648655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a1b95c-6db9-4ac6-ae2c-eb1ad8b3eee5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:32.649207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a1b95c-6db9-4ac6-ae2c-eb1ad8b3eee5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:32.946208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fcd04d05-2549-4c2d-b578-b2fc9c5e8460 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:32.947779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fcd04d05-2549-4c2d-b578-b2fc9c5e8460 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:32.958220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd04d05-2549-4c2d-b578-b2fc9c5e8460 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:32.963447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd04d05-2549-4c2d-b578-b2fc9c5e8460 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:32.964148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd04d05-2549-4c2d-b578-b2fc9c5e8460 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:32.965204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd04d05-2549-4c2d-b578-b2fc9c5e8460 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:32.965895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd04d05-2549-4c2d-b578-b2fc9c5e8460 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:32.966586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd04d05-2549-4c2d-b578-b2fc9c5e8460 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:33.238272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f0a1b95c-6db9-4ac6-ae2c-eb1ad8b3eee5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:33.252919 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f0a1b95c-6db9-4ac6-ae2c-eb1ad8b3eee5 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1475 microversion: 2.1 time: 0.625471 Oct 11 19:48:33.256422 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 876/1793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:32 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1475 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:33.283555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-95b2c192-5bdd-4283-97c2-056bd70f23f9 req-ac542b57-6c71-4682-9aec-92beb952f5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b02ac4-7e82-46ed-b657-ed8e7a88fddc", "tag": "6ff5fc05-e17c-4b5f-969c-e27ed352f61c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:33.329319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-95b2c192-5bdd-4283-97c2-056bd70f23f9 req-ac542b57-6c71-4682-9aec-92beb952f5a3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:33.334470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-95b2c192-5bdd-4283-97c2-056bd70f23f9 req-ac542b57-6c71-4682-9aec-92beb952f5a3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:33.336335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-95b2c192-5bdd-4283-97c2-056bd70f23f9 req-ac542b57-6c71-4682-9aec-92beb952f5a3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:33.393718 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-95b2c192-5bdd-4283-97c2-056bd70f23f9 req-ac542b57-6c71-4682-9aec-92beb952f5a3 service nova] Creating event network-changed:6ff5fc05-e17c-4b5f-969c-e27ed352f61c for instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc on n-h1-860864-3 Oct 11 19:48:33.422289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-95b2c192-5bdd-4283-97c2-056bd70f23f9 req-ac542b57-6c71-4682-9aec-92beb952f5a3 service nova] Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:48:33.480777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fcd04d05-2549-4c2d-b578-b2fc9c5e8460 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:33.483398 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-95b2c192-5bdd-4283-97c2-056bd70f23f9 req-ac542b57-6c71-4682-9aec-92beb952f5a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223485 Oct 11 19:48:33.486512 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 877/1794] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:33.492060 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fcd04d05-2549-4c2d-b578-b2fc9c5e8460 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.549916 Oct 11 19:48:33.496152 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 918/1795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:32 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:48:33.517394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9d6f2d5d-1acf-478b-b9c5-cff442a9b408 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:33.520155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9d6f2d5d-1acf-478b-b9c5-cff442a9b408 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:33.520784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6240987-9abc-4b43-9ba4-13b3a0d8fe23 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:33.522969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d6240987-9abc-4b43-9ba4-13b3a0d8fe23 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:33.544725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6240987-9abc-4b43-9ba4-13b3a0d8fe23 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:33.545475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6240987-9abc-4b43-9ba4-13b3a0d8fe23 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:33.546406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6240987-9abc-4b43-9ba4-13b3a0d8fe23 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:33.550353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6240987-9abc-4b43-9ba4-13b3a0d8fe23 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:33.551117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6240987-9abc-4b43-9ba4-13b3a0d8fe23 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:33.551798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6240987-9abc-4b43-9ba4-13b3a0d8fe23 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:33.559058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d6f2d5d-1acf-478b-b9c5-cff442a9b408 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:33.565122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d6f2d5d-1acf-478b-b9c5-cff442a9b408 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:33.568588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d6f2d5d-1acf-478b-b9c5-cff442a9b408 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:33.571613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d6f2d5d-1acf-478b-b9c5-cff442a9b408 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:33.580301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d6f2d5d-1acf-478b-b9c5-cff442a9b408 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:33.581774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d6f2d5d-1acf-478b-b9c5-cff442a9b408 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:34.164286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9d6f2d5d-1acf-478b-b9c5-cff442a9b408 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:34.179520 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9d6f2d5d-1acf-478b-b9c5-cff442a9b408 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1506 microversion: 2.1 time: 0.680086 Oct 11 19:48:34.189242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d6240987-9abc-4b43-9ba4-13b3a0d8fe23 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:34.203815 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 919/1796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:33 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1506 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:34.206209 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d6240987-9abc-4b43-9ba4-13b3a0d8fe23 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.714976 Oct 11 19:48:34.207852 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 878/1797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:33 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:34.210592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:34.211406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:34.218968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:34.219726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:34.220365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:34.221474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:34.222183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:34.222957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:34.317235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:34.330918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:34.333483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:34.339656 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a57083b-0f6f-40c2-8f9a-a13dbe2687dc tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1540 microversion: 2.91 time: 0.134471 Oct 11 19:48:34.341325 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 920/1798] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:34 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1540 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:34.395002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0fc517e-0aac-46ef-a58a-d5c887e2b893 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860864-3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:34.401079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0fc517e-0aac-46ef-a58a-d5c887e2b893 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:34.419085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0fc517e-0aac-46ef-a58a-d5c887e2b893 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:34.419936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0fc517e-0aac-46ef-a58a-d5c887e2b893 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:34.420853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0fc517e-0aac-46ef-a58a-d5c887e2b893 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:34.421778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0fc517e-0aac-46ef-a58a-d5c887e2b893 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:34.427017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0fc517e-0aac-46ef-a58a-d5c887e2b893 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:34.428199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0fc517e-0aac-46ef-a58a-d5c887e2b893 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:34.518194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0fc517e-0aac-46ef-a58a-d5c887e2b893 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860864-3". {{(pid=126956) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 19:48:34.599807 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0fc517e-0aac-46ef-a58a-d5c887e2b893 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0/action" status: 202 len: 0 microversion: 2.91 time: 0.215289 Oct 11 19:48:34.606180 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 921/1799] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:48:34 2022] POST /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:48:34.620074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-64ddb489-b26c-4738-a2e0-6c1219849b17 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:34.620803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-64ddb489-b26c-4738-a2e0-6c1219849b17 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:34.638409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ddb489-b26c-4738-a2e0-6c1219849b17 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:34.639353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ddb489-b26c-4738-a2e0-6c1219849b17 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:34.641154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ddb489-b26c-4738-a2e0-6c1219849b17 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:34.643696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ddb489-b26c-4738-a2e0-6c1219849b17 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:34.644631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ddb489-b26c-4738-a2e0-6c1219849b17 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:34.645729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ddb489-b26c-4738-a2e0-6c1219849b17 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:34.867749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97cf3840-8241-48b0-9f93-61d55846ffd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:34.868518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97cf3840-8241-48b0-9f93-61d55846ffd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:34.886867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97cf3840-8241-48b0-9f93-61d55846ffd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:34.888236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97cf3840-8241-48b0-9f93-61d55846ffd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:34.889236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97cf3840-8241-48b0-9f93-61d55846ffd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:34.891573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97cf3840-8241-48b0-9f93-61d55846ffd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:34.893089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97cf3840-8241-48b0-9f93-61d55846ffd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:34.893683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97cf3840-8241-48b0-9f93-61d55846ffd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:35.109804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-64ddb489-b26c-4738-a2e0-6c1219849b17 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:35.130776 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-64ddb489-b26c-4738-a2e0-6c1219849b17 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.522385 Oct 11 19:48:35.132339 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 922/1800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:34 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:35.150011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:35.150969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:35.166489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:35.168235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:35.169306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:35.177713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:35.178647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:35.179455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:35.407674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:35.422157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:35.436572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:35.448603 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-686a04f3-cc8e-4127-b9e1-6ba7d6f353ce tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1488 microversion: 2.91 time: 0.314928 Oct 11 19:48:35.454585 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 923/1801] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:35 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1488 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:35.463197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8253e6da-b9cc-442a-af2b-b7e46fe543ba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:35.467665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8253e6da-b9cc-442a-af2b-b7e46fe543ba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:35.482580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8253e6da-b9cc-442a-af2b-b7e46fe543ba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:35.484091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8253e6da-b9cc-442a-af2b-b7e46fe543ba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:35.485701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8253e6da-b9cc-442a-af2b-b7e46fe543ba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:35.488966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8253e6da-b9cc-442a-af2b-b7e46fe543ba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:35.490308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8253e6da-b9cc-442a-af2b-b7e46fe543ba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:35.492519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8253e6da-b9cc-442a-af2b-b7e46fe543ba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:35.634212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97cf3840-8241-48b0-9f93-61d55846ffd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:35.654077 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97cf3840-8241-48b0-9f93-61d55846ffd2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1473 microversion: 2.1 time: 1.370508 Oct 11 19:48:35.667512 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 879/1802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:34 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1473 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:35.681344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-01835734-a24e-48a1-a90f-b3c6cf295979 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:35.682238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-01835734-a24e-48a1-a90f-b3c6cf295979 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:35.691041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01835734-a24e-48a1-a90f-b3c6cf295979 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:35.692039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01835734-a24e-48a1-a90f-b3c6cf295979 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:35.692807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01835734-a24e-48a1-a90f-b3c6cf295979 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:35.693737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01835734-a24e-48a1-a90f-b3c6cf295979 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:35.694361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01835734-a24e-48a1-a90f-b3c6cf295979 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:35.694991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01835734-a24e-48a1-a90f-b3c6cf295979 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:35.919190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8253e6da-b9cc-442a-af2b-b7e46fe543ba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:35.941195 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8253e6da-b9cc-442a-af2b-b7e46fe543ba tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1506 microversion: 2.1 time: 0.486843 Oct 11 19:48:35.968071 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 924/1803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:35 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1506 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:36.078846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-01835734-a24e-48a1-a90f-b3c6cf295979 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:36.092134 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-01835734-a24e-48a1-a90f-b3c6cf295979 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.423224 Oct 11 19:48:36.092720 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 880/1804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:35 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:36.167204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-47e593f8-d36b-4e30-9412-6d0dea32c09c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:36.167933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-47e593f8-d36b-4e30-9412-6d0dea32c09c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:36.198059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47e593f8-d36b-4e30-9412-6d0dea32c09c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:36.199352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47e593f8-d36b-4e30-9412-6d0dea32c09c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:36.202207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47e593f8-d36b-4e30-9412-6d0dea32c09c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:36.202999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47e593f8-d36b-4e30-9412-6d0dea32c09c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:36.203512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47e593f8-d36b-4e30-9412-6d0dea32c09c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:36.203942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47e593f8-d36b-4e30-9412-6d0dea32c09c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:36.489465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:36.491210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:36.502881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:36.504425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:36.506050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:36.508913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:36.510699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:36.512775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:36.542652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-47e593f8-d36b-4e30-9412-6d0dea32c09c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:36.559094 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-47e593f8-d36b-4e30-9412-6d0dea32c09c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.404135 Oct 11 19:48:36.561036 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 925/1805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:36 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:36.632189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:36.648773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:36.653723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:36.666308 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d42349b9-4578-4c78-b5f8-c34002613a7c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1488 microversion: 2.91 time: 0.187910 Oct 11 19:48:36.685148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2cc44be1-5f10-4506-8d4e-851b3a0e5609 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:36.686423 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 881/1806] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:36 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1488 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:48:36.687032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2cc44be1-5f10-4506-8d4e-851b3a0e5609 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:36.704940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cc44be1-5f10-4506-8d4e-851b3a0e5609 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:36.707208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cc44be1-5f10-4506-8d4e-851b3a0e5609 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:36.708198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cc44be1-5f10-4506-8d4e-851b3a0e5609 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:36.709482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cc44be1-5f10-4506-8d4e-851b3a0e5609 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:36.710243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cc44be1-5f10-4506-8d4e-851b3a0e5609 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:36.711007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cc44be1-5f10-4506-8d4e-851b3a0e5609 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:36.969874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc1205a0-6fc5-4bde-a8c8-b9d82cfb0389 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:36.972344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc1205a0-6fc5-4bde-a8c8-b9d82cfb0389 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:36.994362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1205a0-6fc5-4bde-a8c8-b9d82cfb0389 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:36.995878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1205a0-6fc5-4bde-a8c8-b9d82cfb0389 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:36.998383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1205a0-6fc5-4bde-a8c8-b9d82cfb0389 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:37.001563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1205a0-6fc5-4bde-a8c8-b9d82cfb0389 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:37.003711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1205a0-6fc5-4bde-a8c8-b9d82cfb0389 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:37.007102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1205a0-6fc5-4bde-a8c8-b9d82cfb0389 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:37.037662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2cc44be1-5f10-4506-8d4e-851b3a0e5609 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:37.051746 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2cc44be1-5f10-4506-8d4e-851b3a0e5609 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1470 microversion: 2.1 time: 0.371430 Oct 11 19:48:37.066689 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 926/1807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:36 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1470 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:48:37.099521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10523e9c-59df-4cdf-881d-94924c9a07c1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:37.101016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10523e9c-59df-4cdf-881d-94924c9a07c1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:37.115683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10523e9c-59df-4cdf-881d-94924c9a07c1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:37.117013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10523e9c-59df-4cdf-881d-94924c9a07c1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:37.119738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10523e9c-59df-4cdf-881d-94924c9a07c1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:37.121986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10523e9c-59df-4cdf-881d-94924c9a07c1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:37.123221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10523e9c-59df-4cdf-881d-94924c9a07c1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:37.126012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10523e9c-59df-4cdf-881d-94924c9a07c1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:37.507039 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10523e9c-59df-4cdf-881d-94924c9a07c1 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "POST /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc/action" status: 202 len: 0 microversion: 2.1 time: 0.411703 Oct 11 19:48:37.508025 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 927/1808] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:48:37 2022] POST /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:48:37.527722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1796de5b-d503-4217-96ac-21338e87d80b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:37.531711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1796de5b-d503-4217-96ac-21338e87d80b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:37.540837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fc1205a0-6fc5-4bde-a8c8-b9d82cfb0389 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:37.547281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1796de5b-d503-4217-96ac-21338e87d80b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:37.547281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1796de5b-d503-4217-96ac-21338e87d80b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:37.548171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1796de5b-d503-4217-96ac-21338e87d80b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:37.548579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1796de5b-d503-4217-96ac-21338e87d80b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:37.549587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1796de5b-d503-4217-96ac-21338e87d80b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:37.550892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1796de5b-d503-4217-96ac-21338e87d80b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:37.564624 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc1205a0-6fc5-4bde-a8c8-b9d82cfb0389 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1506 microversion: 2.1 time: 0.597247 Oct 11 19:48:37.566959 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 882/1809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:36 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:48:37.593205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b996fcfc-c4c1-4a9e-83bd-d038ed6c1f69 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:37.600037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b996fcfc-c4c1-4a9e-83bd-d038ed6c1f69 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:37.626702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b996fcfc-c4c1-4a9e-83bd-d038ed6c1f69 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:37.627484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b996fcfc-c4c1-4a9e-83bd-d038ed6c1f69 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:37.631022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b996fcfc-c4c1-4a9e-83bd-d038ed6c1f69 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:37.632589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b996fcfc-c4c1-4a9e-83bd-d038ed6c1f69 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:37.634722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b996fcfc-c4c1-4a9e-83bd-d038ed6c1f69 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:37.637719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b996fcfc-c4c1-4a9e-83bd-d038ed6c1f69 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:38.204630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1796de5b-d503-4217-96ac-21338e87d80b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:38.216516 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1796de5b-d503-4217-96ac-21338e87d80b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.706671 Oct 11 19:48:38.237817 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 928/1810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:37 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:38.242907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6d822c0-7ab8-4678-b71d-c58f1d31583f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:38.243551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b6d822c0-7ab8-4678-b71d-c58f1d31583f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:38.257011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b996fcfc-c4c1-4a9e-83bd-d038ed6c1f69 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:38.262092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d822c0-7ab8-4678-b71d-c58f1d31583f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:38.262635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d822c0-7ab8-4678-b71d-c58f1d31583f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:38.263085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d822c0-7ab8-4678-b71d-c58f1d31583f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:38.263806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d822c0-7ab8-4678-b71d-c58f1d31583f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:38.264264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d822c0-7ab8-4678-b71d-c58f1d31583f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:38.264696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d822c0-7ab8-4678-b71d-c58f1d31583f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:38.287534 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b996fcfc-c4c1-4a9e-83bd-d038ed6c1f69 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1469 microversion: 2.1 time: 0.712127 Oct 11 19:48:38.288811 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 883/1811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:37 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1469 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:38.315331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:38.317468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:38.344777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:38.350069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:38.351861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:38.354025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:38.355887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:38.357676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:38.537947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:38.552660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:38.557851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:38.565796 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-142d31b3-ddea-403f-b151-fb4554de6e7d tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1488 microversion: 2.91 time: 0.273366 Oct 11 19:48:38.566736 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 884/1812] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:38 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1488 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:38.595416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05f9469e-b36a-472d-b481-f2936e8174c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:38.597383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05f9469e-b36a-472d-b481-f2936e8174c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:38.605439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b6d822c0-7ab8-4678-b71d-c58f1d31583f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:38.612342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:38.618867 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b6d822c0-7ab8-4678-b71d-c58f1d31583f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.379713 Oct 11 19:48:38.620106 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 929/1813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:38 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:38.637707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f9469e-b36a-472d-b481-f2936e8174c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:38.639781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f9469e-b36a-472d-b481-f2936e8174c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:38.641820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f9469e-b36a-472d-b481-f2936e8174c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:38.643261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f9469e-b36a-472d-b481-f2936e8174c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:38.646253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f9469e-b36a-472d-b481-f2936e8174c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:38.647767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f9469e-b36a-472d-b481-f2936e8174c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:39.053371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-05f9469e-b36a-472d-b481-f2936e8174c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:39.077086 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05f9469e-b36a-472d-b481-f2936e8174c2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1506 microversion: 2.1 time: 0.474918 Oct 11 19:48:39.081591 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 885/1814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:38 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:39.253236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9b3e1d39-7016-4ecd-8f4b-ff40e6f7c8ae tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:39.259803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9b3e1d39-7016-4ecd-8f4b-ff40e6f7c8ae tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:39.274844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b3e1d39-7016-4ecd-8f4b-ff40e6f7c8ae tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:39.277337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b3e1d39-7016-4ecd-8f4b-ff40e6f7c8ae tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:39.277801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b3e1d39-7016-4ecd-8f4b-ff40e6f7c8ae tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:39.278920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b3e1d39-7016-4ecd-8f4b-ff40e6f7c8ae tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:39.279867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b3e1d39-7016-4ecd-8f4b-ff40e6f7c8ae tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:39.280374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b3e1d39-7016-4ecd-8f4b-ff40e6f7c8ae tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:39.318870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b421e924-43fc-4496-9986-18df1d9ba172 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:39.319560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b421e924-43fc-4496-9986-18df1d9ba172 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:39.332800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b421e924-43fc-4496-9986-18df1d9ba172 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:39.333266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b421e924-43fc-4496-9986-18df1d9ba172 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:39.334305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b421e924-43fc-4496-9986-18df1d9ba172 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:39.334443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b421e924-43fc-4496-9986-18df1d9ba172 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:39.335487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b421e924-43fc-4496-9986-18df1d9ba172 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:39.335487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b421e924-43fc-4496-9986-18df1d9ba172 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:39.691686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9b3e1d39-7016-4ecd-8f4b-ff40e6f7c8ae tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:39.707215 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9b3e1d39-7016-4ecd-8f4b-ff40e6f7c8ae tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.465223 Oct 11 19:48:39.708103 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 930/1815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:39 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:39.714144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-bc1972e5-34a0-46ba-81b8-54b4ac837a47 req-8a847cbe-933c-495f-bcca-e989d5a62551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b02ac4-7e82-46ed-b657-ed8e7a88fddc", "name": "network-vif-plugged", "status": "completed", "tag": "6ff5fc05-e17c-4b5f-969c-e27ed352f61c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:39.727624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc1972e5-34a0-46ba-81b8-54b4ac837a47 req-8a847cbe-933c-495f-bcca-e989d5a62551 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:39.728282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc1972e5-34a0-46ba-81b8-54b4ac837a47 req-8a847cbe-933c-495f-bcca-e989d5a62551 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:39.728805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc1972e5-34a0-46ba-81b8-54b4ac837a47 req-8a847cbe-933c-495f-bcca-e989d5a62551 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:39.741865 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bc1972e5-34a0-46ba-81b8-54b4ac837a47 req-8a847cbe-933c-495f-bcca-e989d5a62551 service nova] Creating event network-vif-plugged:6ff5fc05-e17c-4b5f-969c-e27ed352f61c for instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc on n-h1-860864-3 Oct 11 19:48:39.748673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-bc1972e5-34a0-46ba-81b8-54b4ac837a47 req-8a847cbe-933c-495f-bcca-e989d5a62551 service nova] Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:48:39.784864 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-bc1972e5-34a0-46ba-81b8-54b4ac837a47 req-8a847cbe-933c-495f-bcca-e989d5a62551 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075147 Oct 11 19:48:39.788086 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 931/1816] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:39.801943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:39.807371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:39.824469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:39.825318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:39.825946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:39.826883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:39.827509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:39.842656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:39.901155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b421e924-43fc-4496-9986-18df1d9ba172 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:39.907869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:39.911459 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b421e924-43fc-4496-9986-18df1d9ba172 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1469 microversion: 2.1 time: 0.598967 Oct 11 19:48:39.912103 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 886/1817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:39 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1469 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:39.927598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8614c519-a5cf-4ba1-841b-9a4487dabfba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:39.935798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8614c519-a5cf-4ba1-841b-9a4487dabfba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:39.950169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8614c519-a5cf-4ba1-841b-9a4487dabfba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:39.952408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8614c519-a5cf-4ba1-841b-9a4487dabfba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:39.953088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8614c519-a5cf-4ba1-841b-9a4487dabfba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:39.955128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8614c519-a5cf-4ba1-841b-9a4487dabfba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:39.957632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8614c519-a5cf-4ba1-841b-9a4487dabfba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:39.966798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8614c519-a5cf-4ba1-841b-9a4487dabfba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:39.975254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:39.987402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:39.996472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:40.004851 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-35732c3b-45b8-4742-821e-9226d25a3492 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1488 microversion: 2.91 time: 0.217164 Oct 11 19:48:40.006973 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 932/1818] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:39 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1488 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:40.109671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3975223-49db-424b-923b-663ad28b1f50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:40.111502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3975223-49db-424b-923b-663ad28b1f50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:40.119551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3975223-49db-424b-923b-663ad28b1f50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:40.120437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3975223-49db-424b-923b-663ad28b1f50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:40.120975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3975223-49db-424b-923b-663ad28b1f50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:40.122186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3975223-49db-424b-923b-663ad28b1f50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:40.122951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3975223-49db-424b-923b-663ad28b1f50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:40.123696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3975223-49db-424b-923b-663ad28b1f50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:41.001976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8614c519-a5cf-4ba1-841b-9a4487dabfba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:41.013585 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8614c519-a5cf-4ba1-841b-9a4487dabfba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 1.089764 Oct 11 19:48:41.015999 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 887/1819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:39 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:41.032746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-985799ec-653a-4a1c-9261-3ee393568cc8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:41.034470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-985799ec-653a-4a1c-9261-3ee393568cc8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:41.053643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c3975223-49db-424b-923b-663ad28b1f50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:41.055229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985799ec-653a-4a1c-9261-3ee393568cc8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:41.058280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985799ec-653a-4a1c-9261-3ee393568cc8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:41.059003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985799ec-653a-4a1c-9261-3ee393568cc8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:41.061437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985799ec-653a-4a1c-9261-3ee393568cc8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:41.065004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985799ec-653a-4a1c-9261-3ee393568cc8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:41.065540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-985799ec-653a-4a1c-9261-3ee393568cc8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:41.069019 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3975223-49db-424b-923b-663ad28b1f50 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1506 microversion: 2.1 time: 0.965862 Oct 11 19:48:41.080785 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 933/1820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:40 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1506 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:48:41.088198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c40e5a2a-8973-4a50-b7ba-997613734847 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:41.089119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c40e5a2a-8973-4a50-b7ba-997613734847 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:41.104932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c40e5a2a-8973-4a50-b7ba-997613734847 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:41.106352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c40e5a2a-8973-4a50-b7ba-997613734847 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:41.109245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c40e5a2a-8973-4a50-b7ba-997613734847 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:41.110320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c40e5a2a-8973-4a50-b7ba-997613734847 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:41.114070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c40e5a2a-8973-4a50-b7ba-997613734847 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:41.114831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c40e5a2a-8973-4a50-b7ba-997613734847 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:41.732094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c40e5a2a-8973-4a50-b7ba-997613734847 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:41.736420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-985799ec-653a-4a1c-9261-3ee393568cc8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:41.742248 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c40e5a2a-8973-4a50-b7ba-997613734847 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1469 microversion: 2.1 time: 0.664879 Oct 11 19:48:41.753864 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-985799ec-653a-4a1c-9261-3ee393568cc8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.731579 Oct 11 19:48:41.753864 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 888/1821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:41 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:41.759950 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 934/1822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:41 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1469 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:41.769609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:41.770182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:41.776890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:41.777788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:41.777987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:41.779111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:41.779585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:41.780011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:41.991800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f8462cd-623c-4ac7-9159-9b054c41ccbf tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Action: 'create', calling method: .version_select at 0x7f83d086b8b0>, body: {"keypair": {"name": "tempest-keypair-964336370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUtPDPNus9rllz/XkoyKaZZzldVqVTFzMZS91wUQkt1z2tx3kq1YFhVUV1vgrbUshddZLcAnrFHElNE2SJAI0k5OYCpWZO3mpzj2aUe622s+VdEd+ZWbbHp7ZhfzQMVEw=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:42.003008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:42.018051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:42.037841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:42.054289 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c90c8c7-3cf1-431d-a4ab-05f383cf9eae tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1488 microversion: 2.91 time: 0.300436 Oct 11 19:48:42.058607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-0f8462cd-623c-4ac7-9159-9b054c41ccbf tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Getting quotas for project 9043fe6f133c4c1d876227fa7dfcbda3. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:48:42.062227 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 889/1823] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:41 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1488 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:42.070793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-0f8462cd-623c-4ac7-9159-9b054c41ccbf tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Getting quotas for user 69553a727c3147f2bbaf203f17419830 and project 9043fe6f133c4c1d876227fa7dfcbda3. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:48:42.074829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-339cec16-e24e-49d2-86fc-5b27702ebab4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:42.077642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-339cec16-e24e-49d2-86fc-5b27702ebab4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:42.093571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-339cec16-e24e-49d2-86fc-5b27702ebab4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:42.095322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-339cec16-e24e-49d2-86fc-5b27702ebab4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:42.095949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-339cec16-e24e-49d2-86fc-5b27702ebab4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:42.097714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-339cec16-e24e-49d2-86fc-5b27702ebab4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:42.099018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-339cec16-e24e-49d2-86fc-5b27702ebab4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:42.100479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-339cec16-e24e-49d2-86fc-5b27702ebab4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:42.128154 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f8462cd-623c-4ac7-9159-9b054c41ccbf tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.372153 Oct 11 19:48:42.129429 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 935/1824] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:48:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:42.135898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-728b55a7-5047-43c5-8a51-879042ff75a5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:42.137217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-728b55a7-5047-43c5-8a51-879042ff75a5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:42.154065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-728b55a7-5047-43c5-8a51-879042ff75a5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:42.161872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-728b55a7-5047-43c5-8a51-879042ff75a5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:42.162968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-728b55a7-5047-43c5-8a51-879042ff75a5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:42.163937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-728b55a7-5047-43c5-8a51-879042ff75a5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:42.164661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-728b55a7-5047-43c5-8a51-879042ff75a5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:42.165350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-728b55a7-5047-43c5-8a51-879042ff75a5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:42.678742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-339cec16-e24e-49d2-86fc-5b27702ebab4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:42.686708 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-339cec16-e24e-49d2-86fc-5b27702ebab4 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.619973 Oct 11 19:48:42.687866 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 890/1825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:42 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:42.693436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-cd96e96b-b19b-4c04-a8ec-5a9cf2f19669 req-b8415a02-bb80-4409-812d-3ead98091f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d", "name": "network-vif-unplugged", "status": "completed", "tag": "469331a7-5446-4a38-be81-b82560e149f6"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:42.703661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd96e96b-b19b-4c04-a8ec-5a9cf2f19669 req-b8415a02-bb80-4409-812d-3ead98091f24 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:42.704448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd96e96b-b19b-4c04-a8ec-5a9cf2f19669 req-b8415a02-bb80-4409-812d-3ead98091f24 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:42.705199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd96e96b-b19b-4c04-a8ec-5a9cf2f19669 req-b8415a02-bb80-4409-812d-3ead98091f24 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:42.718861 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-cd96e96b-b19b-4c04-a8ec-5a9cf2f19669 req-b8415a02-bb80-4409-812d-3ead98091f24 service nova] Creating event network-vif-unplugged:469331a7-5446-4a38-be81-b82560e149f6 for instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d on n-h1-860864-3 Oct 11 19:48:42.724990 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-cd96e96b-b19b-4c04-a8ec-5a9cf2f19669 req-b8415a02-bb80-4409-812d-3ead98091f24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035591 Oct 11 19:48:42.726042 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 891/1826] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:42.731780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-728b55a7-5047-43c5-8a51-879042ff75a5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:42.749137 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-728b55a7-5047-43c5-8a51-879042ff75a5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1506 microversion: 2.1 time: 0.618534 Oct 11 19:48:42.750394 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 936/1827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:42 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:42.769769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5f262309-26ce-4ebc-accc-72dbc6580441 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:42.770590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f262309-26ce-4ebc-accc-72dbc6580441 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:42.780332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-34d5349c-c0c3-4366-a94c-c19f74798a97 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:42.781609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-34d5349c-c0c3-4366-a94c-c19f74798a97 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:42.793398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34d5349c-c0c3-4366-a94c-c19f74798a97 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:42.795073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34d5349c-c0c3-4366-a94c-c19f74798a97 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:42.795775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34d5349c-c0c3-4366-a94c-c19f74798a97 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:42.796738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34d5349c-c0c3-4366-a94c-c19f74798a97 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:42.797369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34d5349c-c0c3-4366-a94c-c19f74798a97 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:42.797571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f262309-26ce-4ebc-accc-72dbc6580441 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:42.798178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34d5349c-c0c3-4366-a94c-c19f74798a97 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:42.800151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f262309-26ce-4ebc-accc-72dbc6580441 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:42.801312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f262309-26ce-4ebc-accc-72dbc6580441 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:42.802948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f262309-26ce-4ebc-accc-72dbc6580441 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:42.804291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f262309-26ce-4ebc-accc-72dbc6580441 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:42.804722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f262309-26ce-4ebc-accc-72dbc6580441 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:43.407265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5f262309-26ce-4ebc-accc-72dbc6580441 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:43.412066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-34d5349c-c0c3-4366-a94c-c19f74798a97 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:43.435402 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5f262309-26ce-4ebc-accc-72dbc6580441 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1469 microversion: 2.1 time: 0.662606 Oct 11 19:48:43.440117 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 892/1828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:42 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1469 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:43.448938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:43.461975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:43.467637 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-34d5349c-c0c3-4366-a94c-c19f74798a97 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.695177 Oct 11 19:48:43.471229 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 937/1829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:42 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:43.493569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:43.497719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:43.500258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:43.503903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:43.506001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:43.506952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:43.716870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e5a22130-0c03-4f87-8dc4-0af48fc5cd00 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:43.717650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e5a22130-0c03-4f87-8dc4-0af48fc5cd00 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:43.750256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5a22130-0c03-4f87-8dc4-0af48fc5cd00 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:43.751139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5a22130-0c03-4f87-8dc4-0af48fc5cd00 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:43.757504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5a22130-0c03-4f87-8dc4-0af48fc5cd00 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:43.761725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5a22130-0c03-4f87-8dc4-0af48fc5cd00 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:43.762357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5a22130-0c03-4f87-8dc4-0af48fc5cd00 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:43.763464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:43.769668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5a22130-0c03-4f87-8dc4-0af48fc5cd00 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:43.783588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:43.785377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:43.811800 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3addc00c-1084-4b96-8491-67b06c4c7bbe tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.369755 Oct 11 19:48:43.817599 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 893/1830] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:43 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:43.831204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21953389-37e9-4a96-9411-40888b89f58f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:43.834235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-21953389-37e9-4a96-9411-40888b89f58f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:43.865443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21953389-37e9-4a96-9411-40888b89f58f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:43.866069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21953389-37e9-4a96-9411-40888b89f58f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:43.866655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21953389-37e9-4a96-9411-40888b89f58f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:43.867485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21953389-37e9-4a96-9411-40888b89f58f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:43.869216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21953389-37e9-4a96-9411-40888b89f58f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:43.869765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21953389-37e9-4a96-9411-40888b89f58f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:44.895928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e5a22130-0c03-4f87-8dc4-0af48fc5cd00 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:44.928378 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e5a22130-0c03-4f87-8dc4-0af48fc5cd00 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 1.219121 Oct 11 19:48:44.931364 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 938/1831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:43 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:44.941744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7f99f8f4-8036-4b0c-9c36-232cb02e9710 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:44.959655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7f99f8f4-8036-4b0c-9c36-232cb02e9710 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:44.977022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f99f8f4-8036-4b0c-9c36-232cb02e9710 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:44.978136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f99f8f4-8036-4b0c-9c36-232cb02e9710 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:44.980008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f99f8f4-8036-4b0c-9c36-232cb02e9710 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:44.980779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f99f8f4-8036-4b0c-9c36-232cb02e9710 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:44.986848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f99f8f4-8036-4b0c-9c36-232cb02e9710 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:44.987381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f99f8f4-8036-4b0c-9c36-232cb02e9710 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:45.043292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-21953389-37e9-4a96-9411-40888b89f58f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:45.064315 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21953389-37e9-4a96-9411-40888b89f58f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1506 microversion: 2.1 time: 1.244852 Oct 11 19:48:45.066904 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 894/1832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:43 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1506 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:45.090765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32651bb5-a314-4a0c-a652-5ca483d7038c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:45.090765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-32651bb5-a314-4a0c-a652-5ca483d7038c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:45.106296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32651bb5-a314-4a0c-a652-5ca483d7038c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:45.107886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32651bb5-a314-4a0c-a652-5ca483d7038c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:45.109525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32651bb5-a314-4a0c-a652-5ca483d7038c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:45.111968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32651bb5-a314-4a0c-a652-5ca483d7038c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:45.114598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32651bb5-a314-4a0c-a652-5ca483d7038c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:45.115038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32651bb5-a314-4a0c-a652-5ca483d7038c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:46.184573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7f99f8f4-8036-4b0c-9c36-232cb02e9710 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:46.200214 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7f99f8f4-8036-4b0c-9c36-232cb02e9710 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1469 microversion: 2.1 time: 1.265378 Oct 11 19:48:46.206226 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 939/1833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:44 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1469 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:46.214022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:46.224654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:46.248416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:46.248914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:46.249342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:46.250041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:46.250506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:46.260688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:46.578749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:46.592024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:46.594994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:46.617774 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-54054299-921f-403b-b352-21efb5aa043c tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.407180 Oct 11 19:48:46.619552 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 940/1834] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:46 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:46.656111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c2e04c0c-6a93-4bb9-82f9-2ef8b3b644c5 req-ac372dee-e8b1-4696-82ff-9e5043150e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b02ac4-7e82-46ed-b657-ed8e7a88fddc", "name": "network-vif-unplugged", "status": "completed", "tag": "6ff5fc05-e17c-4b5f-969c-e27ed352f61c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:46.684882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c2e04c0c-6a93-4bb9-82f9-2ef8b3b644c5 req-ac372dee-e8b1-4696-82ff-9e5043150e81 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:46.691961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c2e04c0c-6a93-4bb9-82f9-2ef8b3b644c5 req-ac372dee-e8b1-4696-82ff-9e5043150e81 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:46.695110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c2e04c0c-6a93-4bb9-82f9-2ef8b3b644c5 req-ac372dee-e8b1-4696-82ff-9e5043150e81 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:46.729960 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c2e04c0c-6a93-4bb9-82f9-2ef8b3b644c5 req-ac372dee-e8b1-4696-82ff-9e5043150e81 service nova] Creating event network-vif-unplugged:6ff5fc05-e17c-4b5f-969c-e27ed352f61c for instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc on n-h2-860864-3 Oct 11 19:48:46.747100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-c2e04c0c-6a93-4bb9-82f9-2ef8b3b644c5 req-ac372dee-e8b1-4696-82ff-9e5043150e81 service nova] Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:48:46.766501 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c2e04c0c-6a93-4bb9-82f9-2ef8b3b644c5 req-ac372dee-e8b1-4696-82ff-9e5043150e81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143111 Oct 11 19:48:46.768007 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 941/1835] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:46.775483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d7d6aaa4-14a8-447c-b271-af8c9340060b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:46.777104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d7d6aaa4-14a8-447c-b271-af8c9340060b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:46.796945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:46.805916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d6aaa4-14a8-447c-b271-af8c9340060b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:46.806608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d6aaa4-14a8-447c-b271-af8c9340060b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:46.807165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d6aaa4-14a8-447c-b271-af8c9340060b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:46.808162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d6aaa4-14a8-447c-b271-af8c9340060b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:46.808728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d6aaa4-14a8-447c-b271-af8c9340060b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:46.810491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d6aaa4-14a8-447c-b271-af8c9340060b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:46.927226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-32651bb5-a314-4a0c-a652-5ca483d7038c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:46.953866 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-32651bb5-a314-4a0c-a652-5ca483d7038c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 1.873409 Oct 11 19:48:46.974314 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 895/1836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:45 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:46.991879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6bc9ccb1-ed89-4a3c-afc9-e5ac9de140ff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:47.008718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6bc9ccb1-ed89-4a3c-afc9-e5ac9de140ff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:47.034191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc9ccb1-ed89-4a3c-afc9-e5ac9de140ff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:47.035214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc9ccb1-ed89-4a3c-afc9-e5ac9de140ff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:47.036898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc9ccb1-ed89-4a3c-afc9-e5ac9de140ff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:47.037986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc9ccb1-ed89-4a3c-afc9-e5ac9de140ff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:47.050826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc9ccb1-ed89-4a3c-afc9-e5ac9de140ff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:47.063024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc9ccb1-ed89-4a3c-afc9-e5ac9de140ff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:47.685433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d7d6aaa4-14a8-447c-b271-af8c9340060b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:47.711232 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d7d6aaa4-14a8-447c-b271-af8c9340060b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.941323 Oct 11 19:48:47.712030 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 942/1837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:46 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:47.718087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b65ebe11-ff5f-4b8c-9f04-4edb7e60ef53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:47.721691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b65ebe11-ff5f-4b8c-9f04-4edb7e60ef53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:47.744375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65ebe11-ff5f-4b8c-9f04-4edb7e60ef53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:47.748443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65ebe11-ff5f-4b8c-9f04-4edb7e60ef53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:47.749704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65ebe11-ff5f-4b8c-9f04-4edb7e60ef53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:47.751321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65ebe11-ff5f-4b8c-9f04-4edb7e60ef53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:47.752328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65ebe11-ff5f-4b8c-9f04-4edb7e60ef53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:47.753229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65ebe11-ff5f-4b8c-9f04-4edb7e60ef53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:47.970861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6bc9ccb1-ed89-4a3c-afc9-e5ac9de140ff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:47.988529 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6bc9ccb1-ed89-4a3c-afc9-e5ac9de140ff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1506 microversion: 2.1 time: 1.005330 Oct 11 19:48:47.989520 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 896/1838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:46 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1506 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:48.156865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-552d6668-920d-4c09-a65c-99bd3f391e76 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Action: 'create', calling method: .version_select at 0x7f83cc242ca0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:48.196589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:48.209186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-552d6668-920d-4c09-a65c-99bd3f391e76 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Getting quotas for project a93567102a8c4632b6216cb524f4f536. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:48:48.218388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-552d6668-920d-4c09-a65c-99bd3f391e76 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Getting quotas for user c0a33056de1e41179103741cf5179997 and project a93567102a8c4632b6216cb524f4f536. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:48:48.339646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-552d6668-920d-4c09-a65c-99bd3f391e76 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Getting quotas for project a93567102a8c4632b6216cb524f4f536. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:48:48.362645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-552d6668-920d-4c09-a65c-99bd3f391e76 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Getting quotas for user c0a33056de1e41179103741cf5179997 and project a93567102a8c4632b6216cb524f4f536. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:48:48.411448 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-552d6668-920d-4c09-a65c-99bd3f391e76 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.398590 Oct 11 19:48:48.422202 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 897/1839] 10.222.0.27 () {62 vars in 1214 bytes} [Tue Oct 11 19:48:47 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:48:48.440763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:48.441704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:48.451669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:48.453307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:48.455094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:48.457589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:48.458928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:48.462421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:48.560234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b65ebe11-ff5f-4b8c-9f04-4edb7e60ef53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:48.574400 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b65ebe11-ff5f-4b8c-9f04-4edb7e60ef53 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1469 microversion: 2.1 time: 0.860476 Oct 11 19:48:48.577244 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 943/1840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:47 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1469 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:48.598969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9be95ebe-2905-47c2-b9ea-51a12c0c90b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:48.599990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9be95ebe-2905-47c2-b9ea-51a12c0c90b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:48.613694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be95ebe-2905-47c2-b9ea-51a12c0c90b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:48.617446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be95ebe-2905-47c2-b9ea-51a12c0c90b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:48.618194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be95ebe-2905-47c2-b9ea-51a12c0c90b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:48.619875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be95ebe-2905-47c2-b9ea-51a12c0c90b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:48.621667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be95ebe-2905-47c2-b9ea-51a12c0c90b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:48.622195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be95ebe-2905-47c2-b9ea-51a12c0c90b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:48.733375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:48.757892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:48.760232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:48.780890 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca4814c6-2233-41f0-a17f-7e53498c27cb tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.357226 Oct 11 19:48:48.787607 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 898/1841] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:48 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:48.796613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3400b7c6-6fa8-4b30-9d79-cf680a70cc97 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:48.859180 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3400b7c6-6fa8-4b30-9d79-cf680a70cc97 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.069780 Oct 11 19:48:48.860001 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 899/1842] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 11 19:48:48 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:48:48.865235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-90d322cd-ff48-46b5-aaa5-2a56f57facaa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:48.865842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-90d322cd-ff48-46b5-aaa5-2a56f57facaa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:48.879379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90d322cd-ff48-46b5-aaa5-2a56f57facaa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:48.879608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90d322cd-ff48-46b5-aaa5-2a56f57facaa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:48.883682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90d322cd-ff48-46b5-aaa5-2a56f57facaa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:48.884488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90d322cd-ff48-46b5-aaa5-2a56f57facaa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:48.885001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90d322cd-ff48-46b5-aaa5-2a56f57facaa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:48.885976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90d322cd-ff48-46b5-aaa5-2a56f57facaa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:49.456231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9be95ebe-2905-47c2-b9ea-51a12c0c90b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:49.465920 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9be95ebe-2905-47c2-b9ea-51a12c0c90b1 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.884440 Oct 11 19:48:49.467771 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 944/1843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:48 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:49.473570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2f0d3154-5864-4095-8faa-47d538ab2231 req-e37616ca-97f3-4364-947f-5d74897c0c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d", "tag": "469331a7-5446-4a38-be81-b82560e149f6"}, {"name": "network-changed", "server_uuid": "81b02ac4-7e82-46ed-b657-ed8e7a88fddc", "tag": "6ff5fc05-e17c-4b5f-969c-e27ed352f61c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:49.493033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2f0d3154-5864-4095-8faa-47d538ab2231 req-e37616ca-97f3-4364-947f-5d74897c0c23 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:49.493909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2f0d3154-5864-4095-8faa-47d538ab2231 req-e37616ca-97f3-4364-947f-5d74897c0c23 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:49.494626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2f0d3154-5864-4095-8faa-47d538ab2231 req-e37616ca-97f3-4364-947f-5d74897c0c23 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:49.521640 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2f0d3154-5864-4095-8faa-47d538ab2231 req-e37616ca-97f3-4364-947f-5d74897c0c23 service nova] Creating event network-changed:469331a7-5446-4a38-be81-b82560e149f6 for instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d on n-h1-860864-3 Oct 11 19:48:49.527447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2f0d3154-5864-4095-8faa-47d538ab2231 req-e37616ca-97f3-4364-947f-5d74897c0c23 service nova] Creating event network-changed:6ff5fc05-e17c-4b5f-969c-e27ed352f61c for instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc on n-h2-860864-3 Oct 11 19:48:49.549228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-2f0d3154-5864-4095-8faa-47d538ab2231 req-e37616ca-97f3-4364-947f-5d74897c0c23 service nova] Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 19:48:49.600703 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2f0d3154-5864-4095-8faa-47d538ab2231 req-e37616ca-97f3-4364-947f-5d74897c0c23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.116601 Oct 11 19:48:49.606010 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 945/1844] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:49.616531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-02c41eec-d843-4158-95ea-6024e951f8a4 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:49.633744 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-02c41eec-d843-4158-95ea-6024e951f8a4 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/dad19ca9-0db9-4e6e-80db-220f8ac40272" status: 200 len: 235 microversion: 2.64 time: 0.025057 Oct 11 19:48:49.642709 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 946/1845] 10.222.0.27 () {60 vars in 1304 bytes} [Tue Oct 11 19:48:49 2022] GET /compute/v2.1/os-server-groups/dad19ca9-0db9-4e6e-80db-220f8ac40272 => generated 235 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:48:49.653466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b02e05a2-834f-45d3-9395-d7386432fe4f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:49.658267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b02e05a2-834f-45d3-9395-d7386432fe4f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:49.680790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b02e05a2-834f-45d3-9395-d7386432fe4f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:49.685117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b02e05a2-834f-45d3-9395-d7386432fe4f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:49.685878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b02e05a2-834f-45d3-9395-d7386432fe4f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:49.686896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b02e05a2-834f-45d3-9395-d7386432fe4f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:49.688552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b02e05a2-834f-45d3-9395-d7386432fe4f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:49.689962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b02e05a2-834f-45d3-9395-d7386432fe4f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:49.749557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-90d322cd-ff48-46b5-aaa5-2a56f57facaa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:49.795247 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-90d322cd-ff48-46b5-aaa5-2a56f57facaa tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.934007 Oct 11 19:48:49.805867 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 900/1846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:48 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:49.841639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-261cbb8e-25f8-434a-bbce-96e15e870ecf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:49.844569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-261cbb8e-25f8-434a-bbce-96e15e870ecf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:49.854028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-261cbb8e-25f8-434a-bbce-96e15e870ecf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:49.854338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-261cbb8e-25f8-434a-bbce-96e15e870ecf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:49.855464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-261cbb8e-25f8-434a-bbce-96e15e870ecf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:49.856456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-261cbb8e-25f8-434a-bbce-96e15e870ecf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:49.857605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-261cbb8e-25f8-434a-bbce-96e15e870ecf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:49.858623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-261cbb8e-25f8-434a-bbce-96e15e870ecf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:49.914011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b02e05a2-834f-45d3-9395-d7386432fe4f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:49.927942 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b02e05a2-834f-45d3-9395-d7386432fe4f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1527 microversion: 2.1 time: 0.282759 Oct 11 19:48:49.930613 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 947/1847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:49 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1527 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:49.944510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e1faecc-0f32-4635-9610-61086b42242f tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:49.984136 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e1faecc-0f32-4635-9610-61086b42242f tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/dad19ca9-0db9-4e6e-80db-220f8ac40272" status: 204 len: 0 microversion: 2.64 time: 0.050653 Oct 11 19:48:49.994628 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 948/1848] 10.222.0.27 () {60 vars in 1307 bytes} [Tue Oct 11 19:48:49 2022] DELETE /compute/v2.1/os-server-groups/dad19ca9-0db9-4e6e-80db-220f8ac40272 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:48:50.012131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:50.015798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:50.036410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:50.041876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:50.042673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:50.043933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:50.047464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:50.050751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:50.385473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:50.405684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:50.410066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:50.441056 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7fb77117-d819-4012-aac4-22feb9feca16 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.438530 Oct 11 19:48:50.441765 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 949/1849] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:49 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:50.459646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b448d45-c263-4896-b2f5-834d1d1341d0 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:50.494657 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0b448d45-c263-4896-b2f5-834d1d1341d0 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] HTTP exception thrown: Instance group dad19ca9-0db9-4e6e-80db-220f8ac40272 could not be found. Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b448d45-c263-4896-b2f5-834d1d1341d0 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Request method failure captured: Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-server-groups/dad19ca9-0db9-4e6e-80db-220f8ac40272 HTTP/1.1 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRciffTY86Y9tKx-bgRySsRe4TXjS4TJVzIbZhak9I5-irS5pUy7OnXPZuvMSm55EiXih1rEUZvFSGTAAMRUnjDQYTbscoZ3MVbLO-CscqclK0Gs4VOwZ1SOPqlq00m5RfL5EfoRrBohvDOs4kmydw-WVOqdiX0i6qqwjsLxtwHJq1p4 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.64 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: a93567102a8c4632b6216cb524f4f536 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerGroup264TestJSON-1619952607 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a93567102a8c4632b6216cb524f4f536"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a93567102a8c4632b6216cb524f4f536", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a93567102a8c4632b6216cb524f4f536"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a93567102a8c4632b6216cb524f4f536"}]}] Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerGroup264TestJSON-1619952607 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: a93567102a8c4632b6216cb524f4f536 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1619952607 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerGroup264TestJSON-1619952607-project Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: c0a33056de1e41179103741cf5179997 Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerGroup264TestJSON-1619952607-project Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance group dad19ca9-0db9-4e6e-80db-220f8ac40272 could not be found. Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'dad19ca9-0db9-4e6e-80db-220f8ac40272'} Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group dad19ca9-0db9-4e6e-80db-220f8ac40272 could not be found. Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group dad19ca9-0db9-4e6e-80db-220f8ac40272 could not be found. Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:48:50.505116 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:48:50.510240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:48:50.510240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:48:50.510240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:48:50.510240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:48:50.510240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group dad19ca9-0db9-4e6e-80db-220f8ac40272 could not be found. Oct 11 19:48:50.510240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:48:50.512087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b448d45-c263-4896-b2f5-834d1d1341d0 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] Returning 404 to user: Instance group dad19ca9-0db9-4e6e-80db-220f8ac40272 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:48:50.512231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-261cbb8e-25f8-434a-bbce-96e15e870ecf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:50.516090 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b448d45-c263-4896-b2f5-834d1d1341d0 tempest-ServerGroup264TestJSON-1619952607 tempest-ServerGroup264TestJSON-1619952607-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/dad19ca9-0db9-4e6e-80db-220f8ac40272" status: 404 len: 117 microversion: 2.64 time: 0.068672 Oct 11 19:48:50.519772 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 950/1850] 10.222.0.27 () {60 vars in 1307 bytes} [Tue Oct 11 19:48:50 2022] DELETE /compute/v2.1/os-server-groups/dad19ca9-0db9-4e6e-80db-220f8ac40272 => generated 117 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:48:50.524820 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-261cbb8e-25f8-434a-bbce-96e15e870ecf tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1469 microversion: 2.1 time: 0.717413 Oct 11 19:48:50.528040 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 901/1851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:49 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1469 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:50.532723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-50b4508b-2fa0-45a6-90e2-8a25f9806edc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:50.549547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-50b4508b-2fa0-45a6-90e2-8a25f9806edc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:50.550427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2064059169", "imageRef": "4da50d39-914c-4bd3-bd2c-add8acb833da", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f48226d5-4a02-4f0c-b168-421da2cdc35d"}], "security_groups": [{"name": "tempest-securitygroup--923419565"}], "key_name": "tempest-keypair-964336370", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:50.577171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b4508b-2fa0-45a6-90e2-8a25f9806edc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:50.579522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b4508b-2fa0-45a6-90e2-8a25f9806edc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:50.581815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b4508b-2fa0-45a6-90e2-8a25f9806edc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:50.586714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b4508b-2fa0-45a6-90e2-8a25f9806edc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:50.589139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b4508b-2fa0-45a6-90e2-8a25f9806edc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:50.589139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b4508b-2fa0-45a6-90e2-8a25f9806edc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:50.635977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:51.796117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-50b4508b-2fa0-45a6-90e2-8a25f9806edc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:51.807126 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-50b4508b-2fa0-45a6-90e2-8a25f9806edc tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 1.278155 Oct 11 19:48:51.811851 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 951/1852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:50 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:51.824828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-29df80c6-d101-4601-9777-62e052a80c39 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:51.828506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-29df80c6-d101-4601-9777-62e052a80c39 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:51.848838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29df80c6-d101-4601-9777-62e052a80c39 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:51.849667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29df80c6-d101-4601-9777-62e052a80c39 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:51.850422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29df80c6-d101-4601-9777-62e052a80c39 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:51.851495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29df80c6-d101-4601-9777-62e052a80c39 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:51.853978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29df80c6-d101-4601-9777-62e052a80c39 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:51.856519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29df80c6-d101-4601-9777-62e052a80c39 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:52.093005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:52.244433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] validate_networks() for [('f48226d5-4a02-4f0c-b168-421da2cdc35d', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:48:52.781220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-29df80c6-d101-4601-9777-62e052a80c39 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:52.816314 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-29df80c6-d101-4601-9777-62e052a80c39 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 1.000598 Oct 11 19:48:52.819946 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 952/1853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:51 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:52.844182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e3a5be83-d967-4b73-a060-768b81001884 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:52.852407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e3a5be83-d967-4b73-a060-768b81001884 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:52.909454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a5be83-d967-4b73-a060-768b81001884 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:52.912215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a5be83-d967-4b73-a060-768b81001884 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:52.914021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a5be83-d967-4b73-a060-768b81001884 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:52.916920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a5be83-d967-4b73-a060-768b81001884 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:52.917771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a5be83-d967-4b73-a060-768b81001884 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:52.921132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a5be83-d967-4b73-a060-768b81001884 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:53.893772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e3a5be83-d967-4b73-a060-768b81001884 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:53.905551 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e3a5be83-d967-4b73-a060-768b81001884 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 1.080326 Oct 11 19:48:53.911599 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 953/1854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:52 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:53.925944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:53.930093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:53.946633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:53.954320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:53.955924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:53.958335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:53.959826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:53.962918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:54.187840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:54.203839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:54.210706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:54.239260 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-332d3397-c0fd-4061-a7b0-b8122af37fd1 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.326242 Oct 11 19:48:54.254555 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 954/1855] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:53 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:54.254555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c93ab49e-876c-4f9d-b3d4-3d45b9a0bcea tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:54.254555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c93ab49e-876c-4f9d-b3d4-3d45b9a0bcea tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:54.278155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c93ab49e-876c-4f9d-b3d4-3d45b9a0bcea tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:54.278723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c93ab49e-876c-4f9d-b3d4-3d45b9a0bcea tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:54.279177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c93ab49e-876c-4f9d-b3d4-3d45b9a0bcea tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:54.279899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c93ab49e-876c-4f9d-b3d4-3d45b9a0bcea tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:54.280354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c93ab49e-876c-4f9d-b3d4-3d45b9a0bcea tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:54.280781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c93ab49e-876c-4f9d-b3d4-3d45b9a0bcea tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:54.729957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:48:54.730998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:48:54.732060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:48:54.732925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:48:54.733924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:48:54.754637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:54.755480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:54.757913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:54.758940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:54.759892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:54.763111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:54.817737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Getting quotas for project 9043fe6f133c4c1d876227fa7dfcbda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:48:54.831792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Getting quotas for user 69553a727c3147f2bbaf203f17419830 and project 9043fe6f133c4c1d876227fa7dfcbda3. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:48:54.872499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:48:54.903919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4da50d39-914c-4bd3-bd2c-add8acb833da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:48:55.171089 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4db56bc4-0642-4b79-a1c3-47ae4c55a165 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.629918 Oct 11 19:48:55.174738 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 902/1856] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:48:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 4637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:48:55.183890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d3441a2-a760-4087-9585-b3e0e4d95dee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:55.186830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6d3441a2-a760-4087-9585-b3e0e4d95dee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:55.203261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d3441a2-a760-4087-9585-b3e0e4d95dee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:55.205850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d3441a2-a760-4087-9585-b3e0e4d95dee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:55.206765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d3441a2-a760-4087-9585-b3e0e4d95dee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:55.208734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d3441a2-a760-4087-9585-b3e0e4d95dee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:55.210070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d3441a2-a760-4087-9585-b3e0e4d95dee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:55.211542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d3441a2-a760-4087-9585-b3e0e4d95dee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:55.433582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c93ab49e-876c-4f9d-b3d4-3d45b9a0bcea tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:55.443144 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c93ab49e-876c-4f9d-b3d4-3d45b9a0bcea tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1462 microversion: 2.1 time: 1.198624 Oct 11 19:48:55.447276 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 955/1857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:54 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1462 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:55.464581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b42ee0bd-c4ac-44ad-8e51-c3318c4bff37 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:55.467249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b42ee0bd-c4ac-44ad-8e51-c3318c4bff37 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:55.485458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b42ee0bd-c4ac-44ad-8e51-c3318c4bff37 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:55.487460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b42ee0bd-c4ac-44ad-8e51-c3318c4bff37 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:55.492742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b42ee0bd-c4ac-44ad-8e51-c3318c4bff37 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:55.493508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b42ee0bd-c4ac-44ad-8e51-c3318c4bff37 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:55.494006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b42ee0bd-c4ac-44ad-8e51-c3318c4bff37 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:55.497153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b42ee0bd-c4ac-44ad-8e51-c3318c4bff37 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:56.995947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b42ee0bd-c4ac-44ad-8e51-c3318c4bff37 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:57.025584 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b42ee0bd-c4ac-44ad-8e51-c3318c4bff37 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 1.571242 Oct 11 19:48:57.026450 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 956/1858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:55 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:57.034282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b65298a3-48c3-4c0a-b9e2-5d96fe41c04f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:57.038647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b65298a3-48c3-4c0a-b9e2-5d96fe41c04f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:57.051255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65298a3-48c3-4c0a-b9e2-5d96fe41c04f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:57.052565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65298a3-48c3-4c0a-b9e2-5d96fe41c04f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:57.053402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65298a3-48c3-4c0a-b9e2-5d96fe41c04f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:57.054314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65298a3-48c3-4c0a-b9e2-5d96fe41c04f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:57.055046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65298a3-48c3-4c0a-b9e2-5d96fe41c04f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:57.055657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b65298a3-48c3-4c0a-b9e2-5d96fe41c04f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:57.108540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6d3441a2-a760-4087-9585-b3e0e4d95dee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:57.146500 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6d3441a2-a760-4087-9585-b3e0e4d95dee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 1.968882 Oct 11 19:48:57.160464 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 903/1859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:55 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:57.174794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aed44d83-df2e-42b0-8f44-7c9a21ae1df8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:57.175677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aed44d83-df2e-42b0-8f44-7c9a21ae1df8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:57.193747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed44d83-df2e-42b0-8f44-7c9a21ae1df8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:57.196202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed44d83-df2e-42b0-8f44-7c9a21ae1df8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:57.196967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed44d83-df2e-42b0-8f44-7c9a21ae1df8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:57.199388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed44d83-df2e-42b0-8f44-7c9a21ae1df8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:57.205358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed44d83-df2e-42b0-8f44-7c9a21ae1df8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:57.207068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed44d83-df2e-42b0-8f44-7c9a21ae1df8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:57.581686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aed44d83-df2e-42b0-8f44-7c9a21ae1df8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:57.612010 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aed44d83-df2e-42b0-8f44-7c9a21ae1df8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1297 microversion: 2.1 time: 0.444407 Oct 11 19:48:57.627082 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 904/1860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:57 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1297 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:57.633532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:57.634353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:57.650349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:57.651191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:57.651627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:57.652511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:57.653284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:57.653881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:57.845501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b65298a3-48c3-4c0a-b9e2-5d96fe41c04f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:57.867065 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b65298a3-48c3-4c0a-b9e2-5d96fe41c04f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 0.836051 Oct 11 19:48:57.872978 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 957/1861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:57 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:57.877116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:57.887967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:57.903724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:57.916510 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6bdd2915-79e5-4c4d-abf9-e3c3a1961420 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.287965 Oct 11 19:48:57.917112 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 905/1862] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:48:57 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:48:57.932974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-12b349cf-dc8a-4fa8-958c-d8352c507b19 req-8e9ee01a-fa11-4c85-b6e8-26c09c1b701d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1ceed5-0490-4d64-8d97-e0684bd7f05f", "name": "network-vif-plugged", "status": "completed", "tag": "c0a9bf59-035c-4a1e-8ebc-eeb631b03c41"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:48:57.966417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-12b349cf-dc8a-4fa8-958c-d8352c507b19 req-8e9ee01a-fa11-4c85-b6e8-26c09c1b701d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:57.966927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-12b349cf-dc8a-4fa8-958c-d8352c507b19 req-8e9ee01a-fa11-4c85-b6e8-26c09c1b701d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:57.967363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-12b349cf-dc8a-4fa8-958c-d8352c507b19 req-8e9ee01a-fa11-4c85-b6e8-26c09c1b701d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:58.009813 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-12b349cf-dc8a-4fa8-958c-d8352c507b19 req-8e9ee01a-fa11-4c85-b6e8-26c09c1b701d service nova] Creating event network-vif-plugged:c0a9bf59-035c-4a1e-8ebc-eeb631b03c41 for instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f on n-h2-860864-3 Oct 11 19:48:58.031239 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-12b349cf-dc8a-4fa8-958c-d8352c507b19 req-8e9ee01a-fa11-4c85-b6e8-26c09c1b701d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111829 Oct 11 19:48:58.033560 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 906/1863] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:48:58.054493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1aa95fc8-90d7-477b-b9bc-1845f35e3936 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:58.072313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1aa95fc8-90d7-477b-b9bc-1845f35e3936 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:58.093304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa95fc8-90d7-477b-b9bc-1845f35e3936 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:58.095988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa95fc8-90d7-477b-b9bc-1845f35e3936 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:58.098682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa95fc8-90d7-477b-b9bc-1845f35e3936 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:58.102347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa95fc8-90d7-477b-b9bc-1845f35e3936 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:58.102869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa95fc8-90d7-477b-b9bc-1845f35e3936 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:58.103305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1aa95fc8-90d7-477b-b9bc-1845f35e3936 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:58.151388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:48:58.267786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ae9634b-e720-4b46-ab25-02bb1dbd3e27 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:58.268920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ae9634b-e720-4b46-ab25-02bb1dbd3e27 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:58.287147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ae9634b-e720-4b46-ab25-02bb1dbd3e27 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:58.290070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ae9634b-e720-4b46-ab25-02bb1dbd3e27 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:58.293028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ae9634b-e720-4b46-ab25-02bb1dbd3e27 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:58.295005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ae9634b-e720-4b46-ab25-02bb1dbd3e27 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:58.299190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ae9634b-e720-4b46-ab25-02bb1dbd3e27 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:58.301872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ae9634b-e720-4b46-ab25-02bb1dbd3e27 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:58.885953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1aa95fc8-90d7-477b-b9bc-1845f35e3936 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:58.901019 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ae9634b-e720-4b46-ab25-02bb1dbd3e27 tempest-MigrationsAdminTest-2138859350 tempest-MigrationsAdminTest-2138859350-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1613 microversion: 2.1 time: 1.026536 Oct 11 19:48:58.901636 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 958/1864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:57 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1613 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:58.906233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-55e9e174-a0f0-4168-a33d-141c2a7598d7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:58.907555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-55e9e174-a0f0-4168-a33d-141c2a7598d7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:58.922555 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1aa95fc8-90d7-477b-b9bc-1845f35e3936 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.872208 Oct 11 19:48:58.927578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55e9e174-a0f0-4168-a33d-141c2a7598d7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:58.927835 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 907/1865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:58 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:58.933516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55e9e174-a0f0-4168-a33d-141c2a7598d7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:58.934277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55e9e174-a0f0-4168-a33d-141c2a7598d7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:58.935203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55e9e174-a0f0-4168-a33d-141c2a7598d7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:58.936391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7aef84ec-375d-434a-9f33-2ed0f418c5d1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:58.936743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55e9e174-a0f0-4168-a33d-141c2a7598d7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:58.937006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7aef84ec-375d-434a-9f33-2ed0f418c5d1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:58.937525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55e9e174-a0f0-4168-a33d-141c2a7598d7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:58.955158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7aef84ec-375d-434a-9f33-2ed0f418c5d1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:58.955579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7aef84ec-375d-434a-9f33-2ed0f418c5d1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:58.956019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7aef84ec-375d-434a-9f33-2ed0f418c5d1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:58.956729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7aef84ec-375d-434a-9f33-2ed0f418c5d1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:58.959938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7aef84ec-375d-434a-9f33-2ed0f418c5d1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:58.960603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7aef84ec-375d-434a-9f33-2ed0f418c5d1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:59.129612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7aef84ec-375d-434a-9f33-2ed0f418c5d1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:59.155308 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7aef84ec-375d-434a-9f33-2ed0f418c5d1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1303 microversion: 2.1 time: 0.218389 Oct 11 19:48:59.170552 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 908/1866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:58 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:59.178995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d8161eff-3fc3-4bd7-bf65-1bd5ccb75aec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:59.180901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d8161eff-3fc3-4bd7-bf65-1bd5ccb75aec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:59.199575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8161eff-3fc3-4bd7-bf65-1bd5ccb75aec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:59.202076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8161eff-3fc3-4bd7-bf65-1bd5ccb75aec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:59.202760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8161eff-3fc3-4bd7-bf65-1bd5ccb75aec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:59.203625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8161eff-3fc3-4bd7-bf65-1bd5ccb75aec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:59.205827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8161eff-3fc3-4bd7-bf65-1bd5ccb75aec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:59.207062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8161eff-3fc3-4bd7-bf65-1bd5ccb75aec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:59.725309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-55e9e174-a0f0-4168-a33d-141c2a7598d7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:48:59.738079 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-55e9e174-a0f0-4168-a33d-141c2a7598d7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1392 microversion: 2.1 time: 0.835238 Oct 11 19:48:59.738876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 959/1867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:58 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1392 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:48:59.758645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f61c65a7-9bd4-492a-8e44-b83924028b2d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:48:59.759231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f61c65a7-9bd4-492a-8e44-b83924028b2d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:48:59.768490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f61c65a7-9bd4-492a-8e44-b83924028b2d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:59.774180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f61c65a7-9bd4-492a-8e44-b83924028b2d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:59.775016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f61c65a7-9bd4-492a-8e44-b83924028b2d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:59.777528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f61c65a7-9bd4-492a-8e44-b83924028b2d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:48:59.778251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f61c65a7-9bd4-492a-8e44-b83924028b2d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:48:59.781448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f61c65a7-9bd4-492a-8e44-b83924028b2d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:48:59.863914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f61c65a7-9bd4-492a-8e44-b83924028b2d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:00.109302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d8161eff-3fc3-4bd7-bf65-1bd5ccb75aec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:00.130243 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d8161eff-3fc3-4bd7-bf65-1bd5ccb75aec tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 0.965059 Oct 11 19:49:00.133357 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f61c65a7-9bd4-492a-8e44-b83924028b2d tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "DELETE /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 204 len: 0 microversion: 2.1 time: 0.392778 Oct 11 19:49:00.134624 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 960/1868] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:48:59 2022] DELETE /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:49:00.138592 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 909/1869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:48:59 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:00.158086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b6465be-459f-4ea6-92f1-89d4bb2323cd tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:00.164610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:00.166188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:00.175824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2b6465be-459f-4ea6-92f1-89d4bb2323cd tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:00.185854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:00.186783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:00.187480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:00.190034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:00.191095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:00.195248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:00.211639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b6465be-459f-4ea6-92f1-89d4bb2323cd tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:00.212527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b6465be-459f-4ea6-92f1-89d4bb2323cd tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:00.215802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b6465be-459f-4ea6-92f1-89d4bb2323cd tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:00.216993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b6465be-459f-4ea6-92f1-89d4bb2323cd tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:00.217729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b6465be-459f-4ea6-92f1-89d4bb2323cd tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:00.220695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b6465be-459f-4ea6-92f1-89d4bb2323cd tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:00.464022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:00.477352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:00.490697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:00.519481 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-378d1bff-d8d1-494d-94bb-1e5bc5c56b77 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.378812 Oct 11 19:49:00.523287 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 961/1870] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:00 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:00.549707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c596015e-e5b1-428d-90ec-90c9cd34d2d8 req-5d67af34-50b4-44dc-92d7-177427265ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b02ac4-7e82-46ed-b657-ed8e7a88fddc", "name": "network-vif-plugged", "status": "completed", "tag": "6ff5fc05-e17c-4b5f-969c-e27ed352f61c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:00.581343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c596015e-e5b1-428d-90ec-90c9cd34d2d8 req-5d67af34-50b4-44dc-92d7-177427265ccc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:00.587969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c596015e-e5b1-428d-90ec-90c9cd34d2d8 req-5d67af34-50b4-44dc-92d7-177427265ccc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:00.591724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c596015e-e5b1-428d-90ec-90c9cd34d2d8 req-5d67af34-50b4-44dc-92d7-177427265ccc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:00.625957 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c596015e-e5b1-428d-90ec-90c9cd34d2d8 req-5d67af34-50b4-44dc-92d7-177427265ccc service nova] Creating event network-vif-plugged:6ff5fc05-e17c-4b5f-969c-e27ed352f61c for instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc on n-h2-860864-3 Oct 11 19:49:00.645561 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c596015e-e5b1-428d-90ec-90c9cd34d2d8 req-5d67af34-50b4-44dc-92d7-177427265ccc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117390 Oct 11 19:49:00.647308 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 962/1871] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:00.658021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8fb0dee2-bd9c-46d8-bec7-7a5d14858666 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:00.667192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8fb0dee2-bd9c-46d8-bec7-7a5d14858666 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:00.704399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fb0dee2-bd9c-46d8-bec7-7a5d14858666 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:00.705105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fb0dee2-bd9c-46d8-bec7-7a5d14858666 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:00.710660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fb0dee2-bd9c-46d8-bec7-7a5d14858666 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:00.711607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fb0dee2-bd9c-46d8-bec7-7a5d14858666 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:00.712253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fb0dee2-bd9c-46d8-bec7-7a5d14858666 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:00.712812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fb0dee2-bd9c-46d8-bec7-7a5d14858666 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:00.801390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2b6465be-459f-4ea6-92f1-89d4bb2323cd tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:00.811774 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2b6465be-459f-4ea6-92f1-89d4bb2323cd tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.664079 Oct 11 19:49:00.813404 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 910/1872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:00 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:00.819100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9d893d33-66f6-47e2-9622-c434d73a5e96 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:00.820269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9d893d33-66f6-47e2-9622-c434d73a5e96 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:00.830032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d893d33-66f6-47e2-9622-c434d73a5e96 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:00.831269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d893d33-66f6-47e2-9622-c434d73a5e96 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:00.831971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d893d33-66f6-47e2-9622-c434d73a5e96 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:00.834934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d893d33-66f6-47e2-9622-c434d73a5e96 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:00.835656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d893d33-66f6-47e2-9622-c434d73a5e96 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:00.836588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d893d33-66f6-47e2-9622-c434d73a5e96 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:01.107231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9d893d33-66f6-47e2-9622-c434d73a5e96 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:01.121062 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9d893d33-66f6-47e2-9622-c434d73a5e96 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1303 microversion: 2.1 time: 0.305234 Oct 11 19:49:01.123250 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 911/1873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:00 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1303 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:01.139250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1d0b6cf3-be6a-4bd3-99dc-676689ab66d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:01.144672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1d0b6cf3-be6a-4bd3-99dc-676689ab66d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:01.154300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d0b6cf3-be6a-4bd3-99dc-676689ab66d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:01.155400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d0b6cf3-be6a-4bd3-99dc-676689ab66d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:01.156067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d0b6cf3-be6a-4bd3-99dc-676689ab66d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:01.157761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d0b6cf3-be6a-4bd3-99dc-676689ab66d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:01.158653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d0b6cf3-be6a-4bd3-99dc-676689ab66d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:01.160022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d0b6cf3-be6a-4bd3-99dc-676689ab66d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:01.374210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8fb0dee2-bd9c-46d8-bec7-7a5d14858666 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:01.404737 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8fb0dee2-bd9c-46d8-bec7-7a5d14858666 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1468 microversion: 2.1 time: 0.755856 Oct 11 19:49:01.412908 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 963/1874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:00 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1468 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:01.449755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10cc3a02-d911-4e71-b32d-ddb31c462fcd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:01.450993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10cc3a02-d911-4e71-b32d-ddb31c462fcd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:01.466756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cc3a02-d911-4e71-b32d-ddb31c462fcd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:01.475486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cc3a02-d911-4e71-b32d-ddb31c462fcd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:01.479878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cc3a02-d911-4e71-b32d-ddb31c462fcd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:01.482570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cc3a02-d911-4e71-b32d-ddb31c462fcd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:01.485502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cc3a02-d911-4e71-b32d-ddb31c462fcd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:01.491166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cc3a02-d911-4e71-b32d-ddb31c462fcd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:01.864109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1d0b6cf3-be6a-4bd3-99dc-676689ab66d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:01.879443 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1d0b6cf3-be6a-4bd3-99dc-676689ab66d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1382 microversion: 2.1 time: 0.754457 Oct 11 19:49:01.900872 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 912/1875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:01 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1382 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:01.915507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:01.918913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:01.934328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:01.937839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:01.939982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:01.942499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:01.943661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:01.948031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:02.197965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:02.213004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:02.214908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:02.252431 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1a388d40-cc70-4895-8c2e-4c5e9765cf21 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.345339 Oct 11 19:49:02.254180 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 913/1876] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:01 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:02.259074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f210cac5-e75b-4a88-a2a8-e00dd50cf718 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:02.263551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f210cac5-e75b-4a88-a2a8-e00dd50cf718 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:02.275647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f210cac5-e75b-4a88-a2a8-e00dd50cf718 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:02.279498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f210cac5-e75b-4a88-a2a8-e00dd50cf718 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:02.280184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f210cac5-e75b-4a88-a2a8-e00dd50cf718 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:02.281105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f210cac5-e75b-4a88-a2a8-e00dd50cf718 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:02.283453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f210cac5-e75b-4a88-a2a8-e00dd50cf718 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:02.284727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f210cac5-e75b-4a88-a2a8-e00dd50cf718 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:02.306841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-10cc3a02-d911-4e71-b32d-ddb31c462fcd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:02.316855 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10cc3a02-d911-4e71-b32d-ddb31c462fcd tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 0.902588 Oct 11 19:49:02.327512 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 964/1877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:01 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:02.336066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-197d3266-6004-4f5b-bb13-836db55b64e6 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '.version_select at 0x7f83d08881f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:02.340569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197d3266-6004-4f5b-bb13-836db55b64e6 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:02.341486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197d3266-6004-4f5b-bb13-836db55b64e6 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:02.342100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197d3266-6004-4f5b-bb13-836db55b64e6 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:02.391576 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-197d3266-6004-4f5b-bb13-836db55b64e6 tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 4274 microversion: 2.1 time: 0.062174 Oct 11 19:49:02.396212 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 965/1878] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 19:49:02 2022] GET /compute/v2.1/os-migrations => generated 4274 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:02.407327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7d0e1bc-592c-456c-bdca-8c813af25098 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:02.432185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c7d0e1bc-592c-456c-bdca-8c813af25098 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:02.476204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7d0e1bc-592c-456c-bdca-8c813af25098 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:02.477120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7d0e1bc-592c-456c-bdca-8c813af25098 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:02.478053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7d0e1bc-592c-456c-bdca-8c813af25098 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:02.479126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7d0e1bc-592c-456c-bdca-8c813af25098 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:02.479884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7d0e1bc-592c-456c-bdca-8c813af25098 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:02.480681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7d0e1bc-592c-456c-bdca-8c813af25098 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:03.172217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f210cac5-e75b-4a88-a2a8-e00dd50cf718 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:03.185925 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f210cac5-e75b-4a88-a2a8-e00dd50cf718 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1516 microversion: 2.1 time: 0.929956 Oct 11 19:49:03.189366 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 914/1879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:02 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1516 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:03.216750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f66e3a45-047f-46ff-bd86-8350777bf8bd tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:03.221037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f66e3a45-047f-46ff-bd86-8350777bf8bd tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:03.239642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f66e3a45-047f-46ff-bd86-8350777bf8bd tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:03.240443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f66e3a45-047f-46ff-bd86-8350777bf8bd tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:03.241109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f66e3a45-047f-46ff-bd86-8350777bf8bd tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:03.247700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f66e3a45-047f-46ff-bd86-8350777bf8bd tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:03.247700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f66e3a45-047f-46ff-bd86-8350777bf8bd tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:03.247700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f66e3a45-047f-46ff-bd86-8350777bf8bd tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:03.831424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c7d0e1bc-592c-456c-bdca-8c813af25098 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:03.843342 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c7d0e1bc-592c-456c-bdca-8c813af25098 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 1.444343 Oct 11 19:49:03.846439 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 966/1880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:02 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:03.856449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-39cd3b86-1677-4a6e-8bbf-bc7faa25c783 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:03.866577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-39cd3b86-1677-4a6e-8bbf-bc7faa25c783 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:03.890547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39cd3b86-1677-4a6e-8bbf-bc7faa25c783 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:03.895496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39cd3b86-1677-4a6e-8bbf-bc7faa25c783 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:03.897283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39cd3b86-1677-4a6e-8bbf-bc7faa25c783 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:03.900609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39cd3b86-1677-4a6e-8bbf-bc7faa25c783 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:03.903199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39cd3b86-1677-4a6e-8bbf-bc7faa25c783 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:03.904760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39cd3b86-1677-4a6e-8bbf-bc7faa25c783 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:03.983006 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f66e3a45-047f-46ff-bd86-8350777bf8bd tempest-LiveMigrationTest-148637107 tempest-LiveMigrationTest-148637107-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1533 microversion: 2.1 time: 0.777016 Oct 11 19:49:03.984256 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 915/1881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:03 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1533 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:03.992507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:03.993961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:04.003653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:04.019701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:04.020828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:04.021865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:04.022619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:04.023363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:04.247893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:04.257025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:04.258472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:04.276619 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b6ccab40-d43a-4ec4-80c9-4abbcd3e177f tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.290201 Oct 11 19:49:04.280195 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 916/1882] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:03 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:04.290648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-63a57102-2912-459f-9e69-31aacc338a1f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:04.291274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-63a57102-2912-459f-9e69-31aacc338a1f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:04.305644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a57102-2912-459f-9e69-31aacc338a1f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:04.306159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a57102-2912-459f-9e69-31aacc338a1f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:04.306593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a57102-2912-459f-9e69-31aacc338a1f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:04.310190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a57102-2912-459f-9e69-31aacc338a1f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:04.311051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a57102-2912-459f-9e69-31aacc338a1f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:04.311474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a57102-2912-459f-9e69-31aacc338a1f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:04.622236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63a57102-2912-459f-9e69-31aacc338a1f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:04.631886 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-63a57102-2912-459f-9e69-31aacc338a1f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 0.350581 Oct 11 19:49:04.637300 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 917/1883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:04 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:04.652066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0703e79-ac39-4a85-a6fb-ca079c68a4e4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:04.656336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-39cd3b86-1677-4a6e-8bbf-bc7faa25c783 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:04.660349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:04.665399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e0703e79-ac39-4a85-a6fb-ca079c68a4e4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:04.683220 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-39cd3b86-1677-4a6e-8bbf-bc7faa25c783 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1468 microversion: 2.1 time: 0.835385 Oct 11 19:49:04.695340 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 967/1884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:03 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1468 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:04.710636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0703e79-ac39-4a85-a6fb-ca079c68a4e4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:04.711146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0703e79-ac39-4a85-a6fb-ca079c68a4e4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:04.711602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0703e79-ac39-4a85-a6fb-ca079c68a4e4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:04.712291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0703e79-ac39-4a85-a6fb-ca079c68a4e4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:04.712744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0703e79-ac39-4a85-a6fb-ca079c68a4e4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:04.716610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a44f7fbc-6209-41ea-99b8-d8879e067364 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:04.720999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a44f7fbc-6209-41ea-99b8-d8879e067364 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:04.723922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0703e79-ac39-4a85-a6fb-ca079c68a4e4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:04.762131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a44f7fbc-6209-41ea-99b8-d8879e067364 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:04.771870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a44f7fbc-6209-41ea-99b8-d8879e067364 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:04.774642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a44f7fbc-6209-41ea-99b8-d8879e067364 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:04.775627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a44f7fbc-6209-41ea-99b8-d8879e067364 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:04.777677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a44f7fbc-6209-41ea-99b8-d8879e067364 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:04.778315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a44f7fbc-6209-41ea-99b8-d8879e067364 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:04.839659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:04.852211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=14 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:04.864904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e0703e79-ac39-4a85-a6fb-ca079c68a4e4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:05.275204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a44f7fbc-6209-41ea-99b8-d8879e067364 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:05.317524 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e0703e79-ac39-4a85-a6fb-ca079c68a4e4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "DELETE /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 204 len: 0 microversion: 2.1 time: 0.678402 Oct 11 19:49:05.321107 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 918/1885] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:04 2022] DELETE /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:49:05.322871 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a44f7fbc-6209-41ea-99b8-d8879e067364 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1522 microversion: 2.1 time: 0.626706 Oct 11 19:49:05.332241 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 968/1886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:04 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1522 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:05.343818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dfcfd11e-4dcd-4358-8606-538c32b63bc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:05.347682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ab535c67-53c2-41c8-b0ae-7eb2df0a3910 req-c164c977-7ff5-4939-b3b8-c016c2c772e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b02ac4-7e82-46ed-b657-ed8e7a88fddc", "name": "network-vif-deleted", "tag": "6ff5fc05-e17c-4b5f-969c-e27ed352f61c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:05.353586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dfcfd11e-4dcd-4358-8606-538c32b63bc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:05.364842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ab535c67-53c2-41c8-b0ae-7eb2df0a3910 req-c164c977-7ff5-4939-b3b8-c016c2c772e0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:05.365644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ab535c67-53c2-41c8-b0ae-7eb2df0a3910 req-c164c977-7ff5-4939-b3b8-c016c2c772e0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:05.366269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ab535c67-53c2-41c8-b0ae-7eb2df0a3910 req-c164c977-7ff5-4939-b3b8-c016c2c772e0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:05.390338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfcfd11e-4dcd-4358-8606-538c32b63bc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:05.395489 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ab535c67-53c2-41c8-b0ae-7eb2df0a3910 req-c164c977-7ff5-4939-b3b8-c016c2c772e0 service nova] Creating event network-vif-deleted:6ff5fc05-e17c-4b5f-969c-e27ed352f61c for instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc on n-h2-860864-3 Oct 11 19:49:05.396572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfcfd11e-4dcd-4358-8606-538c32b63bc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:05.399288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfcfd11e-4dcd-4358-8606-538c32b63bc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:05.404255 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ab535c67-53c2-41c8-b0ae-7eb2df0a3910 req-c164c977-7ff5-4939-b3b8-c016c2c772e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068368 Oct 11 19:49:05.413069 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 969/1887] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:05.426304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:05.427235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfcfd11e-4dcd-4358-8606-538c32b63bc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:05.427807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:05.427941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfcfd11e-4dcd-4358-8606-538c32b63bc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:05.428436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfcfd11e-4dcd-4358-8606-538c32b63bc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:05.437760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:05.439120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:05.439777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:05.440889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:05.441915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:05.442795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:05.677860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:05.735763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:05.740438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:05.753307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dfcfd11e-4dcd-4358-8606-538c32b63bc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:05.767352 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dfcfd11e-4dcd-4358-8606-538c32b63bc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 0.443814 Oct 11 19:49:05.781271 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-68f3c495-f80e-4f81-bb23-35a6e3732b18 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.363316 Oct 11 19:49:05.786830 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 919/1888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:05 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:05.806305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-562bea84-2f05-4a83-88e6-de31444d0031 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:05.807709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-562bea84-2f05-4a83-88e6-de31444d0031 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:05.812191 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 970/1889] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:05 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:05.828062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77644a09-dd2a-46f6-a1b6-db8bec04cd68 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:05.830217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-562bea84-2f05-4a83-88e6-de31444d0031 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:05.831839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-77644a09-dd2a-46f6-a1b6-db8bec04cd68 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:05.832398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-562bea84-2f05-4a83-88e6-de31444d0031 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:05.833102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-562bea84-2f05-4a83-88e6-de31444d0031 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:05.835336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-562bea84-2f05-4a83-88e6-de31444d0031 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:05.836078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-562bea84-2f05-4a83-88e6-de31444d0031 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:05.843364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77644a09-dd2a-46f6-a1b6-db8bec04cd68 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:05.845279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77644a09-dd2a-46f6-a1b6-db8bec04cd68 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:05.846939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-562bea84-2f05-4a83-88e6-de31444d0031 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:05.866200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77644a09-dd2a-46f6-a1b6-db8bec04cd68 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:05.871425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77644a09-dd2a-46f6-a1b6-db8bec04cd68 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:05.875830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77644a09-dd2a-46f6-a1b6-db8bec04cd68 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:05.891403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77644a09-dd2a-46f6-a1b6-db8bec04cd68 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:06.689268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-562bea84-2f05-4a83-88e6-de31444d0031 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:06.703879 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-562bea84-2f05-4a83-88e6-de31444d0031 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1388 microversion: 2.1 time: 0.914884 Oct 11 19:49:06.704675 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 920/1890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:05 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1388 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:06.714266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:06.715113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:06.718344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:06.735173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:06.735649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:06.736232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:06.737087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:06.737992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:06.738705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:06.740341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-77644a09-dd2a-46f6-a1b6-db8bec04cd68 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:06.752646 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-77644a09-dd2a-46f6-a1b6-db8bec04cd68 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 0.929230 Oct 11 19:49:06.760509 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 971/1891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:05 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:06.760509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13e247e0-320c-4234-9ddc-616cb1b98cec tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:06.760509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-13e247e0-320c-4234-9ddc-616cb1b98cec tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:06.766872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13e247e0-320c-4234-9ddc-616cb1b98cec tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:06.767590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13e247e0-320c-4234-9ddc-616cb1b98cec tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:06.768200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13e247e0-320c-4234-9ddc-616cb1b98cec tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:06.769062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13e247e0-320c-4234-9ddc-616cb1b98cec tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:06.769694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13e247e0-320c-4234-9ddc-616cb1b98cec tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:06.770291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13e247e0-320c-4234-9ddc-616cb1b98cec tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:06.813845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:06.816570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:06.817493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:06.818259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lazy-loading 'fault' on Instance uuid 81b02ac4-7e82-46ed-b657-ed8e7a88fddc {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:49:07.001276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:07.026388 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d5d284ca-2dc6-445c-bb2f-114e170ea7ca tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 200 len: 1302 microversion: 2.1 time: 0.320435 Oct 11 19:49:07.050287 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 921/1892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:06 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 1302 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:07.073058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51b0504f-501c-431d-8d96-8c6c32d8a34a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:07.075778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51b0504f-501c-431d-8d96-8c6c32d8a34a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:07.095465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51b0504f-501c-431d-8d96-8c6c32d8a34a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:07.097965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51b0504f-501c-431d-8d96-8c6c32d8a34a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:07.100324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51b0504f-501c-431d-8d96-8c6c32d8a34a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:07.104956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51b0504f-501c-431d-8d96-8c6c32d8a34a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:07.107067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51b0504f-501c-431d-8d96-8c6c32d8a34a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:07.108360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51b0504f-501c-431d-8d96-8c6c32d8a34a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:07.200902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:07.955608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13e247e0-320c-4234-9ddc-616cb1b98cec tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:07.965131 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13e247e0-320c-4234-9ddc-616cb1b98cec tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1522 microversion: 2.1 time: 1.210685 Oct 11 19:49:07.976421 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 972/1893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:06 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1522 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:08.024300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:08.026119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:08.048042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:08.050780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:08.051443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:08.053439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:08.055167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:08.057645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:08.377786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:08.402592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:08.417186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:08.444634 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fcbd84a1-48cf-4f37-94ea-b29c171f4323 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.441551 Oct 11 19:49:08.454092 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 973/1894] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:07 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:08.505448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-48a0b27f-47ca-4c66-908f-ad50a820d8ca req-76a35960-9988-41e6-b67a-b4fa478a2be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f64eed-776b-4aaf-b46c-cb1f73e5500f", "name": "network-vif-unplugged", "status": "completed", "tag": "bb9a377d-62a3-40e1-bbc3-8342947e2944"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:08.539409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-48a0b27f-47ca-4c66-908f-ad50a820d8ca req-76a35960-9988-41e6-b67a-b4fa478a2be7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:08.542353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-48a0b27f-47ca-4c66-908f-ad50a820d8ca req-76a35960-9988-41e6-b67a-b4fa478a2be7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:08.543083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-48a0b27f-47ca-4c66-908f-ad50a820d8ca req-76a35960-9988-41e6-b67a-b4fa478a2be7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:08.569480 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-48a0b27f-47ca-4c66-908f-ad50a820d8ca req-76a35960-9988-41e6-b67a-b4fa478a2be7 service nova] Creating event network-vif-unplugged:bb9a377d-62a3-40e1-bbc3-8342947e2944 for instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f on n-h2-860864-3 Oct 11 19:49:08.584538 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-48a0b27f-47ca-4c66-908f-ad50a820d8ca req-76a35960-9988-41e6-b67a-b4fa478a2be7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104990 Oct 11 19:49:08.587798 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 974/1895] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:08.601985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ac59ef9f-b8ad-4816-afd7-ba6d5a393512 req-0480a515-d6bd-48fc-b2b0-a4372250b4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21319341-f8a9-4972-88e3-13e7c5f6397d", "tag": "fb84ba1b-772c-4347-9bed-3bbeffe08735"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:08.627219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ac59ef9f-b8ad-4816-afd7-ba6d5a393512 req-0480a515-d6bd-48fc-b2b0-a4372250b4e2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:08.628028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ac59ef9f-b8ad-4816-afd7-ba6d5a393512 req-0480a515-d6bd-48fc-b2b0-a4372250b4e2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:08.628649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ac59ef9f-b8ad-4816-afd7-ba6d5a393512 req-0480a515-d6bd-48fc-b2b0-a4372250b4e2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:08.665100 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ac59ef9f-b8ad-4816-afd7-ba6d5a393512 req-0480a515-d6bd-48fc-b2b0-a4372250b4e2 service nova] Creating event network-changed:fb84ba1b-772c-4347-9bed-3bbeffe08735 for instance 21319341-f8a9-4972-88e3-13e7c5f6397d on n-h1-860864-3 Oct 11 19:49:08.678875 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ac59ef9f-b8ad-4816-afd7-ba6d5a393512 req-0480a515-d6bd-48fc-b2b0-a4372250b4e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089124 Oct 11 19:49:08.680433 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 975/1896] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:08.694393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-be0e10cf-8758-428e-9e7b-3eeecd57b74b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:08.696226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-be0e10cf-8758-428e-9e7b-3eeecd57b74b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:08.697439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51b0504f-501c-431d-8d96-8c6c32d8a34a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:08.709195 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51b0504f-501c-431d-8d96-8c6c32d8a34a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 1.655135 Oct 11 19:49:08.712704 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 922/1897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:07 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:08.718484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be0e10cf-8758-428e-9e7b-3eeecd57b74b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:08.719620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be0e10cf-8758-428e-9e7b-3eeecd57b74b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:08.720156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be0e10cf-8758-428e-9e7b-3eeecd57b74b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:08.721086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be0e10cf-8758-428e-9e7b-3eeecd57b74b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:08.721738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be0e10cf-8758-428e-9e7b-3eeecd57b74b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:08.722353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be0e10cf-8758-428e-9e7b-3eeecd57b74b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:08.724555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c2bdca56-8151-4020-8204-14ade760126c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:08.725331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c2bdca56-8151-4020-8204-14ade760126c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:08.771994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2bdca56-8151-4020-8204-14ade760126c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:08.777031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2bdca56-8151-4020-8204-14ade760126c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:08.778039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2bdca56-8151-4020-8204-14ade760126c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:08.782689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2bdca56-8151-4020-8204-14ade760126c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:08.783666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2bdca56-8151-4020-8204-14ade760126c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:08.784056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2bdca56-8151-4020-8204-14ade760126c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:08.866215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-be0e10cf-8758-428e-9e7b-3eeecd57b74b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:08.878089 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-be0e10cf-8758-428e-9e7b-3eeecd57b74b tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1346 microversion: 2.1 time: 0.196232 Oct 11 19:49:08.896274 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 976/1898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:08 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1346 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:08.903034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:08.903661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 81b02ac4-7e82-46ed-b657-ed8e7a88fddc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:08.942169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:08.942778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:08.943240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:08.951033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:08.951603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:08.952059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:09.022973 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] HTTP exception thrown: Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc could not be found. Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Request method failure captured: Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc HTTP/1.1 Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcdiPNBEtDd07u0dk6ggT3e7XK4hiN1Pzh0nfqN0hzgWFm6yY_CsCxsUHkae0eD6iRDn9NgCIzqzgFHxxWRB0cJgRUOtK8TM9umvhbJPqHrUVZAl96nv5ScRqmxXx311fFsMuGzaMcCwGP67sqAX7o8y5NFWnlB9Hjh1HarapTTJfvI Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 33b91a834ad24c82805880555930825d Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33b91a834ad24c82805880555930825d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33b91a834ad24c82805880555930825d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b91a834ad24c82805880555930825d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b91a834ad24c82805880555930825d"}]}] Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 33b91a834ad24c82805880555930825d Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-MigrationsAdminTest-633353152-project Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5c26541efd824c5ab866c2891adcd748 Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-MigrationsAdminTest-633353152-project Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc could not be found. Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '81b02ac4-7e82-46ed-b657-ed8e7a88fddc'} Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc could not be found. Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc could not be found. Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:09.034863 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:09.040707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:09.040707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:09.040707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:09.040707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:09.040707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:09.040707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc could not be found. Oct 11 19:49:09.040707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:09.040707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Returning 404 to user: Instance 81b02ac4-7e82-46ed-b657-ed8e7a88fddc could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:09.040707 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2ef18bab-9f4c-44e4-9081-41c872ee3670 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc" status: 404 len: 111 microversion: 2.1 time: 0.141602 Oct 11 19:49:09.046020 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 977/1899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:08 2022] GET /compute/v2.1/servers/81b02ac4-7e82-46ed-b657-ed8e7a88fddc => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:09.066875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-abd4eb71-9f1b-4740-95b4-b69278738731 req-8e3a6465-aab1-4d3b-ac93-b6f5bee4b1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d", "name": "network-vif-deleted", "tag": "469331a7-5446-4a38-be81-b82560e149f6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:09.124489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-abd4eb71-9f1b-4740-95b4-b69278738731 req-8e3a6465-aab1-4d3b-ac93-b6f5bee4b1da service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:09.127026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-abd4eb71-9f1b-4740-95b4-b69278738731 req-8e3a6465-aab1-4d3b-ac93-b6f5bee4b1da service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:09.128126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-abd4eb71-9f1b-4740-95b4-b69278738731 req-8e3a6465-aab1-4d3b-ac93-b6f5bee4b1da service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:09.159814 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-abd4eb71-9f1b-4740-95b4-b69278738731 req-8e3a6465-aab1-4d3b-ac93-b6f5bee4b1da service nova] Creating event network-vif-deleted:469331a7-5446-4a38-be81-b82560e149f6 for instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d on n-h2-860864-3 Oct 11 19:49:09.177068 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-abd4eb71-9f1b-4740-95b4-b69278738731 req-8e3a6465-aab1-4d3b-ac93-b6f5bee4b1da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127932 Oct 11 19:49:09.178789 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 978/1900] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:09.192213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b41eb03e-f043-445c-bda9-d617c5da7f88 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:09.192924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b41eb03e-f043-445c-bda9-d617c5da7f88 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:09.214825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b41eb03e-f043-445c-bda9-d617c5da7f88 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:09.215331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b41eb03e-f043-445c-bda9-d617c5da7f88 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:09.215773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b41eb03e-f043-445c-bda9-d617c5da7f88 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:09.216876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b41eb03e-f043-445c-bda9-d617c5da7f88 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:09.220120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b41eb03e-f043-445c-bda9-d617c5da7f88 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:09.221147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b41eb03e-f043-445c-bda9-d617c5da7f88 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:09.762328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b41eb03e-f043-445c-bda9-d617c5da7f88 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:09.773263 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b41eb03e-f043-445c-bda9-d617c5da7f88 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1522 microversion: 2.1 time: 0.592787 Oct 11 19:49:09.788168 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 979/1901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:09 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:09.798597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5d642811-730e-456e-8b03-3052bb543f8b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:09.799138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5d642811-730e-456e-8b03-3052bb543f8b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:09.806186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d642811-730e-456e-8b03-3052bb543f8b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:09.807213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d642811-730e-456e-8b03-3052bb543f8b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:09.808359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d642811-730e-456e-8b03-3052bb543f8b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:09.809123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d642811-730e-456e-8b03-3052bb543f8b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:09.810059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d642811-730e-456e-8b03-3052bb543f8b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:09.810491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d642811-730e-456e-8b03-3052bb543f8b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:10.036497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5d642811-730e-456e-8b03-3052bb543f8b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:10.114246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c2bdca56-8151-4020-8204-14ade760126c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:10.141930 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c2bdca56-8151-4020-8204-14ade760126c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 1.427893 Oct 11 19:49:10.185900 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 923/1902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:08 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:10.194351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:10.195255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:10.207164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:10.207968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:10.208601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:10.209502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:10.210136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:10.210952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:10.334450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:10.377524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:10.385644 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5d642811-730e-456e-8b03-3052bb543f8b tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 204 len: 0 microversion: 2.1 time: 0.596071 Oct 11 19:49:10.392321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:10.394081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:10.397447 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 980/1903] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:09 2022] DELETE /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:49:10.407591 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f4830eb3-c41c-41a3-87e4-b31f17f5bad5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.218839 Oct 11 19:49:10.412664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ad613b62-e6cc-47e4-93b7-efa091d97176 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:10.413416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ad613b62-e6cc-47e4-93b7-efa091d97176 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:10.417116 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 924/1904] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:10 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:10.435526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f192f780-80ce-4fb0-9492-d855710b8200 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:10.438632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f192f780-80ce-4fb0-9492-d855710b8200 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:10.447278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad613b62-e6cc-47e4-93b7-efa091d97176 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:10.447894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad613b62-e6cc-47e4-93b7-efa091d97176 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:10.448564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad613b62-e6cc-47e4-93b7-efa091d97176 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:10.456055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f192f780-80ce-4fb0-9492-d855710b8200 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:10.456555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f192f780-80ce-4fb0-9492-d855710b8200 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:10.457000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f192f780-80ce-4fb0-9492-d855710b8200 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:10.457707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f192f780-80ce-4fb0-9492-d855710b8200 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:10.458657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad613b62-e6cc-47e4-93b7-efa091d97176 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:10.459161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad613b62-e6cc-47e4-93b7-efa091d97176 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:10.459592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad613b62-e6cc-47e4-93b7-efa091d97176 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:10.470918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f192f780-80ce-4fb0-9492-d855710b8200 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:10.471521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f192f780-80ce-4fb0-9492-d855710b8200 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:10.878955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ad613b62-e6cc-47e4-93b7-efa091d97176 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:10.889031 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ad613b62-e6cc-47e4-93b7-efa091d97176 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 0.489527 Oct 11 19:49:10.889850 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 981/1905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:10 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:10.910736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f192f780-80ce-4fb0-9492-d855710b8200 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:10.912801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-edd547be-c54f-4e1c-b314-801cee77549a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:10.913490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-edd547be-c54f-4e1c-b314-801cee77549a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:10.920238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edd547be-c54f-4e1c-b314-801cee77549a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:10.920721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edd547be-c54f-4e1c-b314-801cee77549a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:10.921156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edd547be-c54f-4e1c-b314-801cee77549a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:10.922106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edd547be-c54f-4e1c-b314-801cee77549a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:10.922712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edd547be-c54f-4e1c-b314-801cee77549a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:10.923099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edd547be-c54f-4e1c-b314-801cee77549a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:10.924633 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f192f780-80ce-4fb0-9492-d855710b8200 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1183 microversion: 2.1 time: 0.504857 Oct 11 19:49:10.925787 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 925/1906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:10 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1183 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:10.933912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ea205d0d-a08b-4951-9cbb-b59d20f3eea3 req-1f302bf9-0b20-49f8-9895-38aa1113675d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f64eed-776b-4aaf-b46c-cb1f73e5500f", "name": "network-vif-plugged", "status": "completed", "tag": "bb9a377d-62a3-40e1-bbc3-8342947e2944"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:10.960736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ea205d0d-a08b-4951-9cbb-b59d20f3eea3 req-1f302bf9-0b20-49f8-9895-38aa1113675d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:10.961782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ea205d0d-a08b-4951-9cbb-b59d20f3eea3 req-1f302bf9-0b20-49f8-9895-38aa1113675d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:10.962578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ea205d0d-a08b-4951-9cbb-b59d20f3eea3 req-1f302bf9-0b20-49f8-9895-38aa1113675d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:10.992532 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ea205d0d-a08b-4951-9cbb-b59d20f3eea3 req-1f302bf9-0b20-49f8-9895-38aa1113675d service nova] Creating event network-vif-plugged:bb9a377d-62a3-40e1-bbc3-8342947e2944 for instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f on n-h2-860864-3 Oct 11 19:49:10.999994 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ea205d0d-a08b-4951-9cbb-b59d20f3eea3 req-1f302bf9-0b20-49f8-9895-38aa1113675d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069897 Oct 11 19:49:11.005947 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 926/1907] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:11.013852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c907bcd-b234-4184-8c8b-c0ef3c811a2c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:11.015057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5c907bcd-b234-4184-8c8b-c0ef3c811a2c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:11.025044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c907bcd-b234-4184-8c8b-c0ef3c811a2c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:11.025914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c907bcd-b234-4184-8c8b-c0ef3c811a2c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:11.026659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c907bcd-b234-4184-8c8b-c0ef3c811a2c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:11.028888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c907bcd-b234-4184-8c8b-c0ef3c811a2c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:11.029914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c907bcd-b234-4184-8c8b-c0ef3c811a2c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:11.030644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c907bcd-b234-4184-8c8b-c0ef3c811a2c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:11.353018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-edd547be-c54f-4e1c-b314-801cee77549a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:11.362962 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-edd547be-c54f-4e1c-b314-801cee77549a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1534 microversion: 2.1 time: 0.454657 Oct 11 19:49:11.364127 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 982/1908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:10 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1534 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:11.369319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5c907bcd-b234-4184-8c8b-c0ef3c811a2c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:11.372067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b588596-307a-4d97-8ae4-70acf5cb49b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:11.373057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b588596-307a-4d97-8ae4-70acf5cb49b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:11.381749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b588596-307a-4d97-8ae4-70acf5cb49b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:11.382507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b588596-307a-4d97-8ae4-70acf5cb49b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:11.383134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b588596-307a-4d97-8ae4-70acf5cb49b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:11.384014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b588596-307a-4d97-8ae4-70acf5cb49b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:11.384178 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5c907bcd-b234-4184-8c8b-c0ef3c811a2c tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1522 microversion: 2.1 time: 0.375865 Oct 11 19:49:11.384806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b588596-307a-4d97-8ae4-70acf5cb49b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:11.385234 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 927/1909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:11 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:11.385741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b588596-307a-4d97-8ae4-70acf5cb49b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:11.445012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:11.446782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:11.478620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:11.479439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:11.480066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:11.480961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:11.481588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:11.482183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:11.707117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b588596-307a-4d97-8ae4-70acf5cb49b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:11.717258 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b588596-307a-4d97-8ae4-70acf5cb49b6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 0.351135 Oct 11 19:49:11.738552 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 983/1910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:11 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:11.749871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:11.765277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:11.768312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:11.779486 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ba826049-ff47-4eb7-a65b-52f8b0a7361e tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.337974 Oct 11 19:49:11.792168 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 928/1911] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:11 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:11.917480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6527089e-a67f-48fe-9a52-e6d0449de0c1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:11.922183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6527089e-a67f-48fe-9a52-e6d0449de0c1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:11.931493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6527089e-a67f-48fe-9a52-e6d0449de0c1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:11.934505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6527089e-a67f-48fe-9a52-e6d0449de0c1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:11.935004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6527089e-a67f-48fe-9a52-e6d0449de0c1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:11.936881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6527089e-a67f-48fe-9a52-e6d0449de0c1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:11.937954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6527089e-a67f-48fe-9a52-e6d0449de0c1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:11.938392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6527089e-a67f-48fe-9a52-e6d0449de0c1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:11.957299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56d0cbd2-caaf-4ecf-ab16-375eb6558315 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:11.957919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56d0cbd2-caaf-4ecf-ab16-375eb6558315 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:11.972458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d0cbd2-caaf-4ecf-ab16-375eb6558315 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:11.973204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d0cbd2-caaf-4ecf-ab16-375eb6558315 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:11.975087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d0cbd2-caaf-4ecf-ab16-375eb6558315 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:11.977048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d0cbd2-caaf-4ecf-ab16-375eb6558315 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:11.977500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d0cbd2-caaf-4ecf-ab16-375eb6558315 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:11.979295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d0cbd2-caaf-4ecf-ab16-375eb6558315 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:12.215430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56d0cbd2-caaf-4ecf-ab16-375eb6558315 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:12.237971 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56d0cbd2-caaf-4ecf-ab16-375eb6558315 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1183 microversion: 2.1 time: 0.286933 Oct 11 19:49:12.248533 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 929/1912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:11 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:12.383547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6527089e-a67f-48fe-9a52-e6d0449de0c1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:12.387680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-09c206ea-ca5c-4f09-9ecb-7c5dc0001276 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:12.389046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-09c206ea-ca5c-4f09-9ecb-7c5dc0001276 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:12.399084 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6527089e-a67f-48fe-9a52-e6d0449de0c1 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 0.481512 Oct 11 19:49:12.402172 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 984/1913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:11 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:12.414866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6274a5f0-2b04-42e1-af77-3b123fde5e43 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:12.416098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6274a5f0-2b04-42e1-af77-3b123fde5e43 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:12.422560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09c206ea-ca5c-4f09-9ecb-7c5dc0001276 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:12.423825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09c206ea-ca5c-4f09-9ecb-7c5dc0001276 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:12.424269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09c206ea-ca5c-4f09-9ecb-7c5dc0001276 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:12.425751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6274a5f0-2b04-42e1-af77-3b123fde5e43 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:12.426238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6274a5f0-2b04-42e1-af77-3b123fde5e43 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:12.426717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6274a5f0-2b04-42e1-af77-3b123fde5e43 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:12.427416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6274a5f0-2b04-42e1-af77-3b123fde5e43 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:12.427872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6274a5f0-2b04-42e1-af77-3b123fde5e43 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:12.428284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6274a5f0-2b04-42e1-af77-3b123fde5e43 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:12.434389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09c206ea-ca5c-4f09-9ecb-7c5dc0001276 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:12.439244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09c206ea-ca5c-4f09-9ecb-7c5dc0001276 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:12.440907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09c206ea-ca5c-4f09-9ecb-7c5dc0001276 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:12.981931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-09c206ea-ca5c-4f09-9ecb-7c5dc0001276 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:12.998291 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-09c206ea-ca5c-4f09-9ecb-7c5dc0001276 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1534 microversion: 2.1 time: 0.613610 Oct 11 19:49:13.010585 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 930/1914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:12 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1534 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:13.012465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1d81a3c1-6f14-472c-b08d-4c874cee999e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:13.016990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1d81a3c1-6f14-472c-b08d-4c874cee999e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:13.035520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d81a3c1-6f14-472c-b08d-4c874cee999e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:13.036513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d81a3c1-6f14-472c-b08d-4c874cee999e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:13.037088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d81a3c1-6f14-472c-b08d-4c874cee999e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:13.039597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d81a3c1-6f14-472c-b08d-4c874cee999e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:13.041904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d81a3c1-6f14-472c-b08d-4c874cee999e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:13.042440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d81a3c1-6f14-472c-b08d-4c874cee999e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:13.122670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6274a5f0-2b04-42e1-af77-3b123fde5e43 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:13.132496 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6274a5f0-2b04-42e1-af77-3b123fde5e43 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1522 microversion: 2.1 time: 0.724220 Oct 11 19:49:13.133331 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 985/1915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:12 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1522 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:49:13.148489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:13.149109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:13.174047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:13.174567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:13.175007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:13.175703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:13.178606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:13.184513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:13.189264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:13.364605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:13.379466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:13.383155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:13.397711 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8e0a6019-44be-4d1a-a48b-8e770a033fb5 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.262662 Oct 11 19:49:13.402616 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 986/1916] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:13 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:13.414746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a67a0c33-e4ba-42df-952f-fd6f3663514a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:13.415645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a67a0c33-e4ba-42df-952f-fd6f3663514a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:13.453876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67a0c33-e4ba-42df-952f-fd6f3663514a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:13.454739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67a0c33-e4ba-42df-952f-fd6f3663514a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:13.455319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67a0c33-e4ba-42df-952f-fd6f3663514a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:13.456171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67a0c33-e4ba-42df-952f-fd6f3663514a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:13.457981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67a0c33-e4ba-42df-952f-fd6f3663514a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:13.458715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a67a0c33-e4ba-42df-952f-fd6f3663514a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:13.566702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1d81a3c1-6f14-472c-b08d-4c874cee999e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:13.585398 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1d81a3c1-6f14-472c-b08d-4c874cee999e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 0.583682 Oct 11 19:49:13.602780 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 931/1917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:13 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:13.607798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bfe35454-7d15-4285-936f-e155d956a214 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:13.610184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bfe35454-7d15-4285-936f-e155d956a214 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:13.639453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bfe35454-7d15-4285-936f-e155d956a214 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:13.639961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bfe35454-7d15-4285-936f-e155d956a214 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:13.640489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bfe35454-7d15-4285-936f-e155d956a214 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:13.641211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bfe35454-7d15-4285-936f-e155d956a214 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:13.641674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bfe35454-7d15-4285-936f-e155d956a214 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:13.642103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bfe35454-7d15-4285-936f-e155d956a214 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:13.671348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a67a0c33-e4ba-42df-952f-fd6f3663514a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:13.681237 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a67a0c33-e4ba-42df-952f-fd6f3663514a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1183 microversion: 2.1 time: 0.277317 Oct 11 19:49:13.685545 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 987/1918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:13 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:13.960194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bfe35454-7d15-4285-936f-e155d956a214 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:13.971355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a93800ec-11a4-48f5-ae0d-166b89de2b4d req-64427001-36fd-411b-921a-62b95048cbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffb0124-9fa9-4a38-ad03-7fece0c780fe", "name": "network-vif-deleted", "tag": "7686bb0d-edf8-44e5-bb28-774c272e3719"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:13.983134 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bfe35454-7d15-4285-936f-e155d956a214 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 0.367774 Oct 11 19:49:13.998560 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 932/1919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:13 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:14.005657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a93800ec-11a4-48f5-ae0d-166b89de2b4d req-64427001-36fd-411b-921a-62b95048cbe2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:14.006642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a93800ec-11a4-48f5-ae0d-166b89de2b4d req-64427001-36fd-411b-921a-62b95048cbe2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:14.007389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a93800ec-11a4-48f5-ae0d-166b89de2b4d req-64427001-36fd-411b-921a-62b95048cbe2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:14.026071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-92078aeb-f49d-4cf0-a7e1-d082f635af88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:14.026720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-92078aeb-f49d-4cf0-a7e1-d082f635af88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:14.033663 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a93800ec-11a4-48f5-ae0d-166b89de2b4d req-64427001-36fd-411b-921a-62b95048cbe2 service nova] Creating event network-vif-deleted:7686bb0d-edf8-44e5-bb28-774c272e3719 for instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe on n-h1-860864-3 Oct 11 19:49:14.041970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92078aeb-f49d-4cf0-a7e1-d082f635af88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:14.042115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92078aeb-f49d-4cf0-a7e1-d082f635af88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:14.043508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92078aeb-f49d-4cf0-a7e1-d082f635af88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:14.044772 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a93800ec-11a4-48f5-ae0d-166b89de2b4d req-64427001-36fd-411b-921a-62b95048cbe2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078285 Oct 11 19:49:14.048442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92078aeb-f49d-4cf0-a7e1-d082f635af88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:14.049315 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 988/1920] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:49:14.050422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92078aeb-f49d-4cf0-a7e1-d082f635af88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:14.058880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92078aeb-f49d-4cf0-a7e1-d082f635af88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:14.160760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a7b67d01-b97c-45ac-a600-09b43d414e8d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:14.161804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a7b67d01-b97c-45ac-a600-09b43d414e8d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:14.185104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b67d01-b97c-45ac-a600-09b43d414e8d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:14.193958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b67d01-b97c-45ac-a600-09b43d414e8d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:14.198414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b67d01-b97c-45ac-a600-09b43d414e8d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:14.199404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b67d01-b97c-45ac-a600-09b43d414e8d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:14.206479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b67d01-b97c-45ac-a600-09b43d414e8d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:14.211908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b67d01-b97c-45ac-a600-09b43d414e8d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:14.329653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-92078aeb-f49d-4cf0-a7e1-d082f635af88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:14.340620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-92078aeb-f49d-4cf0-a7e1-d082f635af88 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 200 len: 1364 microversion: 2.1 time: 0.318963 Oct 11 19:49:14.345166 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 933/1921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:14 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:14.453382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:14.456092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:14.467065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:14.471631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:14.472614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:14.478219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:14.479095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:14.480055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:14.769293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:14.786168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:14.788315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:14.807851 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0362657b-94a1-40c0-8bc4-076d29f62585 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.359278 Oct 11 19:49:14.823100 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 934/1922] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:14 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:49:14.833538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ce2427e8-d9ee-44bc-b3d2-073d510620b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:14.833538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ce2427e8-d9ee-44bc-b3d2-073d510620b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:14.842175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce2427e8-d9ee-44bc-b3d2-073d510620b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:14.843032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce2427e8-d9ee-44bc-b3d2-073d510620b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:14.844451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce2427e8-d9ee-44bc-b3d2-073d510620b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:14.845421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce2427e8-d9ee-44bc-b3d2-073d510620b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:14.846233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce2427e8-d9ee-44bc-b3d2-073d510620b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:14.847020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce2427e8-d9ee-44bc-b3d2-073d510620b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:15.527118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a7b67d01-b97c-45ac-a600-09b43d414e8d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:15.536859 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a7b67d01-b97c-45ac-a600-09b43d414e8d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1507 microversion: 2.1 time: 1.381179 Oct 11 19:49:15.539066 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 989/1923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:14 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1507 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:15.545962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f7a986ee-9fad-4eaa-aa7e-98e799d820ec tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:15.558643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f7a986ee-9fad-4eaa-aa7e-98e799d820ec tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:15.576871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7a986ee-9fad-4eaa-aa7e-98e799d820ec tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:15.577932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7a986ee-9fad-4eaa-aa7e-98e799d820ec tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:15.580998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7a986ee-9fad-4eaa-aa7e-98e799d820ec tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:15.581837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7a986ee-9fad-4eaa-aa7e-98e799d820ec tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:15.582320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7a986ee-9fad-4eaa-aa7e-98e799d820ec tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:15.582817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7a986ee-9fad-4eaa-aa7e-98e799d820ec tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:15.751942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7a986ee-9fad-4eaa-aa7e-98e799d820ec tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:15.761604 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f7a986ee-9fad-4eaa-aa7e-98e799d820ec tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1183 microversion: 2.1 time: 0.220705 Oct 11 19:49:15.770997 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 990/1924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:15 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:15.776327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7507804-576e-48cb-9780-8267449a3a6b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:15.777205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7507804-576e-48cb-9780-8267449a3a6b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:15.784267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7507804-576e-48cb-9780-8267449a3a6b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:15.785059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7507804-576e-48cb-9780-8267449a3a6b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:15.785684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7507804-576e-48cb-9780-8267449a3a6b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:15.787107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7507804-576e-48cb-9780-8267449a3a6b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:15.787846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7507804-576e-48cb-9780-8267449a3a6b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:15.788535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7507804-576e-48cb-9780-8267449a3a6b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:15.810925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce2427e8-d9ee-44bc-b3d2-073d510620b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:15.825034 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ce2427e8-d9ee-44bc-b3d2-073d510620b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 1.000348 Oct 11 19:49:15.829603 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 935/1925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:14 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:15.843438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:15.846217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 6ffb0124-9fa9-4a38-ad03-7fece0c780fe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:15.862932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:15.863356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:15.866658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:15.867484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:15.867962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:15.868417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:15.898944 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] HTTP exception thrown: Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe could not be found. Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Request method failure captured: Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe HTTP/1.1 Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcdiPNBEtDd07u0dk6ggT3e7XK4hiN1Pzh0nfqN0hzgWFm6yY_CsCxsUHkae0eD6iRDn9NgCIzqzgFHxxWRB0cJgRUOtK8TM9umvhbJPqHrUVZAl96nv5ScRqmxXx311fFsMuGzaMcCwGP67sqAX7o8y5NFWnlB9Hjh1HarapTTJfvI Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 33b91a834ad24c82805880555930825d Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33b91a834ad24c82805880555930825d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33b91a834ad24c82805880555930825d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b91a834ad24c82805880555930825d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b91a834ad24c82805880555930825d"}]}] Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 33b91a834ad24c82805880555930825d Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-MigrationsAdminTest-633353152-project Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 5c26541efd824c5ab866c2891adcd748 Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-MigrationsAdminTest-633353152-project Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe could not be found. Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '6ffb0124-9fa9-4a38-ad03-7fece0c780fe'} Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe could not be found. Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe could not be found. Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:15.905179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:15.912120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:15.912120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:15.912120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:15.912120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:15.912120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:15.912120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe could not be found. Oct 11 19:49:15.912120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:15.912120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Returning 404 to user: Instance 6ffb0124-9fa9-4a38-ad03-7fece0c780fe could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:15.912120 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-86962cef-03cf-44d1-b406-12e5c3472bb4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe" status: 404 len: 111 microversion: 2.1 time: 0.075922 Oct 11 19:49:15.915042 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 936/1926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:15 2022] GET /compute/v2.1/servers/6ffb0124-9fa9-4a38-ad03-7fece0c780fe => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:15.919988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1a005082-58e4-4c05-86f6-077c46ff421f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:15.920608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1a005082-58e4-4c05-86f6-077c46ff421f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:15.948613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a005082-58e4-4c05-86f6-077c46ff421f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:15.949370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a005082-58e4-4c05-86f6-077c46ff421f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:15.949891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a005082-58e4-4c05-86f6-077c46ff421f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:15.950722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a005082-58e4-4c05-86f6-077c46ff421f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:15.951387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a005082-58e4-4c05-86f6-077c46ff421f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:15.951799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a005082-58e4-4c05-86f6-077c46ff421f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:16.321920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b7507804-576e-48cb-9780-8267449a3a6b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:16.338697 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7507804-576e-48cb-9780-8267449a3a6b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 0.566194 Oct 11 19:49:16.377695 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 991/1927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:15 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:16.389717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:16.393321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:16.416396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:16.416900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:16.417342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:16.418070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:16.429277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:16.429734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:16.601858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a005082-58e4-4c05-86f6-077c46ff421f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:16.611774 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1a005082-58e4-4c05-86f6-077c46ff421f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 200 len: 1507 microversion: 2.1 time: 0.695560 Oct 11 19:49:16.631116 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 937/1928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:15 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 1507 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:16.652345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9440c7cf-715c-4967-966a-09a963c25d4a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '.version_select at 0x7f83cc1d29d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:16.694070 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9440c7cf-715c-4967-966a-09a963c25d4a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-637683612" status: 202 len: 0 microversion: 2.1 time: 0.061498 Oct 11 19:49:16.697543 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 938/1929] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 19:49:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-637683612 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:49:16.707392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:16.738089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:16.741923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-15503ee1-7d26-4da7-9780-f1e2eb67c0e9 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:16.745641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-15503ee1-7d26-4da7-9780-f1e2eb67c0e9 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:16.747904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:16.776505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15503ee1-7d26-4da7-9780-f1e2eb67c0e9 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:16.778622 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-725a169a-58fc-4b54-aee7-6c62df26a7ff tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1546 microversion: 2.91 time: 0.399421 Oct 11 19:49:16.780405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15503ee1-7d26-4da7-9780-f1e2eb67c0e9 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:16.785499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15503ee1-7d26-4da7-9780-f1e2eb67c0e9 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:16.786396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15503ee1-7d26-4da7-9780-f1e2eb67c0e9 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:16.786960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15503ee1-7d26-4da7-9780-f1e2eb67c0e9 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:16.787450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15503ee1-7d26-4da7-9780-f1e2eb67c0e9 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:16.806624 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 992/1930] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:16 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1546 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:16.806624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ab862a3-a867-4719-9fb6-1902e038b78e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:16.806624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6ab862a3-a867-4719-9fb6-1902e038b78e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:16.842206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab862a3-a867-4719-9fb6-1902e038b78e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:16.842752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab862a3-a867-4719-9fb6-1902e038b78e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:16.843516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab862a3-a867-4719-9fb6-1902e038b78e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:16.854362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab862a3-a867-4719-9fb6-1902e038b78e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:16.856409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab862a3-a867-4719-9fb6-1902e038b78e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:16.858384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab862a3-a867-4719-9fb6-1902e038b78e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:16.909046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-15503ee1-7d26-4da7-9780-f1e2eb67c0e9 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:17.050261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:17.117760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6ab862a3-a867-4719-9fb6-1902e038b78e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:17.132364 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6ab862a3-a867-4719-9fb6-1902e038b78e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1183 microversion: 2.1 time: 0.338999 Oct 11 19:49:17.141899 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 993/1931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:16 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1183 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:17.169661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-baf39ca7-bb5c-4081-94da-b307dafadacc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:17.173596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-baf39ca7-bb5c-4081-94da-b307dafadacc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:17.174676 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-15503ee1-7d26-4da7-9780-f1e2eb67c0e9 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 204 len: 0 microversion: 2.1 time: 0.475480 Oct 11 19:49:17.178270 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 939/1932] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:16 2022] DELETE /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:49:17.192447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-baf39ca7-bb5c-4081-94da-b307dafadacc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:17.199227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-baf39ca7-bb5c-4081-94da-b307dafadacc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:17.201398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-baf39ca7-bb5c-4081-94da-b307dafadacc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:17.202224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-baf39ca7-bb5c-4081-94da-b307dafadacc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:17.207144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-baf39ca7-bb5c-4081-94da-b307dafadacc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:17.210826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-baf39ca7-bb5c-4081-94da-b307dafadacc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:17.368561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c139161f-2eee-4b94-ac77-9478e1415e4b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:17.369267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c139161f-2eee-4b94-ac77-9478e1415e4b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:17.390746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c139161f-2eee-4b94-ac77-9478e1415e4b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:17.403418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c139161f-2eee-4b94-ac77-9478e1415e4b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:17.404918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c139161f-2eee-4b94-ac77-9478e1415e4b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:17.416110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c139161f-2eee-4b94-ac77-9478e1415e4b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:17.416615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c139161f-2eee-4b94-ac77-9478e1415e4b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:17.417116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c139161f-2eee-4b94-ac77-9478e1415e4b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:17.862638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-baf39ca7-bb5c-4081-94da-b307dafadacc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:17.882676 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-baf39ca7-bb5c-4081-94da-b307dafadacc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1522 microversion: 2.1 time: 0.732674 Oct 11 19:49:17.898562 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 994/1933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:17 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1522 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:17.907781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-759539786", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "412cbda9-d9a6-437a-9a83-87a92464cf0c"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:17.985835 n-d-860864-3 devstack@n-api.service[126956]: Exception ignored in: . at 0x7f83d07fbc10> Oct 11 19:49:17.985835 n-d-860864-3 devstack@n-api.service[126956]: Traceback (most recent call last): Oct 11 19:49:17.985835 n-d-860864-3 devstack@n-api.service[126956]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 11 19:49:17.986303 n-d-860864-3 devstack@n-api.service[126956]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 11 19:49:17.986303 n-d-860864-3 devstack@n-api.service[126956]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 11 19:49:17.986495 n-d-860864-3 devstack@n-api.service[126956]: connection_record.checkin() Oct 11 19:49:17.986711 n-d-860864-3 devstack@n-api.service[126956]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 11 19:49:17.987124 n-d-860864-3 devstack@n-api.service[126956]: pool.dispatch.checkin(connection, self) Oct 11 19:49:17.987313 n-d-860864-3 devstack@n-api.service[126956]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 11 19:49:17.987705 n-d-860864-3 devstack@n-api.service[126956]: fn(*args, **kw) Oct 11 19:49:17.987865 n-d-860864-3 devstack@n-api.service[126956]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 11 19:49:17.988148 n-d-860864-3 devstack@n-api.service[126956]: time.sleep(0) Oct 11 19:49:17.988357 n-d-860864-3 devstack@n-api.service[126956]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 11 19:49:17.988656 n-d-860864-3 devstack@n-api.service[126956]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 11 19:49:17.988852 n-d-860864-3 devstack@n-api.service[126956]: AssertionError: do not call blocking functions from the mainloop Oct 11 19:49:18.044353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] validate_networks() for [('412cbda9-d9a6-437a-9a83-87a92464cf0c', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:49:18.091067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c139161f-2eee-4b94-ac77-9478e1415e4b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:18.100374 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c139161f-2eee-4b94-ac77-9478e1415e4b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 0.736396 Oct 11 19:49:18.106065 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 940/1934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:17 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:18.118768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:18.120430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:18.137393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:18.138928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:18.140873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:18.144998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:18.146503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:18.148334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:18.526548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:18.540547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:18.542005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:18.580291 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e10a0a8b-143a-4c8a-9d17-ab078b8536b7 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1533 microversion: 2.91 time: 0.472745 Oct 11 19:49:18.581176 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 941/1935] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:18 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1533 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:18.602041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a56dcab-aaef-494f-98a0-0d48b704ef7c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:18.622836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9a56dcab-aaef-494f-98a0-0d48b704ef7c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:18.652728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a56dcab-aaef-494f-98a0-0d48b704ef7c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:18.653230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a56dcab-aaef-494f-98a0-0d48b704ef7c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:18.653712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a56dcab-aaef-494f-98a0-0d48b704ef7c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:18.654423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a56dcab-aaef-494f-98a0-0d48b704ef7c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:18.675905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a56dcab-aaef-494f-98a0-0d48b704ef7c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:18.675905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a56dcab-aaef-494f-98a0-0d48b704ef7c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:19.104554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9a56dcab-aaef-494f-98a0-0d48b704ef7c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:19.115321 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a56dcab-aaef-494f-98a0-0d48b704ef7c tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1183 microversion: 2.1 time: 0.533252 Oct 11 19:49:19.115976 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 942/1936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:18 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:19.144960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b026b854-ad3e-42be-8507-e4c92830ce88 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:19.145870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b026b854-ad3e-42be-8507-e4c92830ce88 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:19.181027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b026b854-ad3e-42be-8507-e4c92830ce88 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:19.181606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b026b854-ad3e-42be-8507-e4c92830ce88 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:19.182071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b026b854-ad3e-42be-8507-e4c92830ce88 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:19.182823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b026b854-ad3e-42be-8507-e4c92830ce88 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:19.183329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b026b854-ad3e-42be-8507-e4c92830ce88 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:19.183758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b026b854-ad3e-42be-8507-e4c92830ce88 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:19.685302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-b026b854-ad3e-42be-8507-e4c92830ce88 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] Lazy-loading 'services' on Instance uuid f30bdfac-1c61-4f61-876d-0922853f40c0 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:49:19.709446 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b026b854-ad3e-42be-8507-e4c92830ce88 tempest-UnshelveToHostMultiNodesTest-231366950 tempest-UnshelveToHostMultiNodesTest-231366950-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1938 microversion: 2.91 time: 0.592406 Oct 11 19:49:19.710312 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 943/1937] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:19 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1938 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:19.715277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f2792b42-a2ae-4901-818d-4d5333f9e95a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:19.716043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f2792b42-a2ae-4901-818d-4d5333f9e95a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:19.724320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2792b42-a2ae-4901-818d-4d5333f9e95a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:19.725147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2792b42-a2ae-4901-818d-4d5333f9e95a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:19.725830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2792b42-a2ae-4901-818d-4d5333f9e95a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:19.726819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2792b42-a2ae-4901-818d-4d5333f9e95a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:19.727525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2792b42-a2ae-4901-818d-4d5333f9e95a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:19.728166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2792b42-a2ae-4901-818d-4d5333f9e95a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:19.792623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f2792b42-a2ae-4901-818d-4d5333f9e95a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:19.949903 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f2792b42-a2ae-4901-818d-4d5333f9e95a tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "DELETE /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 204 len: 0 microversion: 2.1 time: 0.238045 Oct 11 19:49:19.953833 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 944/1938] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:19 2022] DELETE /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:49:19.962083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-28c6f1c3-a92f-4e52-aa12-47e351320d81 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:19.962831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-28c6f1c3-a92f-4e52-aa12-47e351320d81 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:19.969083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28c6f1c3-a92f-4e52-aa12-47e351320d81 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:19.969581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28c6f1c3-a92f-4e52-aa12-47e351320d81 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:19.970026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28c6f1c3-a92f-4e52-aa12-47e351320d81 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:19.970758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28c6f1c3-a92f-4e52-aa12-47e351320d81 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:19.971428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28c6f1c3-a92f-4e52-aa12-47e351320d81 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:19.971784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28c6f1c3-a92f-4e52-aa12-47e351320d81 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:20.824693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-28c6f1c3-a92f-4e52-aa12-47e351320d81 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:20.837853 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-28c6f1c3-a92f-4e52-aa12-47e351320d81 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1504 microversion: 2.1 time: 0.885440 Oct 11 19:49:20.851896 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 945/1939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:19 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1504 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:20.867231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d29e1b3b-61b9-4193-945e-863a60dc9f7f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:20.868227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d29e1b3b-61b9-4193-945e-863a60dc9f7f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:20.877431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d29e1b3b-61b9-4193-945e-863a60dc9f7f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:20.878314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d29e1b3b-61b9-4193-945e-863a60dc9f7f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:20.879029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d29e1b3b-61b9-4193-945e-863a60dc9f7f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:20.879981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d29e1b3b-61b9-4193-945e-863a60dc9f7f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:20.880660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d29e1b3b-61b9-4193-945e-863a60dc9f7f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:20.882161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d29e1b3b-61b9-4193-945e-863a60dc9f7f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:21.000710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:49:21.003347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:49:21.004333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:49:21.005042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:49:21.005564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:49:21.023427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:21.024460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:21.025105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:21.026148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:21.027102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:21.027797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:21.058013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Getting quotas for project cd6c2139c019469d8d6a41e036595765. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:49:21.065543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Getting quotas for user add987fef80d49318742f2c38793cf7a and project cd6c2139c019469d8d6a41e036595765. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:49:21.084902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:49:21.088646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:49:21.195517 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6c3538da-1ba1-407b-8aa8-0b665669cdb8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.307096 Oct 11 19:49:21.204007 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 995/1940] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:49:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:49:21.206878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c2e4b84-d4a2-42fe-b066-766c8e042bc8 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:21.210504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c2e4b84-d4a2-42fe-b066-766c8e042bc8 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:21.228886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c2e4b84-d4a2-42fe-b066-766c8e042bc8 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:21.229400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c2e4b84-d4a2-42fe-b066-766c8e042bc8 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:21.229846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c2e4b84-d4a2-42fe-b066-766c8e042bc8 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:21.231340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c2e4b84-d4a2-42fe-b066-766c8e042bc8 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:21.231815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c2e4b84-d4a2-42fe-b066-766c8e042bc8 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:21.232323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c2e4b84-d4a2-42fe-b066-766c8e042bc8 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:21.276529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c2e4b84-d4a2-42fe-b066-766c8e042bc8 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:21.471036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d29e1b3b-61b9-4193-945e-863a60dc9f7f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:21.471036 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d29e1b3b-61b9-4193-945e-863a60dc9f7f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 0.603728 Oct 11 19:49:21.471036 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 946/1941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:20 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:21.478386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b211b71-4307-46b3-aa7e-07c42b2d9ab2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:21.479458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2b211b71-4307-46b3-aa7e-07c42b2d9ab2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:21.505790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b211b71-4307-46b3-aa7e-07c42b2d9ab2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:21.509628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b211b71-4307-46b3-aa7e-07c42b2d9ab2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:21.511084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b211b71-4307-46b3-aa7e-07c42b2d9ab2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:21.523493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b211b71-4307-46b3-aa7e-07c42b2d9ab2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:21.524727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b211b71-4307-46b3-aa7e-07c42b2d9ab2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:21.525471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b211b71-4307-46b3-aa7e-07c42b2d9ab2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:21.557158 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c2e4b84-d4a2-42fe-b066-766c8e042bc8 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 204 len: 0 microversion: 2.91 time: 0.358064 Oct 11 19:49:21.558553 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 996/1942] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:49:21 2022] DELETE /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:49:21.597535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:21.598645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:21.627159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:21.627917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:21.628633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:21.629489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:21.630273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:21.630805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:21.725124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:21.725767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:21.726331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:21.726905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lazy-loading 'fault' on Instance uuid 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:49:21.837245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:21.856972 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1d3ff818-dc44-4962-b375-6c09253d4c2a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 200 len: 1142 microversion: 2.1 time: 0.293660 Oct 11 19:49:21.863513 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 997/1943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:21 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 1142 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:21.915865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7abf782a-9f13-46df-ba59-eed6abb55047 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:21.917980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7abf782a-9f13-46df-ba59-eed6abb55047 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:22.156047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7abf782a-9f13-46df-ba59-eed6abb55047 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:22.169721 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7abf782a-9f13-46df-ba59-eed6abb55047 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1217 microversion: 2.1 time: 0.302351 Oct 11 19:49:22.187540 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 998/1944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:21 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1217 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:22.194497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:22.213238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:22.243662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:22.244213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:22.244695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:22.245593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:22.246069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:22.246514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:22.517666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:22.535649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:22.537540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:22.559644 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-26d375a7-357a-4e39-9fd1-57bf24c801d4 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.369819 Oct 11 19:49:22.559850 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 999/1945] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:22 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:22.573564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-41ec8d7d-0261-4f42-93dd-052a9c195ed2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:22.574237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-41ec8d7d-0261-4f42-93dd-052a9c195ed2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:22.584625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41ec8d7d-0261-4f42-93dd-052a9c195ed2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:22.585436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41ec8d7d-0261-4f42-93dd-052a9c195ed2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:22.591304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41ec8d7d-0261-4f42-93dd-052a9c195ed2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:22.593473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41ec8d7d-0261-4f42-93dd-052a9c195ed2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:22.598854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41ec8d7d-0261-4f42-93dd-052a9c195ed2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:22.599613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41ec8d7d-0261-4f42-93dd-052a9c195ed2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:22.802510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2b211b71-4307-46b3-aa7e-07c42b2d9ab2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:22.811904 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2b211b71-4307-46b3-aa7e-07c42b2d9ab2 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1469 microversion: 2.1 time: 1.346680 Oct 11 19:49:22.815250 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 947/1946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:21 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1469 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:22.836409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-451379a7-6bc1-4698-887d-14b15da812fd req-7ba72ee3-7af6-4190-abe0-acc74c38eb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f64eed-776b-4aaf-b46c-cb1f73e5500f", "name": "network-vif-deleted", "tag": "bb9a377d-62a3-40e1-bbc3-8342947e2944"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:22.851248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-451379a7-6bc1-4698-887d-14b15da812fd req-7ba72ee3-7af6-4190-abe0-acc74c38eb5d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:22.852300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-451379a7-6bc1-4698-887d-14b15da812fd req-7ba72ee3-7af6-4190-abe0-acc74c38eb5d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:22.854406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-451379a7-6bc1-4698-887d-14b15da812fd req-7ba72ee3-7af6-4190-abe0-acc74c38eb5d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:22.890580 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-451379a7-6bc1-4698-887d-14b15da812fd req-7ba72ee3-7af6-4190-abe0-acc74c38eb5d service nova] Creating event network-vif-deleted:bb9a377d-62a3-40e1-bbc3-8342947e2944 for instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f on n-h2-860864-3 Oct 11 19:49:22.906751 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-451379a7-6bc1-4698-887d-14b15da812fd req-7ba72ee3-7af6-4190-abe0-acc74c38eb5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087157 Oct 11 19:49:22.913749 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 948/1947] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:22.926913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d570295c-2f55-40e3-a905-20ac633afc3b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:22.932165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d570295c-2f55-40e3-a905-20ac633afc3b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:22.957289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d570295c-2f55-40e3-a905-20ac633afc3b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:22.957783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d570295c-2f55-40e3-a905-20ac633afc3b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:22.964372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d570295c-2f55-40e3-a905-20ac633afc3b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:22.969590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d570295c-2f55-40e3-a905-20ac633afc3b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:22.969976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d570295c-2f55-40e3-a905-20ac633afc3b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:22.970411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d570295c-2f55-40e3-a905-20ac633afc3b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:22.981295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-41ec8d7d-0261-4f42-93dd-052a9c195ed2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:22.990479 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-41ec8d7d-0261-4f42-93dd-052a9c195ed2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1504 microversion: 2.1 time: 0.429200 Oct 11 19:49:23.004418 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1000/1948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:22 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:23.018188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8cfa5ce7-9f9c-4472-aed0-56badf432507 req-05ba9ec8-8f94-4ca2-a451-168d7b65590d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1ceed5-0490-4d64-8d97-e0684bd7f05f", "name": "network-vif-unplugged", "status": "completed", "tag": "c0a9bf59-035c-4a1e-8ebc-eeb631b03c41"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:23.036114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8cfa5ce7-9f9c-4472-aed0-56badf432507 req-05ba9ec8-8f94-4ca2-a451-168d7b65590d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:23.036605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8cfa5ce7-9f9c-4472-aed0-56badf432507 req-05ba9ec8-8f94-4ca2-a451-168d7b65590d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:23.057780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8cfa5ce7-9f9c-4472-aed0-56badf432507 req-05ba9ec8-8f94-4ca2-a451-168d7b65590d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:23.082710 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8cfa5ce7-9f9c-4472-aed0-56badf432507 req-05ba9ec8-8f94-4ca2-a451-168d7b65590d service nova] Creating event network-vif-unplugged:c0a9bf59-035c-4a1e-8ebc-eeb631b03c41 for instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f on n-h2-860864-3 Oct 11 19:49:23.099929 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8cfa5ce7-9f9c-4472-aed0-56badf432507 req-05ba9ec8-8f94-4ca2-a451-168d7b65590d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096199 Oct 11 19:49:23.100852 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1001/1949] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:23.106349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:23.114910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:23.132260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:23.132855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:23.133375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:23.134170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:23.135235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:23.135733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:23.170441 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] HTTP exception thrown: Instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d could not be found. Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Request method failure captured: Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d HTTP/1.1 Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccsgzzVs8K4wlcOreWzusfqslL2IgERaJJT7THzhfWPn2GkuCmIzFhhCYJfwDsXS-z4ETFZFcBvMivttSxpkeLzVaDvyy2osF_qtaJbGRvYDJMDSa9Kn0pHwZeFad28A0Wny7VlTNF6JtKB-3BT-FVbGNHHyJujXawY8o2ZGVBWmWY Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 947af1a9d24f4e19a59ec820ba1a65e4 Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-LiveMigrationTest-924138453 Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/947af1a9d24f4e19a59ec820ba1a65e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_947af1a9d24f4e19a59ec820ba1a65e4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/947af1a9d24f4e19a59ec820ba1a65e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/947af1a9d24f4e19a59ec820ba1a65e4"}]}] Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-LiveMigrationTest-924138453 Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 947af1a9d24f4e19a59ec820ba1a65e4 Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-LiveMigrationTest-924138453 Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-LiveMigrationTest-924138453-project Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 4e2460b9a8f34662b802709a91907510 Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-LiveMigrationTest-924138453-project Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d could not be found. Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d'} Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d could not be found. Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d could not be found. Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:23.172776 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:23.178584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:23.178584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:23.178584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:23.178584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:23.178584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:23.178584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d could not be found. Oct 11 19:49:23.178584 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:23.178584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Returning 404 to user: Instance 30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:23.179709 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b9560b3-2736-4e42-a961-718bfd2dd114 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d" status: 404 len: 111 microversion: 2.1 time: 0.076513 Oct 11 19:49:23.180730 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1002/1950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:23 2022] GET /compute/v2.1/servers/30e0a0f7-8a79-4f1f-9fb0-fcc18a60d80d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:23.187396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-0e4940c1-7225-4a06-a643-84e3789ef59d req-dfbca857-07d9-4b02-bb37-8b94e40617b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee854-d900-44e9-8d2f-a34305c016ea", "name": "network-vif-deleted", "tag": "bf229230-440b-48f9-9914-92cff8501f97"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:23.222636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0e4940c1-7225-4a06-a643-84e3789ef59d req-dfbca857-07d9-4b02-bb37-8b94e40617b8 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:23.223288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0e4940c1-7225-4a06-a643-84e3789ef59d req-dfbca857-07d9-4b02-bb37-8b94e40617b8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:23.223852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0e4940c1-7225-4a06-a643-84e3789ef59d req-dfbca857-07d9-4b02-bb37-8b94e40617b8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:23.238670 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-0e4940c1-7225-4a06-a643-84e3789ef59d req-dfbca857-07d9-4b02-bb37-8b94e40617b8 service nova] Creating event network-vif-deleted:bf229230-440b-48f9-9914-92cff8501f97 for instance 35dee854-d900-44e9-8d2f-a34305c016ea on n-h2-860864-3 Oct 11 19:49:23.244455 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-0e4940c1-7225-4a06-a643-84e3789ef59d req-dfbca857-07d9-4b02-bb37-8b94e40617b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062466 Oct 11 19:49:23.245930 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1003/1951] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:23.252829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-294fd862-e672-497c-9275-95776991b3a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:23.253468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-294fd862-e672-497c-9275-95776991b3a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:23.262137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-294fd862-e672-497c-9275-95776991b3a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:23.263103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-294fd862-e672-497c-9275-95776991b3a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:23.263701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-294fd862-e672-497c-9275-95776991b3a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:23.264615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-294fd862-e672-497c-9275-95776991b3a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:23.265229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-294fd862-e672-497c-9275-95776991b3a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:23.265872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-294fd862-e672-497c-9275-95776991b3a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:23.445269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-294fd862-e672-497c-9275-95776991b3a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:23.459037 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-294fd862-e672-497c-9275-95776991b3a1 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1213 microversion: 2.1 time: 0.206851 Oct 11 19:49:23.460508 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1004/1952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:23 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1213 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:23.594100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:23.594744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:23.617312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:23.618752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:23.625897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:23.631764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:23.632539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:23.635796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:23.641103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:23.981559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:23.989144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d570295c-2f55-40e3-a905-20ac633afc3b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:23.998053 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d570295c-2f55-40e3-a905-20ac633afc3b tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 1.082138 Oct 11 19:49:24.002823 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 949/1953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:22 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:24.012295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:24.014218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644423219a0a496e9ec83ec1d8f2a8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56e6a2a33df4160b8835bd8975186ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:24.015788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c69b8f76-f3b3-4b3e-9422-38b3485d06fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:24.016525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c69b8f76-f3b3-4b3e-9422-38b3485d06fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:24.029841 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dd777a93-7409-4898-9fe5-82c9cfbb5014 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 200 len: 1539 microversion: 2.91 time: 0.439976 Oct 11 19:49:24.037088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c69b8f76-f3b3-4b3e-9422-38b3485d06fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:24.039781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c69b8f76-f3b3-4b3e-9422-38b3485d06fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:24.047629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c69b8f76-f3b3-4b3e-9422-38b3485d06fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:24.048008 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1005/1954] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:23 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 1539 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:24.050891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c69b8f76-f3b3-4b3e-9422-38b3485d06fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:24.053266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c69b8f76-f3b3-4b3e-9422-38b3485d06fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:24.064391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c69b8f76-f3b3-4b3e-9422-38b3485d06fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:24.065930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-22c74622-9c7f-4d3c-b04e-2f10d161f7a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:24.070767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-22c74622-9c7f-4d3c-b04e-2f10d161f7a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:24.083715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c74622-9c7f-4d3c-b04e-2f10d161f7a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:24.087157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c74622-9c7f-4d3c-b04e-2f10d161f7a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:24.087838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c74622-9c7f-4d3c-b04e-2f10d161f7a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:24.088760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c74622-9c7f-4d3c-b04e-2f10d161f7a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:24.091358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c74622-9c7f-4d3c-b04e-2f10d161f7a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:24.092016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c74622-9c7f-4d3c-b04e-2f10d161f7a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:24.307788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c69b8f76-f3b3-4b3e-9422-38b3485d06fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:24.323802 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c69b8f76-f3b3-4b3e-9422-38b3485d06fb tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 200 len: 1427 microversion: 2.1 time: 0.315702 Oct 11 19:49:24.330010 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 950/1955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:24 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 1427 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:24.488341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c26c34e4-ff0c-45b5-b4e2-5406afca15c8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:24.489060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c26c34e4-ff0c-45b5-b4e2-5406afca15c8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:24.507569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26c34e4-ff0c-45b5-b4e2-5406afca15c8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:24.520219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26c34e4-ff0c-45b5-b4e2-5406afca15c8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:24.524128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26c34e4-ff0c-45b5-b4e2-5406afca15c8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:24.527929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26c34e4-ff0c-45b5-b4e2-5406afca15c8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:24.530790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26c34e4-ff0c-45b5-b4e2-5406afca15c8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:24.534286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26c34e4-ff0c-45b5-b4e2-5406afca15c8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:24.694432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c26c34e4-ff0c-45b5-b4e2-5406afca15c8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:24.719777 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c26c34e4-ff0c-45b5-b4e2-5406afca15c8 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1277 microversion: 2.1 time: 0.236597 Oct 11 19:49:24.727184 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 951/1956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:24 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:49:24.828561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1015207804", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "80479427-085a-4dd2-8698-782034cdbfac"}], "block_device_mapping_v2": [{"uuid": "01cea201-cd21-42e3-9ad1-d4f9caf3942c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:24.991031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] validate_networks() for [('80479427-085a-4dd2-8698-782034cdbfac', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:49:25.222210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-22c74622-9c7f-4d3c-b04e-2f10d161f7a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:25.231699 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-22c74622-9c7f-4d3c-b04e-2f10d161f7a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1504 microversion: 2.1 time: 1.173741 Oct 11 19:49:25.256213 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1006/1957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:24 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1504 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:25.262263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b2d22813-0ab9-4560-bae8-cf37b8bab055 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:25.262909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b2d22813-0ab9-4560-bae8-cf37b8bab055 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:25.279791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2d22813-0ab9-4560-bae8-cf37b8bab055 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:25.280907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2d22813-0ab9-4560-bae8-cf37b8bab055 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:25.281346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2d22813-0ab9-4560-bae8-cf37b8bab055 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:25.282054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2d22813-0ab9-4560-bae8-cf37b8bab055 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:25.282503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2d22813-0ab9-4560-bae8-cf37b8bab055 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:25.289182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2d22813-0ab9-4560-bae8-cf37b8bab055 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:26.427935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b2d22813-0ab9-4560-bae8-cf37b8bab055 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:26.437943 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b2d22813-0ab9-4560-bae8-cf37b8bab055 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 1.180416 Oct 11 19:49:26.443349 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1007/1958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:25 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:26.463074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:26.464025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] [instance: f30bdfac-1c61-4f61-876d-0922853f40c0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:26.487086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:26.488039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:26.488498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:26.489249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:26.489714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:26.495098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:26.520541 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] HTTP exception thrown: Instance f30bdfac-1c61-4f61-876d-0922853f40c0 could not be found. Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Request method failure captured: Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 HTTP/1.1 Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfpQr6BP5g2kvU0IVkwQ06RYWcWmDegj-pnVRpF1pUj9_kEhzTAn4-dVKOEiCGmDZZZ1-y5FNxUQF-YMJm0Z87Nkn12GE0b2-UbSoc3oWTsDhO-LGmB6ylT_bwRm8E7KeCMJrEx6Xh8A1JgXg06G2q99ATeDrbvfpw6eL36RsJdbYg Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.91 Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: d56e6a2a33df4160b8835bd8975186ea Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-196513867 Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d56e6a2a33df4160b8835bd8975186ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d56e6a2a33df4160b8835bd8975186ea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d56e6a2a33df4160b8835bd8975186ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d56e6a2a33df4160b8835bd8975186ea"}]}] Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-196513867 Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: d56e6a2a33df4160b8835bd8975186ea Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-196513867 Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-UnshelveToHostMultiNodesTest-196513867-project Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 644423219a0a496e9ec83ec1d8f2a8b4 Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-196513867-project Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance f30bdfac-1c61-4f61-876d-0922853f40c0 could not be found. Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'f30bdfac-1c61-4f61-876d-0922853f40c0'} Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30bdfac-1c61-4f61-876d-0922853f40c0 could not be found. Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30bdfac-1c61-4f61-876d-0922853f40c0 could not be found. Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:26.523046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:26.527675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:26.527675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:26.527675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:26.527675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:26.527675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:26.527675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:26.527675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30bdfac-1c61-4f61-876d-0922853f40c0 could not be found. Oct 11 19:49:26.527675 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:26.533027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] Returning 404 to user: Instance f30bdfac-1c61-4f61-876d-0922853f40c0 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:26.534282 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9da10ede-1d24-4fd3-b5e6-629ddd103a78 tempest-UnshelveToHostMultiNodesTest-196513867 tempest-UnshelveToHostMultiNodesTest-196513867-project] 10.222.0.27 "GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0" status: 404 len: 111 microversion: 2.91 time: 0.087813 Oct 11 19:49:26.537560 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1008/1959] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:26 2022] GET /compute/v2.1/servers/f30bdfac-1c61-4f61-876d-0922853f40c0 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:49:26.556284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:26.559049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: 35dee854-d900-44e9-8d2f-a34305c016ea] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:26.579305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:26.579826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:26.580271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:26.583868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:26.584463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:26.584786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:26.635647 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] HTTP exception thrown: Instance 35dee854-d900-44e9-8d2f-a34305c016ea could not be found. Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Request method failure captured: Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea HTTP/1.1 Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcdiPNBEtDd07u0dk6ggT3e7XK4hiN1Pzh0nfqN0hzgWFm6yY_CsCxsUHkae0eD6iRDn9NgCIzqzgFHxxWRB0cJgRUOtK8TM9umvhbJPqHrUVZAl96nv5ScRqmxXx311fFsMuGzaMcCwGP67sqAX7o8y5NFWnlB9Hjh1HarapTTJfvI Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 33b91a834ad24c82805880555930825d Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33b91a834ad24c82805880555930825d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33b91a834ad24c82805880555930825d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b91a834ad24c82805880555930825d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b91a834ad24c82805880555930825d"}]}] Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 33b91a834ad24c82805880555930825d Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-MigrationsAdminTest-633353152-project Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5c26541efd824c5ab866c2891adcd748 Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-MigrationsAdminTest-633353152-project Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 35dee854-d900-44e9-8d2f-a34305c016ea could not be found. Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '35dee854-d900-44e9-8d2f-a34305c016ea'} Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35dee854-d900-44e9-8d2f-a34305c016ea could not be found. Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35dee854-d900-44e9-8d2f-a34305c016ea could not be found. Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:26.657204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:26.662024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:26.662024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:26.662024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:26.662024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:26.662024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:26.662024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35dee854-d900-44e9-8d2f-a34305c016ea could not be found. Oct 11 19:49:26.662024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:26.662024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Returning 404 to user: Instance 35dee854-d900-44e9-8d2f-a34305c016ea could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:26.662024 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0543de2b-f32d-4261-963e-922b81c96461 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea" status: 404 len: 111 microversion: 2.1 time: 0.120061 Oct 11 19:49:26.667245 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1009/1960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:26 2022] GET /compute/v2.1/servers/35dee854-d900-44e9-8d2f-a34305c016ea => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:26.695240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9789e4e0-2daa-44d0-98fe-baa0da6f7802 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:26.697967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9789e4e0-2daa-44d0-98fe-baa0da6f7802 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:26.721585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9789e4e0-2daa-44d0-98fe-baa0da6f7802 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:26.722354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9789e4e0-2daa-44d0-98fe-baa0da6f7802 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:26.725272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9789e4e0-2daa-44d0-98fe-baa0da6f7802 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:26.726060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9789e4e0-2daa-44d0-98fe-baa0da6f7802 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:26.728557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9789e4e0-2daa-44d0-98fe-baa0da6f7802 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:26.728998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9789e4e0-2daa-44d0-98fe-baa0da6f7802 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:27.467960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9789e4e0-2daa-44d0-98fe-baa0da6f7802 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:27.477959 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9789e4e0-2daa-44d0-98fe-baa0da6f7802 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1317 microversion: 2.1 time: 0.807850 Oct 11 19:49:27.486608 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1010/1961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:26 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1317 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:27.491751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6cb15ee4-03d9-48da-b54c-52e3530961b0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:27.492601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6cb15ee4-03d9-48da-b54c-52e3530961b0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:27.513142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cb15ee4-03d9-48da-b54c-52e3530961b0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:27.513926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cb15ee4-03d9-48da-b54c-52e3530961b0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:27.514619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cb15ee4-03d9-48da-b54c-52e3530961b0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:27.515850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cb15ee4-03d9-48da-b54c-52e3530961b0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:27.516482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cb15ee4-03d9-48da-b54c-52e3530961b0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:27.517077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cb15ee4-03d9-48da-b54c-52e3530961b0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:27.767415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:49:27.768722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:49:27.769380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:49:27.770442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:49:27.771348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:49:27.799800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:27.801138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:27.801788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:27.802755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:27.803382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:27.804232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:27.834199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Getting quotas for project 0ac923f5632e40b2bd81aa5de2ed3f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:49:27.845390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Getting quotas for user 823a414535d04791844ab997869542b2 and project 0ac923f5632e40b2bd81aa5de2ed3f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:49:27.943442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:49:27.946588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01cea201-cd21-42e3-9ad1-d4f9caf3942c',volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:49:28.075061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6cb15ee4-03d9-48da-b54c-52e3530961b0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:28.087245 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6cb15ee4-03d9-48da-b54c-52e3530961b0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 200 len: 1447 microversion: 2.1 time: 0.599219 Oct 11 19:49:28.088185 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1011/1962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:27 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 1447 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:28.102724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-711d6bce-2165-4398-b8a5-79a5ece318a4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:28.103284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-711d6bce-2165-4398-b8a5-79a5ece318a4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:28.120594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711d6bce-2165-4398-b8a5-79a5ece318a4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:28.121089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711d6bce-2165-4398-b8a5-79a5ece318a4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:28.121529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711d6bce-2165-4398-b8a5-79a5ece318a4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:28.128269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711d6bce-2165-4398-b8a5-79a5ece318a4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:28.128853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711d6bce-2165-4398-b8a5-79a5ece318a4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:28.129307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711d6bce-2165-4398-b8a5-79a5ece318a4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:28.187617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:28.190654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-711d6bce-2165-4398-b8a5-79a5ece318a4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:28.270871 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5096b42f-019d-4f58-b4e2-e6b676c42860 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.447103 Oct 11 19:49:28.280896 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 952/1963] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3458 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 11 19:49:28.297987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-044734fb-a653-4541-8781-19e5e98e40c7 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:28.299062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-044734fb-a653-4541-8781-19e5e98e40c7 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:28.308059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-044734fb-a653-4541-8781-19e5e98e40c7 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:28.308836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-044734fb-a653-4541-8781-19e5e98e40c7 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:28.309940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-044734fb-a653-4541-8781-19e5e98e40c7 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:28.311301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-044734fb-a653-4541-8781-19e5e98e40c7 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:28.312493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-044734fb-a653-4541-8781-19e5e98e40c7 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:28.313328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-044734fb-a653-4541-8781-19e5e98e40c7 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:28.353102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:28.396538 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-711d6bce-2165-4398-b8a5-79a5ece318a4 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 204 len: 0 microversion: 2.1 time: 0.306991 Oct 11 19:49:28.397631 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1012/1964] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:28 2022] DELETE /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:49:28.405517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ee46653b-2a6e-42af-8ccd-4d1d6816960a req-e96cac19-aaeb-43f7-b92e-74cf4ea8b74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21319341-f8a9-4972-88e3-13e7c5f6397d", "name": "network-vif-plugged", "status": "completed", "tag": "fb84ba1b-772c-4347-9bed-3bbeffe08735"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:28.431846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ee46653b-2a6e-42af-8ccd-4d1d6816960a req-e96cac19-aaeb-43f7-b92e-74cf4ea8b74e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:28.432324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ee46653b-2a6e-42af-8ccd-4d1d6816960a req-e96cac19-aaeb-43f7-b92e-74cf4ea8b74e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:28.432970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ee46653b-2a6e-42af-8ccd-4d1d6816960a req-e96cac19-aaeb-43f7-b92e-74cf4ea8b74e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:28.480499 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ee46653b-2a6e-42af-8ccd-4d1d6816960a req-e96cac19-aaeb-43f7-b92e-74cf4ea8b74e service nova] Creating event network-vif-plugged:fb84ba1b-772c-4347-9bed-3bbeffe08735 for instance 21319341-f8a9-4972-88e3-13e7c5f6397d on n-h1-860864-3 Oct 11 19:49:28.487363 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ee46653b-2a6e-42af-8ccd-4d1d6816960a req-e96cac19-aaeb-43f7-b92e-74cf4ea8b74e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087843 Oct 11 19:49:28.488154 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1013/1965] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:28.494903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:28.495815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:28.504234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:28.507740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:28.508423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:28.511806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:28.514138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:28.515184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:28.602651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:28.616549 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.compute.api [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Working on deleting snapshot e68c03d2-5c0f-460b-a32a-ea8b349f732b from shelved instance... Oct 11 19:49:29.090223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-044734fb-a653-4541-8781-19e5e98e40c7 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:29.109636 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-044734fb-a653-4541-8781-19e5e98e40c7 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 0.819467 Oct 11 19:49:29.113310 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 953/1966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:28 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:29.128553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-d3c3b93c-ca9e-437f-9b9a-bea89793f5c2 req-5a19ebdd-aad8-49af-b007-3ce8c794c82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0077b0-6c4a-4b91-bf7b-d21e1fefca79", "tag": "24aa7525-ed30-4f5d-b78d-85b68013de7c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:29.164347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d3c3b93c-ca9e-437f-9b9a-bea89793f5c2 req-5a19ebdd-aad8-49af-b007-3ce8c794c82e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:29.164853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d3c3b93c-ca9e-437f-9b9a-bea89793f5c2 req-5a19ebdd-aad8-49af-b007-3ce8c794c82e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:29.168461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d3c3b93c-ca9e-437f-9b9a-bea89793f5c2 req-5a19ebdd-aad8-49af-b007-3ce8c794c82e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:29.220152 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-d3c3b93c-ca9e-437f-9b9a-bea89793f5c2 req-5a19ebdd-aad8-49af-b007-3ce8c794c82e service nova] Creating event network-changed:24aa7525-ed30-4f5d-b78d-85b68013de7c for instance 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 on n-h1-860864-3 Oct 11 19:49:29.259752 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-d3c3b93c-ca9e-437f-9b9a-bea89793f5c2 req-5a19ebdd-aad8-49af-b007-3ce8c794c82e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144877 Oct 11 19:49:29.260897 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 954/1967] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:29.288143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:29.290324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:29.310658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:29.316577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:29.317169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:29.317947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:29.318432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:29.322056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:29.488517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:29.507666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:29.509365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:29.511271 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4f5063d8-88b7-4941-b0f9-057f69965f81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1185 microversion: 2.25 time: 0.239204 Oct 11 19:49:29.512466 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 955/1968] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:29 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1185 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:29.523205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1174e142-1206-44b0-8954-d6bd18819503 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:29.524351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1174e142-1206-44b0-8954-d6bd18819503 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:29.541102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1174e142-1206-44b0-8954-d6bd18819503 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:29.541933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1174e142-1206-44b0-8954-d6bd18819503 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:29.542869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1174e142-1206-44b0-8954-d6bd18819503 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:29.543722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1174e142-1206-44b0-8954-d6bd18819503 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:29.544289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1174e142-1206-44b0-8954-d6bd18819503 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:29.544882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1174e142-1206-44b0-8954-d6bd18819503 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:29.550363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:29.804277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Doing local delete in cell 3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) {{(pid=126956) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 11 19:49:29.806231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:29.807001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:29.807719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:29.808353 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.compute.api [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 11 19:49:29.813560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] deallocate_for_instance() {{(pid=126956) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 11 19:49:30.088463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1174e142-1206-44b0-8954-d6bd18819503 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c26541efd824c5ab866c2891adcd748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b91a834ad24c82805880555930825d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:30.097793 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1174e142-1206-44b0-8954-d6bd18819503 tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 200 len: 1469 microversion: 2.1 time: 0.584062 Oct 11 19:49:30.102494 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 956/1969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:29 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 1469 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:30.107541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4338ac3d-b56b-41cc-8951-5b6343a0dc29 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:30.113747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4338ac3d-b56b-41cc-8951-5b6343a0dc29 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:30.133348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4338ac3d-b56b-41cc-8951-5b6343a0dc29 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:30.134202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4338ac3d-b56b-41cc-8951-5b6343a0dc29 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:30.135031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4338ac3d-b56b-41cc-8951-5b6343a0dc29 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:30.135961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4338ac3d-b56b-41cc-8951-5b6343a0dc29 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:30.136627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4338ac3d-b56b-41cc-8951-5b6343a0dc29 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:30.137277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4338ac3d-b56b-41cc-8951-5b6343a0dc29 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:30.372635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4338ac3d-b56b-41cc-8951-5b6343a0dc29 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:30.382069 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4338ac3d-b56b-41cc-8951-5b6343a0dc29 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1317 microversion: 2.1 time: 0.278147 Oct 11 19:49:30.386948 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 957/1970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:30 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:30.399653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06e31473-bafe-4338-b6f5-96a90d561ec7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:30.400434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-06e31473-bafe-4338-b6f5-96a90d561ec7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:30.408628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06e31473-bafe-4338-b6f5-96a90d561ec7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:30.409942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06e31473-bafe-4338-b6f5-96a90d561ec7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:30.410498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06e31473-bafe-4338-b6f5-96a90d561ec7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:30.411393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06e31473-bafe-4338-b6f5-96a90d561ec7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:30.411899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06e31473-bafe-4338-b6f5-96a90d561ec7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:30.412470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06e31473-bafe-4338-b6f5-96a90d561ec7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:30.458773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-06e31473-bafe-4338-b6f5-96a90d561ec7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:30.714810 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-06e31473-bafe-4338-b6f5-96a90d561ec7 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 204 len: 0 microversion: 2.1 time: 0.325931 Oct 11 19:49:30.714810 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 958/1971] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:30 2022] DELETE /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:49:30.724345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:30.725081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:30.747600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:30.758421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:30.758996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:30.763372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:30.763919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:30.764512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:31.047762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:31.794030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:31.811896 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1370 microversion: 2.1 time: 1.095077 Oct 11 19:49:31.813923 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 959/1972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:30 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1370 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:31.814975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:31.815892 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1d82f7c7-b455-43d8-939d-c730eb3d28ac tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001163 Oct 11 19:49:31.828475 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 960/1973] 10.222.0.27 () {56 vars in 886 bytes} [Tue Oct 11 19:49:31 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 19:49:31.833887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:31.834758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:31.841490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:31.842388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:31.843587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:31.844547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:31.845203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:31.845911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:32.163016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:32.381351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:32.401029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:32.406366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:32.414972 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ce0d6ef4-d080-4594-9fc9-333c667f639d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1251 microversion: 2.25 time: 0.584482 Oct 11 19:49:32.419207 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 961/1974] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:31 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1251 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:32.435596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae9aad9b-f3e2-4c64-9349-41a775ae18f8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:32.438007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae9aad9b-f3e2-4c64-9349-41a775ae18f8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:32.460749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae9aad9b-f3e2-4c64-9349-41a775ae18f8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:32.463176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae9aad9b-f3e2-4c64-9349-41a775ae18f8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:32.465306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae9aad9b-f3e2-4c64-9349-41a775ae18f8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:32.469473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae9aad9b-f3e2-4c64-9349-41a775ae18f8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:32.470013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae9aad9b-f3e2-4c64-9349-41a775ae18f8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:32.470586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae9aad9b-f3e2-4c64-9349-41a775ae18f8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:32.546292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Updating instance_info_cache with network_info: [] {{(pid=126956) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:49:33.063230 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7e52f52-1087-4a61-bd43-6b8d632535bb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 204 len: 0 microversion: 2.1 time: 4.573601 Oct 11 19:49:33.064001 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1014/1975] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:28 2022] DELETE /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 0 bytes in 4575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:49:33.071999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:33.072736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] [instance: b1463ded-d983-4703-b256-08dfbb0cda89] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:33.093526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:33.094041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:33.094487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:33.095240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:33.095899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:33.096502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:33.113922 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] HTTP exception thrown: Instance b1463ded-d983-4703-b256-08dfbb0cda89 could not be found. Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Request method failure captured: Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 HTTP/1.1 Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcdiPNBEtDd07u0dk6ggT3e7XK4hiN1Pzh0nfqN0hzgWFm6yY_CsCxsUHkae0eD6iRDn9NgCIzqzgFHxxWRB0cJgRUOtK8TM9umvhbJPqHrUVZAl96nv5ScRqmxXx311fFsMuGzaMcCwGP67sqAX7o8y5NFWnlB9Hjh1HarapTTJfvI Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 33b91a834ad24c82805880555930825d Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33b91a834ad24c82805880555930825d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33b91a834ad24c82805880555930825d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b91a834ad24c82805880555930825d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b91a834ad24c82805880555930825d"}]}] Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 33b91a834ad24c82805880555930825d Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-MigrationsAdminTest-633353152 Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-MigrationsAdminTest-633353152-project Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5c26541efd824c5ab866c2891adcd748 Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-MigrationsAdminTest-633353152-project Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance b1463ded-d983-4703-b256-08dfbb0cda89 could not be found. Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'b1463ded-d983-4703-b256-08dfbb0cda89'} Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1463ded-d983-4703-b256-08dfbb0cda89 could not be found. Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1463ded-d983-4703-b256-08dfbb0cda89 could not be found. Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:33.115912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:33.122581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:33.122581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:33.122581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:33.122581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:33.122581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:33.122581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1463ded-d983-4703-b256-08dfbb0cda89 could not be found. Oct 11 19:49:33.122581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:33.125003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] Returning 404 to user: Instance b1463ded-d983-4703-b256-08dfbb0cda89 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:33.126086 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae9f02b1-1c18-46d2-8644-fd7b4d08938e tempest-MigrationsAdminTest-633353152 tempest-MigrationsAdminTest-633353152-project] 10.222.0.27 "GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89" status: 404 len: 111 microversion: 2.1 time: 0.061059 Oct 11 19:49:33.127234 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1015/1976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:33 2022] GET /compute/v2.1/servers/b1463ded-d983-4703-b256-08dfbb0cda89 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:33.134877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b062955a-92e7-4147-94f9-cbba31eda3c7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:33.138937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b062955a-92e7-4147-94f9-cbba31eda3c7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:33.151524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b062955a-92e7-4147-94f9-cbba31eda3c7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:33.152361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b062955a-92e7-4147-94f9-cbba31eda3c7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:33.153968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b062955a-92e7-4147-94f9-cbba31eda3c7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:33.156594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ae9aad9b-f3e2-4c64-9349-41a775ae18f8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:33.158102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b062955a-92e7-4147-94f9-cbba31eda3c7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:33.158789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b062955a-92e7-4147-94f9-cbba31eda3c7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:33.159454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b062955a-92e7-4147-94f9-cbba31eda3c7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:33.176522 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ae9aad9b-f3e2-4c64-9349-41a775ae18f8 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1668 microversion: 2.1 time: 0.756059 Oct 11 19:49:33.191942 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 962/1977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:32 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1668 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:33.207739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-dbb6f433-bf95-4708-a499-c608e4ae075b req-7db9517a-d0d7-4623-895d-ad1b8890f715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1463ded-d983-4703-b256-08dfbb0cda89", "name": "network-vif-deleted", "tag": "9a1e3906-cf0e-4288-b9c2-eba283fe7bcf"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:33.210089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:33.235599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dbb6f433-bf95-4708-a499-c608e4ae075b req-7db9517a-d0d7-4623-895d-ad1b8890f715 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:33.236460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dbb6f433-bf95-4708-a499-c608e4ae075b req-7db9517a-d0d7-4623-895d-ad1b8890f715 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:33.237120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dbb6f433-bf95-4708-a499-c608e4ae075b req-7db9517a-d0d7-4623-895d-ad1b8890f715 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:33.262460 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-dbb6f433-bf95-4708-a499-c608e4ae075b req-7db9517a-d0d7-4623-895d-ad1b8890f715 service nova] Creating event network-vif-deleted:9a1e3906-cf0e-4288-b9c2-eba283fe7bcf for instance b1463ded-d983-4703-b256-08dfbb0cda89 on n-h2-860864-3 Oct 11 19:49:33.270805 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-dbb6f433-bf95-4708-a499-c608e4ae075b req-7db9517a-d0d7-4623-895d-ad1b8890f715 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077402 Oct 11 19:49:33.272255 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 963/1978] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:33.283699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-486a44c5-e5de-4b39-8e51-4e6e6c9215c8 req-f2fcafd5-a4fa-4f45-9eae-22808b4c62bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1ceed5-0490-4d64-8d97-e0684bd7f05f", "name": "network-vif-deleted", "tag": "c0a9bf59-035c-4a1e-8ebc-eeb631b03c41"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:33.308440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-486a44c5-e5de-4b39-8e51-4e6e6c9215c8 req-f2fcafd5-a4fa-4f45-9eae-22808b4c62bd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:33.311102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-486a44c5-e5de-4b39-8e51-4e6e6c9215c8 req-f2fcafd5-a4fa-4f45-9eae-22808b4c62bd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:33.314349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-486a44c5-e5de-4b39-8e51-4e6e6c9215c8 req-f2fcafd5-a4fa-4f45-9eae-22808b4c62bd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:33.341244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.compute.server_external_events [req-486a44c5-e5de-4b39-8e51-4e6e6c9215c8 req-f2fcafd5-a4fa-4f45-9eae-22808b4c62bd service nova] Unable to find a host for instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f. Dropping event network-vif-deleted {{(pid=126955) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 19:49:33.344844 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-486a44c5-e5de-4b39-8e51-4e6e6c9215c8 req-f2fcafd5-a4fa-4f45-9eae-22808b4c62bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.071151 Oct 11 19:49:33.346676 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 964/1979] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 19:49:33.355530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-450b2cb6-ae76-46e7-ae22-563cf43a799f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:33.357298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-450b2cb6-ae76-46e7-ae22-563cf43a799f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:33.373488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-450b2cb6-ae76-46e7-ae22-563cf43a799f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:33.375417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-450b2cb6-ae76-46e7-ae22-563cf43a799f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:33.377309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-450b2cb6-ae76-46e7-ae22-563cf43a799f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:33.381730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-450b2cb6-ae76-46e7-ae22-563cf43a799f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:33.383268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-450b2cb6-ae76-46e7-ae22-563cf43a799f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:33.385414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-450b2cb6-ae76-46e7-ae22-563cf43a799f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:34.029933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-450b2cb6-ae76-46e7-ae22-563cf43a799f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:34.044353 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-450b2cb6-ae76-46e7-ae22-563cf43a799f tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1556 microversion: 2.1 time: 0.695984 Oct 11 19:49:34.048233 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 965/1980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:33 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1556 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:34.062891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:34.064029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:34.079773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:34.080185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:34.082600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:34.088500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:34.089199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:34.089819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:34.123573 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f HTTP/1.1 Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '7d1ceed5-0490-4d64-8d97-e0684bd7f05f'} Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:34.128932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:34.134500 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:34.134500 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:34.134500 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:34.134500 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:34.134500 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:34.134500 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:49:34.134500 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:34.138103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:34.141922 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9b4fa20f-d48e-4ada-a52e-1c9d95c30c28 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 404 len: 111 microversion: 2.1 time: 0.090233 Oct 11 19:49:34.145154 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 966/1981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:34 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:34.150130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:34.159551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:34.180446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:34.181355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:34.182069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:34.183086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:34.183795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:34.184481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:34.261968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b062955a-92e7-4147-94f9-cbba31eda3c7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:34.283605 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b062955a-92e7-4147-94f9-cbba31eda3c7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1317 microversion: 2.1 time: 1.152756 Oct 11 19:49:34.294543 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1016/1982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:33 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1317 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:34.305559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a3726dcb-74dc-4bc9-b861-17beea3752fe tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:34.311283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a3726dcb-74dc-4bc9-b861-17beea3752fe tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:34.330702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3726dcb-74dc-4bc9-b861-17beea3752fe tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:34.331601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3726dcb-74dc-4bc9-b861-17beea3752fe tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:34.332418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3726dcb-74dc-4bc9-b861-17beea3752fe tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:34.333371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3726dcb-74dc-4bc9-b861-17beea3752fe tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:34.334048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3726dcb-74dc-4bc9-b861-17beea3752fe tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:34.337614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3726dcb-74dc-4bc9-b861-17beea3752fe tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:34.800111 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a3726dcb-74dc-4bc9-b861-17beea3752fe tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.503577 Oct 11 19:49:34.801011 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1017/1983] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:49:34 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-interface => generated 285 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:34.812651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d4b758dd-2934-475f-ad1e-9bfe7fd16c15 req-8ccd11f2-90d5-4f01-a4d5-003f15e3581e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0077b0-6c4a-4b91-bf7b-d21e1fefca79", "name": "network-vif-plugged", "status": "completed", "tag": "24aa7525-ed30-4f5d-b78d-85b68013de7c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:34.851215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d4b758dd-2934-475f-ad1e-9bfe7fd16c15 req-8ccd11f2-90d5-4f01-a4d5-003f15e3581e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:34.851890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d4b758dd-2934-475f-ad1e-9bfe7fd16c15 req-8ccd11f2-90d5-4f01-a4d5-003f15e3581e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:34.852430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d4b758dd-2934-475f-ad1e-9bfe7fd16c15 req-8ccd11f2-90d5-4f01-a4d5-003f15e3581e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:34.882185 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d4b758dd-2934-475f-ad1e-9bfe7fd16c15 req-8ccd11f2-90d5-4f01-a4d5-003f15e3581e service nova] Creating event network-vif-plugged:24aa7525-ed30-4f5d-b78d-85b68013de7c for instance 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 on n-h1-860864-3 Oct 11 19:49:34.897136 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d4b758dd-2934-475f-ad1e-9bfe7fd16c15 req-8ccd11f2-90d5-4f01-a4d5-003f15e3581e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094988 Oct 11 19:49:34.904320 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1018/1984] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:34.912839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d51c93c-ae63-4394-979d-de1130adea2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:34.919028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:34.924583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8d51c93c-ae63-4394-979d-de1130adea2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:34.933277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:34.944441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:34.946726 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8542ee67-4799-415a-9aef-d17baef3fa67 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1293 microversion: 2.25 time: 0.800228 Oct 11 19:49:34.956366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d51c93c-ae63-4394-979d-de1130adea2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:34.957889 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 967/1985] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:34 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1293 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:34.958711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d51c93c-ae63-4394-979d-de1130adea2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:34.961980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d51c93c-ae63-4394-979d-de1130adea2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:34.964154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d51c93c-ae63-4394-979d-de1130adea2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:34.964880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d51c93c-ae63-4394-979d-de1130adea2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:34.966188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d51c93c-ae63-4394-979d-de1130adea2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:34.987300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-186470695", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "50a85b7f-a8bb-479c-b121-72e05795de50"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:35.116884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] validate_networks() for [('50a85b7f-a8bb-479c-b121-72e05795de50', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:49:35.330294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8d51c93c-ae63-4394-979d-de1130adea2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:35.341056 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8d51c93c-ae63-4394-979d-de1130adea2e tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1600 microversion: 2.1 time: 0.434816 Oct 11 19:49:35.341662 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1019/1986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:34 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1600 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:35.360465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9ed90f0e-dbe6-4fb0-ad8b-07b0c83935da tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:35.362292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9ed90f0e-dbe6-4fb0-ad8b-07b0c83935da tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:35.380915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ed90f0e-dbe6-4fb0-ad8b-07b0c83935da tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:35.381632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ed90f0e-dbe6-4fb0-ad8b-07b0c83935da tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:35.383364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ed90f0e-dbe6-4fb0-ad8b-07b0c83935da tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:35.384905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ed90f0e-dbe6-4fb0-ad8b-07b0c83935da tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:35.385375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ed90f0e-dbe6-4fb0-ad8b-07b0c83935da tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:35.385812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ed90f0e-dbe6-4fb0-ad8b-07b0c83935da tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:35.996414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9ed90f0e-dbe6-4fb0-ad8b-07b0c83935da tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:36.006962 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9ed90f0e-dbe6-4fb0-ad8b-07b0c83935da tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1317 microversion: 2.1 time: 0.663647 Oct 11 19:49:36.018949 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1020/1987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:35 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:36.024072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ecefe923-b0c7-4cb6-abe4-db809a4c1bc6 req-8406c765-a1b8-4930-b6ed-cac5476ecf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2bcc99-b3f9-47c2-bb34-4f3a24081296", "name": "network-vif-deleted", "tag": "b2665c89-ac83-4c8b-9c20-01ff3ddcd688"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:36.042487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ecefe923-b0c7-4cb6-abe4-db809a4c1bc6 req-8406c765-a1b8-4930-b6ed-cac5476ecf96 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:36.043351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ecefe923-b0c7-4cb6-abe4-db809a4c1bc6 req-8406c765-a1b8-4930-b6ed-cac5476ecf96 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:36.044020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ecefe923-b0c7-4cb6-abe4-db809a4c1bc6 req-8406c765-a1b8-4930-b6ed-cac5476ecf96 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:36.069331 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ecefe923-b0c7-4cb6-abe4-db809a4c1bc6 req-8406c765-a1b8-4930-b6ed-cac5476ecf96 service nova] Creating event network-vif-deleted:b2665c89-ac83-4c8b-9c20-01ff3ddcd688 for instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 on n-h2-860864-3 Oct 11 19:49:36.084890 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ecefe923-b0c7-4cb6-abe4-db809a4c1bc6 req-8406c765-a1b8-4930-b6ed-cac5476ecf96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064224 Oct 11 19:49:36.085900 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1021/1988] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:36.101740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:36.102872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:36.110653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:36.116565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:36.117309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:36.118278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:36.119430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:36.120125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:36.929338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:36.943965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:36.945794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:36.954390 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87b87f1f-a6a9-4879-84a4-58dc6fe28fd8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1293 microversion: 2.25 time: 0.866972 Oct 11 19:49:36.958837 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1022/1989] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:36 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1293 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:36.963859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:36.988312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:37.003360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:37.004476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:37.007932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:37.008962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:37.010618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:37.011274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:37.088333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:37.090121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:37.092934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:37.093709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lazy-loading 'fault' on Instance uuid ab2bcc99-b3f9-47c2-bb34-4f3a24081296 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:49:37.132069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:49:37.133324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:49:37.134080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:49:37.134764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:49:37.135419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:49:37.153904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:37.157083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:37.158934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:37.159741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:37.160215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:37.160652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:37.208450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:49:37.218784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for user 8494488a13a3496eb59a8062479816bc and project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:49:37.268325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:37.272873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:49:37.278057 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e858bf1e-1547-4f30-98b3-fadaae981cd9 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 200 len: 1324 microversion: 2.1 time: 0.317836 Oct 11 19:49:37.281215 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1023/1990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:36 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:37.284986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:49:37.288827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b1021b92-af9a-4399-98f6-2e7d44cb8d7f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:37.300647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b1021b92-af9a-4399-98f6-2e7d44cb8d7f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:37.315228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1021b92-af9a-4399-98f6-2e7d44cb8d7f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:37.316083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1021b92-af9a-4399-98f6-2e7d44cb8d7f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:37.316875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1021b92-af9a-4399-98f6-2e7d44cb8d7f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:37.317850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1021b92-af9a-4399-98f6-2e7d44cb8d7f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:37.320079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1021b92-af9a-4399-98f6-2e7d44cb8d7f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:37.322604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1021b92-af9a-4399-98f6-2e7d44cb8d7f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:37.412446 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a38dbc96-a5e2-4647-b252-dc309562264d tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.452371 Oct 11 19:49:37.424600 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 968/1991] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:49:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:49:37.432219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0ebd0f52-1997-46ec-b42d-16cc99bdaf37 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:37.437133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0ebd0f52-1997-46ec-b42d-16cc99bdaf37 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:38.368751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0ebd0f52-1997-46ec-b42d-16cc99bdaf37 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:38.378785 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0ebd0f52-1997-46ec-b42d-16cc99bdaf37 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1214 microversion: 2.1 time: 0.952760 Oct 11 19:49:38.380025 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 969/1992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:37 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1214 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:38.388506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:38.389667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:38.415165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:38.420109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:38.421198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:38.422206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:38.425657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:38.426835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:39.410251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b1021b92-af9a-4399-98f6-2e7d44cb8d7f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:39.428691 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b1021b92-af9a-4399-98f6-2e7d44cb8d7f tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1506 microversion: 2.1 time: 2.144579 Oct 11 19:49:39.431279 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1024/1993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:37 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1506 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:39.448842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-dd22a2ab-27b5-4c6f-b64f-8117e252ec26 req-0d544a06-cfeb-4414-af96-af3387aeb674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21319341-f8a9-4972-88e3-13e7c5f6397d", "tag": "fb84ba1b-772c-4347-9bed-3bbeffe08735"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:39.489764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dd22a2ab-27b5-4c6f-b64f-8117e252ec26 req-0d544a06-cfeb-4414-af96-af3387aeb674 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:39.495505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dd22a2ab-27b5-4c6f-b64f-8117e252ec26 req-0d544a06-cfeb-4414-af96-af3387aeb674 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:39.496292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dd22a2ab-27b5-4c6f-b64f-8117e252ec26 req-0d544a06-cfeb-4414-af96-af3387aeb674 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:39.525555 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-dd22a2ab-27b5-4c6f-b64f-8117e252ec26 req-0d544a06-cfeb-4414-af96-af3387aeb674 service nova] Creating event network-changed:fb84ba1b-772c-4347-9bed-3bbeffe08735 for instance 21319341-f8a9-4972-88e3-13e7c5f6397d on n-h1-860864-3 Oct 11 19:49:39.536405 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-dd22a2ab-27b5-4c6f-b64f-8117e252ec26 req-0d544a06-cfeb-4414-af96-af3387aeb674 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099415 Oct 11 19:49:39.546963 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1025/1994] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:39.558115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:39.575440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: ab2bcc99-b3f9-47c2-bb34-4f3a24081296] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:39.602406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:39.602924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:39.613435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:39.614144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:39.617708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:39.618213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:39.654415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] HTTP exception thrown: Instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 could not be found. Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Request method failure captured: Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 HTTP/1.1 Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccsgzzVs8K4wlcOreWzusfqslL2IgERaJJT7THzhfWPn2GkuCmIzFhhCYJfwDsXS-z4ETFZFcBvMivttSxpkeLzVaDvyy2osF_qtaJbGRvYDJMDSa9Kn0pHwZeFad28A0Wny7VlTNF6JtKB-3BT-FVbGNHHyJujXawY8o2ZGVBWmWY Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 947af1a9d24f4e19a59ec820ba1a65e4 Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-LiveMigrationTest-924138453 Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/947af1a9d24f4e19a59ec820ba1a65e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_947af1a9d24f4e19a59ec820ba1a65e4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/947af1a9d24f4e19a59ec820ba1a65e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/947af1a9d24f4e19a59ec820ba1a65e4"}]}] Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-LiveMigrationTest-924138453 Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 947af1a9d24f4e19a59ec820ba1a65e4 Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-LiveMigrationTest-924138453 Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-LiveMigrationTest-924138453-project Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 4e2460b9a8f34662b802709a91907510 Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-LiveMigrationTest-924138453-project Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 could not be found. Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ab2bcc99-b3f9-47c2-bb34-4f3a24081296'} Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 could not be found. Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 could not be found. Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:39.664037 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:39.669047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:39.669047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:39.669047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:39.669047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:39.669047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:39.669047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 could not be found. Oct 11 19:49:39.669047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:39.669047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Returning 404 to user: Instance ab2bcc99-b3f9-47c2-bb34-4f3a24081296 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:39.669047 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fbb3c8e8-4f56-4d8e-bdbb-3d971498d7ed tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296" status: 404 len: 111 microversion: 2.1 time: 0.115110 Oct 11 19:49:39.669047 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1026/1995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:39 2022] GET /compute/v2.1/servers/ab2bcc99-b3f9-47c2-bb34-4f3a24081296 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:39.676660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-00c2f9d6-cfee-491e-b2f6-b9634b2c8be2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:39.677581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-00c2f9d6-cfee-491e-b2f6-b9634b2c8be2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:39.684923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c2f9d6-cfee-491e-b2f6-b9634b2c8be2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:39.685844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c2f9d6-cfee-491e-b2f6-b9634b2c8be2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:39.686519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c2f9d6-cfee-491e-b2f6-b9634b2c8be2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:39.687524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c2f9d6-cfee-491e-b2f6-b9634b2c8be2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:39.688291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c2f9d6-cfee-491e-b2f6-b9634b2c8be2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:39.688950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c2f9d6-cfee-491e-b2f6-b9634b2c8be2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:39.745425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:39.774839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:39.802434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:39.803986 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aed21e6f-c871-4ba0-8f6f-02ba19e3061a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1293 microversion: 2.25 time: 1.420379 Oct 11 19:49:39.808946 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 970/1996] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:38 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1293 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:39.820423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3d61f0db-36ae-489e-a7ec-469be1c80607 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:39.823921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3d61f0db-36ae-489e-a7ec-469be1c80607 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:39.834219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d61f0db-36ae-489e-a7ec-469be1c80607 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:39.839376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d61f0db-36ae-489e-a7ec-469be1c80607 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:39.841257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d61f0db-36ae-489e-a7ec-469be1c80607 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:39.846121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d61f0db-36ae-489e-a7ec-469be1c80607 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:39.846807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d61f0db-36ae-489e-a7ec-469be1c80607 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:39.849290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d61f0db-36ae-489e-a7ec-469be1c80607 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:39.914509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-00c2f9d6-cfee-491e-b2f6-b9634b2c8be2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:39.925377 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-00c2f9d6-cfee-491e-b2f6-b9634b2c8be2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1266 microversion: 2.1 time: 0.260491 Oct 11 19:49:39.927309 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1027/1997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:39 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:40.218113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Action: 'update', calling method: .version_select at 0x7f83d07465e0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:40.227110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.229105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.231606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.256126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.257851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.259724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.290157 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] HTTP exception thrown: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Request method failure captured: Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/os-services/0f224657-8e41-4fd6-adf6-6095ceb5eb7c HTTP/1.1 Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 56 Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjTzqsUleFeKMgaUs2mKBd51wiTsNOhTqcIFYRbwmcKEl6W90Rgw6gZGRzpui2La1X101a_jucPmhBwwkbXxonCyEtzZJBiV8VNIevMLp2IkQg48m-74g0dHKEdIb3B9hgARTQraiC9C0W9-Pgfw2Pe5k8mIq1fBLYMCezHmO9KFcU Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: dbbd2688e1c748b0abdfff9772381e5e Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-487166023 Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dbbd2688e1c748b0abdfff9772381e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dbbd2688e1c748b0abdfff9772381e5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbbd2688e1c748b0abdfff9772381e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbbd2688e1c748b0abdfff9772381e5e"}]}] Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-487166023 Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: dbbd2688e1c748b0abdfff9772381e5e Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-487166023 Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cf7ea54e7b784fb797ee666500e2ee6f Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: exception: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '0f224657-8e41-4fd6-adf6-6095ceb5eb7c', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:49:40.296831 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Returning 404 to user: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4761bdc0-0ca6-4ae8-ad40-50e2d6e81a39 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/0f224657-8e41-4fd6-adf6-6095ceb5eb7c" status: 404 len: 110 microversion: 2.53 time: 0.371460 Oct 11 19:49:40.302938 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1028/1998] 10.222.0.27 () {62 vars in 1309 bytes} [Tue Oct 11 19:49:39 2022] PUT /compute/v2.1/os-services/0f224657-8e41-4fd6-adf6-6095ceb5eb7c => generated 110 bytes in 374 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:49:40.315146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78aab35f-0daf-4b04-868b-135e3deeb8da tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '.version_select at 0x7f83d0746670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:40.343430 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78aab35f-0daf-4b04-868b-135e3deeb8da tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-458505072" status: 202 len: 0 microversion: 2.1 time: 0.031380 Oct 11 19:49:40.344453 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1029/1999] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 19:49:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-458505072 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:49:40.354291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Action: 'update', calling method: .version_select at 0x7f83d06d1820>, body: {"status": "disabled"} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:40.367007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.368784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.371317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.388290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.389199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.389839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.398621 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] HTTP exception thrown: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Request method failure captured: Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/os-services/0f224657-8e41-4fd6-adf6-6095ceb5eb7c HTTP/1.1 Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 22 Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjTzqsUleFeKMgaUs2mKBd51wiTsNOhTqcIFYRbwmcKEl6W90Rgw6gZGRzpui2La1X101a_jucPmhBwwkbXxonCyEtzZJBiV8VNIevMLp2IkQg48m-74g0dHKEdIb3B9hgARTQraiC9C0W9-Pgfw2Pe5k8mIq1fBLYMCezHmO9KFcU Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: dbbd2688e1c748b0abdfff9772381e5e Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-487166023 Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dbbd2688e1c748b0abdfff9772381e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dbbd2688e1c748b0abdfff9772381e5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbbd2688e1c748b0abdfff9772381e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbbd2688e1c748b0abdfff9772381e5e"}]}] Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-487166023 Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: dbbd2688e1c748b0abdfff9772381e5e Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-487166023 Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cf7ea54e7b784fb797ee666500e2ee6f Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: {"status": "disabled"} Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: exception: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '0f224657-8e41-4fd6-adf6-6095ceb5eb7c', 'body': {'status': 'disabled'}} Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:49:40.401504 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.407167 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.417597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Returning 404 to user: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:40.418483 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d59f5487-8c0e-4f08-a973-41ae82a62545 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/0f224657-8e41-4fd6-adf6-6095ceb5eb7c" status: 404 len: 110 microversion: 2.53 time: 0.072935 Oct 11 19:49:40.422652 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1030/2000] 10.222.0.27 () {62 vars in 1309 bytes} [Tue Oct 11 19:49:40 2022] PUT /compute/v2.1/os-services/0f224657-8e41-4fd6-adf6-6095ceb5eb7c => generated 110 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:49:40.433994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Action: 'update', calling method: .version_select at 0x7f83d0888af0>, body: {"status": "enabled"} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:40.440321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.442829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.443468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.461255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.462167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.464202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.474608 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] HTTP exception thrown: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Request method failure captured: Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/os-services/0f224657-8e41-4fd6-adf6-6095ceb5eb7c HTTP/1.1 Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 21 Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjTzqsUleFeKMgaUs2mKBd51wiTsNOhTqcIFYRbwmcKEl6W90Rgw6gZGRzpui2La1X101a_jucPmhBwwkbXxonCyEtzZJBiV8VNIevMLp2IkQg48m-74g0dHKEdIb3B9hgARTQraiC9C0W9-Pgfw2Pe5k8mIq1fBLYMCezHmO9KFcU Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: dbbd2688e1c748b0abdfff9772381e5e Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-487166023 Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dbbd2688e1c748b0abdfff9772381e5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dbbd2688e1c748b0abdfff9772381e5e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbbd2688e1c748b0abdfff9772381e5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbbd2688e1c748b0abdfff9772381e5e"}]}] Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-487166023 Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: dbbd2688e1c748b0abdfff9772381e5e Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-487166023 Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cf7ea54e7b784fb797ee666500e2ee6f Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: {"status": "enabled"} Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: exception: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '0f224657-8e41-4fd6-adf6-6095ceb5eb7c', 'body': {'status': 'enabled'}} Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:49:40.476488 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. Oct 11 19:49:40.482326 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:40.484623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Returning 404 to user: Service 0f224657-8e41-4fd6-adf6-6095ceb5eb7c could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:40.485649 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8480e144-53dc-4a11-90c1-ec3ea717fbfd tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/0f224657-8e41-4fd6-adf6-6095ceb5eb7c" status: 404 len: 110 microversion: 2.53 time: 0.055984 Oct 11 19:49:40.486787 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1031/2001] 10.222.0.27 () {62 vars in 1309 bytes} [Tue Oct 11 19:49:40 2022] PUT /compute/v2.1/os-services/0f224657-8e41-4fd6-adf6-6095ceb5eb7c => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:49:40.500797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2d9dece9-411c-41e1-a84d-be320aaed67a tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:40.516711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d9dece9-411c-41e1-a84d-be320aaed67a tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.517820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d9dece9-411c-41e1-a84d-be320aaed67a tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.518730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d9dece9-411c-41e1-a84d-be320aaed67a tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.519789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d9dece9-411c-41e1-a84d-be320aaed67a tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.522615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d9dece9-411c-41e1-a84d-be320aaed67a tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.523413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d9dece9-411c-41e1-a84d-be320aaed67a tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.584702 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2d9dece9-411c-41e1-a84d-be320aaed67a tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.088136 Oct 11 19:49:40.586378 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1032/2002] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Oct 11 19:49:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:40.602959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-957af5a2-0104-4e93-a6a4-a5d5815e81d7 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:40.624059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957af5a2-0104-4e93-a6a4-a5d5815e81d7 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.624996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957af5a2-0104-4e93-a6a4-a5d5815e81d7 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.640162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957af5a2-0104-4e93-a6a4-a5d5815e81d7 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.641294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957af5a2-0104-4e93-a6a4-a5d5815e81d7 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.641949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957af5a2-0104-4e93-a6a4-a5d5815e81d7 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.642579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-957af5a2-0104-4e93-a6a4-a5d5815e81d7 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.690919 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-957af5a2-0104-4e93-a6a4-a5d5815e81d7 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.091534 Oct 11 19:49:40.692058 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1033/2003] 10.222.0.27 () {60 vars in 1211 bytes} [Tue Oct 11 19:49:40 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:40.708084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11d22b2d-31fd-4b9c-8bcb-912838b5aeac tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:40.713890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11d22b2d-31fd-4b9c-8bcb-912838b5aeac tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.714674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11d22b2d-31fd-4b9c-8bcb-912838b5aeac tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.715214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11d22b2d-31fd-4b9c-8bcb-912838b5aeac tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.716378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11d22b2d-31fd-4b9c-8bcb-912838b5aeac tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.717712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11d22b2d-31fd-4b9c-8bcb-912838b5aeac tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.718388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11d22b2d-31fd-4b9c-8bcb-912838b5aeac tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.783949 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-11d22b2d-31fd-4b9c-8bcb-912838b5aeac tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.079589 Oct 11 19:49:40.787155 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1034/2004] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Oct 11 19:49:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:40.808783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9694dcab-7970-4950-840b-4320ddae5170 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:40.818060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9694dcab-7970-4950-840b-4320ddae5170 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.820721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9694dcab-7970-4950-840b-4320ddae5170 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.821241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9694dcab-7970-4950-840b-4320ddae5170 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.823581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9694dcab-7970-4950-840b-4320ddae5170 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.824758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9694dcab-7970-4950-840b-4320ddae5170 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.829530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9694dcab-7970-4950-840b-4320ddae5170 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.872571 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9694dcab-7970-4950-840b-4320ddae5170 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-860864-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.076452 Oct 11 19:49:40.875179 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1035/2005] 10.222.0.27 () {60 vars in 1235 bytes} [Tue Oct 11 19:49:40 2022] GET /compute/v2.1/os-services?host=n-d-860864-3&binary=xxx => generated 16 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:40.887324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:40.888320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:40.898769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.899781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.900610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.901549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.902266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.903618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.928822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3d61f0db-36ae-489e-a7ec-469be1c80607 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:40.941366 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3d61f0db-36ae-489e-a7ec-469be1c80607 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1506 microversion: 2.1 time: 1.130936 Oct 11 19:49:40.942842 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 971/2006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:39 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1506 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:40.960126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1359ea41-0010-4023-8606-285700ebc53e tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:40.966245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1359ea41-0010-4023-8606-285700ebc53e tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.966904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1359ea41-0010-4023-8606-285700ebc53e tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.967811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1359ea41-0010-4023-8606-285700ebc53e tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:40.968842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1359ea41-0010-4023-8606-285700ebc53e tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:40.969368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1359ea41-0010-4023-8606-285700ebc53e tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:40.969854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1359ea41-0010-4023-8606-285700ebc53e tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:41.007686 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1359ea41-0010-4023-8606-285700ebc53e tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063271 Oct 11 19:49:41.017799 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 972/2007] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Oct 11 19:49:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:41.024679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c7439380-16a3-4bbd-ad6a-6f161be520e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:41.025297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c7439380-16a3-4bbd-ad6a-6f161be520e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:41.037705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7439380-16a3-4bbd-ad6a-6f161be520e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:41.039080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7439380-16a3-4bbd-ad6a-6f161be520e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:41.040296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7439380-16a3-4bbd-ad6a-6f161be520e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:41.044481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7439380-16a3-4bbd-ad6a-6f161be520e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:41.046033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7439380-16a3-4bbd-ad6a-6f161be520e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:41.046749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7439380-16a3-4bbd-ad6a-6f161be520e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:41.188834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c7439380-16a3-4bbd-ad6a-6f161be520e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:41.200108 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c7439380-16a3-4bbd-ad6a-6f161be520e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1272 microversion: 2.1 time: 0.185038 Oct 11 19:49:41.201499 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 973/2008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:41 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:41.220357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3fe08e27-5f99-45ce-8d73-810be7c93320 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:41.229431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3fe08e27-5f99-45ce-8d73-810be7c93320 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:41.240680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe08e27-5f99-45ce-8d73-810be7c93320 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:41.241485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe08e27-5f99-45ce-8d73-810be7c93320 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:41.242208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe08e27-5f99-45ce-8d73-810be7c93320 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:41.243185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe08e27-5f99-45ce-8d73-810be7c93320 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:41.244278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe08e27-5f99-45ce-8d73-810be7c93320 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:41.244904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe08e27-5f99-45ce-8d73-810be7c93320 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:41.436215 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3fe08e27-5f99-45ce-8d73-810be7c93320 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "PUT /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1078 microversion: 2.1 time: 0.232136 Oct 11 19:49:41.437034 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 974/2009] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 11 19:49:41 2022] PUT /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1078 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:41.456379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b907d46-5929-4836-aac3-4b23c0c4e619 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:41.460400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b907d46-5929-4836-aac3-4b23c0c4e619 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:41.461086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b907d46-5929-4836-aac3-4b23c0c4e619 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:41.461948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b907d46-5929-4836-aac3-4b23c0c4e619 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:41.463155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b907d46-5929-4836-aac3-4b23c0c4e619 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:41.463860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b907d46-5929-4836-aac3-4b23c0c4e619 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:41.464586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b907d46-5929-4836-aac3-4b23c0c4e619 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:41.510042 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b907d46-5929-4836-aac3-4b23c0c4e619 tempest-ServicesAdminNegativeV253TestJSON-487166023 tempest-ServicesAdminNegativeV253TestJSON-487166023-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.071525 Oct 11 19:49:41.510709 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 975/2010] 10.222.0.27 () {60 vars in 1239 bytes} [Tue Oct 11 19:49:41 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:41.526462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-dcaa9b9a-1c83-4671-90c1-cf1d6e00264f req-40576c3f-80f9-4ae8-9b3d-b03e04c8e14b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebd21bb0-f168-4a05-ad19-6b72415fc036", "tag": "7c1948ab-cfd5-4292-93ea-b18935d2b086"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:41.537382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:41.548945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:41.550177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dcaa9b9a-1c83-4671-90c1-cf1d6e00264f req-40576c3f-80f9-4ae8-9b3d-b03e04c8e14b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:41.550998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:41.552325 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-290ff1b7-b9f7-46a5-bbde-1af2b08c7eb2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 0.675952 Oct 11 19:49:41.552567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dcaa9b9a-1c83-4671-90c1-cf1d6e00264f req-40576c3f-80f9-4ae8-9b3d-b03e04c8e14b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:41.553057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dcaa9b9a-1c83-4671-90c1-cf1d6e00264f req-40576c3f-80f9-4ae8-9b3d-b03e04c8e14b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:41.553867 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1036/2011] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:40 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:41.560057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c2ae89c-6326-4098-8a7e-e12fdf26b94e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:41.561168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6c2ae89c-6326-4098-8a7e-e12fdf26b94e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:41.568458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2ae89c-6326-4098-8a7e-e12fdf26b94e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:41.569215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2ae89c-6326-4098-8a7e-e12fdf26b94e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:41.570076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2ae89c-6326-4098-8a7e-e12fdf26b94e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:41.577417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2ae89c-6326-4098-8a7e-e12fdf26b94e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:41.577923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2ae89c-6326-4098-8a7e-e12fdf26b94e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:41.578373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2ae89c-6326-4098-8a7e-e12fdf26b94e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:41.582662 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-dcaa9b9a-1c83-4671-90c1-cf1d6e00264f req-40576c3f-80f9-4ae8-9b3d-b03e04c8e14b service nova] Creating event network-changed:7c1948ab-cfd5-4292-93ea-b18935d2b086 for instance ebd21bb0-f168-4a05-ad19-6b72415fc036 on n-h2-860864-3 Oct 11 19:49:41.591082 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-dcaa9b9a-1c83-4671-90c1-cf1d6e00264f req-40576c3f-80f9-4ae8-9b3d-b03e04c8e14b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069099 Oct 11 19:49:41.592713 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 976/2012] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:41.753486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-562bbcb2-133a-4f29-a3e8-443022feddbc tempest-ServicesAdminNegativeV253TestJSON-1886285188 tempest-ServicesAdminNegativeV253TestJSON-1886285188-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:41.762415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-562bbcb2-133a-4f29-a3e8-443022feddbc tempest-ServicesAdminNegativeV253TestJSON-1886285188 tempest-ServicesAdminNegativeV253TestJSON-1886285188-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7559e8c93139451bad4833877f8c17dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99926f5fc19f4b33837b14e2d4fdd560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-562bbcb2-133a-4f29-a3e8-443022feddbc tempest-ServicesAdminNegativeV253TestJSON-1886285188 tempest-ServicesAdminNegativeV253TestJSON-1886285188-project] Request method failure captured: Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcjS3Cfnzfy83VGX3A2HFA4fKxHY6JcwphiEWnRGKlNpGmrpdHZxqh_SRGPm8_08RSdl0_gHzcEzawsuPZbbhJOWs5gypdOwz9qJGYbP_Ra4Clu8yqs6Lkz2GpzT_Sw5IttrJP2agcKHXrM_f6JreARlpTGX30HDjkbz-UYIjBtkfB0 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 99926f5fc19f4b33837b14e2d4fdd560 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1886285188 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/99926f5fc19f4b33837b14e2d4fdd560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_99926f5fc19f4b33837b14e2d4fdd560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/99926f5fc19f4b33837b14e2d4fdd560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/99926f5fc19f4b33837b14e2d4fdd560"}]}] Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1886285188 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 99926f5fc19f4b33837b14e2d4fdd560 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1886285188 Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1886285188-project Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7559e8c93139451bad4833877f8c17dd Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1886285188-project Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: action_args: {} Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:49:41.769018 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:41.774474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-562bbcb2-133a-4f29-a3e8-443022feddbc tempest-ServicesAdminNegativeV253TestJSON-1886285188 tempest-ServicesAdminNegativeV253TestJSON-1886285188-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:41.778258 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-562bbcb2-133a-4f29-a3e8-443022feddbc tempest-ServicesAdminNegativeV253TestJSON-1886285188 tempest-ServicesAdminNegativeV253TestJSON-1886285188-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.175533 Oct 11 19:49:41.780145 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 977/2013] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Oct 11 19:49:41 2022] GET /compute/v2.1/os-services => generated 112 bytes in 187 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:49:42.224984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-779edc8e-1c49-464d-8f5d-9f6972010311 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:42.225723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-779edc8e-1c49-464d-8f5d-9f6972010311 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:42.243128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-779edc8e-1c49-464d-8f5d-9f6972010311 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:42.243895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-779edc8e-1c49-464d-8f5d-9f6972010311 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:42.244576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-779edc8e-1c49-464d-8f5d-9f6972010311 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:42.245524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-779edc8e-1c49-464d-8f5d-9f6972010311 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:42.246205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-779edc8e-1c49-464d-8f5d-9f6972010311 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:42.246878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-779edc8e-1c49-464d-8f5d-9f6972010311 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:42.288282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:42.544054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6c2ae89c-6326-4098-8a7e-e12fdf26b94e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:42.559464 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6c2ae89c-6326-4098-8a7e-e12fdf26b94e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1504 microversion: 2.1 time: 1.004263 Oct 11 19:49:42.560050 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1037/2014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:41 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1504 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:42.584907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:42.585517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:42.592987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:42.593477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:42.608649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:42.609622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:42.610257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:42.610870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:42.952944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-779edc8e-1c49-464d-8f5d-9f6972010311 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:43.019072 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-779edc8e-1c49-464d-8f5d-9f6972010311 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1314 microversion: 2.1 time: 0.796433 Oct 11 19:49:43.020128 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 978/2015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:42 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:49:43.082363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2c0d2817-e755-41c0-9837-7fe1f4aa6896 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:43.089669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2c0d2817-e755-41c0-9837-7fe1f4aa6896 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:43.132288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c0d2817-e755-41c0-9837-7fe1f4aa6896 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:43.139281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c0d2817-e755-41c0-9837-7fe1f4aa6896 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:43.140288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c0d2817-e755-41c0-9837-7fe1f4aa6896 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:43.143876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c0d2817-e755-41c0-9837-7fe1f4aa6896 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:43.148552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c0d2817-e755-41c0-9837-7fe1f4aa6896 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:43.149300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c0d2817-e755-41c0-9837-7fe1f4aa6896 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:43.198738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:43.216151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:43.217931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:43.219080 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-42379b02-49b2-4a23-894f-dd2ae03b881c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 0.639883 Oct 11 19:49:43.219832 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1038/2016] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:42 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:49:43.582721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-50ceecaf-4ef1-41a1-ad08-cb5f7fe815a3 req-74171d91-1e71-4d99-b269-3d1cbb411ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ec61a7-946a-464c-8c7b-179353b2bce7", "tag": "2cc87b3c-09de-4035-a04d-aded17bae470"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:43.599576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-50ceecaf-4ef1-41a1-ad08-cb5f7fe815a3 req-74171d91-1e71-4d99-b269-3d1cbb411ad7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:43.603557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-50ceecaf-4ef1-41a1-ad08-cb5f7fe815a3 req-74171d91-1e71-4d99-b269-3d1cbb411ad7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:43.615947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-50ceecaf-4ef1-41a1-ad08-cb5f7fe815a3 req-74171d91-1e71-4d99-b269-3d1cbb411ad7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:43.635100 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-50ceecaf-4ef1-41a1-ad08-cb5f7fe815a3 req-74171d91-1e71-4d99-b269-3d1cbb411ad7 service nova] Creating event network-changed:2cc87b3c-09de-4035-a04d-aded17bae470 for instance b6ec61a7-946a-464c-8c7b-179353b2bce7 on n-h2-860864-3 Oct 11 19:49:43.644635 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-50ceecaf-4ef1-41a1-ad08-cb5f7fe815a3 req-74171d91-1e71-4d99-b269-3d1cbb411ad7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065652 Oct 11 19:49:43.651628 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1039/2017] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:43.657394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2c0d2817-e755-41c0-9837-7fe1f4aa6896 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:43.671765 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2c0d2817-e755-41c0-9837-7fe1f4aa6896 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1504 microversion: 2.1 time: 0.646858 Oct 11 19:49:43.679183 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 979/2018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:43 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1504 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:43.705157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c3b76da-2eab-41ce-b818-1bb0d6d058bf tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:43.707729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c3b76da-2eab-41ce-b818-1bb0d6d058bf tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:43.721781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b76da-2eab-41ce-b818-1bb0d6d058bf tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:43.724893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b76da-2eab-41ce-b818-1bb0d6d058bf tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:43.726650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b76da-2eab-41ce-b818-1bb0d6d058bf tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:43.727561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b76da-2eab-41ce-b818-1bb0d6d058bf tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:43.729119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b76da-2eab-41ce-b818-1bb0d6d058bf tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:43.729893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b76da-2eab-41ce-b818-1bb0d6d058bf tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:43.882641 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c3b76da-2eab-41ce-b818-1bb0d6d058bf tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "PUT /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1080 microversion: 2.1 time: 0.187070 Oct 11 19:49:43.885823 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1040/2019] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 11 19:49:43 2022] PUT /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1080 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:43.908943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-14dfe7c7-3cc8-420f-aa8a-9f94acb335d7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:43.909561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-14dfe7c7-3cc8-420f-aa8a-9f94acb335d7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:43.918028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14dfe7c7-3cc8-420f-aa8a-9f94acb335d7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:43.920320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14dfe7c7-3cc8-420f-aa8a-9f94acb335d7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:43.922726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14dfe7c7-3cc8-420f-aa8a-9f94acb335d7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:43.923870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14dfe7c7-3cc8-420f-aa8a-9f94acb335d7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:43.927393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14dfe7c7-3cc8-420f-aa8a-9f94acb335d7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:43.929581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14dfe7c7-3cc8-420f-aa8a-9f94acb335d7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:44.041212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-663b9232-ebff-4811-b351-592cd5286d2b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:44.041841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-663b9232-ebff-4811-b351-592cd5286d2b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:44.048100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-663b9232-ebff-4811-b351-592cd5286d2b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:44.048883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-663b9232-ebff-4811-b351-592cd5286d2b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:44.049571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-663b9232-ebff-4811-b351-592cd5286d2b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:44.050291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-663b9232-ebff-4811-b351-592cd5286d2b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:44.050764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-663b9232-ebff-4811-b351-592cd5286d2b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:44.051455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-663b9232-ebff-4811-b351-592cd5286d2b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:44.078078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:44.413459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-14dfe7c7-3cc8-420f-aa8a-9f94acb335d7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:44.427237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-14dfe7c7-3cc8-420f-aa8a-9f94acb335d7 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1506 microversion: 2.1 time: 0.523116 Oct 11 19:49:44.430085 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 980/2020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:43 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:49:44.438629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1f75dbc5-36a1-4513-803f-01742bc02bd5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:44.439479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f75dbc5-36a1-4513-803f-01742bc02bd5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:44.453525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f75dbc5-36a1-4513-803f-01742bc02bd5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:44.455220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f75dbc5-36a1-4513-803f-01742bc02bd5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:44.456193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f75dbc5-36a1-4513-803f-01742bc02bd5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:44.458753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f75dbc5-36a1-4513-803f-01742bc02bd5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:44.459808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f75dbc5-36a1-4513-803f-01742bc02bd5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:44.460553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f75dbc5-36a1-4513-803f-01742bc02bd5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:44.493342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f75dbc5-36a1-4513-803f-01742bc02bd5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:44.609802 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1f75dbc5-36a1-4513-803f-01742bc02bd5 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 204 len: 0 microversion: 2.1 time: 0.177920 Oct 11 19:49:44.613288 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 981/2021] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:44 2022] DELETE /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:49:44.625153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:44.625989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:44.642970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:44.644721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:44.646147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:44.649202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:44.650195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:44.651561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:44.833251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-663b9232-ebff-4811-b351-592cd5286d2b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:44.841265 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-663b9232-ebff-4811-b351-592cd5286d2b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1314 microversion: 2.1 time: 0.803791 Oct 11 19:49:44.842545 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1041/2022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:44 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:49:44.849318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dfd0269b-4bc9-4fe1-8139-02856dba0a0e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:44.850663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dfd0269b-4bc9-4fe1-8139-02856dba0a0e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:44.858863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfd0269b-4bc9-4fe1-8139-02856dba0a0e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:44.866303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfd0269b-4bc9-4fe1-8139-02856dba0a0e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:44.868970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfd0269b-4bc9-4fe1-8139-02856dba0a0e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:44.869895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfd0269b-4bc9-4fe1-8139-02856dba0a0e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:44.870496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfd0269b-4bc9-4fe1-8139-02856dba0a0e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:44.871232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfd0269b-4bc9-4fe1-8139-02856dba0a0e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:45.138032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:45.151716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:45.153171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:45.154862 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6cc1c202-b57a-4f47-8eac-971ebe2bf29b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 0.542821 Oct 11 19:49:45.167031 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 982/2023] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:44 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:45.176615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-28e7202e-aa90-4dc0-bc3c-d6ca517cc943 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:45.176615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-28e7202e-aa90-4dc0-bc3c-d6ca517cc943 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:45.190006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28e7202e-aa90-4dc0-bc3c-d6ca517cc943 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:45.190500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28e7202e-aa90-4dc0-bc3c-d6ca517cc943 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:45.190964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28e7202e-aa90-4dc0-bc3c-d6ca517cc943 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:45.191665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28e7202e-aa90-4dc0-bc3c-d6ca517cc943 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:45.192117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28e7202e-aa90-4dc0-bc3c-d6ca517cc943 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:45.192538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28e7202e-aa90-4dc0-bc3c-d6ca517cc943 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:45.330508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dfd0269b-4bc9-4fe1-8139-02856dba0a0e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:45.342387 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dfd0269b-4bc9-4fe1-8139-02856dba0a0e tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1506 microversion: 2.1 time: 0.498006 Oct 11 19:49:45.344523 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1042/2024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:44 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:45.368545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2d170f3e-b5bd-4397-b7d5-9eb494df44ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:45.376525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2d170f3e-b5bd-4397-b7d5-9eb494df44ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:45.412989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d170f3e-b5bd-4397-b7d5-9eb494df44ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:45.415526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d170f3e-b5bd-4397-b7d5-9eb494df44ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:45.416485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d170f3e-b5bd-4397-b7d5-9eb494df44ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:45.420010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d170f3e-b5bd-4397-b7d5-9eb494df44ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:45.422095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d170f3e-b5bd-4397-b7d5-9eb494df44ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:45.424155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d170f3e-b5bd-4397-b7d5-9eb494df44ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:45.476919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2d170f3e-b5bd-4397-b7d5-9eb494df44ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:45.560621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-28e7202e-aa90-4dc0-bc3c-d6ca517cc943 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:45.568640 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-28e7202e-aa90-4dc0-bc3c-d6ca517cc943 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1485 microversion: 2.1 time: 0.400505 Oct 11 19:49:45.569822 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 983/2025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:45 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1485 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:45.622276 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2d170f3e-b5bd-4397-b7d5-9eb494df44ba tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 204 len: 0 microversion: 2.1 time: 0.257072 Oct 11 19:49:45.623660 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1043/2026] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:45 2022] DELETE /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:49:45.633849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:45.634572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:45.642409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:45.644353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:45.644788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:45.646447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:45.646930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:45.647353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:45.699191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:45.757166 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.compute.api [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Instance is already in deleting state, ignoring this request Oct 11 19:49:45.758220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-40b3fbe7-0ff2-4aa7-b90d-939c8f7d845b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 204 len: 0 microversion: 2.1 time: 0.128629 Oct 11 19:49:45.762315 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 984/2027] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:45 2022] DELETE /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:49:45.771908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a7c771cc-eee6-4625-bb3d-d4d36949ee4b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:45.773325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a7c771cc-eee6-4625-bb3d-d4d36949ee4b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:45.788769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7c771cc-eee6-4625-bb3d-d4d36949ee4b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:45.789283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7c771cc-eee6-4625-bb3d-d4d36949ee4b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:45.789710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7c771cc-eee6-4625-bb3d-d4d36949ee4b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:45.790428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7c771cc-eee6-4625-bb3d-d4d36949ee4b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:45.790909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7c771cc-eee6-4625-bb3d-d4d36949ee4b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:45.791324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7c771cc-eee6-4625-bb3d-d4d36949ee4b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:45.871070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-767a6f02-5cf7-40ce-9541-9bb968bce0bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:45.871758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-767a6f02-5cf7-40ce-9541-9bb968bce0bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:45.882658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-767a6f02-5cf7-40ce-9541-9bb968bce0bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:45.883074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-767a6f02-5cf7-40ce-9541-9bb968bce0bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:45.883501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-767a6f02-5cf7-40ce-9541-9bb968bce0bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:45.886804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-767a6f02-5cf7-40ce-9541-9bb968bce0bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:45.887270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-767a6f02-5cf7-40ce-9541-9bb968bce0bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:45.892729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-767a6f02-5cf7-40ce-9541-9bb968bce0bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:46.844830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a7c771cc-eee6-4625-bb3d-d4d36949ee4b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:46.859908 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a7c771cc-eee6-4625-bb3d-d4d36949ee4b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1512 microversion: 2.1 time: 1.094643 Oct 11 19:49:46.860530 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1044/2028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:45 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1512 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:46.865409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:46.870578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:46.878943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:46.879711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:46.881360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:46.882335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:46.883055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:46.883762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:46.888581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-767a6f02-5cf7-40ce-9541-9bb968bce0bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:46.906482 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-767a6f02-5cf7-40ce-9541-9bb968bce0bf tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1314 microversion: 2.1 time: 1.046263 Oct 11 19:49:46.907754 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 985/2029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:45 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1314 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:49:46.936252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-338d8898-e39a-4aed-9ce1-7e0b1058ed7a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:46.937461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-338d8898-e39a-4aed-9ce1-7e0b1058ed7a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:46.946983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-338d8898-e39a-4aed-9ce1-7e0b1058ed7a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:46.949150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-338d8898-e39a-4aed-9ce1-7e0b1058ed7a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:46.951662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-338d8898-e39a-4aed-9ce1-7e0b1058ed7a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:46.952689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-338d8898-e39a-4aed-9ce1-7e0b1058ed7a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:46.955373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-338d8898-e39a-4aed-9ce1-7e0b1058ed7a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:46.956098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-338d8898-e39a-4aed-9ce1-7e0b1058ed7a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:47.650238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-338d8898-e39a-4aed-9ce1-7e0b1058ed7a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:47.659126 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-338d8898-e39a-4aed-9ce1-7e0b1058ed7a tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1485 microversion: 2.1 time: 0.737223 Oct 11 19:49:47.682707 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 986/2030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:46 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1485 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:47.820561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:47.836130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:47.837784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:47.842571 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ecbcda13-d7f9-4fe0-8553-a144bf13c9e8 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 0.977107 Oct 11 19:49:47.843185 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1045/2031] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:46 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:47.873327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-18f11698-fb3a-48d6-aa65-4f7a440d31cf req-456730ae-8576-4aa3-85c4-e96926c6c978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0077b0-6c4a-4b91-bf7b-d21e1fefca79", "name": "network-vif-deleted", "tag": "24aa7525-ed30-4f5d-b78d-85b68013de7c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:47.902417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a99e346d-2d67-4546-bffd-c174b55c47ea tempest-QuotasTestJSON-586332636 tempest-QuotasTestJSON-586332636-project] Calling method '.version_select at 0x7f83cc187c10>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:47.909537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-18f11698-fb3a-48d6-aa65-4f7a440d31cf req-456730ae-8576-4aa3-85c4-e96926c6c978 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:47.910019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-18f11698-fb3a-48d6-aa65-4f7a440d31cf req-456730ae-8576-4aa3-85c4-e96926c6c978 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:47.917971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-18f11698-fb3a-48d6-aa65-4f7a440d31cf req-456730ae-8576-4aa3-85c4-e96926c6c978 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:47.966821 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-18f11698-fb3a-48d6-aa65-4f7a440d31cf req-456730ae-8576-4aa3-85c4-e96926c6c978 service nova] Creating event network-vif-deleted:24aa7525-ed30-4f5d-b78d-85b68013de7c for instance 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 on n-h1-860864-3 Oct 11 19:49:47.995772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:48.009433 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-18f11698-fb3a-48d6-aa65-4f7a440d31cf req-456730ae-8576-4aa3-85c4-e96926c6c978 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146506 Oct 11 19:49:48.011970 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1046/2032] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:48.013817 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a99e346d-2d67-4546-bffd-c174b55c47ea tempest-QuotasTestJSON-586332636 tempest-QuotasTestJSON-586332636-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c233e6849a85471da78a5fc8a37cb6ad/defaults" status: 200 len: 371 microversion: 2.1 time: 0.329489 Oct 11 19:49:48.024688 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 987/2033] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:49:47 2022] GET /compute/v2.1/os-quota-sets/c233e6849a85471da78a5fc8a37cb6ad/defaults => generated 371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:48.026055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:48.026838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:48.040521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:48.043554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:48.044757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:48.047772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:48.049356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db645ca5-560a-492c-a670-1d7ec3fd2fc5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:48.049610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:48.050222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:48.052218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-db645ca5-560a-492c-a670-1d7ec3fd2fc5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:48.084531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db645ca5-560a-492c-a670-1d7ec3fd2fc5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:48.087221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db645ca5-560a-492c-a670-1d7ec3fd2fc5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:48.088053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db645ca5-560a-492c-a670-1d7ec3fd2fc5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:48.090781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db645ca5-560a-492c-a670-1d7ec3fd2fc5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:48.105236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db645ca5-560a-492c-a670-1d7ec3fd2fc5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:48.105963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db645ca5-560a-492c-a670-1d7ec3fd2fc5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:48.114550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:48.115046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:48.115481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:48.115931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lazy-loading 'fault' on Instance uuid 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:49:48.357169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add987fef80d49318742f2c38793cf7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6c2139c019469d8d6a41e036595765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:48.365641 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-697ff66e-959f-4845-b228-c8bfc1d6c4d0 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 200 len: 1307 microversion: 2.1 time: 0.352405 Oct 11 19:49:48.366646 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1047/2034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:48 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 1307 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:48.372018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1cd29613-5c20-40fa-8870-a43d157d794e tempest-QuotasTestJSON-586332636 tempest-QuotasTestJSON-586332636-project] Calling method '.version_select at 0x7f83d06e5d30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:48.375589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=14 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:48.500964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:48.503810 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1cd29613-5c20-40fa-8870-a43d157d794e tempest-QuotasTestJSON-586332636 tempest-QuotasTestJSON-586332636-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c233e6849a85471da78a5fc8a37cb6ad" status: 200 len: 371 microversion: 2.1 time: 0.135941 Oct 11 19:49:48.504934 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1048/2035] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 11 19:49:48 2022] GET /compute/v2.1/os-quota-sets/c233e6849a85471da78a5fc8a37cb6ad => generated 371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:48.523765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62c51bd9-05c8-4d83-b34a-e62c05c6989e tempest-QuotasTestJSON-586332636 tempest-QuotasTestJSON-586332636-project] Calling method '.version_select at 0x7f83d074dee0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:48.608894 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-62c51bd9-05c8-4d83-b34a-e62c05c6989e tempest-QuotasTestJSON-586332636 tempest-QuotasTestJSON-586332636-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c233e6849a85471da78a5fc8a37cb6ad/defaults" status: 200 len: 371 microversion: 2.1 time: 0.088917 Oct 11 19:49:48.609890 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1049/2036] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 19:49:48 2022] GET /compute/v2.1/os-quota-sets/c233e6849a85471da78a5fc8a37cb6ad/defaults => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:49:48.630989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c6b0c34b-f56b-49dc-ac43-d24a44e52fff tempest-QuotasTestJSON-586332636 tempest-QuotasTestJSON-586332636-project] Calling method '.version_select at 0x7f83d06fc9d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:48.772523 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c6b0c34b-f56b-49dc-ac43-d24a44e52fff tempest-QuotasTestJSON-586332636 tempest-QuotasTestJSON-586332636-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c233e6849a85471da78a5fc8a37cb6ad" status: 200 len: 371 microversion: 2.1 time: 0.146106 Oct 11 19:49:48.774356 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1050/2037] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 11 19:49:48 2022] GET /compute/v2.1/os-quota-sets/c233e6849a85471da78a5fc8a37cb6ad => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:49:48.785416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-db645ca5-560a-492c-a670-1d7ec3fd2fc5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:48.790395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3beda021-f639-4857-97c7-76d480a2beb1 req-93811f53-ed3a-4c42-a936-75a9849046ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dea9975-b38a-465e-a181-454a20b0ae00", "name": "network-vif-deleted", "tag": "44663329-774c-463a-a864-c1e0c979ab76"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:48.798174 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-db645ca5-560a-492c-a670-1d7ec3fd2fc5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1314 microversion: 2.1 time: 0.771223 Oct 11 19:49:48.800587 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 988/2038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:48 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:48.820182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:48.821183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:48.821464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3beda021-f639-4857-97c7-76d480a2beb1 req-93811f53-ed3a-4c42-a936-75a9849046ed service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:48.822290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3beda021-f639-4857-97c7-76d480a2beb1 req-93811f53-ed3a-4c42-a936-75a9849046ed service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:48.823680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3beda021-f639-4857-97c7-76d480a2beb1 req-93811f53-ed3a-4c42-a936-75a9849046ed service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:48.834462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:48.835016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:48.835514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:48.840714 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3beda021-f639-4857-97c7-76d480a2beb1 req-93811f53-ed3a-4c42-a936-75a9849046ed service nova] Creating event network-vif-deleted:44663329-774c-463a-a864-c1e0c979ab76 for instance 7dea9975-b38a-465e-a181-454a20b0ae00 on n-h2-860864-3 Oct 11 19:49:48.842291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:48.843006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:48.843455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:48.848136 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3beda021-f639-4857-97c7-76d480a2beb1 req-93811f53-ed3a-4c42-a936-75a9849046ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072019 Oct 11 19:49:48.850181 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1051/2039] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:48.858751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-facdc0c7-6254-4bdf-95ce-191e10efe09f tempest-QuotasTestJSON-586332636 tempest-QuotasTestJSON-586332636-project] Calling method '.version_select at 0x7f83d06f09d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:48.954496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:48.956706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:48.960307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:48.961213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lazy-loading 'fault' on Instance uuid 7dea9975-b38a-465e-a181-454a20b0ae00 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:49:49.009272 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-facdc0c7-6254-4bdf-95ce-191e10efe09f tempest-QuotasTestJSON-586332636 tempest-QuotasTestJSON-586332636-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c233e6849a85471da78a5fc8a37cb6ad?user_id=82055e5989ca479e8201c555ad2b05f1" status: 200 len: 371 microversion: 2.1 time: 0.157544 Oct 11 19:49:49.012578 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1052/2040] 10.222.0.27 () {58 vars in 1323 bytes} [Tue Oct 11 19:49:48 2022] GET /compute/v2.1/os-quota-sets/c233e6849a85471da78a5fc8a37cb6ad?user_id=82055e5989ca479e8201c555ad2b05f1 => generated 371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:49.037231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:49.043513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:49.064213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.065660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.066118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.070593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.072901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.073538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.594434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:49.606329 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93a59822-5192-410f-a7d8-47417a387ef2 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 200 len: 1301 microversion: 2.1 time: 0.802094 Oct 11 19:49:49.620107 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 989/2041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:48 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 1301 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:49.638477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:49.641524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:49.648880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.650596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.651246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.652147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.652779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.654685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.673857 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] HTTP exception thrown: Instance 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 could not be found. Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Request method failure captured: Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 HTTP/1.1 Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcgrXOzP0n9dlHzcK3QhcIWjicDNunnjXJal43pmPVz4V2hB9S5HSEr1qalhFiX31uAx_oqDC8aNIY79kWYfSskbeKqwvHOIGRQgpvAZGp1fGdAxe6onV6PENX95fcu0Sl5ed6WqY1TQ_bS8pvQ68hTuia2N7oj2RxlFDUxhN7Q0dmM Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: cd6c2139c019469d8d6a41e036595765 Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cd6c2139c019469d8d6a41e036595765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cd6c2139c019469d8d6a41e036595765", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd6c2139c019469d8d6a41e036595765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd6c2139c019469d8d6a41e036595765"}]}] Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: cd6c2139c019469d8d6a41e036595765 Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerDiskConfigTestJSON-192246851-project Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: add987fef80d49318742f2c38793cf7a Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerDiskConfigTestJSON-192246851-project Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 could not be found. Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '0d0077b0-6c4a-4b91-bf7b-d21e1fefca79'} Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 could not be found. Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 could not be found. Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:49.676368 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.684122 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.684122 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:49.684122 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:49.684122 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:49.684122 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:49.684122 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 could not be found. Oct 11 19:49:49.684122 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.687340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Returning 404 to user: Instance 0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:49.689073 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1acf2b06-7e23-4fa0-848b-2b6391d9ae1d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79" status: 404 len: 111 microversion: 2.1 time: 0.067693 Oct 11 19:49:49.694192 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 990/2042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:49 2022] GET /compute/v2.1/servers/0d0077b0-6c4a-4b91-bf7b-d21e1fefca79 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:49.700671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:49.701614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:49.710161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.711361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.712283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.713215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.714000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.714678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.734909 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] HTTP exception thrown: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Request method failure captured: Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f HTTP/1.1 Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcgrXOzP0n9dlHzcK3QhcIWjicDNunnjXJal43pmPVz4V2hB9S5HSEr1qalhFiX31uAx_oqDC8aNIY79kWYfSskbeKqwvHOIGRQgpvAZGp1fGdAxe6onV6PENX95fcu0Sl5ed6WqY1TQ_bS8pvQ68hTuia2N7oj2RxlFDUxhN7Q0dmM Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: cd6c2139c019469d8d6a41e036595765 Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cd6c2139c019469d8d6a41e036595765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cd6c2139c019469d8d6a41e036595765", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd6c2139c019469d8d6a41e036595765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd6c2139c019469d8d6a41e036595765"}]}] Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: cd6c2139c019469d8d6a41e036595765 Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerDiskConfigTestJSON-192246851-project Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: add987fef80d49318742f2c38793cf7a Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerDiskConfigTestJSON-192246851-project Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'd6f64eed-776b-4aaf-b46c-cb1f73e5500f'} Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:49.737603 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Returning 404 to user: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:49.743599 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a46e230-d270-48f7-82b5-9d28ba97d86b tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 404 len: 111 microversion: 2.1 time: 0.044697 Oct 11 19:49:49.749810 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 991/2043] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:49 2022] DELETE /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:49.752704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:49.753395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: d6f64eed-776b-4aaf-b46c-cb1f73e5500f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:49.760358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.760872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.761700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.762089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.762566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.764167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.782348 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] HTTP exception thrown: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Request method failure captured: Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f HTTP/1.1 Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcgrXOzP0n9dlHzcK3QhcIWjicDNunnjXJal43pmPVz4V2hB9S5HSEr1qalhFiX31uAx_oqDC8aNIY79kWYfSskbeKqwvHOIGRQgpvAZGp1fGdAxe6onV6PENX95fcu0Sl5ed6WqY1TQ_bS8pvQ68hTuia2N7oj2RxlFDUxhN7Q0dmM Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: cd6c2139c019469d8d6a41e036595765 Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cd6c2139c019469d8d6a41e036595765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cd6c2139c019469d8d6a41e036595765", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd6c2139c019469d8d6a41e036595765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd6c2139c019469d8d6a41e036595765"}]}] Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: cd6c2139c019469d8d6a41e036595765 Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerDiskConfigTestJSON-192246851-project Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: add987fef80d49318742f2c38793cf7a Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerDiskConfigTestJSON-192246851-project Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'd6f64eed-776b-4aaf-b46c-cb1f73e5500f'} Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:49.783943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.788749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.788749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:49.788749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:49.788749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:49.788749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:49.788749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. Oct 11 19:49:49.788749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.788749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Returning 404 to user: Instance d6f64eed-776b-4aaf-b46c-cb1f73e5500f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:49.788749 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d76e0f38-4676-4a34-9564-a9a73ad2e38d tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f" status: 404 len: 111 microversion: 2.1 time: 0.037036 Oct 11 19:49:49.788749 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 992/2044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:49 2022] GET /compute/v2.1/servers/d6f64eed-776b-4aaf-b46c-cb1f73e5500f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:49.795242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:49.795851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:49.803450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.804483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.804931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.805648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.807322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.808205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.829826 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] HTTP exception thrown: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Request method failure captured: Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d HTTP/1.1 Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcgrXOzP0n9dlHzcK3QhcIWjicDNunnjXJal43pmPVz4V2hB9S5HSEr1qalhFiX31uAx_oqDC8aNIY79kWYfSskbeKqwvHOIGRQgpvAZGp1fGdAxe6onV6PENX95fcu0Sl5ed6WqY1TQ_bS8pvQ68hTuia2N7oj2RxlFDUxhN7Q0dmM Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: cd6c2139c019469d8d6a41e036595765 Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cd6c2139c019469d8d6a41e036595765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cd6c2139c019469d8d6a41e036595765", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd6c2139c019469d8d6a41e036595765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd6c2139c019469d8d6a41e036595765"}]}] Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: cd6c2139c019469d8d6a41e036595765 Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerDiskConfigTestJSON-192246851-project Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: add987fef80d49318742f2c38793cf7a Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerDiskConfigTestJSON-192246851-project Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'fa0ed4c2-43b2-4097-853d-fc6d93d63a1d'} Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:49.831892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Returning 404 to user: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-45ff8143-3d43-4743-a588-6929b26724ae tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 404 len: 111 microversion: 2.1 time: 0.043221 Oct 11 19:49:49.840181 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 993/2045] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:49 2022] DELETE /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:49.841544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a956789-3fa4-40d0-b0db-38662d91b942 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:49.842359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a956789-3fa4-40d0-b0db-38662d91b942 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:49.849397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a956789-3fa4-40d0-b0db-38662d91b942 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.849956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a956789-3fa4-40d0-b0db-38662d91b942 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.850400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a956789-3fa4-40d0-b0db-38662d91b942 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.851159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a956789-3fa4-40d0-b0db-38662d91b942 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.851758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a956789-3fa4-40d0-b0db-38662d91b942 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.852193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a956789-3fa4-40d0-b0db-38662d91b942 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.920816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:49.932616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:49.938017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:49.939596 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3be3942b-f7eb-412d-ab2c-a88bdb790e81 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 0.925861 Oct 11 19:49:49.940769 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1053/2046] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:49 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:49.946626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:49.947537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] [instance: fa0ed4c2-43b2-4097-853d-fc6d93d63a1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:49.956010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.956775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.957476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.958280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:49.959504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:49.960036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:49.975591 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] HTTP exception thrown: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Request method failure captured: Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d HTTP/1.1 Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcgrXOzP0n9dlHzcK3QhcIWjicDNunnjXJal43pmPVz4V2hB9S5HSEr1qalhFiX31uAx_oqDC8aNIY79kWYfSskbeKqwvHOIGRQgpvAZGp1fGdAxe6onV6PENX95fcu0Sl5ed6WqY1TQ_bS8pvQ68hTuia2N7oj2RxlFDUxhN7Q0dmM Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: cd6c2139c019469d8d6a41e036595765 Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cd6c2139c019469d8d6a41e036595765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cd6c2139c019469d8d6a41e036595765", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd6c2139c019469d8d6a41e036595765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd6c2139c019469d8d6a41e036595765"}]}] Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: cd6c2139c019469d8d6a41e036595765 Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-192246851 Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerDiskConfigTestJSON-192246851-project Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: add987fef80d49318742f2c38793cf7a Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerDiskConfigTestJSON-192246851-project Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'fa0ed4c2-43b2-4097-853d-fc6d93d63a1d'} Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:49.977646 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.983232 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:49.983232 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:49.983232 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:49.983232 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:49.983232 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:49.983232 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. Oct 11 19:49:49.983232 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:49.985685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] Returning 404 to user: Instance fa0ed4c2-43b2-4097-853d-fc6d93d63a1d could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:49.986718 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3351acd3-5845-4caa-9806-39ea58b88428 tempest-ServerDiskConfigTestJSON-192246851 tempest-ServerDiskConfigTestJSON-192246851-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d" status: 404 len: 111 microversion: 2.1 time: 0.044752 Oct 11 19:49:49.987710 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1054/2047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:49 2022] GET /compute/v2.1/servers/fa0ed4c2-43b2-4097-853d-fc6d93d63a1d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:50.334943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a956789-3fa4-40d0-b0db-38662d91b942 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:50.351271 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a956789-3fa4-40d0-b0db-38662d91b942 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1314 microversion: 2.1 time: 0.515122 Oct 11 19:49:50.377372 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 994/2048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:49 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:50.633262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:50.633886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 7dea9975-b38a-465e-a181-454a20b0ae00] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:50.649081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:50.649584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:50.650021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:50.650822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:50.651514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:50.652127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:50.704740 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] HTTP exception thrown: Instance 7dea9975-b38a-465e-a181-454a20b0ae00 could not be found. Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Request method failure captured: Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 HTTP/1.1 Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccsgzzVs8K4wlcOreWzusfqslL2IgERaJJT7THzhfWPn2GkuCmIzFhhCYJfwDsXS-z4ETFZFcBvMivttSxpkeLzVaDvyy2osF_qtaJbGRvYDJMDSa9Kn0pHwZeFad28A0Wny7VlTNF6JtKB-3BT-FVbGNHHyJujXawY8o2ZGVBWmWY Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 947af1a9d24f4e19a59ec820ba1a65e4 Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-LiveMigrationTest-924138453 Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/947af1a9d24f4e19a59ec820ba1a65e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_947af1a9d24f4e19a59ec820ba1a65e4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/947af1a9d24f4e19a59ec820ba1a65e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/947af1a9d24f4e19a59ec820ba1a65e4"}]}] Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-LiveMigrationTest-924138453 Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 947af1a9d24f4e19a59ec820ba1a65e4 Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-LiveMigrationTest-924138453 Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-LiveMigrationTest-924138453-project Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 4e2460b9a8f34662b802709a91907510 Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-LiveMigrationTest-924138453-project Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 7dea9975-b38a-465e-a181-454a20b0ae00 could not be found. Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '7dea9975-b38a-465e-a181-454a20b0ae00'} Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dea9975-b38a-465e-a181-454a20b0ae00 could not be found. Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dea9975-b38a-465e-a181-454a20b0ae00 could not be found. Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:50.706419 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:50.711774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:50.711774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:50.711774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:50.711774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:50.711774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:50.711774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dea9975-b38a-465e-a181-454a20b0ae00 could not be found. Oct 11 19:49:50.711774 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:50.714233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Returning 404 to user: Instance 7dea9975-b38a-465e-a181-454a20b0ae00 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:50.715378 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-64fa01ff-fcad-4148-95db-ab6b8af7deeb tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00" status: 404 len: 111 microversion: 2.1 time: 0.086061 Oct 11 19:49:50.716752 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1055/2049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:50 2022] GET /compute/v2.1/servers/7dea9975-b38a-465e-a181-454a20b0ae00 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:50.725284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6e3d0753-8b01-42b3-948d-91c5a647ac48 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:50.725977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6e3d0753-8b01-42b3-948d-91c5a647ac48 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:50.742705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e3d0753-8b01-42b3-948d-91c5a647ac48 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:50.743319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e3d0753-8b01-42b3-948d-91c5a647ac48 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:50.743838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e3d0753-8b01-42b3-948d-91c5a647ac48 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:50.744956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e3d0753-8b01-42b3-948d-91c5a647ac48 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:50.745491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e3d0753-8b01-42b3-948d-91c5a647ac48 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:50.746001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e3d0753-8b01-42b3-948d-91c5a647ac48 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:50.752976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:50.801839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6e3d0753-8b01-42b3-948d-91c5a647ac48 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:49:50.972616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:50.973768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:50.976980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=14 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:50.994317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:50.998290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:51.003886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:51.006381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:51.007298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:51.008114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:51.009289 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6e3d0753-8b01-42b3-948d-91c5a647ac48 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 204 len: 0 microversion: 2.1 time: 0.288248 Oct 11 19:49:51.010394 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 995/2050] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:49:50 2022] DELETE /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:49:51.023300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8da93067-0108-49ea-aaff-fc983e4dcf42 req-15ea911b-1577-451c-b1c4-3a4e9fc19bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ec61a7-946a-464c-8c7b-179353b2bce7", "name": "network-vif-plugged", "status": "completed", "tag": "2cc87b3c-09de-4035-a04d-aded17bae470"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:51.047247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8da93067-0108-49ea-aaff-fc983e4dcf42 req-15ea911b-1577-451c-b1c4-3a4e9fc19bb6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:51.047749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8da93067-0108-49ea-aaff-fc983e4dcf42 req-15ea911b-1577-451c-b1c4-3a4e9fc19bb6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:51.048183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8da93067-0108-49ea-aaff-fc983e4dcf42 req-15ea911b-1577-451c-b1c4-3a4e9fc19bb6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:51.074830 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8da93067-0108-49ea-aaff-fc983e4dcf42 req-15ea911b-1577-451c-b1c4-3a4e9fc19bb6 service nova] Creating event network-vif-plugged:2cc87b3c-09de-4035-a04d-aded17bae470 for instance b6ec61a7-946a-464c-8c7b-179353b2bce7 on n-h2-860864-3 Oct 11 19:49:51.088730 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8da93067-0108-49ea-aaff-fc983e4dcf42 req-15ea911b-1577-451c-b1c4-3a4e9fc19bb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076380 Oct 11 19:49:51.091783 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 996/2051] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:51.104255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b33f12bb-78eb-408a-8004-cafc219dfbee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:51.104964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b33f12bb-78eb-408a-8004-cafc219dfbee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:51.120517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b33f12bb-78eb-408a-8004-cafc219dfbee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:51.120898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b33f12bb-78eb-408a-8004-cafc219dfbee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:51.121336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b33f12bb-78eb-408a-8004-cafc219dfbee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:51.125481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b33f12bb-78eb-408a-8004-cafc219dfbee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:51.126014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b33f12bb-78eb-408a-8004-cafc219dfbee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:51.126454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b33f12bb-78eb-408a-8004-cafc219dfbee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:51.488955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:51.539924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:51.551758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:51.559268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:51.567969 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-56c25974-a9cf-4541-babb-840a4ff89f1e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 0.600230 Oct 11 19:49:51.572744 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1056/2052] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:50 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:51.591154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-235f5158-778b-4657-a5b3-38e7de9e2bea tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:51.593088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-235f5158-778b-4657-a5b3-38e7de9e2bea tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:51.605161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-235f5158-778b-4657-a5b3-38e7de9e2bea tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:51.607821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-235f5158-778b-4657-a5b3-38e7de9e2bea tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:51.608501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-235f5158-778b-4657-a5b3-38e7de9e2bea tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:51.609246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-235f5158-778b-4657-a5b3-38e7de9e2bea tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:51.609714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-235f5158-778b-4657-a5b3-38e7de9e2bea tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:51.610141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-235f5158-778b-4657-a5b3-38e7de9e2bea tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:51.809170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b33f12bb-78eb-408a-8004-cafc219dfbee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2460b9a8f34662b802709a91907510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947af1a9d24f4e19a59ec820ba1a65e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:51.822383 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b33f12bb-78eb-408a-8004-cafc219dfbee tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 200 len: 1500 microversion: 2.1 time: 0.729282 Oct 11 19:49:51.826614 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 997/2053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:51 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 1500 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:52.150511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-235f5158-778b-4657-a5b3-38e7de9e2bea tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:52.158871 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-235f5158-778b-4657-a5b3-38e7de9e2bea tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1314 microversion: 2.1 time: 0.584065 Oct 11 19:49:52.159449 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1057/2054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:51 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:52.596732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:52.597345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:52.609759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:52.612802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:52.613648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:52.615730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:52.616413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:52.617175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:52.659811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b478d864-77fa-47f6-b56b-1c31ee9cfd87 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Action: 'create', calling method: .version_select at 0x7f83d076f0d0>, body: {"pool": null} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:53.745864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:53.764393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:53.766163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:53.767558 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c52ee2ae-29d1-4646-acc9-988cd3dbd43e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 1.175420 Oct 11 19:49:53.768626 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1058/2055] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:52 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:53.782597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3ef895b9-5235-4b5c-aae7-a7c92fdba68c req-9bb32173-5fb1-4669-bf2f-c5afae5a2dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ac645a-a576-4cad-a7f2-58d8920c2523", "name": "network-vif-deleted", "tag": "8f81cfc1-8024-4193-8b3a-821edf92818d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:53.802631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3ef895b9-5235-4b5c-aae7-a7c92fdba68c req-9bb32173-5fb1-4669-bf2f-c5afae5a2dc5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:53.803361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3ef895b9-5235-4b5c-aae7-a7c92fdba68c req-9bb32173-5fb1-4669-bf2f-c5afae5a2dc5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:53.804001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3ef895b9-5235-4b5c-aae7-a7c92fdba68c req-9bb32173-5fb1-4669-bf2f-c5afae5a2dc5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:53.832264 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3ef895b9-5235-4b5c-aae7-a7c92fdba68c req-9bb32173-5fb1-4669-bf2f-c5afae5a2dc5 service nova] Creating event network-vif-deleted:8f81cfc1-8024-4193-8b3a-821edf92818d for instance 71ac645a-a576-4cad-a7f2-58d8920c2523 on n-h2-860864-3 Oct 11 19:49:53.837779 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3ef895b9-5235-4b5c-aae7-a7c92fdba68c req-9bb32173-5fb1-4669-bf2f-c5afae5a2dc5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067768 Oct 11 19:49:53.839299 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1059/2056] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:53.850809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:53.855850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] [instance: 71ac645a-a576-4cad-a7f2-58d8920c2523] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:53.864730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:53.865490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:53.866177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:53.867144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:53.867798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:53.868412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:53.884472 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] HTTP exception thrown: Instance 71ac645a-a576-4cad-a7f2-58d8920c2523 could not be found. Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Request method failure captured: Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 HTTP/1.1 Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRccsgzzVs8K4wlcOreWzusfqslL2IgERaJJT7THzhfWPn2GkuCmIzFhhCYJfwDsXS-z4ETFZFcBvMivttSxpkeLzVaDvyy2osF_qtaJbGRvYDJMDSa9Kn0pHwZeFad28A0Wny7VlTNF6JtKB-3BT-FVbGNHHyJujXawY8o2ZGVBWmWY Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 947af1a9d24f4e19a59ec820ba1a65e4 Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-LiveMigrationTest-924138453 Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/947af1a9d24f4e19a59ec820ba1a65e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_947af1a9d24f4e19a59ec820ba1a65e4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/947af1a9d24f4e19a59ec820ba1a65e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/947af1a9d24f4e19a59ec820ba1a65e4"}]}] Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-LiveMigrationTest-924138453 Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 947af1a9d24f4e19a59ec820ba1a65e4 Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-LiveMigrationTest-924138453 Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-LiveMigrationTest-924138453-project Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 4e2460b9a8f34662b802709a91907510 Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-LiveMigrationTest-924138453-project Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 71ac645a-a576-4cad-a7f2-58d8920c2523 could not be found. Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '71ac645a-a576-4cad-a7f2-58d8920c2523'} Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ac645a-a576-4cad-a7f2-58d8920c2523 could not be found. Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ac645a-a576-4cad-a7f2-58d8920c2523 could not be found. Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:49:53.886492 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:53.892398 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:49:53.892398 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:49:53.892398 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:49:53.892398 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:49:53.892398 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:49:53.892398 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ac645a-a576-4cad-a7f2-58d8920c2523 could not be found. Oct 11 19:49:53.892398 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:49:53.894580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] Returning 404 to user: Instance 71ac645a-a576-4cad-a7f2-58d8920c2523 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:49:53.895675 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e8c2317-26df-442e-beae-66b6b232d5d4 tempest-LiveMigrationTest-924138453 tempest-LiveMigrationTest-924138453-project] 10.222.0.27 "GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523" status: 404 len: 111 microversion: 2.1 time: 0.055117 Oct 11 19:49:53.896800 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1060/2057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:53 2022] GET /compute/v2.1/servers/71ac645a-a576-4cad-a7f2-58d8920c2523 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:49:53.902425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d4da301c-09c7-41ad-b347-4258d32e239c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:53.903540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d4da301c-09c7-41ad-b347-4258d32e239c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:53.910418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4da301c-09c7-41ad-b347-4258d32e239c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:53.911463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4da301c-09c7-41ad-b347-4258d32e239c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:53.912129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4da301c-09c7-41ad-b347-4258d32e239c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:53.913241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4da301c-09c7-41ad-b347-4258d32e239c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:53.913913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4da301c-09c7-41ad-b347-4258d32e239c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:53.914600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4da301c-09c7-41ad-b347-4258d32e239c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:54.685017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d4da301c-09c7-41ad-b347-4258d32e239c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:54.698056 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d4da301c-09c7-41ad-b347-4258d32e239c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1500 microversion: 2.1 time: 0.798715 Oct 11 19:49:54.714068 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1061/2058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:53 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1500 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:54.724592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-17b6767e-ef31-4b18-95a8-2254d15eed74 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:49:54.731791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17b6767e-ef31-4b18-95a8-2254d15eed74 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:54.732539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17b6767e-ef31-4b18-95a8-2254d15eed74 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:54.733171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17b6767e-ef31-4b18-95a8-2254d15eed74 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:54.818685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-17b6767e-ef31-4b18-95a8-2254d15eed74 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Going to try to stop instance {{(pid=126956) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 19:49:54.886811 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-17b6767e-ef31-4b18-95a8-2254d15eed74 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7/action" status: 202 len: 0 microversion: 2.1 time: 0.163245 Oct 11 19:49:54.891096 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1062/2059] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:49:54 2022] POST /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:49:54.900313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:54.901033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:54.921841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:54.922370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:54.926511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:54.927352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:54.927842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:54.928278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:54.942003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:55.822260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:55.837908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:55.840047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:55.852388 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-76878987-ee1e-4a7e-bc66-97ff4be055a5 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 0.959534 Oct 11 19:49:55.853071 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1063/2060] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:54 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:49:55.859560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f8e4301f-68a6-4501-93fe-45a7a70049b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:55.860590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f8e4301f-68a6-4501-93fe-45a7a70049b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:55.874814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8e4301f-68a6-4501-93fe-45a7a70049b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:55.877467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8e4301f-68a6-4501-93fe-45a7a70049b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:55.878116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8e4301f-68a6-4501-93fe-45a7a70049b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:55.879509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8e4301f-68a6-4501-93fe-45a7a70049b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:55.881972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8e4301f-68a6-4501-93fe-45a7a70049b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:55.883054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8e4301f-68a6-4501-93fe-45a7a70049b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:56.596331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f8e4301f-68a6-4501-93fe-45a7a70049b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:56.609764 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f8e4301f-68a6-4501-93fe-45a7a70049b8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 0.754932 Oct 11 19:49:56.623710 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1064/2061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:55 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:56.883651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:56.885485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:56.920881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:56.925613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:56.927105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:56.928042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:56.931117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:56.933596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:57.688456 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b478d864-77fa-47f6-b56b-1c31ee9cfd87 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.486475 Oct 11 19:49:57.697085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:57.699007 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 998/2062] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:49:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:57.709796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:57.712287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:57.714427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fb3a202c-c9e8-4daf-ac5b-a5a269fbffbb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:57.715157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fb3a202c-c9e8-4daf-ac5b-a5a269fbffbb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:57.720023 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ed222fcd-a91f-49af-aa76-2a7d984b9f6b tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 0.840788 Oct 11 19:49:57.732550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb3a202c-c9e8-4daf-ac5b-a5a269fbffbb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:57.733066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb3a202c-c9e8-4daf-ac5b-a5a269fbffbb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:57.733712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb3a202c-c9e8-4daf-ac5b-a5a269fbffbb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:57.734924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb3a202c-c9e8-4daf-ac5b-a5a269fbffbb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:57.747109 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1065/2063] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:56 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:49:57.747109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-15ccf129-9f9b-4bd5-9c23-dd8efdb05509 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Calling method '.version_select at 0x7f83d07c18b0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:57.748803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb3a202c-c9e8-4daf-ac5b-a5a269fbffbb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:57.749431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb3a202c-c9e8-4daf-ac5b-a5a269fbffbb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:58.214063 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-15ccf129-9f9b-4bd5-9c23-dd8efdb05509 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/5f4a87c1-d299-488f-b97a-b0e1aa26d7b4" status: 200 len: 141 microversion: 2.1 time: 0.475974 Oct 11 19:49:58.216976 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1066/2064] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:49:57 2022] GET /compute/v2.1/os-floating-ips/5f4a87c1-d299-488f-b97a-b0e1aa26d7b4 => generated 141 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:58.307882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98b43374-5275-470a-9fc3-2db594e15dab tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Calling method '.version_select at 0x7f83d0712280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:58.468052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fb3a202c-c9e8-4daf-ac5b-a5a269fbffbb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:49:58.481839 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fb3a202c-c9e8-4daf-ac5b-a5a269fbffbb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 0.776650 Oct 11 19:49:58.484304 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 999/2065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:49:57 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:49:58.765395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:49:58.766943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:49:58.776162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:58.781113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:58.781842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:58.782933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:49:58.784699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:49:58.785413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:49:58.989775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:49:59.279449 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98b43374-5275-470a-9fc3-2db594e15dab tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.983222 Oct 11 19:49:59.281664 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1067/2066] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 11 19:49:58 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:49:59.294749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9810f77-d77c-4fdc-9609-e3930da8c634 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Calling method '.version_select at 0x7f83d0712310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:00.145022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:00.166307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:00.177097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:00.199884 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d40545bf-4198-44d8-8082-aab4c66b7fb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 1.433430 Oct 11 19:50:00.206125 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1000/2067] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:49:58 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:00.217977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7ce81029-521e-4f11-9664-14129b8b7052 req-d11c2bd8-ba03-490b-a6bf-7dc42bc4ff70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd21bb0-f168-4a05-ad19-6b72415fc036", "name": "network-vif-plugged", "status": "completed", "tag": "7c1948ab-cfd5-4292-93ea-b18935d2b086"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:00.241695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7ce81029-521e-4f11-9664-14129b8b7052 req-d11c2bd8-ba03-490b-a6bf-7dc42bc4ff70 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:00.242582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7ce81029-521e-4f11-9664-14129b8b7052 req-d11c2bd8-ba03-490b-a6bf-7dc42bc4ff70 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:00.243245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7ce81029-521e-4f11-9664-14129b8b7052 req-d11c2bd8-ba03-490b-a6bf-7dc42bc4ff70 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:00.261941 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7ce81029-521e-4f11-9664-14129b8b7052 req-d11c2bd8-ba03-490b-a6bf-7dc42bc4ff70 service nova] Creating event network-vif-plugged:7c1948ab-cfd5-4292-93ea-b18935d2b086 for instance ebd21bb0-f168-4a05-ad19-6b72415fc036 on n-h2-860864-3 Oct 11 19:50:00.270806 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7ce81029-521e-4f11-9664-14129b8b7052 req-d11c2bd8-ba03-490b-a6bf-7dc42bc4ff70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063167 Oct 11 19:50:00.271838 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1001/2068] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:00.286793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cdabefc4-2272-4922-8b10-27e668e19688 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:00.287733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cdabefc4-2272-4922-8b10-27e668e19688 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:00.306568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdabefc4-2272-4922-8b10-27e668e19688 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:00.307362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdabefc4-2272-4922-8b10-27e668e19688 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:00.308045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdabefc4-2272-4922-8b10-27e668e19688 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:00.309058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdabefc4-2272-4922-8b10-27e668e19688 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:00.309769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdabefc4-2272-4922-8b10-27e668e19688 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:00.313297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdabefc4-2272-4922-8b10-27e668e19688 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:00.724408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cdabefc4-2272-4922-8b10-27e668e19688 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:00.735992 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cdabefc4-2272-4922-8b10-27e668e19688 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 0.461698 Oct 11 19:50:00.738382 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1002/2069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:00 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:01.230478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:01.233550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:01.245634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:01.246998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:01.247994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:01.251423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:01.253204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:01.256339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:01.834352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:01.843928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:01.845385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:01.846502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6d4b048f-d97f-4fba-b24c-187c9f35f6b3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1281 microversion: 2.25 time: 0.621029 Oct 11 19:50:01.870951 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1003/2070] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:01 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1281 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:50:01.878477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-04653c3e-83b1-44ce-b6ca-ff160595db61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:01.882286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-04653c3e-83b1-44ce-b6ca-ff160595db61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:01.903916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04653c3e-83b1-44ce-b6ca-ff160595db61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:01.913280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04653c3e-83b1-44ce-b6ca-ff160595db61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:01.914266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04653c3e-83b1-44ce-b6ca-ff160595db61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:01.915061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04653c3e-83b1-44ce-b6ca-ff160595db61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:01.924141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04653c3e-83b1-44ce-b6ca-ff160595db61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:01.924362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04653c3e-83b1-44ce-b6ca-ff160595db61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:02.536720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-04653c3e-83b1-44ce-b6ca-ff160595db61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:02.550741 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-04653c3e-83b1-44ce-b6ca-ff160595db61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 0.677379 Oct 11 19:50:02.560139 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1004/2071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:01 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:02.821573 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9810f77-d77c-4fdc-9609-e3930da8c634 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/5f4a87c1-d299-488f-b97a-b0e1aa26d7b4" status: 202 len: 0 microversion: 2.1 time: 3.530874 Oct 11 19:50:02.822411 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1068/2072] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:49:59 2022] DELETE /compute/v2.1/os-floating-ips/5f4a87c1-d299-488f-b97a-b0e1aa26d7b4 => generated 0 bytes in 3532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:50:02.832457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c485357f-5d19-49a3-8f24-03469c486de8 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Action: 'create', calling method: .version_select at 0x7f83cc25e4c0>, body: {"pool": null} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:02.894259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:02.894924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:02.908979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:02.908979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:02.918704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:02.919802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:02.926646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:02.927132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:03.647800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:03.661513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:03.669384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:03.671183 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-63c28c3d-bf0d-4c54-bd25-fefca3a14340 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1477 microversion: 2.25 time: 0.781010 Oct 11 19:50:03.672546 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1069/2073] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:02 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1477 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:50:03.690170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-52c9c1cc-ce4f-4f79-9c19-1d0231dfea23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:03.692429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-52c9c1cc-ce4f-4f79-9c19-1d0231dfea23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:03.733708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52c9c1cc-ce4f-4f79-9c19-1d0231dfea23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:03.738652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52c9c1cc-ce4f-4f79-9c19-1d0231dfea23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:03.739912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52c9c1cc-ce4f-4f79-9c19-1d0231dfea23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:03.752004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52c9c1cc-ce4f-4f79-9c19-1d0231dfea23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:03.762571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52c9c1cc-ce4f-4f79-9c19-1d0231dfea23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:03.764912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52c9c1cc-ce4f-4f79-9c19-1d0231dfea23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:04.175844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-52c9c1cc-ce4f-4f79-9c19-1d0231dfea23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:04.195473 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-52c9c1cc-ce4f-4f79-9c19-1d0231dfea23 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 0.519771 Oct 11 19:50:04.196701 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1070/2074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:03 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:04.843370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6dc4cad7-34ca-4c33-8de1-f676c5695448 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:04.844608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6dc4cad7-34ca-4c33-8de1-f676c5695448 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:04.868826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dc4cad7-34ca-4c33-8de1-f676c5695448 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:04.870028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dc4cad7-34ca-4c33-8de1-f676c5695448 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:04.870837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dc4cad7-34ca-4c33-8de1-f676c5695448 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:04.872419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dc4cad7-34ca-4c33-8de1-f676c5695448 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:04.885544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dc4cad7-34ca-4c33-8de1-f676c5695448 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:04.888990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dc4cad7-34ca-4c33-8de1-f676c5695448 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:05.245822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-6dc4cad7-34ca-4c33-8de1-f676c5695448 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid ebd21bb0-f168-4a05-ad19-6b72415fc036 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:50:05.284182 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6dc4cad7-34ca-4c33-8de1-f676c5695448 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1970 microversion: 2.25 time: 1.083514 Oct 11 19:50:05.286314 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1071/2075] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:04 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1970 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:05.291673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7db63c20-53ed-4b95-9288-5da001d928c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:05.292617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7db63c20-53ed-4b95-9288-5da001d928c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:05.318094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7db63c20-53ed-4b95-9288-5da001d928c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:05.318982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7db63c20-53ed-4b95-9288-5da001d928c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:05.319921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7db63c20-53ed-4b95-9288-5da001d928c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:05.321349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7db63c20-53ed-4b95-9288-5da001d928c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:05.322470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7db63c20-53ed-4b95-9288-5da001d928c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:05.323193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7db63c20-53ed-4b95-9288-5da001d928c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:05.896561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7db63c20-53ed-4b95-9288-5da001d928c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:05.911304 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7db63c20-53ed-4b95-9288-5da001d928c3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 0.623277 Oct 11 19:50:05.913641 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1072/2076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:05 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:05.919593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b8ea471f-c992-4511-9eb3-d0c84e8b6273 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:05.924881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b8ea471f-c992-4511-9eb3-d0c84e8b6273 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:05.951732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ea471f-c992-4511-9eb3-d0c84e8b6273 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:05.952500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ea471f-c992-4511-9eb3-d0c84e8b6273 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:05.953142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ea471f-c992-4511-9eb3-d0c84e8b6273 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:05.954050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ea471f-c992-4511-9eb3-d0c84e8b6273 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:05.954757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ea471f-c992-4511-9eb3-d0c84e8b6273 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:05.955351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ea471f-c992-4511-9eb3-d0c84e8b6273 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:06.560264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-b8ea471f-c992-4511-9eb3-d0c84e8b6273 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid ebd21bb0-f168-4a05-ad19-6b72415fc036 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:50:06.603604 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b8ea471f-c992-4511-9eb3-d0c84e8b6273 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1970 microversion: 2.25 time: 0.688514 Oct 11 19:50:06.604210 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1073/2077] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:05 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1970 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:06.631192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1e93bf0-f97c-4cb3-867b-d9c80d6f6291 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:06.634880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1e93bf0-f97c-4cb3-867b-d9c80d6f6291 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:06.635372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1e93bf0-f97c-4cb3-867b-d9c80d6f6291 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:06.635817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1e93bf0-f97c-4cb3-867b-d9c80d6f6291 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:06.637101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1e93bf0-f97c-4cb3-867b-d9c80d6f6291 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:06.637584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1e93bf0-f97c-4cb3-867b-d9c80d6f6291 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:06.638012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1e93bf0-f97c-4cb3-867b-d9c80d6f6291 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:06.716807 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1e93bf0-f97c-4cb3-867b-d9c80d6f6291 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.089262 Oct 11 19:50:06.721594 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1074/2078] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Oct 11 19:50:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 19:50:06.732890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-853dcab4-884f-4e06-8e8c-d0645d403280 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20ee5122-6e65-4cc1-85f0-85df216999ef"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:06.735866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-853dcab4-884f-4e06-8e8c-d0645d403280 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:06.742647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-853dcab4-884f-4e06-8e8c-d0645d403280 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:06.743171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-853dcab4-884f-4e06-8e8c-d0645d403280 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:06.743614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-853dcab4-884f-4e06-8e8c-d0645d403280 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:06.746871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-853dcab4-884f-4e06-8e8c-d0645d403280 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:06.747447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-853dcab4-884f-4e06-8e8c-d0645d403280 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:06.752440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-853dcab4-884f-4e06-8e8c-d0645d403280 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:07.132485 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c485357f-5d19-49a3-8f24-03469c486de8 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.303465 Oct 11 19:50:07.134071 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1005/2079] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:50:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:07.156242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-3", "block_migration": "auto"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:07.165761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:07.185423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:07.186364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:07.187100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:07.188258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:07.189670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:07.190362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:07.204862 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-853dcab4-884f-4e06-8e8c-d0645d403280 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "POST /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481923 Oct 11 19:50:07.205484 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1075/2080] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 19:50:06 2022] POST /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:07.216212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9277da7b-eee0-4251-a1d8-6e0414f8abd9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:07.216936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9277da7b-eee0-4251-a1d8-6e0414f8abd9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:07.236262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9277da7b-eee0-4251-a1d8-6e0414f8abd9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:07.237327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9277da7b-eee0-4251-a1d8-6e0414f8abd9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:07.238066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9277da7b-eee0-4251-a1d8-6e0414f8abd9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:07.239162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9277da7b-eee0-4251-a1d8-6e0414f8abd9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:07.239940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9277da7b-eee0-4251-a1d8-6e0414f8abd9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:07.240687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9277da7b-eee0-4251-a1d8-6e0414f8abd9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:07.303118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'flavor' on Instance uuid ebd21bb0-f168-4a05-ad19-6b72415fc036 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:50:07.369804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Going to try to live migrate instance to n-h1-860864-3 {{(pid=126955) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 19:50:08.452944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9277da7b-eee0-4251-a1d8-6e0414f8abd9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:08.461931 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9277da7b-eee0-4251-a1d8-6e0414f8abd9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 1.255056 Oct 11 19:50:08.479767 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1076/2081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:07 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:08.486382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-36e15cbb-1c61-4bd2-909c-6f0b742ff46f tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Calling method '.version_select at 0x7f83d073b8b0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:10.149065 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-36e15cbb-1c61-4bd2-909c-6f0b742ff46f tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/7aca8771-057a-4a55-af53-5c2f70008410" status: 202 len: 0 microversion: 2.1 time: 1.681419 Oct 11 19:50:10.150348 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1077/2082] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:50:08 2022] DELETE /compute/v2.1/os-floating-ips/7aca8771-057a-4a55-af53-5c2f70008410 => generated 0 bytes in 1683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:50:10.159041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e76d0a78-ae68-412d-95e7-b529e431d748 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:10.159969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e76d0a78-ae68-412d-95e7-b529e431d748 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:10.169414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e76d0a78-ae68-412d-95e7-b529e431d748 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:10.170210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e76d0a78-ae68-412d-95e7-b529e431d748 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:10.170942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e76d0a78-ae68-412d-95e7-b529e431d748 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:10.171777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e76d0a78-ae68-412d-95e7-b529e431d748 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:10.175182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e76d0a78-ae68-412d-95e7-b529e431d748 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:10.175709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e76d0a78-ae68-412d-95e7-b529e431d748 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:10.360957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e76d0a78-ae68-412d-95e7-b529e431d748 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:10.375858 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e76d0a78-ae68-412d-95e7-b529e431d748 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 0.221155 Oct 11 19:50:10.379481 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1078/2083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:10 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:10.470447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1063948164", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "7111e238-7f25-453d-97c3-4209c9f28f65"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:10.567550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] validate_networks() for [('7111e238-7f25-453d-97c3-4209c9f28f65', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:50:11.398121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:50:11.399460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:50:11.400492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:50:11.407589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:50:11.408688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:50:11.427398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:11.429043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:11.430470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:11.431648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:11.432409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:11.433621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:11.468679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Getting quotas for project 720def5330eb4ea192335c6a4d9d2884. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:50:11.476035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Getting quotas for user 54b2ce29886e4de8a2e40c970378284a and project 720def5330eb4ea192335c6a4d9d2884. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:50:11.495371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:50:11.503936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:50:11.594651 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-63291984-fdc2-4124-a8cd-c252dbd1af58 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.211403 Oct 11 19:50:11.612828 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1079/2084] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:50:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:50:11.635436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fc18909c-dae9-4ed3-9ead-9eebd21f809a tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Calling method '.version_select at 0x7f83d06c1310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:11.796778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-fc18909c-dae9-4ed3-9ead-9eebd21f809a tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7aca8771-057a-4a55-af53-5c2f70008410 could not be found", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:50:11.797594 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-fc18909c-dae9-4ed3-9ead-9eebd21f809a tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] HTTP exception thrown: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fc18909c-dae9-4ed3-9ead-9eebd21f809a tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Request method failure captured: Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-floating-ips/7aca8771-057a-4a55-af53-5c2f70008410 HTTP/1.1 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjg1gyEspSN7BpMeEr2F7aJW3aQTHl4H7uVPBEeykE2FsxTD7xAj3wgUq2E4dmQL54O9AB_MpnuidkdMfgmJgxP7PtvEUZ3peTf-raKFZstlcQnEtCL07RYVKm-62YbCaiKau3Rv3l3UIYSLWts0bDdPSURlwO9Tg0_Gi1RdBspphc Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bb96be08455a4eecaa66190de1abf5a2 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-FloatingIPsTestJSON-1031912720 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb96be08455a4eecaa66190de1abf5a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb96be08455a4eecaa66190de1abf5a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb96be08455a4eecaa66190de1abf5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb96be08455a4eecaa66190de1abf5a2"}]}] Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-FloatingIPsTestJSON-1031912720 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bb96be08455a4eecaa66190de1abf5a2 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1031912720 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-FloatingIPsTestJSON-1031912720-project Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: a38adb6e5f564343b55cf054eaaa1e71 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-FloatingIPsTestJSON-1031912720-project Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: exception: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '7aca8771-057a-4a55-af53-5c2f70008410'} Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7aca8771-057a-4a55-af53-5c2f70008410 could not be found Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b060a6ae-11fe-4fb3-81f1-c640f6915b80'] Oct 11 19:50:11.800871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410. Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410 Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410 Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fc18909c-dae9-4ed3-9ead-9eebd21f809a tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Returning 404 to user: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410 {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:50:11.808672 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fc18909c-dae9-4ed3-9ead-9eebd21f809a tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/7aca8771-057a-4a55-af53-5c2f70008410" status: 404 len: 111 microversion: 2.1 time: 0.191700 Oct 11 19:50:11.812801 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1080/2085] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:50:11 2022] GET /compute/v2.1/os-floating-ips/7aca8771-057a-4a55-af53-5c2f70008410 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:50:11.826780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b7617a6-44b9-48eb-8ade-b3d428baf1a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:11.834265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b7617a6-44b9-48eb-8ade-b3d428baf1a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:11.852734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7617a6-44b9-48eb-8ade-b3d428baf1a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:11.859263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7617a6-44b9-48eb-8ade-b3d428baf1a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:11.859946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7617a6-44b9-48eb-8ade-b3d428baf1a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:11.862797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7617a6-44b9-48eb-8ade-b3d428baf1a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:11.869905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7617a6-44b9-48eb-8ade-b3d428baf1a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:11.874022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7617a6-44b9-48eb-8ade-b3d428baf1a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:12.305712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b7617a6-44b9-48eb-8ade-b3d428baf1a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:12.324843 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b7617a6-44b9-48eb-8ade-b3d428baf1a1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 0.508996 Oct 11 19:50:12.326074 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1081/2086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:11 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:12.355054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1157665052", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "7111e238-7f25-453d-97c3-4209c9f28f65"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:12.533404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] validate_networks() for [('7111e238-7f25-453d-97c3-4209c9f28f65', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:50:12.812306 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7a416427-1d94-4b97-8d99-502188c5ba2c tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036/action" status: 202 len: 0 microversion: 2.25 time: 5.676099 Oct 11 19:50:12.813656 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1006/2087] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:50:07 2022] POST /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036/action => generated 0 bytes in 5679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:50:12.820113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec1245a7-6a70-4f29-8032-06ac03a0a627 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Calling method '.version_select at 0x7f83cc19ddc0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:13.018385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-ec1245a7-6a70-4f29-8032-06ac03a0a627 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7aca8771-057a-4a55-af53-5c2f70008410 could not be found", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:50:13.019405 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-ec1245a7-6a70-4f29-8032-06ac03a0a627 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] HTTP exception thrown: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec1245a7-6a70-4f29-8032-06ac03a0a627 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Request method failure captured: Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-floating-ips/7aca8771-057a-4a55-af53-5c2f70008410 HTTP/1.1 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcjg1gyEspSN7BpMeEr2F7aJW3aQTHl4H7uVPBEeykE2FsxTD7xAj3wgUq2E4dmQL54O9AB_MpnuidkdMfgmJgxP7PtvEUZ3peTf-raKFZstlcQnEtCL07RYVKm-62YbCaiKau3Rv3l3UIYSLWts0bDdPSURlwO9Tg0_Gi1RdBspphc Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bb96be08455a4eecaa66190de1abf5a2 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FloatingIPsTestJSON-1031912720 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb96be08455a4eecaa66190de1abf5a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb96be08455a4eecaa66190de1abf5a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb96be08455a4eecaa66190de1abf5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb96be08455a4eecaa66190de1abf5a2"}]}] Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FloatingIPsTestJSON-1031912720 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bb96be08455a4eecaa66190de1abf5a2 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1031912720 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FloatingIPsTestJSON-1031912720-project Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a38adb6e5f564343b55cf054eaaa1e71 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FloatingIPsTestJSON-1031912720-project Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: exception: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '7aca8771-057a-4a55-af53-5c2f70008410'} Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7aca8771-057a-4a55-af53-5c2f70008410 could not be found Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fd312d5-fb6e-4584-8309-6dbc36af25d1'] Oct 11 19:50:13.021713 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410. Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410 Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410 Oct 11 19:50:13.028943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:13.035491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec1245a7-6a70-4f29-8032-06ac03a0a627 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] Returning 404 to user: Floating IP not found for ID 7aca8771-057a-4a55-af53-5c2f70008410 {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:50:13.035491 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ec1245a7-6a70-4f29-8032-06ac03a0a627 tempest-FloatingIPsTestJSON-1031912720 tempest-FloatingIPsTestJSON-1031912720-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/7aca8771-057a-4a55-af53-5c2f70008410" status: 404 len: 111 microversion: 2.1 time: 0.219210 Oct 11 19:50:13.036827 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1007/2088] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:50:12 2022] DELETE /compute/v2.1/os-floating-ips/7aca8771-057a-4a55-af53-5c2f70008410 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:50:13.213708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c3d81778-66bf-4003-befa-5b6fcef8a010 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'create', calling method: .version_select at 0x7f83cc1e7940>, body: {"keypair": {"name": "tempest-keypair-1095256113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8hpLd+kFKNfKKxKUtl2uJaCTbwKtmx87oHBLy/DLx+TaB1Ldv8MwOiziMoyxuNVUpO5quHMBPE/L6+qSiRxfU1iGBjY+57rqrAfcRNr52tAaGKUvwJR0F+BJEK9FV9Ag=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:13.270788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c3d81778-66bf-4003-befa-5b6fcef8a010 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Getting quotas for project 59971595644041418ea11fd1d795f42c. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:50:13.295247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c3d81778-66bf-4003-befa-5b6fcef8a010 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Getting quotas for user bc6a1d30f20048159afd27eefdc831f9 and project 59971595644041418ea11fd1d795f42c. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:50:13.388538 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c3d81778-66bf-4003-befa-5b6fcef8a010 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.350321 Oct 11 19:50:13.389170 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1008/2089] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:50:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:13.402494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:13.405875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:13.421888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:13.422777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:13.425700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:13.426808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:13.427646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:13.429700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:14.264762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:14.274924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:14.280422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:14.283861 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e97e8a8d-f30a-40a7-923c-2c929082987f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.893311 Oct 11 19:50:14.293299 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1009/2090] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:13 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:14.303981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-563bd9f2-040a-46fc-93e3-a392c3915327 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:14.306929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-563bd9f2-040a-46fc-93e3-a392c3915327 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:14.332830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-563bd9f2-040a-46fc-93e3-a392c3915327 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:14.336051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-563bd9f2-040a-46fc-93e3-a392c3915327 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:14.342104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-563bd9f2-040a-46fc-93e3-a392c3915327 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:14.343287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-563bd9f2-040a-46fc-93e3-a392c3915327 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:14.344009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-563bd9f2-040a-46fc-93e3-a392c3915327 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:14.344758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-563bd9f2-040a-46fc-93e3-a392c3915327 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:14.715543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:50:14.716027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:50:14.716547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:50:14.717035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:50:14.717520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:50:14.743562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:14.745138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:14.747849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:14.748930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:14.749622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:14.751294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:14.805180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Getting quotas for project 720def5330eb4ea192335c6a4d9d2884. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:50:14.812379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Getting quotas for user 54b2ce29886e4de8a2e40c970378284a and project 720def5330eb4ea192335c6a4d9d2884. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:50:14.852179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:50:14.854536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:50:14.949125 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-49500528-790a-4c23-a2fb-a50c602f108b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.612284 Oct 11 19:50:14.953499 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1082/2091] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:50:15.057281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1685757453", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "451", "networks": [{"uuid": "7111e238-7f25-453d-97c3-4209c9f28f65"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:15.157320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] validate_networks() for [('7111e238-7f25-453d-97c3-4209c9f28f65', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:50:15.585487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-563bd9f2-040a-46fc-93e3-a392c3915327 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:15.597143 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-563bd9f2-040a-46fc-93e3-a392c3915327 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 1.300361 Oct 11 19:50:15.611959 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1010/2092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:14 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:15.631488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:15.633056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:15.651480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:15.652209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:15.661260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:15.662157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:15.662679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:15.663968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:17.435509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:17.452876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:17.454437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:17.456597 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-df0b8441-a1b7-4a35-aa74-c0115ddac64e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 1.842280 Oct 11 19:50:17.457546 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1011/2093] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:15 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:17.462862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2adabd02-4ebf-4b1b-94d2-d57a0e3604dc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:17.463469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2adabd02-4ebf-4b1b-94d2-d57a0e3604dc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:17.472833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2adabd02-4ebf-4b1b-94d2-d57a0e3604dc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:17.474844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2adabd02-4ebf-4b1b-94d2-d57a0e3604dc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:17.475515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2adabd02-4ebf-4b1b-94d2-d57a0e3604dc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:17.476422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2adabd02-4ebf-4b1b-94d2-d57a0e3604dc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:17.477188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2adabd02-4ebf-4b1b-94d2-d57a0e3604dc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:17.477795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2adabd02-4ebf-4b1b-94d2-d57a0e3604dc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:18.632359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:50:18.632907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:50:18.633258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:50:18.636179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:50:18.636726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:50:18.640807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:18.683750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:18.697495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:18.698091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:18.699220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:18.699691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:18.707625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:18.742166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2adabd02-4ebf-4b1b-94d2-d57a0e3604dc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:18.758067 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2adabd02-4ebf-4b1b-94d2-d57a0e3604dc tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 1.299312 Oct 11 19:50:18.765875 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1012/2094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:17 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:18.775821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:18.794387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:18.802966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Getting quotas for project 720def5330eb4ea192335c6a4d9d2884. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:50:18.806353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:18.811537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:18.812136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:18.814649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:18.815855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:18.817713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:18.819976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:18.828456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Getting quotas for user 54b2ce29886e4de8a2e40c970378284a and project 720def5330eb4ea192335c6a4d9d2884. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:50:18.867241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:50:18.874416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:50:18.880400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:19.063794 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fb9cdf14-f0eb-4b14-a140-0233e303df84 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.012483 Oct 11 19:50:19.066053 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1083/2095] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:50:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 19:50:19.089425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-81da9f4e-ab7d-4ab2-95b3-38285d36f3b5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:19.090115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-81da9f4e-ab7d-4ab2-95b3-38285d36f3b5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:19.701049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-81da9f4e-ab7d-4ab2-95b3-38285d36f3b5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:19.715473 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-81da9f4e-ab7d-4ab2-95b3-38285d36f3b5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1221 microversion: 2.1 time: 0.632081 Oct 11 19:50:19.716081 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1084/2096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:19 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1221 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:50:19.796084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3f826905-6df7-4ef9-a257-d088e8d15f33 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:19.797663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3f826905-6df7-4ef9-a257-d088e8d15f33 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:19.811654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f826905-6df7-4ef9-a257-d088e8d15f33 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:19.812234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f826905-6df7-4ef9-a257-d088e8d15f33 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:19.812730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f826905-6df7-4ef9-a257-d088e8d15f33 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:19.824837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f826905-6df7-4ef9-a257-d088e8d15f33 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:19.825024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f826905-6df7-4ef9-a257-d088e8d15f33 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:19.830602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f826905-6df7-4ef9-a257-d088e8d15f33 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:20.114771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:20.130184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:20.133232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:20.135144 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d48ad07b-56dd-4408-8826-412db9293e33 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 1.367476 Oct 11 19:50:20.137724 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1013/2097] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:18 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:20.348240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-271b767e-75e7-40a3-9137-e7c2035f139f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Action: 'create', calling method: .version_select at 0x7f83cc0f40d0>, body: {"keypair": {"name": "tempest-keypair-1994430814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5ENl80x4m8Dd43ITmxs4ZqEJgRfCufFqrhiqkKqlBGBC7tFYUYagDUErOFVmcUS9WKK6kVnNDzeYVjP9/GkZqhazPbEAsKvhD6+uvzPqvXLHahk8dbgoYUKEN/c3QfMg=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:20.386738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-271b767e-75e7-40a3-9137-e7c2035f139f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Getting quotas for project 104b4ee892e441b79f520b0591ec0e33. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:50:20.402717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-271b767e-75e7-40a3-9137-e7c2035f139f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Getting quotas for user f34a23ce45c8419693d5fb67010548ad and project 104b4ee892e441b79f520b0591ec0e33. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:50:20.455686 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-271b767e-75e7-40a3-9137-e7c2035f139f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.315599 Oct 11 19:50:20.460741 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1014/2098] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:50:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:20.745923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2d52d482-bc22-4035-9817-5acda638d784 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:20.747107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2d52d482-bc22-4035-9817-5acda638d784 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:20.757368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d52d482-bc22-4035-9817-5acda638d784 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:20.757862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d52d482-bc22-4035-9817-5acda638d784 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:20.766484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d52d482-bc22-4035-9817-5acda638d784 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:20.767303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d52d482-bc22-4035-9817-5acda638d784 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:20.767814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d52d482-bc22-4035-9817-5acda638d784 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:20.768200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d52d482-bc22-4035-9817-5acda638d784 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:21.091497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2d52d482-bc22-4035-9817-5acda638d784 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:21.105187 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2d52d482-bc22-4035-9817-5acda638d784 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1273 microversion: 2.1 time: 0.362753 Oct 11 19:50:21.107100 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1015/2099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:20 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1273 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:50:21.144873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3f826905-6df7-4ef9-a257-d088e8d15f33 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:21.156747 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3f826905-6df7-4ef9-a257-d088e8d15f33 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1510 microversion: 2.1 time: 1.367913 Oct 11 19:50:21.165612 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1085/2100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:19 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1510 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:21.181848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:21.184702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:21.193376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:21.194171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:21.195349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:21.196288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:21.196974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:21.197781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:22.130183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1f69198d-47f9-4433-8705-8828144168eb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:22.131178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1f69198d-47f9-4433-8705-8828144168eb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:22.146314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f69198d-47f9-4433-8705-8828144168eb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:22.147060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f69198d-47f9-4433-8705-8828144168eb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:22.147332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f69198d-47f9-4433-8705-8828144168eb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:22.148038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f69198d-47f9-4433-8705-8828144168eb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:22.148492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f69198d-47f9-4433-8705-8828144168eb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:22.148924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f69198d-47f9-4433-8705-8828144168eb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:22.153770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:22.166070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:22.169046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:22.171418 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2088bc31-e8a4-4461-878d-f31618eb3c04 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 1.012825 Oct 11 19:50:22.172885 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1016/2101] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:21 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:50:22.174085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:22.195188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f81ea2a8-7ead-4ddd-b226-0338d6546e3b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:22.195899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f81ea2a8-7ead-4ddd-b226-0338d6546e3b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:22.219712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f81ea2a8-7ead-4ddd-b226-0338d6546e3b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:22.228212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f81ea2a8-7ead-4ddd-b226-0338d6546e3b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:22.231345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f81ea2a8-7ead-4ddd-b226-0338d6546e3b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:22.232207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f81ea2a8-7ead-4ddd-b226-0338d6546e3b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:22.235132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f81ea2a8-7ead-4ddd-b226-0338d6546e3b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:22.235661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f81ea2a8-7ead-4ddd-b226-0338d6546e3b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:22.944264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1f69198d-47f9-4433-8705-8828144168eb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:22.959538 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1f69198d-47f9-4433-8705-8828144168eb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1279 microversion: 2.1 time: 0.833546 Oct 11 19:50:22.960468 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1086/2102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:22 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1279 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:22.965704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ef02334c-5f50-4443-b931-a99dd30b8120 req-5caa3f91-0c23-42d1-b6d9-ede4c249cc9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9376e6e3-23d1-417c-893e-ac22dca17f02", "tag": "e11263d0-918d-4e50-b5fe-518c79ec4c73"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:22.990909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ef02334c-5f50-4443-b931-a99dd30b8120 req-5caa3f91-0c23-42d1-b6d9-ede4c249cc9f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:22.991436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ef02334c-5f50-4443-b931-a99dd30b8120 req-5caa3f91-0c23-42d1-b6d9-ede4c249cc9f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:22.991900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ef02334c-5f50-4443-b931-a99dd30b8120 req-5caa3f91-0c23-42d1-b6d9-ede4c249cc9f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:23.012355 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ef02334c-5f50-4443-b931-a99dd30b8120 req-5caa3f91-0c23-42d1-b6d9-ede4c249cc9f service nova] Creating event network-changed:e11263d0-918d-4e50-b5fe-518c79ec4c73 for instance 9376e6e3-23d1-417c-893e-ac22dca17f02 on n-h1-860864-3 Oct 11 19:50:23.025743 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ef02334c-5f50-4443-b931-a99dd30b8120 req-5caa3f91-0c23-42d1-b6d9-ede4c249cc9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063978 Oct 11 19:50:23.027181 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1087/2103] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:23.205209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:23.205915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:23.218799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:23.219274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:23.219793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:23.220529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:23.220970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:23.221392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:23.403336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f81ea2a8-7ead-4ddd-b226-0338d6546e3b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:23.415305 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f81ea2a8-7ead-4ddd-b226-0338d6546e3b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1487 microversion: 2.1 time: 1.227619 Oct 11 19:50:23.417496 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1017/2104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:22 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1487 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:23.440213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ad20fade-1685-4eee-887b-38046e2292fa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:23.440721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ad20fade-1685-4eee-887b-38046e2292fa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:23.451875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad20fade-1685-4eee-887b-38046e2292fa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:23.452376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad20fade-1685-4eee-887b-38046e2292fa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:23.452863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad20fade-1685-4eee-887b-38046e2292fa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:23.459192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad20fade-1685-4eee-887b-38046e2292fa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:23.459727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad20fade-1685-4eee-887b-38046e2292fa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:23.460187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad20fade-1685-4eee-887b-38046e2292fa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:23.527503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ad20fade-1685-4eee-887b-38046e2292fa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:50:23.776980 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ad20fade-1685-4eee-887b-38046e2292fa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 204 len: 0 microversion: 2.1 time: 0.340090 Oct 11 19:50:23.778276 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1018/2105] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:50:23 2022] DELETE /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:50:23.788919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7fa0861f-98eb-4d8a-97be-221dfea9ddb2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:23.791272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7fa0861f-98eb-4d8a-97be-221dfea9ddb2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:23.803816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fa0861f-98eb-4d8a-97be-221dfea9ddb2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:23.809899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fa0861f-98eb-4d8a-97be-221dfea9ddb2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:23.810613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fa0861f-98eb-4d8a-97be-221dfea9ddb2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:23.813274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fa0861f-98eb-4d8a-97be-221dfea9ddb2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:23.814822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fa0861f-98eb-4d8a-97be-221dfea9ddb2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:23.816850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fa0861f-98eb-4d8a-97be-221dfea9ddb2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:25.519163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:25.549299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:25.554987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:25.556619 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6520f418-dfad-4011-a893-2a1bd850b517 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 2.357124 Oct 11 19:50:25.559297 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1088/2106] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:23 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:50:25.566237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bfcb9cde-306b-40b0-8656-acace15d8e42 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:25.571010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bfcb9cde-306b-40b0-8656-acace15d8e42 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:25.593889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfcb9cde-306b-40b0-8656-acace15d8e42 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:25.594553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfcb9cde-306b-40b0-8656-acace15d8e42 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:25.596686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfcb9cde-306b-40b0-8656-acace15d8e42 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:25.598799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfcb9cde-306b-40b0-8656-acace15d8e42 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:25.600548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfcb9cde-306b-40b0-8656-acace15d8e42 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:25.601146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfcb9cde-306b-40b0-8656-acace15d8e42 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:25.965665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7fa0861f-98eb-4d8a-97be-221dfea9ddb2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:25.981478 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7fa0861f-98eb-4d8a-97be-221dfea9ddb2 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1493 microversion: 2.1 time: 2.193879 Oct 11 19:50:25.982506 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1019/2107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:23 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1493 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:50:25.987675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-86577ec3-b213-4e9c-96d8-92551d36433e tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:25.997811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-86577ec3-b213-4e9c-96d8-92551d36433e tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:26.016817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86577ec3-b213-4e9c-96d8-92551d36433e tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:26.017622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86577ec3-b213-4e9c-96d8-92551d36433e tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:26.018251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86577ec3-b213-4e9c-96d8-92551d36433e tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:26.023392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86577ec3-b213-4e9c-96d8-92551d36433e tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:26.024072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86577ec3-b213-4e9c-96d8-92551d36433e tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:26.024743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86577ec3-b213-4e9c-96d8-92551d36433e tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:26.113777 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-86577ec3-b213-4e9c-96d8-92551d36433e tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129903 Oct 11 19:50:26.114595 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1020/2108] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:50:25 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:26.129653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c85af737-6347-47d9-a83f-c206802baf15 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:26.141339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c85af737-6347-47d9-a83f-c206802baf15 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:26.149916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c85af737-6347-47d9-a83f-c206802baf15 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:26.150915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c85af737-6347-47d9-a83f-c206802baf15 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:26.151782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c85af737-6347-47d9-a83f-c206802baf15 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:26.152949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c85af737-6347-47d9-a83f-c206802baf15 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:26.153597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c85af737-6347-47d9-a83f-c206802baf15 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:26.154370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c85af737-6347-47d9-a83f-c206802baf15 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:26.352710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-c85af737-6347-47d9-a83f-c206802baf15 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lazy-loading 'services' on Instance uuid 21319341-f8a9-4972-88e3-13e7c5f6397d {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:50:26.517631 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c85af737-6347-47d9-a83f-c206802baf15 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "DELETE /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-volume_attachments/20ee5122-6e65-4cc1-85f0-85df216999ef" status: 202 len: 0 microversion: 2.1 time: 0.390308 Oct 11 19:50:26.522361 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1021/2109] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 19:50:26 2022] DELETE /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-volume_attachments/20ee5122-6e65-4cc1-85f0-85df216999ef => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:50:26.594656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:26.595695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:26.606902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:26.607709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:26.608453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:26.609428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:26.610123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:26.610894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:27.234442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:27.245434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:27.252113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:27.267478 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0841fde8-b7ff-485b-b44b-871a894a24ae tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.678363 Oct 11 19:50:27.269935 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1022/2110] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:26 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:50:27.277743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e456a243-6f52-49b8-aae6-adbced1bf7e6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:27.283052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e456a243-6f52-49b8-aae6-adbced1bf7e6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:27.311914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e456a243-6f52-49b8-aae6-adbced1bf7e6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:27.311914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e456a243-6f52-49b8-aae6-adbced1bf7e6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:27.312154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e456a243-6f52-49b8-aae6-adbced1bf7e6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:27.312891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e456a243-6f52-49b8-aae6-adbced1bf7e6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:27.313540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e456a243-6f52-49b8-aae6-adbced1bf7e6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:27.315084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e456a243-6f52-49b8-aae6-adbced1bf7e6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:27.357118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bfcb9cde-306b-40b0-8656-acace15d8e42 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:27.371558 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bfcb9cde-306b-40b0-8656-acace15d8e42 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1321 microversion: 2.1 time: 1.810753 Oct 11 19:50:27.374674 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1089/2111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:25 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1321 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:27.380836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1464469719", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7591add0-fdf6-4241-8d33-bc1dba02813a"}], "security_groups": [{"name": "tempest-securitygroup--570206719"}], "key_name": "tempest-keypair-1095256113", "user_data": "}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:27.750776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e456a243-6f52-49b8-aae6-adbced1bf7e6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:27.767706 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e456a243-6f52-49b8-aae6-adbced1bf7e6 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 200 len: 1493 microversion: 2.1 time: 0.496181 Oct 11 19:50:27.769364 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1023/2112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:27 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 1493 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:27.779529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1288321402", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "dee5511c-417e-4642-a694-e2dd7950486d"}], "security_groups": [{"name": "tempest-securitygroup--453780221"}], "key_name": "tempest-keypair-1994430814", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:27.785074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] validate_networks() for [('7591add0-fdf6-4241-8d33-bc1dba02813a', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:50:28.400571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] validate_networks() for [('dee5511c-417e-4642-a694-e2dd7950486d', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:50:28.735018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:29.706091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=20 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:30.260821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:50:30.262081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:50:30.262781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:50:30.263860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:50:30.264579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:50:30.286045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:30.287005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:30.288647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:30.292246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:30.293929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:30.294581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:30.343905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Getting quotas for project 59971595644041418ea11fd1d795f42c. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:50:30.352285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Getting quotas for user bc6a1d30f20048159afd27eefdc831f9 and project 59971595644041418ea11fd1d795f42c. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:50:30.370137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:50:30.373141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:50:30.420686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:30.442273 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6fe0ce77-16a3-4cfc-a3aa-b2629215aaa4 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.065946 Oct 11 19:50:30.443634 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1090/2113] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:50:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 3068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:50:30.454645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-bd5d66f9-8da0-4313-9dab-332e3757864d req-dbb847c2-7797-44ed-8626-b75ca105f35b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212824a5-4bd2-47b3-a64d-b428e088010e", "tag": "45b409e8-26ed-4842-8e68-cbdf94bd1ffb"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:30.485256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bd5d66f9-8da0-4313-9dab-332e3757864d req-dbb847c2-7797-44ed-8626-b75ca105f35b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:30.486049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bd5d66f9-8da0-4313-9dab-332e3757864d req-dbb847c2-7797-44ed-8626-b75ca105f35b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:30.490004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bd5d66f9-8da0-4313-9dab-332e3757864d req-dbb847c2-7797-44ed-8626-b75ca105f35b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:30.515355 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bd5d66f9-8da0-4313-9dab-332e3757864d req-dbb847c2-7797-44ed-8626-b75ca105f35b service nova] Creating event network-changed:45b409e8-26ed-4842-8e68-cbdf94bd1ffb for instance 212824a5-4bd2-47b3-a64d-b428e088010e on n-h2-860864-3 Oct 11 19:50:30.523697 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-bd5d66f9-8da0-4313-9dab-332e3757864d req-dbb847c2-7797-44ed-8626-b75ca105f35b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078550 Oct 11 19:50:30.528050 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1091/2114] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:30.542568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:30.544914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:30.561533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:30.564489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:30.565172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:30.566115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:30.566873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:30.570261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:30.659221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:50:30.660424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:50:30.660915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:50:30.661390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:50:30.661960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:50:30.685923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:30.686443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:30.686919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:30.687695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:30.688235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:30.688558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:30.741733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Getting quotas for project 104b4ee892e441b79f520b0591ec0e33. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:50:30.754486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Getting quotas for user f34a23ce45c8419693d5fb67010548ad and project 104b4ee892e441b79f520b0591ec0e33. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:50:30.787780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:50:30.794165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:50:30.918067 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f8c377b7-a764-47f7-8bd3-dcc22f7616e1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.144087 Oct 11 19:50:30.919499 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1024/2115] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:50:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 3149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:50:30.934087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e87df00-f4d7-44f9-8ca7-e0c824a66fa4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:30.936312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7e87df00-f4d7-44f9-8ca7-e0c824a66fa4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:30.955026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e87df00-f4d7-44f9-8ca7-e0c824a66fa4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:30.955631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e87df00-f4d7-44f9-8ca7-e0c824a66fa4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:30.957679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e87df00-f4d7-44f9-8ca7-e0c824a66fa4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:30.961329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e87df00-f4d7-44f9-8ca7-e0c824a66fa4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:30.962358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e87df00-f4d7-44f9-8ca7-e0c824a66fa4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:30.962931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e87df00-f4d7-44f9-8ca7-e0c824a66fa4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:31.232786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:31.269660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:31.277134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:31.283419 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-65ebcccc-98e8-400e-ac41-09bcb1be8eca tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.749496 Oct 11 19:50:31.285312 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1092/2116] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:30 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:31.329322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9e20d966-4316-4052-b498-969a9374b87c req-5351041d-3298-4c17-af8e-4c1eb6edb71f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62427f88-7209-4cca-b0d0-417db41dae91", "tag": "f990d77f-6e62-4992-8620-d4a2ed2e5780"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:31.360773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9e20d966-4316-4052-b498-969a9374b87c req-5351041d-3298-4c17-af8e-4c1eb6edb71f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:31.361274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9e20d966-4316-4052-b498-969a9374b87c req-5351041d-3298-4c17-af8e-4c1eb6edb71f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:31.361711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9e20d966-4316-4052-b498-969a9374b87c req-5351041d-3298-4c17-af8e-4c1eb6edb71f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:31.402817 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9e20d966-4316-4052-b498-969a9374b87c req-5351041d-3298-4c17-af8e-4c1eb6edb71f service nova] Creating event network-changed:f990d77f-6e62-4992-8620-d4a2ed2e5780 for instance 62427f88-7209-4cca-b0d0-417db41dae91 on n-h1-860864-3 Oct 11 19:50:31.419288 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9e20d966-4316-4052-b498-969a9374b87c req-5351041d-3298-4c17-af8e-4c1eb6edb71f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109587 Oct 11 19:50:31.422130 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1093/2117] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:31.451856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:31.452992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:31.468031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:31.471065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:31.471800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:31.472779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:31.475697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:31.476382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:31.544457 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 HTTP/1.1 Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'b6ec61a7-946a-464c-8c7b-179353b2bce7'} Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:31.546111 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:31.552911 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:31.552911 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:31.552911 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:31.552911 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:50:31.552911 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:50:31.552911 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:50:31.552911 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:50:31.554743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:50:31.555654 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc324f15-f558-4151-8887-b67ba62ea09e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 404 len: 111 microversion: 2.1 time: 0.118604 Oct 11 19:50:31.577507 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1094/2118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:31 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:50:31.591441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d7662d49-91de-46b0-84cb-150dcf5750c3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:31.592085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d7662d49-91de-46b0-84cb-150dcf5750c3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:31.612146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7662d49-91de-46b0-84cb-150dcf5750c3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:31.613372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7662d49-91de-46b0-84cb-150dcf5750c3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:31.614280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7662d49-91de-46b0-84cb-150dcf5750c3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:31.618834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7662d49-91de-46b0-84cb-150dcf5750c3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:31.621254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7662d49-91de-46b0-84cb-150dcf5750c3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:31.623075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7662d49-91de-46b0-84cb-150dcf5750c3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:31.647179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7e87df00-f4d7-44f9-8ca7-e0c824a66fa4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:31.662714 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e87df00-f4d7-44f9-8ca7-e0c824a66fa4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1321 microversion: 2.1 time: 0.739665 Oct 11 19:50:31.675399 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1025/2119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:30 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:31.693996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8c2f8c66-ee8e-4b98-ba6a-44daab2e2ff8 req-00c5355f-0300-491f-bb8c-691e3df748fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9376e6e3-23d1-417c-893e-ac22dca17f02", "name": "network-vif-plugged", "status": "completed", "tag": "e11263d0-918d-4e50-b5fe-518c79ec4c73"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:31.723764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8c2f8c66-ee8e-4b98-ba6a-44daab2e2ff8 req-00c5355f-0300-491f-bb8c-691e3df748fd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:31.725896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8c2f8c66-ee8e-4b98-ba6a-44daab2e2ff8 req-00c5355f-0300-491f-bb8c-691e3df748fd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:31.726356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8c2f8c66-ee8e-4b98-ba6a-44daab2e2ff8 req-00c5355f-0300-491f-bb8c-691e3df748fd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:31.777082 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8c2f8c66-ee8e-4b98-ba6a-44daab2e2ff8 req-00c5355f-0300-491f-bb8c-691e3df748fd service nova] Creating event network-vif-plugged:e11263d0-918d-4e50-b5fe-518c79ec4c73 for instance 9376e6e3-23d1-417c-893e-ac22dca17f02 on n-h1-860864-3 Oct 11 19:50:31.795692 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8c2f8c66-ee8e-4b98-ba6a-44daab2e2ff8 req-00c5355f-0300-491f-bb8c-691e3df748fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114688 Oct 11 19:50:31.800917 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1026/2120] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:31.808329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5bec9fad-2d80-4035-9060-b571ed240cf2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:31.809202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5bec9fad-2d80-4035-9060-b571ed240cf2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:31.877665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d7662d49-91de-46b0-84cb-150dcf5750c3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:31.892459 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d7662d49-91de-46b0-84cb-150dcf5750c3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1242 microversion: 2.1 time: 0.313679 Oct 11 19:50:31.893803 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1095/2121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:31 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1242 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:31.912444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-456302011", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "50a85b7f-a8bb-479c-b121-72e05795de50"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:32.090578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] validate_networks() for [('50a85b7f-a8bb-479c-b121-72e05795de50', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:50:32.098859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5bec9fad-2d80-4035-9060-b571ed240cf2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:32.111142 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5bec9fad-2d80-4035-9060-b571ed240cf2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1242 microversion: 2.1 time: 0.307400 Oct 11 19:50:32.111826 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1027/2122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:31 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1242 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:32.318977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:32.319995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:32.345117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:32.349428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:32.355916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:32.357161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:32.357878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:32.360374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:33.117656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:33.129625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:33.135586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:33.138876 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8bc8b3ae-37c4-4fd7-85bf-c5e7fce40681 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.824032 Oct 11 19:50:33.145285 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1028/2123] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:32 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:33.157201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-060414c4-5fb0-48a7-ad06-a37d3e569073 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:33.158282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-060414c4-5fb0-48a7-ad06-a37d3e569073 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:33.171761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-060414c4-5fb0-48a7-ad06-a37d3e569073 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:33.179334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-060414c4-5fb0-48a7-ad06-a37d3e569073 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:33.180153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-060414c4-5fb0-48a7-ad06-a37d3e569073 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:33.183520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-060414c4-5fb0-48a7-ad06-a37d3e569073 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:33.184231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-060414c4-5fb0-48a7-ad06-a37d3e569073 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:33.184880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-060414c4-5fb0-48a7-ad06-a37d3e569073 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:33.802772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-060414c4-5fb0-48a7-ad06-a37d3e569073 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:33.819198 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-060414c4-5fb0-48a7-ad06-a37d3e569073 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1321 microversion: 2.1 time: 0.672135 Oct 11 19:50:33.824125 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1029/2124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:33 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:33.845042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-2986814a-6e72-4ec1-8b77-3d23ec2bae88 req-0bbcb173-a927-4685-a96d-d640d10792bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ec61a7-946a-464c-8c7b-179353b2bce7", "name": "network-vif-deleted", "tag": "2cc87b3c-09de-4035-a04d-aded17bae470"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:33.886761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2986814a-6e72-4ec1-8b77-3d23ec2bae88 req-0bbcb173-a927-4685-a96d-d640d10792bb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:33.889205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2986814a-6e72-4ec1-8b77-3d23ec2bae88 req-0bbcb173-a927-4685-a96d-d640d10792bb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:33.890956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2986814a-6e72-4ec1-8b77-3d23ec2bae88 req-0bbcb173-a927-4685-a96d-d640d10792bb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:33.921760 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2986814a-6e72-4ec1-8b77-3d23ec2bae88 req-0bbcb173-a927-4685-a96d-d640d10792bb service nova] Creating event network-vif-deleted:2cc87b3c-09de-4035-a04d-aded17bae470 for instance b6ec61a7-946a-464c-8c7b-179353b2bce7 on n-h2-860864-3 Oct 11 19:50:33.933661 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-2986814a-6e72-4ec1-8b77-3d23ec2bae88 req-0bbcb173-a927-4685-a96d-d640d10792bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102842 Oct 11 19:50:33.936969 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1030/2125] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:33.949282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2840c3d-22cc-4281-b6a1-2e24830d22f6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:33.951190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d2840c3d-22cc-4281-b6a1-2e24830d22f6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:33.971398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2840c3d-22cc-4281-b6a1-2e24830d22f6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:33.972418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2840c3d-22cc-4281-b6a1-2e24830d22f6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:33.975229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2840c3d-22cc-4281-b6a1-2e24830d22f6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:33.978415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2840c3d-22cc-4281-b6a1-2e24830d22f6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:33.979653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2840c3d-22cc-4281-b6a1-2e24830d22f6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:33.980334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2840c3d-22cc-4281-b6a1-2e24830d22f6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:34.757509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d2840c3d-22cc-4281-b6a1-2e24830d22f6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:34.771792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:34.777144 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d2840c3d-22cc-4281-b6a1-2e24830d22f6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1296 microversion: 2.1 time: 0.836938 Oct 11 19:50:34.778664 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1031/2126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:33 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1296 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:34.806116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-227c99da-b70f-4c78-8eff-8bcf6ea52fb1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:34.809379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-227c99da-b70f-4c78-8eff-8bcf6ea52fb1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:34.834952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-227c99da-b70f-4c78-8eff-8bcf6ea52fb1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:34.836951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-227c99da-b70f-4c78-8eff-8bcf6ea52fb1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:34.838754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-227c99da-b70f-4c78-8eff-8bcf6ea52fb1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:34.844251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-227c99da-b70f-4c78-8eff-8bcf6ea52fb1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:34.845004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-227c99da-b70f-4c78-8eff-8bcf6ea52fb1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:34.845738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-227c99da-b70f-4c78-8eff-8bcf6ea52fb1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:34.876351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:50:34.877642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:50:34.878873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:50:34.879497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:50:34.880171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:50:34.918343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:34.925815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:34.931828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:34.933045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:34.938604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:34.942939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.043433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:50:35.053562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Getting quotas for user 8494488a13a3496eb59a8062479816bc and project be070f1da3c0467daf15d6b120df125e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:50:35.092452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:50:35.095050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-227c99da-b70f-4c78-8eff-8bcf6ea52fb1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:35.095466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:50:35.122941 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-227c99da-b70f-4c78-8eff-8bcf6ea52fb1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1300 microversion: 2.1 time: 0.342861 Oct 11 19:50:35.124445 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1032/2127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:34 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1300 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:35.130402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:35.131432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:35.140338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:35.141182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:35.142291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.143353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:35.144045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:35.146419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.196379 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9dc0905d-b953-416a-aba9-e75ff6f23024 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.301015 Oct 11 19:50:35.197986 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1096/2128] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:50:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:50:35.223295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6ca8d2e6-ab2e-4c5e-82ac-354d8c519ced req-273e4015-4022-4c12-83da-2aea7e76a9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62427f88-7209-4cca-b0d0-417db41dae91", "name": "network-vif-plugged", "status": "completed", "tag": "f990d77f-6e62-4992-8620-d4a2ed2e5780"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:35.240975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ca8d2e6-ab2e-4c5e-82ac-354d8c519ced req-273e4015-4022-4c12-83da-2aea7e76a9fc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:35.241566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ca8d2e6-ab2e-4c5e-82ac-354d8c519ced req-273e4015-4022-4c12-83da-2aea7e76a9fc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:35.242265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ca8d2e6-ab2e-4c5e-82ac-354d8c519ced req-273e4015-4022-4c12-83da-2aea7e76a9fc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.254313 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6ca8d2e6-ab2e-4c5e-82ac-354d8c519ced req-273e4015-4022-4c12-83da-2aea7e76a9fc service nova] Creating event network-vif-plugged:f990d77f-6e62-4992-8620-d4a2ed2e5780 for instance 62427f88-7209-4cca-b0d0-417db41dae91 on n-h1-860864-3 Oct 11 19:50:35.264625 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6ca8d2e6-ab2e-4c5e-82ac-354d8c519ced req-273e4015-4022-4c12-83da-2aea7e76a9fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059574 Oct 11 19:50:35.266135 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1097/2129] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:35.277342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bdeac2f9-b6b4-47b1-86c9-007634caecaf tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:35.278394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bdeac2f9-b6b4-47b1-86c9-007634caecaf tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:35.285786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdeac2f9-b6b4-47b1-86c9-007634caecaf tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:35.286861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdeac2f9-b6b4-47b1-86c9-007634caecaf tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:35.287537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdeac2f9-b6b4-47b1-86c9-007634caecaf tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.288564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdeac2f9-b6b4-47b1-86c9-007634caecaf tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:35.289237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdeac2f9-b6b4-47b1-86c9-007634caecaf tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:35.292499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdeac2f9-b6b4-47b1-86c9-007634caecaf tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.575444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:35.588950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:35.591771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:35.593753 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ff466908-72bb-4861-ad84-411ed6ae16c3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.467750 Oct 11 19:50:35.594637 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1033/2130] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:35 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:35.616301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c103622d-b19a-415e-ac49-b4df1bd7e9e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:35.617323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c103622d-b19a-415e-ac49-b4df1bd7e9e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:35.733128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c103622d-b19a-415e-ac49-b4df1bd7e9e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:35.741616 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c103622d-b19a-415e-ac49-b4df1bd7e9e8 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1214 microversion: 2.1 time: 0.137630 Oct 11 19:50:35.743202 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1034/2131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:35 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:35.768021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-92e8e35d-88f6-4c85-aafc-c7f25e4ac71a req-c6a6eff4-99ed-4434-b5ab-b22a0892cf3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd21bb0-f168-4a05-ad19-6b72415fc036", "name": "network-vif-unplugged", "status": "completed", "tag": "7c1948ab-cfd5-4292-93ea-b18935d2b086"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:35.782395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-92e8e35d-88f6-4c85-aafc-c7f25e4ac71a req-c6a6eff4-99ed-4434-b5ab-b22a0892cf3e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:35.783403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-92e8e35d-88f6-4c85-aafc-c7f25e4ac71a req-c6a6eff4-99ed-4434-b5ab-b22a0892cf3e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:35.784144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-92e8e35d-88f6-4c85-aafc-c7f25e4ac71a req-c6a6eff4-99ed-4434-b5ab-b22a0892cf3e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.801146 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-92e8e35d-88f6-4c85-aafc-c7f25e4ac71a req-c6a6eff4-99ed-4434-b5ab-b22a0892cf3e service nova] Creating event network-vif-unplugged:7c1948ab-cfd5-4292-93ea-b18935d2b086 for instance ebd21bb0-f168-4a05-ad19-6b72415fc036 on n-h2-860864-3 Oct 11 19:50:35.809967 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-92e8e35d-88f6-4c85-aafc-c7f25e4ac71a req-c6a6eff4-99ed-4434-b5ab-b22a0892cf3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065018 Oct 11 19:50:35.811262 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1035/2132] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:35.819188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cf959651-dde8-4dab-9e46-b57b6cefb0d4 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:35.822303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cf959651-dde8-4dab-9e46-b57b6cefb0d4 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:35.830916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf959651-dde8-4dab-9e46-b57b6cefb0d4 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:35.831676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf959651-dde8-4dab-9e46-b57b6cefb0d4 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:35.832523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf959651-dde8-4dab-9e46-b57b6cefb0d4 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.833455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf959651-dde8-4dab-9e46-b57b6cefb0d4 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:35.834121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf959651-dde8-4dab-9e46-b57b6cefb0d4 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:35.835587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf959651-dde8-4dab-9e46-b57b6cefb0d4 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.878420 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cf959651-dde8-4dab-9e46-b57b6cefb0d4 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064343 Oct 11 19:50:35.879718 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1036/2133] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:50:35 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:50:35.890257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2367c4f5-403a-4205-b6d3-acc801d63929 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:35.891224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2367c4f5-403a-4205-b6d3-acc801d63929 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:35.899293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2367c4f5-403a-4205-b6d3-acc801d63929 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:35.901201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2367c4f5-403a-4205-b6d3-acc801d63929 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:35.901960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2367c4f5-403a-4205-b6d3-acc801d63929 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.903093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2367c4f5-403a-4205-b6d3-acc801d63929 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:35.904163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2367c4f5-403a-4205-b6d3-acc801d63929 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:35.904812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2367c4f5-403a-4205-b6d3-acc801d63929 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:35.932901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bdeac2f9-b6b4-47b1-86c9-007634caecaf tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:35.949590 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bdeac2f9-b6b4-47b1-86c9-007634caecaf tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1321 microversion: 2.1 time: 0.679122 Oct 11 19:50:35.959535 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1098/2134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:35 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1321 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:35.990933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c9cae7de-c23a-49ca-b2cf-03af1e8a37e6 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:35.996919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c9cae7de-c23a-49ca-b2cf-03af1e8a37e6 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:36.004162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9cae7de-c23a-49ca-b2cf-03af1e8a37e6 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.005750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9cae7de-c23a-49ca-b2cf-03af1e8a37e6 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.006478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9cae7de-c23a-49ca-b2cf-03af1e8a37e6 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.007396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9cae7de-c23a-49ca-b2cf-03af1e8a37e6 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.008109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9cae7de-c23a-49ca-b2cf-03af1e8a37e6 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.008795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9cae7de-c23a-49ca-b2cf-03af1e8a37e6 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.049758 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c9cae7de-c23a-49ca-b2cf-03af1e8a37e6 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064710 Oct 11 19:50:36.057711 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1099/2135] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:50:35 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 19:50:36.119668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2367c4f5-403a-4205-b6d3-acc801d63929 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:36.129073 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2367c4f5-403a-4205-b6d3-acc801d63929 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1296 microversion: 2.1 time: 0.247680 Oct 11 19:50:36.136044 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1037/2136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:35 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1296 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:36.154843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6cacc0d9-6b0a-47b6-8806-87e2893c9c15 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:36.154843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6cacc0d9-6b0a-47b6-8806-87e2893c9c15 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:36.179327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cacc0d9-6b0a-47b6-8806-87e2893c9c15 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.179847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cacc0d9-6b0a-47b6-8806-87e2893c9c15 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.180295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cacc0d9-6b0a-47b6-8806-87e2893c9c15 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.181020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cacc0d9-6b0a-47b6-8806-87e2893c9c15 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.182058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cacc0d9-6b0a-47b6-8806-87e2893c9c15 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.186384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cacc0d9-6b0a-47b6-8806-87e2893c9c15 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.190798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f76a4269-7d93-4fd1-ad25-3f0e6dcac5f0 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:36.191308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f76a4269-7d93-4fd1-ad25-3f0e6dcac5f0 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:36.212551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76a4269-7d93-4fd1-ad25-3f0e6dcac5f0 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.213250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76a4269-7d93-4fd1-ad25-3f0e6dcac5f0 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.213700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76a4269-7d93-4fd1-ad25-3f0e6dcac5f0 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.214423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76a4269-7d93-4fd1-ad25-3f0e6dcac5f0 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.214913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76a4269-7d93-4fd1-ad25-3f0e6dcac5f0 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.215960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f76a4269-7d93-4fd1-ad25-3f0e6dcac5f0 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.275943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f76a4269-7d93-4fd1-ad25-3f0e6dcac5f0 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:50:36.302090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6cacc0d9-6b0a-47b6-8806-87e2893c9c15 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:36.315001 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6cacc0d9-6b0a-47b6-8806-87e2893c9c15 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1300 microversion: 2.1 time: 0.165983 Oct 11 19:50:36.315508 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1100/2137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:36 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:36.415026 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f76a4269-7d93-4fd1-ad25-3f0e6dcac5f0 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "DELETE /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 204 len: 0 microversion: 2.1 time: 0.226043 Oct 11 19:50:36.416416 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1038/2138] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:50:36 2022] DELETE /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:50:36.424574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e6fb42f-e566-4614-9221-22274cb5740d tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:36.425274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e6fb42f-e566-4614-9221-22274cb5740d tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:36.431596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e6fb42f-e566-4614-9221-22274cb5740d tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.432349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e6fb42f-e566-4614-9221-22274cb5740d tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.432793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e6fb42f-e566-4614-9221-22274cb5740d tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.433492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e6fb42f-e566-4614-9221-22274cb5740d tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.434123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e6fb42f-e566-4614-9221-22274cb5740d tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.434751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e6fb42f-e566-4614-9221-22274cb5740d tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.621709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:36.622512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:36.633590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.634211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.636255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.639754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.640477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.641116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.862623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e6fb42f-e566-4614-9221-22274cb5740d tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:36.878714 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e6fb42f-e566-4614-9221-22274cb5740d tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1681 microversion: 2.1 time: 0.457945 Oct 11 19:50:36.898597 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1101/2139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:36 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1681 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:36.904788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c798c8c-b409-415d-b738-3d68954643df tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:36.905397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c798c8c-b409-415d-b738-3d68954643df tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:36.929089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c798c8c-b409-415d-b738-3d68954643df tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.929846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c798c8c-b409-415d-b738-3d68954643df tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.930450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c798c8c-b409-415d-b738-3d68954643df tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:36.931883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c798c8c-b409-415d-b738-3d68954643df tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:36.932504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c798c8c-b409-415d-b738-3d68954643df tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:36.933172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c798c8c-b409-415d-b738-3d68954643df tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:37.131160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c798c8c-b409-415d-b738-3d68954643df tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:37.145095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:37.154397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:37.154727 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c798c8c-b409-415d-b738-3d68954643df tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1210 microversion: 2.1 time: 0.254303 Oct 11 19:50:37.155332 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1102/2140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:36 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1210 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:37.162134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae30e158-8fd2-4bc0-8f2e-a960ab6b53bc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:37.162794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ae30e158-8fd2-4bc0-8f2e-a960ab6b53bc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:37.179960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:37.187803 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f2fca41e-e822-4715-9080-bc6a0f1ae7ee tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.564461 Oct 11 19:50:37.190908 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1039/2141] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:36 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:50:37.191925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae30e158-8fd2-4bc0-8f2e-a960ab6b53bc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:37.193134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae30e158-8fd2-4bc0-8f2e-a960ab6b53bc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:37.195069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae30e158-8fd2-4bc0-8f2e-a960ab6b53bc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:37.196721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae30e158-8fd2-4bc0-8f2e-a960ab6b53bc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:37.199091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae30e158-8fd2-4bc0-8f2e-a960ab6b53bc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:37.201480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae30e158-8fd2-4bc0-8f2e-a960ab6b53bc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:37.202429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58919dc3-31a9-4d5d-93b1-e792fb82321d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:37.203275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58919dc3-31a9-4d5d-93b1-e792fb82321d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:37.216605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58919dc3-31a9-4d5d-93b1-e792fb82321d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:37.217102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58919dc3-31a9-4d5d-93b1-e792fb82321d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:37.217540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58919dc3-31a9-4d5d-93b1-e792fb82321d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:37.221434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58919dc3-31a9-4d5d-93b1-e792fb82321d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:37.222976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58919dc3-31a9-4d5d-93b1-e792fb82321d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:37.223621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58919dc3-31a9-4d5d-93b1-e792fb82321d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:37.809328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae30e158-8fd2-4bc0-8f2e-a960ab6b53bc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:37.824370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58919dc3-31a9-4d5d-93b1-e792fb82321d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:37.839744 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58919dc3-31a9-4d5d-93b1-e792fb82321d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1363 microversion: 2.1 time: 0.647463 Oct 11 19:50:37.841303 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1040/2142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:37 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1363 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:37.848213 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae30e158-8fd2-4bc0-8f2e-a960ab6b53bc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1321 microversion: 2.1 time: 0.689650 Oct 11 19:50:37.849988 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1103/2143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:37 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1321 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:37.864445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9a275fb5-20c0-4b53-a669-b0099a8eb24b tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:37.871854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9a275fb5-20c0-4b53-a669-b0099a8eb24b tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:37.872121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-2c5e6a21-39c0-42db-877f-90fbd3610619 req-d552a4ec-e2d6-4720-850b-d8ab51ace41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212824a5-4bd2-47b3-a64d-b428e088010e", "name": "network-vif-plugged", "status": "completed", "tag": "45b409e8-26ed-4842-8e68-cbdf94bd1ffb"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:37.889209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2c5e6a21-39c0-42db-877f-90fbd3610619 req-d552a4ec-e2d6-4720-850b-d8ab51ace41e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:37.890134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2c5e6a21-39c0-42db-877f-90fbd3610619 req-d552a4ec-e2d6-4720-850b-d8ab51ace41e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:37.891072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2c5e6a21-39c0-42db-877f-90fbd3610619 req-d552a4ec-e2d6-4720-850b-d8ab51ace41e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:37.902643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a275fb5-20c0-4b53-a669-b0099a8eb24b tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:37.903161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a275fb5-20c0-4b53-a669-b0099a8eb24b tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:37.903605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a275fb5-20c0-4b53-a669-b0099a8eb24b tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:37.908826 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2c5e6a21-39c0-42db-877f-90fbd3610619 req-d552a4ec-e2d6-4720-850b-d8ab51ace41e service nova] Creating event network-vif-plugged:45b409e8-26ed-4842-8e68-cbdf94bd1ffb for instance 212824a5-4bd2-47b3-a64d-b428e088010e on n-h2-860864-3 Oct 11 19:50:37.910634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a275fb5-20c0-4b53-a669-b0099a8eb24b tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:37.911594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a275fb5-20c0-4b53-a669-b0099a8eb24b tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:37.912578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a275fb5-20c0-4b53-a669-b0099a8eb24b tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:37.919522 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-2c5e6a21-39c0-42db-877f-90fbd3610619 req-d552a4ec-e2d6-4720-850b-d8ab51ace41e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073742 Oct 11 19:50:37.920965 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1041/2144] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:37.930398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7ae86a1d-6418-40a1-897b-6a70d7218c94 req-41e15355-1aa4-4b5d-bc5a-aa1e3a3c4c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebd21bb0-f168-4a05-ad19-6b72415fc036", "tag": "7c1948ab-cfd5-4292-93ea-b18935d2b086"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:37.951885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:37.973717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7ae86a1d-6418-40a1-897b-6a70d7218c94 req-41e15355-1aa4-4b5d-bc5a-aa1e3a3c4c81 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:37.975400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7ae86a1d-6418-40a1-897b-6a70d7218c94 req-41e15355-1aa4-4b5d-bc5a-aa1e3a3c4c81 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:37.976603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7ae86a1d-6418-40a1-897b-6a70d7218c94 req-41e15355-1aa4-4b5d-bc5a-aa1e3a3c4c81 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:38.016940 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7ae86a1d-6418-40a1-897b-6a70d7218c94 req-41e15355-1aa4-4b5d-bc5a-aa1e3a3c4c81 service nova] Creating event network-changed:7c1948ab-cfd5-4292-93ea-b18935d2b086 for instance ebd21bb0-f168-4a05-ad19-6b72415fc036 on n-h2-860864-3 Oct 11 19:50:38.024325 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7ae86a1d-6418-40a1-897b-6a70d7218c94 req-41e15355-1aa4-4b5d-bc5a-aa1e3a3c4c81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101432 Oct 11 19:50:38.026043 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1042/2145] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:38.032885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-626a213d-65ee-4745-9cbe-0867ebcd77fc tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:38.033950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-626a213d-65ee-4745-9cbe-0867ebcd77fc tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:38.046252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626a213d-65ee-4745-9cbe-0867ebcd77fc tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:38.047461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626a213d-65ee-4745-9cbe-0867ebcd77fc tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:38.048346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626a213d-65ee-4745-9cbe-0867ebcd77fc tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:38.049771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626a213d-65ee-4745-9cbe-0867ebcd77fc tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:38.050603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626a213d-65ee-4745-9cbe-0867ebcd77fc tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:38.051435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626a213d-65ee-4745-9cbe-0867ebcd77fc tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:38.593655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9a275fb5-20c0-4b53-a669-b0099a8eb24b tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:38.607002 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9a275fb5-20c0-4b53-a669-b0099a8eb24b tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1367 microversion: 2.1 time: 0.751386 Oct 11 19:50:38.608376 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1104/2146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:37 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1367 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:38.613931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-74e30258-f516-46e3-8345-41d4e0911615 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:38.614805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-74e30258-f516-46e3-8345-41d4e0911615 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:38.630418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74e30258-f516-46e3-8345-41d4e0911615 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:38.631354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74e30258-f516-46e3-8345-41d4e0911615 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:38.632076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74e30258-f516-46e3-8345-41d4e0911615 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:38.635622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74e30258-f516-46e3-8345-41d4e0911615 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:38.636316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74e30258-f516-46e3-8345-41d4e0911615 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:38.636914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74e30258-f516-46e3-8345-41d4e0911615 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:38.779044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-74e30258-f516-46e3-8345-41d4e0911615 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:38.811812 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-74e30258-f516-46e3-8345-41d4e0911615 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1266 microversion: 2.1 time: 0.202120 Oct 11 19:50:38.826743 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1105/2147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:38 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:38.826972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-626a213d-65ee-4745-9cbe-0867ebcd77fc tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:38.835348 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-626a213d-65ee-4745-9cbe-0867ebcd77fc tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1681 microversion: 2.1 time: 0.807742 Oct 11 19:50:38.835948 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1043/2148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:38 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1681 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:38.844968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:38.846216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:38.864525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:38.867406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:38.868829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:38.870561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:38.871002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58b6e7b5-60a1-49a8-a7b7-22abcccdad61 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:38.871715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58b6e7b5-60a1-49a8-a7b7-22abcccdad61 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:38.872218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:38.878030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:38.898610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b6e7b5-60a1-49a8-a7b7-22abcccdad61 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:38.899550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b6e7b5-60a1-49a8-a7b7-22abcccdad61 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:38.900964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b6e7b5-60a1-49a8-a7b7-22abcccdad61 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:38.902344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b6e7b5-60a1-49a8-a7b7-22abcccdad61 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:38.906469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b6e7b5-60a1-49a8-a7b7-22abcccdad61 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:38.907175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b6e7b5-60a1-49a8-a7b7-22abcccdad61 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:39.744440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:39.746796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58b6e7b5-60a1-49a8-a7b7-22abcccdad61 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:39.760210 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58b6e7b5-60a1-49a8-a7b7-22abcccdad61 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1363 microversion: 2.1 time: 0.898786 Oct 11 19:50:39.760973 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1044/2149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:38 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1363 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:50:39.769342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c35be176-a43d-4d2e-8393-1e4625f47e2e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:39.771842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c35be176-a43d-4d2e-8393-1e4625f47e2e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:39.786724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:39.788170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:39.788822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35be176-a43d-4d2e-8393-1e4625f47e2e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:39.789322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35be176-a43d-4d2e-8393-1e4625f47e2e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:39.789763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35be176-a43d-4d2e-8393-1e4625f47e2e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:39.790735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35be176-a43d-4d2e-8393-1e4625f47e2e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:39.792168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35be176-a43d-4d2e-8393-1e4625f47e2e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:39.792835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35be176-a43d-4d2e-8393-1e4625f47e2e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:39.799898 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-168b9bfd-7bac-4f14-8a63-d3067831bc6e tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.978741 Oct 11 19:50:39.801261 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1106/2150] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:38 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:39.820274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-be44ada9-ec76-4891-9b64-8ec764cdca17 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:39.820893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-be44ada9-ec76-4891-9b64-8ec764cdca17 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:39.832377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be44ada9-ec76-4891-9b64-8ec764cdca17 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:39.832878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be44ada9-ec76-4891-9b64-8ec764cdca17 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:39.833313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be44ada9-ec76-4891-9b64-8ec764cdca17 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:39.839408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be44ada9-ec76-4891-9b64-8ec764cdca17 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:39.840156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be44ada9-ec76-4891-9b64-8ec764cdca17 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:39.841238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be44ada9-ec76-4891-9b64-8ec764cdca17 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:40.262380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-be44ada9-ec76-4891-9b64-8ec764cdca17 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:40.264755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:40.276475 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-be44ada9-ec76-4891-9b64-8ec764cdca17 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1367 microversion: 2.1 time: 0.474107 Oct 11 19:50:40.277459 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1107/2151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:39 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1367 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:40.282236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5d6594d9-6908-4c32-a6d5-2218660c7f08 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:40.300177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5d6594d9-6908-4c32-a6d5-2218660c7f08 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:40.331697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d6594d9-6908-4c32-a6d5-2218660c7f08 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:40.332411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d6594d9-6908-4c32-a6d5-2218660c7f08 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:40.337036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d6594d9-6908-4c32-a6d5-2218660c7f08 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:40.338717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d6594d9-6908-4c32-a6d5-2218660c7f08 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:40.339364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d6594d9-6908-4c32-a6d5-2218660c7f08 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:40.339953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d6594d9-6908-4c32-a6d5-2218660c7f08 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:40.368611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c35be176-a43d-4d2e-8393-1e4625f47e2e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:40.378844 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c35be176-a43d-4d2e-8393-1e4625f47e2e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1512 microversion: 2.1 time: 0.616505 Oct 11 19:50:40.381681 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1045/2152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:39 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1512 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:40.387145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df72ebc9-148a-407c-985f-3e4a58cc45f8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:40.387989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-df72ebc9-148a-407c-985f-3e4a58cc45f8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:40.394469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df72ebc9-148a-407c-985f-3e4a58cc45f8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:40.403081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df72ebc9-148a-407c-985f-3e4a58cc45f8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:40.408239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df72ebc9-148a-407c-985f-3e4a58cc45f8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:40.418750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df72ebc9-148a-407c-985f-3e4a58cc45f8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:40.419262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df72ebc9-148a-407c-985f-3e4a58cc45f8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:40.420425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df72ebc9-148a-407c-985f-3e4a58cc45f8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:40.622910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5d6594d9-6908-4c32-a6d5-2218660c7f08 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:40.632747 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5d6594d9-6908-4c32-a6d5-2218660c7f08 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1272 microversion: 2.1 time: 0.354288 Oct 11 19:50:40.633373 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1108/2153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:40 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1272 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:40.647503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b19869a1-e8bc-4adf-b6d3-c5598a27315a req-72cd60b1-7fd3-4179-a72b-4afaba1f6778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a52feaa-0925-49de-bb88-68790063b724", "tag": "e9769511-f249-4f8b-83a8-d2aa8cbf950e"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:40.675491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b19869a1-e8bc-4adf-b6d3-c5598a27315a req-72cd60b1-7fd3-4179-a72b-4afaba1f6778 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:40.677793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b19869a1-e8bc-4adf-b6d3-c5598a27315a req-72cd60b1-7fd3-4179-a72b-4afaba1f6778 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:40.678457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b19869a1-e8bc-4adf-b6d3-c5598a27315a req-72cd60b1-7fd3-4179-a72b-4afaba1f6778 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:40.716098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:40.723715 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b19869a1-e8bc-4adf-b6d3-c5598a27315a req-72cd60b1-7fd3-4179-a72b-4afaba1f6778 service nova] Creating event network-changed:e9769511-f249-4f8b-83a8-d2aa8cbf950e for instance 5a52feaa-0925-49de-bb88-68790063b724 on n-h2-860864-3 Oct 11 19:50:40.738318 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b19869a1-e8bc-4adf-b6d3-c5598a27315a req-72cd60b1-7fd3-4179-a72b-4afaba1f6778 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094075 Oct 11 19:50:40.740621 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1109/2154] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:40.753555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-06f32d58-8856-4f4f-b282-fc554c65aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:40.754285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-06f32d58-8856-4f4f-b282-fc554c65aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:40.766448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06f32d58-8856-4f4f-b282-fc554c65aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:40.767403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06f32d58-8856-4f4f-b282-fc554c65aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:40.769579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06f32d58-8856-4f4f-b282-fc554c65aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:40.770775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06f32d58-8856-4f4f-b282-fc554c65aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:40.772207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06f32d58-8856-4f4f-b282-fc554c65aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:40.774180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06f32d58-8856-4f4f-b282-fc554c65aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:40.987412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df72ebc9-148a-407c-985f-3e4a58cc45f8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69553a727c3147f2bbaf203f17419830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9043fe6f133c4c1d876227fa7dfcbda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:41.004050 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-df72ebc9-148a-407c-985f-3e4a58cc45f8 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 200 len: 1681 microversion: 2.1 time: 0.621111 Oct 11 19:50:41.004874 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1046/2155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:40 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 1681 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:41.025529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d92a4d9-3957-4dc5-950e-561091c64311 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:41.026358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6d92a4d9-3957-4dc5-950e-561091c64311 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:41.034488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d92a4d9-3957-4dc5-950e-561091c64311 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:41.035280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d92a4d9-3957-4dc5-950e-561091c64311 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:41.035827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d92a4d9-3957-4dc5-950e-561091c64311 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:41.036685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d92a4d9-3957-4dc5-950e-561091c64311 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:41.037461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d92a4d9-3957-4dc5-950e-561091c64311 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:41.037997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d92a4d9-3957-4dc5-950e-561091c64311 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:41.246648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-06f32d58-8856-4f4f-b282-fc554c65aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:41.265629 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-06f32d58-8856-4f4f-b282-fc554c65aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1513 microversion: 2.1 time: 0.523747 Oct 11 19:50:41.283653 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1110/2156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:40 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1513 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:41.295458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:41.296081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:41.303195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:41.305240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:41.305844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:41.307319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:41.308306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:41.308770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:41.309417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:41.725360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6d92a4d9-3957-4dc5-950e-561091c64311 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:41.736191 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6d92a4d9-3957-4dc5-950e-561091c64311 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1363 microversion: 2.1 time: 0.713799 Oct 11 19:50:41.739115 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1047/2157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:41 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1363 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:41.758041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f00c1711-3961-4003-88f6-1e78b00eaf7c req-9efcacf5-1931-44ce-9225-b26e9b42b2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db170ae-e6b1-4057-8d54-6bba8c210919", "tag": "3780f4c2-abd7-4eed-a9ea-b6d199050677"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:41.801645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f00c1711-3961-4003-88f6-1e78b00eaf7c req-9efcacf5-1931-44ce-9225-b26e9b42b2d8 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:41.802133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f00c1711-3961-4003-88f6-1e78b00eaf7c req-9efcacf5-1931-44ce-9225-b26e9b42b2d8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:41.807256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f00c1711-3961-4003-88f6-1e78b00eaf7c req-9efcacf5-1931-44ce-9225-b26e9b42b2d8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:41.838680 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f00c1711-3961-4003-88f6-1e78b00eaf7c req-9efcacf5-1931-44ce-9225-b26e9b42b2d8 service nova] Creating event network-changed:3780f4c2-abd7-4eed-a9ea-b6d199050677 for instance 5db170ae-e6b1-4057-8d54-6bba8c210919 on n-h2-860864-3 Oct 11 19:50:41.850027 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f00c1711-3961-4003-88f6-1e78b00eaf7c req-9efcacf5-1931-44ce-9225-b26e9b42b2d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105771 Oct 11 19:50:41.853781 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1048/2158] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:41.870653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-abb9c159-1c4c-4fe1-a213-27fc17d85bca tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:41.871926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-abb9c159-1c4c-4fe1-a213-27fc17d85bca tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:41.879748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:41.888800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb9c159-1c4c-4fe1-a213-27fc17d85bca tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:41.892466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb9c159-1c4c-4fe1-a213-27fc17d85bca tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:41.893204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb9c159-1c4c-4fe1-a213-27fc17d85bca tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:41.896277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb9c159-1c4c-4fe1-a213-27fc17d85bca tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:41.897018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb9c159-1c4c-4fe1-a213-27fc17d85bca tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:41.905711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:41.906155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb9c159-1c4c-4fe1-a213-27fc17d85bca tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:41.915009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:41.917047 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4b670582-7c45-4a40-af25-1ca92142f290 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.632135 Oct 11 19:50:41.946545 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1111/2159] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:41 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:41.952640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b9a932c8-b0ef-417c-9fe1-40e026541e8c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:41.953247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b9a932c8-b0ef-417c-9fe1-40e026541e8c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:41.994590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a932c8-b0ef-417c-9fe1-40e026541e8c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:41.995472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a932c8-b0ef-417c-9fe1-40e026541e8c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:41.996078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a932c8-b0ef-417c-9fe1-40e026541e8c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:41.997341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a932c8-b0ef-417c-9fe1-40e026541e8c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:42.004262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a932c8-b0ef-417c-9fe1-40e026541e8c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:42.005600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9a932c8-b0ef-417c-9fe1-40e026541e8c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:42.610641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b9a932c8-b0ef-417c-9fe1-40e026541e8c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:42.628124 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b9a932c8-b0ef-417c-9fe1-40e026541e8c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1367 microversion: 2.1 time: 0.677891 Oct 11 19:50:42.631084 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1112/2160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:41 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1367 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:42.661835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-da27f091-32da-478b-9fca-8f0793037f72 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:42.663288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-da27f091-32da-478b-9fca-8f0793037f72 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:42.678076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da27f091-32da-478b-9fca-8f0793037f72 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:42.684401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da27f091-32da-478b-9fca-8f0793037f72 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:42.684867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da27f091-32da-478b-9fca-8f0793037f72 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:42.685640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da27f091-32da-478b-9fca-8f0793037f72 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:42.686099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da27f091-32da-478b-9fca-8f0793037f72 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:42.686550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da27f091-32da-478b-9fca-8f0793037f72 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:42.714158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-abb9c159-1c4c-4fe1-a213-27fc17d85bca tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:42.731375 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-abb9c159-1c4c-4fe1-a213-27fc17d85bca tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e" status: 200 len: 1512 microversion: 2.1 time: 0.876093 Oct 11 19:50:42.732132 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1049/2161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:41 2022] GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e => generated 1512 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:42.740376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:42.740997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:42.772369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:42.772876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:42.773310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:42.774325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:42.780429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:42.782162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:42.810593 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] HTTP exception thrown: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Request method failure captured: Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d HTTP/1.1 Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRchnLYfPXui5is0Ao9ATjkK8VB7YNgulJR-MEALPIPGvBd--Vm7FZ-ZfNs9iLq6_kUcbcMK9Acqiw5w_kCywTbuqDqGuzyOEpp1VVtJe_Xh2SLF3sxtiUHBAbJ66ZFlGaMzv9S0ZXDwg_qzY8-VeCIogJx3Gw4ey2yP66q4agWmnjpU Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9043fe6f133c4c1d876227fa7dfcbda3 Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1342955529 Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9043fe6f133c4c1d876227fa7dfcbda3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9043fe6f133c4c1d876227fa7dfcbda3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9043fe6f133c4c1d876227fa7dfcbda3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9043fe6f133c4c1d876227fa7dfcbda3"}]}] Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1342955529 Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9043fe6f133c4c1d876227fa7dfcbda3 Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1342955529 Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachSCSIVolumeTestJSON-1342955529-project Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 69553a727c3147f2bbaf203f17419830 Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1342955529-project Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '21319341-f8a9-4972-88e3-13e7c5f6397d'} Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:42.819100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:42.824894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:42.824894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:42.824894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:42.824894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:50:42.824894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:50:42.824894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:42.824894 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:42.827157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Returning 404 to user: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:50:42.876868 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-31221920-b8d1-4f3d-ae91-b221ad0a7266 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 404 len: 111 microversion: 2.1 time: 0.095546 Oct 11 19:50:42.876868 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1050/2162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:42 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:50:42.876868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:42.876868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:42.876868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:50:42.912082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:42.912692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:42.913267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:42.914130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:42.914689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:42.915104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:43.090318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:43.120860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:50:43.222212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:43.232715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:43.233473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:43.234156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:43.235207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-da27f091-32da-478b-9fca-8f0793037f72 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:43.244217 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-da27f091-32da-478b-9fca-8f0793037f72 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1314 microversion: 2.1 time: 0.611093 Oct 11 19:50:43.248061 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1113/2163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:42 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:43.255687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb041e62-d708-43fd-8702-2d90fce6f8f9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:43.256307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eb041e62-d708-43fd-8702-2d90fce6f8f9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:43.275017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb041e62-d708-43fd-8702-2d90fce6f8f9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:43.275795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb041e62-d708-43fd-8702-2d90fce6f8f9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:43.283877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb041e62-d708-43fd-8702-2d90fce6f8f9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:43.284652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb041e62-d708-43fd-8702-2d90fce6f8f9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:43.285231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb041e62-d708-43fd-8702-2d90fce6f8f9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:43.285772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb041e62-d708-43fd-8702-2d90fce6f8f9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:43.821027 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-01668a44-7920-485b-aac9-69af5a51c17b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.990527 Oct 11 19:50:43.822125 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1051/2164] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 11 19:50:42 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:43.830479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cbcbc5dd-15de-4efc-9046-44c9f9efccb5 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '.version_select at 0x7f83cc05d310>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:43.860672 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cbcbc5dd-15de-4efc-9046-44c9f9efccb5 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964336370" status: 202 len: 0 microversion: 2.1 time: 0.037186 Oct 11 19:50:43.862079 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1052/2165] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 19:50:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964336370 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:50:43.870723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:43.872684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:43.880788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:43.882119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:43.882879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:43.883816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:43.888012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb041e62-d708-43fd-8702-2d90fce6f8f9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:43.897342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:43.898815 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb041e62-d708-43fd-8702-2d90fce6f8f9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1363 microversion: 2.1 time: 0.649471 Oct 11 19:50:43.900288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:43.901441 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1114/2166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:43 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1363 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:43.909930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-433ca7a5-b3cf-43a2-b07c-a6bf903c61d6 req-b6dce307-dd07-490b-9966-4c3f0e28a9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21319341-f8a9-4972-88e3-13e7c5f6397d", "name": "network-vif-deleted", "tag": "fb84ba1b-772c-4347-9bed-3bbeffe08735"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:43.937176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-433ca7a5-b3cf-43a2-b07c-a6bf903c61d6 req-b6dce307-dd07-490b-9966-4c3f0e28a9c0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:43.937763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-433ca7a5-b3cf-43a2-b07c-a6bf903c61d6 req-b6dce307-dd07-490b-9966-4c3f0e28a9c0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:43.938261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-433ca7a5-b3cf-43a2-b07c-a6bf903c61d6 req-b6dce307-dd07-490b-9966-4c3f0e28a9c0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:43.969977 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-433ca7a5-b3cf-43a2-b07c-a6bf903c61d6 req-b6dce307-dd07-490b-9966-4c3f0e28a9c0 service nova] Creating event network-vif-deleted:fb84ba1b-772c-4347-9bed-3bbeffe08735 for instance 21319341-f8a9-4972-88e3-13e7c5f6397d on n-h1-860864-3 Oct 11 19:50:43.983673 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-433ca7a5-b3cf-43a2-b07c-a6bf903c61d6 req-b6dce307-dd07-490b-9966-4c3f0e28a9c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079057 Oct 11 19:50:43.984720 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1115/2167] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:43.998806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-47b3607f-13f8-478a-9550-82c3313941db tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:44.012262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-47b3607f-13f8-478a-9550-82c3313941db tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:44.027917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47b3607f-13f8-478a-9550-82c3313941db tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:44.034019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47b3607f-13f8-478a-9550-82c3313941db tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:44.034772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47b3607f-13f8-478a-9550-82c3313941db tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:44.035675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47b3607f-13f8-478a-9550-82c3313941db tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:44.036277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47b3607f-13f8-478a-9550-82c3313941db tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:44.036864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47b3607f-13f8-478a-9550-82c3313941db tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:44.549579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-47b3607f-13f8-478a-9550-82c3313941db tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:44.564710 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-47b3607f-13f8-478a-9550-82c3313941db tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1367 microversion: 2.1 time: 0.575104 Oct 11 19:50:44.568017 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1116/2168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:43 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1367 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:44.831377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff2889a4-b139-4868-9934-203cd429c0da tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Action: 'update', calling method: .version_select at 0x7f83d07e9670>, body: {"quota_set": {"ram": "5120"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:44.936628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff2889a4-b139-4868-9934-203cd429c0da tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:44.940280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff2889a4-b139-4868-9934-203cd429c0da tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:44.941006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff2889a4-b139-4868-9934-203cd429c0da tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:44.944569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff2889a4-b139-4868-9934-203cd429c0da tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:44.945395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff2889a4-b139-4868-9934-203cd429c0da tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:44.946111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff2889a4-b139-4868-9934-203cd429c0da tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:45.075830 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff2889a4-b139-4868-9934-203cd429c0da tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/40310605c9614b8fafddc4ac685373af" status: 200 len: 240 microversion: 2.36 time: 0.505665 Oct 11 19:50:45.082760 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1117/2169] 10.222.0.27 () {62 vars in 1303 bytes} [Tue Oct 11 19:50:44 2022] PUT /compute/v2.1/os-quota-sets/40310605c9614b8fafddc4ac685373af => generated 240 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:50:45.088383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:45.098710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:45.104944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1063948164', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:50:45.117674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:45.119829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:45.120437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:45.124114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:45.124892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:45.125667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:45.320674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:45.341033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:45.345006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:45.345953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:50:45.346625 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4402c674-6977-46d6-8d82-84a82f897d41 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 1.483235 Oct 11 19:50:45.347338 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1053/2170] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:43 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:45.555220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:45.568485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:45.570956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:45.571952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:45.648760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e9de022b-c741-4b93-b4d9-420a091f0447 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:45.649455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e9de022b-c741-4b93-b4d9-420a091f0447 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:45.664000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9de022b-c741-4b93-b4d9-420a091f0447 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:45.664706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9de022b-c741-4b93-b4d9-420a091f0447 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:45.665802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9de022b-c741-4b93-b4d9-420a091f0447 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:45.667325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9de022b-c741-4b93-b4d9-420a091f0447 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:45.667806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9de022b-c741-4b93-b4d9-420a091f0447 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:45.668267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9de022b-c741-4b93-b4d9-420a091f0447 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:45.999341 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aea7b9ad-97f3-4326-95a8-e3a266c39f25 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1063948164" status: 200 len: 1516 microversion: 2.1 time: 0.921425 Oct 11 19:50:46.000021 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1118/2171] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:50:45 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1063948164 => generated 1516 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:46.007458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-112e01bb-b43d-4ac7-ac5c-1c21033d1e50 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:46.008108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-112e01bb-b43d-4ac7-ac5c-1c21033d1e50 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:46.024361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-112e01bb-b43d-4ac7-ac5c-1c21033d1e50 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.024898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-112e01bb-b43d-4ac7-ac5c-1c21033d1e50 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.025505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-112e01bb-b43d-4ac7-ac5c-1c21033d1e50 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.026402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-112e01bb-b43d-4ac7-ac5c-1c21033d1e50 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.027074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-112e01bb-b43d-4ac7-ac5c-1c21033d1e50 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.027741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-112e01bb-b43d-4ac7-ac5c-1c21033d1e50 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.051853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e9de022b-c741-4b93-b4d9-420a091f0447 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:46.067325 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e9de022b-c741-4b93-b4d9-420a091f0447 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1314 microversion: 2.1 time: 0.717093 Oct 11 19:50:46.068597 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1054/2172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:45 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:46.073812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b5a9bbde-2ab8-49f2-89c4-fbe736c77507 tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Calling method '.version_select at 0x7f83cc169ee0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:46.172599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5a9bbde-2ab8-49f2-89c4-fbe736c77507 tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.173187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5a9bbde-2ab8-49f2-89c4-fbe736c77507 tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.173713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5a9bbde-2ab8-49f2-89c4-fbe736c77507 tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.174887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5a9bbde-2ab8-49f2-89c4-fbe736c77507 tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.175421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5a9bbde-2ab8-49f2-89c4-fbe736c77507 tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.175922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5a9bbde-2ab8-49f2-89c4-fbe736c77507 tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.205879 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b5a9bbde-2ab8-49f2-89c4-fbe736c77507 tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/40310605c9614b8fafddc4ac685373af/detail" status: 200 len: 672 microversion: 2.36 time: 0.135938 Oct 11 19:50:46.206901 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1055/2173] 10.222.0.27 () {60 vars in 1304 bytes} [Tue Oct 11 19:50:46 2022] GET /compute/v2.1/os-quota-sets/40310605c9614b8fafddc4ac685373af/detail => generated 672 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:50:46.211617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c72314c6-7d59-48ac-8329-a339f698af43 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:46.212306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c72314c6-7d59-48ac-8329-a339f698af43 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:46.239397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c72314c6-7d59-48ac-8329-a339f698af43 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.240109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c72314c6-7d59-48ac-8329-a339f698af43 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.240754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c72314c6-7d59-48ac-8329-a339f698af43 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.242381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c72314c6-7d59-48ac-8329-a339f698af43 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.243128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c72314c6-7d59-48ac-8329-a339f698af43 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.244572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c72314c6-7d59-48ac-8329-a339f698af43 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.366172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-112e01bb-b43d-4ac7-ac5c-1c21033d1e50 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:46.378949 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-112e01bb-b43d-4ac7-ac5c-1c21033d1e50 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1363 microversion: 2.1 time: 0.375938 Oct 11 19:50:46.381606 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1119/2174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:46 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:46.401915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:46.408581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:46.409693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:50:46.422496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.423220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.423855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.426056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.426901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.427494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.545552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c72314c6-7d59-48ac-8329-a339f698af43 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:46.562201 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c72314c6-7d59-48ac-8329-a339f698af43 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1367 microversion: 2.1 time: 0.354033 Oct 11 19:50:46.563178 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1056/2175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:46 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:46.574241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5dd3f476-ed41-4e18-b671-1907daa8055a req-a6c9eb45-903b-4a8b-ba40-cd8f1e4621ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9caeef-5fc5-41a0-83dc-49646e17b292", "tag": "88d8ed7b-6d69-48e6-b71a-a905a31d2b8d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:46.591888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5dd3f476-ed41-4e18-b671-1907daa8055a req-a6c9eb45-903b-4a8b-ba40-cd8f1e4621ba service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.592694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5dd3f476-ed41-4e18-b671-1907daa8055a req-a6c9eb45-903b-4a8b-ba40-cd8f1e4621ba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.593337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5dd3f476-ed41-4e18-b671-1907daa8055a req-a6c9eb45-903b-4a8b-ba40-cd8f1e4621ba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.608869 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5dd3f476-ed41-4e18-b671-1907daa8055a req-a6c9eb45-903b-4a8b-ba40-cd8f1e4621ba service nova] Creating event network-changed:88d8ed7b-6d69-48e6-b71a-a905a31d2b8d for instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 on n-h1-860864-3 Oct 11 19:50:46.615517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:50:46.623681 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5dd3f476-ed41-4e18-b671-1907daa8055a req-a6c9eb45-903b-4a8b-ba40-cd8f1e4621ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058279 Oct 11 19:50:46.629114 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1057/2176] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:46.637631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:46.641670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:46.652349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.652964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.653510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.654294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.669670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.670484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.783144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:46.806197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:46.811405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:46.811882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:46.950851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:46.961704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:46.963423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:46.965649 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dffb8289-826c-4fd2-ac59-6a28df3425f9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.335359 Oct 11 19:50:46.966438 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1058/2177] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:46 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:46.973702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Action: 'update', calling method: .version_select at 0x7f83cc157430>, body: {"quota_set": {"ram": "2048"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:47.066329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.067482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.068099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.069005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.069624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.070203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.116616 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e18929fd-ede2-4358-8b15-b4f34ae3fa0f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.733550 Oct 11 19:50:47.117334 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1120/2178] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 11 19:50:46 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:47.129270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.129270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.129438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.130449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.131244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.132041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.149778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-82419a1f-7414-4827-aa66-9891e7881a13 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:47.150906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-82419a1f-7414-4827-aa66-9891e7881a13 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:47.158779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82419a1f-7414-4827-aa66-9891e7881a13 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.160872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82419a1f-7414-4827-aa66-9891e7881a13 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.161978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82419a1f-7414-4827-aa66-9891e7881a13 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.163981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82419a1f-7414-4827-aa66-9891e7881a13 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.164644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82419a1f-7414-4827-aa66-9891e7881a13 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.166279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82419a1f-7414-4827-aa66-9891e7881a13 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.261076 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0f6d28d4-a261-448d-90a2-fdca7cf3b61d tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/40310605c9614b8fafddc4ac685373af?user_id=34692de601b14e7e9cd147cdb2f2c966" status: 200 len: 240 microversion: 2.36 time: 0.291174 Oct 11 19:50:47.267812 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1059/2179] 10.222.0.27 () {62 vars in 1384 bytes} [Tue Oct 11 19:50:46 2022] PUT /compute/v2.1/os-quota-sets/40310605c9614b8fafddc4ac685373af?user_id=34692de601b14e7e9cd147cdb2f2c966 => generated 240 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:50:47.274421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:47.295416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:47.296259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.compute.servers [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Removing options 'limit' from query {{(pid=126955) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 19:50:47.298124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:50:47.311504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.313621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.314234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.316590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.317549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.319693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.393263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82419a1f-7414-4827-aa66-9891e7881a13 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:47.409222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-82419a1f-7414-4827-aa66-9891e7881a13 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1314 microversion: 2.1 time: 0.267352 Oct 11 19:50:47.423312 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1121/2180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:47 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:47.437003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0de71c08-12df-4ccb-9dde-5b41f9402bbd tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] Calling method '.version_select at 0x7f83d08404c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:47.564330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:47.577096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.577841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.578718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.590711 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0de71c08-12df-4ccb-9dde-5b41f9402bbd tempest-QuotasAdminTestV236-1218644948 tempest-QuotasAdminTestV236-1218644948-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/40310605c9614b8fafddc4ac685373af?user_id=34692de601b14e7e9cd147cdb2f2c966" status: 200 len: 282 microversion: 2.36 time: 0.165324 Oct 11 19:50:47.592018 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1122/2181] 10.222.0.27 () {60 vars in 1364 bytes} [Tue Oct 11 19:50:47 2022] GET /compute/v2.1/os-quota-sets/40310605c9614b8fafddc4ac685373af?user_id=34692de601b14e7e9cd147cdb2f2c966 => generated 282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:50:47.618302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89068f01-ca7c-48b1-a461-a0e1da5b04fa tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:47.619141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-89068f01-ca7c-48b1-a461-a0e1da5b04fa tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:47.658814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89068f01-ca7c-48b1-a461-a0e1da5b04fa tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.659329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89068f01-ca7c-48b1-a461-a0e1da5b04fa tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.662697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89068f01-ca7c-48b1-a461-a0e1da5b04fa tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.663459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89068f01-ca7c-48b1-a461-a0e1da5b04fa tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:47.668237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89068f01-ca7c-48b1-a461-a0e1da5b04fa tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:47.669385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89068f01-ca7c-48b1-a461-a0e1da5b04fa tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:47.945149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-89068f01-ca7c-48b1-a461-a0e1da5b04fa tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:47.964524 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-89068f01-ca7c-48b1-a461-a0e1da5b04fa tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1363 microversion: 2.1 time: 0.371302 Oct 11 19:50:47.968192 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1123/2182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:47 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:47.973111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f98f4f3a-53a8-440a-8d32-b24d2aef339c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:47.976189 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f565875e-98a4-462d-aad6-ca571bea45b8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.711862 Oct 11 19:50:47.987278 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1060/2183] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 19:50:47 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:48.003518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-cb116ad8-7eb9-4c24-a2bd-9c8d5ffd3ec4 req-43b1199a-2b04-4a97-acef-8f47919b6431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a52feaa-0925-49de-bb88-68790063b724", "name": "network-vif-plugged", "status": "completed", "tag": "e9769511-f249-4f8b-83a8-d2aa8cbf950e"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:48.013655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f98f4f3a-53a8-440a-8d32-b24d2aef339c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:48.023441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cb116ad8-7eb9-4c24-a2bd-9c8d5ffd3ec4 req-43b1199a-2b04-4a97-acef-8f47919b6431 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.026397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f98f4f3a-53a8-440a-8d32-b24d2aef339c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.026917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f98f4f3a-53a8-440a-8d32-b24d2aef339c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.027353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f98f4f3a-53a8-440a-8d32-b24d2aef339c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.028063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f98f4f3a-53a8-440a-8d32-b24d2aef339c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.028538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f98f4f3a-53a8-440a-8d32-b24d2aef339c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.029045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cb116ad8-7eb9-4c24-a2bd-9c8d5ffd3ec4 req-43b1199a-2b04-4a97-acef-8f47919b6431 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.029479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cb116ad8-7eb9-4c24-a2bd-9c8d5ffd3ec4 req-43b1199a-2b04-4a97-acef-8f47919b6431 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.034211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f98f4f3a-53a8-440a-8d32-b24d2aef339c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.043399 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-cb116ad8-7eb9-4c24-a2bd-9c8d5ffd3ec4 req-43b1199a-2b04-4a97-acef-8f47919b6431 service nova] Creating event network-vif-plugged:e9769511-f249-4f8b-83a8-d2aa8cbf950e for instance 5a52feaa-0925-49de-bb88-68790063b724 on n-h2-860864-3 Oct 11 19:50:48.051145 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-cb116ad8-7eb9-4c24-a2bd-9c8d5ffd3ec4 req-43b1199a-2b04-4a97-acef-8f47919b6431 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062437 Oct 11 19:50:48.052480 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1061/2184] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:48.058800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:48.060153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:48.067785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.068518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.069106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.069953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.070575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.071794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.368808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f98f4f3a-53a8-440a-8d32-b24d2aef339c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:48.378126 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f98f4f3a-53a8-440a-8d32-b24d2aef339c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1367 microversion: 2.1 time: 0.408167 Oct 11 19:50:48.390559 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1124/2185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:47 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:48.409476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:48.421368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:48.426029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:48.428039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:50:48.435088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:48.436719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:48.438062 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9b92855b-a1ea-4d79-8113-3d0a38013bb7 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.384360 Oct 11 19:50:48.446800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.451689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.454213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.456068 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1062/2186] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:48 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:48.461322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.461322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.461322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.474081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-267e76cc-00b0-48a8-8948-c9805b84732a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:48.475778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-267e76cc-00b0-48a8-8948-c9805b84732a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:48.484356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-267e76cc-00b0-48a8-8948-c9805b84732a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.485041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-267e76cc-00b0-48a8-8948-c9805b84732a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.485618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-267e76cc-00b0-48a8-8948-c9805b84732a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.486482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-267e76cc-00b0-48a8-8948-c9805b84732a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.487737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-267e76cc-00b0-48a8-8948-c9805b84732a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.488307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-267e76cc-00b0-48a8-8948-c9805b84732a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.655446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:50:48.657683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-267e76cc-00b0-48a8-8948-c9805b84732a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:48.667108 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-267e76cc-00b0-48a8-8948-c9805b84732a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1314 microversion: 2.1 time: 0.209685 Oct 11 19:50:48.678667 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1063/2187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:48 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:48.692907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:48.776869 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1a859707-a418-4145-8cc5-53e8b60ee33d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.393952 Oct 11 19:50:48.787171 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1125/2188] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:50:48 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:48.791690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:48.797027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:48.797731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.compute.servers [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Removing options 'limit' from query {{(pid=126955) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 19:50:48.798734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:50:48.804345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.805052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.806280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.807256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.807939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.808569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.851051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:50:48.894414 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0a524e4f-9503-41dc-a9ee-7f04244a63c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.106972 Oct 11 19:50:48.895827 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1064/2189] 10.222.0.27 () {58 vars in 1150 bytes} [Tue Oct 11 19:50:48 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:48.908949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:48.914148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:48.914771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:50:48.925931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.926416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.926881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.927732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:48.928199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:48.929257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:48.992079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d9ebc9db-ee41-4a83-97f7-126f142bcae7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:48.992696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d9ebc9db-ee41-4a83-97f7-126f142bcae7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:48.999788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9ebc9db-ee41-4a83-97f7-126f142bcae7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.000214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9ebc9db-ee41-4a83-97f7-126f142bcae7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.004740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9ebc9db-ee41-4a83-97f7-126f142bcae7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.005491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9ebc9db-ee41-4a83-97f7-126f142bcae7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.005959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9ebc9db-ee41-4a83-97f7-126f142bcae7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.006385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9ebc9db-ee41-4a83-97f7-126f142bcae7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.089144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:50:49.193669 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6dca927d-781d-4272-b2a5-66ca3ae5155a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.288721 Oct 11 19:50:49.195167 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1126/2190] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 19:50:48 2022] GET /compute/v2.1/servers => generated 1012 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:49.210414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:49.216408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:49.217279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:50:49.230736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.231433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.232000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.235224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d9ebc9db-ee41-4a83-97f7-126f142bcae7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:49.240260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.243360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.245704 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d9ebc9db-ee41-4a83-97f7-126f142bcae7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1363 microversion: 2.1 time: 0.257424 Oct 11 19:50:49.246482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.248254 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1065/2191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:48 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:49.360740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:50:49.409918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-80c9bfa4-68a9-4db7-835b-3839f5dd84c6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:49.411139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-80c9bfa4-68a9-4db7-835b-3839f5dd84c6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:49.424407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80c9bfa4-68a9-4db7-835b-3839f5dd84c6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.426922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80c9bfa4-68a9-4db7-835b-3839f5dd84c6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.427696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80c9bfa4-68a9-4db7-835b-3839f5dd84c6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.429142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80c9bfa4-68a9-4db7-835b-3839f5dd84c6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.429854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80c9bfa4-68a9-4db7-835b-3839f5dd84c6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.430484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80c9bfa4-68a9-4db7-835b-3839f5dd84c6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.448313 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c49d03dc-0fbb-4ce6-8437-4dba1391f79c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.241540 Oct 11 19:50:49.458253 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1127/2192] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:50:49 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:49.466761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:49.474633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:49.475106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.compute.servers [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Removing options 'limit' from query {{(pid=126956) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 19:50:49.475791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:50:49.482454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.483236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.483834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.485295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.485806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.486232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.518365 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-60cf8be7-214c-4b12-8f8a-9e14adb8eba7 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.058201 Oct 11 19:50:49.526847 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1128/2193] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 11 19:50:49 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:50:49.526847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:49.526847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:49.533109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.533597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.534031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.534899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.535347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.535820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.680729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-80c9bfa4-68a9-4db7-835b-3839f5dd84c6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:49.698054 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-80c9bfa4-68a9-4db7-835b-3839f5dd84c6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1367 microversion: 2.1 time: 0.292377 Oct 11 19:50:49.699508 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1066/2194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:49 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:49.705609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:49.716696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:49.717714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1063948164', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:50:49.730166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:49.734865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.740856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:49.742059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.742515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.743863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.744359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.744768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.746026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:49.747289 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4b409afa-148e-403a-9551-8e1ed8cd35d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1487 microversion: 2.25 time: 0.227545 Oct 11 19:50:49.758645 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1129/2195] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:49 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1487 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:49.759424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5735320d-b7f9-4e90-97dd-a8fc8fb95582 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:49.760059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5735320d-b7f9-4e90-97dd-a8fc8fb95582 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:49.778677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5735320d-b7f9-4e90-97dd-a8fc8fb95582 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.779487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5735320d-b7f9-4e90-97dd-a8fc8fb95582 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.780142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5735320d-b7f9-4e90-97dd-a8fc8fb95582 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.782483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5735320d-b7f9-4e90-97dd-a8fc8fb95582 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.783487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5735320d-b7f9-4e90-97dd-a8fc8fb95582 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.784478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5735320d-b7f9-4e90-97dd-a8fc8fb95582 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.859405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:50:49.933640 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-129b8a6b-8e2e-4aa6-b41a-cf7e11534354 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1063948164" status: 200 len: 346 microversion: 2.1 time: 0.232772 Oct 11 19:50:49.942389 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1067/2196] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 11 19:50:49 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1063948164 => generated 346 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:49.950195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6436235d-96b6-49a8-8944-4f7c27303658 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:49.959378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6436235d-96b6-49a8-8944-4f7c27303658 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:49.959883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6436235d-96b6-49a8-8944-4f7c27303658 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:49.960324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6436235d-96b6-49a8-8944-4f7c27303658 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:49.990814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5735320d-b7f9-4e90-97dd-a8fc8fb95582 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:49.999269 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5735320d-b7f9-4e90-97dd-a8fc8fb95582 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1314 microversion: 2.1 time: 0.250370 Oct 11 19:50:50.008418 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1130/2197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:49 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:50.062403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6436235d-96b6-49a8-8944-4f7c27303658 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Going to try to stop instance {{(pid=126955) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 19:50:50.117836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-e468f73b-fe66-49a2-91d7-7264a5091bfd req-49a2cd9c-ab1c-4f93-bd36-0b66679a5cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db170ae-e6b1-4057-8d54-6bba8c210919", "name": "network-vif-plugged", "status": "completed", "tag": "3780f4c2-abd7-4eed-a9ea-b6d199050677"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:50.164483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e468f73b-fe66-49a2-91d7-7264a5091bfd req-49a2cd9c-ab1c-4f93-bd36-0b66679a5cdf service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:50.165913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e468f73b-fe66-49a2-91d7-7264a5091bfd req-49a2cd9c-ab1c-4f93-bd36-0b66679a5cdf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:50.166583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e468f73b-fe66-49a2-91d7-7264a5091bfd req-49a2cd9c-ab1c-4f93-bd36-0b66679a5cdf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:50.170737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:50.192335 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6436235d-96b6-49a8-8944-4f7c27303658 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "POST /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02/action" status: 202 len: 0 microversion: 2.1 time: 0.244739 Oct 11 19:50:50.194614 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1068/2198] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:50:49 2022] POST /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:50:50.206436 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-e468f73b-fe66-49a2-91d7-7264a5091bfd req-49a2cd9c-ab1c-4f93-bd36-0b66679a5cdf service nova] Creating event network-vif-plugged:3780f4c2-abd7-4eed-a9ea-b6d199050677 for instance 5db170ae-e6b1-4057-8d54-6bba8c210919 on n-h2-860864-3 Oct 11 19:50:50.212776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-31ec6988-eeee-432f-a0d3-0041d4a728bb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:50.213735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-31ec6988-eeee-432f-a0d3-0041d4a728bb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:50.216184 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-e468f73b-fe66-49a2-91d7-7264a5091bfd req-49a2cd9c-ab1c-4f93-bd36-0b66679a5cdf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101008 Oct 11 19:50:50.218752 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1131/2199] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:50.226960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31ec6988-eeee-432f-a0d3-0041d4a728bb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:50.227631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31ec6988-eeee-432f-a0d3-0041d4a728bb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:50.228155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31ec6988-eeee-432f-a0d3-0041d4a728bb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:50.228952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31ec6988-eeee-432f-a0d3-0041d4a728bb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:50.229557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31ec6988-eeee-432f-a0d3-0041d4a728bb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:50.230066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31ec6988-eeee-432f-a0d3-0041d4a728bb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:50.270355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3712a918-e4b9-4f4e-be92-6d44918f9862 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:50.271198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3712a918-e4b9-4f4e-be92-6d44918f9862 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:50.282163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3712a918-e4b9-4f4e-be92-6d44918f9862 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:50.287036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3712a918-e4b9-4f4e-be92-6d44918f9862 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:50.287661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3712a918-e4b9-4f4e-be92-6d44918f9862 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:50.288481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3712a918-e4b9-4f4e-be92-6d44918f9862 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:50.289551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3712a918-e4b9-4f4e-be92-6d44918f9862 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:50.290224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3712a918-e4b9-4f4e-be92-6d44918f9862 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:50.864407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3712a918-e4b9-4f4e-be92-6d44918f9862 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:50.869348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-31ec6988-eeee-432f-a0d3-0041d4a728bb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:50.881226 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-31ec6988-eeee-432f-a0d3-0041d4a728bb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1523 microversion: 2.1 time: 0.681143 Oct 11 19:50:50.882241 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1069/2200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:50 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1523 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:50.886674 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3712a918-e4b9-4f4e-be92-6d44918f9862 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1363 microversion: 2.1 time: 0.619355 Oct 11 19:50:50.888896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5db14366-b444-4b6c-b70d-7a18083ca5c7 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:50.889772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5db14366-b444-4b6c-b70d-7a18083ca5c7 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:50.890504 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1132/2201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:50 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1363 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:50.897291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5db14366-b444-4b6c-b70d-7a18083ca5c7 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:50.897890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5db14366-b444-4b6c-b70d-7a18083ca5c7 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:50.898345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5db14366-b444-4b6c-b70d-7a18083ca5c7 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:50.899093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5db14366-b444-4b6c-b70d-7a18083ca5c7 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:50.899677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5db14366-b444-4b6c-b70d-7a18083ca5c7 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:50.905118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:50.905994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:50.911082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5db14366-b444-4b6c-b70d-7a18083ca5c7 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:50.924617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:50.925599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:50.928618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:50.930916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:50.931996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:50.933356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:51.236517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5db14366-b444-4b6c-b70d-7a18083ca5c7 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:51.248776 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5db14366-b444-4b6c-b70d-7a18083ca5c7 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1557 microversion: 2.1 time: 0.365144 Oct 11 19:50:51.249396 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1070/2202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:50 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1557 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:51.257590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a7ca97ac-cffb-4bd0-acb8-0e7b8537f851 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:51.258208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a7ca97ac-cffb-4bd0-acb8-0e7b8537f851 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:51.272136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7ca97ac-cffb-4bd0-acb8-0e7b8537f851 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:51.272660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7ca97ac-cffb-4bd0-acb8-0e7b8537f851 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:51.276703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7ca97ac-cffb-4bd0-acb8-0e7b8537f851 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:51.276703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7ca97ac-cffb-4bd0-acb8-0e7b8537f851 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:51.276933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7ca97ac-cffb-4bd0-acb8-0e7b8537f851 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:51.277234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7ca97ac-cffb-4bd0-acb8-0e7b8537f851 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:51.285687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:51.306332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:51.314152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:51.318021 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b9f01722-b0eb-4495-9a6c-c1ca766e7b89 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1477 microversion: 2.25 time: 0.423796 Oct 11 19:50:51.320058 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1133/2203] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:50 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:51.512893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a7ca97ac-cffb-4bd0-acb8-0e7b8537f851 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:51.522047 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a7ca97ac-cffb-4bd0-acb8-0e7b8537f851 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1314 microversion: 2.1 time: 0.271552 Oct 11 19:50:51.527715 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1071/2204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:51 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:51.538787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84a5e156-63d8-4bce-9672-99f32497a3ee tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:51.544273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-84a5e156-63d8-4bce-9672-99f32497a3ee tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:51.559388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84a5e156-63d8-4bce-9672-99f32497a3ee tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:51.562862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84a5e156-63d8-4bce-9672-99f32497a3ee tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:51.563595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84a5e156-63d8-4bce-9672-99f32497a3ee tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:51.564810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84a5e156-63d8-4bce-9672-99f32497a3ee tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:51.565477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84a5e156-63d8-4bce-9672-99f32497a3ee tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:51.567824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84a5e156-63d8-4bce-9672-99f32497a3ee tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:51.692120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e2054135-9021-4115-8f55-cfe85dd53a88 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Action: 'create', calling method: .version_select at 0x7f83cc84c940>, body: {"pool": null} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:51.904244 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-84a5e156-63d8-4bce-9672-99f32497a3ee tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.375040 Oct 11 19:50:51.905466 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1072/2205] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:50:51 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-interface => generated 284 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:51.912294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-83ee06d5-e3f7-46ae-9bcf-89afcc7d5408 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '.version_select at 0x7f83cc19df70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:51.934518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83ee06d5-e3f7-46ae-9bcf-89afcc7d5408 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:51.939164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83ee06d5-e3f7-46ae-9bcf-89afcc7d5408 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:51.939931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83ee06d5-e3f7-46ae-9bcf-89afcc7d5408 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:51.970305 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-83ee06d5-e3f7-46ae-9bcf-89afcc7d5408 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.25 time: 0.062581 Oct 11 19:50:51.971074 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1073/2206] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Oct 11 19:50:51 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:52.007769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-38419d5e-3e53-4981-98bb-951604275195 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:52.009186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-38419d5e-3e53-4981-98bb-951604275195 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:52.051307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38419d5e-3e53-4981-98bb-951604275195 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:52.051828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38419d5e-3e53-4981-98bb-951604275195 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:52.052269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38419d5e-3e53-4981-98bb-951604275195 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:52.052987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38419d5e-3e53-4981-98bb-951604275195 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:52.053437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38419d5e-3e53-4981-98bb-951604275195 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:52.053864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38419d5e-3e53-4981-98bb-951604275195 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:52.480862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-38419d5e-3e53-4981-98bb-951604275195 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:52.488860 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-38419d5e-3e53-4981-98bb-951604275195 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1523 microversion: 2.1 time: 0.499105 Oct 11 19:50:52.492696 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1074/2207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:51 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1523 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:52.499695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3148818d-8e30-484b-9c15-48d720ae5aab tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:52.500316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3148818d-8e30-484b-9c15-48d720ae5aab tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:52.516243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3148818d-8e30-484b-9c15-48d720ae5aab tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:52.518253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3148818d-8e30-484b-9c15-48d720ae5aab tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:52.518922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3148818d-8e30-484b-9c15-48d720ae5aab tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:52.521101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3148818d-8e30-484b-9c15-48d720ae5aab tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:52.521816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3148818d-8e30-484b-9c15-48d720ae5aab tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:52.523040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3148818d-8e30-484b-9c15-48d720ae5aab tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:53.009552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3148818d-8e30-484b-9c15-48d720ae5aab tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:53.017287 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3148818d-8e30-484b-9c15-48d720ae5aab tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1549 microversion: 2.1 time: 0.523020 Oct 11 19:50:53.036146 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1075/2208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:52 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1549 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:53.071888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-25adb5ab-fd33-463f-aeb0-8e584a85bec3 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:53.073822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-25adb5ab-fd33-463f-aeb0-8e584a85bec3 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:53.087793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:53.090028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25adb5ab-fd33-463f-aeb0-8e584a85bec3 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:53.090768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25adb5ab-fd33-463f-aeb0-8e584a85bec3 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:53.091695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25adb5ab-fd33-463f-aeb0-8e584a85bec3 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:53.093413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25adb5ab-fd33-463f-aeb0-8e584a85bec3 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:53.094029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25adb5ab-fd33-463f-aeb0-8e584a85bec3 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:53.094626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25adb5ab-fd33-463f-aeb0-8e584a85bec3 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:53.384441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-25adb5ab-fd33-463f-aeb0-8e584a85bec3 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] Lazy-loading 'services' on Instance uuid ebd21bb0-f168-4a05-ad19-6b72415fc036 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:50:53.421662 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-25adb5ab-fd33-463f-aeb0-8e584a85bec3 tempest-LiveAutoBlockMigrationV225Test-264182838 tempest-LiveAutoBlockMigrationV225Test-264182838-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1970 microversion: 2.25 time: 0.382470 Oct 11 19:50:53.431497 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1076/2209] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:53 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1970 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:53.439299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff830a0e-a542-45fc-80d9-5da12456d5d3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:53.439912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ff830a0e-a542-45fc-80d9-5da12456d5d3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:53.457664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff830a0e-a542-45fc-80d9-5da12456d5d3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:53.458079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff830a0e-a542-45fc-80d9-5da12456d5d3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:53.458515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff830a0e-a542-45fc-80d9-5da12456d5d3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:53.459239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff830a0e-a542-45fc-80d9-5da12456d5d3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:53.459691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff830a0e-a542-45fc-80d9-5da12456d5d3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:53.460354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff830a0e-a542-45fc-80d9-5da12456d5d3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:53.841961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ff830a0e-a542-45fc-80d9-5da12456d5d3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:53.849944 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ff830a0e-a542-45fc-80d9-5da12456d5d3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1314 microversion: 2.1 time: 0.414492 Oct 11 19:50:53.851291 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1077/2210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:53 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:53.860189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56622927-effe-474b-982c-a6c465149697 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:53.870404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56622927-effe-474b-982c-a6c465149697 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:53.885911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56622927-effe-474b-982c-a6c465149697 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:53.887632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56622927-effe-474b-982c-a6c465149697 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:53.890715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56622927-effe-474b-982c-a6c465149697 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:53.891475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56622927-effe-474b-982c-a6c465149697 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:53.894015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56622927-effe-474b-982c-a6c465149697 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:53.894518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56622927-effe-474b-982c-a6c465149697 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:54.033011 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56622927-effe-474b-982c-a6c465149697 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180622 Oct 11 19:50:54.041147 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1078/2211] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:50:53 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:54.046121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-2484f0db-be99-41e5-ac87-a1247ab96db5 req-04906912-79fa-4b00-a8cd-d7a7c71611aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9caeef-5fc5-41a0-83dc-49646e17b292", "name": "network-vif-plugged", "status": "completed", "tag": "88d8ed7b-6d69-48e6-b71a-a905a31d2b8d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:54.063505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2484f0db-be99-41e5-ac87-a1247ab96db5 req-04906912-79fa-4b00-a8cd-d7a7c71611aa service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:54.064778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2484f0db-be99-41e5-ac87-a1247ab96db5 req-04906912-79fa-4b00-a8cd-d7a7c71611aa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:54.067054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2484f0db-be99-41e5-ac87-a1247ab96db5 req-04906912-79fa-4b00-a8cd-d7a7c71611aa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:54.093448 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2484f0db-be99-41e5-ac87-a1247ab96db5 req-04906912-79fa-4b00-a8cd-d7a7c71611aa service nova] Creating event network-vif-plugged:88d8ed7b-6d69-48e6-b71a-a905a31d2b8d for instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 on n-h1-860864-3 Oct 11 19:50:54.105701 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-2484f0db-be99-41e5-ac87-a1247ab96db5 req-04906912-79fa-4b00-a8cd-d7a7c71611aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063022 Oct 11 19:50:54.106310 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1079/2212] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:54.126896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:54.127858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:54.136658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:54.137369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:54.137994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:54.139303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:54.139907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:54.140472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:54.174196 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] HTTP exception thrown: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Request method failure captured: Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d HTTP/1.1 Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRchnLYfPXui5is0Ao9ATjkK8VB7YNgulJR-MEALPIPGvBd--Vm7FZ-ZfNs9iLq6_kUcbcMK9Acqiw5w_kCywTbuqDqGuzyOEpp1VVtJe_Xh2SLF3sxtiUHBAbJ66ZFlGaMzv9S0ZXDwg_qzY8-VeCIogJx3Gw4ey2yP66q4agWmnjpU Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9043fe6f133c4c1d876227fa7dfcbda3 Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1342955529 Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9043fe6f133c4c1d876227fa7dfcbda3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9043fe6f133c4c1d876227fa7dfcbda3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9043fe6f133c4c1d876227fa7dfcbda3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9043fe6f133c4c1d876227fa7dfcbda3"}]}] Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1342955529 Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9043fe6f133c4c1d876227fa7dfcbda3 Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1342955529 Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachSCSIVolumeTestJSON-1342955529-project Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 69553a727c3147f2bbaf203f17419830 Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1342955529-project Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '21319341-f8a9-4972-88e3-13e7c5f6397d'} Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:50:54.178287 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:54.182842 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:54.187886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Returning 404 to user: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:50:54.189005 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c59a9144-9cfe-4c1b-b0c7-92dae619a29a tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "DELETE /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 404 len: 111 microversion: 2.1 time: 0.068256 Oct 11 19:50:54.193101 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1080/2213] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:50:54 2022] DELETE /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:50:54.197491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b180b555-0cbf-4cd7-a3ad-e8b97ba7389a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:54.198004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b180b555-0cbf-4cd7-a3ad-e8b97ba7389a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:54.216000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b180b555-0cbf-4cd7-a3ad-e8b97ba7389a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:54.216793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b180b555-0cbf-4cd7-a3ad-e8b97ba7389a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:54.217250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b180b555-0cbf-4cd7-a3ad-e8b97ba7389a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:54.218019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b180b555-0cbf-4cd7-a3ad-e8b97ba7389a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:54.218467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b180b555-0cbf-4cd7-a3ad-e8b97ba7389a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:54.219140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b180b555-0cbf-4cd7-a3ad-e8b97ba7389a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:54.250204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b180b555-0cbf-4cd7-a3ad-e8b97ba7389a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:50:54.511787 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b180b555-0cbf-4cd7-a3ad-e8b97ba7389a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 204 len: 0 microversion: 2.25 time: 0.315845 Oct 11 19:50:54.526736 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1081/2214] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:50:54 2022] DELETE /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:50:54.543094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-59a144af-de79-400d-ae10-1477c94d4928 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:54.544207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-59a144af-de79-400d-ae10-1477c94d4928 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:54.553234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a144af-de79-400d-ae10-1477c94d4928 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:54.555417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a144af-de79-400d-ae10-1477c94d4928 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:54.556098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a144af-de79-400d-ae10-1477c94d4928 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:54.557320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a144af-de79-400d-ae10-1477c94d4928 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:54.558760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a144af-de79-400d-ae10-1477c94d4928 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:54.559412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a144af-de79-400d-ae10-1477c94d4928 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:55.239465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-59a144af-de79-400d-ae10-1477c94d4928 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:55.252001 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-59a144af-de79-400d-ae10-1477c94d4928 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1523 microversion: 2.1 time: 0.723411 Oct 11 19:50:55.255021 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1082/2215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:54 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1523 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:55.260491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:55.261110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] [instance: 21319341-f8a9-4972-88e3-13e7c5f6397d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:55.268087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:55.269234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:55.269708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:55.270416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:55.270918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:55.271392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:55.291783 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] HTTP exception thrown: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Request method failure captured: Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d HTTP/1.1 Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRchnLYfPXui5is0Ao9ATjkK8VB7YNgulJR-MEALPIPGvBd--Vm7FZ-ZfNs9iLq6_kUcbcMK9Acqiw5w_kCywTbuqDqGuzyOEpp1VVtJe_Xh2SLF3sxtiUHBAbJ66ZFlGaMzv9S0ZXDwg_qzY8-VeCIogJx3Gw4ey2yP66q4agWmnjpU Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9043fe6f133c4c1d876227fa7dfcbda3 Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1342955529 Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9043fe6f133c4c1d876227fa7dfcbda3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9043fe6f133c4c1d876227fa7dfcbda3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9043fe6f133c4c1d876227fa7dfcbda3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9043fe6f133c4c1d876227fa7dfcbda3"}]}] Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1342955529 Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9043fe6f133c4c1d876227fa7dfcbda3 Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1342955529 Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachSCSIVolumeTestJSON-1342955529-project Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 69553a727c3147f2bbaf203f17419830 Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1342955529-project Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '21319341-f8a9-4972-88e3-13e7c5f6397d'} Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:55.294206 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:55.297688 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:55.297688 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:55.297688 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:55.297688 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:50:55.297688 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:50:55.297688 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. Oct 11 19:50:55.297688 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:55.299337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] Returning 404 to user: Instance 21319341-f8a9-4972-88e3-13e7c5f6397d could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:50:55.300221 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-199e1a5a-ca85-48bd-a1e7-4f6a8596ebc2 tempest-AttachSCSIVolumeTestJSON-1342955529 tempest-AttachSCSIVolumeTestJSON-1342955529-project] 10.222.0.27 "GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d" status: 404 len: 111 microversion: 2.1 time: 0.044055 Oct 11 19:50:55.300802 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1083/2216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:55 2022] GET /compute/v2.1/servers/21319341-f8a9-4972-88e3-13e7c5f6397d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:50:55.305950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1254631c-da70-4505-86b2-4012f7d53ed5 req-01b46a07-9a0a-4c8f-8f53-5dbeff186dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a52feaa-0925-49de-bb88-68790063b724", "tag": "e9769511-f249-4f8b-83a8-d2aa8cbf950e"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:55.315982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1254631c-da70-4505-86b2-4012f7d53ed5 req-01b46a07-9a0a-4c8f-8f53-5dbeff186dde service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:55.316387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1254631c-da70-4505-86b2-4012f7d53ed5 req-01b46a07-9a0a-4c8f-8f53-5dbeff186dde service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:55.317071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1254631c-da70-4505-86b2-4012f7d53ed5 req-01b46a07-9a0a-4c8f-8f53-5dbeff186dde service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:55.335352 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1254631c-da70-4505-86b2-4012f7d53ed5 req-01b46a07-9a0a-4c8f-8f53-5dbeff186dde service nova] Creating event network-changed:e9769511-f249-4f8b-83a8-d2aa8cbf950e for instance 5a52feaa-0925-49de-bb88-68790063b724 on n-h2-860864-3 Oct 11 19:50:55.342864 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1254631c-da70-4505-86b2-4012f7d53ed5 req-01b46a07-9a0a-4c8f-8f53-5dbeff186dde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040800 Oct 11 19:50:55.343788 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1084/2217] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:55.355046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:55.355756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:55.371137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:55.372118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:55.373389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:55.374438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:55.375098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:55.375677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:55.442725 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e2054135-9021-4115-8f55-cfe85dd53a88 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.117898 Oct 11 19:50:55.452383 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1134/2218] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:50:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:55.458051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-48444a17-3cb5-4e82-8076-f6e0482219b3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:55.458865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-48444a17-3cb5-4e82-8076-f6e0482219b3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:55.466569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48444a17-3cb5-4e82-8076-f6e0482219b3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:55.467285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48444a17-3cb5-4e82-8076-f6e0482219b3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:55.467869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48444a17-3cb5-4e82-8076-f6e0482219b3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:55.469670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48444a17-3cb5-4e82-8076-f6e0482219b3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:55.470462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48444a17-3cb5-4e82-8076-f6e0482219b3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:55.471522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48444a17-3cb5-4e82-8076-f6e0482219b3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:55.717366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:55.725812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:55.727875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:55.729035 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-234db0eb-5495-4254-a0b1-656fde60328f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1483 microversion: 2.25 time: 0.384168 Oct 11 19:50:55.734801 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1085/2219] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:55 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1483 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:55.805538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-48444a17-3cb5-4e82-8076-f6e0482219b3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:55.820219 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-48444a17-3cb5-4e82-8076-f6e0482219b3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1314 microversion: 2.1 time: 0.361994 Oct 11 19:50:55.821673 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1135/2220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:55 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:55.843141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-72dbffc0-0987-49c1-adac-6fdb932fc5d8 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Action: 'create', calling method: .version_select at 0x7f83cc9f24c0>, body: {"pool": null} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:55.963687 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d5e1e1c6-4ec4-40a7-acb9-5f70e877ec12 tempest-TenantUsagesNegativeTestJSON-2006032900 tempest-TenantUsagesNegativeTestJSON-2006032900-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-10T19%3A50%3A54.870171&end=2022-10-12T19%3A50%3A54.870171" status: 404 len: 112 microversion: - time: 0.232519 Oct 11 19:50:55.964908 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1086/2221] 10.222.0.27 () {58 vars in 1316 bytes} [Tue Oct 11 19:50:55 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-10T19%3A50%3A54.870171&end=2022-10-12T19%3A50%3A54.870171 => generated 112 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 19:50:55.973939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-66140c1d-b674-4fe8-b72d-6d4e2c362fe1 tempest-TenantUsagesNegativeTestJSON-2006032900 tempest-TenantUsagesNegativeTestJSON-2006032900-project-admin] Calling method '.version_select at 0x7f83cc193a60>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:55.983469 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-66140c1d-b674-4fe8-b72d-6d4e2c362fe1 tempest-TenantUsagesNegativeTestJSON-2006032900 tempest-TenantUsagesNegativeTestJSON-2006032900-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-66140c1d-b674-4fe8-b72d-6d4e2c362fe1 tempest-TenantUsagesNegativeTestJSON-2006032900 tempest-TenantUsagesNegativeTestJSON-2006032900-project-admin] Request method failure captured: Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-simple-tenant-usage/09004ed39b174543928f73f935551a72?start=2022-10-12T19%3A50%3A54.870171&end=2022-10-10T19%3A50%3A54.870171 HTTP/1.1 Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRckegDCyZuq02yTKrVvLvBozGgmXEYTT3lSqusDpJrNqWqAGyZJqExcZwpDkS2RdoH-pMAzT4q0jVC_EoDoiZh0k1D2OGBX8N8wqOZn144tLE0idJYk5O04HOLH0AWV5Q8sx0mEb7rgizJ3CYFKVE92wznZafoC8uEI8taocrMZzeFE Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bea13b68aef84a45999099f18695274d Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2006032900 Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bea13b68aef84a45999099f18695274d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bea13b68aef84a45999099f18695274d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bea13b68aef84a45999099f18695274d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bea13b68aef84a45999099f18695274d"}]}] Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2006032900 Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bea13b68aef84a45999099f18695274d Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2006032900 Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TenantUsagesNegativeTestJSON-2006032900-project-admin Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a94001deb02244bfa68d90d4e835c96a Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2006032900-project-admin Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid start time. The start time cannot occur after the end time. Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '09004ed39b174543928f73f935551a72'} Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 11 19:50:56.000079 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:56.003035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-66140c1d-b674-4fe8-b72d-6d4e2c362fe1 tempest-TenantUsagesNegativeTestJSON-2006032900 tempest-TenantUsagesNegativeTestJSON-2006032900-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:50:56.003035 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-66140c1d-b674-4fe8-b72d-6d4e2c362fe1 tempest-TenantUsagesNegativeTestJSON-2006032900 tempest-TenantUsagesNegativeTestJSON-2006032900-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/09004ed39b174543928f73f935551a72?start=2022-10-12T19%3A50%3A54.870171&end=2022-10-10T19%3A50%3A54.870171" status: 400 len: 111 microversion: 2.1 time: 0.031559 Oct 11 19:50:56.003911 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1087/2222] 10.222.0.27 () {58 vars in 1412 bytes} [Tue Oct 11 19:50:55 2022] GET /compute/v2.1/os-simple-tenant-usage/09004ed39b174543928f73f935551a72?start=2022-10-12T19%3A50%3A54.870171&end=2022-10-10T19%3A50%3A54.870171 => generated 111 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:50:56.154934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f86293cc-1c32-4c85-8dbb-7a31573ad0d2 tempest-TenantUsagesNegativeTestJSON-334410181 tempest-TenantUsagesNegativeTestJSON-334410181-project] Calling method '.version_select at 0x7f83cc1b9160>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:56.158883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f86293cc-1c32-4c85-8dbb-7a31573ad0d2 tempest-TenantUsagesNegativeTestJSON-334410181 tempest-TenantUsagesNegativeTestJSON-334410181-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'c55ce6b499ab4a4695b5d96222e95d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09004ed39b174543928f73f935551a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f86293cc-1c32-4c85-8dbb-7a31573ad0d2 tempest-TenantUsagesNegativeTestJSON-334410181 tempest-TenantUsagesNegativeTestJSON-334410181-project] Request method failure captured: Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T19%3A50%3A54.870171&end=2022-10-12T19%3A50%3A54.870171&detailed=1 HTTP/1.1 Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRckdta5pfTln1x9lRKLX_3YR-KPdYID2exHBfLIjORKDPC_uvG7cBmFOTFT5iafuR9TQWxJcGGwKzSDizepgAMTshs37-Yw9AYYiFGc4EJ2SClN9jbVXp7Dm-3tAVkj-DVyr1AhWcI2TVAErtSuDQScMd0fr3cVKsUimi19o0KUvmjo Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 09004ed39b174543928f73f935551a72 Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-334410181 Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09004ed39b174543928f73f935551a72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09004ed39b174543928f73f935551a72", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09004ed39b174543928f73f935551a72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09004ed39b174543928f73f935551a72"}]}] Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-334410181 Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 09004ed39b174543928f73f935551a72 Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-334410181 Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TenantUsagesNegativeTestJSON-334410181-project Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: c55ce6b499ab4a4695b5d96222e95d01 Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-334410181-project Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: action_args: {} Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 19:50:56.161441 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f86293cc-1c32-4c85-8dbb-7a31573ad0d2 tempest-TenantUsagesNegativeTestJSON-334410181 tempest-TenantUsagesNegativeTestJSON-334410181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f86293cc-1c32-4c85-8dbb-7a31573ad0d2 tempest-TenantUsagesNegativeTestJSON-334410181 tempest-TenantUsagesNegativeTestJSON-334410181-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T19%3A50%3A54.870171&end=2022-10-12T19%3A50%3A54.870171&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.152990 Oct 11 19:50:56.165053 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1088/2223] 10.222.0.27 () {58 vars in 1335 bytes} [Tue Oct 11 19:50:56 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T19%3A50%3A54.870171&end=2022-10-12T19%3A50%3A54.870171&detailed=1 => generated 123 bytes in 154 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:50:56.281385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d67f2867-5c22-4847-b182-f864b9910800 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:56.283249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d67f2867-5c22-4847-b182-f864b9910800 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:56.292717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d67f2867-5c22-4847-b182-f864b9910800 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:56.293469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d67f2867-5c22-4847-b182-f864b9910800 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:56.294121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d67f2867-5c22-4847-b182-f864b9910800 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:56.295069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d67f2867-5c22-4847-b182-f864b9910800 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:56.296030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d67f2867-5c22-4847-b182-f864b9910800 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:56.296644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d67f2867-5c22-4847-b182-f864b9910800 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:56.658836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d67f2867-5c22-4847-b182-f864b9910800 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:56.675200 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d67f2867-5c22-4847-b182-f864b9910800 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1523 microversion: 2.1 time: 0.401508 Oct 11 19:50:56.690950 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1089/2224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:56 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:56.759524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:56.760239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:56.767466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:56.768055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:56.768555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:56.769324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:56.769845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:56.770361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:56.787803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:57.015454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:57.033830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:57.037841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:57.040669 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f11f3d59-b6b1-44d7-bf8e-e2c82c234346 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1483 microversion: 2.25 time: 0.286340 Oct 11 19:50:57.056919 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1090/2225] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:56 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1483 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:50:57.056919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0b45ce19-b77b-492e-b05e-9223da86485a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:57.056919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0b45ce19-b77b-492e-b05e-9223da86485a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:57.068553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b45ce19-b77b-492e-b05e-9223da86485a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:57.069084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b45ce19-b77b-492e-b05e-9223da86485a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:57.069525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b45ce19-b77b-492e-b05e-9223da86485a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:57.070246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b45ce19-b77b-492e-b05e-9223da86485a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:57.071310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b45ce19-b77b-492e-b05e-9223da86485a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:57.072841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b45ce19-b77b-492e-b05e-9223da86485a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:57.338372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0b45ce19-b77b-492e-b05e-9223da86485a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:57.348690 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0b45ce19-b77b-492e-b05e-9223da86485a tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1501 microversion: 2.1 time: 0.306151 Oct 11 19:50:57.349825 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1091/2226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:57 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1501 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:57.357665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7cba7ea6-a68b-4a85-9045-cc8023fbdf43 req-a7d33f84-cff9-4703-93f5-93eed855dc2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db170ae-e6b1-4057-8d54-6bba8c210919", "tag": "3780f4c2-abd7-4eed-a9ea-b6d199050677"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:57.371166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7cba7ea6-a68b-4a85-9045-cc8023fbdf43 req-a7d33f84-cff9-4703-93f5-93eed855dc2f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:57.371978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7cba7ea6-a68b-4a85-9045-cc8023fbdf43 req-a7d33f84-cff9-4703-93f5-93eed855dc2f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:57.373167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7cba7ea6-a68b-4a85-9045-cc8023fbdf43 req-a7d33f84-cff9-4703-93f5-93eed855dc2f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:57.406098 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7cba7ea6-a68b-4a85-9045-cc8023fbdf43 req-a7d33f84-cff9-4703-93f5-93eed855dc2f service nova] Creating event network-changed:3780f4c2-abd7-4eed-a9ea-b6d199050677 for instance 5db170ae-e6b1-4057-8d54-6bba8c210919 on n-h2-860864-3 Oct 11 19:50:57.418424 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7cba7ea6-a68b-4a85-9045-cc8023fbdf43 req-a7d33f84-cff9-4703-93f5-93eed855dc2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066891 Oct 11 19:50:57.419101 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1092/2227] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:57.431648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21d25bf7-0fdf-46fc-913f-970db1b8f7be tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:57.439239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-21d25bf7-0fdf-46fc-913f-970db1b8f7be tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:57.456480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d25bf7-0fdf-46fc-913f-970db1b8f7be tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:57.458054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d25bf7-0fdf-46fc-913f-970db1b8f7be tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:57.462288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d25bf7-0fdf-46fc-913f-970db1b8f7be tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:57.463547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d25bf7-0fdf-46fc-913f-970db1b8f7be tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:57.464185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d25bf7-0fdf-46fc-913f-970db1b8f7be tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:57.465317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21d25bf7-0fdf-46fc-913f-970db1b8f7be tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:57.533277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-21d25bf7-0fdf-46fc-913f-970db1b8f7be tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lazy-loading 'flavor' on Instance uuid 2c9caeef-5fc5-41a0-83dc-49646e17b292 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:50:57.572940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=28 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:57.592580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=28 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:57.709050 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21d25bf7-0fdf-46fc-913f-970db1b8f7be tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "POST /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292/action" status: 202 len: 0 microversion: 2.1 time: 0.288517 Oct 11 19:50:57.712055 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1093/2228] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:50:57 2022] POST /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:50:57.726232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6274f4db-37a6-476a-902d-f34aea87323b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:57.727024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6274f4db-37a6-476a-902d-f34aea87323b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:57.740170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274f4db-37a6-476a-902d-f34aea87323b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:57.741798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274f4db-37a6-476a-902d-f34aea87323b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:57.742292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274f4db-37a6-476a-902d-f34aea87323b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:57.744598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274f4db-37a6-476a-902d-f34aea87323b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:57.746688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274f4db-37a6-476a-902d-f34aea87323b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:57.747141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274f4db-37a6-476a-902d-f34aea87323b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:58.047280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6274f4db-37a6-476a-902d-f34aea87323b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:58.068521 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6274f4db-37a6-476a-902d-f34aea87323b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1523 microversion: 2.1 time: 0.355104 Oct 11 19:50:58.078667 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1094/2229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:57 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:58.088700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-68b64f10-40f7-4f6c-bcda-c8ade5f9043f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:58.097344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-68b64f10-40f7-4f6c-bcda-c8ade5f9043f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:58.105114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b64f10-40f7-4f6c-bcda-c8ade5f9043f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:58.105625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b64f10-40f7-4f6c-bcda-c8ade5f9043f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:58.106083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b64f10-40f7-4f6c-bcda-c8ade5f9043f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:58.106833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b64f10-40f7-4f6c-bcda-c8ade5f9043f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:58.107300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b64f10-40f7-4f6c-bcda-c8ade5f9043f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:58.107723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b64f10-40f7-4f6c-bcda-c8ade5f9043f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:58.210026 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-72dbffc0-0987-49c1-adac-6fdb932fc5d8 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.387203 Oct 11 19:50:58.210650 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1136/2230] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:50:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:58.223672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2be59cc6-e3d6-453c-8e16-9e0272abf877 req-dcea3c88-8662-4bab-924e-14f2d5c13859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd21bb0-f168-4a05-ad19-6b72415fc036", "name": "network-vif-deleted", "tag": "7c1948ab-cfd5-4292-93ea-b18935d2b086"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:58.242201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2be59cc6-e3d6-453c-8e16-9e0272abf877 req-dcea3c88-8662-4bab-924e-14f2d5c13859 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:58.243706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2be59cc6-e3d6-453c-8e16-9e0272abf877 req-dcea3c88-8662-4bab-924e-14f2d5c13859 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:58.244282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2be59cc6-e3d6-453c-8e16-9e0272abf877 req-dcea3c88-8662-4bab-924e-14f2d5c13859 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:58.281355 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2be59cc6-e3d6-453c-8e16-9e0272abf877 req-dcea3c88-8662-4bab-924e-14f2d5c13859 service nova] Creating event network-vif-deleted:7c1948ab-cfd5-4292-93ea-b18935d2b086 for instance ebd21bb0-f168-4a05-ad19-6b72415fc036 on n-h1-860864-3 Oct 11 19:50:58.292099 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2be59cc6-e3d6-453c-8e16-9e0272abf877 req-dcea3c88-8662-4bab-924e-14f2d5c13859 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072113 Oct 11 19:50:58.297917 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1137/2231] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:50:58.303496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:58.304218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:58.323852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:58.324374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:58.326428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:58.327427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:58.327865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:58.330504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:58.411266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68b64f10-40f7-4f6c-bcda-c8ade5f9043f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:58.421973 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-68b64f10-40f7-4f6c-bcda-c8ade5f9043f tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1509 microversion: 2.1 time: 0.350933 Oct 11 19:50:58.423790 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1095/2232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:58 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1509 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:50:58.431806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8fb538db-fe85-4d98-b68a-2d219eac2e62 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Action: 'create', calling method: .version_select at 0x7f83c7adad30>, body: {"pool": null} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:50:58.472756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:58.483477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:58.492060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:58.494202 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-63458e6e-386a-4803-80ff-0f0495eb0412 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1266 microversion: 2.25 time: 0.194904 Oct 11 19:50:58.499748 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1138/2233] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:50:58 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:50:59.096269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1162bad5-ab7b-48f4-af95-6964d5a8f0a8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:59.097062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1162bad5-ab7b-48f4-af95-6964d5a8f0a8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:59.109198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1162bad5-ab7b-48f4-af95-6964d5a8f0a8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:59.109872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1162bad5-ab7b-48f4-af95-6964d5a8f0a8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:59.110422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1162bad5-ab7b-48f4-af95-6964d5a8f0a8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:59.113411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1162bad5-ab7b-48f4-af95-6964d5a8f0a8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:59.114017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1162bad5-ab7b-48f4-af95-6964d5a8f0a8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:59.116353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1162bad5-ab7b-48f4-af95-6964d5a8f0a8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:59.464156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1162bad5-ab7b-48f4-af95-6964d5a8f0a8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:50:59.478188 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1162bad5-ab7b-48f4-af95-6964d5a8f0a8 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1523 microversion: 2.1 time: 0.385001 Oct 11 19:50:59.500344 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1139/2234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:59 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:50:59.500344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-02a3c4dc-f636-4ca8-89e9-0d84fd938c5b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:50:59.500344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-02a3c4dc-f636-4ca8-89e9-0d84fd938c5b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:50:59.521267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=18 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:50:59.525818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a3c4dc-f636-4ca8-89e9-0d84fd938c5b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:59.526612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a3c4dc-f636-4ca8-89e9-0d84fd938c5b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:59.527164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a3c4dc-f636-4ca8-89e9-0d84fd938c5b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:59.528058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a3c4dc-f636-4ca8-89e9-0d84fd938c5b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:50:59.528714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a3c4dc-f636-4ca8-89e9-0d84fd938c5b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:50:59.528945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a3c4dc-f636-4ca8-89e9-0d84fd938c5b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:50:59.806921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=15 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:00.348431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-02a3c4dc-f636-4ca8-89e9-0d84fd938c5b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:00.358925 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-02a3c4dc-f636-4ca8-89e9-0d84fd938c5b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1492 microversion: 2.1 time: 0.870202 Oct 11 19:51:00.360715 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1140/2235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:50:59 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1492 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:00.365546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:00.370077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:00.376689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:00.379288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:00.380141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:00.383448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:00.385790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:00.387189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:00.619113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:00.638258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:00.640960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:00.642377 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e06fe55b-0404-4310-8d33-a915e5f5848a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1266 microversion: 2.25 time: 0.280581 Oct 11 19:51:00.643677 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1141/2236] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:00 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:00.651273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87f190bc-da97-45ea-ac72-d4f4e1eb2e9b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:00.652093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-87f190bc-da97-45ea-ac72-d4f4e1eb2e9b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:00.658706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87f190bc-da97-45ea-ac72-d4f4e1eb2e9b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:00.659931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87f190bc-da97-45ea-ac72-d4f4e1eb2e9b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:00.660587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87f190bc-da97-45ea-ac72-d4f4e1eb2e9b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:00.662149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87f190bc-da97-45ea-ac72-d4f4e1eb2e9b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:00.663888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87f190bc-da97-45ea-ac72-d4f4e1eb2e9b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:00.665335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87f190bc-da97-45ea-ac72-d4f4e1eb2e9b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:00.709270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-87f190bc-da97-45ea-ac72-d4f4e1eb2e9b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:51:00.820873 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87f190bc-da97-45ea-ac72-d4f4e1eb2e9b tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 204 len: 0 microversion: 2.1 time: 0.173969 Oct 11 19:51:00.822057 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1142/2237] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:00 2022] DELETE /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:51:00.827948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd5ef2c5-6bda-43a2-9559-0672907df02c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:00.829076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fd5ef2c5-6bda-43a2-9559-0672907df02c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:00.837376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd5ef2c5-6bda-43a2-9559-0672907df02c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:00.838360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd5ef2c5-6bda-43a2-9559-0672907df02c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:00.839028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd5ef2c5-6bda-43a2-9559-0672907df02c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:00.840021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd5ef2c5-6bda-43a2-9559-0672907df02c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:00.840619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd5ef2c5-6bda-43a2-9559-0672907df02c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:00.841347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd5ef2c5-6bda-43a2-9559-0672907df02c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:01.233699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fd5ef2c5-6bda-43a2-9559-0672907df02c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:01.237420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:01.247720 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fd5ef2c5-6bda-43a2-9559-0672907df02c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1523 microversion: 2.1 time: 0.423935 Oct 11 19:51:01.248799 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1143/2238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:00 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1523 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:01.253775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c2a394d1-0523-4369-980f-3bc2a7386034 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:01.258778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c2a394d1-0523-4369-980f-3bc2a7386034 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:01.284246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a394d1-0523-4369-980f-3bc2a7386034 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:01.290068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a394d1-0523-4369-980f-3bc2a7386034 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:01.290880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a394d1-0523-4369-980f-3bc2a7386034 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:01.291821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a394d1-0523-4369-980f-3bc2a7386034 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:01.292527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a394d1-0523-4369-980f-3bc2a7386034 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:01.295143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2a394d1-0523-4369-980f-3bc2a7386034 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:01.403179 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8fb538db-fe85-4d98-b68a-2d219eac2e62 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.975469 Oct 11 19:51:01.406187 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1096/2239] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:50:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:01.422471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a9a3203-ad04-4a8e-b1af-496b3ded5373 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Action: 'create', calling method: .version_select at 0x7f83cc1ffee0>, body: {"pool": null} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:01.640778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c2a394d1-0523-4369-980f-3bc2a7386034 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:01.657844 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c2a394d1-0523-4369-980f-3bc2a7386034 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1498 microversion: 2.1 time: 0.406185 Oct 11 19:51:01.658468 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1144/2240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:01 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1498 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:01.672884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:01.673505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:01.686979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:01.688700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:01.689327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:01.690240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:01.692116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:01.693485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:01.844316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:01.866401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:01.870016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:01.872253 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d5fecc4a-d523-4b70-add8-ed5afefaf6f3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1266 microversion: 2.25 time: 0.204545 Oct 11 19:51:01.875341 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1145/2241] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:01 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:02.273147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7cf157b8-d40d-40f5-831c-891bdc8ab2ea tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:02.274412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7cf157b8-d40d-40f5-831c-891bdc8ab2ea tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:02.283579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf157b8-d40d-40f5-831c-891bdc8ab2ea tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:02.284644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf157b8-d40d-40f5-831c-891bdc8ab2ea tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:02.306290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf157b8-d40d-40f5-831c-891bdc8ab2ea tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:02.310027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf157b8-d40d-40f5-831c-891bdc8ab2ea tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:02.311325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf157b8-d40d-40f5-831c-891bdc8ab2ea tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:02.312516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf157b8-d40d-40f5-831c-891bdc8ab2ea tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:02.702930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7cf157b8-d40d-40f5-831c-891bdc8ab2ea tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:02.717702 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7cf157b8-d40d-40f5-831c-891bdc8ab2ea tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1523 microversion: 2.1 time: 0.448153 Oct 11 19:51:02.762935 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1146/2242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:02 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:51:02.795746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-770d4f23-b061-4abc-a0e6-e3c3f5940bc0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:02.797347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-770d4f23-b061-4abc-a0e6-e3c3f5940bc0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:02.827440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-770d4f23-b061-4abc-a0e6-e3c3f5940bc0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:02.830113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-770d4f23-b061-4abc-a0e6-e3c3f5940bc0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:02.830827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-770d4f23-b061-4abc-a0e6-e3c3f5940bc0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:02.835446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-770d4f23-b061-4abc-a0e6-e3c3f5940bc0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:02.837162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-770d4f23-b061-4abc-a0e6-e3c3f5940bc0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:02.838371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-770d4f23-b061-4abc-a0e6-e3c3f5940bc0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:03.454132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-770d4f23-b061-4abc-a0e6-e3c3f5940bc0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:03.467982 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-770d4f23-b061-4abc-a0e6-e3c3f5940bc0 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1498 microversion: 2.1 time: 0.697495 Oct 11 19:51:03.468563 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1147/2243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:02 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1498 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:03.496621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:03.497578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:03.504086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:03.504752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:03.505323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:03.506151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:03.506764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:03.507298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:03.636307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:03.662941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:03.668392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:03.674205 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fab07740-8922-41c8-9d88-8a017ea8e8fa tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1266 microversion: 2.25 time: 0.183338 Oct 11 19:51:03.675488 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1148/2244] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:03 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:03.753771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe8e37b8-e07e-4c57-a93c-75d5c738082a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:03.755247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fe8e37b8-e07e-4c57-a93c-75d5c738082a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:03.766427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:03.770452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe8e37b8-e07e-4c57-a93c-75d5c738082a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:03.771021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe8e37b8-e07e-4c57-a93c-75d5c738082a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:03.771533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe8e37b8-e07e-4c57-a93c-75d5c738082a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:03.772250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe8e37b8-e07e-4c57-a93c-75d5c738082a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:03.772708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe8e37b8-e07e-4c57-a93c-75d5c738082a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:03.773142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe8e37b8-e07e-4c57-a93c-75d5c738082a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:04.532970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe8e37b8-e07e-4c57-a93c-75d5c738082a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:04.546274 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fe8e37b8-e07e-4c57-a93c-75d5c738082a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1523 microversion: 2.1 time: 0.800850 Oct 11 19:51:04.549400 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1149/2245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:03 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1523 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:04.559248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-14365a97-e33a-4dd4-a977-e222fa0390a1 req-a0c25549-7305-4f59-9915-7fc7f49c00e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9caeef-5fc5-41a0-83dc-49646e17b292", "name": "network-vif-deleted", "tag": "88d8ed7b-6d69-48e6-b71a-a905a31d2b8d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:04.588211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-14365a97-e33a-4dd4-a977-e222fa0390a1 req-a0c25549-7305-4f59-9915-7fc7f49c00e6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:04.588754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-14365a97-e33a-4dd4-a977-e222fa0390a1 req-a0c25549-7305-4f59-9915-7fc7f49c00e6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:04.589440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-14365a97-e33a-4dd4-a977-e222fa0390a1 req-a0c25549-7305-4f59-9915-7fc7f49c00e6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:04.613094 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-14365a97-e33a-4dd4-a977-e222fa0390a1 req-a0c25549-7305-4f59-9915-7fc7f49c00e6 service nova] Creating event network-vif-deleted:88d8ed7b-6d69-48e6-b71a-a905a31d2b8d for instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 on n-h1-860864-3 Oct 11 19:51:04.625019 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-14365a97-e33a-4dd4-a977-e222fa0390a1 req-a0c25549-7305-4f59-9915-7fc7f49c00e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074053 Oct 11 19:51:04.625631 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1150/2246] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:04.635946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:04.636656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:04.701114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:04.701775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:04.702114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:04.711926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:04.712470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:04.716290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:04.811144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:04.811731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:04.812540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:04.812674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lazy-loading 'fault' on Instance uuid 2c9caeef-5fc5-41a0-83dc-49646e17b292 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:51:05.386479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8494488a13a3496eb59a8062479816bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be070f1da3c0467daf15d6b120df125e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:05.395223 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7827f9f1-b2e8-4483-adf5-83460ddc4e14 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 200 len: 1304 microversion: 2.1 time: 0.768395 Oct 11 19:51:05.397504 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1151/2247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:04 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 1304 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:05.409458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:05.410280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:05.444945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:05.447683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:05.448160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:05.448886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:05.449337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:05.449763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:05.596704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:05.597585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:05.598908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:05.599667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lazy-loading 'fault' on Instance uuid ebd21bb0-f168-4a05-ad19-6b72415fc036 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:51:06.071150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:06.097872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:06.100914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:06.118731 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aacd8e2a-f8d8-41a4-a95a-1a9432b5fbb3 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 200 len: 1194 microversion: 2.25 time: 0.704174 Oct 11 19:51:06.121643 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1152/2248] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:05 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 1194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:06.143353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7398c47-d5c2-4889-9639-d47d08bd4ff6 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:06.144271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7398c47-d5c2-4889-9639-d47d08bd4ff6 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:06.167037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7398c47-d5c2-4889-9639-d47d08bd4ff6 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:06.167785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7398c47-d5c2-4889-9639-d47d08bd4ff6 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:06.168380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7398c47-d5c2-4889-9639-d47d08bd4ff6 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:06.169252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7398c47-d5c2-4889-9639-d47d08bd4ff6 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:06.169860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7398c47-d5c2-4889-9639-d47d08bd4ff6 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:06.170437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7398c47-d5c2-4889-9639-d47d08bd4ff6 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:06.215795 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a9a3203-ad04-4a8e-b1af-496b3ded5373 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.798900 Oct 11 19:51:06.220773 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1097/2249] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:51:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:06.236845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e608635-4fed-49c4-956d-9924e2d0a61f tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Calling method '.version_select at 0x7f83cc252670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:06.614917 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e608635-4fed-49c4-956d-9924e2d0a61f tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/eb65c899-6f34-4577-b6c0-6d166aa70a62" status: 200 len: 142 microversion: 2.1 time: 0.383731 Oct 11 19:51:06.625493 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1098/2250] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:51:06 2022] GET /compute/v2.1/os-floating-ips/eb65c899-6f34-4577-b6c0-6d166aa70a62 => generated 142 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:06.633967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:06.635152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:06.642966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:06.649597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:06.650249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:06.651183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:06.651404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b7398c47-d5c2-4889-9639-d47d08bd4ff6 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:06.651798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:06.652228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:06.667584 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7398c47-d5c2-4889-9639-d47d08bd4ff6 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1500 microversion: 2.1 time: 0.543162 Oct 11 19:51:06.668948 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1153/2251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:06 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1500 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:06.686252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2b4ca003-0ece-442a-8c72-da73ba4278ba tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Calling method '.version_select at 0x7f83cc9fca60>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:06.696430 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 HTTP/1.1 Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '2c9caeef-5fc5-41a0-83dc-49646e17b292'} Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:06.698330 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:06.702092 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:06.702092 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:06.702092 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:06.702092 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:06.702092 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:06.702092 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:06.702092 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:06.702092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:06.702092 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a1104daa-bb26-4cf8-8eaa-53ad125faa61 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 404 len: 111 microversion: 2.1 time: 0.071169 Oct 11 19:51:06.702092 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1099/2252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:06 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:06.710864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:06.716527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:06.717349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:51:06.740582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:06.741075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:06.741506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:06.742261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:06.742889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:06.743908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:06.876321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:51:07.009275 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5feaff9e-8c8c-44e0-b02b-d517608495c1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.306935 Oct 11 19:51:07.009913 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1100/2253] 10.222.0.27 () {58 vars in 1154 bytes} [Tue Oct 11 19:51:06 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:07.020287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:07.021043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:07.027972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:07.028721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:07.029338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:07.030218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:07.030905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:07.031522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:07.053659 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 HTTP/1.1 Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '2c9caeef-5fc5-41a0-83dc-49646e17b292'} Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:07.055710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:07.058943 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.060996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:07.062751 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7710a233-429f-4212-bc6f-c44ace4d3ade tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 404 len: 111 microversion: 2.1 time: 0.051203 Oct 11 19:51:07.063839 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1101/2254] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:07 2022] DELETE /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:07.069584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6e944f3a-2d2c-4cba-85a8-c3758af209a4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:07.076988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e944f3a-2d2c-4cba-85a8-c3758af209a4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:07.078380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e944f3a-2d2c-4cba-85a8-c3758af209a4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:07.079075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e944f3a-2d2c-4cba-85a8-c3758af209a4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:07.103844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6e944f3a-2d2c-4cba-85a8-c3758af209a4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Going to try to start instance {{(pid=126955) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 19:51:07.166019 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6e944f3a-2d2c-4cba-85a8-c3758af209a4 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "POST /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02/action" status: 202 len: 0 microversion: 2.1 time: 0.100307 Oct 11 19:51:07.169450 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1102/2255] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:51:07 2022] POST /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:51:07.174983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:07.175979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 2c9caeef-5fc5-41a0-83dc-49646e17b292] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:07.183605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:07.187317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:07.187623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:07.188350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:07.188816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:07.189237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:07.218005 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 HTTP/1.1 Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '2c9caeef-5fc5-41a0-83dc-49646e17b292'} Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:07.219856 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.223130 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:07.223130 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:07.223130 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:07.223130 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:07.223130 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:07.223130 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. Oct 11 19:51:07.223130 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.224678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 2c9caeef-5fc5-41a0-83dc-49646e17b292 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:07.225738 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4adc6159-5c35-4c95-8216-0a8db2656cff tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292" status: 404 len: 111 microversion: 2.1 time: 0.054976 Oct 11 19:51:07.227328 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1103/2256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:07 2022] GET /compute/v2.1/servers/2c9caeef-5fc5-41a0-83dc-49646e17b292 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:07.232615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:07.233481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: ebd21bb0-f168-4a05-ad19-6b72415fc036] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:07.239829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:07.240573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:07.241232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:07.242336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:07.243146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:07.243801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:07.260344 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] HTTP exception thrown: Instance ebd21bb0-f168-4a05-ad19-6b72415fc036 could not be found. Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Request method failure captured: Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 HTTP/1.1 Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceHyZ66COueCmMKS6bIM-PiL0BnU0kxcFgwGgFRRr46Ha6jo127LWAWgwkxrbL7c46CrNcvHA38ix2lmhFbQ5UOUA9mMnRyFyKtu9E9vpPJjhi0X4KDDLPanYn3L5AHayOzW5L0m0h9N4xj3kgQlsf_7VBmtNadimV4sw-wCIQ6q14 Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 0ac923f5632e40b2bd81aa5de2ed3f5a Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ac923f5632e40b2bd81aa5de2ed3f5a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}] Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 0ac923f5632e40b2bd81aa5de2ed3f5a Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-LiveAutoBlockMigrationV225Test-1536528071-project Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 823a414535d04791844ab997869542b2 Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071-project Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ebd21bb0-f168-4a05-ad19-6b72415fc036 could not be found. Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ebd21bb0-f168-4a05-ad19-6b72415fc036'} Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd21bb0-f168-4a05-ad19-6b72415fc036 could not be found. Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd21bb0-f168-4a05-ad19-6b72415fc036 could not be found. Oct 11 19:51:07.262352 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd21bb0-f168-4a05-ad19-6b72415fc036 could not be found. Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Returning 404 to user: Instance ebd21bb0-f168-4a05-ad19-6b72415fc036 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:07.265486 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c196cbd9-fca9-4812-afc2-66a1c35b2dbb tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036" status: 404 len: 111 microversion: 2.25 time: 0.035404 Oct 11 19:51:07.268103 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1104/2257] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:07 2022] GET /compute/v2.1/servers/ebd21bb0-f168-4a05-ad19-6b72415fc036 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:51:07.273407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-22fb0466-5fc6-438c-a482-a3c387070823 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:07.274103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-22fb0466-5fc6-438c-a482-a3c387070823 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:07.285347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22fb0466-5fc6-438c-a482-a3c387070823 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:07.285944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22fb0466-5fc6-438c-a482-a3c387070823 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:07.286388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22fb0466-5fc6-438c-a482-a3c387070823 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:07.287385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22fb0466-5fc6-438c-a482-a3c387070823 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:07.298847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22fb0466-5fc6-438c-a482-a3c387070823 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:07.299363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22fb0466-5fc6-438c-a482-a3c387070823 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:07.994079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-22fb0466-5fc6-438c-a482-a3c387070823 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:08.002575 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-22fb0466-5fc6-438c-a482-a3c387070823 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1509 microversion: 2.1 time: 0.733370 Oct 11 19:51:08.018553 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1105/2258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:07 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1509 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:08.018553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:08.018553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:08.030199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.037017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.037737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.038722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.040053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.040739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.088563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 HTTP/1.1 Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'b6ec61a7-946a-464c-8c7b-179353b2bce7'} Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:08.092106 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:51:08.095397 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.097013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:08.100159 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3e11b3df-0b2d-45de-a4d6-4661ef71feeb tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 404 len: 111 microversion: 2.1 time: 0.091140 Oct 11 19:51:08.106011 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1106/2259] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:08 2022] DELETE /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:08.119621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:08.124901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: b6ec61a7-946a-464c-8c7b-179353b2bce7] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:08.144890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.152279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.156184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.157197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.157861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.158480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.206364 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2b4ca003-0ece-442a-8c72-da73ba4278ba tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/eb65c899-6f34-4577-b6c0-6d166aa70a62" status: 202 len: 0 microversion: 2.1 time: 1.535661 Oct 11 19:51:08.207532 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1154/2260] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:51:06 2022] DELETE /compute/v2.1/os-floating-ips/eb65c899-6f34-4577-b6c0-6d166aa70a62 => generated 0 bytes in 1538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:51:08.208005 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 HTTP/1.1 Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'b6ec61a7-946a-464c-8c7b-179353b2bce7'} Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.213052 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.216363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.216363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.216363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.216363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:08.216363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:08.216363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. Oct 11 19:51:08.216363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.216363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance b6ec61a7-946a-464c-8c7b-179353b2bce7 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:08.217790 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-043de6b9-7a0e-4a51-9c23-1d23dda9f115 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7" status: 404 len: 111 microversion: 2.1 time: 0.109790 Oct 11 19:51:08.219989 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1107/2261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:08 2022] GET /compute/v2.1/servers/b6ec61a7-946a-464c-8c7b-179353b2bce7 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:08.224589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-036f254a-0a7f-4087-85a2-23d6877114ae tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Calling method '.version_select at 0x7f83cca8a940>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:08.247280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:08.247811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:08.269616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.270123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.270600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.280393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.281532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.282000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.314583 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f HTTP/1.1 Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '7d1ceed5-0490-4d64-8d97-e0684bd7f05f'} Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:08.325272 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:08.328557 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e7ae60b1-0842-4a03-8f9c-ed38d53f6ec3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 404 len: 111 microversion: 2.1 time: 0.102381 Oct 11 19:51:08.331051 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1108/2262] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:08 2022] DELETE /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:08.336633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:08.337260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 7d1ceed5-0490-4d64-8d97-e0684bd7f05f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:08.359396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.359912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.360358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.361086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.361551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.361989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.393851 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f HTTP/1.1 Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '7d1ceed5-0490-4d64-8d97-e0684bd7f05f'} Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.397126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.401485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.401485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.401485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.401485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:08.401485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:08.401485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. Oct 11 19:51:08.401485 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.401485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 7d1ceed5-0490-4d64-8d97-e0684bd7f05f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:08.401485 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9bac23e5-0c3d-4e89-acec-6bbf9d101b05 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f" status: 404 len: 111 microversion: 2.1 time: 0.066453 Oct 11 19:51:08.415219 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1109/2263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:08 2022] GET /compute/v2.1/servers/7d1ceed5-0490-4d64-8d97-e0684bd7f05f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:08.420274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:08.420785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:08.432531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.438759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.439369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.440215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.440921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.441366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.469095 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 HTTP/1.1 Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '8ff982cd-411a-407e-8fd9-070fd3c3a298'} Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:08.470695 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:08.473721 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-12373081-27ad-4e7e-b467-27fbb41babb9 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 404 len: 111 microversion: 2.1 time: 0.055808 Oct 11 19:51:08.476219 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1110/2264] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:08 2022] DELETE /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:08.481755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:08.482394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 8ff982cd-411a-407e-8fd9-070fd3c3a298] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:08.489289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.489798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.490242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.491014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:08.491478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:08.491911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:08.558741 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 HTTP/1.1 Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '8ff982cd-411a-407e-8fd9-070fd3c3a298'} Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.560323 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.563448 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.563448 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.563448 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.563448 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:08.563448 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:08.563448 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. Oct 11 19:51:08.563448 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.563448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 8ff982cd-411a-407e-8fd9-070fd3c3a298 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:08.563448 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-71cd4739-28bb-46a5-964b-fcf57acbcdaa tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298" status: 404 len: 111 microversion: 2.1 time: 0.085539 Oct 11 19:51:08.579603 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1111/2265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:08 2022] GET /compute/v2.1/servers/8ff982cd-411a-407e-8fd9-070fd3c3a298 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:08.585471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a956613c-5853-40ba-8e51-f5c14c8cf1d1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:08.586081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a956613c-5853-40ba-8e51-f5c14c8cf1d1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 16e5939a-3567-4863-af67-b6e6833e8220] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:08.614090 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-036f254a-0a7f-4087-85a2-23d6877114ae tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.400687 Oct 11 19:51:08.615075 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1155/2266] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Oct 11 19:51:08 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:08.620081 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-a956613c-5853-40ba-8e51-f5c14c8cf1d1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a956613c-5853-40ba-8e51-f5c14c8cf1d1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220 HTTP/1.1 Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '16e5939a-3567-4863-af67-b6e6833e8220'} Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.621655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.625745 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.625745 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.625745 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.625745 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:08.625745 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:08.625745 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:51:08.625745 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.625745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a956613c-5853-40ba-8e51-f5c14c8cf1d1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:08.626365 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a956613c-5853-40ba-8e51-f5c14c8cf1d1 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220" status: 404 len: 111 microversion: 2.1 time: 0.045641 Oct 11 19:51:08.628882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11f85b3e-e5ba-492b-950c-53e2159746b3 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Calling method '.version_select at 0x7f83cca75430>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:08.630185 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1112/2267] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:08 2022] DELETE /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:08.635748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-81d7e40c-b0b0-4b7d-91bf-29e61673b02e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:08.636390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-81d7e40c-b0b0-4b7d-91bf-29e61673b02e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 16e5939a-3567-4863-af67-b6e6833e8220] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:08.643648 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-81d7e40c-b0b0-4b7d-91bf-29e61673b02e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-81d7e40c-b0b0-4b7d-91bf-29e61673b02e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220 HTTP/1.1 Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '16e5939a-3567-4863-af67-b6e6833e8220'} Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:08.645386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:08.648724 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:08.648724 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:08.648724 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:08.648724 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. Oct 11 19:51:08.648724 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:08.648724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-81d7e40c-b0b0-4b7d-91bf-29e61673b02e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 16e5939a-3567-4863-af67-b6e6833e8220 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:08.649830 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-81d7e40c-b0b0-4b7d-91bf-29e61673b02e tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220" status: 404 len: 111 microversion: 2.1 time: 0.018263 Oct 11 19:51:08.665426 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1113/2268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:08 2022] GET /compute/v2.1/servers/16e5939a-3567-4863-af67-b6e6833e8220 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:08.934644 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-11f85b3e-e5ba-492b-950c-53e2159746b3 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.310676 Oct 11 19:51:08.947625 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1156/2269] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 11 19:51:08 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:08.951921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d85576d-8fcb-40c4-ba0a-f612ae556889 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Calling method '.version_select at 0x7f83c7adadc0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:09.033338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b999f37-dda5-425d-9550-a1c194a3aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:09.033959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b999f37-dda5-425d-9550-a1c194a3aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:09.047728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b999f37-dda5-425d-9550-a1c194a3aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:09.048257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b999f37-dda5-425d-9550-a1c194a3aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:09.056485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b999f37-dda5-425d-9550-a1c194a3aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:09.057538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b999f37-dda5-425d-9550-a1c194a3aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:09.058820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b999f37-dda5-425d-9550-a1c194a3aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:09.059602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b999f37-dda5-425d-9550-a1c194a3aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:09.493739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b999f37-dda5-425d-9550-a1c194a3aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:09.504015 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b999f37-dda5-425d-9550-a1c194a3aff1 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1509 microversion: 2.1 time: 0.474548 Oct 11 19:51:09.516351 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1157/2270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:09 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1509 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:51:10.282915 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6d85576d-8fcb-40c4-ba0a-f612ae556889 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/ab855390-7016-4673-bef4-10316d9a5279" status: 202 len: 0 microversion: 2.1 time: 1.334715 Oct 11 19:51:10.283882 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1114/2271] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:51:08 2022] DELETE /compute/v2.1/os-floating-ips/ab855390-7016-4673-bef4-10316d9a5279 => generated 0 bytes in 1336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:51:10.292192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40c656ec-8f5a-4f9a-a3ea-c486d44bed52 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Calling method '.version_select at 0x7f83cc9a1d30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:10.548537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a002b287-70eb-4bb7-a2cd-f5f24ac74519 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:10.549166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a002b287-70eb-4bb7-a2cd-f5f24ac74519 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:10.572727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a002b287-70eb-4bb7-a2cd-f5f24ac74519 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:10.578209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a002b287-70eb-4bb7-a2cd-f5f24ac74519 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:10.578779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a002b287-70eb-4bb7-a2cd-f5f24ac74519 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:10.579598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a002b287-70eb-4bb7-a2cd-f5f24ac74519 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:10.580127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a002b287-70eb-4bb7-a2cd-f5f24ac74519 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:10.580481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a002b287-70eb-4bb7-a2cd-f5f24ac74519 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:11.565089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a002b287-70eb-4bb7-a2cd-f5f24ac74519 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:11.580927 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a002b287-70eb-4bb7-a2cd-f5f24ac74519 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1509 microversion: 2.1 time: 1.041882 Oct 11 19:51:11.582167 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1115/2272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:10 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1509 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:51:12.491923 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40c656ec-8f5a-4f9a-a3ea-c486d44bed52 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/9fd5e50a-fafb-4f56-9b2c-6ed8b99d6393" status: 202 len: 0 microversion: 2.1 time: 2.204251 Oct 11 19:51:12.492566 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1158/2273] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:51:10 2022] DELETE /compute/v2.1/os-floating-ips/9fd5e50a-fafb-4f56-9b2c-6ed8b99d6393 => generated 0 bytes in 2206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:51:12.501028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dbbc4c46-811c-41c3-959c-b4d10b9c4814 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] Calling method '.version_select at 0x7f83cca8ac10>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:12.553156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-134f05be-c08a-46bf-b2b2-ea0656ff8951 tempest-FloatingIPDetailsNegativeTestJSON-625756162 tempest-FloatingIPDetailsNegativeTestJSON-625756162-project] Calling method '.version_select at 0x7f83cc1ffb80>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:13.025441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-134f05be-c08a-46bf-b2b2-ea0656ff8951 tempest-FloatingIPDetailsNegativeTestJSON-625756162 tempest-FloatingIPDetailsNegativeTestJSON-625756162-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b could not be found", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:51:13.026146 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-134f05be-c08a-46bf-b2b2-ea0656ff8951 tempest-FloatingIPDetailsNegativeTestJSON-625756162 tempest-FloatingIPDetailsNegativeTestJSON-625756162-project] HTTP exception thrown: Floating IP not found for ID ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-134f05be-c08a-46bf-b2b2-ea0656ff8951 tempest-FloatingIPDetailsNegativeTestJSON-625756162 tempest-FloatingIPDetailsNegativeTestJSON-625756162-project] Request method failure captured: Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-floating-ips/ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b HTTP/1.1 Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRckvD97Uy1JerW2a7wXEchDczcfhqAmrAc-FNZ7wB7FzoqUt_Kajs1mIXO8_FD_vti1YGWgoSwQ_Sjfz0QVtA4ch8kwkrMpatKACa0kGybLKLIkL59hK6fe6NTJEgjw4OTdz0BEXc2LZ963mN8W54W9Sn1pL6ZIlHbUjFw_GC7M_HvM Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 4ee6f6dd09f641faa0db4792025e7aab Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-625756162 Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ee6f6dd09f641faa0db4792025e7aab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ee6f6dd09f641faa0db4792025e7aab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ee6f6dd09f641faa0db4792025e7aab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ee6f6dd09f641faa0db4792025e7aab"}]}] Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-625756162 Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 4ee6f6dd09f641faa0db4792025e7aab Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-625756162 Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-625756162-project Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 9002ead1d30b414bb8ba6501a8796534 Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-625756162-project Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: exception: Floating IP not found for ID ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b'} Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b could not be found Oct 11 19:51:13.028012 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88a2f6b3-1975-455b-a986-a72a7f8b43ae'] Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b. Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-134f05be-c08a-46bf-b2b2-ea0656ff8951 tempest-FloatingIPDetailsNegativeTestJSON-625756162 tempest-FloatingIPDetailsNegativeTestJSON-625756162-project] Returning 404 to user: Floating IP not found for ID ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:13.031980 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-134f05be-c08a-46bf-b2b2-ea0656ff8951 tempest-FloatingIPDetailsNegativeTestJSON-625756162 tempest-FloatingIPDetailsNegativeTestJSON-625756162-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b" status: 404 len: 111 microversion: 2.1 time: 0.751928 Oct 11 19:51:13.035883 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1116/2274] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:51:12 2022] GET /compute/v2.1/os-floating-ips/ac41953f-5c8b-4ebe-9c5d-ac6f28d63a1b => generated 111 bytes in 758 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:13.050385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4485e3aa-6044-4bd0-8519-9f033a503b59 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:13.051056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4485e3aa-6044-4bd0-8519-9f033a503b59 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:13.121140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4485e3aa-6044-4bd0-8519-9f033a503b59 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:13.121655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4485e3aa-6044-4bd0-8519-9f033a503b59 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:13.122103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4485e3aa-6044-4bd0-8519-9f033a503b59 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:13.128350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4485e3aa-6044-4bd0-8519-9f033a503b59 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:13.128890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4485e3aa-6044-4bd0-8519-9f033a503b59 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:13.129344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4485e3aa-6044-4bd0-8519-9f033a503b59 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:14.027128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4485e3aa-6044-4bd0-8519-9f033a503b59 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:14.040935 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4485e3aa-6044-4bd0-8519-9f033a503b59 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1513 microversion: 2.1 time: 1.003902 Oct 11 19:51:14.043677 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1117/2275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:13 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1513 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:14.084081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:14.098323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:14.106663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.compute.servers [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Removing options 'limit' from query {{(pid=126955) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 19:51:14.114214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:51:14.115717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:14.116834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:14.117945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:14.119088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:14.119735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:14.120329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:14.127593 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-648c411d-e319-476d-b677-6bd0c2b6f14d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.049239 Oct 11 19:51:14.130097 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1118/2276] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 11 19:51:14 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:14.146935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-92d50d55-3266-45cd-8f64-60e33d961cd2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:14.147944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-92d50d55-3266-45cd-8f64-60e33d961cd2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:14.176950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92d50d55-3266-45cd-8f64-60e33d961cd2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:14.177701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92d50d55-3266-45cd-8f64-60e33d961cd2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:14.178322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92d50d55-3266-45cd-8f64-60e33d961cd2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:14.180259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92d50d55-3266-45cd-8f64-60e33d961cd2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:14.180897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92d50d55-3266-45cd-8f64-60e33d961cd2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:14.181504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92d50d55-3266-45cd-8f64-60e33d961cd2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:14.211559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:14.217098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-92d50d55-3266-45cd-8f64-60e33d961cd2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:51:14.350125 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-92d50d55-3266-45cd-8f64-60e33d961cd2 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "DELETE /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 204 len: 0 microversion: 2.25 time: 0.213188 Oct 11 19:51:14.350672 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1119/2277] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:14 2022] DELETE /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:51:14.381152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ce1df218-6574-433e-b57d-d59f0f8f1e06 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:14.383218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ce1df218-6574-433e-b57d-d59f0f8f1e06 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:14.418421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce1df218-6574-433e-b57d-d59f0f8f1e06 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:14.418969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce1df218-6574-433e-b57d-d59f0f8f1e06 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:14.421997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce1df218-6574-433e-b57d-d59f0f8f1e06 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:14.422821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce1df218-6574-433e-b57d-d59f0f8f1e06 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:14.427327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce1df218-6574-433e-b57d-d59f0f8f1e06 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:14.428094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce1df218-6574-433e-b57d-d59f0f8f1e06 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.022264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce1df218-6574-433e-b57d-d59f0f8f1e06 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:15.029589 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dbbc4c46-811c-41c3-959c-b4d10b9c4814 tempest-FloatingIPDetailsTestJSON-553366673 tempest-FloatingIPDetailsTestJSON-553366673-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/8f504aab-292d-40d8-8760-2ebb0afee9a0" status: 202 len: 0 microversion: 2.1 time: 2.531763 Oct 11 19:51:15.030748 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1159/2278] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:51:12 2022] DELETE /compute/v2.1/os-floating-ips/8f504aab-292d-40d8-8760-2ebb0afee9a0 => generated 0 bytes in 2535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:51:15.035960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:15.036774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:15.039046 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ce1df218-6574-433e-b57d-d59f0f8f1e06 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1513 microversion: 2.1 time: 0.680300 Oct 11 19:51:15.048301 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1120/2279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:14 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1513 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:15.082327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-763b5fcd-6e25-472b-bf72-4ea1b3c46e87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:15.083673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-763b5fcd-6e25-472b-bf72-4ea1b3c46e87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:15.090748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.091263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.091708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.092428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.092894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.098078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.117072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-763b5fcd-6e25-472b-bf72-4ea1b3c46e87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.117072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-763b5fcd-6e25-472b-bf72-4ea1b3c46e87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.124593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-763b5fcd-6e25-472b-bf72-4ea1b3c46e87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.127438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-763b5fcd-6e25-472b-bf72-4ea1b3c46e87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.128153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-763b5fcd-6e25-472b-bf72-4ea1b3c46e87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.129001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-763b5fcd-6e25-472b-bf72-4ea1b3c46e87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.577505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-763b5fcd-6e25-472b-bf72-4ea1b3c46e87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:15.587427 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-763b5fcd-6e25-472b-bf72-4ea1b3c46e87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e" status: 200 len: 1512 microversion: 2.1 time: 0.522278 Oct 11 19:51:15.592009 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1121/2280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:15 2022] GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:15.607580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:15.608324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:15.620804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.621682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.621863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.628828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.629553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.630005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.664059 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c HTTP/1.1 Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '5fb63556-0909-48c6-b68a-edce831b629c'} Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:15.667180 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:51:15.670425 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.672634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:15.674792 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7be2bec0-42f4-414f-90e7-e0f5aa34d142 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 404 len: 111 microversion: 2.1 time: 0.080606 Oct 11 19:51:15.675916 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1122/2281] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:15 2022] DELETE /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:15.686095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1fb090d8-acab-4fd2-b361-368ca0c62822 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:15.687076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1fb090d8-acab-4fd2-b361-368ca0c62822 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:15.693944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fb090d8-acab-4fd2-b361-368ca0c62822 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.694748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fb090d8-acab-4fd2-b361-368ca0c62822 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.695521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fb090d8-acab-4fd2-b361-368ca0c62822 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.696449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fb090d8-acab-4fd2-b361-368ca0c62822 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.697088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fb090d8-acab-4fd2-b361-368ca0c62822 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.697706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fb090d8-acab-4fd2-b361-368ca0c62822 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.734010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:15.743847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:15.750712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:15.752859 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-21034ec5-43ed-482c-bcdc-13ba85649a10 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1731 microversion: 2.25 time: 0.720733 Oct 11 19:51:15.756192 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1160/2282] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:15 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1731 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:15.782773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:15.783621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: 5fb63556-0909-48c6-b68a-edce831b629c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:15.812306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.819309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.820117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.821516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.822171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.822879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.846735 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c HTTP/1.1 Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5fb63556-0909-48c6-b68a-edce831b629c'} Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:15.853159 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.857234 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:15.857234 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:15.857234 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:15.857234 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:15.857234 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:15.857234 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. Oct 11 19:51:15.857234 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.870240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance 5fb63556-0909-48c6-b68a-edce831b629c could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:15.876474 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-52cdd038-dd77-43d9-9daf-3979528b6ea5 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c" status: 404 len: 111 microversion: 2.1 time: 0.118832 Oct 11 19:51:15.877732 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1161/2283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:15 2022] GET /compute/v2.1/servers/5fb63556-0909-48c6-b68a-edce831b629c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:15.893699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:15.896760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:15.904596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.905607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.906246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.907205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.907890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.908531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.937116 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 HTTP/1.1 Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'add978ad-6324-4802-a5a1-29a549940439'} Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:15.939371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c7397a2b-33cf-41a2-b475-4b6e916f248c tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 404 len: 111 microversion: 2.1 time: 0.058439 Oct 11 19:51:15.946445 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1162/2284] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:15 2022] DELETE /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:15.952942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:15.953837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] [instance: add978ad-6324-4802-a5a1-29a549940439] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:15.969443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.973462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.973462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:15.974434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:15.979332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:15.979890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:16.014179 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] HTTP exception thrown: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Request method failure captured: Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 HTTP/1.1 Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcfnDBQB_XOMJ9FI9siIXC5et4SHgFv-580uu4JwjlaIKZMdOJfsg39q3LqXHceTCZ8EFvALem7X-xEQ5Ipwfx6ev6bXXm5ypog9uMYIMBlgjhjzp7gDlWHMS2ERD9NaUn40pU6KZzi7W15tAgn4d4adjj8PLgXqtkuEf80tXUXJ3Ro Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be070f1da3c0467daf15d6b120df125e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be070f1da3c0467daf15d6b120df125e"}]}] Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: be070f1da3c0467daf15d6b120df125e Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-DeleteServersTestJSON-47522773 Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 8494488a13a3496eb59a8062479816bc Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-DeleteServersTestJSON-47522773-project Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'add978ad-6324-4802-a5a1-29a549940439'} Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:16.017276 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:16.021024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:16.021024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:16.021024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:16.021024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:16.021024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:16.021024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. Oct 11 19:51:16.021024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:16.021024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] Returning 404 to user: Instance add978ad-6324-4802-a5a1-29a549940439 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:16.021024 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-37259e06-fa79-4b21-99a0-2ee412fcd6f3 tempest-DeleteServersTestJSON-47522773 tempest-DeleteServersTestJSON-47522773-project] 10.222.0.27 "GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439" status: 404 len: 111 microversion: 2.1 time: 0.071041 Oct 11 19:51:16.026209 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1163/2285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:15 2022] GET /compute/v2.1/servers/add978ad-6324-4802-a5a1-29a549940439 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:16.406005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1fb090d8-acab-4fd2-b361-368ca0c62822 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:16.425256 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1fb090d8-acab-4fd2-b361-368ca0c62822 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1512 microversion: 2.1 time: 0.748004 Oct 11 19:51:16.426927 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1123/2286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:15 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1512 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:16.455749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:16.469414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:16.481877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:51:16.787830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:16.788735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:16.794274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:16.818378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:16.819493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:16.820343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:16.821966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:16.823758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:16.827100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:16.834051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:16.835167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:16.835825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:16.837036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:16.837731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:16.838387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:17.052314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:51:17.151705 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-71ccf1fd-805f-4208-8122-aed5dcce2e2c tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.701043 Oct 11 19:51:17.152864 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1164/2287] 10.222.0.27 () {58 vars in 1154 bytes} [Tue Oct 11 19:51:16 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:17.169833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-35b92c3b-54dd-4255-b8af-342bb8265589 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:17.170714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-35b92c3b-54dd-4255-b8af-342bb8265589 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:17.177331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b92c3b-54dd-4255-b8af-342bb8265589 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:17.178051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b92c3b-54dd-4255-b8af-342bb8265589 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:17.178842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b92c3b-54dd-4255-b8af-342bb8265589 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:17.179709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b92c3b-54dd-4255-b8af-342bb8265589 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:17.180412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b92c3b-54dd-4255-b8af-342bb8265589 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:17.181048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b92c3b-54dd-4255-b8af-342bb8265589 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:17.605245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:17.617381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:17.621687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:17.623349 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5fd033e1-eab1-4c17-be63-6c516c408e8a tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1731 microversion: 2.25 time: 0.842047 Oct 11 19:51:17.624678 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1124/2288] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:16 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1731 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:51:18.044502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35b92c3b-54dd-4255-b8af-342bb8265589 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:18.052793 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-35b92c3b-54dd-4255-b8af-342bb8265589 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1513 microversion: 2.1 time: 0.888718 Oct 11 19:51:18.082569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e22f7584-e500-47df-bf92-951a02f71b1f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:18.086113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e22f7584-e500-47df-bf92-951a02f71b1f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:18.089846 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1165/2289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:17 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1513 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:51:18.093577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e22f7584-e500-47df-bf92-951a02f71b1f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:18.094302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e22f7584-e500-47df-bf92-951a02f71b1f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:18.095004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e22f7584-e500-47df-bf92-951a02f71b1f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:18.095940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e22f7584-e500-47df-bf92-951a02f71b1f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:18.096661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e22f7584-e500-47df-bf92-951a02f71b1f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:18.097313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e22f7584-e500-47df-bf92-951a02f71b1f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:18.517466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e22f7584-e500-47df-bf92-951a02f71b1f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:18.526648 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e22f7584-e500-47df-bf92-951a02f71b1f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e" status: 200 len: 1512 microversion: 2.1 time: 0.449709 Oct 11 19:51:18.527613 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1125/2290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:18 2022] GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:18.549672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e231df6d-fff1-4324-92d0-6aa431973796 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:18.550284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e231df6d-fff1-4324-92d0-6aa431973796 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:18.559612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e231df6d-fff1-4324-92d0-6aa431973796 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:18.560103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e231df6d-fff1-4324-92d0-6aa431973796 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:18.560523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e231df6d-fff1-4324-92d0-6aa431973796 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:18.561217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e231df6d-fff1-4324-92d0-6aa431973796 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:18.561666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e231df6d-fff1-4324-92d0-6aa431973796 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:18.562082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e231df6d-fff1-4324-92d0-6aa431973796 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:18.649942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:18.650574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:18.663153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:18.663866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:18.666706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:18.667568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:18.668052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:18.682506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:18.940008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:18.962212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:18.963785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:18.970932 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9ca4bb42-c607-4041-8ead-980282871ce0 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 200 len: 1664 microversion: 2.25 time: 0.325255 Oct 11 19:51:18.972096 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1126/2291] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:18 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 1664 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:51:18.984710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-cd5581b6-740d-408e-b3a1-0fe928063b51 req-6ef9aee3-a97c-4f4d-af0a-1cc3180f630b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bf9d5c-d025-4705-828e-4e4e389f5681", "name": "network-vif-deleted", "tag": "0d0ecc45-e711-4f9a-870b-ac48a8637962"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:19.012061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd5581b6-740d-408e-b3a1-0fe928063b51 req-6ef9aee3-a97c-4f4d-af0a-1cc3180f630b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:19.012798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd5581b6-740d-408e-b3a1-0fe928063b51 req-6ef9aee3-a97c-4f4d-af0a-1cc3180f630b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:19.013538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd5581b6-740d-408e-b3a1-0fe928063b51 req-6ef9aee3-a97c-4f4d-af0a-1cc3180f630b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:19.040779 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-cd5581b6-740d-408e-b3a1-0fe928063b51 req-6ef9aee3-a97c-4f4d-af0a-1cc3180f630b service nova] Creating event network-vif-deleted:0d0ecc45-e711-4f9a-870b-ac48a8637962 for instance 72bf9d5c-d025-4705-828e-4e4e389f5681 on n-h2-860864-3 Oct 11 19:51:19.061832 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-cd5581b6-740d-408e-b3a1-0fe928063b51 req-6ef9aee3-a97c-4f4d-af0a-1cc3180f630b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086274 Oct 11 19:51:19.062450 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1127/2292] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:19.281267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e231df6d-fff1-4324-92d0-6aa431973796 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:19.293674 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e231df6d-fff1-4324-92d0-6aa431973796 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1512 microversion: 2.1 time: 0.747015 Oct 11 19:51:19.294265 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1166/2293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:18 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1512 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:19.318363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:19.324550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:19.325627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:51:19.332423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:19.333245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:19.333887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:19.334888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:19.335557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:19.336351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:19.390865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:51:19.490088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:19.496753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:19.500177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:19.500886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:19.501486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:19.843822 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d7d852cc-af68-47e3-af08-197ac0806671 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.530160 Oct 11 19:51:19.844490 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1128/2294] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:51:19 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:19.875615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:19.887911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:19.888584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:51:20.004544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:20.005631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 72bf9d5c-d025-4705-828e-4e4e389f5681] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:20.019511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:20.020252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:20.020944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:20.022288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:20.023132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:20.024021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:20.048664 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] HTTP exception thrown: Instance 72bf9d5c-d025-4705-828e-4e4e389f5681 could not be found. Oct 11 19:51:20.057533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:20.058311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:20.059037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:20.060202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:20.061048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:20.061840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Request method failure captured: Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 HTTP/1.1 Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceHyZ66COueCmMKS6bIM-PiL0BnU0kxcFgwGgFRRr46Ha6jo127LWAWgwkxrbL7c46CrNcvHA38ix2lmhFbQ5UOUA9mMnRyFyKtu9E9vpPJjhi0X4KDDLPanYn3L5AHayOzW5L0m0h9N4xj3kgQlsf_7VBmtNadimV4sw-wCIQ6q14 Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 0ac923f5632e40b2bd81aa5de2ed3f5a Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ac923f5632e40b2bd81aa5de2ed3f5a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}] Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 0ac923f5632e40b2bd81aa5de2ed3f5a Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-LiveAutoBlockMigrationV225Test-1536528071-project Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 823a414535d04791844ab997869542b2 Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071-project Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 72bf9d5c-d025-4705-828e-4e4e389f5681 could not be found. Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '72bf9d5c-d025-4705-828e-4e4e389f5681'} Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72bf9d5c-d025-4705-828e-4e4e389f5681 could not be found. Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72bf9d5c-d025-4705-828e-4e4e389f5681 could not be found. Oct 11 19:51:20.068056 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:20.072482 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:20.072482 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:20.072482 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:20.072482 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:20.072482 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:20.072482 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:20.072482 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:20.072482 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72bf9d5c-d025-4705-828e-4e4e389f5681 could not be found. Oct 11 19:51:20.072482 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:20.077145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Returning 404 to user: Instance 72bf9d5c-d025-4705-828e-4e4e389f5681 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:20.080948 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-83d91897-f38e-47f8-bfd2-3feb4d833bc1 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681" status: 404 len: 111 microversion: 2.25 time: 0.085268 Oct 11 19:51:20.083127 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1129/2295] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:19 2022] GET /compute/v2.1/servers/72bf9d5c-d025-4705-828e-4e4e389f5681 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:51:20.097225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b0bb195-7bae-475a-aaf6-1affb768536f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '.version_select at 0x7f83cc1ca9d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:20.134307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:20.139392 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b0bb195-7bae-475a-aaf6-1affb768536f tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453764179" status: 204 len: 0 microversion: 2.25 time: 0.051332 Oct 11 19:51:20.140548 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1130/2296] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Oct 11 19:51:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453764179 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:51:20.140883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:51:20.182227 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4859806a-9a3b-4748-a6f0-a4fdce2c686a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.315351 Oct 11 19:51:20.191908 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1167/2297] 10.222.0.27 () {58 vars in 1150 bytes} [Tue Oct 11 19:51:19 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:20.198447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:20.204181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:20.205063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:51:20.213373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:20.214020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:20.214629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:20.215707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:20.216315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:20.216899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:20.353087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:51:20.470771 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ffb97f38-13fd-4910-ac35-65b035fbd6f5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.276810 Oct 11 19:51:20.480019 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1131/2298] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Oct 11 19:51:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:20.486935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:20.498633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:20.501478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:51:20.528716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:20.529335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:20.543537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:20.547415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:20.548332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:20.549111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:20.810354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:51:20.951469 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc0248c0-2e7b-4793-a545-d38fa245e216 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.470670 Oct 11 19:51:20.953388 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1168/2299] 10.222.0.27 () {58 vars in 1196 bytes} [Tue Oct 11 19:51:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:20.966298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:20.975554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:20.976611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'name': '1063948164', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:51:20.987577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:20.988396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:20.988980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:20.989864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:20.990794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:20.991373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:21.163470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:51:21.274970 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-084b713d-da0c-43eb-8623-d9e7e93c1147 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?name=1063948164" status: 200 len: 346 microversion: 2.1 time: 0.311379 Oct 11 19:51:21.276659 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1132/2300] 10.222.0.27 () {58 vars in 1156 bytes} [Tue Oct 11 19:51:20 2022] GET /compute/v2.1/servers?name=1063948164 => generated 346 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:21.290070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:21.307227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:21.307227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:51:21.323897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:21.324390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:21.324893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:21.325610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:21.326309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:21.327672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:21.581939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:51:21.704268 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-775bc78f-c121-43b9-82b0-9690f36569fb tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.418500 Oct 11 19:51:21.718090 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1169/2301] 10.222.0.27 () {58 vars in 1154 bytes} [Tue Oct 11 19:51:21 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:21.733207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:21.746325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:21.747564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-106394816', 'deleted': False, 'project_id': '720def5330eb4ea192335c6a4d9d2884'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:51:21.763781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:21.764426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:21.764880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:21.766748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:21.767222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:21.768496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:21.943238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:51:22.125914 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc1a887e-e140-43cf-9cbc-f545df96a36e tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-106394816" status: 200 len: 346 microversion: 2.1 time: 0.398712 Oct 11 19:51:22.135800 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1133/2302] 10.222.0.27 () {58 vars in 1228 bytes} [Tue Oct 11 19:51:21 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-106394816 => generated 346 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:22.145999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ac3f5a2-1aee-4a22-8473-e1cfc67bb2c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:22.146789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ac3f5a2-1aee-4a22-8473-e1cfc67bb2c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:22.166736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5a2-1aee-4a22-8473-e1cfc67bb2c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:22.167265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5a2-1aee-4a22-8473-e1cfc67bb2c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:22.167716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5a2-1aee-4a22-8473-e1cfc67bb2c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:22.168523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5a2-1aee-4a22-8473-e1cfc67bb2c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:22.168877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5a2-1aee-4a22-8473-e1cfc67bb2c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:22.169306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5a2-1aee-4a22-8473-e1cfc67bb2c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:22.251672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ac3f5a2-1aee-4a22-8473-e1cfc67bb2c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:51:22.482732 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ac3f5a2-1aee-4a22-8473-e1cfc67bb2c0 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "DELETE /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 204 len: 0 microversion: 2.1 time: 0.340246 Oct 11 19:51:22.488222 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1170/2303] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:22 2022] DELETE /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:51:22.494185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-63b5e58d-9dad-4378-9710-1c37b356ed96 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:22.495032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-63b5e58d-9dad-4378-9710-1c37b356ed96 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:22.501941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63b5e58d-9dad-4378-9710-1c37b356ed96 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:22.502823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63b5e58d-9dad-4378-9710-1c37b356ed96 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:22.504767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63b5e58d-9dad-4378-9710-1c37b356ed96 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:22.505369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63b5e58d-9dad-4378-9710-1c37b356ed96 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:22.505824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63b5e58d-9dad-4378-9710-1c37b356ed96 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:22.506246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63b5e58d-9dad-4378-9710-1c37b356ed96 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:22.519063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9f0a8d58-cb9a-4b52-874f-b0a54bdfbafc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:22.520047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9f0a8d58-cb9a-4b52-874f-b0a54bdfbafc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:22.528294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f0a8d58-cb9a-4b52-874f-b0a54bdfbafc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:22.529231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f0a8d58-cb9a-4b52-874f-b0a54bdfbafc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:22.529953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f0a8d58-cb9a-4b52-874f-b0a54bdfbafc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:22.530946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f0a8d58-cb9a-4b52-874f-b0a54bdfbafc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:22.531905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f0a8d58-cb9a-4b52-874f-b0a54bdfbafc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:22.532533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f0a8d58-cb9a-4b52-874f-b0a54bdfbafc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:22.621626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9f0a8d58-cb9a-4b52-874f-b0a54bdfbafc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:51:22.840581 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9f0a8d58-cb9a-4b52-874f-b0a54bdfbafc tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 204 len: 0 microversion: 2.25 time: 0.329878 Oct 11 19:51:22.845372 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1171/2304] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:22 2022] DELETE /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:51:22.853900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:22.858877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:22.873271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:22.874157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:22.875515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:22.876419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:22.877038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:22.877619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:23.146124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63b5e58d-9dad-4378-9710-1c37b356ed96 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:23.171844 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-63b5e58d-9dad-4378-9710-1c37b356ed96 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1518 microversion: 2.1 time: 0.680520 Oct 11 19:51:23.173802 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1134/2305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:22 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1518 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:51:23.317374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:23.336766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:23.339467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:23.343074 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2928069f-2562-4810-a370-8b807c28c9d6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1549 microversion: 2.25 time: 0.495026 Oct 11 19:51:23.344145 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1172/2306] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:22 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1549 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:23.843760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b0c1f622-a59e-4087-98ba-b872ff29cd0a tempest-FlavorsV2NegativeTest-1185489004 tempest-FlavorsV2NegativeTest-1185489004-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:23.868455 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b0c1f622-a59e-4087-98ba-b872ff29cd0a tempest-FlavorsV2NegativeTest-1185489004 tempest-FlavorsV2NegativeTest-1185489004-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.350096 Oct 11 19:51:23.871257 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1135/2307] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:51:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:24.199823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e9eda13a-d0b5-4792-907d-ad2cf3fb2c1a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:24.200531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e9eda13a-d0b5-4792-907d-ad2cf3fb2c1a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:24.221557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9eda13a-d0b5-4792-907d-ad2cf3fb2c1a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:24.223088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9eda13a-d0b5-4792-907d-ad2cf3fb2c1a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:24.224097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9eda13a-d0b5-4792-907d-ad2cf3fb2c1a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:24.225710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9eda13a-d0b5-4792-907d-ad2cf3fb2c1a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:24.227380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9eda13a-d0b5-4792-907d-ad2cf3fb2c1a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:24.228504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9eda13a-d0b5-4792-907d-ad2cf3fb2c1a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:24.372666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:24.373293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:24.388810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:24.389335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:24.394314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:24.395152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:24.395956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:24.396853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:25.382336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:25.385978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:25.408983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:25.411828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:25.413753 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-478fb797-22c6-4cf1-b280-e24fc869db87 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1549 microversion: 2.25 time: 1.045357 Oct 11 19:51:25.415126 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1136/2308] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:24 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1549 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:25.421314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-960dabf4-3153-4dba-8d36-0d5efe305df3 tempest-FlavorsV2NegativeTest-1185489004 tempest-FlavorsV2NegativeTest-1185489004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-616999702", "imageRef": "f237283d-e9ac-4a8e-a606-270d67222915", "flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:25.500611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-960dabf4-3153-4dba-8d36-0d5efe305df3 tempest-FlavorsV2NegativeTest-1185489004 tempest-FlavorsV2NegativeTest-1185489004-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:51:25.781658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e9eda13a-d0b5-4792-907d-ad2cf3fb2c1a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:25.803169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e9eda13a-d0b5-4792-907d-ad2cf3fb2c1a tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 200 len: 1518 microversion: 2.1 time: 1.610029 Oct 11 19:51:25.824925 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1173/2309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:24 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 1518 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:25.835084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-cc4d3b56-b240-411a-8710-68c0e5ccde79 req-d28ff225-eef6-4e3a-bdb7-3ea6ebd59475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62427f88-7209-4cca-b0d0-417db41dae91", "name": "network-vif-deleted", "tag": "f990d77f-6e62-4992-8620-d4a2ed2e5780"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:25.871496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cc4d3b56-b240-411a-8710-68c0e5ccde79 req-d28ff225-eef6-4e3a-bdb7-3ea6ebd59475 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:25.872741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cc4d3b56-b240-411a-8710-68c0e5ccde79 req-d28ff225-eef6-4e3a-bdb7-3ea6ebd59475 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:25.874244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cc4d3b56-b240-411a-8710-68c0e5ccde79 req-d28ff225-eef6-4e3a-bdb7-3ea6ebd59475 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:25.920524 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-cc4d3b56-b240-411a-8710-68c0e5ccde79 req-d28ff225-eef6-4e3a-bdb7-3ea6ebd59475 service nova] Creating event network-vif-deleted:f990d77f-6e62-4992-8620-d4a2ed2e5780 for instance 62427f88-7209-4cca-b0d0-417db41dae91 on n-h1-860864-3 Oct 11 19:51:25.939961 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-cc4d3b56-b240-411a-8710-68c0e5ccde79 req-d28ff225-eef6-4e3a-bdb7-3ea6ebd59475 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113447 Oct 11 19:51:25.941827 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1174/2310] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:26.145014 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-960dabf4-3153-4dba-8d36-0d5efe305df3 tempest-FlavorsV2NegativeTest-1185489004 tempest-FlavorsV2NegativeTest-1185489004-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-960dabf4-3153-4dba-8d36-0d5efe305df3 tempest-FlavorsV2NegativeTest-1185489004 tempest-FlavorsV2NegativeTest-1185489004-project] Request method failure captured: Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 142 Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRck7jnQtrfVx2ycUOYCyw3ykOPmcV03-zW5sUiTxPHpqbsvXjckOkN0PwU-WskAUFdli7kXx2nnJg4ZsxAuawd7gdypOGCozwEhHqSONh4FwgjylWQLOe2ihyf0R1vC_J4SN8EguWY0PruPeJrcvSgKpV_Nqvjec1F6TID1LzXyTyS8 Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 856ce7ef7e694decbb7c63eb7054dc7c Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FlavorsV2NegativeTest-1185489004 Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/856ce7ef7e694decbb7c63eb7054dc7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_856ce7ef7e694decbb7c63eb7054dc7c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/856ce7ef7e694decbb7c63eb7054dc7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/856ce7ef7e694decbb7c63eb7054dc7c"}]}] Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FlavorsV2NegativeTest-1185489004 Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 856ce7ef7e694decbb7c63eb7054dc7c Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1185489004 Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FlavorsV2NegativeTest-1185489004-project Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3ecc8365f7854bbeaaca7d7fc149981b Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FlavorsV2NegativeTest-1185489004-project Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-616999702", "imageRef": "f237283d-e9ac-4a8e-a606-270d67222915", "flavorRef": "452"}} Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: exception: Flavor's memory is too small for requested image. Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-616999702', 'imageRef': 'f237283d-e9ac-4a8e-a606-270d67222915', 'flavorRef': '452'}}} Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:51:26.146711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-960dabf4-3153-4dba-8d36-0d5efe305df3 tempest-FlavorsV2NegativeTest-1185489004 tempest-FlavorsV2NegativeTest-1185489004-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:26.150416 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-960dabf4-3153-4dba-8d36-0d5efe305df3 tempest-FlavorsV2NegativeTest-1185489004 tempest-FlavorsV2NegativeTest-1185489004-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.731822 Oct 11 19:51:26.160345 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1137/2311] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:51:25 2022] POST /compute/v2.1/servers => generated 93 bytes in 744 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:51:26.446099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:26.447855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:26.468158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:26.470948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:26.471737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:26.473390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:26.474859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:26.478002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:26.539798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:26.540460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:26.540901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:26.542015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lazy-loading 'fault' on Instance uuid 2e6fb34e-c435-436b-905d-3898c72acc34 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:51:26.632357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:26.646020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:26.649670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:26.652065 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b68f27d2-a7c2-43cd-b5b7-fe36da326635 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 200 len: 1352 microversion: 2.25 time: 0.210521 Oct 11 19:51:26.652985 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1175/2312] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:26 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 1352 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:26.828770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:26.829377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 62427f88-7209-4cca-b0d0-417db41dae91] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:26.836987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:26.837482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:26.837915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:26.838633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:26.839087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:26.839511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] HTTP exception thrown: Instance 62427f88-7209-4cca-b0d0-417db41dae91 could not be found. Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Request method failure captured: Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 HTTP/1.1 Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcjxpVv76WsN8dulFOiG8lL4KqLebzj23ao4E4K16I5wJ6oFFdoYDCGryIKt3xwwMtCxb4oX-Ky99hfIJV-nsr_xEl2ZKB9cO9C-8AsRLB4n9Wwv_Wm2AFt0fE7cZPNEylrmFFv7VUCtRNhHB6YQ3I37ylp-bJek7LD3tIOAKsSVtkY Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 720def5330eb4ea192335c6a4d9d2884 Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ListServerFiltersTestJSON-1334404726 Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/720def5330eb4ea192335c6a4d9d2884"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_720def5330eb4ea192335c6a4d9d2884", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/720def5330eb4ea192335c6a4d9d2884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/720def5330eb4ea192335c6a4d9d2884"}]}] Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ListServerFiltersTestJSON-1334404726 Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 720def5330eb4ea192335c6a4d9d2884 Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1334404726 Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ListServerFiltersTestJSON-1334404726-project Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 54b2ce29886e4de8a2e40c970378284a Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ListServerFiltersTestJSON-1334404726-project Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 62427f88-7209-4cca-b0d0-417db41dae91 could not be found. Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '62427f88-7209-4cca-b0d0-417db41dae91'} Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62427f88-7209-4cca-b0d0-417db41dae91 could not be found. Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:26.859488 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62427f88-7209-4cca-b0d0-417db41dae91 could not be found. Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62427f88-7209-4cca-b0d0-417db41dae91 could not be found. Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Returning 404 to user: Instance 62427f88-7209-4cca-b0d0-417db41dae91 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca6b7267-243d-4938-92da-939a1e21ff87 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91" status: 404 len: 111 microversion: 2.1 time: 0.032028 Oct 11 19:51:26.862952 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1138/2313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:26 2022] GET /compute/v2.1/servers/62427f88-7209-4cca-b0d0-417db41dae91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:26.864344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c04afe32-c04e-453a-b04a-f7c03a821412 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:26.865664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c04afe32-c04e-453a-b04a-f7c03a821412 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:26.870961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c04afe32-c04e-453a-b04a-f7c03a821412 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:26.871450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c04afe32-c04e-453a-b04a-f7c03a821412 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:26.871883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c04afe32-c04e-453a-b04a-f7c03a821412 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:26.872594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c04afe32-c04e-453a-b04a-f7c03a821412 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:26.873043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c04afe32-c04e-453a-b04a-f7c03a821412 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:26.873462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c04afe32-c04e-453a-b04a-f7c03a821412 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:26.905509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c04afe32-c04e-453a-b04a-f7c03a821412 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:51:27.029754 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c04afe32-c04e-453a-b04a-f7c03a821412 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "DELETE /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e" status: 204 len: 0 microversion: 2.1 time: 0.168597 Oct 11 19:51:27.033314 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1176/2314] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:26 2022] DELETE /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:51:27.041930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4442ec83-517b-4143-8848-fb239c806a5b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:27.042848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4442ec83-517b-4143-8848-fb239c806a5b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:27.053958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4442ec83-517b-4143-8848-fb239c806a5b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:27.055498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4442ec83-517b-4143-8848-fb239c806a5b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:27.056510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4442ec83-517b-4143-8848-fb239c806a5b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:27.057645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4442ec83-517b-4143-8848-fb239c806a5b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:27.058210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4442ec83-517b-4143-8848-fb239c806a5b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:27.058851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4442ec83-517b-4143-8848-fb239c806a5b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:27.228781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4442ec83-517b-4143-8848-fb239c806a5b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:27.238209 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4442ec83-517b-4143-8848-fb239c806a5b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e" status: 200 len: 1518 microversion: 2.1 time: 0.200947 Oct 11 19:51:27.239190 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1139/2315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:27 2022] GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e => generated 1518 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:27.681712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:27.682873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: 2e6fb34e-c435-436b-905d-3898c72acc34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:27.691492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:27.692562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:27.693298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:27.694266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:27.695052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:27.696368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:27.714620 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] HTTP exception thrown: Instance 2e6fb34e-c435-436b-905d-3898c72acc34 could not be found. Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Request method failure captured: Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 HTTP/1.1 Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRceHyZ66COueCmMKS6bIM-PiL0BnU0kxcFgwGgFRRr46Ha6jo127LWAWgwkxrbL7c46CrNcvHA38ix2lmhFbQ5UOUA9mMnRyFyKtu9E9vpPJjhi0X4KDDLPanYn3L5AHayOzW5L0m0h9N4xj3kgQlsf_7VBmtNadimV4sw-wCIQ6q14 Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 0ac923f5632e40b2bd81aa5de2ed3f5a Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ac923f5632e40b2bd81aa5de2ed3f5a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}] Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 0ac923f5632e40b2bd81aa5de2ed3f5a Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-LiveAutoBlockMigrationV225Test-1536528071-project Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 823a414535d04791844ab997869542b2 Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071-project Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 2e6fb34e-c435-436b-905d-3898c72acc34 could not be found. Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '2e6fb34e-c435-436b-905d-3898c72acc34'} Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6fb34e-c435-436b-905d-3898c72acc34 could not be found. Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6fb34e-c435-436b-905d-3898c72acc34 could not be found. Oct 11 19:51:27.716677 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6fb34e-c435-436b-905d-3898c72acc34 could not be found. Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Returning 404 to user: Instance 2e6fb34e-c435-436b-905d-3898c72acc34 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:27.721177 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-101d39e8-5741-4b87-8b8d-5cf2485eb39d tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34" status: 404 len: 111 microversion: 2.25 time: 0.041930 Oct 11 19:51:27.728305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5bad9fab-7719-4dbf-b0ab-0a03c518c57c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:27.728305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5bad9fab-7719-4dbf-b0ab-0a03c518c57c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:27.732299 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1177/2316] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:27 2022] GET /compute/v2.1/servers/2e6fb34e-c435-436b-905d-3898c72acc34 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:51:27.733855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bad9fab-7719-4dbf-b0ab-0a03c518c57c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:27.734340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bad9fab-7719-4dbf-b0ab-0a03c518c57c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:27.734845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bad9fab-7719-4dbf-b0ab-0a03c518c57c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:27.735706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bad9fab-7719-4dbf-b0ab-0a03c518c57c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:27.736345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bad9fab-7719-4dbf-b0ab-0a03c518c57c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:27.736728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bad9fab-7719-4dbf-b0ab-0a03c518c57c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:27.765298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5bad9fab-7719-4dbf-b0ab-0a03c518c57c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:51:27.887194 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5bad9fab-7719-4dbf-b0ab-0a03c518c57c tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 204 len: 0 microversion: 2.25 time: 0.163615 Oct 11 19:51:27.890836 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1140/2317] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:27 2022] DELETE /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:51:27.901168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:27.901944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:27.909019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:27.909698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:27.910126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:27.911443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:27.912062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:27.912834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:28.029644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a256a776-c306-417d-a802-3bef032a335d req-302df85d-32ae-4124-9618-6c95c47cf09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6fb34e-c435-436b-905d-3898c72acc34", "name": "network-vif-deleted", "tag": "808efdac-6278-4889-b777-265334565eda"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:28.044425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a256a776-c306-417d-a802-3bef032a335d req-302df85d-32ae-4124-9618-6c95c47cf09e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:28.045584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a256a776-c306-417d-a802-3bef032a335d req-302df85d-32ae-4124-9618-6c95c47cf09e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:28.046027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a256a776-c306-417d-a802-3bef032a335d req-302df85d-32ae-4124-9618-6c95c47cf09e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:28.087578 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a256a776-c306-417d-a802-3bef032a335d req-302df85d-32ae-4124-9618-6c95c47cf09e service nova] Creating event network-vif-deleted:808efdac-6278-4889-b777-265334565eda for instance 2e6fb34e-c435-436b-905d-3898c72acc34 on n-h1-860864-3 Oct 11 19:51:28.095611 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a256a776-c306-417d-a802-3bef032a335d req-302df85d-32ae-4124-9618-6c95c47cf09e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071055 Oct 11 19:51:28.097765 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1141/2318] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:28.100619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:28.108916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:28.114224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:28.115712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:28.117203 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eec43e15-037a-48e0-a9ed-eb27d49a1dc6 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1564 microversion: 2.25 time: 0.221550 Oct 11 19:51:28.119167 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1178/2319] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:27 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1564 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:51:28.262679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d1bb629-869c-483f-aee3-1818339ea57b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:28.263376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0d1bb629-869c-483f-aee3-1818339ea57b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:28.271943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1bb629-869c-483f-aee3-1818339ea57b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:28.272593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1bb629-869c-483f-aee3-1818339ea57b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:28.273169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1bb629-869c-483f-aee3-1818339ea57b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:28.274262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1bb629-869c-483f-aee3-1818339ea57b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:28.274741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1bb629-869c-483f-aee3-1818339ea57b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:28.275167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1bb629-869c-483f-aee3-1818339ea57b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:28.464739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0d1bb629-869c-483f-aee3-1818339ea57b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:28.474420 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0d1bb629-869c-483f-aee3-1818339ea57b tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e" status: 200 len: 1518 microversion: 2.1 time: 0.217044 Oct 11 19:51:28.475778 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1142/2320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:28 2022] GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e => generated 1518 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:29.145268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:29.145883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:29.173028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:29.174989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:29.176240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:29.178394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:29.179482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:29.180247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:29.248586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f0babf5-7a7c-41e4-8070-10261cbe9fb1 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Calling method '.version_select at 0x7f83d06fbd30>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:29.293208 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f0babf5-7a7c-41e4-8070-10261cbe9fb1 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091" status: 200 len: 637 microversion: 2.1 time: 0.053918 Oct 11 19:51:29.293807 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1143/2321] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:51:29 2022] GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091 => generated 637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:29.373042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:29.383312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:29.385039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:29.386331 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2aabc95d-d201-4905-b077-098034d56218 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1564 microversion: 2.25 time: 0.244957 Oct 11 19:51:29.387027 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1179/2322] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:29 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1564 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:51:29.391747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bc462ec9-318a-4a3c-b0e7-b065ef09dcf6 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Action: 'update_all', calling method: .version_select at 0x7f83cc9acca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:29.437893 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4e3f08b1-cef7-4abd-9b1c-b62030fd171f tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.142866 Oct 11 19:51:29.438573 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1144/2323] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 11 19:51:29 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 19:51:29.447803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe832b84-c1dc-4756-8e49-7bb858b400fc tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Calling method '.version_select at 0x7f83d06f9700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:29.450352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-bc462ec9-318a-4a3c-b0e7-b065ef09dcf6 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:29.456649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-bc462ec9-318a-4a3c-b0e7-b065ef09dcf6 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for user fe56fc9199084eacb8552510c13e4392 and project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:29.470183 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-fe832b84-c1dc-4756-8e49-7bb858b400fc tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] HTTP exception thrown: Image not found. Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe832b84-c1dc-4756-8e49-7bb858b400fc tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Request method failure captured: Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclBN-qL8iGxmbHE1X8HF_GPE5TVJrajknkfPwLwok2Gep_eB5_tZ4ALouWdzQsXGw8A9pgf7OlEhCDF7ec3uHcWi3aD4FYsTX5So0aGCJUi--jZap_Tf_xh2NEkLNjWgFPvloQKrxPML4yoAoTVbXd23inKbLdDxz-r8wscm-2658Y Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 387afc98f7414958b42b1cde69ac119c Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/387afc98f7414958b42b1cde69ac119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_387afc98f7414958b42b1cde69ac119c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387afc98f7414958b42b1cde69ac119c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387afc98f7414958b42b1cde69ac119c"}]}] Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 387afc98f7414958b42b1cde69ac119c Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesDeleteNegativeTestJSON-470735333-project Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7df0d54860f244e1ba368fecbcbe4237 Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-470735333-project Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '-1'} Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.472742 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:29.476898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.479908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe832b84-c1dc-4756-8e49-7bb858b400fc tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:29.480972 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fe832b84-c1dc-4756-8e49-7bb858b400fc tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.036870 Oct 11 19:51:29.483267 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1145/2324] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 11 19:51:29 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 19:51:29.492188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1df0bb90-ac4e-4f6f-886c-06c1337fc9b5 tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Calling method '.version_select at 0x7f83d06fbdc0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:29.499256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:29.519412 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-1df0bb90-ac4e-4f6f-886c-06c1337fc9b5 tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] HTTP exception thrown: Image not found. Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1df0bb90-ac4e-4f6f-886c-06c1337fc9b5 tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Request method failure captured: Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/images/7b9bbf32-94bd-413e-9bab-86d7a9e95b1j HTTP/1.1 Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclBN-qL8iGxmbHE1X8HF_GPE5TVJrajknkfPwLwok2Gep_eB5_tZ4ALouWdzQsXGw8A9pgf7OlEhCDF7ec3uHcWi3aD4FYsTX5So0aGCJUi--jZap_Tf_xh2NEkLNjWgFPvloQKrxPML4yoAoTVbXd23inKbLdDxz-r8wscm-2658Y Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 387afc98f7414958b42b1cde69ac119c Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/387afc98f7414958b42b1cde69ac119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_387afc98f7414958b42b1cde69ac119c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387afc98f7414958b42b1cde69ac119c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387afc98f7414958b42b1cde69ac119c"}]}] Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 387afc98f7414958b42b1cde69ac119c Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesDeleteNegativeTestJSON-470735333-project Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7df0d54860f244e1ba368fecbcbe4237 Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-470735333-project Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '7b9bbf32-94bd-413e-9bab-86d7a9e95b1j'} Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7b9bbf32-94bd-413e-9bab-86d7a9e95b1j to delete Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7b9bbf32-94bd-413e-9bab-86d7a9e95b1j could not be found. Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.521235 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:29.525498 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.527280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1df0bb90-ac4e-4f6f-886c-06c1337fc9b5 tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:29.528237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1df0bb90-ac4e-4f6f-886c-06c1337fc9b5 tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] 10.222.0.27 "DELETE /compute/v2.1/images/7b9bbf32-94bd-413e-9bab-86d7a9e95b1j" status: 404 len: 62 microversion: 2.1 time: 0.041167 Oct 11 19:51:29.530659 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1146/2325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:29 2022] DELETE /compute/v2.1/images/7b9bbf32-94bd-413e-9bab-86d7a9e95b1j => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:51:29.539505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0c4fc86-f4f2-4505-9127-745d58c97ab5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:29.540803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a0c4fc86-f4f2-4505-9127-745d58c97ab5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:29.548492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c4fc86-f4f2-4505-9127-745d58c97ab5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:29.549211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c4fc86-f4f2-4505-9127-745d58c97ab5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:29.549874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c4fc86-f4f2-4505-9127-745d58c97ab5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:29.551174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c4fc86-f4f2-4505-9127-745d58c97ab5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:29.551924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c4fc86-f4f2-4505-9127-745d58c97ab5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:29.552535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c4fc86-f4f2-4505-9127-745d58c97ab5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:29.709918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a0c4fc86-f4f2-4505-9127-745d58c97ab5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:29.722646 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a0c4fc86-f4f2-4505-9127-745d58c97ab5 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e" status: 200 len: 1518 microversion: 2.1 time: 0.190416 Oct 11 19:51:29.723182 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1147/2326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:29 2022] GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:29.731311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c987778-81a6-41fe-888a-d22e75ab11e6 tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Calling method '.version_select at 0x7f83d06f9af0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:29.754374 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5c987778-81a6-41fe-888a-d22e75ab11e6 tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] HTTP exception thrown: Image not found. Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c987778-81a6-41fe-888a-d22e75ab11e6 tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Request method failure captured: Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/images/73aa0791-a0dd-4157-885f-baeb5f945a4d1 HTTP/1.1 Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclBN-qL8iGxmbHE1X8HF_GPE5TVJrajknkfPwLwok2Gep_eB5_tZ4ALouWdzQsXGw8A9pgf7OlEhCDF7ec3uHcWi3aD4FYsTX5So0aGCJUi--jZap_Tf_xh2NEkLNjWgFPvloQKrxPML4yoAoTVbXd23inKbLdDxz-r8wscm-2658Y Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 387afc98f7414958b42b1cde69ac119c Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/387afc98f7414958b42b1cde69ac119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_387afc98f7414958b42b1cde69ac119c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387afc98f7414958b42b1cde69ac119c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387afc98f7414958b42b1cde69ac119c"}]}] Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 387afc98f7414958b42b1cde69ac119c Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesDeleteNegativeTestJSON-470735333-project Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7df0d54860f244e1ba368fecbcbe4237 Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-470735333-project Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '73aa0791-a0dd-4157-885f-baeb5f945a4d1'} Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 73aa0791-a0dd-4157-885f-baeb5f945a4d1 to delete Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 73aa0791-a0dd-4157-885f-baeb5f945a4d1 could not be found. Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.756659 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c987778-81a6-41fe-888a-d22e75ab11e6 tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5c987778-81a6-41fe-888a-d22e75ab11e6 tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] 10.222.0.27 "DELETE /compute/v2.1/images/73aa0791-a0dd-4157-885f-baeb5f945a4d1" status: 404 len: 62 microversion: 2.1 time: 0.033782 Oct 11 19:51:29.760266 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1148/2327] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:29 2022] DELETE /compute/v2.1/images/73aa0791-a0dd-4157-885f-baeb5f945a4d1 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:51:29.768144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8c5f554-35bd-49a9-b569-03c4655cce1b tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Calling method '.version_select at 0x7f83d0700f70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:29.793025 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c8c5f554-35bd-49a9-b569-03c4655cce1b tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] HTTP exception thrown: Image not found. Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8c5f554-35bd-49a9-b569-03c4655cce1b tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Request method failure captured: Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/images/tempest-invalid-1384095806 HTTP/1.1 Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclBN-qL8iGxmbHE1X8HF_GPE5TVJrajknkfPwLwok2Gep_eB5_tZ4ALouWdzQsXGw8A9pgf7OlEhCDF7ec3uHcWi3aD4FYsTX5So0aGCJUi--jZap_Tf_xh2NEkLNjWgFPvloQKrxPML4yoAoTVbXd23inKbLdDxz-r8wscm-2658Y Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 387afc98f7414958b42b1cde69ac119c Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/387afc98f7414958b42b1cde69ac119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_387afc98f7414958b42b1cde69ac119c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387afc98f7414958b42b1cde69ac119c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387afc98f7414958b42b1cde69ac119c"}]}] Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 387afc98f7414958b42b1cde69ac119c Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesDeleteNegativeTestJSON-470735333-project Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7df0d54860f244e1ba368fecbcbe4237 Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-470735333-project Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'tempest-invalid-1384095806'} Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1384095806 to delete Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1384095806 could not be found. Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.795252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8c5f554-35bd-49a9-b569-03c4655cce1b tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8c5f554-35bd-49a9-b569-03c4655cce1b tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-1384095806" status: 404 len: 62 microversion: 2.1 time: 0.032654 Oct 11 19:51:29.799867 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1149/2328] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 11 19:51:29 2022] DELETE /compute/v2.1/images/tempest-invalid-1384095806 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 19:51:29.808773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7af84c47-1488-41ad-82fb-c4756c9f412d tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Calling method '.version_select at 0x7f83d06f9670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:29.838898 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7af84c47-1488-41ad-82fb-c4756c9f412d tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] HTTP exception thrown: Image not found. Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7af84c47-1488-41ad-82fb-c4756c9f412d tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Request method failure captured: Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/images/cd9bcb1f-7b40-4c24-8947-777a95e5a7f7 HTTP/1.1 Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclBN-qL8iGxmbHE1X8HF_GPE5TVJrajknkfPwLwok2Gep_eB5_tZ4ALouWdzQsXGw8A9pgf7OlEhCDF7ec3uHcWi3aD4FYsTX5So0aGCJUi--jZap_Tf_xh2NEkLNjWgFPvloQKrxPML4yoAoTVbXd23inKbLdDxz-r8wscm-2658Y Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 387afc98f7414958b42b1cde69ac119c Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/387afc98f7414958b42b1cde69ac119c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_387afc98f7414958b42b1cde69ac119c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387afc98f7414958b42b1cde69ac119c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387afc98f7414958b42b1cde69ac119c"}]}] Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 387afc98f7414958b42b1cde69ac119c Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-470735333 Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesDeleteNegativeTestJSON-470735333-project Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 7df0d54860f244e1ba368fecbcbe4237 Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-470735333-project Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'cd9bcb1f-7b40-4c24-8947-777a95e5a7f7'} Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cd9bcb1f-7b40-4c24-8947-777a95e5a7f7 to delete Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd9bcb1f-7b40-4c24-8947-777a95e5a7f7 could not be found. Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.846594 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:29.849888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:29.853212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7af84c47-1488-41ad-82fb-c4756c9f412d tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:29.855909 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7af84c47-1488-41ad-82fb-c4756c9f412d tempest-ImagesDeleteNegativeTestJSON-470735333 tempest-ImagesDeleteNegativeTestJSON-470735333-project] 10.222.0.27 "DELETE /compute/v2.1/images/cd9bcb1f-7b40-4c24-8947-777a95e5a7f7" status: 404 len: 62 microversion: 2.1 time: 0.050939 Oct 11 19:51:29.857288 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1150/2329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:29 2022] DELETE /compute/v2.1/images/cd9bcb1f-7b40-4c24-8947-777a95e5a7f7 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:51:29.891376 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bc462ec9-318a-4a3c-b0e7-b065ef09dcf6 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 61 microversion: 2.1 time: 0.502715 Oct 11 19:51:29.892414 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1180/2330] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:29 2022] PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 61 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:29.904213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c51f5bb-a790-4652-9a51-f99b9612517a tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Calling method '.version_select at 0x7f83d0700dc0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:30.124800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-cac4f456-28b0-4807-9079-c5659bbd990f req-cc8213c8-ce4d-460a-8282-7575114bb7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337", "name": "network-vif-deleted", "tag": "8295ec70-df13-4a58-810c-672a4906086f"}, {"server_uuid": "212824a5-4bd2-47b3-a64d-b428e088010e", "name": "network-vif-deleted", "tag": "45b409e8-26ed-4842-8e68-cbdf94bd1ffb"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:30.152951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cac4f456-28b0-4807-9079-c5659bbd990f req-cc8213c8-ce4d-460a-8282-7575114bb7eb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:30.157893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cac4f456-28b0-4807-9079-c5659bbd990f req-cc8213c8-ce4d-460a-8282-7575114bb7eb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:30.158576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cac4f456-28b0-4807-9079-c5659bbd990f req-cc8213c8-ce4d-460a-8282-7575114bb7eb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:30.199321 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-cac4f456-28b0-4807-9079-c5659bbd990f req-cc8213c8-ce4d-460a-8282-7575114bb7eb service nova] Creating event network-vif-deleted:8295ec70-df13-4a58-810c-672a4906086f for instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 on n-h1-860864-3 Oct 11 19:51:30.201336 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-cac4f456-28b0-4807-9079-c5659bbd990f req-cc8213c8-ce4d-460a-8282-7575114bb7eb service nova] Creating event network-vif-deleted:45b409e8-26ed-4842-8e68-cbdf94bd1ffb for instance 212824a5-4bd2-47b3-a64d-b428e088010e on n-h2-860864-3 Oct 11 19:51:30.253054 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-cac4f456-28b0-4807-9079-c5659bbd990f req-cc8213c8-ce4d-460a-8282-7575114bb7eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.124137 Oct 11 19:51:30.258975 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1181/2331] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:30.410808 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c51f5bb-a790-4652-9a51-f99b9612517a tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "DELETE /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.510935 Oct 11 19:51:30.415295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:30.415461 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1151/2332] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Oct 11 19:51:29 2022] DELETE /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata/os_version => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:51:30.417425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:30.423126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e4f2a14e-c299-409c-a9e9-4db306365c6f tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Calling method '.version_select at 0x7f83d0702790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:30.435188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:30.435951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:30.438835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:30.450993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:30.456479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:30.460494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:30.514791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:30.515424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:30.516038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:30.516578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lazy-loading 'fault' on Instance uuid fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:51:30.525231 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e4f2a14e-c299-409c-a9e9-4db306365c6f tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 37 microversion: 2.1 time: 0.103126 Oct 11 19:51:30.525891 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1152/2333] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:51:30 2022] GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 37 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:30.552170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c2f992e4-b28f-4ad2-87d7-012e3fd8b7f2 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Action: 'update_all', calling method: .version_select at 0x7f83d0700310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:30.609775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:30.640171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:30.642004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '823a414535d04791844ab997869542b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac923f5632e40b2bd81aa5de2ed3f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:30.648215 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cbafaf75-31e3-4945-ae94-1ee62f7371e9 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 200 len: 1352 microversion: 2.25 time: 0.238442 Oct 11 19:51:30.662439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c2f992e4-b28f-4ad2-87d7-012e3fd8b7f2 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:30.668683 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1182/2334] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:30 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 1352 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:30.672461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c2f992e4-b28f-4ad2-87d7-012e3fd8b7f2 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for user fe56fc9199084eacb8552510c13e4392 and project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:30.746415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:30.747063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:30.758783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:30.759624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:30.760067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:30.764155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:30.764851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:30.765223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:30.826457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:30.826981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:30.827421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:30.827867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lazy-loading 'fault' on Instance uuid 212824a5-4bd2-47b3-a64d-b428e088010e {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:51:30.937987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:30.950585 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1cc96bc9-d870-4034-b562-d5f02f40ffa3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e" status: 200 len: 1311 microversion: 2.1 time: 0.208678 Oct 11 19:51:30.951196 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1183/2335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:30 2022] GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e => generated 1311 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:51:31.089265 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c2f992e4-b28f-4ad2-87d7-012e3fd8b7f2 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 61 microversion: 2.1 time: 0.550222 Oct 11 19:51:31.094812 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1153/2336] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:30 2022] PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 61 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:31.100803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cba2f430-acff-44b1-ad17-5225bcdf0fce tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Calling method '.version_select at 0x7f83cc66d280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:31.171567 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cba2f430-acff-44b1-ad17-5225bcdf0fce tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.074088 Oct 11 19:51:31.172205 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1184/2337] 10.222.0.27 () {58 vars in 1290 bytes} [Tue Oct 11 19:51:31 2022] GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata/os_distro => generated 33 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 19:51:31.184738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bcacee55-ae96-4877-a741-790e65911921 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Action: 'update_all', calling method: .version_select at 0x7f83d06f9e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:31.277211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-bcacee55-ae96-4877-a741-790e65911921 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:31.285859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-bcacee55-ae96-4877-a741-790e65911921 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for user fe56fc9199084eacb8552510c13e4392 and project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:31.330889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c80a445-8cc1-4eac-822f-760c345ed5a7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:31.331817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c80a445-8cc1-4eac-822f-760c345ed5a7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:31.370496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c80a445-8cc1-4eac-822f-760c345ed5a7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:31.371134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c80a445-8cc1-4eac-822f-760c345ed5a7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:31.374767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c80a445-8cc1-4eac-822f-760c345ed5a7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:31.379009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c80a445-8cc1-4eac-822f-760c345ed5a7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:31.381387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c80a445-8cc1-4eac-822f-760c345ed5a7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:31.384217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c80a445-8cc1-4eac-822f-760c345ed5a7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:31.439228 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c80a445-8cc1-4eac-822f-760c345ed5a7 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/ips" status: 200 len: 145 microversion: 2.1 time: 0.107230 Oct 11 19:51:31.443344 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1185/2338] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 19:51:31 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/ips => generated 145 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:51:31.633871 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bcacee55-ae96-4877-a741-790e65911921 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 61 microversion: 2.1 time: 0.453858 Oct 11 19:51:31.635111 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1154/2339] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:31 2022] PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 61 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:31.655138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-686e2bb5-619c-46c1-ac70-b53ecb519834 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Calling method '.version_select at 0x7f83cc66d280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:31.661092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:31.681603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:31.682311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] [instance: fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:31.699660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:31.701441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:31.704100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:31.705624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:31.706174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:31.706725 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-686e2bb5-619c-46c1-ac70-b53ecb519834 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 61 microversion: 2.1 time: 0.062584 Oct 11 19:51:31.707617 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1186/2340] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:51:31 2022] GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 61 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:31.715232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:31.720258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f0dedf3-4a6e-49ad-98bd-be7dcedd3de0 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Action: 'update_all', calling method: .version_select at 0x7f83cc31d160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:31.766923 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] HTTP exception thrown: Instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 could not be found. Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Request method failure captured: Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 HTTP/1.1 Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRceHyZ66COueCmMKS6bIM-PiL0BnU0kxcFgwGgFRRr46Ha6jo127LWAWgwkxrbL7c46CrNcvHA38ix2lmhFbQ5UOUA9mMnRyFyKtu9E9vpPJjhi0X4KDDLPanYn3L5AHayOzW5L0m0h9N4xj3kgQlsf_7VBmtNadimV4sw-wCIQ6q14 Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 0ac923f5632e40b2bd81aa5de2ed3f5a Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ac923f5632e40b2bd81aa5de2ed3f5a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ac923f5632e40b2bd81aa5de2ed3f5a"}]}] Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 0ac923f5632e40b2bd81aa5de2ed3f5a Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071 Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-LiveAutoBlockMigrationV225Test-1536528071-project Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 823a414535d04791844ab997869542b2 Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1536528071-project Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 could not be found. Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337'} Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 could not be found. Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 could not be found. Oct 11 19:51:31.770428 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 could not be found. Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] Returning 404 to user: Instance fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:31.775362 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f0131eea-6ef0-4e11-84fe-794d8f5296d4 tempest-LiveAutoBlockMigrationV225Test-1536528071 tempest-LiveAutoBlockMigrationV225Test-1536528071-project] 10.222.0.27 "GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337" status: 404 len: 111 microversion: 2.25 time: 0.100705 Oct 11 19:51:31.778040 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1155/2341] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:31 2022] GET /compute/v2.1/servers/fe10ea9c-bf1a-429f-a8e3-f0a78cc0c337 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:51:31.831031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-0f0dedf3-4a6e-49ad-98bd-be7dcedd3de0 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:31.856972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-0f0dedf3-4a6e-49ad-98bd-be7dcedd3de0 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for user fe56fc9199084eacb8552510c13e4392 and project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:31.979359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:31.979980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 212824a5-4bd2-47b3-a64d-b428e088010e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:31.981898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:32.006163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:32.006640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:32.007160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:32.016979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:32.017366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:32.017835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:32.091565 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] HTTP exception thrown: Instance 212824a5-4bd2-47b3-a64d-b428e088010e could not be found. Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Request method failure captured: Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e HTTP/1.1 Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcjxpVv76WsN8dulFOiG8lL4KqLebzj23ao4E4K16I5wJ6oFFdoYDCGryIKt3xwwMtCxb4oX-Ky99hfIJV-nsr_xEl2ZKB9cO9C-8AsRLB4n9Wwv_Wm2AFt0fE7cZPNEylrmFFv7VUCtRNhHB6YQ3I37ylp-bJek7LD3tIOAKsSVtkY Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 720def5330eb4ea192335c6a4d9d2884 Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ListServerFiltersTestJSON-1334404726 Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/720def5330eb4ea192335c6a4d9d2884"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_720def5330eb4ea192335c6a4d9d2884", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/720def5330eb4ea192335c6a4d9d2884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/720def5330eb4ea192335c6a4d9d2884"}]}] Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ListServerFiltersTestJSON-1334404726 Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 720def5330eb4ea192335c6a4d9d2884 Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1334404726 Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ListServerFiltersTestJSON-1334404726-project Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 54b2ce29886e4de8a2e40c970378284a Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ListServerFiltersTestJSON-1334404726-project Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 212824a5-4bd2-47b3-a64d-b428e088010e could not be found. Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '212824a5-4bd2-47b3-a64d-b428e088010e'} Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212824a5-4bd2-47b3-a64d-b428e088010e could not be found. Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212824a5-4bd2-47b3-a64d-b428e088010e could not be found. Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:32.093168 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:32.097455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:32.097455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:32.097455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:32.097455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:32.097455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:32.097455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212824a5-4bd2-47b3-a64d-b428e088010e could not be found. Oct 11 19:51:32.097455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:32.097455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Returning 404 to user: Instance 212824a5-4bd2-47b3-a64d-b428e088010e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:32.097455 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-edcc4e2a-8cb0-4576-8cb5-b878a60cc649 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e" status: 404 len: 111 microversion: 2.1 time: 0.120740 Oct 11 19:51:32.102807 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1156/2342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:31 2022] GET /compute/v2.1/servers/212824a5-4bd2-47b3-a64d-b428e088010e => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:51:32.130188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-850739b2-ee3a-42f8-add4-96feebf7ec6d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:32.130798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-850739b2-ee3a-42f8-add4-96feebf7ec6d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:32.176370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-850739b2-ee3a-42f8-add4-96feebf7ec6d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:32.177738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-850739b2-ee3a-42f8-add4-96feebf7ec6d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:32.177738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-850739b2-ee3a-42f8-add4-96feebf7ec6d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:32.178032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-850739b2-ee3a-42f8-add4-96feebf7ec6d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:32.178497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-850739b2-ee3a-42f8-add4-96feebf7ec6d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:32.178953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-850739b2-ee3a-42f8-add4-96feebf7ec6d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:32.195711 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f0dedf3-4a6e-49ad-98bd-be7dcedd3de0 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 61 microversion: 2.1 time: 0.479670 Oct 11 19:51:32.196923 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1187/2343] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:31 2022] PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 61 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 19:51:32.207202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5c541199-e4de-4ae5-9904-db65e8e8b424 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Action: 'update_all', calling method: .version_select at 0x7f83cc5de550>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:32.254444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-850739b2-ee3a-42f8-add4-96feebf7ec6d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:51:32.292940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:32.313332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-5c541199-e4de-4ae5-9904-db65e8e8b424 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:32.331064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-5c541199-e4de-4ae5-9904-db65e8e8b424 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for user fe56fc9199084eacb8552510c13e4392 and project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:32.449004 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-850739b2-ee3a-42f8-add4-96feebf7ec6d tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 204 len: 0 microversion: 2.1 time: 0.343656 Oct 11 19:51:32.459684 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1157/2344] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:51:32 2022] DELETE /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:51:32.500648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62e9dc49-14dc-4c99-86d3-61156252edf3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:32.501363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-62e9dc49-14dc-4c99-86d3-61156252edf3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:32.530807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e9dc49-14dc-4c99-86d3-61156252edf3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:32.531334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e9dc49-14dc-4c99-86d3-61156252edf3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:32.532657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e9dc49-14dc-4c99-86d3-61156252edf3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:32.533388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e9dc49-14dc-4c99-86d3-61156252edf3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:32.533841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e9dc49-14dc-4c99-86d3-61156252edf3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:32.534259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e9dc49-14dc-4c99-86d3-61156252edf3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:33.146880 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5c541199-e4de-4ae5-9904-db65e8e8b424 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 64 microversion: 2.1 time: 0.944673 Oct 11 19:51:33.147537 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1188/2345] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:32 2022] PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 64 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:33.157534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aeaa0c6e-7f5a-4247-afe4-9d9ed016f225 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Calling method '.version_select at 0x7f83cc66d9d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:33.258568 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aeaa0c6e-7f5a-4247-afe4-9d9ed016f225 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 64 microversion: 2.1 time: 0.104430 Oct 11 19:51:33.259197 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1189/2346] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:51:33 2022] GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 64 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 19:51:33.270185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-22996f1b-76e0-42c4-a7c0-cbeacf891000 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Action: 'update_all', calling method: .version_select at 0x7f83cc5718b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:33.446114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-22996f1b-76e0-42c4-a7c0-cbeacf891000 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:33.465270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-22996f1b-76e0-42c4-a7c0-cbeacf891000 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for user fe56fc9199084eacb8552510c13e4392 and project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:33.790779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-62e9dc49-14dc-4c99-86d3-61156252edf3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:33.799943 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-62e9dc49-14dc-4c99-86d3-61156252edf3 tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1519 microversion: 2.1 time: 1.342411 Oct 11 19:51:33.800516 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1158/2347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:32 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1519 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:34.085559 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-22996f1b-76e0-42c4-a7c0-cbeacf891000 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 61 microversion: 2.1 time: 0.819649 Oct 11 19:51:34.091209 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1190/2348] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:33 2022] PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 61 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:34.097030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-db6f9e9c-4802-4793-bf65-3596039c52dc tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46cc3b49-7153-4c56-989e-10f1c60c8383"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:34.099408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-db6f9e9c-4802-4793-bf65-3596039c52dc tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:34.120106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db6f9e9c-4802-4793-bf65-3596039c52dc tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:34.121914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db6f9e9c-4802-4793-bf65-3596039c52dc tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:34.123238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db6f9e9c-4802-4793-bf65-3596039c52dc tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:34.124616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db6f9e9c-4802-4793-bf65-3596039c52dc tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:34.126895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db6f9e9c-4802-4793-bf65-3596039c52dc tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:34.127539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db6f9e9c-4802-4793-bf65-3596039c52dc tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:34.135808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-697b323d-f29e-4d26-80a0-1132c77c2797 tempest-AbsoluteLimitsTestJSON-1493111662 tempest-AbsoluteLimitsTestJSON-1493111662-project] Calling method '.version_select at 0x7f83d0702ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:34.161498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697b323d-f29e-4d26-80a0-1132c77c2797 tempest-AbsoluteLimitsTestJSON-1493111662 tempest-AbsoluteLimitsTestJSON-1493111662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:34.165750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697b323d-f29e-4d26-80a0-1132c77c2797 tempest-AbsoluteLimitsTestJSON-1493111662 tempest-AbsoluteLimitsTestJSON-1493111662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:34.166484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697b323d-f29e-4d26-80a0-1132c77c2797 tempest-AbsoluteLimitsTestJSON-1493111662 tempest-AbsoluteLimitsTestJSON-1493111662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:34.169415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697b323d-f29e-4d26-80a0-1132c77c2797 tempest-AbsoluteLimitsTestJSON-1493111662 tempest-AbsoluteLimitsTestJSON-1493111662-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:34.171267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697b323d-f29e-4d26-80a0-1132c77c2797 tempest-AbsoluteLimitsTestJSON-1493111662 tempest-AbsoluteLimitsTestJSON-1493111662-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:34.171644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697b323d-f29e-4d26-80a0-1132c77c2797 tempest-AbsoluteLimitsTestJSON-1493111662 tempest-AbsoluteLimitsTestJSON-1493111662-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:34.225845 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-697b323d-f29e-4d26-80a0-1132c77c2797 tempest-AbsoluteLimitsTestJSON-1493111662 tempest-AbsoluteLimitsTestJSON-1493111662-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.416278 Oct 11 19:51:34.227001 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1159/2349] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 11 19:51:33 2022] GET /compute/v2.1/limits => generated 511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:34.235706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-747c8dff-f042-456d-8596-4dc882dd5982 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Action: 'update', calling method: .version_select at 0x7f83d06fb700>, body: {"meta": {"os_version": "alt"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:34.336179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-747c8dff-f042-456d-8596-4dc882dd5982 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:34.374222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-747c8dff-f042-456d-8596-4dc882dd5982 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for user fe56fc9199084eacb8552510c13e4392 and project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:34.653905 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-db6f9e9c-4802-4793-bf65-3596039c52dc tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "POST /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.559004 Oct 11 19:51:34.656616 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1191/2350] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 19:51:34 2022] POST /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:34.829060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3c0afa4d-27e7-4b76-b1f4-f6fdf2808d9f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:34.830223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3c0afa4d-27e7-4b76-b1f4-f6fdf2808d9f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:34.849696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c0afa4d-27e7-4b76-b1f4-f6fdf2808d9f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:34.850211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c0afa4d-27e7-4b76-b1f4-f6fdf2808d9f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:34.863177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c0afa4d-27e7-4b76-b1f4-f6fdf2808d9f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:34.863926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c0afa4d-27e7-4b76-b1f4-f6fdf2808d9f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:34.864387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c0afa4d-27e7-4b76-b1f4-f6fdf2808d9f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:34.864808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c0afa4d-27e7-4b76-b1f4-f6fdf2808d9f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:35.017915 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-747c8dff-f042-456d-8596-4dc882dd5982 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.789544 Oct 11 19:51:35.018840 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1160/2351] 10.222.0.27 () {60 vars in 1313 bytes} [Tue Oct 11 19:51:34 2022] PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata/os_version => generated 31 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:35.028445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f091b0f-f638-4b71-b2c5-6f41e8b893c1 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Calling method '.version_select at 0x7f83d07000d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:35.115205 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6f091b0f-f638-4b71-b2c5-6f41e8b893c1 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 58 microversion: 2.1 time: 0.090925 Oct 11 19:51:35.115995 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1161/2352] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:51:35 2022] GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 58 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:35.127409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d86eaa34-99cb-4a8b-b1ad-91a3c6de8c0c tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Action: 'update_all', calling method: .version_select at 0x7f83d06d03a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:35.227705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d86eaa34-99cb-4a8b-b1ad-91a3c6de8c0c tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:35.243586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d86eaa34-99cb-4a8b-b1ad-91a3c6de8c0c tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for user fe56fc9199084eacb8552510c13e4392 and project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:35.882373 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d86eaa34-99cb-4a8b-b1ad-91a3c6de8c0c tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 61 microversion: 2.1 time: 0.758534 Oct 11 19:51:35.884003 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1162/2353] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:35 2022] PUT /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 61 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:35.894688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a80f719-fb21-4db8-95c4-635787c0f0e1 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Action: 'create', calling method: .version_select at 0x7f83d0702b80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:35.989192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-8a80f719-fb21-4db8-95c4-635787c0f0e1 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:36.007088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-8a80f719-fb21-4db8-95c4-635787c0f0e1 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Getting quotas for user fe56fc9199084eacb8552510c13e4392 and project 9e443a3f505046cf92710c6473941a00. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:36.293306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3c0afa4d-27e7-4b76-b1f4-f6fdf2808d9f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b2ce29886e4de8a2e40c970378284a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720def5330eb4ea192335c6a4d9d2884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:36.304650 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3c0afa4d-27e7-4b76-b1f4-f6fdf2808d9f tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 200 len: 1519 microversion: 2.1 time: 1.480415 Oct 11 19:51:36.324100 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1192/2354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:34 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 1519 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:51:36.364371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9fd521a9-4c25-4064-97b9-b41f9973605a req-6a7a042a-3e5d-4f6e-85cc-43a1f10ce77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9376e6e3-23d1-417c-893e-ac22dca17f02", "name": "network-vif-deleted", "tag": "e11263d0-918d-4e50-b5fe-518c79ec4c73"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:36.382961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9fd521a9-4c25-4064-97b9-b41f9973605a req-6a7a042a-3e5d-4f6e-85cc-43a1f10ce77c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:36.384441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9fd521a9-4c25-4064-97b9-b41f9973605a req-6a7a042a-3e5d-4f6e-85cc-43a1f10ce77c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:36.385141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9fd521a9-4c25-4064-97b9-b41f9973605a req-6a7a042a-3e5d-4f6e-85cc-43a1f10ce77c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:36.403563 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9fd521a9-4c25-4064-97b9-b41f9973605a req-6a7a042a-3e5d-4f6e-85cc-43a1f10ce77c service nova] Creating event network-vif-deleted:e11263d0-918d-4e50-b5fe-518c79ec4c73 for instance 9376e6e3-23d1-417c-893e-ac22dca17f02 on n-h1-860864-3 Oct 11 19:51:36.447138 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9fd521a9-4c25-4064-97b9-b41f9973605a req-6a7a042a-3e5d-4f6e-85cc-43a1f10ce77c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086646 Oct 11 19:51:36.452032 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1193/2355] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:36.665889 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a80f719-fb21-4db8-95c4-635787c0f0e1 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "POST /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 85 microversion: 2.1 time: 0.775683 Oct 11 19:51:36.667356 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1163/2356] 10.222.0.27 () {60 vars in 1281 bytes} [Tue Oct 11 19:51:35 2022] POST /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 85 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:36.678014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4852c3cc-fa30-43b1-9668-50167c4c3ec1 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] Calling method '.version_select at 0x7f83ccb46700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:36.679246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-efe564b7-4ebf-4307-b85a-a826ceac5261 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08f4f5cb-024a-4616-b88a-2d161557dea0"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:36.681731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-efe564b7-4ebf-4307-b85a-a826ceac5261 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:36.708203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:36.709730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe564b7-4ebf-4307-b85a-a826ceac5261 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:36.713073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe564b7-4ebf-4307-b85a-a826ceac5261 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:36.713649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe564b7-4ebf-4307-b85a-a826ceac5261 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:36.714406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe564b7-4ebf-4307-b85a-a826ceac5261 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:36.714944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe564b7-4ebf-4307-b85a-a826ceac5261 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:36.715378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe564b7-4ebf-4307-b85a-a826ceac5261 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:36.741033 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4852c3cc-fa30-43b1-9668-50167c4c3ec1 tempest-ImagesMetadataTestJSON-1385770513 tempest-ImagesMetadataTestJSON-1385770513-project] 10.222.0.27 "GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata" status: 200 len: 85 microversion: 2.1 time: 0.067975 Oct 11 19:51:36.741907 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1194/2357] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:51:36 2022] GET /compute/v2.1/images/81676960-c03b-4df7-8916-1ab76281d091/metadata => generated 85 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:51:37.353229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:37.355426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] [instance: 9376e6e3-23d1-417c-893e-ac22dca17f02] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:37.401548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:37.403614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:37.404493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:37.405906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:37.411923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:37.413023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:37.422813 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-efe564b7-4ebf-4307-b85a-a826ceac5261 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745100 Oct 11 19:51:37.439990 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1164/2358] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 19:51:36 2022] POST /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/os-volume_attachments => generated 194 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:37.467715 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] HTTP exception thrown: Instance 9376e6e3-23d1-417c-893e-ac22dca17f02 could not be found. Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Request method failure captured: Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 HTTP/1.1 Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjxpVv76WsN8dulFOiG8lL4KqLebzj23ao4E4K16I5wJ6oFFdoYDCGryIKt3xwwMtCxb4oX-Ky99hfIJV-nsr_xEl2ZKB9cO9C-8AsRLB4n9Wwv_Wm2AFt0fE7cZPNEylrmFFv7VUCtRNhHB6YQ3I37ylp-bJek7LD3tIOAKsSVtkY Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 720def5330eb4ea192335c6a4d9d2884 Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ListServerFiltersTestJSON-1334404726 Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/720def5330eb4ea192335c6a4d9d2884"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_720def5330eb4ea192335c6a4d9d2884", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/720def5330eb4ea192335c6a4d9d2884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/720def5330eb4ea192335c6a4d9d2884"}]}] Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ListServerFiltersTestJSON-1334404726 Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 720def5330eb4ea192335c6a4d9d2884 Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1334404726 Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ListServerFiltersTestJSON-1334404726-project Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 54b2ce29886e4de8a2e40c970378284a Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ListServerFiltersTestJSON-1334404726-project Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 9376e6e3-23d1-417c-893e-ac22dca17f02 could not be found. Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '9376e6e3-23d1-417c-893e-ac22dca17f02'} Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9376e6e3-23d1-417c-893e-ac22dca17f02 could not be found. Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9376e6e3-23d1-417c-893e-ac22dca17f02 could not be found. Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:37.470475 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:37.474852 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:37.474852 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:37.474852 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:37.474852 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:37.474852 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:37.474852 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9376e6e3-23d1-417c-893e-ac22dca17f02 could not be found. Oct 11 19:51:37.474852 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:37.478920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] Returning 404 to user: Instance 9376e6e3-23d1-417c-893e-ac22dca17f02 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:37.481110 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3a63762d-2ce8-4604-80e7-2777204aa3dc tempest-ListServerFiltersTestJSON-1334404726 tempest-ListServerFiltersTestJSON-1334404726-project] 10.222.0.27 "GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02" status: 404 len: 111 microversion: 2.1 time: 0.142897 Oct 11 19:51:37.482714 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1195/2359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:37 2022] GET /compute/v2.1/servers/9376e6e3-23d1-417c-893e-ac22dca17f02 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:51:42.194957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67057aef-45f1-4938-9b31-8955b949c64d tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Calling method '.version_select at 0x7f83d08034c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:42.232590 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-67057aef-45f1-4938-9b31-8955b949c64d tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] HTTP exception thrown: Image not found. Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67057aef-45f1-4938-9b31-8955b949c64d tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Request method failure captured: Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/images/9201b455-3e4c-4aab-bd54-129b3bdb7d22/metadata/os_distro HTTP/1.1 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclN309SThJQFSGeRXla8JLtS1kz4wapTJK4tYGo1im8OJwWzgEG9b4lJfIz05kLUjnvDpnoyrdZU8o3J0PvHiLUAGoBgIU4-o3V2AYDPTHxAPiJ8Hj0mSsUw-2E6ZkzozA7QfUVbaos0lKYeZrbjH2JctRtaxOi1LgHxPgaZKnzPbU Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8e9e9a291a94d148861ba9ecfb5cea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}] Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 77d141fd1494424dab77a5fbad37b6e5 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'image_id': '9201b455-3e4c-4aab-bd54-129b3bdb7d22', 'id': 'os_distro'} Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9201b455-3e4c-4aab-bd54-129b3bdb7d22 Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 19:51:42.245354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9201b455-3e4c-4aab-bd54-129b3bdb7d22 could not be found. Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.250509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67057aef-45f1-4938-9b31-8955b949c64d tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:42.255257 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-67057aef-45f1-4938-9b31-8955b949c64d tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] 10.222.0.27 "DELETE /compute/v2.1/images/9201b455-3e4c-4aab-bd54-129b3bdb7d22/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.343665 Oct 11 19:51:42.264759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0aae07a0-5e95-45a9-8dab-0f01ea5ab134 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Calling method '.version_select at 0x7f83cc5b20d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:42.270333 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1165/2360] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 11 19:51:41 2022] DELETE /compute/v2.1/images/9201b455-3e4c-4aab-bd54-129b3bdb7d22/metadata/os_distro => generated 62 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:51:42.293162 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0aae07a0-5e95-45a9-8dab-0f01ea5ab134 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] HTTP exception thrown: Image not found. Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0aae07a0-5e95-45a9-8dab-0f01ea5ab134 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Request method failure captured: Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/images/62c3fef6-0939-47f7-a61d-25afacd007bc/metadata/os_version HTTP/1.1 Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclN309SThJQFSGeRXla8JLtS1kz4wapTJK4tYGo1im8OJwWzgEG9b4lJfIz05kLUjnvDpnoyrdZU8o3J0PvHiLUAGoBgIU4-o3V2AYDPTHxAPiJ8Hj0mSsUw-2E6ZkzozA7QfUVbaos0lKYeZrbjH2JctRtaxOi1LgHxPgaZKnzPbU Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8e9e9a291a94d148861ba9ecfb5cea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}] Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 77d141fd1494424dab77a5fbad37b6e5 Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: exception: Image not found. Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'image_id': '62c3fef6-0939-47f7-a61d-25afacd007bc', 'id': 'os_version'} Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 62c3fef6-0939-47f7-a61d-25afacd007bc Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 19:51:42.303025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62c3fef6-0939-47f7-a61d-25afacd007bc could not be found. Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:42.307023 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.310959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0aae07a0-5e95-45a9-8dab-0f01ea5ab134 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Returning 404 to user: Image not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:42.315947 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0aae07a0-5e95-45a9-8dab-0f01ea5ab134 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] 10.222.0.27 "GET /compute/v2.1/images/62c3fef6-0939-47f7-a61d-25afacd007bc/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.053348 Oct 11 19:51:42.318561 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1196/2361] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 11 19:51:42 2022] GET /compute/v2.1/images/62c3fef6-0939-47f7-a61d-25afacd007bc/metadata/os_version => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:51:42.329758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a36b192b-2f90-47bc-9440-186a4e2f9a95 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Calling method '.version_select at 0x7f83d0700310>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:42.371121 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-a36b192b-2f90-47bc-9440-186a4e2f9a95 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] HTTP exception thrown: Image not found. Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a36b192b-2f90-47bc-9440-186a4e2f9a95 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Request method failure captured: Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/images/6de1ebdc-337b-4b2c-b3ae-7d910f3fcc54/metadata HTTP/1.1 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclN309SThJQFSGeRXla8JLtS1kz4wapTJK4tYGo1im8OJwWzgEG9b4lJfIz05kLUjnvDpnoyrdZU8o3J0PvHiLUAGoBgIU4-o3V2AYDPTHxAPiJ8Hj0mSsUw-2E6ZkzozA7QfUVbaos0lKYeZrbjH2JctRtaxOi1LgHxPgaZKnzPbU Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8e9e9a291a94d148861ba9ecfb5cea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}] Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 77d141fd1494424dab77a5fbad37b6e5 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'image_id': '6de1ebdc-337b-4b2c-b3ae-7d910f3fcc54'} Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6de1ebdc-337b-4b2c-b3ae-7d910f3fcc54 Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 19:51:42.373344 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6de1ebdc-337b-4b2c-b3ae-7d910f3fcc54 could not be found. Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:42.377295 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.380398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a36b192b-2f90-47bc-9440-186a4e2f9a95 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:42.381381 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a36b192b-2f90-47bc-9440-186a4e2f9a95 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] 10.222.0.27 "GET /compute/v2.1/images/6de1ebdc-337b-4b2c-b3ae-7d910f3fcc54/metadata" status: 404 len: 62 microversion: 2.1 time: 0.056693 Oct 11 19:51:42.393623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-db390f8f-4c3b-46ad-b78c-bdd07528550c tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Action: 'update_all', calling method: .version_select at 0x7f83cc61e670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:42.394893 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1166/2362] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:51:42 2022] GET /compute/v2.1/images/6de1ebdc-337b-4b2c-b3ae-7d910f3fcc54/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:51:42.442063 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-db390f8f-4c3b-46ad-b78c-bdd07528550c tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] HTTP exception thrown: Image not found. Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-db390f8f-4c3b-46ad-b78c-bdd07528550c tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Request method failure captured: Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/images/af89828a-c8de-40fc-96c7-36c545bb5301/metadata HTTP/1.1 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 57 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclN309SThJQFSGeRXla8JLtS1kz4wapTJK4tYGo1im8OJwWzgEG9b4lJfIz05kLUjnvDpnoyrdZU8o3J0PvHiLUAGoBgIU4-o3V2AYDPTHxAPiJ8Hj0mSsUw-2E6ZkzozA7QfUVbaos0lKYeZrbjH2JctRtaxOi1LgHxPgaZKnzPbU Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8e9e9a291a94d148861ba9ecfb5cea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}] Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 77d141fd1494424dab77a5fbad37b6e5 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: exception: Image not found. Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'image_id': 'af89828a-c8de-40fc-96c7-36c545bb5301', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID af89828a-c8de-40fc-96c7-36c545bb5301 Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 19:51:42.444751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af89828a-c8de-40fc-96c7-36c545bb5301 could not be found. Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.449781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-db390f8f-4c3b-46ad-b78c-bdd07528550c tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Returning 404 to user: Image not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:42.453721 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-db390f8f-4c3b-46ad-b78c-bdd07528550c tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] 10.222.0.27 "PUT /compute/v2.1/images/af89828a-c8de-40fc-96c7-36c545bb5301/metadata" status: 404 len: 62 microversion: 2.1 time: 0.064542 Oct 11 19:51:42.454633 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1197/2363] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:51:42 2022] PUT /compute/v2.1/images/af89828a-c8de-40fc-96c7-36c545bb5301/metadata => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:51:42.465080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4dab1bbd-bee8-4127-bc24-2ca2aaa5daf1 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Action: 'update', calling method: .version_select at 0x7f83d08038b0>, body: {"meta": {"os_distro": "alt"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:42.542325 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-4dab1bbd-bee8-4127-bc24-2ca2aaa5daf1 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] HTTP exception thrown: Image not found. Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4dab1bbd-bee8-4127-bc24-2ca2aaa5daf1 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Request method failure captured: Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: request: PUT /compute/v2.1/images/49242934-2e73-4e74-8f0e-4d282a534bd5/metadata/os_distro HTTP/1.1 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 30 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclN309SThJQFSGeRXla8JLtS1kz4wapTJK4tYGo1im8OJwWzgEG9b4lJfIz05kLUjnvDpnoyrdZU8o3J0PvHiLUAGoBgIU4-o3V2AYDPTHxAPiJ8Hj0mSsUw-2E6ZkzozA7QfUVbaos0lKYeZrbjH2JctRtaxOi1LgHxPgaZKnzPbU Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8e9e9a291a94d148861ba9ecfb5cea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}] Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 77d141fd1494424dab77a5fbad37b6e5 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: {"meta": {"os_distro": "alt"}} Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'image_id': '49242934-2e73-4e74-8f0e-4d282a534bd5', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 49242934-2e73-4e74-8f0e-4d282a534bd5 Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 19:51:42.545232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 49242934-2e73-4e74-8f0e-4d282a534bd5 could not be found. Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:42.548710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.556000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4dab1bbd-bee8-4127-bc24-2ca2aaa5daf1 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:42.556905 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4dab1bbd-bee8-4127-bc24-2ca2aaa5daf1 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] 10.222.0.27 "PUT /compute/v2.1/images/49242934-2e73-4e74-8f0e-4d282a534bd5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.096888 Oct 11 19:51:42.557508 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1167/2364] 10.222.0.27 () {60 vars in 1310 bytes} [Tue Oct 11 19:51:42 2022] PUT /compute/v2.1/images/49242934-2e73-4e74-8f0e-4d282a534bd5/metadata/os_distro => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:51:42.568326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f24f6485-6668-4933-91b3-a50297a48c55 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Action: 'create', calling method: .version_select at 0x7f83cc485160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:42.602666 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-f24f6485-6668-4933-91b3-a50297a48c55 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] HTTP exception thrown: Image not found. Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f24f6485-6668-4933-91b3-a50297a48c55 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Request method failure captured: Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/images/d87b368f-4f4d-44fc-9dfc-c35a97bb4b2c/metadata HTTP/1.1 Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 57 Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclN309SThJQFSGeRXla8JLtS1kz4wapTJK4tYGo1im8OJwWzgEG9b4lJfIz05kLUjnvDpnoyrdZU8o3J0PvHiLUAGoBgIU4-o3V2AYDPTHxAPiJ8Hj0mSsUw-2E6ZkzozA7QfUVbaos0lKYeZrbjH2JctRtaxOi1LgHxPgaZKnzPbU Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8e9e9a291a94d148861ba9ecfb5cea6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8e9e9a291a94d148861ba9ecfb5cea6"}]}] Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: c8e9e9a291a94d148861ba9ecfb5cea6 Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-402921879 Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 77d141fd1494424dab77a5fbad37b6e5 Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-402921879-project Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: exception: Image not found. Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'image_id': 'd87b368f-4f4d-44fc-9dfc-c35a97bb4b2c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d87b368f-4f4d-44fc-9dfc-c35a97bb4b2c Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 19:51:42.604965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d87b368f-4f4d-44fc-9dfc-c35a97bb4b2c could not be found. Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f24f6485-6668-4933-91b3-a50297a48c55 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] Returning 404 to user: Image not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:42.608349 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f24f6485-6668-4933-91b3-a50297a48c55 tempest-ImagesMetadataNegativeTestJSON-402921879 tempest-ImagesMetadataNegativeTestJSON-402921879-project] 10.222.0.27 "POST /compute/v2.1/images/d87b368f-4f4d-44fc-9dfc-c35a97bb4b2c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043846 Oct 11 19:51:42.615168 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1198/2365] 10.222.0.27 () {60 vars in 1281 bytes} [Tue Oct 11 19:51:42 2022] POST /compute/v2.1/images/d87b368f-4f4d-44fc-9dfc-c35a97bb4b2c/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:51:44.253895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:44.670956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-258524418", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "69a8f9b2-af02-48e8-b1e2-48f604be91af"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:44.860134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] validate_networks() for [('69a8f9b2-af02-48e8-b1e2-48f604be91af', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:51:45.940440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=16 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:46.039088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=22 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:46.650010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-493097661", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "31dc338c-b193-4306-a570-b067e3b3bc87"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:46.758219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] validate_networks() for [('31dc338c-b193-4306-a570-b067e3b3bc87', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:51:47.405296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:47.448627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:47.596094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:51:47.596524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:51:47.597006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:51:47.597420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:51:47.597832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:51:47.615540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:47.616050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:47.616518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:47.617285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:47.617866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:47.618302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:47.707896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Getting quotas for project d8f24f96dcc14e20b72d9937d66e850e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:47.714198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Getting quotas for user d229b3160d124151bf266f50b96b153c and project d8f24f96dcc14e20b72d9937d66e850e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:47.747413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:51:47.749976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:51:47.918220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-20215bc1-c5c5-40fa-9c19-841f81660f4b tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.670739 Oct 11 19:51:47.919157 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1168/2366] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:51:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3672 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 19:51:47.935308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1e559292-c65a-4a6d-b8dc-8dcfd1aa8723 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:47.936196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1e559292-c65a-4a6d-b8dc-8dcfd1aa8723 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:48.121665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e559292-c65a-4a6d-b8dc-8dcfd1aa8723 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:48.132910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e559292-c65a-4a6d-b8dc-8dcfd1aa8723 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:48.137473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e559292-c65a-4a6d-b8dc-8dcfd1aa8723 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:48.144249 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1e559292-c65a-4a6d-b8dc-8dcfd1aa8723 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1258 microversion: 2.21 time: 0.216939 Oct 11 19:51:48.145066 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1169/2367] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:47 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1258 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:51:48.679751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:51:48.681022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:51:48.681957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:51:48.682594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:51:48.683218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:51:48.694110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:48.694975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:48.696006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:48.697220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:48.698023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:48.698926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:48.743432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Getting quotas for project a3d6079311d94932a20980893d2383e8. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:51:48.756055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Getting quotas for user faf3736eab7b46dfa7d5fe0d4161cb62 and project a3d6079311d94932a20980893d2383e8. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:51:48.774548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:51:48.779999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:51:48.873036 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1f6987b8-d2c9-4951-b11c-bb8756d7120a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.934142 Oct 11 19:51:48.874637 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1199/2368] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:51:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 19:51:48.886939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aaf5c217-ac4e-41ec-afb0-b4c681920ddb tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:48.888300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aaf5c217-ac4e-41ec-afb0-b4c681920ddb tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:49.155830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aaf5c217-ac4e-41ec-afb0-b4c681920ddb tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:49.163949 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aaf5c217-ac4e-41ec-afb0-b4c681920ddb tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1215 microversion: 2.1 time: 0.282032 Oct 11 19:51:49.166969 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1170/2369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:48 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:49.175020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:49.176034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:49.189615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:49.198258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:49.204496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:49.205886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:49.206369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:49.208633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:49.450060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:49.467221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:49.468710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:49.469845 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8bdbcd59-e30e-49db-a598-d22cb471c57e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1254 microversion: 2.21 time: 0.300316 Oct 11 19:51:49.479099 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1200/2370] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:49 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1254 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:50.197778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dfc0e6ba-b932-4b5c-ac99-abd1024c1a02 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:50.199737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dfc0e6ba-b932-4b5c-ac99-abd1024c1a02 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:50.218306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfc0e6ba-b932-4b5c-ac99-abd1024c1a02 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:50.235142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfc0e6ba-b932-4b5c-ac99-abd1024c1a02 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:50.235810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfc0e6ba-b932-4b5c-ac99-abd1024c1a02 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:50.236767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfc0e6ba-b932-4b5c-ac99-abd1024c1a02 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:50.237248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfc0e6ba-b932-4b5c-ac99-abd1024c1a02 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:50.241414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfc0e6ba-b932-4b5c-ac99-abd1024c1a02 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:50.455493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dfc0e6ba-b932-4b5c-ac99-abd1024c1a02 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:50.471043 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dfc0e6ba-b932-4b5c-ac99-abd1024c1a02 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1267 microversion: 2.1 time: 0.281265 Oct 11 19:51:50.474969 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1171/2371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:50 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:50.506314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:50.506957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:50.523537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:50.527532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:50.528074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:50.530348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:50.532158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:50.534811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:50.707798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:50.721237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:50.724735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:50.729129 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-83471bf3-dd9d-4f75-ad25-df3e36419e97 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1328 microversion: 2.21 time: 0.226263 Oct 11 19:51:50.731975 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1201/2372] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:50 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1328 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:51.502892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-984b950b-515f-465f-b2cf-90c6da1b03e5 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:51.503527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-984b950b-515f-465f-b2cf-90c6da1b03e5 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:51.520441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-984b950b-515f-465f-b2cf-90c6da1b03e5 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:51.525195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-984b950b-515f-465f-b2cf-90c6da1b03e5 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:51.526060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-984b950b-515f-465f-b2cf-90c6da1b03e5 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:51.527127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-984b950b-515f-465f-b2cf-90c6da1b03e5 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:51.527734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-984b950b-515f-465f-b2cf-90c6da1b03e5 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:51.528307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-984b950b-515f-465f-b2cf-90c6da1b03e5 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:51.751900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-984b950b-515f-465f-b2cf-90c6da1b03e5 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:51.754928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:51.756188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:51.764294 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-984b950b-515f-465f-b2cf-90c6da1b03e5 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1273 microversion: 2.1 time: 0.262984 Oct 11 19:51:51.766056 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1172/2373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:51 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:51.788811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:51.789436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:51.799520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:51.810224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:51.811020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:51.811676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:52.406129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:52.418062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:52.419564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:52.420695 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-59596d65-2e49-4a33-88bc-10333379025d tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1358 microversion: 2.21 time: 0.669921 Oct 11 19:51:52.429123 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1202/2374] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:51 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1358 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:51:52.792284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5b92bb7c-8773-4dc2-9a51-64c4ec266478 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:52.794659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5b92bb7c-8773-4dc2-9a51-64c4ec266478 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:52.817476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b92bb7c-8773-4dc2-9a51-64c4ec266478 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:52.819604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b92bb7c-8773-4dc2-9a51-64c4ec266478 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:52.820376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b92bb7c-8773-4dc2-9a51-64c4ec266478 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:52.822233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b92bb7c-8773-4dc2-9a51-64c4ec266478 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:52.824545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b92bb7c-8773-4dc2-9a51-64c4ec266478 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:52.826242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b92bb7c-8773-4dc2-9a51-64c4ec266478 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:52.984900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5b92bb7c-8773-4dc2-9a51-64c4ec266478 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:53.002510 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5b92bb7c-8773-4dc2-9a51-64c4ec266478 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1273 microversion: 2.1 time: 0.215090 Oct 11 19:51:53.014574 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1173/2375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:52 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:53.452482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:53.454300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:53.473372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:53.475487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:53.476150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:53.479979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:53.480676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:53.481294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:54.027283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9364ab7d-a18d-46e4-9317-6804015e5036 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:54.029134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9364ab7d-a18d-46e4-9317-6804015e5036 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:54.044637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9364ab7d-a18d-46e4-9317-6804015e5036 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:54.047316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9364ab7d-a18d-46e4-9317-6804015e5036 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:54.047927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9364ab7d-a18d-46e4-9317-6804015e5036 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:54.049058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9364ab7d-a18d-46e4-9317-6804015e5036 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:54.053434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9364ab7d-a18d-46e4-9317-6804015e5036 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:54.054050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9364ab7d-a18d-46e4-9317-6804015e5036 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:54.117217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:54.131585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:54.140491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:54.141665 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0bc81f05-4b74-4b9a-bf45-c5d2be5ccc58 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1358 microversion: 2.21 time: 0.693339 Oct 11 19:51:54.142230 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1203/2376] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:53 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1358 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:51:54.483532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9364ab7d-a18d-46e4-9317-6804015e5036 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:54.513420 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9364ab7d-a18d-46e4-9317-6804015e5036 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1273 microversion: 2.1 time: 0.490606 Oct 11 19:51:54.528725 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1174/2377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:54 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1273 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:51:55.171828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:55.172456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:55.186283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:55.187220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:55.187825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:55.191490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:55.193195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:55.197255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:55.547469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f4e10e1-235a-4fb5-b8ef-11a587d9e6fc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:55.549051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6f4e10e1-235a-4fb5-b8ef-11a587d9e6fc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:55.589393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f4e10e1-235a-4fb5-b8ef-11a587d9e6fc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:55.593116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f4e10e1-235a-4fb5-b8ef-11a587d9e6fc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:55.593690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f4e10e1-235a-4fb5-b8ef-11a587d9e6fc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:55.596488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f4e10e1-235a-4fb5-b8ef-11a587d9e6fc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:55.597199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f4e10e1-235a-4fb5-b8ef-11a587d9e6fc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:55.598599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f4e10e1-235a-4fb5-b8ef-11a587d9e6fc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:56.085128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:56.111956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:56.114422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:56.116789 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bc6cca5a-c495-4aee-9491-2c12b73c72d7 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1358 microversion: 2.21 time: 0.948318 Oct 11 19:51:56.138934 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1204/2378] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:55 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1358 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:56.213508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3966d07c-13a2-4150-a460-685b4d207510 req-3e417c07-3a6e-466d-a139-5373dede7697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea069e25-cf9d-4bc9-a6f3-009a424ab562", "tag": "ea5040c9-7296-48c3-b913-6e43b5de7ef9"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:56.238929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3966d07c-13a2-4150-a460-685b4d207510 req-3e417c07-3a6e-466d-a139-5373dede7697 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:56.239972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3966d07c-13a2-4150-a460-685b4d207510 req-3e417c07-3a6e-466d-a139-5373dede7697 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:56.240635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3966d07c-13a2-4150-a460-685b4d207510 req-3e417c07-3a6e-466d-a139-5373dede7697 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:56.271419 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3966d07c-13a2-4150-a460-685b4d207510 req-3e417c07-3a6e-466d-a139-5373dede7697 service nova] Creating event network-changed:ea5040c9-7296-48c3-b913-6e43b5de7ef9 for instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 on n-h1-860864-3 Oct 11 19:51:56.284684 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3966d07c-13a2-4150-a460-685b4d207510 req-3e417c07-3a6e-466d-a139-5373dede7697 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074842 Oct 11 19:51:56.286500 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1205/2379] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:56.366390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6f4e10e1-235a-4fb5-b8ef-11a587d9e6fc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:56.393821 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6f4e10e1-235a-4fb5-b8ef-11a587d9e6fc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1315 microversion: 2.1 time: 0.857620 Oct 11 19:51:56.394450 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1175/2380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:55 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:57.146405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:57.147148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:57.158467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:57.160466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:57.161355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:57.162278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:57.162908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:57.163560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:57.422779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9502f801-9c9a-40b5-b1f8-eb442f91f353 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:57.423425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9502f801-9c9a-40b5-b1f8-eb442f91f353 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:57.437448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9502f801-9c9a-40b5-b1f8-eb442f91f353 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:57.438048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9502f801-9c9a-40b5-b1f8-eb442f91f353 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:57.438571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9502f801-9c9a-40b5-b1f8-eb442f91f353 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:57.439536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9502f801-9c9a-40b5-b1f8-eb442f91f353 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:57.440213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9502f801-9c9a-40b5-b1f8-eb442f91f353 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:57.440850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9502f801-9c9a-40b5-b1f8-eb442f91f353 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:57.680101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:58.367301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:58.377739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:58.380259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9502f801-9c9a-40b5-b1f8-eb442f91f353 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:58.381496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:58.383452 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0298e0aa-f13c-465f-b3e5-e4528f6ef0a2 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1358 microversion: 2.21 time: 1.243648 Oct 11 19:51:58.384216 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1206/2381] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:57 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1358 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:58.395402 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9502f801-9c9a-40b5-b1f8-eb442f91f353 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1315 microversion: 2.1 time: 0.975081 Oct 11 19:51:58.418330 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1176/2382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:57 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:51:58.471060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-6849a47a-0545-496f-a850-39d4d11baac5 req-cd5621ed-8247-435a-8724-9e47445138da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb8d83ef-de75-4359-bb6d-87d0268d2754", "tag": "9f3bc577-ea3e-4bcc-ab80-9c335d111e08"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:58.509553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6849a47a-0545-496f-a850-39d4d11baac5 req-cd5621ed-8247-435a-8724-9e47445138da service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:58.511983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6849a47a-0545-496f-a850-39d4d11baac5 req-cd5621ed-8247-435a-8724-9e47445138da service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:58.513097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6849a47a-0545-496f-a850-39d4d11baac5 req-cd5621ed-8247-435a-8724-9e47445138da service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:58.528733 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6849a47a-0545-496f-a850-39d4d11baac5 req-cd5621ed-8247-435a-8724-9e47445138da service nova] Creating event network-changed:9f3bc577-ea3e-4bcc-ab80-9c335d111e08 for instance eb8d83ef-de75-4359-bb6d-87d0268d2754 on n-h1-860864-3 Oct 11 19:51:58.534652 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-6849a47a-0545-496f-a850-39d4d11baac5 req-cd5621ed-8247-435a-8724-9e47445138da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093319 Oct 11 19:51:58.536022 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1177/2383] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:51:58.723679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4f3c4921-a9f8-40c3-9230-50940491eee2"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:51:58.726620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:58.736237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:58.738399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:58.740078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:58.740903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:58.742250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:58.748962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:58.749610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:58.782325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:58.960757 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] HTTP exception thrown: Volume 4f3c4921-a9f8-40c3-9230-50940491eee2 could not be found. Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Request method failure captured: Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments/46cc3b49-7153-4c56-989e-10f1c60c8383 HTTP/1.1 Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 74 Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcj7RO6kedLcSmnmfaAzpdWCihZsia95zjFKfKVfOb9h5qhPnmcnWhKJorS86YxHYH1xCXGShqL5-VteU6EpyGHY0D3Ch9dMt6v4IjZzYu8xLV1tn8b7p7ng3TeOIj3r3Z4K52dSzVpNkep9DsBuR8FoqIM1wsJzsuEIvGW7XxmUp8U Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1b7e2bc136ed4783b38ee86d18a518ab Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesAdminNegativeTest-9733670 Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1b7e2bc136ed4783b38ee86d18a518ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1b7e2bc136ed4783b38ee86d18a518ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b7e2bc136ed4783b38ee86d18a518ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b7e2bc136ed4783b38ee86d18a518ab"}]}] Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesAdminNegativeTest-9733670 Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1b7e2bc136ed4783b38ee86d18a518ab Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-9733670 Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesAdminNegativeTest-9733670-project-admin Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e919851499dc49c398384a02739dc555 Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesAdminNegativeTest-9733670-project-admin Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: {"volumeAttachment": {"volumeId": "4f3c4921-a9f8-40c3-9230-50940491eee2"}} Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: exception: Volume 4f3c4921-a9f8-40c3-9230-50940491eee2 could not be found. Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': '5a52feaa-0925-49de-bb88-68790063b724', 'id': '46cc3b49-7153-4c56-989e-10f1c60c8383', 'body': {'volumeAttachment': {'volumeId': '4f3c4921-a9f8-40c3-9230-50940491eee2'}}} Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f3c4921-a9f8-40c3-9230-50940491eee2 could not be found. (HTTP 404) (Request-ID: req-32883bae-855f-464f-938c-5c52cb148b24) Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 19:51:58.993849 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f3c4921-a9f8-40c3-9230-50940491eee2 could not be found. Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 4f3c4921-a9f8-40c3-9230-50940491eee2 could not be found. Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f3c4921-a9f8-40c3-9230-50940491eee2 could not be found. Oct 11 19:51:58.998175 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:51:59.003580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Returning 400 to user: Volume 4f3c4921-a9f8-40c3-9230-50940491eee2 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:51:59.004652 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-310d31ce-5a23-4b01-a075-88b19a6218f7 tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments/46cc3b49-7153-4c56-989e-10f1c60c8383" status: 400 len: 107 microversion: 2.1 time: 0.601203 Oct 11 19:51:59.005402 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1207/2384] 10.222.0.27 () {60 vars in 1433 bytes} [Tue Oct 11 19:51:58 2022] PUT /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments/46cc3b49-7153-4c56-989e-10f1c60c8383 => generated 107 bytes in 608 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:51:59.120131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1487359d-ebfb-4365-a55f-f3035e69a0fd tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:59.120717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1487359d-ebfb-4365-a55f-f3035e69a0fd tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:59.138984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1487359d-ebfb-4365-a55f-f3035e69a0fd tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:59.139656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1487359d-ebfb-4365-a55f-f3035e69a0fd tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:59.140146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1487359d-ebfb-4365-a55f-f3035e69a0fd tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:59.140920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1487359d-ebfb-4365-a55f-f3035e69a0fd tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:59.141373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1487359d-ebfb-4365-a55f-f3035e69a0fd tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:59.141967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1487359d-ebfb-4365-a55f-f3035e69a0fd tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:59.201277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:51:59.353122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-1487359d-ebfb-4365-a55f-f3035e69a0fd tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lazy-loading 'services' on Instance uuid 5a52feaa-0925-49de-bb88-68790063b724 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:51:59.415947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:59.417280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:59.429183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:59.434976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:59.435821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:59.436733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:59.438660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:59.443992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:59.501015 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1487359d-ebfb-4365-a55f-f3035e69a0fd tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments/46cc3b49-7153-4c56-989e-10f1c60c8383" status: 202 len: 0 microversion: 2.1 time: 0.384874 Oct 11 19:51:59.504743 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1178/2385] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 19:51:59 2022] DELETE /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments/46cc3b49-7153-4c56-989e-10f1c60c8383 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:51:59.513378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e67243c6-c628-4567-8ce7-657f63ec0f75 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:59.515284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e67243c6-c628-4567-8ce7-657f63ec0f75 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:59.530543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e67243c6-c628-4567-8ce7-657f63ec0f75 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:59.531460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e67243c6-c628-4567-8ce7-657f63ec0f75 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:59.532150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e67243c6-c628-4567-8ce7-657f63ec0f75 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:59.533103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e67243c6-c628-4567-8ce7-657f63ec0f75 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:59.533789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e67243c6-c628-4567-8ce7-657f63ec0f75 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:59.534438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e67243c6-c628-4567-8ce7-657f63ec0f75 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:59.903243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:59.914271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e67243c6-c628-4567-8ce7-657f63ec0f75 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:59.918640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:59.920354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:51:59.921537 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-90c7ccec-06a6-4533-b738-44df903c2287 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1358 microversion: 2.21 time: 0.510282 Oct 11 19:51:59.922080 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1208/2386] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:51:59 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1358 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:51:59.925207 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e67243c6-c628-4567-8ce7-657f63ec0f75 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1315 microversion: 2.1 time: 0.418657 Oct 11 19:51:59.939448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ef7339d-5a59-4b68-8312-65535d65bdb6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:51:59.947023 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1179/2387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:51:59 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:51:59.948256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ef7339d-5a59-4b68-8312-65535d65bdb6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:51:59.963022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ef7339d-5a59-4b68-8312-65535d65bdb6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:59.963523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ef7339d-5a59-4b68-8312-65535d65bdb6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:59.964841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ef7339d-5a59-4b68-8312-65535d65bdb6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:51:59.971370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ef7339d-5a59-4b68-8312-65535d65bdb6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:51:59.972067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ef7339d-5a59-4b68-8312-65535d65bdb6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:51:59.972660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ef7339d-5a59-4b68-8312-65535d65bdb6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:00.047260 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ef7339d-5a59-4b68-8312-65535d65bdb6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120568 Oct 11 19:52:00.058433 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1209/2388] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:51:59 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:00.955549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:00.957764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:00.961154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3b09d272-108d-4a60-bcca-dd7071fb5b38 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:00.962415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3b09d272-108d-4a60-bcca-dd7071fb5b38 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:00.973566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:00.974892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b09d272-108d-4a60-bcca-dd7071fb5b38 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:00.978998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b09d272-108d-4a60-bcca-dd7071fb5b38 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:00.979507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b09d272-108d-4a60-bcca-dd7071fb5b38 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:00.983143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:00.983593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:00.984895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:00.985598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:00.986029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:00.988883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b09d272-108d-4a60-bcca-dd7071fb5b38 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:00.989398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b09d272-108d-4a60-bcca-dd7071fb5b38 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:00.989844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b09d272-108d-4a60-bcca-dd7071fb5b38 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:02.949322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:02.954512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3b09d272-108d-4a60-bcca-dd7071fb5b38 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:02.973731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:02.975386 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3b09d272-108d-4a60-bcca-dd7071fb5b38 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1315 microversion: 2.1 time: 2.018838 Oct 11 19:52:02.977825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:02.979091 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1210/2389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:00 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1315 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:02.987321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0fa55344-daa3-49ba-8971-abf33b86e676 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:02.993650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0fa55344-daa3-49ba-8971-abf33b86e676 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:02.995747 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-62e8d91b-c269-4056-baa1-75c56065d449 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1358 microversion: 2.21 time: 2.047107 Oct 11 19:52:03.005211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:03.010941 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1180/2390] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:00 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1358 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:03.026278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fa55344-daa3-49ba-8971-abf33b86e676 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:03.027186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fa55344-daa3-49ba-8971-abf33b86e676 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:03.029239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fa55344-daa3-49ba-8971-abf33b86e676 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:03.030234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fa55344-daa3-49ba-8971-abf33b86e676 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:03.030952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fa55344-daa3-49ba-8971-abf33b86e676 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:03.032764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fa55344-daa3-49ba-8971-abf33b86e676 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:03.144460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2041686255", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "1e236917-8566-45a0-b790-793f3a02168f"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:03.184672 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0fa55344-daa3-49ba-8971-abf33b86e676 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203708 Oct 11 19:52:03.193866 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1211/2391] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:52:02 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:03.213164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fcc8515f-ce45-4936-817e-5e24df89b765 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:03.255476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcc8515f-ce45-4936-817e-5e24df89b765 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:03.255982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcc8515f-ce45-4936-817e-5e24df89b765 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:03.258223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcc8515f-ce45-4936-817e-5e24df89b765 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:03.303686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] validate_networks() for [('1e236917-8566-45a0-b790-793f3a02168f', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:52:03.355186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fcc8515f-ce45-4936-817e-5e24df89b765 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Going to try to stop instance {{(pid=126956) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 19:52:03.468169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fcc8515f-ce45-4936-817e-5e24df89b765 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/action" status: 202 len: 0 microversion: 2.1 time: 0.276292 Oct 11 19:52:03.469108 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1212/2392] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:52:03 2022] POST /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:52:03.489382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-57f5e6d3-ba52-4c5b-b8af-35f9bf7928f1 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:03.503523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-57f5e6d3-ba52-4c5b-b8af-35f9bf7928f1 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:03.521928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57f5e6d3-ba52-4c5b-b8af-35f9bf7928f1 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:03.522660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57f5e6d3-ba52-4c5b-b8af-35f9bf7928f1 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:03.525583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57f5e6d3-ba52-4c5b-b8af-35f9bf7928f1 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:03.528779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57f5e6d3-ba52-4c5b-b8af-35f9bf7928f1 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:03.529412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57f5e6d3-ba52-4c5b-b8af-35f9bf7928f1 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:03.530664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57f5e6d3-ba52-4c5b-b8af-35f9bf7928f1 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:04.609364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-57f5e6d3-ba52-4c5b-b8af-35f9bf7928f1 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:04.618574 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-57f5e6d3-ba52-4c5b-b8af-35f9bf7928f1 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1723 microversion: 2.1 time: 1.138683 Oct 11 19:52:04.634882 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1213/2393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:03 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1723 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:04.634882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1deeb25c-2a4d-488a-b1bd-1bf5712b6d9e tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:04.634882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1deeb25c-2a4d-488a-b1bd-1bf5712b6d9e tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:04.646790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1deeb25c-2a4d-488a-b1bd-1bf5712b6d9e tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:04.647302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1deeb25c-2a4d-488a-b1bd-1bf5712b6d9e tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:04.647746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1deeb25c-2a4d-488a-b1bd-1bf5712b6d9e tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:04.648456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1deeb25c-2a4d-488a-b1bd-1bf5712b6d9e tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:04.649498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1deeb25c-2a4d-488a-b1bd-1bf5712b6d9e tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:04.649498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1deeb25c-2a4d-488a-b1bd-1bf5712b6d9e tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:05.043396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1deeb25c-2a4d-488a-b1bd-1bf5712b6d9e tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:05.057110 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1deeb25c-2a4d-488a-b1bd-1bf5712b6d9e tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1315 microversion: 2.1 time: 0.430221 Oct 11 19:52:05.057693 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1214/2394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:04 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:05.062367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:05.070129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:05.089520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:05.090258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:05.090878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:05.094116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:05.094814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:05.095727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:05.976378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:05.977408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:05.978052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:05.978684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:05.979468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:05.998180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:05.998931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:06.001471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:06.002436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:06.003086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:06.004262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:06.055572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:06.064713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Getting quotas for project bf853b49896343b7852bb83640b7ef73. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:52:06.067814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:06.073123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:06.077882 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a593f890-3178-4a9b-9259-db0e2faca8ff tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1358 microversion: 2.21 time: 1.018977 Oct 11 19:52:06.078749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Getting quotas for user 6fc438ee89be4ecca0895c161377c9c3 and project bf853b49896343b7852bb83640b7ef73. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:52:06.081680 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1215/2395] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:05 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1358 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:06.087623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9f75aae4-c074-4b77-bca0-9a4d4270b360 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:06.090487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9f75aae4-c074-4b77-bca0-9a4d4270b360 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:06.097183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f75aae4-c074-4b77-bca0-9a4d4270b360 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:06.097865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f75aae4-c074-4b77-bca0-9a4d4270b360 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:06.098682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f75aae4-c074-4b77-bca0-9a4d4270b360 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:06.099527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f75aae4-c074-4b77-bca0-9a4d4270b360 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:06.100125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f75aae4-c074-4b77-bca0-9a4d4270b360 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:06.100769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f75aae4-c074-4b77-bca0-9a4d4270b360 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:06.147362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:06.165512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Going to run 2 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:52:06.175108 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9f75aae4-c074-4b77-bca0-9a4d4270b360 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091602 Oct 11 19:52:06.175338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 0a308e18-5663-4908-bb68-88beb2a586a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:06.175784 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1216/2396] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:52:06 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:06.187582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0021b038-c9d4-45de-bd38-67d96ce0e53b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:06.188203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0021b038-c9d4-45de-bd38-67d96ce0e53b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:06.203621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0021b038-c9d4-45de-bd38-67d96ce0e53b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:06.204123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0021b038-c9d4-45de-bd38-67d96ce0e53b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:06.204556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0021b038-c9d4-45de-bd38-67d96ce0e53b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:06.213628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0021b038-c9d4-45de-bd38-67d96ce0e53b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:06.214131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0021b038-c9d4-45de-bd38-67d96ce0e53b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:06.214590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0021b038-c9d4-45de-bd38-67d96ce0e53b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:06.349030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 82d89574-9fa1-4698-a809-cdcbffb59ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=0a308e18-5663-4908-bb68-88beb2a586a8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:06.554172 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bcfd0eb5-fd40-4820-883e-ba016bc5a870 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.540549 Oct 11 19:52:06.555708 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1181/2397] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:52:06.560534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-23a6d0a3-fad1-4032-9159-7e22100ad1be tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:06.574128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-23a6d0a3-fad1-4032-9159-7e22100ad1be tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:06.604761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a6d0a3-fad1-4032-9159-7e22100ad1be tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:06.611114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a6d0a3-fad1-4032-9159-7e22100ad1be tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:06.613347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a6d0a3-fad1-4032-9159-7e22100ad1be tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:06.615728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a6d0a3-fad1-4032-9159-7e22100ad1be tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:06.624704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a6d0a3-fad1-4032-9159-7e22100ad1be tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:06.627273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a6d0a3-fad1-4032-9159-7e22100ad1be tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:07.230651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0021b038-c9d4-45de-bd38-67d96ce0e53b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:07.251040 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0021b038-c9d4-45de-bd38-67d96ce0e53b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1723 microversion: 2.1 time: 1.073951 Oct 11 19:52:07.264038 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1217/2398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:06 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1723 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:07.282255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-14461743-e304-4c92-ac49-90bf376c8db2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:07.301373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-14461743-e304-4c92-ac49-90bf376c8db2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:07.315860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-14461743-e304-4c92-ac49-90bf376c8db2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Searching by: {'deleted': False, 'project_id': 'bf853b49896343b7852bb83640b7ef73'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:07.356244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14461743-e304-4c92-ac49-90bf376c8db2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:07.357114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14461743-e304-4c92-ac49-90bf376c8db2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:07.358592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14461743-e304-4c92-ac49-90bf376c8db2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:07.359719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14461743-e304-4c92-ac49-90bf376c8db2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:07.360585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14461743-e304-4c92-ac49-90bf376c8db2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:07.361238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14461743-e304-4c92-ac49-90bf376c8db2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:07.419606 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-14461743-e304-4c92-ac49-90bf376c8db2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.137930 Oct 11 19:52:07.422702 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1218/2399] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 19:52:07 2022] GET /compute/v2.1/servers => generated 677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:07.436114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:07.436819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:07.457397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:07.458154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:07.459535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:07.461114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:07.464672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:07.465185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:07.750776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-23a6d0a3-fad1-4032-9159-7e22100ad1be tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:07.758558 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-23a6d0a3-fad1-4032-9159-7e22100ad1be tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1315 microversion: 2.1 time: 1.201557 Oct 11 19:52:07.759133 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1182/2400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:06 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1315 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:07.779983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56cf6899-22ef-4211-8edf-9f047e1b8699 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:07.786119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56cf6899-22ef-4211-8edf-9f047e1b8699 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:07.802493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=9 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:07.819322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56cf6899-22ef-4211-8edf-9f047e1b8699 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:07.820100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56cf6899-22ef-4211-8edf-9f047e1b8699 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:07.822087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56cf6899-22ef-4211-8edf-9f047e1b8699 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:07.823000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56cf6899-22ef-4211-8edf-9f047e1b8699 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:07.829182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56cf6899-22ef-4211-8edf-9f047e1b8699 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:07.829835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56cf6899-22ef-4211-8edf-9f047e1b8699 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:07.897179 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56cf6899-22ef-4211-8edf-9f047e1b8699 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129283 Oct 11 19:52:07.898433 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1183/2401] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:52:07 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:07.905130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-542eb659-b2fc-43c3-9580-ca4648866399 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:07.906233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-542eb659-b2fc-43c3-9580-ca4648866399 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 82d89574-9fa1-4698-a809-cdcbffb59ed6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:08.056973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-542eb659-b2fc-43c3-9580-ca4648866399 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:08.081130 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-542eb659-b2fc-43c3-9580-ca4648866399 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6" status: 200 len: 1220 microversion: 2.1 time: 0.180071 Oct 11 19:52:08.083765 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1184/2402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:07 2022] GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6 => generated 1220 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:08.105177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-cf663e12-03b1-4cc8-952d-9e549b665f05 req-00402c9f-3c47-4aba-b901-6f953b5c91d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea069e25-cf9d-4bc9-a6f3-009a424ab562", "name": "network-vif-plugged", "status": "completed", "tag": "ea5040c9-7296-48c3-b913-6e43b5de7ef9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:08.124889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cf663e12-03b1-4cc8-952d-9e549b665f05 req-00402c9f-3c47-4aba-b901-6f953b5c91d1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:08.125373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cf663e12-03b1-4cc8-952d-9e549b665f05 req-00402c9f-3c47-4aba-b901-6f953b5c91d1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:08.129528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cf663e12-03b1-4cc8-952d-9e549b665f05 req-00402c9f-3c47-4aba-b901-6f953b5c91d1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:08.160649 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-cf663e12-03b1-4cc8-952d-9e549b665f05 req-00402c9f-3c47-4aba-b901-6f953b5c91d1 service nova] Creating event network-vif-plugged:ea5040c9-7296-48c3-b913-6e43b5de7ef9 for instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 on n-h1-860864-3 Oct 11 19:52:08.197879 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-cf663e12-03b1-4cc8-952d-9e549b665f05 req-00402c9f-3c47-4aba-b901-6f953b5c91d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112621 Oct 11 19:52:08.200099 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1185/2403] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:08.266394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:08.281691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-69d9bf36-9c3d-43bc-8215-b0f603c1693b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:08.283592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-69d9bf36-9c3d-43bc-8215-b0f603c1693b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:08.283890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:08.285620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:08.292447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d97365a7-ce16-461c-a4c2-c17efd533134 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1358 microversion: 2.21 time: 0.866069 Oct 11 19:52:08.307124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d9bf36-9c3d-43bc-8215-b0f603c1693b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:08.313209 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1219/2404] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:07 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1358 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:08.321909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d9bf36-9c3d-43bc-8215-b0f603c1693b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:08.323228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d9bf36-9c3d-43bc-8215-b0f603c1693b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:08.328218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d9bf36-9c3d-43bc-8215-b0f603c1693b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:08.328989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d9bf36-9c3d-43bc-8215-b0f603c1693b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:08.329697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d9bf36-9c3d-43bc-8215-b0f603c1693b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:08.795191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8309b427-d1aa-4eb1-bb92-b54b32fd7a8d tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:08.796109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8309b427-d1aa-4eb1-bb92-b54b32fd7a8d tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:08.820318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8309b427-d1aa-4eb1-bb92-b54b32fd7a8d tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:08.822695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8309b427-d1aa-4eb1-bb92-b54b32fd7a8d tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:08.823439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8309b427-d1aa-4eb1-bb92-b54b32fd7a8d tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:08.824418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8309b427-d1aa-4eb1-bb92-b54b32fd7a8d tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:08.825122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8309b427-d1aa-4eb1-bb92-b54b32fd7a8d tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:08.826164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8309b427-d1aa-4eb1-bb92-b54b32fd7a8d tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:09.210036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-69d9bf36-9c3d-43bc-8215-b0f603c1693b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:09.225707 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-69d9bf36-9c3d-43bc-8215-b0f603c1693b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1723 microversion: 2.1 time: 0.948992 Oct 11 19:52:09.226303 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1186/2405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:08 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1723 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:09.234244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fd474053-26ab-4cc3-979c-ed9ba2fbffde tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:09.236683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fd474053-26ab-4cc3-979c-ed9ba2fbffde tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:09.245154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd474053-26ab-4cc3-979c-ed9ba2fbffde tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:09.245970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd474053-26ab-4cc3-979c-ed9ba2fbffde tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:09.246663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd474053-26ab-4cc3-979c-ed9ba2fbffde tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:09.247737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd474053-26ab-4cc3-979c-ed9ba2fbffde tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:09.248984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd474053-26ab-4cc3-979c-ed9ba2fbffde tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:09.249653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd474053-26ab-4cc3-979c-ed9ba2fbffde tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:09.308900 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fd474053-26ab-4cc3-979c-ed9ba2fbffde tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080596 Oct 11 19:52:09.309497 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1187/2406] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:52:09 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:52:09.314914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b93d822-55fe-42d6-ba2a-dace998bfdee tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:09.315727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7b93d822-55fe-42d6-ba2a-dace998bfdee tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 82d89574-9fa1-4698-a809-cdcbffb59ed6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:09.334605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b93d822-55fe-42d6-ba2a-dace998bfdee tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:09.356510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b93d822-55fe-42d6-ba2a-dace998bfdee tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:09.357429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b93d822-55fe-42d6-ba2a-dace998bfdee tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:09.363578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b93d822-55fe-42d6-ba2a-dace998bfdee tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:09.364334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b93d822-55fe-42d6-ba2a-dace998bfdee tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:09.365127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b93d822-55fe-42d6-ba2a-dace998bfdee tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:09.557450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8309b427-d1aa-4eb1-bb92-b54b32fd7a8d tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:09.579583 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8309b427-d1aa-4eb1-bb92-b54b32fd7a8d tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1315 microversion: 2.1 time: 0.780500 Oct 11 19:52:09.580251 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1220/2407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:08 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:09.595680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:09.605420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:09.624099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:09.625097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:09.625848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:09.630054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:09.632005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:09.633562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:09.640291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7b93d822-55fe-42d6-ba2a-dace998bfdee tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:09.655642 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7b93d822-55fe-42d6-ba2a-dace998bfdee tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6" status: 200 len: 1272 microversion: 2.1 time: 0.344817 Oct 11 19:52:09.663363 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1188/2408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:09 2022] GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6 => generated 1272 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:09.691009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1160572257", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "dee5511c-417e-4642-a694-e2dd7950486d"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:09.848429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] validate_networks() for [('dee5511c-417e-4642-a694-e2dd7950486d', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:52:10.111541 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 19:52:10.111931 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 19:52:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 (ip 10.222.0.27) !!! Oct 11 19:52:10.430313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:10.441152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:10.451829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:10.454451 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-03c46df3-108c-4518-8433-658d3df5670f tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1551 microversion: 2.21 time: 0.871566 Oct 11 19:52:10.455890 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1221/2409] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:09 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1551 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:10.717487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-889816798", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": "none"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:10.822609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:10.823139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:10.823724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:10.824233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:10.825613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:10.845570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:10.856781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:10.857379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:10.858295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:10.858888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:10.859410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:10.893001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Getting quotas for project 8bba0e59b5314bb29bebe8c96e748ef9. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:52:10.908295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Getting quotas for user 0ca619bcb2714746a1c74cff0ad64f8b and project 8bba0e59b5314bb29bebe8c96e748ef9. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:52:10.940000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:52:10.942463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:11.036441 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-18befe55-eb3b-420d-a4c8-0d4d77100946 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.579050 Oct 11 19:52:11.037461 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1222/2410] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 19:52:11.048586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-01aeb039-5c28-4fd6-be05-19e6d8771531 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:11.049652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-01aeb039-5c28-4fd6-be05-19e6d8771531 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:11.074872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeb039-5c28-4fd6-be05-19e6d8771531 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:11.075628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeb039-5c28-4fd6-be05-19e6d8771531 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:11.076267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeb039-5c28-4fd6-be05-19e6d8771531 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:11.077996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeb039-5c28-4fd6-be05-19e6d8771531 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:11.078794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeb039-5c28-4fd6-be05-19e6d8771531 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:11.080879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeb039-5c28-4fd6-be05-19e6d8771531 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:11.968725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-01aeb039-5c28-4fd6-be05-19e6d8771531 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:11.995429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:11.996517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:11.997146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:11.997751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:11.999643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:12.033186 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-01aeb039-5c28-4fd6-be05-19e6d8771531 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1723 microversion: 2.1 time: 0.993560 Oct 11 19:52:12.036455 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1223/2411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:11 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1723 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:12.037716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.040644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.041256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:12.042780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.046306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.047744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:12.050126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6335aad3-7e6b-486e-96e6-8eeeb178196a req-12105631-18e0-42b0-8b41-18ce2d6c1ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb8d83ef-de75-4359-bb6d-87d0268d2754", "name": "network-vif-plugged", "status": "completed", "tag": "9f3bc577-ea3e-4bcc-ab80-9c335d111e08"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:12.081526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6335aad3-7e6b-486e-96e6-8eeeb178196a req-12105631-18e0-42b0-8b41-18ce2d6c1ded service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.082765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6335aad3-7e6b-486e-96e6-8eeeb178196a req-12105631-18e0-42b0-8b41-18ce2d6c1ded service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.098098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Getting quotas for project 104b4ee892e441b79f520b0591ec0e33. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:52:12.102090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6335aad3-7e6b-486e-96e6-8eeeb178196a req-12105631-18e0-42b0-8b41-18ce2d6c1ded service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:12.115235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Getting quotas for user f34a23ce45c8419693d5fb67010548ad and project 104b4ee892e441b79f520b0591ec0e33. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:52:12.133374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:52:12.136556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:12.159551 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6335aad3-7e6b-486e-96e6-8eeeb178196a req-12105631-18e0-42b0-8b41-18ce2d6c1ded service nova] Creating event network-vif-plugged:9f3bc577-ea3e-4bcc-ab80-9c335d111e08 for instance eb8d83ef-de75-4359-bb6d-87d0268d2754 on n-h1-860864-3 Oct 11 19:52:12.169679 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6335aad3-7e6b-486e-96e6-8eeeb178196a req-12105631-18e0-42b0-8b41-18ce2d6c1ded service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130884 Oct 11 19:52:12.173137 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1224/2412] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:12.246558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6db1c44b-5a9d-40aa-b824-f07b5186cf2e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:12.257920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6db1c44b-5a9d-40aa-b824-f07b5186cf2e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:12.299340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1c44b-5a9d-40aa-b824-f07b5186cf2e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.299840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1c44b-5a9d-40aa-b824-f07b5186cf2e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.300275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1c44b-5a9d-40aa-b824-f07b5186cf2e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:12.300980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1c44b-5a9d-40aa-b824-f07b5186cf2e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.301432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1c44b-5a9d-40aa-b824-f07b5186cf2e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.301845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db1c44b-5a9d-40aa-b824-f07b5186cf2e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:12.316675 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5c1b0709-f097-4fb6-975a-b495c7a46f10 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.629635 Oct 11 19:52:12.319662 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1189/2413] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 19:52:12.331607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0a674a3-e335-4ef9-8ccf-b83694915dbf tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:12.335536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f0a674a3-e335-4ef9-8ccf-b83694915dbf tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:12.348994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a674a3-e335-4ef9-8ccf-b83694915dbf tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.353982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a674a3-e335-4ef9-8ccf-b83694915dbf tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.354760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a674a3-e335-4ef9-8ccf-b83694915dbf tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:12.359505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a674a3-e335-4ef9-8ccf-b83694915dbf tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.360259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a674a3-e335-4ef9-8ccf-b83694915dbf tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.360854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0a674a3-e335-4ef9-8ccf-b83694915dbf tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:12.404859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6db1c44b-5a9d-40aa-b824-f07b5186cf2e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:12.453092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:12.661333 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6db1c44b-5a9d-40aa-b824-f07b5186cf2e tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 204 len: 0 microversion: 2.21 time: 0.484711 Oct 11 19:52:12.662423 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1225/2414] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:52:12 2022] DELETE /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:52:12.676222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-393754aa-2b78-4dc7-aff1-accb4049a64f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:12.676946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-393754aa-2b78-4dc7-aff1-accb4049a64f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 82d89574-9fa1-4698-a809-cdcbffb59ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:12.690925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-393754aa-2b78-4dc7-aff1-accb4049a64f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.691504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-393754aa-2b78-4dc7-aff1-accb4049a64f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.691849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-393754aa-2b78-4dc7-aff1-accb4049a64f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:12.692551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-393754aa-2b78-4dc7-aff1-accb4049a64f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.696369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-393754aa-2b78-4dc7-aff1-accb4049a64f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.696966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-393754aa-2b78-4dc7-aff1-accb4049a64f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:12.847425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f0a674a3-e335-4ef9-8ccf-b83694915dbf tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:12.857253 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f0a674a3-e335-4ef9-8ccf-b83694915dbf tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1315 microversion: 2.1 time: 0.534328 Oct 11 19:52:12.860420 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1190/2415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:12 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:12.867026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:12.870370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:12.894132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.896815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.898252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:12.899841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:12.909378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:12.915310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:13.056707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:13.068552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:13.072710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:13.087490 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1fe518ee-dd50-4574-948f-b8c7c3f32d6a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "PUT /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1428 microversion: 2.75 time: 0.225749 Oct 11 19:52:13.090347 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1191/2416] 10.222.0.27 () {62 vars in 1297 bytes} [Tue Oct 11 19:52:12 2022] PUT /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1428 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:13.107505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9d987aaa-d931-4b05-a673-c55579b7764d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:13.121408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9d987aaa-d931-4b05-a673-c55579b7764d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:13.284581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9d987aaa-d931-4b05-a673-c55579b7764d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:13.294858 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9d987aaa-d931-4b05-a673-c55579b7764d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1218 microversion: 2.1 time: 0.191163 Oct 11 19:52:13.295432 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1192/2417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:13 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:13.441128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1214449771", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "5177bac2-1508-4dd5-9ffa-bc494f9c5422"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:13.624552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-393754aa-2b78-4dc7-aff1-accb4049a64f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:13.644927 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-393754aa-2b78-4dc7-aff1-accb4049a64f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6" status: 200 len: 1320 microversion: 2.1 time: 0.981061 Oct 11 19:52:13.645485 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1226/2418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:12 2022] GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6 => generated 1320 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:13.763007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-854325650", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "d54228aa-3070-40cd-8b24-f48bbdc5858b"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:13.872348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] validate_networks() for [('d54228aa-3070-40cd-8b24-f48bbdc5858b', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:52:13.944641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] validate_networks() for [('5177bac2-1508-4dd5-9ffa-bc494f9c5422', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:52:14.737413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:14.738007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:14.738285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:14.738959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:14.740130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:14.751295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:14.752173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:14.752778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:14.753508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:14.753996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:14.754613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:14.788940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Getting quotas for project 264dda6e3c7a4280a08204fda9003f54. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:52:14.796671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Getting quotas for user 258cb2ba63914f1a9dc997cc297f787e and project 264dda6e3c7a4280a08204fda9003f54. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:52:14.812095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Going to run 3 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:52:14.815015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:14.820215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:14.823183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:14.824137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:14.828331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:14.831585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:14.874270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:14.875256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:14.875727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:14.876542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:14.877386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:14.877848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:14.881916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: efc7c3f0-fdf4-425e-97c9-534e4f3144a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=d4683095-d0c3-42c7-aa5c-203a404a7143,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:14.902112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Getting quotas for project a8b39062227d428186d4a665fac14fb1. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:52:14.911570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Getting quotas for user 8faada3423bb457c8b1f8f55853934de and project a8b39062227d428186d4a665fac14fb1. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:52:14.926655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=efc7c3f0-fdf4-425e-97c9-534e4f3144a3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:14.932386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:52:14.936766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:15.015942 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-35cceb21-ee95-4c2c-811a-4c1dfd26f22d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.719420 Oct 11 19:52:15.016604 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1193/2419] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:52:15.031872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:15.032743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:15.039404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:15.040372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:15.041010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:15.041906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:15.069919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:15.070444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:15.087857 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-33506077-14a1-41a3-a6f5-3c9a1c56612c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436267 Oct 11 19:52:15.093429 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1227/2420] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:52:15.105537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-981c6778-4bda-4d5d-b245-462afd945445 req-9ffae9ec-3ee8-46af-baa9-a58fc96421bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d89574-9fa1-4698-a809-cdcbffb59ed6", "tag": "10eee565-ba3b-492a-8760-dcb24a1796d4"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:15.155418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-981c6778-4bda-4d5d-b245-462afd945445 req-9ffae9ec-3ee8-46af-baa9-a58fc96421bc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:15.158568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-981c6778-4bda-4d5d-b245-462afd945445 req-9ffae9ec-3ee8-46af-baa9-a58fc96421bc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:15.163115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-981c6778-4bda-4d5d-b245-462afd945445 req-9ffae9ec-3ee8-46af-baa9-a58fc96421bc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:15.187406 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-981c6778-4bda-4d5d-b245-462afd945445 req-9ffae9ec-3ee8-46af-baa9-a58fc96421bc service nova] Creating event network-changed:10eee565-ba3b-492a-8760-dcb24a1796d4 for instance 82d89574-9fa1-4698-a809-cdcbffb59ed6 on n-h2-860864-3 Oct 11 19:52:15.203850 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-981c6778-4bda-4d5d-b245-462afd945445 req-9ffae9ec-3ee8-46af-baa9-a58fc96421bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107269 Oct 11 19:52:15.213411 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1228/2421] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:15.221438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2eddd1a5-a915-4d81-9e75-06c27c92ab26 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:15.222457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2eddd1a5-a915-4d81-9e75-06c27c92ab26 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:15.241259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eddd1a5-a915-4d81-9e75-06c27c92ab26 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:15.251865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eddd1a5-a915-4d81-9e75-06c27c92ab26 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:15.252318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eddd1a5-a915-4d81-9e75-06c27c92ab26 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:15.253118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eddd1a5-a915-4d81-9e75-06c27c92ab26 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:15.253584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eddd1a5-a915-4d81-9e75-06c27c92ab26 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:15.254003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eddd1a5-a915-4d81-9e75-06c27c92ab26 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:15.848569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2eddd1a5-a915-4d81-9e75-06c27c92ab26 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:15.863480 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2eddd1a5-a915-4d81-9e75-06c27c92ab26 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1723 microversion: 2.1 time: 0.646739 Oct 11 19:52:15.868389 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1229/2422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:15 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1723 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:15.877623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:15.887599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:15.896423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:15.897678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:15.898168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:15.899508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:15.901390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:15.902204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:15.925784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:15.944792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:15.951434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:15.952880 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-13faff52-8d6a-4b53-a74a-8ddad9eddb34 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1557 microversion: 2.21 time: 0.930757 Oct 11 19:52:15.958880 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1194/2423] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:15 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1557 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:15.964090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7fd1eb73-88a1-4ff2-901e-bcac8ffcb091 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:15.972065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7fd1eb73-88a1-4ff2-901e-bcac8ffcb091 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:15.982910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fd1eb73-88a1-4ff2-901e-bcac8ffcb091 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:15.983893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fd1eb73-88a1-4ff2-901e-bcac8ffcb091 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:15.984656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fd1eb73-88a1-4ff2-901e-bcac8ffcb091 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:15.985667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fd1eb73-88a1-4ff2-901e-bcac8ffcb091 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:15.986841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fd1eb73-88a1-4ff2-901e-bcac8ffcb091 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:15.987622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7fd1eb73-88a1-4ff2-901e-bcac8ffcb091 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.141574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:16.155453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:16.161288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:16.176260 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-67f02411-9bf0-49ef-b4a5-2af5d3834344 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1416 microversion: 2.75 time: 0.304139 Oct 11 19:52:16.178307 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1230/2424] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:15 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1416 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:16.195422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6e79981-f536-45a0-9e33-c7d7baf7c9e2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:16.196581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6e79981-f536-45a0-9e33-c7d7baf7c9e2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:16.206403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e79981-f536-45a0-9e33-c7d7baf7c9e2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:16.207534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e79981-f536-45a0-9e33-c7d7baf7c9e2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:16.224989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e79981-f536-45a0-9e33-c7d7baf7c9e2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.228116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e79981-f536-45a0-9e33-c7d7baf7c9e2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:16.229737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e79981-f536-45a0-9e33-c7d7baf7c9e2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:16.231207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e79981-f536-45a0-9e33-c7d7baf7c9e2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.432811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f6e79981-f536-45a0-9e33-c7d7baf7c9e2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:16.457118 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6e79981-f536-45a0-9e33-c7d7baf7c9e2 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1276 microversion: 2.1 time: 0.277471 Oct 11 19:52:16.457611 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1231/2425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:16 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:16.471475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ec56b00-5459-4d5b-be75-6faa835fb6e8 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:16.481056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6ec56b00-5459-4d5b-be75-6faa835fb6e8 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 82d89574-9fa1-4698-a809-cdcbffb59ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:16.495478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ec56b00-5459-4d5b-be75-6faa835fb6e8 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:16.500874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ec56b00-5459-4d5b-be75-6faa835fb6e8 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:16.501681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ec56b00-5459-4d5b-be75-6faa835fb6e8 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.502976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ec56b00-5459-4d5b-be75-6faa835fb6e8 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:16.503823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ec56b00-5459-4d5b-be75-6faa835fb6e8 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:16.505442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ec56b00-5459-4d5b-be75-6faa835fb6e8 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.513997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7fd1eb73-88a1-4ff2-901e-bcac8ffcb091 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:16.523640 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7fd1eb73-88a1-4ff2-901e-bcac8ffcb091 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1504 microversion: 2.1 time: 0.563518 Oct 11 19:52:16.541230 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1195/2426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:15 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:16.549855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30fd2e22-7889-49dc-b296-6bbacfd73311 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:16.550607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30fd2e22-7889-49dc-b296-6bbacfd73311 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:16.569914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30fd2e22-7889-49dc-b296-6bbacfd73311 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:16.570446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30fd2e22-7889-49dc-b296-6bbacfd73311 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:16.571094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30fd2e22-7889-49dc-b296-6bbacfd73311 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.577129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30fd2e22-7889-49dc-b296-6bbacfd73311 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:16.577629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30fd2e22-7889-49dc-b296-6bbacfd73311 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:16.578069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30fd2e22-7889-49dc-b296-6bbacfd73311 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.730877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-30fd2e22-7889-49dc-b296-6bbacfd73311 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:16.750281 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-30fd2e22-7889-49dc-b296-6bbacfd73311 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1221 microversion: 2.1 time: 0.206330 Oct 11 19:52:16.754367 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1196/2427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:16 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1221 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:16.763043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:16.791583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:16.794411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Searching by: {'deleted': False, 'project_id': '264dda6e3c7a4280a08204fda9003f54'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:16.824269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6ec56b00-5459-4d5b-be75-6faa835fb6e8 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:16.835793 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6ec56b00-5459-4d5b-be75-6faa835fb6e8 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6" status: 200 len: 1320 microversion: 2.1 time: 0.370150 Oct 11 19:52:16.837191 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1232/2428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:16 2022] GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6 => generated 1320 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:16.842845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-700d8499-aa33-4db9-bb9e-a2a41c8f012b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:16.843624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-700d8499-aa33-4db9-bb9e-a2a41c8f012b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:16.853536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:16.854060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:16.854851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.856408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:16.866689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-700d8499-aa33-4db9-bb9e-a2a41c8f012b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:16.867927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-700d8499-aa33-4db9-bb9e-a2a41c8f012b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:16.868656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-700d8499-aa33-4db9-bb9e-a2a41c8f012b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.869576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-700d8499-aa33-4db9-bb9e-a2a41c8f012b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:16.869960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:16.870415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.871462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-700d8499-aa33-4db9-bb9e-a2a41c8f012b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:16.873186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-700d8499-aa33-4db9-bb9e-a2a41c8f012b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:16.939683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-700d8499-aa33-4db9-bb9e-a2a41c8f012b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:17.009379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Listed batch of 3 results from cell out of 997 limit. Returned 3 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:52:17.043029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:17.153314 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9fc0a8cb-6a44-4b7e-b867-4ba2cb43db99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.395691 Oct 11 19:52:17.153912 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1197/2429] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 19:52:16 2022] GET /compute/v2.1/servers => generated 1015 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:17.159765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4c49bc95-5044-4d87-80c7-ffc380571e72 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:17.160731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4c49bc95-5044-4d87-80c7-ffc380571e72 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:17.171833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c49bc95-5044-4d87-80c7-ffc380571e72 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.172784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c49bc95-5044-4d87-80c7-ffc380571e72 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.173458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c49bc95-5044-4d87-80c7-ffc380571e72 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:17.174754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c49bc95-5044-4d87-80c7-ffc380571e72 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.175456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c49bc95-5044-4d87-80c7-ffc380571e72 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.176265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c49bc95-5044-4d87-80c7-ffc380571e72 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:17.184543 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-700d8499-aa33-4db9-bb9e-a2a41c8f012b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 204 len: 0 microversion: 2.1 time: 0.346312 Oct 11 19:52:17.185695 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1233/2430] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:16 2022] DELETE /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:17.191266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:17.192199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:17.209133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.209634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.210073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:17.210865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.211830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.212283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:17.349772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:17.364689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:17.366708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:17.375337 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-67b6152c-c503-4d1c-b596-d55117a9f9c8 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1515 microversion: 2.21 time: 0.188108 Oct 11 19:52:17.376612 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1234/2431] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:17 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:17.393048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-0eee029b-9ca8-421e-b7cf-a5a0fdc2b49b req-12f462ec-bfea-4f21-881a-5107a4406400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a308e18-5663-4908-bb68-88beb2a586a8", "tag": "72fcbc2b-58b1-4f39-b25a-3c22281ae408"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:17.419997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0eee029b-9ca8-421e-b7cf-a5a0fdc2b49b req-12f462ec-bfea-4f21-881a-5107a4406400 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.421184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0eee029b-9ca8-421e-b7cf-a5a0fdc2b49b req-12f462ec-bfea-4f21-881a-5107a4406400 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.425959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0eee029b-9ca8-421e-b7cf-a5a0fdc2b49b req-12f462ec-bfea-4f21-881a-5107a4406400 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:17.478586 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-0eee029b-9ca8-421e-b7cf-a5a0fdc2b49b req-12f462ec-bfea-4f21-881a-5107a4406400 service nova] Creating event network-changed:72fcbc2b-58b1-4f39-b25a-3c22281ae408 for instance 0a308e18-5663-4908-bb68-88beb2a586a8 on n-h2-860864-3 Oct 11 19:52:17.491753 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-0eee029b-9ca8-421e-b7cf-a5a0fdc2b49b req-12f462ec-bfea-4f21-881a-5107a4406400 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113337 Oct 11 19:52:17.495507 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1235/2432] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:17.507664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c22759f3-4e40-42f9-90a4-4295139642a8 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:17.509062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c22759f3-4e40-42f9-90a4-4295139642a8 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:17.517674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=12,nova_api:UPDATE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:17.535186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c22759f3-4e40-42f9-90a4-4295139642a8 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.535863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c22759f3-4e40-42f9-90a4-4295139642a8 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.536425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c22759f3-4e40-42f9-90a4-4295139642a8 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:17.537247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c22759f3-4e40-42f9-90a4-4295139642a8 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.537816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c22759f3-4e40-42f9-90a4-4295139642a8 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.538348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c22759f3-4e40-42f9-90a4-4295139642a8 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:17.678966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4c49bc95-5044-4d87-80c7-ffc380571e72 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:17.698391 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4c49bc95-5044-4d87-80c7-ffc380571e72 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1723 microversion: 2.1 time: 0.543050 Oct 11 19:52:17.701792 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1198/2433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:17 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1723 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:17.713331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9cccdb73-ca23-405e-8423-41698c36ebce tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:17.715153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9cccdb73-ca23-405e-8423-41698c36ebce tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:17.760445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cccdb73-ca23-405e-8423-41698c36ebce tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.763072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cccdb73-ca23-405e-8423-41698c36ebce tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.765312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cccdb73-ca23-405e-8423-41698c36ebce tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:17.766319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cccdb73-ca23-405e-8423-41698c36ebce tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.767639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cccdb73-ca23-405e-8423-41698c36ebce tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.768908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cccdb73-ca23-405e-8423-41698c36ebce tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:17.829330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c22759f3-4e40-42f9-90a4-4295139642a8 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:17.851388 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c22759f3-4e40-42f9-90a4-4295139642a8 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1226 microversion: 2.1 time: 0.354347 Oct 11 19:52:17.867242 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1236/2434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:17 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1226 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:17.892732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:17.896232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:17.903354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.903849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.915083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:17.915925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:17.916416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:17.916849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:18.071798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:18.094465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:18.097603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:18.113417 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4cd344a4-f8cb-4b07-b134-44d0a7945bc7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1437 microversion: 2.75 time: 0.255615 Oct 11 19:52:18.115535 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1237/2435] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:17 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1437 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:18.128414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c37e4ec5-2910-4704-9beb-050337f48b00 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:18.128414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c37e4ec5-2910-4704-9beb-050337f48b00 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:18.145434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c37e4ec5-2910-4704-9beb-050337f48b00 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:18.145939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c37e4ec5-2910-4704-9beb-050337f48b00 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:18.146373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c37e4ec5-2910-4704-9beb-050337f48b00 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:18.147113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c37e4ec5-2910-4704-9beb-050337f48b00 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:18.150302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c37e4ec5-2910-4704-9beb-050337f48b00 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:18.151741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c37e4ec5-2910-4704-9beb-050337f48b00 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:18.197651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9cccdb73-ca23-405e-8423-41698c36ebce tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:18.217549 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9cccdb73-ca23-405e-8423-41698c36ebce tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1510 microversion: 2.1 time: 0.514052 Oct 11 19:52:18.237937 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1199/2436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:17 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1510 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:18.250765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ac1e41f8-bad0-4336-8615-2eff031a98de tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:18.251726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ac1e41f8-bad0-4336-8615-2eff031a98de tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:18.261260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac1e41f8-bad0-4336-8615-2eff031a98de tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:18.268597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac1e41f8-bad0-4336-8615-2eff031a98de tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:18.269386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac1e41f8-bad0-4336-8615-2eff031a98de tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:18.270466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac1e41f8-bad0-4336-8615-2eff031a98de tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:18.271217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac1e41f8-bad0-4336-8615-2eff031a98de tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:18.271868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac1e41f8-bad0-4336-8615-2eff031a98de tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:18.893954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ac1e41f8-bad0-4336-8615-2eff031a98de tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:18.904327 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ac1e41f8-bad0-4336-8615-2eff031a98de tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1285 microversion: 2.1 time: 0.657413 Oct 11 19:52:18.905602 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1200/2437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:18 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1285 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:18.907481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c37e4ec5-2910-4704-9beb-050337f48b00 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:18.913742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-16b5cdb9-d338-4650-b91b-0d48fc630f96 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:18.915378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-16b5cdb9-d338-4650-b91b-0d48fc630f96 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 82d89574-9fa1-4698-a809-cdcbffb59ed6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:18.922661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16b5cdb9-d338-4650-b91b-0d48fc630f96 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:18.924683 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c37e4ec5-2910-4704-9beb-050337f48b00 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1276 microversion: 2.1 time: 0.804611 Oct 11 19:52:18.926014 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1238/2438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:18 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1276 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:18.931046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16b5cdb9-d338-4650-b91b-0d48fc630f96 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:18.931533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16b5cdb9-d338-4650-b91b-0d48fc630f96 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:18.932433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16b5cdb9-d338-4650-b91b-0d48fc630f96 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:18.933046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16b5cdb9-d338-4650-b91b-0d48fc630f96 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:18.933641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16b5cdb9-d338-4650-b91b-0d48fc630f96 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:18.942373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-62cec572-1d77-4ee4-966a-8bcdf07c1a42 req-b0125487-2dbf-45fa-8ac6-06f0ed079519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea069e25-cf9d-4bc9-a6f3-009a424ab562", "name": "network-vif-deleted", "tag": "ea5040c9-7296-48c3-b913-6e43b5de7ef9"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:18.962684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-62cec572-1d77-4ee4-966a-8bcdf07c1a42 req-b0125487-2dbf-45fa-8ac6-06f0ed079519 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:18.963516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-62cec572-1d77-4ee4-966a-8bcdf07c1a42 req-b0125487-2dbf-45fa-8ac6-06f0ed079519 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:18.964982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-62cec572-1d77-4ee4-966a-8bcdf07c1a42 req-b0125487-2dbf-45fa-8ac6-06f0ed079519 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:18.981173 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-62cec572-1d77-4ee4-966a-8bcdf07c1a42 req-b0125487-2dbf-45fa-8ac6-06f0ed079519 service nova] Creating event network-vif-deleted:ea5040c9-7296-48c3-b913-6e43b5de7ef9 for instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 on n-h1-860864-3 Oct 11 19:52:18.994736 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-62cec572-1d77-4ee4-966a-8bcdf07c1a42 req-b0125487-2dbf-45fa-8ac6-06f0ed079519 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066663 Oct 11 19:52:18.999248 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1239/2439] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:19.008901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:19.013059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:19.023014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.023616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.024637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:19.025554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.027062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.027658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:19.159201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:19.161394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:19.162100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:19.162767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:19.163430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:19.332532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:19.346989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.347803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.348399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:19.349265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.352645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.355532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:19.560930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:19.595209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:19.612850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:19.643646 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-894a18a9-84b0-4c6b-b02f-232ae109705a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "POST /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90/action" status: 202 len: 1494 microversion: 2.75 time: 0.642847 Oct 11 19:52:19.646359 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1240/2440] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:52:18 2022] POST /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90/action => generated 1494 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 19:52:19.664790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:19.667519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:19.684657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.687526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.688129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:19.689033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.689637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.690218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:19.715945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-16b5cdb9-d338-4650-b91b-0d48fc630f96 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:19.731927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.732701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.733290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:19.733893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lazy-loading 'fault' on Instance uuid ea069e25-cf9d-4bc9-a6f3-009a424ab562 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:19.747318 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-16b5cdb9-d338-4650-b91b-0d48fc630f96 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6" status: 200 len: 1320 microversion: 2.1 time: 0.836751 Oct 11 19:52:19.758753 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1201/2441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:18 2022] GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6 => generated 1320 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:19.767287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-86b05743-c605-48ca-90fa-c2ceaf541084 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:19.767287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-86b05743-c605-48ca-90fa-c2ceaf541084 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:19.776685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86b05743-c605-48ca-90fa-c2ceaf541084 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.778142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86b05743-c605-48ca-90fa-c2ceaf541084 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.778776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86b05743-c605-48ca-90fa-c2ceaf541084 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:19.779759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86b05743-c605-48ca-90fa-c2ceaf541084 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.780472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86b05743-c605-48ca-90fa-c2ceaf541084 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.781325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86b05743-c605-48ca-90fa-c2ceaf541084 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:19.841296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:19.861041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:19.863013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd229b3160d124151bf266f50b96b153c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f24f96dcc14e20b72d9937d66e850e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:19.865530 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4c479af7-ef8b-423c-a224-6fb3db660543 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 200 len: 1348 microversion: 2.21 time: 0.215974 Oct 11 19:52:19.866784 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1241/2442] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:19 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 1348 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:19.880656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-48b28f73-839c-4798-b7a0-dbb8f7470029 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:19.881491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-48b28f73-839c-4798-b7a0-dbb8f7470029 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:19.890249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b28f73-839c-4798-b7a0-dbb8f7470029 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.891589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b28f73-839c-4798-b7a0-dbb8f7470029 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.892211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b28f73-839c-4798-b7a0-dbb8f7470029 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:19.893068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b28f73-839c-4798-b7a0-dbb8f7470029 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:19.893670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b28f73-839c-4798-b7a0-dbb8f7470029 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:19.894227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b28f73-839c-4798-b7a0-dbb8f7470029 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.015615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-48b28f73-839c-4798-b7a0-dbb8f7470029 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:20.035948 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-48b28f73-839c-4798-b7a0-dbb8f7470029 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1274 microversion: 2.1 time: 0.165345 Oct 11 19:52:20.060174 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1242/2443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:19 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:20.085329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2848fbd9-5da1-40f9-a320-0f94a4ae09b7 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:20.087095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2848fbd9-5da1-40f9-a320-0f94a4ae09b7 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:20.107210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2848fbd9-5da1-40f9-a320-0f94a4ae09b7 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.108415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2848fbd9-5da1-40f9-a320-0f94a4ae09b7 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.109428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2848fbd9-5da1-40f9-a320-0f94a4ae09b7 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.110488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2848fbd9-5da1-40f9-a320-0f94a4ae09b7 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.111260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2848fbd9-5da1-40f9-a320-0f94a4ae09b7 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.111889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2848fbd9-5da1-40f9-a320-0f94a4ae09b7 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.123948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-86b05743-c605-48ca-90fa-c2ceaf541084 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:20.145156 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-86b05743-c605-48ca-90fa-c2ceaf541084 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1700 microversion: 2.1 time: 0.395062 Oct 11 19:52:20.145768 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1202/2444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:19 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1700 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:20.150695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a8ee2334-5b24-416d-8b14-1c192610fc1a req-1c5c58f4-a565-4866-9303-47d330ee4cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d89574-9fa1-4698-a809-cdcbffb59ed6", "name": "network-vif-plugged", "status": "completed", "tag": "10eee565-ba3b-492a-8760-dcb24a1796d4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:20.170662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a8ee2334-5b24-416d-8b14-1c192610fc1a req-1c5c58f4-a565-4866-9303-47d330ee4cc3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.171187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a8ee2334-5b24-416d-8b14-1c192610fc1a req-1c5c58f4-a565-4866-9303-47d330ee4cc3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.171648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a8ee2334-5b24-416d-8b14-1c192610fc1a req-1c5c58f4-a565-4866-9303-47d330ee4cc3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.210561 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a8ee2334-5b24-416d-8b14-1c192610fc1a req-1c5c58f4-a565-4866-9303-47d330ee4cc3 service nova] Creating event network-vif-plugged:10eee565-ba3b-492a-8760-dcb24a1796d4 for instance 82d89574-9fa1-4698-a809-cdcbffb59ed6 on n-h2-860864-3 Oct 11 19:52:20.224449 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a8ee2334-5b24-416d-8b14-1c192610fc1a req-1c5c58f4-a565-4866-9303-47d330ee4cc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077428 Oct 11 19:52:20.225385 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1203/2445] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:20.230771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:20.231529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:20.250719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2848fbd9-5da1-40f9-a320-0f94a4ae09b7 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf3736eab7b46dfa7d5fe0d4161cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d6079311d94932a20980893d2383e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:20.277910 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2848fbd9-5da1-40f9-a320-0f94a4ae09b7 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 200 len: 1468 microversion: 2.1 time: 0.207181 Oct 11 19:52:20.296060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.296256 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1243/2446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:20 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 1468 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:20.296346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.296346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.296346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.296346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.299489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.303231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa9ac4c6-dc58-4ae7-9689-9bb11ebb3746 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:20.304073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa9ac4c6-dc58-4ae7-9689-9bb11ebb3746 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:20.339120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9ac4c6-dc58-4ae7-9689-9bb11ebb3746 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.340732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9ac4c6-dc58-4ae7-9689-9bb11ebb3746 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.344493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9ac4c6-dc58-4ae7-9689-9bb11ebb3746 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.345283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9ac4c6-dc58-4ae7-9689-9bb11ebb3746 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.345761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9ac4c6-dc58-4ae7-9689-9bb11ebb3746 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.346189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9ac4c6-dc58-4ae7-9689-9bb11ebb3746 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.556205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:20.565392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:20.567508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:20.581527 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0c25e0c3-aea8-46c6-bdb3-f7ba8f7fd182 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.354808 Oct 11 19:52:20.582453 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1204/2447] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:20 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:20.597543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa9ac4c6-dc58-4ae7-9689-9bb11ebb3746 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:20.599420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f584a1b5-4d71-4d62-abd4-ff63f1f671eb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:20.604792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f584a1b5-4d71-4d62-abd4-ff63f1f671eb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:20.618215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f584a1b5-4d71-4d62-abd4-ff63f1f671eb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.618390 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa9ac4c6-dc58-4ae7-9689-9bb11ebb3746 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1283 microversion: 2.1 time: 0.333738 Oct 11 19:52:20.619042 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1244/2448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:20 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1283 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:20.620220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f584a1b5-4d71-4d62-abd4-ff63f1f671eb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.620909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f584a1b5-4d71-4d62-abd4-ff63f1f671eb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.622034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f584a1b5-4d71-4d62-abd4-ff63f1f671eb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.622828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f584a1b5-4d71-4d62-abd4-ff63f1f671eb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.623479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f584a1b5-4d71-4d62-abd4-ff63f1f671eb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.632346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f470574c-1265-4738-9435-f029d20de0e2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:20.651243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f470574c-1265-4738-9435-f029d20de0e2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.653339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f470574c-1265-4738-9435-f029d20de0e2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.656548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f470574c-1265-4738-9435-f029d20de0e2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.718912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f470574c-1265-4738-9435-f029d20de0e2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Going to try to start instance {{(pid=126956) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 19:52:20.815918 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f470574c-1265-4738-9435-f029d20de0e2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/action" status: 202 len: 0 microversion: 2.1 time: 0.194929 Oct 11 19:52:20.820412 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1245/2449] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:52:20 2022] POST /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:52:20.828696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbfac56b-f8c7-4b3c-be1a-1d922b283c48 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:20.829961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cbfac56b-f8c7-4b3c-be1a-1d922b283c48 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 82d89574-9fa1-4698-a809-cdcbffb59ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:20.843767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbfac56b-f8c7-4b3c-be1a-1d922b283c48 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.844618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbfac56b-f8c7-4b3c-be1a-1d922b283c48 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.845037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbfac56b-f8c7-4b3c-be1a-1d922b283c48 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:20.845871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbfac56b-f8c7-4b3c-be1a-1d922b283c48 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:20.847775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbfac56b-f8c7-4b3c-be1a-1d922b283c48 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:20.848275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbfac56b-f8c7-4b3c-be1a-1d922b283c48 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.141452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f584a1b5-4d71-4d62-abd4-ff63f1f671eb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:21.151768 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f584a1b5-4d71-4d62-abd4-ff63f1f671eb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1318 microversion: 2.1 time: 0.567772 Oct 11 19:52:21.152482 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1205/2450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:20 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:21.159450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cf2836f1-729b-4ee9-8585-8982eb209dc0 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:21.161424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cf2836f1-729b-4ee9-8585-8982eb209dc0 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:21.168854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf2836f1-729b-4ee9-8585-8982eb209dc0 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.169616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf2836f1-729b-4ee9-8585-8982eb209dc0 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.170148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf2836f1-729b-4ee9-8585-8982eb209dc0 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.170994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf2836f1-729b-4ee9-8585-8982eb209dc0 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.171559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf2836f1-729b-4ee9-8585-8982eb209dc0 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.172080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf2836f1-729b-4ee9-8585-8982eb209dc0 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.489806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cbfac56b-f8c7-4b3c-be1a-1d922b283c48 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:21.511768 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cbfac56b-f8c7-4b3c-be1a-1d922b283c48 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6" status: 200 len: 1320 microversion: 2.1 time: 0.688683 Oct 11 19:52:21.513152 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1246/2451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:20 2022] GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6 => generated 1320 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:21.518696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:21.519503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:21.535183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.536659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.537266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.538568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.539188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.540324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.545484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:21.559678 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] HTTP exception thrown: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Request method failure captured: Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 HTTP/1.1 Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclPPu2waRv-OmhdfsVboze68As5-hRLnHj8qMs8iQ0xsSObBLHAAnKFrFuVFvyzuUfVGykiFEIWasoSoC1sm0C4iOpIcuRAmn-e0J56pzi84sciNs8TrX1JGC7K8R1isFo3FVIcR1X776fUiFUZFXpTcIqmzq-VBOh3g3cuR0ThZZ4 Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: d8f24f96dcc14e20b72d9937d66e850e Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1707705517 Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d8f24f96dcc14e20b72d9937d66e850e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d8f24f96dcc14e20b72d9937d66e850e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8f24f96dcc14e20b72d9937d66e850e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8f24f96dcc14e20b72d9937d66e850e"}]}] Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-InstanceActionsV221TestJSON-1707705517 Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: d8f24f96dcc14e20b72d9937d66e850e Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1707705517 Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-InstanceActionsV221TestJSON-1707705517-project Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d229b3160d124151bf266f50b96b153c Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-InstanceActionsV221TestJSON-1707705517-project Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ea069e25-cf9d-4bc9-a6f3-009a424ab562'} Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:21.561709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:21.568494 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:21.568494 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:21.568494 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:21.568494 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:21.568494 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:21.568494 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:21.568494 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:21.568494 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:21.568494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Returning 404 to user: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:21.568494 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78255b5f-668a-47e2-847c-76d114136914 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 404 len: 111 microversion: 2.21 time: 0.053303 Oct 11 19:52:21.570089 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1247/2452] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:21 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:52:21.583228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1eee042d-d99c-4bc1-8b14-999bec8dbd5a req-cfe2b091-f701-4a50-ace2-a723321e880c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb8d83ef-de75-4359-bb6d-87d0268d2754", "name": "network-vif-deleted", "tag": "9f3bc577-ea3e-4bcc-ab80-9c335d111e08"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:21.594680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1eee042d-d99c-4bc1-8b14-999bec8dbd5a req-cfe2b091-f701-4a50-ace2-a723321e880c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.595439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1eee042d-d99c-4bc1-8b14-999bec8dbd5a req-cfe2b091-f701-4a50-ace2-a723321e880c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.596042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1eee042d-d99c-4bc1-8b14-999bec8dbd5a req-cfe2b091-f701-4a50-ace2-a723321e880c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.620221 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1eee042d-d99c-4bc1-8b14-999bec8dbd5a req-cfe2b091-f701-4a50-ace2-a723321e880c service nova] Creating event network-vif-deleted:9f3bc577-ea3e-4bcc-ab80-9c335d111e08 for instance eb8d83ef-de75-4359-bb6d-87d0268d2754 on n-h1-860864-3 Oct 11 19:52:21.626127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cf2836f1-729b-4ee9-8585-8982eb209dc0 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:21.626759 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1eee042d-d99c-4bc1-8b14-999bec8dbd5a req-cfe2b091-f701-4a50-ace2-a723321e880c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054560 Oct 11 19:52:21.627759 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1248/2453] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:21.633001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b5875ed-88af-415a-9b71-5ee36fe05e1b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:21.634344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b5875ed-88af-415a-9b71-5ee36fe05e1b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:21.637302 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cf2836f1-729b-4ee9-8585-8982eb209dc0 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1709 microversion: 2.1 time: 0.482570 Oct 11 19:52:21.638591 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1206/2454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:21 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1709 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:21.643601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:21.644589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:21.651253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b5875ed-88af-415a-9b71-5ee36fe05e1b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.651885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b5875ed-88af-415a-9b71-5ee36fe05e1b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.652557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b5875ed-88af-415a-9b71-5ee36fe05e1b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.653485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b5875ed-88af-415a-9b71-5ee36fe05e1b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.654153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b5875ed-88af-415a-9b71-5ee36fe05e1b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.654711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b5875ed-88af-415a-9b71-5ee36fe05e1b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.661435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.662177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.662798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.663700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.665027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.665711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.691356 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] HTTP exception thrown: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Request method failure captured: Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 HTTP/1.1 Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclRk9QP7yghTFWXYnkebC0vIJw6ClBpw_8_gCdIg3CSWTFZmKx4q471fMMGsJNzx3Y1jygA9DLoMeaODUxZava3H2RF5i6a9_BFC_j3p7NJIQN5Pgz4AbfZKmDeSido62a-GdbB-I0K53iOGEkIVKvcB29G98dK-KZDhtlK-TuhTPU Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3d6079311d94932a20980893d2383e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3d6079311d94932a20980893d2383e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}] Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: faf3736eab7b46dfa7d5fe0d4161cb62 Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'eb8d83ef-de75-4359-bb6d-87d0268d2754'} Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:21.693458 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:21.698298 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:21.698298 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:21.698298 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:21.698298 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:21.698298 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:21.698298 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:21.698298 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:21.698298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Returning 404 to user: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:21.698298 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c726d9cc-41f5-4bff-8179-1211bec2ece6 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 404 len: 111 microversion: 2.1 time: 0.055673 Oct 11 19:52:21.700589 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1207/2455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:21 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:21.705704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6e5d981-67d1-4a6a-8aa2-7b0a6a3d2af3 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '.version_select at 0x7f83d0702550>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:21.706288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a6e5d981-67d1-4a6a-8aa2-7b0a6a3d2af3 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:21.713427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e5d981-67d1-4a6a-8aa2-7b0a6a3d2af3 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.714575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e5d981-67d1-4a6a-8aa2-7b0a6a3d2af3 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.715031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e5d981-67d1-4a6a-8aa2-7b0a6a3d2af3 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.715929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e5d981-67d1-4a6a-8aa2-7b0a6a3d2af3 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.716396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e5d981-67d1-4a6a-8aa2-7b0a6a3d2af3 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.716821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6e5d981-67d1-4a6a-8aa2-7b0a6a3d2af3 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.767904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b5875ed-88af-415a-9b71-5ee36fe05e1b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:21.780766 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b5875ed-88af-415a-9b71-5ee36fe05e1b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1280 microversion: 2.1 time: 0.151712 Oct 11 19:52:21.794896 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1249/2456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:21 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1280 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:21.794896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:21.794896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:21.795891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.796630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.797509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.798626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.799285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.799907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.829369 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6e5d981-67d1-4a6a-8aa2-7b0a6a3d2af3 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.127512 Oct 11 19:52:21.830305 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1208/2457] 10.222.0.27 () {60 vars in 1337 bytes} [Tue Oct 11 19:52:21 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562/os-instance-actions => generated 611 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:52:21.835509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-44860921-3a67-495f-b4c1-6dc18165ae0c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:21.836128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-44860921-3a67-495f-b4c1-6dc18165ae0c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:21.842855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44860921-3a67-495f-b4c1-6dc18165ae0c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.843494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44860921-3a67-495f-b4c1-6dc18165ae0c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.844112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44860921-3a67-495f-b4c1-6dc18165ae0c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.845221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44860921-3a67-495f-b4c1-6dc18165ae0c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:21.845835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44860921-3a67-495f-b4c1-6dc18165ae0c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:21.846412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44860921-3a67-495f-b4c1-6dc18165ae0c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:21.868637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:22.298541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:22.313699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:22.315228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:22.326201 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ecb7ca86-441f-454a-8533-b552d5593bc1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.543166 Oct 11 19:52:22.327263 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1250/2458] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:21 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:22.342569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1639586222", "metadata": {"image_type": "test"}}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:22.345459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:22.353935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:22.354730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:22.355345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:22.357626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:22.358272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:22.358891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:22.375536 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] HTTP exception thrown: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Request method failure captured: Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754/action HTTP/1.1 Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 112 Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclRk9QP7yghTFWXYnkebC0vIJw6ClBpw_8_gCdIg3CSWTFZmKx4q471fMMGsJNzx3Y1jygA9DLoMeaODUxZava3H2RF5i6a9_BFC_j3p7NJIQN5Pgz4AbfZKmDeSido62a-GdbB-I0K53iOGEkIVKvcB29G98dK-KZDhtlK-TuhTPU Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3d6079311d94932a20980893d2383e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3d6079311d94932a20980893d2383e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}] Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: faf3736eab7b46dfa7d5fe0d4161cb62 Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1639586222", "metadata": {"image_type": "test"}}} Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'eb8d83ef-de75-4359-bb6d-87d0268d2754', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1639586222', 'metadata': {'image_type': 'test'}}}} Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 19:52:22.377581 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Returning 404 to user: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ccf846f-f074-452c-9074-e0b6d48dec88 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "POST /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754/action" status: 404 len: 111 microversion: 2.1 time: 0.050716 Oct 11 19:52:22.383523 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1251/2459] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Oct 11 19:52:22 2022] POST /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:22.395854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:22.396614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:22.405301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:22.406107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:22.406811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:22.407537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:22.408029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:22.408742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:22.424994 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] HTTP exception thrown: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Request method failure captured: Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 HTTP/1.1 Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclPPu2waRv-OmhdfsVboze68As5-hRLnHj8qMs8iQ0xsSObBLHAAnKFrFuVFvyzuUfVGykiFEIWasoSoC1sm0C4iOpIcuRAmn-e0J56pzi84sciNs8TrX1JGC7K8R1isFo3FVIcR1X776fUiFUZFXpTcIqmzq-VBOh3g3cuR0ThZZ4 Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: d8f24f96dcc14e20b72d9937d66e850e Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1707705517 Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d8f24f96dcc14e20b72d9937d66e850e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d8f24f96dcc14e20b72d9937d66e850e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8f24f96dcc14e20b72d9937d66e850e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8f24f96dcc14e20b72d9937d66e850e"}]}] Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-InstanceActionsV221TestJSON-1707705517 Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: d8f24f96dcc14e20b72d9937d66e850e Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1707705517 Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-InstanceActionsV221TestJSON-1707705517-project Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d229b3160d124151bf266f50b96b153c Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-InstanceActionsV221TestJSON-1707705517-project Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ea069e25-cf9d-4bc9-a6f3-009a424ab562'} Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:22.426621 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Returning 404 to user: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e30ab75c-ac65-4c01-965b-c0b95afddb92 tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 404 len: 111 microversion: 2.21 time: 0.047433 Oct 11 19:52:22.430961 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1252/2460] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:52:22 2022] DELETE /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:52:22.434715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-18fe6cc4-4a18-4991-8bfb-5553cf5620cb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:22.436134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-18fe6cc4-4a18-4991-8bfb-5553cf5620cb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:22.442787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18fe6cc4-4a18-4991-8bfb-5553cf5620cb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:22.443591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18fe6cc4-4a18-4991-8bfb-5553cf5620cb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:22.444033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18fe6cc4-4a18-4991-8bfb-5553cf5620cb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:22.445188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18fe6cc4-4a18-4991-8bfb-5553cf5620cb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:22.445678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18fe6cc4-4a18-4991-8bfb-5553cf5620cb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:22.446273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18fe6cc4-4a18-4991-8bfb-5553cf5620cb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:22.462422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-44860921-3a67-495f-b4c1-6dc18165ae0c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:22.470861 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-44860921-3a67-495f-b4c1-6dc18165ae0c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1325 microversion: 2.1 time: 0.639270 Oct 11 19:52:22.480218 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1209/2461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:21 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1325 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:22.493726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-45d15feb-06b8-49f0-933d-81be483069bc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2054447956", "metadata": {"image_type": "test"}}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:22.496475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-45d15feb-06b8-49f0-933d-81be483069bc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Failed to fetch instance by id tempest-invalid-1998332887 {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 19:52:22.497086 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-45d15feb-06b8-49f0-933d-81be483069bc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] HTTP exception thrown: Instance tempest-invalid-1998332887 could not be found. Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-45d15feb-06b8-49f0-933d-81be483069bc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Request method failure captured: Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/tempest-invalid-1998332887/action HTTP/1.1 Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 112 Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclRk9QP7yghTFWXYnkebC0vIJw6ClBpw_8_gCdIg3CSWTFZmKx4q471fMMGsJNzx3Y1jygA9DLoMeaODUxZava3H2RF5i6a9_BFC_j3p7NJIQN5Pgz4AbfZKmDeSido62a-GdbB-I0K53iOGEkIVKvcB29G98dK-KZDhtlK-TuhTPU Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3d6079311d94932a20980893d2383e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3d6079311d94932a20980893d2383e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}] Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: faf3736eab7b46dfa7d5fe0d4161cb62 Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2054447956", "metadata": {"image_type": "test"}}} Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance tempest-invalid-1998332887 could not be found. Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'tempest-invalid-1998332887', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2054447956', 'metadata': {'image_type': 'test'}}}} Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1998332887 could not be found. Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:22.498792 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1998332887 could not be found. Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1998332887 could not be found. Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-45d15feb-06b8-49f0-933d-81be483069bc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Returning 404 to user: Instance tempest-invalid-1998332887 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-45d15feb-06b8-49f0-933d-81be483069bc tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-1998332887/action" status: 404 len: 101 microversion: 2.1 time: 0.018564 Oct 11 19:52:22.502340 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1210/2462] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 11 19:52:22 2022] POST /compute/v2.1/servers/tempest-invalid-1998332887/action => generated 101 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:22.508080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:22.509131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] [instance: ea069e25-cf9d-4bc9-a6f3-009a424ab562] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:22.519131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:22.519826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:22.520536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:22.521376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:22.521957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:22.522506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:22.537576 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] HTTP exception thrown: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Request method failure captured: Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 HTTP/1.1 Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclPPu2waRv-OmhdfsVboze68As5-hRLnHj8qMs8iQ0xsSObBLHAAnKFrFuVFvyzuUfVGykiFEIWasoSoC1sm0C4iOpIcuRAmn-e0J56pzi84sciNs8TrX1JGC7K8R1isFo3FVIcR1X776fUiFUZFXpTcIqmzq-VBOh3g3cuR0ThZZ4 Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: d8f24f96dcc14e20b72d9937d66e850e Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1707705517 Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d8f24f96dcc14e20b72d9937d66e850e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d8f24f96dcc14e20b72d9937d66e850e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8f24f96dcc14e20b72d9937d66e850e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8f24f96dcc14e20b72d9937d66e850e"}]}] Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-InstanceActionsV221TestJSON-1707705517 Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: d8f24f96dcc14e20b72d9937d66e850e Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1707705517 Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-InstanceActionsV221TestJSON-1707705517-project Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d229b3160d124151bf266f50b96b153c Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-InstanceActionsV221TestJSON-1707705517-project Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ea069e25-cf9d-4bc9-a6f3-009a424ab562'} Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.539417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:22.544552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.544552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.544552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:22.544552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:22.544552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:22.544552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:22.544552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. Oct 11 19:52:22.544552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.544552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] Returning 404 to user: Instance ea069e25-cf9d-4bc9-a6f3-009a424ab562 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:22.546087 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d49a6b74-7029-4137-8f92-85d885e828ec tempest-InstanceActionsV221TestJSON-1707705517 tempest-InstanceActionsV221TestJSON-1707705517-project] 10.222.0.27 "GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562" status: 404 len: 111 microversion: 2.21 time: 0.044046 Oct 11 19:52:22.546809 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1211/2463] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:22 2022] GET /compute/v2.1/servers/ea069e25-cf9d-4bc9-a6f3-009a424ab562 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:52:22.551767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21b9a9cb-22ad-4a53-b4c8-97ac021c2bac tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1568185347"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:22.554225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-21b9a9cb-22ad-4a53-b4c8-97ac021c2bac tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 19:52:22.554887 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-21b9a9cb-22ad-4a53-b4c8-97ac021c2bac tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21b9a9cb-22ad-4a53-b4c8-97ac021c2bac tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Request method failure captured: Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 57 Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclRk9QP7yghTFWXYnkebC0vIJw6ClBpw_8_gCdIg3CSWTFZmKx4q471fMMGsJNzx3Y1jygA9DLoMeaODUxZava3H2RF5i6a9_BFC_j3p7NJIQN5Pgz4AbfZKmDeSido62a-GdbB-I0K53iOGEkIVKvcB29G98dK-KZDhtlK-TuhTPU Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3d6079311d94932a20980893d2383e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3d6079311d94932a20980893d2383e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}] Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: faf3736eab7b46dfa7d5fe0d4161cb62 Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: {"createImage": {"name": "tempest-test-snap-1568185347"}} Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1568185347'}}} Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 19:52:22.556575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21b9a9cb-22ad-4a53-b4c8-97ac021c2bac tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:22.562288 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21b9a9cb-22ad-4a53-b4c8-97ac021c2bac tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011880 Oct 11 19:52:22.563738 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1212/2464] 10.222.0.27 () {60 vars in 1275 bytes} [Tue Oct 11 19:52:22 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:22.568594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e632951-1b40-439e-a028-590810a1854e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:22.569617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7e632951-1b40-439e-a028-590810a1854e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 82d89574-9fa1-4698-a809-cdcbffb59ed6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:22.576888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e632951-1b40-439e-a028-590810a1854e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:22.577549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e632951-1b40-439e-a028-590810a1854e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:22.578109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e632951-1b40-439e-a028-590810a1854e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:22.578984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e632951-1b40-439e-a028-590810a1854e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:22.579555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e632951-1b40-439e-a028-590810a1854e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:22.580242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e632951-1b40-439e-a028-590810a1854e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:23.454598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-18fe6cc4-4a18-4991-8bfb-5553cf5620cb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:23.464280 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-18fe6cc4-4a18-4991-8bfb-5553cf5620cb tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1318 microversion: 2.1 time: 1.034093 Oct 11 19:52:23.464773 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1253/2465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:22 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1318 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:23.469595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7f621e8-7ecc-4b5d-b6f0-deb76560a48a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1527359258"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:23.472020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c7f621e8-7ecc-4b5d-b6f0-deb76560a48a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 19:52:23.472699 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c7f621e8-7ecc-4b5d-b6f0-deb76560a48a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7f621e8-7ecc-4b5d-b6f0-deb76560a48a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Request method failure captured: Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 57 Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclRk9QP7yghTFWXYnkebC0vIJw6ClBpw_8_gCdIg3CSWTFZmKx4q471fMMGsJNzx3Y1jygA9DLoMeaODUxZava3H2RF5i6a9_BFC_j3p7NJIQN5Pgz4AbfZKmDeSido62a-GdbB-I0K53iOGEkIVKvcB29G98dK-KZDhtlK-TuhTPU Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3d6079311d94932a20980893d2383e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3d6079311d94932a20980893d2383e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}] Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: faf3736eab7b46dfa7d5fe0d4161cb62 Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: {"createImage": {"name": "tempest-test-snap-1527359258"}} Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1527359258'}}} Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 19:52:23.474339 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:23.478370 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:23.478370 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:23.478370 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:23.478370 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:23.478370 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:23.478370 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:23.478370 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:23.478370 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 19:52:23.478370 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:23.479515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7f621e8-7ecc-4b5d-b6f0-deb76560a48a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:23.483589 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c7f621e8-7ecc-4b5d-b6f0-deb76560a48a tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.017593 Oct 11 19:52:23.484334 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1254/2466] 10.222.0.27 () {60 vars in 1281 bytes} [Tue Oct 11 19:52:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:23.492242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3bff2ed6-a04d-4e37-b155-4ce25370ec13 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:23.494337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3bff2ed6-a04d-4e37-b155-4ce25370ec13 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:23.501603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3bff2ed6-a04d-4e37-b155-4ce25370ec13 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:23.502254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3bff2ed6-a04d-4e37-b155-4ce25370ec13 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:23.502972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3bff2ed6-a04d-4e37-b155-4ce25370ec13 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:23.504169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3bff2ed6-a04d-4e37-b155-4ce25370ec13 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:23.505079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3bff2ed6-a04d-4e37-b155-4ce25370ec13 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:23.506257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3bff2ed6-a04d-4e37-b155-4ce25370ec13 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:23.565581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7e632951-1b40-439e-a028-590810a1854e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:23.577095 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e632951-1b40-439e-a028-590810a1854e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6" status: 200 len: 1508 microversion: 2.1 time: 1.012027 Oct 11 19:52:23.595745 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1213/2467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:22 2022] GET /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6 => generated 1508 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:23.604419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-af6b65dc-ee54-4ce4-adca-345b28462400 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:23.605156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-af6b65dc-ee54-4ce4-adca-345b28462400 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:23.611632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af6b65dc-ee54-4ce4-adca-345b28462400 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:23.612504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af6b65dc-ee54-4ce4-adca-345b28462400 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:23.613193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af6b65dc-ee54-4ce4-adca-345b28462400 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:23.614072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af6b65dc-ee54-4ce4-adca-345b28462400 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:23.614757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af6b65dc-ee54-4ce4-adca-345b28462400 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:23.615335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af6b65dc-ee54-4ce4-adca-345b28462400 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:24.221568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3bff2ed6-a04d-4e37-b155-4ce25370ec13 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:24.234425 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3bff2ed6-a04d-4e37-b155-4ce25370ec13 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1709 microversion: 2.1 time: 0.749046 Oct 11 19:52:24.247376 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1255/2468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:23 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1709 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:24.257905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:24.259231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:24.271713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:24.272565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:24.273164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:24.274623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:24.275241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:24.275827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:24.425044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-af6b65dc-ee54-4ce4-adca-345b28462400 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:24.436512 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-af6b65dc-ee54-4ce4-adca-345b28462400 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1322 microversion: 2.1 time: 0.838796 Oct 11 19:52:24.440786 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1214/2469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:23 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1322 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:24.449762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:24.450557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:24.452199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:24.459194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:24.460007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:24.460868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:24.461969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:24.462737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:24.463405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:24.469636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:24.471940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:24.483222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-64ce7c88-6e89-465f-a136-c7e7a404697a tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.234422 Oct 11 19:52:24.487202 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1256/2470] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:24 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:24.500996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13927d2c-9781-4803-919e-75f5d9230b30 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:24.501851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-13927d2c-9781-4803-919e-75f5d9230b30 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:24.502171 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] HTTP exception thrown: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Request method failure captured: Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 HTTP/1.1 Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclRk9QP7yghTFWXYnkebC0vIJw6ClBpw_8_gCdIg3CSWTFZmKx4q471fMMGsJNzx3Y1jygA9DLoMeaODUxZava3H2RF5i6a9_BFC_j3p7NJIQN5Pgz4AbfZKmDeSido62a-GdbB-I0K53iOGEkIVKvcB29G98dK-KZDhtlK-TuhTPU Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3d6079311d94932a20980893d2383e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3d6079311d94932a20980893d2383e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}] Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: faf3736eab7b46dfa7d5fe0d4161cb62 Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'eb8d83ef-de75-4359-bb6d-87d0268d2754'} Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:24.503755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Returning 404 to user: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-556524c3-d963-4987-8d2e-f669ed4eb40b tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 404 len: 111 microversion: 2.1 time: 0.063249 Oct 11 19:52:24.507242 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1215/2471] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:24 2022] DELETE /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:24.516296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13927d2c-9781-4803-919e-75f5d9230b30 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:24.520365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-16801928-d187-4395-b596-fa95752c7598 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:24.521184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-16801928-d187-4395-b596-fa95752c7598 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 0a308e18-5663-4908-bb68-88beb2a586a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:24.521446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13927d2c-9781-4803-919e-75f5d9230b30 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:24.522166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13927d2c-9781-4803-919e-75f5d9230b30 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:24.523174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13927d2c-9781-4803-919e-75f5d9230b30 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:24.523951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13927d2c-9781-4803-919e-75f5d9230b30 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:24.524678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13927d2c-9781-4803-919e-75f5d9230b30 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:24.539081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16801928-d187-4395-b596-fa95752c7598 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:24.540112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16801928-d187-4395-b596-fa95752c7598 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:24.540544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16801928-d187-4395-b596-fa95752c7598 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:24.541245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16801928-d187-4395-b596-fa95752c7598 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:24.541696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16801928-d187-4395-b596-fa95752c7598 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:24.542116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16801928-d187-4395-b596-fa95752c7598 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:24.777227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:24.806546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=12 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:24.922866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=22 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:25.040776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-16801928-d187-4395-b596-fa95752c7598 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:25.049445 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-16801928-d187-4395-b596-fa95752c7598 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/0a308e18-5663-4908-bb68-88beb2a586a8" status: 200 len: 1320 microversion: 2.1 time: 0.542341 Oct 11 19:52:25.050116 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1216/2472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:24 2022] GET /compute/v2.1/servers/0a308e18-5663-4908-bb68-88beb2a586a8 => generated 1320 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:25.061707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-2b3b4807-378e-4f34-a518-8d440ac72547 req-4e8304c1-417d-47e3-8f86-2de9a12e14f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25cf673d-5755-4959-8872-2f42951c8ed6", "tag": "c20023fb-4c4f-4ca5-a9b8-4c931246863b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:25.067605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:25.080392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13927d2c-9781-4803-919e-75f5d9230b30 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:25.084104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2b3b4807-378e-4f34-a518-8d440ac72547 req-4e8304c1-417d-47e3-8f86-2de9a12e14f3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:25.084783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2b3b4807-378e-4f34-a518-8d440ac72547 req-4e8304c1-417d-47e3-8f86-2de9a12e14f3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:25.085323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2b3b4807-378e-4f34-a518-8d440ac72547 req-4e8304c1-417d-47e3-8f86-2de9a12e14f3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:25.097002 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13927d2c-9781-4803-919e-75f5d9230b30 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1325 microversion: 2.1 time: 0.608471 Oct 11 19:52:25.099208 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1257/2473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:24 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1325 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:25.100157 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2b3b4807-378e-4f34-a518-8d440ac72547 req-4e8304c1-417d-47e3-8f86-2de9a12e14f3 service nova] Creating event network-changed:c20023fb-4c4f-4ca5-a9b8-4c931246863b for instance 25cf673d-5755-4959-8872-2f42951c8ed6 on n-h2-860864-3 Oct 11 19:52:25.110426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-574cede9-ab64-49a5-883a-9aa778f4868d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:25.111489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-574cede9-ab64-49a5-883a-9aa778f4868d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:25.113553 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-2b3b4807-378e-4f34-a518-8d440ac72547 req-4e8304c1-417d-47e3-8f86-2de9a12e14f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062023 Oct 11 19:52:25.115130 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1217/2474] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:25.124420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:25.128368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] [instance: eb8d83ef-de75-4359-bb6d-87d0268d2754] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:25.136624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-574cede9-ab64-49a5-883a-9aa778f4868d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:25.140055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-574cede9-ab64-49a5-883a-9aa778f4868d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:25.140891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-574cede9-ab64-49a5-883a-9aa778f4868d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:25.144165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-574cede9-ab64-49a5-883a-9aa778f4868d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:25.145019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-574cede9-ab64-49a5-883a-9aa778f4868d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:25.146371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-574cede9-ab64-49a5-883a-9aa778f4868d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:25.150773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:25.154058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:25.154880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:25.159711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:25.160632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:25.161376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:25.197505 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] HTTP exception thrown: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Request method failure captured: Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 HTTP/1.1 Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclRk9QP7yghTFWXYnkebC0vIJw6ClBpw_8_gCdIg3CSWTFZmKx4q471fMMGsJNzx3Y1jygA9DLoMeaODUxZava3H2RF5i6a9_BFC_j3p7NJIQN5Pgz4AbfZKmDeSido62a-GdbB-I0K53iOGEkIVKvcB29G98dK-KZDhtlK-TuhTPU Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3d6079311d94932a20980893d2383e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3d6079311d94932a20980893d2383e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3d6079311d94932a20980893d2383e8"}]}] Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a3d6079311d94932a20980893d2383e8 Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2064017390 Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: faf3736eab7b46dfa7d5fe0d4161cb62 Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesNegativeTestJSON-2064017390-project Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'eb8d83ef-de75-4359-bb6d-87d0268d2754'} Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:25.202727 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:25.206739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:25.206739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:25.206739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:25.206739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:25.206739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:25.206739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. Oct 11 19:52:25.206739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:25.208111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] Returning 404 to user: Instance eb8d83ef-de75-4359-bb6d-87d0268d2754 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:25.209168 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-696cddc4-99b4-4c03-a158-8f6696c34852 tempest-ImagesNegativeTestJSON-2064017390 tempest-ImagesNegativeTestJSON-2064017390-project] 10.222.0.27 "GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754" status: 404 len: 111 microversion: 2.1 time: 0.090455 Oct 11 19:52:25.215019 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1218/2475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:25 2022] GET /compute/v2.1/servers/eb8d83ef-de75-4359-bb6d-87d0268d2754 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:25.261885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4ba0e112-59d4-40f5-b513-f3ba7bba98dd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:25.262501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ba0e112-59d4-40f5-b513-f3ba7bba98dd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:25.281475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ba0e112-59d4-40f5-b513-f3ba7bba98dd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:25.282129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ba0e112-59d4-40f5-b513-f3ba7bba98dd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:25.282721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ba0e112-59d4-40f5-b513-f3ba7bba98dd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:25.283601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ba0e112-59d4-40f5-b513-f3ba7bba98dd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:25.284380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ba0e112-59d4-40f5-b513-f3ba7bba98dd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:25.285031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ba0e112-59d4-40f5-b513-f3ba7bba98dd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:26.073228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-574cede9-ab64-49a5-883a-9aa778f4868d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:26.084650 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-574cede9-ab64-49a5-883a-9aa778f4868d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1318 microversion: 2.1 time: 0.980675 Oct 11 19:52:26.085234 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1258/2476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:25 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1318 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:26.091662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a8e59232-9248-4709-a745-8f9c755c3818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:26.092651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a8e59232-9248-4709-a745-8f9c755c3818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:26.102721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8e59232-9248-4709-a745-8f9c755c3818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:26.104536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8e59232-9248-4709-a745-8f9c755c3818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:26.105162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8e59232-9248-4709-a745-8f9c755c3818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:26.105888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8e59232-9248-4709-a745-8f9c755c3818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:26.106345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8e59232-9248-4709-a745-8f9c755c3818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:26.107025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8e59232-9248-4709-a745-8f9c755c3818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:26.163381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ba0e112-59d4-40f5-b513-f3ba7bba98dd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:26.172905 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4ba0e112-59d4-40f5-b513-f3ba7bba98dd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1709 microversion: 2.1 time: 0.915322 Oct 11 19:52:26.179433 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1219/2477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:25 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1709 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:26.179433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-3bf02246-bd79-4ada-a652-922f1d3a33a9 req-598d6fb5-6164-4c32-9e1d-0cdc1554cda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a308e18-5663-4908-bb68-88beb2a586a8", "name": "network-vif-plugged", "status": "completed", "tag": "72fcbc2b-58b1-4f39-b25a-3c22281ae408"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:26.190369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3bf02246-bd79-4ada-a652-922f1d3a33a9 req-598d6fb5-6164-4c32-9e1d-0cdc1554cda0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:26.190879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3bf02246-bd79-4ada-a652-922f1d3a33a9 req-598d6fb5-6164-4c32-9e1d-0cdc1554cda0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:26.191303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3bf02246-bd79-4ada-a652-922f1d3a33a9 req-598d6fb5-6164-4c32-9e1d-0cdc1554cda0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:26.203453 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-3bf02246-bd79-4ada-a652-922f1d3a33a9 req-598d6fb5-6164-4c32-9e1d-0cdc1554cda0 service nova] Creating event network-vif-plugged:72fcbc2b-58b1-4f39-b25a-3c22281ae408 for instance 0a308e18-5663-4908-bb68-88beb2a586a8 on n-h2-860864-3 Oct 11 19:52:26.208810 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-3bf02246-bd79-4ada-a652-922f1d3a33a9 req-598d6fb5-6164-4c32-9e1d-0cdc1554cda0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033170 Oct 11 19:52:26.209976 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1220/2478] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:26.216992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:26.217804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:26.224818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:26.225368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:26.226670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:26.227723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:26.228374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:26.229010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:26.419410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:26.431692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:26.433414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:26.442217 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1f16ddb4-9402-4be5-a7fc-43b159bab868 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.230770 Oct 11 19:52:26.443014 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1221/2479] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:26 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:26.449232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe843e86-cc39-442d-a3ca-6da674c56e26 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:26.450185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fe843e86-cc39-442d-a3ca-6da674c56e26 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 0a308e18-5663-4908-bb68-88beb2a586a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:26.457894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe843e86-cc39-442d-a3ca-6da674c56e26 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:26.458783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe843e86-cc39-442d-a3ca-6da674c56e26 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:26.459497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe843e86-cc39-442d-a3ca-6da674c56e26 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:26.460428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe843e86-cc39-442d-a3ca-6da674c56e26 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:26.461107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe843e86-cc39-442d-a3ca-6da674c56e26 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:26.461845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe843e86-cc39-442d-a3ca-6da674c56e26 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:26.721774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a8e59232-9248-4709-a745-8f9c755c3818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:26.741064 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a8e59232-9248-4709-a745-8f9c755c3818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1322 microversion: 2.1 time: 0.654560 Oct 11 19:52:26.741656 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1259/2480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:26 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:26.749090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9560fa1d-08a4-4c74-87e6-9082ca8272e0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:26.750415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9560fa1d-08a4-4c74-87e6-9082ca8272e0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:26.757709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9560fa1d-08a4-4c74-87e6-9082ca8272e0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:26.758447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9560fa1d-08a4-4c74-87e6-9082ca8272e0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:26.758913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9560fa1d-08a4-4c74-87e6-9082ca8272e0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:26.759995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9560fa1d-08a4-4c74-87e6-9082ca8272e0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:26.760465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9560fa1d-08a4-4c74-87e6-9082ca8272e0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:26.760896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9560fa1d-08a4-4c74-87e6-9082ca8272e0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:26.946918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:27.100004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fe843e86-cc39-442d-a3ca-6da674c56e26 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:27.112198 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fe843e86-cc39-442d-a3ca-6da674c56e26 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/0a308e18-5663-4908-bb68-88beb2a586a8" status: 200 len: 1320 microversion: 2.1 time: 0.667573 Oct 11 19:52:27.116943 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1222/2481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:26 2022] GET /compute/v2.1/servers/0a308e18-5663-4908-bb68-88beb2a586a8 => generated 1320 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:27.123289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-250fca69-b15c-4c28-94bc-649cb596b456 req-95080511-b69e-433e-bcfb-cbe6a9baffdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc7c3f0-fdf4-425e-97c9-534e4f3144a3", "tag": "16be72e7-e842-4ef5-9aa9-2df41883dbfe"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:27.138056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-250fca69-b15c-4c28-94bc-649cb596b456 req-95080511-b69e-433e-bcfb-cbe6a9baffdb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:27.139730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-250fca69-b15c-4c28-94bc-649cb596b456 req-95080511-b69e-433e-bcfb-cbe6a9baffdb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:27.140792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-250fca69-b15c-4c28-94bc-649cb596b456 req-95080511-b69e-433e-bcfb-cbe6a9baffdb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:27.165598 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-250fca69-b15c-4c28-94bc-649cb596b456 req-95080511-b69e-433e-bcfb-cbe6a9baffdb service nova] Creating event network-changed:16be72e7-e842-4ef5-9aa9-2df41883dbfe for instance efc7c3f0-fdf4-425e-97c9-534e4f3144a3 on n-h2-860864-3 Oct 11 19:52:27.172914 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-250fca69-b15c-4c28-94bc-649cb596b456 req-95080511-b69e-433e-bcfb-cbe6a9baffdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052859 Oct 11 19:52:27.173740 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1223/2482] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:27.182651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05f0aa4a-3461-4a70-a392-b20a9a9721de tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:27.184325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05f0aa4a-3461-4a70-a392-b20a9a9721de tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:27.194741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f0aa4a-3461-4a70-a392-b20a9a9721de tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:27.195441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f0aa4a-3461-4a70-a392-b20a9a9721de tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:27.196476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f0aa4a-3461-4a70-a392-b20a9a9721de tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:27.197364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f0aa4a-3461-4a70-a392-b20a9a9721de tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:27.200567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f0aa4a-3461-4a70-a392-b20a9a9721de tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:27.201242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05f0aa4a-3461-4a70-a392-b20a9a9721de tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:27.370819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9560fa1d-08a4-4c74-87e6-9082ca8272e0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:27.390156 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9560fa1d-08a4-4c74-87e6-9082ca8272e0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1325 microversion: 2.1 time: 0.646962 Oct 11 19:52:27.392410 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1260/2483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:26 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1325 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:27.417289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b5577265-874a-4c6e-8874-0300b197bde9 req-d71924f4-5295-4298-87c7-cc1d73d85f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc35c0a-199d-4075-bad2-7daffd9a2e1d", "tag": "bea0ec61-84f0-4611-9fb2-ac9b2df50352"}, {"name": "network-changed", "server_uuid": "d4683095-d0c3-42c7-aa5c-203a404a7143", "tag": "764e7ae6-76cc-4855-9f84-b0207300f25f"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:27.434301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b5577265-874a-4c6e-8874-0300b197bde9 req-d71924f4-5295-4298-87c7-cc1d73d85f21 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:27.435354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b5577265-874a-4c6e-8874-0300b197bde9 req-d71924f4-5295-4298-87c7-cc1d73d85f21 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:27.436104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b5577265-874a-4c6e-8874-0300b197bde9 req-d71924f4-5295-4298-87c7-cc1d73d85f21 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:27.460570 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b5577265-874a-4c6e-8874-0300b197bde9 req-d71924f4-5295-4298-87c7-cc1d73d85f21 service nova] Creating event network-changed:bea0ec61-84f0-4611-9fb2-ac9b2df50352 for instance 4cc35c0a-199d-4075-bad2-7daffd9a2e1d on n-h1-860864-3 Oct 11 19:52:27.461567 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b5577265-874a-4c6e-8874-0300b197bde9 req-d71924f4-5295-4298-87c7-cc1d73d85f21 service nova] Creating event network-changed:764e7ae6-76cc-4855-9f84-b0207300f25f for instance d4683095-d0c3-42c7-aa5c-203a404a7143 on n-h1-860864-3 Oct 11 19:52:27.474264 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b5577265-874a-4c6e-8874-0300b197bde9 req-d71924f4-5295-4298-87c7-cc1d73d85f21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.078572 Oct 11 19:52:27.475126 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1261/2484] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:27.487704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1379b7d7-c20c-4922-9441-baa3f3985602 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:27.487874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1379b7d7-c20c-4922-9441-baa3f3985602 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:27.501076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1379b7d7-c20c-4922-9441-baa3f3985602 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:27.501737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1379b7d7-c20c-4922-9441-baa3f3985602 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:27.510331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1379b7d7-c20c-4922-9441-baa3f3985602 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:27.512806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1379b7d7-c20c-4922-9441-baa3f3985602 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:27.513692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1379b7d7-c20c-4922-9441-baa3f3985602 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:27.514396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1379b7d7-c20c-4922-9441-baa3f3985602 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:27.684851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-05f0aa4a-3461-4a70-a392-b20a9a9721de tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:27.698239 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05f0aa4a-3461-4a70-a392-b20a9a9721de tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1318 microversion: 2.1 time: 0.522465 Oct 11 19:52:27.699513 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1224/2485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:27 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:27.706662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:27.707475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:27.723512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:27.725178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:27.726320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:27.727382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:27.728714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:27.729383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:28.014218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:28.033257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:28.042236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:28.065235 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6a0706aa-03ab-4be8-addf-aedfdf3ddbd7 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.363260 Oct 11 19:52:28.075584 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1225/2486] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:27 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:28.099639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ce32e8cf-6dc2-4e17-848a-f08a3d3f946c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:28.101200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ce32e8cf-6dc2-4e17-848a-f08a3d3f946c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:28.121990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce32e8cf-6dc2-4e17-848a-f08a3d3f946c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:28.126173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce32e8cf-6dc2-4e17-848a-f08a3d3f946c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:28.128647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce32e8cf-6dc2-4e17-848a-f08a3d3f946c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:28.129791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce32e8cf-6dc2-4e17-848a-f08a3d3f946c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:28.131145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce32e8cf-6dc2-4e17-848a-f08a3d3f946c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:28.134591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce32e8cf-6dc2-4e17-848a-f08a3d3f946c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:28.653134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1379b7d7-c20c-4922-9441-baa3f3985602 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:28.673777 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1379b7d7-c20c-4922-9441-baa3f3985602 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1713 microversion: 2.1 time: 1.193151 Oct 11 19:52:28.676233 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1262/2487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:27 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1713 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:28.700846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5fe9a70c-d02f-4a4f-9a8f-a004be093697 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:28.701863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5fe9a70c-d02f-4a4f-9a8f-a004be093697 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 0a308e18-5663-4908-bb68-88beb2a586a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:28.709566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fe9a70c-d02f-4a4f-9a8f-a004be093697 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:28.710589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fe9a70c-d02f-4a4f-9a8f-a004be093697 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:28.711888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fe9a70c-d02f-4a4f-9a8f-a004be093697 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:28.713096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fe9a70c-d02f-4a4f-9a8f-a004be093697 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:28.714254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fe9a70c-d02f-4a4f-9a8f-a004be093697 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:28.715079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fe9a70c-d02f-4a4f-9a8f-a004be093697 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:29.262816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce32e8cf-6dc2-4e17-848a-f08a3d3f946c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:29.270685 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ce32e8cf-6dc2-4e17-848a-f08a3d3f946c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1322 microversion: 2.1 time: 1.193539 Oct 11 19:52:29.270973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5fe9a70c-d02f-4a4f-9a8f-a004be093697 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:29.274874 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1226/2488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:28 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1322 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:29.279630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-96233d3d-fa9e-4b25-a358-8e9ec932d0d9 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:29.280458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-96233d3d-fa9e-4b25-a358-8e9ec932d0d9 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:29.303021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96233d3d-fa9e-4b25-a358-8e9ec932d0d9 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:29.303685 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5fe9a70c-d02f-4a4f-9a8f-a004be093697 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/0a308e18-5663-4908-bb68-88beb2a586a8" status: 200 len: 1507 microversion: 2.1 time: 0.617914 Oct 11 19:52:29.303823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96233d3d-fa9e-4b25-a358-8e9ec932d0d9 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:29.304328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96233d3d-fa9e-4b25-a358-8e9ec932d0d9 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:29.305639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96233d3d-fa9e-4b25-a358-8e9ec932d0d9 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:29.311264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96233d3d-fa9e-4b25-a358-8e9ec932d0d9 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:29.311969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96233d3d-fa9e-4b25-a358-8e9ec932d0d9 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:29.324641 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1263/2489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:28 2022] GET /compute/v2.1/servers/0a308e18-5663-4908-bb68-88beb2a586a8 => generated 1507 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:29.327959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0a25efc-a9b5-47eb-920d-a16342334015 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:29.328845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a0a25efc-a9b5-47eb-920d-a16342334015 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:29.337047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0a25efc-a9b5-47eb-920d-a16342334015 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:29.337815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0a25efc-a9b5-47eb-920d-a16342334015 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:29.338478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0a25efc-a9b5-47eb-920d-a16342334015 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:29.339447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0a25efc-a9b5-47eb-920d-a16342334015 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:29.340206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0a25efc-a9b5-47eb-920d-a16342334015 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:29.340861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0a25efc-a9b5-47eb-920d-a16342334015 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:29.818041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a0a25efc-a9b5-47eb-920d-a16342334015 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:29.822641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96233d3d-fa9e-4b25-a358-8e9ec932d0d9 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:29.829498 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a0a25efc-a9b5-47eb-920d-a16342334015 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1318 microversion: 2.1 time: 0.505419 Oct 11 19:52:29.834938 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-96233d3d-fa9e-4b25-a358-8e9ec932d0d9 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1325 microversion: 2.1 time: 0.558845 Oct 11 19:52:29.836042 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1227/2490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:29 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1325 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:29.842152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:29.843329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:29.848257 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1264/2491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:29 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:29.853850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:29.854584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:29.855152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:29.856038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:29.856836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:29.857390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:29.869825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-cbce6c39-31c5-499e-9577-a8cdc65ca522 req-ad854812-d432-4700-a422-90d6ae99080d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768", "tag": "031b5fb2-9390-4322-88f9-961fd24d7144"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:29.904569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cbce6c39-31c5-499e-9577-a8cdc65ca522 req-ad854812-d432-4700-a422-90d6ae99080d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:29.907228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cbce6c39-31c5-499e-9577-a8cdc65ca522 req-ad854812-d432-4700-a422-90d6ae99080d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:29.907885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cbce6c39-31c5-499e-9577-a8cdc65ca522 req-ad854812-d432-4700-a422-90d6ae99080d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:29.954832 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-cbce6c39-31c5-499e-9577-a8cdc65ca522 req-ad854812-d432-4700-a422-90d6ae99080d service nova] Creating event network-changed:031b5fb2-9390-4322-88f9-961fd24d7144 for instance e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 on n-h1-860864-3 Oct 11 19:52:29.965060 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-cbce6c39-31c5-499e-9577-a8cdc65ca522 req-ad854812-d432-4700-a422-90d6ae99080d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115614 Oct 11 19:52:29.966693 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1265/2492] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:29.978918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2addf4f4-45e7-4ac1-9a69-3b2638db4ead tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:29.979768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2addf4f4-45e7-4ac1-9a69-3b2638db4ead tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 0a308e18-5663-4908-bb68-88beb2a586a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:29.988351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2addf4f4-45e7-4ac1-9a69-3b2638db4ead tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:29.991139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2addf4f4-45e7-4ac1-9a69-3b2638db4ead tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:29.994113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2addf4f4-45e7-4ac1-9a69-3b2638db4ead tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:29.995116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2addf4f4-45e7-4ac1-9a69-3b2638db4ead tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:29.995747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2addf4f4-45e7-4ac1-9a69-3b2638db4ead tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:29.997579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2addf4f4-45e7-4ac1-9a69-3b2638db4ead tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:30.063759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2addf4f4-45e7-4ac1-9a69-3b2638db4ead tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 0a308e18-5663-4908-bb68-88beb2a586a8] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:30.106834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:30.120816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:30.122673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:30.147000 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-185ebf16-b9c6-4fdf-ab7a-cffc447f948c tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.308227 Oct 11 19:52:30.149824 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1228/2493] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:29 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:30.239368 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2addf4f4-45e7-4ac1-9a69-3b2638db4ead tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0a308e18-5663-4908-bb68-88beb2a586a8" status: 204 len: 0 microversion: 2.1 time: 0.269481 Oct 11 19:52:30.240599 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1266/2494] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:29 2022] DELETE /compute/v2.1/servers/0a308e18-5663-4908-bb68-88beb2a586a8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:30.249345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cab02cec-55d6-4c4d-9479-b6d444566f21 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:30.250016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cab02cec-55d6-4c4d-9479-b6d444566f21 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 82d89574-9fa1-4698-a809-cdcbffb59ed6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:30.280980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cab02cec-55d6-4c4d-9479-b6d444566f21 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:30.283233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cab02cec-55d6-4c4d-9479-b6d444566f21 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:30.283698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cab02cec-55d6-4c4d-9479-b6d444566f21 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:30.284457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cab02cec-55d6-4c4d-9479-b6d444566f21 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:30.284927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cab02cec-55d6-4c4d-9479-b6d444566f21 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:30.285363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cab02cec-55d6-4c4d-9479-b6d444566f21 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:30.296534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a4031cba-bd6d-4dce-bbfc-f42956681c7d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:30.298227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a4031cba-bd6d-4dce-bbfc-f42956681c7d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:30.313343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4031cba-bd6d-4dce-bbfc-f42956681c7d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:30.322087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4031cba-bd6d-4dce-bbfc-f42956681c7d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:30.322995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4031cba-bd6d-4dce-bbfc-f42956681c7d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:30.327365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4031cba-bd6d-4dce-bbfc-f42956681c7d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:30.328529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4031cba-bd6d-4dce-bbfc-f42956681c7d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:30.329184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4031cba-bd6d-4dce-bbfc-f42956681c7d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:30.346573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:30.375804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cab02cec-55d6-4c4d-9479-b6d444566f21 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: 82d89574-9fa1-4698-a809-cdcbffb59ed6] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:30.567435 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cab02cec-55d6-4c4d-9479-b6d444566f21 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6" status: 204 len: 0 microversion: 2.1 time: 0.318749 Oct 11 19:52:30.568387 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1229/2495] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:30 2022] DELETE /compute/v2.1/servers/82d89574-9fa1-4698-a809-cdcbffb59ed6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:30.607598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4031cba-bd6d-4dce-bbfc-f42956681c7d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:30.617141 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a4031cba-bd6d-4dce-bbfc-f42956681c7d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1322 microversion: 2.1 time: 0.325053 Oct 11 19:52:30.626558 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1267/2496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:30 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:30.733293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1522132782", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "1e236917-8566-45a0-b790-793f3a02168f"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:30.796658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] validate_networks() for [('1e236917-8566-45a0-b790-793f3a02168f', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:52:30.856824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-803a238d-299c-443a-a189-bbf346435d50 req-e742b24a-0e60-43d3-b588-16f30e886b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc35c0a-199d-4075-bad2-7daffd9a2e1d", "name": "network-vif-plugged", "status": "completed", "tag": "bea0ec61-84f0-4611-9fb2-ac9b2df50352"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:30.875904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-803a238d-299c-443a-a189-bbf346435d50 req-e742b24a-0e60-43d3-b588-16f30e886b33 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:30.876436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-803a238d-299c-443a-a189-bbf346435d50 req-e742b24a-0e60-43d3-b588-16f30e886b33 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:30.877760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-803a238d-299c-443a-a189-bbf346435d50 req-e742b24a-0e60-43d3-b588-16f30e886b33 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:30.904846 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-803a238d-299c-443a-a189-bbf346435d50 req-e742b24a-0e60-43d3-b588-16f30e886b33 service nova] Creating event network-vif-plugged:bea0ec61-84f0-4611-9fb2-ac9b2df50352 for instance 4cc35c0a-199d-4075-bad2-7daffd9a2e1d on n-h1-860864-3 Oct 11 19:52:30.916967 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-803a238d-299c-443a-a189-bbf346435d50 req-e742b24a-0e60-43d3-b588-16f30e886b33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066722 Oct 11 19:52:30.920315 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1268/2497] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:30.929643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-df7060da-7a76-4e0a-980a-2ca6f127bb43 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:30.931648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-df7060da-7a76-4e0a-980a-2ca6f127bb43 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:30.949476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df7060da-7a76-4e0a-980a-2ca6f127bb43 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:30.950222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df7060da-7a76-4e0a-980a-2ca6f127bb43 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:30.950854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df7060da-7a76-4e0a-980a-2ca6f127bb43 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:30.952808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df7060da-7a76-4e0a-980a-2ca6f127bb43 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:30.956069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df7060da-7a76-4e0a-980a-2ca6f127bb43 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:30.956694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df7060da-7a76-4e0a-980a-2ca6f127bb43 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:31.715915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-df7060da-7a76-4e0a-980a-2ca6f127bb43 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:31.727655 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-df7060da-7a76-4e0a-980a-2ca6f127bb43 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1325 microversion: 2.1 time: 0.805872 Oct 11 19:52:31.744469 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1269/2498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:30 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1325 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:31.759492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-541c588a-daf9-4524-b185-e7f7b5fe2586 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:31.760557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-541c588a-daf9-4524-b185-e7f7b5fe2586 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:31.769406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-541c588a-daf9-4524-b185-e7f7b5fe2586 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:31.770082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-541c588a-daf9-4524-b185-e7f7b5fe2586 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:31.770957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-541c588a-daf9-4524-b185-e7f7b5fe2586 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:31.772807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-541c588a-daf9-4524-b185-e7f7b5fe2586 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:31.773570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-541c588a-daf9-4524-b185-e7f7b5fe2586 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:31.774979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-541c588a-daf9-4524-b185-e7f7b5fe2586 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:31.793449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:31.794030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:31.794454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:31.794872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:31.795276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:31.813480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:31.814264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:31.814880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:31.815789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:31.816504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:31.817086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:31.860703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Getting quotas for project bf853b49896343b7852bb83640b7ef73. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:52:31.866431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Getting quotas for user 6fc438ee89be4ecca0895c161377c9c3 and project bf853b49896343b7852bb83640b7ef73. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:52:31.881179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Going to run 2 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:52:31.883944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: fead6667-c8f7-4c5d-a46b-150040f0e863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:31.928137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=fead6667-c8f7-4c5d-a46b-150040f0e863,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:31.990442 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cc2cc7c3-595d-464a-9ba9-dbb49ca55c1d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.262225 Oct 11 19:52:31.991553 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1230/2499] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 1264 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 11 19:52:31.995812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-541c588a-daf9-4524-b185-e7f7b5fe2586 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:31.997479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:31.998307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:32.008816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:32.009480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:32.010066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:32.011193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:32.011920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:32.012488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:32.036343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:32.064935 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-541c588a-daf9-4524-b185-e7f7b5fe2586 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1318 microversion: 2.1 time: 0.309551 Oct 11 19:52:32.066411 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1270/2500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:31 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:32.074953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4db32935-9566-42eb-9a89-614118b101e3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:32.075764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4db32935-9566-42eb-9a89-614118b101e3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:32.120915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4db32935-9566-42eb-9a89-614118b101e3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:32.122933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4db32935-9566-42eb-9a89-614118b101e3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:32.126198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4db32935-9566-42eb-9a89-614118b101e3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:32.131893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4db32935-9566-42eb-9a89-614118b101e3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:32.132322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4db32935-9566-42eb-9a89-614118b101e3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:32.135269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4db32935-9566-42eb-9a89-614118b101e3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:32.135997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:32.150493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:32.154337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:32.169437 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1a095d4d-3d22-41dc-bb1f-d2e433cebb92 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.176682 Oct 11 19:52:32.172914 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1231/2501] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:31 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:32.186193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:32.200449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:32.201951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Searching by: {'deleted': False, 'project_id': 'bf853b49896343b7852bb83640b7ef73'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:32.239292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:32.248364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:32.248923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:32.249808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:32.250498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:32.254798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:32.343082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:52:32.389335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4db32935-9566-42eb-9a89-614118b101e3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:32.397408 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4db32935-9566-42eb-9a89-614118b101e3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1322 microversion: 2.1 time: 0.328621 Oct 11 19:52:32.398018 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1271/2502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:32 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:32.421995 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c87ceb18-5e1b-4070-a558-be1e0251a728 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.247945 Oct 11 19:52:32.422785 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1232/2503] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 19:52:32 2022] GET /compute/v2.1/servers => generated 1337 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:32.436502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-db2765f5-e30d-431c-af5e-453849574f78 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:32.437444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-db2765f5-e30d-431c-af5e-453849574f78 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:32.540419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-db2765f5-e30d-431c-af5e-453849574f78 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:32.557698 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-db2765f5-e30d-431c-af5e-453849574f78 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1218 microversion: 2.1 time: 0.125547 Oct 11 19:52:32.561802 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1272/2504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:32 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:32.760414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ffc49403-0ea0-450e-9599-691ee4ac7b2c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:32.761222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ffc49403-0ea0-450e-9599-691ee4ac7b2c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:32.773875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc49403-0ea0-450e-9599-691ee4ac7b2c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:32.774551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc49403-0ea0-450e-9599-691ee4ac7b2c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:32.777802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc49403-0ea0-450e-9599-691ee4ac7b2c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:32.778563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc49403-0ea0-450e-9599-691ee4ac7b2c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:32.779183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc49403-0ea0-450e-9599-691ee4ac7b2c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:32.781941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc49403-0ea0-450e-9599-691ee4ac7b2c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:32.988980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4fb2c50f-7fca-463c-8cba-6354454367ed req-4515320c-1f7c-45f9-a05c-8679fce27e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25cf673d-5755-4959-8872-2f42951c8ed6", "name": "network-vif-plugged", "status": "completed", "tag": "c20023fb-4c4f-4ca5-a9b8-4c931246863b"}, {"server_uuid": "d4683095-d0c3-42c7-aa5c-203a404a7143", "name": "network-vif-plugged", "status": "completed", "tag": "764e7ae6-76cc-4855-9f84-b0207300f25f"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:33.018334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4fb2c50f-7fca-463c-8cba-6354454367ed req-4515320c-1f7c-45f9-a05c-8679fce27e7e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:33.019019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4fb2c50f-7fca-463c-8cba-6354454367ed req-4515320c-1f7c-45f9-a05c-8679fce27e7e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:33.020991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4fb2c50f-7fca-463c-8cba-6354454367ed req-4515320c-1f7c-45f9-a05c-8679fce27e7e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:33.079729 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4fb2c50f-7fca-463c-8cba-6354454367ed req-4515320c-1f7c-45f9-a05c-8679fce27e7e service nova] Creating event network-vif-plugged:c20023fb-4c4f-4ca5-a9b8-4c931246863b for instance 25cf673d-5755-4959-8872-2f42951c8ed6 on n-h2-860864-3 Oct 11 19:52:33.080252 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4fb2c50f-7fca-463c-8cba-6354454367ed req-4515320c-1f7c-45f9-a05c-8679fce27e7e service nova] Creating event network-vif-plugged:764e7ae6-76cc-4855-9f84-b0207300f25f for instance d4683095-d0c3-42c7-aa5c-203a404a7143 on n-h1-860864-3 Oct 11 19:52:33.133370 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4fb2c50f-7fca-463c-8cba-6354454367ed req-4515320c-1f7c-45f9-a05c-8679fce27e7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.151166 Oct 11 19:52:33.133996 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1273/2505] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:52:33.167068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3dd9a06e-1d6a-42c1-9284-a649f066f082 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:33.203090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3dd9a06e-1d6a-42c1-9284-a649f066f082 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:33.219613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dd9a06e-1d6a-42c1-9284-a649f066f082 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:33.224780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dd9a06e-1d6a-42c1-9284-a649f066f082 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:33.225477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dd9a06e-1d6a-42c1-9284-a649f066f082 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:33.226496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dd9a06e-1d6a-42c1-9284-a649f066f082 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:33.227599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dd9a06e-1d6a-42c1-9284-a649f066f082 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:33.230083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dd9a06e-1d6a-42c1-9284-a649f066f082 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:33.931918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ffc49403-0ea0-450e-9599-691ee4ac7b2c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:33.932658 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ffc49403-0ea0-450e-9599-691ee4ac7b2c tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1325 microversion: 2.1 time: 1.177905 Oct 11 19:52:33.940936 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1233/2506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:32 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1325 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:33.956649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:33.957767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3dd9a06e-1d6a-42c1-9284-a649f066f082 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:33.958693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:33.966339 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3dd9a06e-1d6a-42c1-9284-a649f066f082 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1318 microversion: 2.1 time: 0.820061 Oct 11 19:52:33.967020 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1274/2507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:33 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1318 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:33.979776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6036178-ecd1-42af-a56c-6fc098f7d76f tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:33.980634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b6036178-ecd1-42af-a56c-6fc098f7d76f tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:33.993650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6036178-ecd1-42af-a56c-6fc098f7d76f tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:33.997305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6036178-ecd1-42af-a56c-6fc098f7d76f tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:33.997969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6036178-ecd1-42af-a56c-6fc098f7d76f tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:33.999721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6036178-ecd1-42af-a56c-6fc098f7d76f tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:33.999844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:34.001743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:34.002359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:34.002593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6036178-ecd1-42af-a56c-6fc098f7d76f tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:34.003038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6036178-ecd1-42af-a56c-6fc098f7d76f tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:34.004576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:34.011220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:34.011914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:34.209413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:34.225813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:34.230164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:34.254164 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca134bac-d4ff-4382-9f11-c16938c447d3 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.311846 Oct 11 19:52:34.256762 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1234/2508] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:33 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:34.262318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-37e2e180-dfd8-45f6-8cca-11e55afe20e4 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:34.264225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-37e2e180-dfd8-45f6-8cca-11e55afe20e4 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:34.270557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37e2e180-dfd8-45f6-8cca-11e55afe20e4 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:34.271304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37e2e180-dfd8-45f6-8cca-11e55afe20e4 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:34.271985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37e2e180-dfd8-45f6-8cca-11e55afe20e4 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:34.272894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37e2e180-dfd8-45f6-8cca-11e55afe20e4 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:34.273566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37e2e180-dfd8-45f6-8cca-11e55afe20e4 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:34.274291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37e2e180-dfd8-45f6-8cca-11e55afe20e4 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:34.418207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-37e2e180-dfd8-45f6-8cca-11e55afe20e4 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:34.441981 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-37e2e180-dfd8-45f6-8cca-11e55afe20e4 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1214 microversion: 2.1 time: 0.183808 Oct 11 19:52:34.445950 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1235/2509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:34 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:34.557930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b6036178-ecd1-42af-a56c-6fc098f7d76f tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:34.591149 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b6036178-ecd1-42af-a56c-6fc098f7d76f tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1322 microversion: 2.1 time: 0.620148 Oct 11 19:52:34.595588 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1275/2510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:33 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:34.967468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dbfcb0ad-d70c-4d04-85a2-59ed5218372e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:34.969203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dbfcb0ad-d70c-4d04-85a2-59ed5218372e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:34.976176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:34.978659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbfcb0ad-d70c-4d04-85a2-59ed5218372e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:34.985320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbfcb0ad-d70c-4d04-85a2-59ed5218372e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:34.986020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbfcb0ad-d70c-4d04-85a2-59ed5218372e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:34.987003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbfcb0ad-d70c-4d04-85a2-59ed5218372e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:34.987616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbfcb0ad-d70c-4d04-85a2-59ed5218372e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:34.988342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbfcb0ad-d70c-4d04-85a2-59ed5218372e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:35.041414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-6f02d0e4-a23d-46c6-a4ca-dafeb7e7ec5b req-1f45c813-7c19-4bd0-81b2-0119f7c05521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d89574-9fa1-4698-a809-cdcbffb59ed6", "name": "network-vif-deleted", "tag": "10eee565-ba3b-492a-8760-dcb24a1796d4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:35.099680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6f02d0e4-a23d-46c6-a4ca-dafeb7e7ec5b req-1f45c813-7c19-4bd0-81b2-0119f7c05521 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:35.104394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6f02d0e4-a23d-46c6-a4ca-dafeb7e7ec5b req-1f45c813-7c19-4bd0-81b2-0119f7c05521 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:35.105415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6f02d0e4-a23d-46c6-a4ca-dafeb7e7ec5b req-1f45c813-7c19-4bd0-81b2-0119f7c05521 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:35.138801 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6f02d0e4-a23d-46c6-a4ca-dafeb7e7ec5b req-1f45c813-7c19-4bd0-81b2-0119f7c05521 service nova] Creating event network-vif-deleted:10eee565-ba3b-492a-8760-dcb24a1796d4 for instance 82d89574-9fa1-4698-a809-cdcbffb59ed6 on n-h2-860864-3 Oct 11 19:52:35.164073 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-6f02d0e4-a23d-46c6-a4ca-dafeb7e7ec5b req-1f45c813-7c19-4bd0-81b2-0119f7c05521 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.357395 Oct 11 19:52:35.168984 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1236/2511] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:35.181896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1dd5ccce-88bc-4fc4-8913-05a89f3006f1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:35.185958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1dd5ccce-88bc-4fc4-8913-05a89f3006f1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:35.204833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1dd5ccce-88bc-4fc4-8913-05a89f3006f1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:35.205519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1dd5ccce-88bc-4fc4-8913-05a89f3006f1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:35.206563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1dd5ccce-88bc-4fc4-8913-05a89f3006f1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:35.209741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1dd5ccce-88bc-4fc4-8913-05a89f3006f1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:35.210330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1dd5ccce-88bc-4fc4-8913-05a89f3006f1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:35.211674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1dd5ccce-88bc-4fc4-8913-05a89f3006f1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:35.710768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dbfcb0ad-d70c-4d04-85a2-59ed5218372e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:35.721067 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dbfcb0ad-d70c-4d04-85a2-59ed5218372e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1521 microversion: 2.1 time: 0.760482 Oct 11 19:52:35.722337 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1276/2512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:34 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1521 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:35.750553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1dd5ccce-88bc-4fc4-8913-05a89f3006f1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:35.776949 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1dd5ccce-88bc-4fc4-8913-05a89f3006f1 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1318 microversion: 2.1 time: 0.604934 Oct 11 19:52:35.793450 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1237/2513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:35 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:35.817503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:35.818030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:35.837649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:35.838206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:35.838790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:35.839563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:35.840014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:35.840446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:35.973141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:35.990898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:35.994115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:36.002786 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-78a80c2f-d0d1-477a-9076-64cefd7a72f5 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.206744 Oct 11 19:52:36.004531 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1238/2514] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:35 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:36.012238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ea3958b3-97f5-4730-95bb-c5bb2d00749a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:36.013460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ea3958b3-97f5-4730-95bb-c5bb2d00749a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:36.022878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea3958b3-97f5-4730-95bb-c5bb2d00749a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.023617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea3958b3-97f5-4730-95bb-c5bb2d00749a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.025090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea3958b3-97f5-4730-95bb-c5bb2d00749a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.026084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea3958b3-97f5-4730-95bb-c5bb2d00749a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.026768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea3958b3-97f5-4730-95bb-c5bb2d00749a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.028553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea3958b3-97f5-4730-95bb-c5bb2d00749a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.104458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-51070460-f7cb-4db9-a73f-7e0e008a566a req-1fc7f539-34b8-4cf7-bf07-3f6d103046ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a308e18-5663-4908-bb68-88beb2a586a8", "name": "network-vif-deleted", "tag": "72fcbc2b-58b1-4f39-b25a-3c22281ae408"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:36.129290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-51070460-f7cb-4db9-a73f-7e0e008a566a req-1fc7f539-34b8-4cf7-bf07-3f6d103046ef service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.130407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-51070460-f7cb-4db9-a73f-7e0e008a566a req-1fc7f539-34b8-4cf7-bf07-3f6d103046ef service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.134019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-51070460-f7cb-4db9-a73f-7e0e008a566a req-1fc7f539-34b8-4cf7-bf07-3f6d103046ef service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.156672 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-51070460-f7cb-4db9-a73f-7e0e008a566a req-1fc7f539-34b8-4cf7-bf07-3f6d103046ef service nova] Creating event network-vif-deleted:72fcbc2b-58b1-4f39-b25a-3c22281ae408 for instance 0a308e18-5663-4908-bb68-88beb2a586a8 on n-h2-860864-3 Oct 11 19:52:36.169741 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-51070460-f7cb-4db9-a73f-7e0e008a566a req-1fc7f539-34b8-4cf7-bf07-3f6d103046ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.445981 Oct 11 19:52:36.174671 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1277/2515] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:36.187940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dab29393-27fa-410b-8a4e-fc0c27e46b46 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:36.188925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dab29393-27fa-410b-8a4e-fc0c27e46b46 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:36.203822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dab29393-27fa-410b-8a4e-fc0c27e46b46 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.205471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dab29393-27fa-410b-8a4e-fc0c27e46b46 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.207888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dab29393-27fa-410b-8a4e-fc0c27e46b46 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.214751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dab29393-27fa-410b-8a4e-fc0c27e46b46 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.217174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dab29393-27fa-410b-8a4e-fc0c27e46b46 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.219572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dab29393-27fa-410b-8a4e-fc0c27e46b46 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.272839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ea3958b3-97f5-4730-95bb-c5bb2d00749a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:36.291003 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ea3958b3-97f5-4730-95bb-c5bb2d00749a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1278 microversion: 2.1 time: 0.276935 Oct 11 19:52:36.291810 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1239/2516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:36 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:36.309079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a7ba2d5e-3339-431e-84f2-056a80ab1d82 req-30273ac3-a746-4582-ac68-c3c27d4e10d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc7c3f0-fdf4-425e-97c9-534e4f3144a3", "name": "network-vif-plugged", "status": "completed", "tag": "16be72e7-e842-4ef5-9aa9-2df41883dbfe"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:36.331783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a7ba2d5e-3339-431e-84f2-056a80ab1d82 req-30273ac3-a746-4582-ac68-c3c27d4e10d2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.332670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a7ba2d5e-3339-431e-84f2-056a80ab1d82 req-30273ac3-a746-4582-ac68-c3c27d4e10d2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.333634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a7ba2d5e-3339-431e-84f2-056a80ab1d82 req-30273ac3-a746-4582-ac68-c3c27d4e10d2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.378002 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a7ba2d5e-3339-431e-84f2-056a80ab1d82 req-30273ac3-a746-4582-ac68-c3c27d4e10d2 service nova] Creating event network-vif-plugged:16be72e7-e842-4ef5-9aa9-2df41883dbfe for instance efc7c3f0-fdf4-425e-97c9-534e4f3144a3 on n-h2-860864-3 Oct 11 19:52:36.391019 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a7ba2d5e-3339-431e-84f2-056a80ab1d82 req-30273ac3-a746-4582-ac68-c3c27d4e10d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097510 Oct 11 19:52:36.391976 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1240/2517] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:36.409063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:36.411625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:36.429694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.433177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.437750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.439161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.439750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.440607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.481162 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] HTTP exception thrown: Action 999 not found Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Request method failure captured: Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d/os-instance-actions/999 HTTP/1.1 Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcls8rnhlJiajMiOVDWwqZKx81QjSv3AjQO4JCJuI_Eqle1_g0YKHAJbMYGlRgqAkXW83Xb6f2DhjnY2fZ3ZyB8H4zIeHpTIHTaMm6iMkmrEFt2d8kQzCaycUighUQMLLHFss0vs2rbAheMCLWtJXwkoxxGt9frJxRv3bi9oxCRX91g Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a8b39062227d428186d4a665fac14fb1 Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-282653831 Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a8b39062227d428186d4a665fac14fb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a8b39062227d428186d4a665fac14fb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8b39062227d428186d4a665fac14fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8b39062227d428186d4a665fac14fb1"}]}] Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-282653831 Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a8b39062227d428186d4a665fac14fb1 Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-282653831 Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-InstanceActionsNegativeTestJSON-282653831-project Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8faada3423bb457c8b1f8f55853934de Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-282653831-project Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: exception: Action 999 not found Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'server_id': '4cc35c0a-199d-4075-bad2-7daffd9a2e1d', 'id': '999'} Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 11 19:52:36.491932 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:36.496920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Returning 404 to user: Action 999 not found {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:36.499401 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c46b5631-6242-4062-938e-7d78b7b87075 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.101727 Oct 11 19:52:36.500240 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1241/2518] 10.222.0.27 () {58 vars in 1308 bytes} [Tue Oct 11 19:52:36 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d/os-instance-actions/999 => generated 66 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:52:36.511624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8354fc83-53f1-4ba4-a5bd-80ad5a396d4a tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '.version_select at 0x7f83cc187160>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:36.513154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8354fc83-53f1-4ba4-a5bd-80ad5a396d4a tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 6ade7f7c-715a-4067-84b7-24ee069d5460] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:36.524900 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-8354fc83-53f1-4ba4-a5bd-80ad5a396d4a tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] HTTP exception thrown: Instance 6ade7f7c-715a-4067-84b7-24ee069d5460 could not be found. Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8354fc83-53f1-4ba4-a5bd-80ad5a396d4a tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Request method failure captured: Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/6ade7f7c-715a-4067-84b7-24ee069d5460/os-instance-actions HTTP/1.1 Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcls8rnhlJiajMiOVDWwqZKx81QjSv3AjQO4JCJuI_Eqle1_g0YKHAJbMYGlRgqAkXW83Xb6f2DhjnY2fZ3ZyB8H4zIeHpTIHTaMm6iMkmrEFt2d8kQzCaycUighUQMLLHFss0vs2rbAheMCLWtJXwkoxxGt9frJxRv3bi9oxCRX91g Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a8b39062227d428186d4a665fac14fb1 Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-282653831 Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a8b39062227d428186d4a665fac14fb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a8b39062227d428186d4a665fac14fb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8b39062227d428186d4a665fac14fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8b39062227d428186d4a665fac14fb1"}]}] Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-282653831 Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a8b39062227d428186d4a665fac14fb1 Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-282653831 Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-InstanceActionsNegativeTestJSON-282653831-project Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8faada3423bb457c8b1f8f55853934de Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-282653831-project Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 6ade7f7c-715a-4067-84b7-24ee069d5460 could not be found. Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'server_id': '6ade7f7c-715a-4067-84b7-24ee069d5460'} Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ade7f7c-715a-4067-84b7-24ee069d5460 could not be found. Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:36.527045 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ade7f7c-715a-4067-84b7-24ee069d5460 could not be found. Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ade7f7c-715a-4067-84b7-24ee069d5460 could not be found. Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8354fc83-53f1-4ba4-a5bd-80ad5a396d4a tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Returning 404 to user: Instance 6ade7f7c-715a-4067-84b7-24ee069d5460 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8354fc83-53f1-4ba4-a5bd-80ad5a396d4a tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/6ade7f7c-715a-4067-84b7-24ee069d5460/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024391 Oct 11 19:52:36.537064 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1242/2519] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Oct 11 19:52:36 2022] GET /compute/v2.1/servers/6ade7f7c-715a-4067-84b7-24ee069d5460/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:52:36.542112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c14c005c-3bfd-42f1-8b33-72d306aa864e tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d07633a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:36.595112 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c14c005c-3bfd-42f1-8b33-72d306aa864e tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/bf9dbab6-95f5-4fa3-9469-39fb8f7e3dac" status: 200 len: 662 microversion: 2.1 time: 0.062605 Oct 11 19:52:36.605199 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1243/2520] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:52:36 2022] GET /compute/v2.1/images/bf9dbab6-95f5-4fa3-9469-39fb8f7e3dac => generated 662 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:36.626059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1954a9d7-0557-413d-bb35-11d171919b5e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:36.627751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1954a9d7-0557-413d-bb35-11d171919b5e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:36.634874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1954a9d7-0557-413d-bb35-11d171919b5e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.636181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1954a9d7-0557-413d-bb35-11d171919b5e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.636523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dab29393-27fa-410b-8a4e-fc0c27e46b46 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:36.637183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1954a9d7-0557-413d-bb35-11d171919b5e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.638055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1954a9d7-0557-413d-bb35-11d171919b5e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.638845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1954a9d7-0557-413d-bb35-11d171919b5e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.639426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1954a9d7-0557-413d-bb35-11d171919b5e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.646028 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dab29393-27fa-410b-8a4e-fc0c27e46b46 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1322 microversion: 2.1 time: 0.469752 Oct 11 19:52:36.646710 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1278/2521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:36 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:36.653902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-930a3e52-fcc9-415f-9906-b399b8c0b818 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc328310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:36.698834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1954a9d7-0557-413d-bb35-11d171919b5e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:36.771078 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-930a3e52-fcc9-415f-9906-b399b8c0b818 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/bf9dbab6-95f5-4fa3-9469-39fb8f7e3dac" status: 200 len: 662 microversion: 2.1 time: 0.120376 Oct 11 19:52:36.772914 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1279/2522] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:52:36 2022] GET /compute/v2.1/images/bf9dbab6-95f5-4fa3-9469-39fb8f7e3dac => generated 662 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:36.811163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f45b9f7e-3cf4-430b-84c9-c115a0618388 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:36.814389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f45b9f7e-3cf4-430b-84c9-c115a0618388 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:36.828545 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1954a9d7-0557-413d-bb35-11d171919b5e tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 204 len: 0 microversion: 2.1 time: 0.225736 Oct 11 19:52:36.829985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f45b9f7e-3cf4-430b-84c9-c115a0618388 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.830772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f45b9f7e-3cf4-430b-84c9-c115a0618388 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.832613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f45b9f7e-3cf4-430b-84c9-c115a0618388 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.833604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f45b9f7e-3cf4-430b-84c9-c115a0618388 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.834287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f45b9f7e-3cf4-430b-84c9-c115a0618388 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.835067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f45b9f7e-3cf4-430b-84c9-c115a0618388 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.837381 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1244/2523] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:36 2022] DELETE /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:36.857046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7a56863d-3bf5-4a06-91f6-2fc613b6b811 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:36.864480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7a56863d-3bf5-4a06-91f6-2fc613b6b811 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:36.885208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a56863d-3bf5-4a06-91f6-2fc613b6b811 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.887677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a56863d-3bf5-4a06-91f6-2fc613b6b811 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.888978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a56863d-3bf5-4a06-91f6-2fc613b6b811 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:36.892668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a56863d-3bf5-4a06-91f6-2fc613b6b811 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:36.896466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a56863d-3bf5-4a06-91f6-2fc613b6b811 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:36.897970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a56863d-3bf5-4a06-91f6-2fc613b6b811 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:37.285023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f45b9f7e-3cf4-430b-84c9-c115a0618388 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:37.293305 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f45b9f7e-3cf4-430b-84c9-c115a0618388 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1508 microversion: 2.1 time: 0.486836 Oct 11 19:52:37.293881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7a56863d-3bf5-4a06-91f6-2fc613b6b811 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:37.294433 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1280/2524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:36 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1508 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:37.299101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:37.299945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:37.306057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:37.306774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:37.307304 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7a56863d-3bf5-4a06-91f6-2fc613b6b811 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1527 microversion: 2.1 time: 0.463949 Oct 11 19:52:37.307562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:37.308414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:37.309188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:37.309781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:37.310231 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1245/2525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:36 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1527 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:37.413234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:37.425207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:37.426959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:37.439201 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a4a8a562-3729-463d-a728-f2ff30075c81 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.143726 Oct 11 19:52:37.439807 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1281/2526] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:37 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:37.464989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-074ab58f-2a48-4637-a1f6-63007f13d85e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:37.465822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-074ab58f-2a48-4637-a1f6-63007f13d85e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:37.472947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-074ab58f-2a48-4637-a1f6-63007f13d85e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:37.473756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-074ab58f-2a48-4637-a1f6-63007f13d85e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:37.474413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-074ab58f-2a48-4637-a1f6-63007f13d85e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:37.475323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-074ab58f-2a48-4637-a1f6-63007f13d85e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:37.476202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-074ab58f-2a48-4637-a1f6-63007f13d85e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:37.476859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-074ab58f-2a48-4637-a1f6-63007f13d85e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:37.483793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff4a5d3a-1fb4-4f5d-9df3-0746aa67b464 tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-246299416", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:37.487367 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-ff4a5d3a-1fb4-4f5d-9df3-0746aa67b464 tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] HTTP exception thrown: min_count must be <= max_count Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff4a5d3a-1fb4-4f5d-9df3-0746aa67b464 tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Request method failure captured: Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 183 Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcmFdJKVsU0GNtOz8MB1QjU0Z8T4mMdZvRGOSrmkiBQDutqVBBsrymU0DVN5uzu9WUVF21w3wrCZh-Xa7j1QjtoY6UlFqbk2VHBP4SzuF5FOTOL96PHdkGpJEZNNpHUlk8Oy7A5FScQkSUFeQLsv5UoJpoJvrxTmavnAPAMLw606vnc Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 1c94d950474f4f87bcd6c9d8298463ec Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c94d950474f4f87bcd6c9d8298463ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c94d950474f4f87bcd6c9d8298463ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c94d950474f4f87bcd6c9d8298463ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c94d950474f4f87bcd6c9d8298463ec"}]}] Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 1c94d950474f4f87bcd6c9d8298463ec Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-MultipleCreateNegativeTestJSON-924835370-project Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d646bc2181d84c15b38ac529fcc9134d Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-924835370-project Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-246299416", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: exception: min_count must be <= max_count Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-246299416', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 11 19:52:37.489386 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.494045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff4a5d3a-1fb4-4f5d-9df3-0746aa67b464 tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Returning 400 to user: min_count must be <= max_count {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:37.494045 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ff4a5d3a-1fb4-4f5d-9df3-0746aa67b464 tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.179560 Oct 11 19:52:37.494045 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1246/2527] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:37 2022] POST /compute/v2.1/servers => generated 74 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:52:37.570394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-16e9d2d9-63e0-4911-8385-ec6d182e3f8c tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1942063910", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "max_count": 0}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:37.576506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-074ab58f-2a48-4637-a1f6-63007f13d85e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-16e9d2d9-63e0-4911-8385-ec6d182e3f8c tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Request method failure captured: Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 168 Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcmFdJKVsU0GNtOz8MB1QjU0Z8T4mMdZvRGOSrmkiBQDutqVBBsrymU0DVN5uzu9WUVF21w3wrCZh-Xa7j1QjtoY6UlFqbk2VHBP4SzuF5FOTOL96PHdkGpJEZNNpHUlk8Oy7A5FScQkSUFeQLsv5UoJpoJvrxTmavnAPAMLw606vnc Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 1c94d950474f4f87bcd6c9d8298463ec Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c94d950474f4f87bcd6c9d8298463ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c94d950474f4f87bcd6c9d8298463ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c94d950474f4f87bcd6c9d8298463ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c94d950474f4f87bcd6c9d8298463ec"}]}] Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 1c94d950474f4f87bcd6c9d8298463ec Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-MultipleCreateNegativeTestJSON-924835370-project Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d646bc2181d84c15b38ac529fcc9134d Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-924835370-project Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1942063910", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "max_count": 0}} Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1942063910', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'max_count': 0}}} Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 0 Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:52:37.577179 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 19:52:37.580954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.584235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-16e9d2d9-63e0-4911-8385-ec6d182e3f8c tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:37.585654 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-16e9d2d9-63e0-4911-8385-ec6d182e3f8c tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021919 Oct 11 19:52:37.591200 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-074ab58f-2a48-4637-a1f6-63007f13d85e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1276 microversion: 2.1 time: 0.135472 Oct 11 19:52:37.592016 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1282/2528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:37 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:37.609806 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1247/2529] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:52:37.681598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98933c26-d056-4acc-b165-24784d5af042 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:37.681792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-33ee76fc-688b-473e-a978-84c2a3eada4f tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1620077042", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "max_count": 2.5}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:37.682733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-98933c26-d056-4acc-b165-24784d5af042 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-33ee76fc-688b-473e-a978-84c2a3eada4f tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Request method failure captured: Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 170 Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcmFdJKVsU0GNtOz8MB1QjU0Z8T4mMdZvRGOSrmkiBQDutqVBBsrymU0DVN5uzu9WUVF21w3wrCZh-Xa7j1QjtoY6UlFqbk2VHBP4SzuF5FOTOL96PHdkGpJEZNNpHUlk8Oy7A5FScQkSUFeQLsv5UoJpoJvrxTmavnAPAMLw606vnc Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 1c94d950474f4f87bcd6c9d8298463ec Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c94d950474f4f87bcd6c9d8298463ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c94d950474f4f87bcd6c9d8298463ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c94d950474f4f87bcd6c9d8298463ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c94d950474f4f87bcd6c9d8298463ec"}]}] Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 1c94d950474f4f87bcd6c9d8298463ec Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-MultipleCreateNegativeTestJSON-924835370-project Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d646bc2181d84c15b38ac529fcc9134d Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-924835370-project Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1620077042", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "max_count": 2.5}} Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1620077042', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'max_count': 2.5}}} Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 2.5 Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:52:37.685710 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 19:52:37.689732 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.691581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98933c26-d056-4acc-b165-24784d5af042 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:37.691681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98933c26-d056-4acc-b165-24784d5af042 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:37.692206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98933c26-d056-4acc-b165-24784d5af042 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:37.692664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-33ee76fc-688b-473e-a978-84c2a3eada4f tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:37.693122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98933c26-d056-4acc-b165-24784d5af042 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:37.694007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98933c26-d056-4acc-b165-24784d5af042 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:37.694197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98933c26-d056-4acc-b165-24784d5af042 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:37.695030 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-33ee76fc-688b-473e-a978-84c2a3eada4f tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018032 Oct 11 19:52:37.696316 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1248/2530] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:52:37.769221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-335b8053-c61f-48c8-ac39-cdae5fbc0472 tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1131612801", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 0}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-335b8053-c61f-48c8-ac39-cdae5fbc0472 tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Request method failure captured: Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 168 Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcmFdJKVsU0GNtOz8MB1QjU0Z8T4mMdZvRGOSrmkiBQDutqVBBsrymU0DVN5uzu9WUVF21w3wrCZh-Xa7j1QjtoY6UlFqbk2VHBP4SzuF5FOTOL96PHdkGpJEZNNpHUlk8Oy7A5FScQkSUFeQLsv5UoJpoJvrxTmavnAPAMLw606vnc Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 1c94d950474f4f87bcd6c9d8298463ec Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c94d950474f4f87bcd6c9d8298463ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c94d950474f4f87bcd6c9d8298463ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c94d950474f4f87bcd6c9d8298463ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c94d950474f4f87bcd6c9d8298463ec"}]}] Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 1c94d950474f4f87bcd6c9d8298463ec Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-MultipleCreateNegativeTestJSON-924835370-project Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d646bc2181d84c15b38ac529fcc9134d Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-924835370-project Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1131612801", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 0}} Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1131612801', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'min_count': 0}}} Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 0 Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:52:37.774074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-335b8053-c61f-48c8-ac39-cdae5fbc0472 tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-335b8053-c61f-48c8-ac39-cdae5fbc0472 tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010407 Oct 11 19:52:37.785779 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1249/2531] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:52:37.828116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a94848e5-5809-4541-b01b-c3d5fc007b3a tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1642151611", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 2.5}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a94848e5-5809-4541-b01b-c3d5fc007b3a tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Request method failure captured: Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 170 Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcmFdJKVsU0GNtOz8MB1QjU0Z8T4mMdZvRGOSrmkiBQDutqVBBsrymU0DVN5uzu9WUVF21w3wrCZh-Xa7j1QjtoY6UlFqbk2VHBP4SzuF5FOTOL96PHdkGpJEZNNpHUlk8Oy7A5FScQkSUFeQLsv5UoJpoJvrxTmavnAPAMLw606vnc Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 1c94d950474f4f87bcd6c9d8298463ec Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1c94d950474f4f87bcd6c9d8298463ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1c94d950474f4f87bcd6c9d8298463ec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c94d950474f4f87bcd6c9d8298463ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1c94d950474f4f87bcd6c9d8298463ec"}]}] Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 1c94d950474f4f87bcd6c9d8298463ec Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-924835370 Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-MultipleCreateNegativeTestJSON-924835370-project Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d646bc2181d84c15b38ac529fcc9134d Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-924835370-project Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1642151611", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "min_count": 2.5}} Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1642151611', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'min_count': 2.5}}} Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 2.5 Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:52:37.832035 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a94848e5-5809-4541-b01b-c3d5fc007b3a tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a94848e5-5809-4541-b01b-c3d5fc007b3a tempest-MultipleCreateNegativeTestJSON-924835370 tempest-MultipleCreateNegativeTestJSON-924835370-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009110 Oct 11 19:52:37.836730 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1250/2532] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:52:37.940151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-98933c26-d056-4acc-b165-24784d5af042 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:37.949617 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98933c26-d056-4acc-b165-24784d5af042 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1322 microversion: 2.1 time: 0.272909 Oct 11 19:52:37.955449 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1283/2533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:37 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:38.336114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-07f0945f-fc5a-4967-a89e-851c50b52e5d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:38.337796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-07f0945f-fc5a-4967-a89e-851c50b52e5d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:38.356646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f0945f-fc5a-4967-a89e-851c50b52e5d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:38.357340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f0945f-fc5a-4967-a89e-851c50b52e5d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:38.371047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f0945f-fc5a-4967-a89e-851c50b52e5d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:38.371899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f0945f-fc5a-4967-a89e-851c50b52e5d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:38.372382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f0945f-fc5a-4967-a89e-851c50b52e5d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:38.372816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07f0945f-fc5a-4967-a89e-851c50b52e5d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:38.444006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6860d2f8-1bfd-40e2-ab44-7adb101a52fc req-dec75941-301d-46c1-ba24-90f033ac4395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768", "name": "network-vif-plugged", "status": "completed", "tag": "031b5fb2-9390-4322-88f9-961fd24d7144"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:38.465907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6860d2f8-1bfd-40e2-ab44-7adb101a52fc req-dec75941-301d-46c1-ba24-90f033ac4395 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:38.466389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6860d2f8-1bfd-40e2-ab44-7adb101a52fc req-dec75941-301d-46c1-ba24-90f033ac4395 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:38.466841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6860d2f8-1bfd-40e2-ab44-7adb101a52fc req-dec75941-301d-46c1-ba24-90f033ac4395 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:38.488020 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6860d2f8-1bfd-40e2-ab44-7adb101a52fc req-dec75941-301d-46c1-ba24-90f033ac4395 service nova] Creating event network-vif-plugged:031b5fb2-9390-4322-88f9-961fd24d7144 for instance e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 on n-h1-860864-3 Oct 11 19:52:38.500566 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6860d2f8-1bfd-40e2-ab44-7adb101a52fc req-dec75941-301d-46c1-ba24-90f033ac4395 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060447 Oct 11 19:52:38.504761 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1284/2534] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:52:38.514719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:38.523314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:38.545509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:38.551582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:38.552746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:38.554127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:38.557467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:38.558915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:38.821282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:38.846237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:38.848209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:38.858493 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-57333847-10b2-4f9c-a4ed-fcb1960648c0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.347772 Oct 11 19:52:38.859355 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1285/2535] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:38 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:38.878108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5dbf794c-ed6f-4f25-b98a-79ab361232c3 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:38.878821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5dbf794c-ed6f-4f25-b98a-79ab361232c3 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:38.889782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dbf794c-ed6f-4f25-b98a-79ab361232c3 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:38.890451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dbf794c-ed6f-4f25-b98a-79ab361232c3 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:38.891023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dbf794c-ed6f-4f25-b98a-79ab361232c3 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:38.891892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dbf794c-ed6f-4f25-b98a-79ab361232c3 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:38.892463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dbf794c-ed6f-4f25-b98a-79ab361232c3 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:38.892993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dbf794c-ed6f-4f25-b98a-79ab361232c3 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:39.049497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-07f0945f-fc5a-4967-a89e-851c50b52e5d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:39.064962 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-07f0945f-fc5a-4967-a89e-851c50b52e5d tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1527 microversion: 2.1 time: 0.733341 Oct 11 19:52:39.065554 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1251/2536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:38 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1527 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:39.072194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-85246cab-113d-4130-8c30-137590173f78 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c762a4c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:39.126217 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-85246cab-113d-4130-8c30-137590173f78 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/ffb66135-1f7a-46d1-accc-f4a029128a5d" status: 200 len: 661 microversion: 2.1 time: 0.059049 Oct 11 19:52:39.136156 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1252/2537] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:52:39 2022] GET /compute/v2.1/images/ffb66135-1f7a-46d1-accc-f4a029128a5d => generated 661 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:39.136156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe9cb097-c2e8-4c9c-93aa-9dbb7c2ad5ca tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:39.136156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fe9cb097-c2e8-4c9c-93aa-9dbb7c2ad5ca tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:39.137649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:39.145314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9cb097-c2e8-4c9c-93aa-9dbb7c2ad5ca tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:39.146055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9cb097-c2e8-4c9c-93aa-9dbb7c2ad5ca tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:39.146693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9cb097-c2e8-4c9c-93aa-9dbb7c2ad5ca tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:39.147527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9cb097-c2e8-4c9c-93aa-9dbb7c2ad5ca tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:39.148036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9cb097-c2e8-4c9c-93aa-9dbb7c2ad5ca tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:39.148542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9cb097-c2e8-4c9c-93aa-9dbb7c2ad5ca tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:39.283861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5dbf794c-ed6f-4f25-b98a-79ab361232c3 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:39.291886 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5dbf794c-ed6f-4f25-b98a-79ab361232c3 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1318 microversion: 2.1 time: 0.431406 Oct 11 19:52:39.302892 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1286/2538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:38 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:39.312336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c81423b9-7461-4894-bc35-b39874846873 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cd1ab550>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:39.362610 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c81423b9-7461-4894-bc35-b39874846873 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/ffb66135-1f7a-46d1-accc-f4a029128a5d" status: 200 len: 661 microversion: 2.1 time: 0.054080 Oct 11 19:52:39.363202 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1287/2539] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:52:39 2022] GET /compute/v2.1/images/ffb66135-1f7a-46d1-accc-f4a029128a5d => generated 661 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:39.380787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-882531a4-c3ee-4013-8f68-52474439b44b req-756a3df4-1c71-4412-ad2e-6e004c3fab94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fead6667-c8f7-4c5d-a46b-150040f0e863", "tag": "3bf3cb15-f7ba-4733-b3d9-b660d06e3908"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:39.394924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-882531a4-c3ee-4013-8f68-52474439b44b req-756a3df4-1c71-4412-ad2e-6e004c3fab94 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:39.395400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-882531a4-c3ee-4013-8f68-52474439b44b req-756a3df4-1c71-4412-ad2e-6e004c3fab94 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:39.396198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-882531a4-c3ee-4013-8f68-52474439b44b req-756a3df4-1c71-4412-ad2e-6e004c3fab94 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:39.417205 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-882531a4-c3ee-4013-8f68-52474439b44b req-756a3df4-1c71-4412-ad2e-6e004c3fab94 service nova] Creating event network-changed:3bf3cb15-f7ba-4733-b3d9-b660d06e3908 for instance fead6667-c8f7-4c5d-a46b-150040f0e863 on n-h1-860864-3 Oct 11 19:52:39.422581 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-882531a4-c3ee-4013-8f68-52474439b44b req-756a3df4-1c71-4412-ad2e-6e004c3fab94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050084 Oct 11 19:52:39.423385 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1288/2540] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:39.531894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fe9cb097-c2e8-4c9c-93aa-9dbb7c2ad5ca tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:39.539774 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fe9cb097-c2e8-4c9c-93aa-9dbb7c2ad5ca tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1322 microversion: 2.1 time: 0.410830 Oct 11 19:52:39.540542 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1253/2541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:39 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:39.779620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-edd6392b-1994-406f-a038-992654920e8f req-51c7cacb-384f-4fd9-a4a3-e2958b327aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc35c0a-199d-4075-bad2-7daffd9a2e1d", "name": "network-vif-deleted", "tag": "bea0ec61-84f0-4611-9fb2-ac9b2df50352"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:39.842186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-edd6392b-1994-406f-a038-992654920e8f req-51c7cacb-384f-4fd9-a4a3-e2958b327aad service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:39.846515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-edd6392b-1994-406f-a038-992654920e8f req-51c7cacb-384f-4fd9-a4a3-e2958b327aad service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:39.847325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-edd6392b-1994-406f-a038-992654920e8f req-51c7cacb-384f-4fd9-a4a3-e2958b327aad service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:39.901035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:39.902082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:39.908019 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-edd6392b-1994-406f-a038-992654920e8f req-51c7cacb-384f-4fd9-a4a3-e2958b327aad service nova] Creating event network-vif-deleted:bea0ec61-84f0-4611-9fb2-ac9b2df50352 for instance 4cc35c0a-199d-4075-bad2-7daffd9a2e1d on n-h1-860864-3 Oct 11 19:52:39.913090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:39.917555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:39.918983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:39.922802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:39.924927 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-edd6392b-1994-406f-a038-992654920e8f req-51c7cacb-384f-4fd9-a4a3-e2958b327aad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155411 Oct 11 19:52:39.925058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:39.926290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:39.929516 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1289/2542] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:39.937659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6a3fda78-df80-452a-839b-2c68b044863d"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:39.943305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:39.960579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:39.961653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:39.962180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:39.962925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:39.963427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:39.963851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:40.034907 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] HTTP exception thrown: Volume 9390fc15-01bc-4453-b2cf-6c094f74e3a2 could not be found. Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Request method failure captured: Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6/os-volume_attachments/9390fc15-01bc-4453-b2cf-6c094f74e3a2 HTTP/1.1 Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 74 Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcj7RO6kedLcSmnmfaAzpdWCihZsia95zjFKfKVfOb9h5qhPnmcnWhKJorS86YxHYH1xCXGShqL5-VteU6EpyGHY0D3Ch9dMt6v4IjZzYu8xLV1tn8b7p7ng3TeOIj3r3Z4K52dSzVpNkep9DsBuR8FoqIM1wsJzsuEIvGW7XxmUp8U Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1b7e2bc136ed4783b38ee86d18a518ab Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesAdminNegativeTest-9733670 Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1b7e2bc136ed4783b38ee86d18a518ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1b7e2bc136ed4783b38ee86d18a518ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b7e2bc136ed4783b38ee86d18a518ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b7e2bc136ed4783b38ee86d18a518ab"}]}] Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesAdminNegativeTest-9733670 Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1b7e2bc136ed4783b38ee86d18a518ab Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-9733670 Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesAdminNegativeTest-9733670-project-admin Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e919851499dc49c398384a02739dc555 Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesAdminNegativeTest-9733670-project-admin Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: {"volumeAttachment": {"volumeId": "6a3fda78-df80-452a-839b-2c68b044863d"}} Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: exception: Volume 9390fc15-01bc-4453-b2cf-6c094f74e3a2 could not be found. Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': '25cf673d-5755-4959-8872-2f42951c8ed6', 'id': '9390fc15-01bc-4453-b2cf-6c094f74e3a2', 'body': {'volumeAttachment': {'volumeId': '6a3fda78-df80-452a-839b-2c68b044863d'}}} Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9390fc15-01bc-4453-b2cf-6c094f74e3a2 could not be found. (HTTP 404) (Request-ID: req-1b68fad4-4442-4052-b96e-7c93aab1c133) Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 19:52:40.038123 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9390fc15-01bc-4453-b2cf-6c094f74e3a2 could not be found. Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9390fc15-01bc-4453-b2cf-6c094f74e3a2 could not be found. Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9390fc15-01bc-4453-b2cf-6c094f74e3a2 could not be found. Oct 11 19:52:40.043414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:40.048540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] Returning 404 to user: Volume 9390fc15-01bc-4453-b2cf-6c094f74e3a2 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:40.049590 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4be32237-bb02-48dc-9842-cdfbbc7c42ff tempest-VolumesAdminNegativeTest-9733670 tempest-VolumesAdminNegativeTest-9733670-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6/os-volume_attachments/9390fc15-01bc-4453-b2cf-6c094f74e3a2" status: 404 len: 109 microversion: 2.1 time: 0.118193 Oct 11 19:52:40.050328 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1290/2543] 10.222.0.27 () {60 vars in 1433 bytes} [Tue Oct 11 19:52:39 2022] PUT /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6/os-volume_attachments/9390fc15-01bc-4453-b2cf-6c094f74e3a2 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:40.066745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:40.080482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:40.082458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:40.091726 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f6613f12-4139-4fcb-bf53-2da926f72453 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.208154 Oct 11 19:52:40.093049 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1254/2544] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:39 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:52:40.094907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:40.095529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:40.110592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:40.111427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:40.112029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:40.112919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:40.113757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:40.115524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:40.122663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:40.178704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:40.179790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:40.181031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:40.181830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lazy-loading 'fault' on Instance uuid 4cc35c0a-199d-4075-bad2-7daffd9a2e1d {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:40.273672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:40.283693 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a355be20-0d4f-413f-85a8-15e5ee7d36d0 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1315 microversion: 2.1 time: 0.193459 Oct 11 19:52:40.285011 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1291/2545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:40 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:40.317687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c44db7d4-511b-4cc1-bac3-c31fb2db7f8a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:40.321152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c44db7d4-511b-4cc1-bac3-c31fb2db7f8a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:40.335344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44db7d4-511b-4cc1-bac3-c31fb2db7f8a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:40.335843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44db7d4-511b-4cc1-bac3-c31fb2db7f8a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:40.339011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44db7d4-511b-4cc1-bac3-c31fb2db7f8a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:40.339830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44db7d4-511b-4cc1-bac3-c31fb2db7f8a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:40.340186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44db7d4-511b-4cc1-bac3-c31fb2db7f8a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:40.343168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44db7d4-511b-4cc1-bac3-c31fb2db7f8a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:40.354443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:40.564906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4729942a-f10a-469b-a979-2d6898d0122a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:40.565809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4729942a-f10a-469b-a979-2d6898d0122a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:40.581290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4729942a-f10a-469b-a979-2d6898d0122a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:40.582676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4729942a-f10a-469b-a979-2d6898d0122a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:40.583289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4729942a-f10a-469b-a979-2d6898d0122a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:40.584179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4729942a-f10a-469b-a979-2d6898d0122a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:40.584640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4729942a-f10a-469b-a979-2d6898d0122a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:40.585070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4729942a-f10a-469b-a979-2d6898d0122a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:41.031968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c44db7d4-511b-4cc1-bac3-c31fb2db7f8a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:41.040656 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c44db7d4-511b-4cc1-bac3-c31fb2db7f8a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1318 microversion: 2.1 time: 0.729048 Oct 11 19:52:41.051277 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1255/2546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:40 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:41.121821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:41.122680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:41.138819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:41.139348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:41.143514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:41.144351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:41.145019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:41.145619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:41.213533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4729942a-f10a-469b-a979-2d6898d0122a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:41.223073 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4729942a-f10a-469b-a979-2d6898d0122a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 200 len: 1515 microversion: 2.1 time: 0.662724 Oct 11 19:52:41.228411 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1292/2547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:40 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 1515 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:41.251949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38fc74b6-82b9-442b-af2a-98ed9db4d9fd tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:41.253414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-38fc74b6-82b9-442b-af2a-98ed9db4d9fd tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: efc7c3f0-fdf4-425e-97c9-534e4f3144a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:41.262702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38fc74b6-82b9-442b-af2a-98ed9db4d9fd tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:41.263694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38fc74b6-82b9-442b-af2a-98ed9db4d9fd tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:41.264560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38fc74b6-82b9-442b-af2a-98ed9db4d9fd tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:41.265567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38fc74b6-82b9-442b-af2a-98ed9db4d9fd tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:41.266375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38fc74b6-82b9-442b-af2a-98ed9db4d9fd tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:41.267407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38fc74b6-82b9-442b-af2a-98ed9db4d9fd tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:41.273074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:41.281953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:41.283836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:41.289977 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b8fc8cc9-8988-4b6c-bee1-8a94b3b00fdb tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.173152 Oct 11 19:52:41.303433 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1256/2548] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:41 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:52:41.317708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-faf70377-3f94-4530-8931-92d2d2102c1a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d076faf0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:41.371091 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-faf70377-3f94-4530-8931-92d2d2102c1a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/defaae22-39fe-4df4-ab49-2645d27c279e" status: 200 len: 662 microversion: 2.1 time: 0.066150 Oct 11 19:52:41.376610 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1257/2549] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:52:41 2022] GET /compute/v2.1/images/defaae22-39fe-4df4-ab49-2645d27c279e => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:41.389273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:41.390121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:41.402792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:41.404561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:41.405421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:41.407258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:41.411559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:41.412453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:41.462357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:41.463257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:41.463972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:41.464720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lazy-loading 'fault' on Instance uuid 4cc35c0a-199d-4075-bad2-7daffd9a2e1d {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:41.521729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faada3423bb457c8b1f8f55853934de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b39062227d428186d4a665fac14fb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:41.532009 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6ccd5ecf-8518-4eda-be91-dd6e98f54e63 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 200 len: 1315 microversion: 2.1 time: 0.154104 Oct 11 19:52:41.533280 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1258/2550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:41 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:41.538024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4de3a6e1-4d8b-493c-8dc2-982bea6d2b7c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc2e4e50>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:41.572912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-38fc74b6-82b9-442b-af2a-98ed9db4d9fd tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:41.593130 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4de3a6e1-4d8b-493c-8dc2-982bea6d2b7c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/defaae22-39fe-4df4-ab49-2645d27c279e" status: 200 len: 662 microversion: 2.1 time: 0.058564 Oct 11 19:52:41.594261 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1259/2551] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:52:41 2022] GET /compute/v2.1/images/defaae22-39fe-4df4-ab49-2645d27c279e => generated 662 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:41.611672 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-38fc74b6-82b9-442b-af2a-98ed9db4d9fd tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3" status: 200 len: 1515 microversion: 2.1 time: 0.367527 Oct 11 19:52:41.615060 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1293/2552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:41 2022] GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3 => generated 1515 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:41.640146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a95115e6-285f-4895-bb13-3c4a1a43d6e9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:41.640836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a95115e6-285f-4895-bb13-3c4a1a43d6e9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:41.652632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95115e6-285f-4895-bb13-3c4a1a43d6e9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:41.657860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95115e6-285f-4895-bb13-3c4a1a43d6e9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:41.659965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95115e6-285f-4895-bb13-3c4a1a43d6e9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:41.660949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95115e6-285f-4895-bb13-3c4a1a43d6e9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:41.665677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95115e6-285f-4895-bb13-3c4a1a43d6e9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:41.666271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95115e6-285f-4895-bb13-3c4a1a43d6e9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:41.790990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1640175149", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:41.874562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:41.882210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:52:41.963307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a95115e6-285f-4895-bb13-3c4a1a43d6e9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:41.971905 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a95115e6-285f-4895-bb13-3c4a1a43d6e9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143" status: 200 len: 1515 microversion: 2.1 time: 0.336462 Oct 11 19:52:41.972714 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1260/2553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:41 2022] GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 => generated 1515 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:41.977414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-afdff3d5-82d5-4a54-a167-2baa571b0f99 req-6eb27343-ba8f-431a-9734-381450b42c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2931952-99d6-499e-afc6-c6cad13d6f13", "tag": "de2d0b3e-340e-470e-8627-79415fe34f52"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:41.989075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-afdff3d5-82d5-4a54-a167-2baa571b0f99 req-6eb27343-ba8f-431a-9734-381450b42c62 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:41.989895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-afdff3d5-82d5-4a54-a167-2baa571b0f99 req-6eb27343-ba8f-431a-9734-381450b42c62 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:41.990908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-afdff3d5-82d5-4a54-a167-2baa571b0f99 req-6eb27343-ba8f-431a-9734-381450b42c62 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.006574 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-afdff3d5-82d5-4a54-a167-2baa571b0f99 req-6eb27343-ba8f-431a-9734-381450b42c62 service nova] Creating event network-changed:de2d0b3e-340e-470e-8627-79415fe34f52 for instance b2931952-99d6-499e-afc6-c6cad13d6f13 on n-h2-860864-3 Oct 11 19:52:42.012556 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-afdff3d5-82d5-4a54-a167-2baa571b0f99 req-6eb27343-ba8f-431a-9734-381450b42c62 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038436 Oct 11 19:52:42.013373 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1261/2554] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:42.022293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b374650-b6dd-4935-94ca-0e53d430781b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:42.023117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2b374650-b6dd-4935-94ca-0e53d430781b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:42.030286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b374650-b6dd-4935-94ca-0e53d430781b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.030943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b374650-b6dd-4935-94ca-0e53d430781b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.031493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b374650-b6dd-4935-94ca-0e53d430781b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.032519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b374650-b6dd-4935-94ca-0e53d430781b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.033171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b374650-b6dd-4935-94ca-0e53d430781b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.033704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b374650-b6dd-4935-94ca-0e53d430781b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.069251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2b374650-b6dd-4935-94ca-0e53d430781b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:42.190007 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2b374650-b6dd-4935-94ca-0e53d430781b tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143" status: 204 len: 0 microversion: 2.1 time: 0.174127 Oct 11 19:52:42.190830 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1262/2555] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:42 2022] DELETE /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:42.202268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93d5d439-7e50-4c00-a5f8-a8250c8589d2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:42.203180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-93d5d439-7e50-4c00-a5f8-a8250c8589d2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:42.210607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d5d439-7e50-4c00-a5f8-a8250c8589d2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.211685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d5d439-7e50-4c00-a5f8-a8250c8589d2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.212980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d5d439-7e50-4c00-a5f8-a8250c8589d2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.213809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d5d439-7e50-4c00-a5f8-a8250c8589d2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.214547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d5d439-7e50-4c00-a5f8-a8250c8589d2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.215075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d5d439-7e50-4c00-a5f8-a8250c8589d2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.236692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:42.237427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:42.238214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:42.238844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:42.239457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:42.258577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.259276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.259815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.260679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.261172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.265919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:42.266672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.301361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Getting quotas for project 60660b00dcde45ab82615713f086851e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:52:42.321149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Getting quotas for user 6d10af74e94344029b7d19060dadc700 and project 60660b00dcde45ab82615713f086851e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:52:42.350165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:52:42.355073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:42.431911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-93d5d439-7e50-4c00-a5f8-a8250c8589d2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:42.446427 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93d5d439-7e50-4c00-a5f8-a8250c8589d2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1318 microversion: 2.1 time: 0.250516 Oct 11 19:52:42.449549 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1263/2556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:42 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:42.456954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a39a3ea9-fe8a-4c0a-b806-874edc699966 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:42.458012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a39a3ea9-fe8a-4c0a-b806-874edc699966 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:42.465654 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-890b2e1b-c4b4-4f31-bae0-de75efe6e19b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678684 Oct 11 19:52:42.466409 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1294/2557] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:52:42.472965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:42.473574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:42.487357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.488243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.488959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.490149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.490891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.491580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.496862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39a3ea9-fe8a-4c0a-b806-874edc699966 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.500859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39a3ea9-fe8a-4c0a-b806-874edc699966 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.502252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39a3ea9-fe8a-4c0a-b806-874edc699966 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.504617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39a3ea9-fe8a-4c0a-b806-874edc699966 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.506737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39a3ea9-fe8a-4c0a-b806-874edc699966 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.507304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39a3ea9-fe8a-4c0a-b806-874edc699966 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.590908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:42.603480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:42.605185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:42.618951 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3b494d29-0ee7-44c9-926c-f086d3dbe844 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.149719 Oct 11 19:52:42.621388 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1295/2558] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:42 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:42.634457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:42.635320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] [instance: 4cc35c0a-199d-4075-bad2-7daffd9a2e1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:42.649788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.650480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.651204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.655698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:42.656396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:42.657068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:42.690058 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] HTTP exception thrown: Instance 4cc35c0a-199d-4075-bad2-7daffd9a2e1d could not be found. Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Request method failure captured: Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d HTTP/1.1 Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcls8rnhlJiajMiOVDWwqZKx81QjSv3AjQO4JCJuI_Eqle1_g0YKHAJbMYGlRgqAkXW83Xb6f2DhjnY2fZ3ZyB8H4zIeHpTIHTaMm6iMkmrEFt2d8kQzCaycUighUQMLLHFss0vs2rbAheMCLWtJXwkoxxGt9frJxRv3bi9oxCRX91g Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: a8b39062227d428186d4a665fac14fb1 Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-282653831 Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a8b39062227d428186d4a665fac14fb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a8b39062227d428186d4a665fac14fb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8b39062227d428186d4a665fac14fb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a8b39062227d428186d4a665fac14fb1"}]}] Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-282653831 Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: a8b39062227d428186d4a665fac14fb1 Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-282653831 Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-InstanceActionsNegativeTestJSON-282653831-project Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 8faada3423bb457c8b1f8f55853934de Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-282653831-project Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 4cc35c0a-199d-4075-bad2-7daffd9a2e1d could not be found. Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '4cc35c0a-199d-4075-bad2-7daffd9a2e1d'} Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc35c0a-199d-4075-bad2-7daffd9a2e1d could not be found. Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc35c0a-199d-4075-bad2-7daffd9a2e1d could not be found. Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:42.704883 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc35c0a-199d-4075-bad2-7daffd9a2e1d could not be found. Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] Returning 404 to user: Instance 4cc35c0a-199d-4075-bad2-7daffd9a2e1d could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b5905fcd-4d87-499d-a710-d2f27452aa94 tempest-InstanceActionsNegativeTestJSON-282653831 tempest-InstanceActionsNegativeTestJSON-282653831-project] 10.222.0.27 "GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d" status: 404 len: 111 microversion: 2.1 time: 0.084068 Oct 11 19:52:42.708513 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1296/2559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:42 2022] GET /compute/v2.1/servers/4cc35c0a-199d-4075-bad2-7daffd9a2e1d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:42.727485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-622513810", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:42.805703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:52:43.279289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a39a3ea9-fe8a-4c0a-b806-874edc699966 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:43.290857 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a39a3ea9-fe8a-4c0a-b806-874edc699966 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143" status: 200 len: 1521 microversion: 2.1 time: 0.838880 Oct 11 19:52:43.307238 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1264/2560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:42 2022] GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 => generated 1521 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:43.476003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b62730b2-f009-41c2-9efc-c172df199f5f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:43.477624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b62730b2-f009-41c2-9efc-c172df199f5f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:43.490485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:43.491507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:43.492144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:43.493251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:43.493874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:43.504622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62730b2-f009-41c2-9efc-c172df199f5f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:43.509547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:43.512544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62730b2-f009-41c2-9efc-c172df199f5f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:43.513144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:43.514487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:43.515711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62730b2-f009-41c2-9efc-c172df199f5f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:43.517835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:43.518780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:43.520112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:43.520739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62730b2-f009-41c2-9efc-c172df199f5f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:43.522219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62730b2-f009-41c2-9efc-c172df199f5f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:43.527631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62730b2-f009-41c2-9efc-c172df199f5f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:43.594573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Getting quotas for project 60660b00dcde45ab82615713f086851e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:52:43.615966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Getting quotas for user 6d10af74e94344029b7d19060dadc700 and project 60660b00dcde45ab82615713f086851e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:52:43.630642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:52:43.633784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:43.703521 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a4371c39-3ae5-499e-82db-d31fee667f0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995398 Oct 11 19:52:43.713693 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1297/2561] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:52:43.735904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5859d81a-879c-4856-b064-30c54524a67e tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:43.737867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5859d81a-879c-4856-b064-30c54524a67e tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:43.752632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5859d81a-879c-4856-b064-30c54524a67e tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:43.753132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5859d81a-879c-4856-b064-30c54524a67e tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:43.756763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5859d81a-879c-4856-b064-30c54524a67e tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:43.757402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5859d81a-879c-4856-b064-30c54524a67e tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:43.761910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5859d81a-879c-4856-b064-30c54524a67e tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:43.762495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5859d81a-879c-4856-b064-30c54524a67e tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:43.845607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5859d81a-879c-4856-b064-30c54524a67e tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:44.003680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b62730b2-f009-41c2-9efc-c172df199f5f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:44.017108 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b62730b2-f009-41c2-9efc-c172df199f5f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1318 microversion: 2.1 time: 0.546736 Oct 11 19:52:44.017709 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1265/2562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:43 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:44.053846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:44.058116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:44.081639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:44.083456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:44.085055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:44.085871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:44.088296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:44.090295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:44.092396 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5859d81a-879c-4856-b064-30c54524a67e tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "DELETE /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 204 len: 0 microversion: 2.1 time: 0.376854 Oct 11 19:52:44.093495 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1298/2563] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:43 2022] DELETE /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:44.107872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba4c8457-81c6-4bf0-a680-829f627085b8 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:44.109014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba4c8457-81c6-4bf0-a680-829f627085b8 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:44.343377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba4c8457-81c6-4bf0-a680-829f627085b8 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:44.351527 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba4c8457-81c6-4bf0-a680-829f627085b8 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1217 microversion: 2.1 time: 0.255933 Oct 11 19:52:44.355072 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1299/2564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:44 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:44.365680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8bfb9f24-1419-473c-9768-661b3b4b2454 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:44.369371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8bfb9f24-1419-473c-9768-661b3b4b2454 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:44.375995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:44.400680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:44.402459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:44.420572 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bafe6329-1e11-4093-b654-e8e250e85bb1 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.382151 Oct 11 19:52:44.424412 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1266/2565] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:44 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:44.429404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfb9f24-1419-473c-9768-661b3b4b2454 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:44.430545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfb9f24-1419-473c-9768-661b3b4b2454 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:44.431613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfb9f24-1419-473c-9768-661b3b4b2454 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:44.432315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfb9f24-1419-473c-9768-661b3b4b2454 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:44.432777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfb9f24-1419-473c-9768-661b3b4b2454 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:44.433351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfb9f24-1419-473c-9768-661b3b4b2454 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:44.435004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1c9290e3-16ba-4c5e-bc55-47603dc37ee4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:44.435629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1c9290e3-16ba-4c5e-bc55-47603dc37ee4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:44.449301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c9290e3-16ba-4c5e-bc55-47603dc37ee4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:44.452573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c9290e3-16ba-4c5e-bc55-47603dc37ee4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:44.458964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c9290e3-16ba-4c5e-bc55-47603dc37ee4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:44.462669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c9290e3-16ba-4c5e-bc55-47603dc37ee4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:44.464528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c9290e3-16ba-4c5e-bc55-47603dc37ee4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:44.465701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c9290e3-16ba-4c5e-bc55-47603dc37ee4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:44.898347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8bfb9f24-1419-473c-9768-661b3b4b2454 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:44.914990 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8bfb9f24-1419-473c-9768-661b3b4b2454 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1514 microversion: 2.1 time: 0.553839 Oct 11 19:52:44.916320 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1300/2566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:44 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1514 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:44.999176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1c9290e3-16ba-4c5e-bc55-47603dc37ee4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:45.014211 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1c9290e3-16ba-4c5e-bc55-47603dc37ee4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143" status: 200 len: 1521 microversion: 2.1 time: 0.587941 Oct 11 19:52:45.026505 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1267/2567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:44 2022] GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:45.051087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-daa11b02-3e7a-4868-a39e-9bea158ee252 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:45.052765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-daa11b02-3e7a-4868-a39e-9bea158ee252 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:45.078489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa11b02-3e7a-4868-a39e-9bea158ee252 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:45.079149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa11b02-3e7a-4868-a39e-9bea158ee252 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:45.079610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa11b02-3e7a-4868-a39e-9bea158ee252 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:45.080351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa11b02-3e7a-4868-a39e-9bea158ee252 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:45.080810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa11b02-3e7a-4868-a39e-9bea158ee252 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:45.081232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-daa11b02-3e7a-4868-a39e-9bea158ee252 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:45.222837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c81c9754-6777-4415-ae83-62e5a1bb6e65 req-fa77fae7-52b4-4dae-8287-88e6359cdd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fead6667-c8f7-4c5d-a46b-150040f0e863", "name": "network-vif-plugged", "status": "completed", "tag": "3bf3cb15-f7ba-4733-b3d9-b660d06e3908"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:45.241309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c81c9754-6777-4415-ae83-62e5a1bb6e65 req-fa77fae7-52b4-4dae-8287-88e6359cdd87 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:45.246137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c81c9754-6777-4415-ae83-62e5a1bb6e65 req-fa77fae7-52b4-4dae-8287-88e6359cdd87 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:45.247112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c81c9754-6777-4415-ae83-62e5a1bb6e65 req-fa77fae7-52b4-4dae-8287-88e6359cdd87 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:45.277886 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c81c9754-6777-4415-ae83-62e5a1bb6e65 req-fa77fae7-52b4-4dae-8287-88e6359cdd87 service nova] Creating event network-vif-plugged:3bf3cb15-f7ba-4733-b3d9-b660d06e3908 for instance fead6667-c8f7-4c5d-a46b-150040f0e863 on n-h1-860864-3 Oct 11 19:52:45.290087 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c81c9754-6777-4415-ae83-62e5a1bb6e65 req-fa77fae7-52b4-4dae-8287-88e6359cdd87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370272 Oct 11 19:52:45.292738 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1301/2568] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:45.381296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f8af4a9f-ed00-41cd-a9c2-cb36893bacfc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:45.382011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f8af4a9f-ed00-41cd-a9c2-cb36893bacfc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:45.401119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8af4a9f-ed00-41cd-a9c2-cb36893bacfc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:45.401705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8af4a9f-ed00-41cd-a9c2-cb36893bacfc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:45.402169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8af4a9f-ed00-41cd-a9c2-cb36893bacfc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:45.402944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8af4a9f-ed00-41cd-a9c2-cb36893bacfc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:45.406876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8af4a9f-ed00-41cd-a9c2-cb36893bacfc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:45.407594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8af4a9f-ed00-41cd-a9c2-cb36893bacfc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:45.626925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-daa11b02-3e7a-4868-a39e-9bea158ee252 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:45.641182 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-daa11b02-3e7a-4868-a39e-9bea158ee252 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1318 microversion: 2.1 time: 0.598650 Oct 11 19:52:45.641792 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1268/2569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:45 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:45.674401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:45.683832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:45.703685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:45.708193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:45.708860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:45.709789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:45.710422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:45.713323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:45.721952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f8af4a9f-ed00-41cd-a9c2-cb36893bacfc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:45.731675 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f8af4a9f-ed00-41cd-a9c2-cb36893bacfc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1269 microversion: 2.1 time: 0.354528 Oct 11 19:52:45.755656 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1302/2570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:45 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1269 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:45.775737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b4e21571-26ea-46f4-9a3e-4a838c3726e7 req-d9424523-6c43-42f8-b2c1-3bbb4b29aeed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4683095-d0c3-42c7-aa5c-203a404a7143", "name": "network-vif-deleted", "tag": "764e7ae6-76cc-4855-9f84-b0207300f25f"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:45.812635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b4e21571-26ea-46f4-9a3e-4a838c3726e7 req-d9424523-6c43-42f8-b2c1-3bbb4b29aeed service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:45.818874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b4e21571-26ea-46f4-9a3e-4a838c3726e7 req-d9424523-6c43-42f8-b2c1-3bbb4b29aeed service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:45.822355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b4e21571-26ea-46f4-9a3e-4a838c3726e7 req-d9424523-6c43-42f8-b2c1-3bbb4b29aeed service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:45.844074 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b4e21571-26ea-46f4-9a3e-4a838c3726e7 req-d9424523-6c43-42f8-b2c1-3bbb4b29aeed service nova] Creating event network-vif-deleted:764e7ae6-76cc-4855-9f84-b0207300f25f for instance d4683095-d0c3-42c7-aa5c-203a404a7143 on n-h1-860864-3 Oct 11 19:52:45.850397 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b4e21571-26ea-46f4-9a3e-4a838c3726e7 req-d9424523-6c43-42f8-b2c1-3bbb4b29aeed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093097 Oct 11 19:52:45.855224 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1303/2571] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:45.939042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-db50aef2-eb8a-43a2-9341-3d5cd5de8ce0 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:45.940474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-db50aef2-eb8a-43a2-9341-3d5cd5de8ce0 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:45.950778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db50aef2-eb8a-43a2-9341-3d5cd5de8ce0 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:45.953038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db50aef2-eb8a-43a2-9341-3d5cd5de8ce0 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:45.953666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db50aef2-eb8a-43a2-9341-3d5cd5de8ce0 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:45.958999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db50aef2-eb8a-43a2-9341-3d5cd5de8ce0 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:45.963231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db50aef2-eb8a-43a2-9341-3d5cd5de8ce0 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:45.963887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db50aef2-eb8a-43a2-9341-3d5cd5de8ce0 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:46.128710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:46.137650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:46.145026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:46.169452 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e04dfa4c-3a14-4597-8f5c-0dc93b9af7a8 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1446 microversion: 2.75 time: 0.486382 Oct 11 19:52:46.171685 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1269/2572] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:45 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1446 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:46.182824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4247d88-00ab-4ac5-8adc-5d8ce5e8bc94 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:46.186430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a4247d88-00ab-4ac5-8adc-5d8ce5e8bc94 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:46.232589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4247d88-00ab-4ac5-8adc-5d8ce5e8bc94 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:46.233501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4247d88-00ab-4ac5-8adc-5d8ce5e8bc94 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:46.234178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4247d88-00ab-4ac5-8adc-5d8ce5e8bc94 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:46.235418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4247d88-00ab-4ac5-8adc-5d8ce5e8bc94 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:46.237188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4247d88-00ab-4ac5-8adc-5d8ce5e8bc94 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:46.237888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4247d88-00ab-4ac5-8adc-5d8ce5e8bc94 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:46.544578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a4247d88-00ab-4ac5-8adc-5d8ce5e8bc94 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:46.562212 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a4247d88-00ab-4ac5-8adc-5d8ce5e8bc94 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143" status: 200 len: 1307 microversion: 2.1 time: 0.388803 Oct 11 19:52:46.563513 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1270/2573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:46 2022] GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 => generated 1307 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:46.624639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-db50aef2-eb8a-43a2-9341-3d5cd5de8ce0 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:46.637477 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-db50aef2-eb8a-43a2-9341-3d5cd5de8ce0 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1514 microversion: 2.1 time: 0.701446 Oct 11 19:52:46.639656 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1304/2574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:45 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1514 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:46.674738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a9cc2b28-4b60-445c-b031-ed84f7a8fdbe tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:46.675334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a9cc2b28-4b60-445c-b031-ed84f7a8fdbe tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:46.688237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b28-4b60-445c-b031-ed84f7a8fdbe tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:46.688742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b28-4b60-445c-b031-ed84f7a8fdbe tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:46.689185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b28-4b60-445c-b031-ed84f7a8fdbe tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:46.689892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b28-4b60-445c-b031-ed84f7a8fdbe tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:46.690404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b28-4b60-445c-b031-ed84f7a8fdbe tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:46.691887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b28-4b60-445c-b031-ed84f7a8fdbe tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:46.764251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c8a9040-a78e-4e78-81de-29444090d2f9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:46.765239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c8a9040-a78e-4e78-81de-29444090d2f9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:46.777311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c8a9040-a78e-4e78-81de-29444090d2f9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:46.778127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c8a9040-a78e-4e78-81de-29444090d2f9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:46.778797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c8a9040-a78e-4e78-81de-29444090d2f9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:46.780327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c8a9040-a78e-4e78-81de-29444090d2f9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:46.782902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c8a9040-a78e-4e78-81de-29444090d2f9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:46.783890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c8a9040-a78e-4e78-81de-29444090d2f9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:46.941405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c8a9040-a78e-4e78-81de-29444090d2f9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:46.960703 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c8a9040-a78e-4e78-81de-29444090d2f9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1277 microversion: 2.1 time: 0.200281 Oct 11 19:52:46.962132 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1305/2575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:46 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:47.082883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a9cc2b28-4b60-445c-b031-ed84f7a8fdbe tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:47.095492 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a9cc2b28-4b60-445c-b031-ed84f7a8fdbe tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1318 microversion: 2.1 time: 0.424445 Oct 11 19:52:47.097080 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1271/2576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:46 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:47.202901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:47.203994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:47.207848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:47.219485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:47.220493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:47.221370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:47.222842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:47.223619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:47.224350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:47.343094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:47.356211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:47.358624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:47.366212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-91fe38ef-095f-4083-9cfd-53e54ec76f05 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1452 microversion: 2.75 time: 0.167990 Oct 11 19:52:47.368117 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1306/2577] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:47 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:47.588766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:47.589773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:47.600257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:47.600768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:47.601241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:47.602452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:47.609825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:47.610334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:47.641891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:47.659807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:47.660371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:47.661420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:47.662095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lazy-loading 'fault' on Instance uuid d4683095-d0c3-42c7-aa5c-203a404a7143 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:47.681081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:47.682069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:47.688727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:47.689529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:47.690313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:47.691233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:47.691847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:47.692619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:47.728268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:47.736898 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1689bb14-1ad1-42ea-bc55-044050a0797d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143" status: 200 len: 1312 microversion: 2.1 time: 0.152541 Oct 11 19:52:47.738151 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1272/2578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:47 2022] GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:47.748480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:47.750187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:47.751753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:47.753830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lazy-loading 'fault' on Instance uuid 25cf673d-5755-4959-8872-2f42951c8ed6 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:47.848787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:47.872424 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d08235c3-28b3-4f19-9433-a9f4ae422a63 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 200 len: 1308 microversion: 2.1 time: 0.207805 Oct 11 19:52:47.873674 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1307/2579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:47 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:47.937641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-913498b4-2b8c-4e14-b20d-5fe27794b9cd req-fffba9a6-1e44-4278-962e-1610b2bc7cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25cf673d-5755-4959-8872-2f42951c8ed6", "name": "network-vif-deleted", "tag": "c20023fb-4c4f-4ca5-a9b8-4c931246863b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:47.953775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-913498b4-2b8c-4e14-b20d-5fe27794b9cd req-fffba9a6-1e44-4278-962e-1610b2bc7cbf service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:47.958476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-913498b4-2b8c-4e14-b20d-5fe27794b9cd req-fffba9a6-1e44-4278-962e-1610b2bc7cbf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:47.958954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-913498b4-2b8c-4e14-b20d-5fe27794b9cd req-fffba9a6-1e44-4278-962e-1610b2bc7cbf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:47.979686 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-913498b4-2b8c-4e14-b20d-5fe27794b9cd req-fffba9a6-1e44-4278-962e-1610b2bc7cbf service nova] Creating event network-vif-deleted:c20023fb-4c4f-4ca5-a9b8-4c931246863b for instance 25cf673d-5755-4959-8872-2f42951c8ed6 on n-h2-860864-3 Oct 11 19:52:47.987097 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-913498b4-2b8c-4e14-b20d-5fe27794b9cd req-fffba9a6-1e44-4278-962e-1610b2bc7cbf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055713 Oct 11 19:52:47.988319 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1273/2580] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:47.989309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a8bda33b-e461-459c-9332-75f5ed30b14a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:47.991033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a8bda33b-e461-459c-9332-75f5ed30b14a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:47.998507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8bda33b-e461-459c-9332-75f5ed30b14a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:47.999020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8bda33b-e461-459c-9332-75f5ed30b14a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:48.003066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8bda33b-e461-459c-9332-75f5ed30b14a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:48.005153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8bda33b-e461-459c-9332-75f5ed30b14a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:48.009861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8bda33b-e461-459c-9332-75f5ed30b14a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:48.011526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8bda33b-e461-459c-9332-75f5ed30b14a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:48.121708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d73602d1-6569-4975-adb4-73e2b73b4237 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:48.123290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d73602d1-6569-4975-adb4-73e2b73b4237 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:48.157660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d73602d1-6569-4975-adb4-73e2b73b4237 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:48.159818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d73602d1-6569-4975-adb4-73e2b73b4237 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:48.160421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d73602d1-6569-4975-adb4-73e2b73b4237 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:48.163160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d73602d1-6569-4975-adb4-73e2b73b4237 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:48.165898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d73602d1-6569-4975-adb4-73e2b73b4237 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:48.169352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d73602d1-6569-4975-adb4-73e2b73b4237 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:48.671647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a8bda33b-e461-459c-9332-75f5ed30b14a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:48.684851 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a8bda33b-e461-459c-9332-75f5ed30b14a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1287 microversion: 2.1 time: 0.700584 Oct 11 19:52:48.704705 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1308/2581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:47 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1287 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:48.714093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:48.721148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:48.741249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:48.741927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:48.745541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:48.746488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:48.747137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:48.750912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:48.879719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d73602d1-6569-4975-adb4-73e2b73b4237 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:48.891947 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d73602d1-6569-4975-adb4-73e2b73b4237 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1318 microversion: 2.1 time: 0.772316 Oct 11 19:52:48.906625 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1274/2582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:48 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:48.906625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:48.908567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:48.929084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:48.929084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:48.929561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:48.930965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:48.933750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:48.934993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:49.029360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:49.030999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:49.032945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:49.033780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lazy-loading 'fault' on Instance uuid d4683095-d0c3-42c7-aa5c-203a404a7143 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:49.048903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:49.081989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:49.088393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:49.093194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:49.114406 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7d1da245-d91d-4b1a-9401-6f7750292aa9 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1452 microversion: 2.75 time: 0.408191 Oct 11 19:52:49.115492 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1309/2583] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:48 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1452 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:49.138670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:49.139770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 25cf673d-5755-4959-8872-2f42951c8ed6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:49.156157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:49.157056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:49.157653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:49.158555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:49.163216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:49.164098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:49.186152 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] HTTP exception thrown: Instance 25cf673d-5755-4959-8872-2f42951c8ed6 could not be found. Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Request method failure captured: Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 HTTP/1.1 Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjl0McOb_J9c-I0PIIC-gqI6mBxGVFjfqlnAoY3BH2UBqPRyAr8gWlVbK3BRa9Bk80O19pcF0cEgQW47NDixzO5bFIfs80NlWxjBgjTuaJiIS3whnfzyOlRCuDoJHFvBK9fbHAObe8SK2rK3BRAmO61ibFgIVbz4H7aye3BMOzHRfA Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 104b4ee892e441b79f520b0591ec0e33 Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesAdminNegativeTest-793087563 Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/104b4ee892e441b79f520b0591ec0e33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_104b4ee892e441b79f520b0591ec0e33", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/104b4ee892e441b79f520b0591ec0e33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/104b4ee892e441b79f520b0591ec0e33"}]}] Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesAdminNegativeTest-793087563 Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 104b4ee892e441b79f520b0591ec0e33 Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-793087563 Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesAdminNegativeTest-793087563-project Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: f34a23ce45c8419693d5fb67010548ad Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesAdminNegativeTest-793087563-project Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 25cf673d-5755-4959-8872-2f42951c8ed6 could not be found. Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '25cf673d-5755-4959-8872-2f42951c8ed6'} Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25cf673d-5755-4959-8872-2f42951c8ed6 could not be found. Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25cf673d-5755-4959-8872-2f42951c8ed6 could not be found. Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:49.188924 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:49.197934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:49.197934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:49.197934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:49.197934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:49.197934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:49.197934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25cf673d-5755-4959-8872-2f42951c8ed6 could not be found. Oct 11 19:52:49.197934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:49.203083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Returning 404 to user: Instance 25cf673d-5755-4959-8872-2f42951c8ed6 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:49.204620 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-66b491dd-95d3-442c-8be9-6ff53b12d60a tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6" status: 404 len: 111 microversion: 2.1 time: 0.087465 Oct 11 19:52:49.206652 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1310/2584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:49 2022] GET /compute/v2.1/servers/25cf673d-5755-4959-8872-2f42951c8ed6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:49.257702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:49.267234 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bae0cd14-02b2-4e29-94cc-debf73ff9d29 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143" status: 200 len: 1312 microversion: 2.1 time: 0.371526 Oct 11 19:52:49.274809 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1275/2585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:48 2022] GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:49.713138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d220754b-c4a4-4523-8bfb-3da85876c1c7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:49.713764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d220754b-c4a4-4523-8bfb-3da85876c1c7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:49.727069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d220754b-c4a4-4523-8bfb-3da85876c1c7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:49.728137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d220754b-c4a4-4523-8bfb-3da85876c1c7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:49.728819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d220754b-c4a4-4523-8bfb-3da85876c1c7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:49.730679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d220754b-c4a4-4523-8bfb-3da85876c1c7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:49.731610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d220754b-c4a4-4523-8bfb-3da85876c1c7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:49.732320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d220754b-c4a4-4523-8bfb-3da85876c1c7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:49.940120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8e8a88f0-117f-4d4b-912f-c5217df57d1f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:49.942655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8e8a88f0-117f-4d4b-912f-c5217df57d1f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:49.965901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e8a88f0-117f-4d4b-912f-c5217df57d1f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:49.968150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e8a88f0-117f-4d4b-912f-c5217df57d1f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:49.970311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e8a88f0-117f-4d4b-912f-c5217df57d1f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:49.970684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d220754b-c4a4-4523-8bfb-3da85876c1c7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:49.972623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e8a88f0-117f-4d4b-912f-c5217df57d1f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:49.973396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e8a88f0-117f-4d4b-912f-c5217df57d1f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:49.974030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e8a88f0-117f-4d4b-912f-c5217df57d1f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:49.995462 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d220754b-c4a4-4523-8bfb-3da85876c1c7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1275 microversion: 2.1 time: 0.287624 Oct 11 19:52:50.005743 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1311/2586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:49 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:50.143900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:50.146302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:50.162422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:50.167140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:50.168138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:50.170766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:50.174799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:50.176650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:50.502496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:50.517299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:50.520904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:50.531487 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8356d046-0f0d-44d8-8c23-3aa596fa9fd0 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1437 microversion: 2.75 time: 0.391673 Oct 11 19:52:50.532870 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1312/2587] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:50 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1437 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:52:50.537834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-270f1649-fd88-4e7d-9082-2e1525253b0b req-959e09e9-2be0-44bb-98a2-12d9a730b9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2931952-99d6-499e-afc6-c6cad13d6f13", "name": "network-vif-plugged", "status": "completed", "tag": "de2d0b3e-340e-470e-8627-79415fe34f52"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:50.561994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-270f1649-fd88-4e7d-9082-2e1525253b0b req-959e09e9-2be0-44bb-98a2-12d9a730b9df service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:50.562585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-270f1649-fd88-4e7d-9082-2e1525253b0b req-959e09e9-2be0-44bb-98a2-12d9a730b9df service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:50.563118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-270f1649-fd88-4e7d-9082-2e1525253b0b req-959e09e9-2be0-44bb-98a2-12d9a730b9df service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:50.584943 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-270f1649-fd88-4e7d-9082-2e1525253b0b req-959e09e9-2be0-44bb-98a2-12d9a730b9df service nova] Creating event network-vif-plugged:de2d0b3e-340e-470e-8627-79415fe34f52 for instance b2931952-99d6-499e-afc6-c6cad13d6f13 on n-h2-860864-3 Oct 11 19:52:50.593545 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-270f1649-fd88-4e7d-9082-2e1525253b0b req-959e09e9-2be0-44bb-98a2-12d9a730b9df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059180 Oct 11 19:52:50.600336 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1313/2588] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:50.608300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:50.609941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:50.641918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:50.642760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:50.643623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:50.644713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:50.645333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:50.645928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:50.687934 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] HTTP exception thrown: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Request method failure captured: Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 HTTP/1.1 Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclsyYKdZmpXoi8AI_MmTQf-JAKNS3L5ZMZry14ADD5g5ssIzgBWh7RdlVZTfd0-13Pi2M5tslT9o02tbGHYLbMuaQRx66XjyUCOJCmqRAC3STiO7DegcU-MCJeZMorEfAsD-poMVVdew01sfWs37pPrrydBjUu3X1xy8G67kLMYBLs Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_264dda6e3c7a4280a08204fda9003f54", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}] Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 258cb2ba63914f1a9dc997cc297f787e Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'd4683095-d0c3-42c7-aa5c-203a404a7143'} Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:50.692739 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:50.698857 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:50.698857 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:50.698857 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:50.698857 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:50.698857 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:50.698857 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:50.698857 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:50.698857 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:50.701089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Returning 404 to user: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:50.705233 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6702abba-2889-4dd9-8356-22c884429878 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143" status: 404 len: 111 microversion: 2.1 time: 0.101717 Oct 11 19:52:50.706825 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1314/2589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:50 2022] GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:50.786891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8e8a88f0-117f-4d4b-912f-c5217df57d1f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:50.804955 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8e8a88f0-117f-4d4b-912f-c5217df57d1f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1318 microversion: 2.1 time: 0.880826 Oct 11 19:52:50.822916 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1276/2590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:49 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1318 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:50.827919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-331cc6d8-a6a8-433d-a5f7-c98d144861cb tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:50.844996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-331cc6d8-a6a8-433d-a5f7-c98d144861cb tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:50.846106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-331cc6d8-a6a8-433d-a5f7-c98d144861cb tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '264dda6e3c7a4280a08204fda9003f54'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:50.858689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-331cc6d8-a6a8-433d-a5f7-c98d144861cb tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:50.859314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-331cc6d8-a6a8-433d-a5f7-c98d144861cb tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:50.859874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-331cc6d8-a6a8-433d-a5f7-c98d144861cb tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:50.860697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-331cc6d8-a6a8-433d-a5f7-c98d144861cb tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:50.861200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-331cc6d8-a6a8-433d-a5f7-c98d144861cb tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:50.861720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-331cc6d8-a6a8-433d-a5f7-c98d144861cb tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:51.025027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:51.028598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:51.055777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:51.064301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:51.065006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:51.065784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:51.066257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:51.066715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:51.112022 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-331cc6d8-a6a8-433d-a5f7-c98d144861cb tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.285715 Oct 11 19:52:51.125280 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1277/2591] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 11 19:52:50 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:52:51.131849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1f2d4d20-ab86-44b3-9f22-fd0c856798d7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:51.132791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f2d4d20-ab86-44b3-9f22-fd0c856798d7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:51.141876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2d4d20-ab86-44b3-9f22-fd0c856798d7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:51.142701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2d4d20-ab86-44b3-9f22-fd0c856798d7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:51.143357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2d4d20-ab86-44b3-9f22-fd0c856798d7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:51.144310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2d4d20-ab86-44b3-9f22-fd0c856798d7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:51.144946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2d4d20-ab86-44b3-9f22-fd0c856798d7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:51.151856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2d4d20-ab86-44b3-9f22-fd0c856798d7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:51.229332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:51.230466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:51.238131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:51.238855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:51.239669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:51.355929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:51.377399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:51.379325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:51.380046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:51.381390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:51.382129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:51.382813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:51.852530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:51.953331 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-040ed8cc-8cdd-4c78-8fe6-83e1e9ba1bc8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90/action" status: 202 len: 1940 microversion: 2.75 time: 1.219114 Oct 11 19:52:51.956433 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1315/2592] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 19:52:50 2022] POST /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90/action => generated 1940 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 19:52:51.972564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7feb6f41-7a14-4b9c-81ee-1e800fb91318 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7feb6f41-7a14-4b9c-81ee-1e800fb91318 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Request method failure captured: Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclsyYKdZmpXoi8AI_MmTQf-JAKNS3L5ZMZry14ADD5g5ssIzgBWh7RdlVZTfd0-13Pi2M5tslT9o02tbGHYLbMuaQRx66XjyUCOJCmqRAC3STiO7DegcU-MCJeZMorEfAsD-poMVVdew01sfWs37pPrrydBjUu3X1xy8G67kLMYBLs Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_264dda6e3c7a4280a08204fda9003f54", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}] Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 258cb2ba63914f1a9dc997cc297f787e Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: action_args: {} Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 19:52:51.976674 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 19:52:51.981245 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:51.984750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7feb6f41-7a14-4b9c-81ee-1e800fb91318 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:51.990575 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7feb6f41-7a14-4b9c-81ee-1e800fb91318 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.030666 Oct 11 19:52:51.994459 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1316/2593] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Oct 11 19:52:51 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:52:52.008904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1f2d4d20-ab86-44b3-9f22-fd0c856798d7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:52.024382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5deddf25-c4fc-4561-9232-17b76bd2d3e2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:52.025016 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1f2d4d20-ab86-44b3-9f22-fd0c856798d7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1317 microversion: 2.1 time: 0.891058 Oct 11 19:52:52.025883 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1278/2594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:51 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1317 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:52.028132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5deddf25-c4fc-4561-9232-17b76bd2d3e2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:52.033891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-33763bcb-5a36-4cdf-be0a-34899bbf307e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:52.043343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-33763bcb-5a36-4cdf-be0a-34899bbf307e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:52.052454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5deddf25-c4fc-4561-9232-17b76bd2d3e2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:52.054431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5deddf25-c4fc-4561-9232-17b76bd2d3e2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:52.057312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5deddf25-c4fc-4561-9232-17b76bd2d3e2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:52.058059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5deddf25-c4fc-4561-9232-17b76bd2d3e2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:52.058550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5deddf25-c4fc-4561-9232-17b76bd2d3e2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:52.061166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33763bcb-5a36-4cdf-be0a-34899bbf307e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:52.061653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33763bcb-5a36-4cdf-be0a-34899bbf307e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:52.062087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33763bcb-5a36-4cdf-be0a-34899bbf307e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:52.062566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5deddf25-c4fc-4561-9232-17b76bd2d3e2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:52.072086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33763bcb-5a36-4cdf-be0a-34899bbf307e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:52.072566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33763bcb-5a36-4cdf-be0a-34899bbf307e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:52.073001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33763bcb-5a36-4cdf-be0a-34899bbf307e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:52.715843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-33763bcb-5a36-4cdf-be0a-34899bbf307e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:52.777611 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-33763bcb-5a36-4cdf-be0a-34899bbf307e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.749801 Oct 11 19:52:52.779542 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1279/2595] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:52 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:52.799932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:52.821745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5deddf25-c4fc-4561-9232-17b76bd2d3e2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:52.823911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:52.824904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Searching by: {'deleted': False, 'project_id': '264dda6e3c7a4280a08204fda9003f54'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:52.834509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:52.834788 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5deddf25-c4fc-4561-9232-17b76bd2d3e2 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1318 microversion: 2.1 time: 0.830786 Oct 11 19:52:52.835484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:52.835950 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1317/2596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:51 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1318 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:52.836609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:52.838165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:52.839058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:52.839711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:52.882137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:52:52.935152 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ef1c259d-adf2-4f7f-9309-664c29b80bb7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.154081 Oct 11 19:52:52.937275 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1280/2597] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 19:52:52 2022] GET /compute/v2.1/servers => generated 681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:52.959004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:52.966366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:52.967265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.compute.servers [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Removing options 'limit' from query {{(pid=126956) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 19:52:52.968423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Searching by: {'deleted': False, 'project_id': '264dda6e3c7a4280a08204fda9003f54'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:52.977293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:52.978494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:52.979271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:52.981004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:52.981696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:52.982743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.060679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-143573f2-5790-4a89-b9de-cf8087e758b1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:53.061853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-143573f2-5790-4a89-b9de-cf8087e758b1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:53.068149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:52:53.079049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-143573f2-5790-4a89-b9de-cf8087e758b1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.080931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-143573f2-5790-4a89-b9de-cf8087e758b1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.082238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-143573f2-5790-4a89-b9de-cf8087e758b1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.085648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-143573f2-5790-4a89-b9de-cf8087e758b1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.088583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-143573f2-5790-4a89-b9de-cf8087e758b1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.089319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-143573f2-5790-4a89-b9de-cf8087e758b1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.146995 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3a11abb5-919a-457a-aa07-d02975256346 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.199843 Oct 11 19:52:53.149442 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1318/2598] 10.222.0.27 () {58 vars in 1144 bytes} [Tue Oct 11 19:52:52 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:52:53.178845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d499cd45-73c5-4129-acbd-3fa28becc56d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d499cd45-73c5-4129-acbd-3fa28becc56d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Request method failure captured: Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclsyYKdZmpXoi8AI_MmTQf-JAKNS3L5ZMZry14ADD5g5ssIzgBWh7RdlVZTfd0-13Pi2M5tslT9o02tbGHYLbMuaQRx66XjyUCOJCmqRAC3STiO7DegcU-MCJeZMorEfAsD-poMVVdew01sfWs37pPrrydBjUu3X1xy8G67kLMYBLs Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_264dda6e3c7a4280a08204fda9003f54", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}] Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 258cb2ba63914f1a9dc997cc297f787e Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: action_args: {} Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi '-1' Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 19:52:53.184541 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 19:52:53.190243 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.193538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d499cd45-73c5-4129-acbd-3fa28becc56d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:53.195525 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d499cd45-73c5-4129-acbd-3fa28becc56d tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.033092 Oct 11 19:52:53.198202 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1319/2599] 10.222.0.27 () {58 vars in 1142 bytes} [Tue Oct 11 19:52:53 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:52:53.207463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9206fc57-12bf-4dbc-a045-1df120b1cb39 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9206fc57-12bf-4dbc-a045-1df120b1cb39 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Request method failure captured: Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclsyYKdZmpXoi8AI_MmTQf-JAKNS3L5ZMZry14ADD5g5ssIzgBWh7RdlVZTfd0-13Pi2M5tslT9o02tbGHYLbMuaQRx66XjyUCOJCmqRAC3STiO7DegcU-MCJeZMorEfAsD-poMVVdew01sfWs37pPrrydBjUu3X1xy8G67kLMYBLs Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_264dda6e3c7a4280a08204fda9003f54", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}] Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 258cb2ba63914f1a9dc997cc297f787e Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: action_args: {} Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'testing' Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 19:52:53.214703 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 19:52:53.218902 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:53.231535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9206fc57-12bf-4dbc-a045-1df120b1cb39 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:53.233091 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9206fc57-12bf-4dbc-a045-1df120b1cb39 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.029570 Oct 11 19:52:53.234190 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1320/2600] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 19:52:53 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:52:53.245624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b803fccb-c641-4c03-8a0b-fdddce4b5c51 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:53.259251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b803fccb-c641-4c03-8a0b-fdddce4b5c51 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:53.264002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b803fccb-c641-4c03-8a0b-fdddce4b5c51 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '264dda6e3c7a4280a08204fda9003f54'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:53.277822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.compute.servers [None req-b803fccb-c641-4c03-8a0b-fdddce4b5c51 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Flavor 'non_existing_flavor' could not be found {{(pid=126956) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 11 19:52:53.279200 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b803fccb-c641-4c03-8a0b-fdddce4b5c51 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.039505 Oct 11 19:52:53.280659 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1321/2601] 10.222.0.27 () {58 vars in 1178 bytes} [Tue Oct 11 19:52:53 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 19:52:53.317710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-095916e5-14d7-4655-b1e2-264bc3606cc9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:53.335064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-095916e5-14d7-4655-b1e2-264bc3606cc9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:53.338931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-095916e5-14d7-4655-b1e2-264bc3606cc9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '264dda6e3c7a4280a08204fda9003f54'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:53.355915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-095916e5-14d7-4655-b1e2-264bc3606cc9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.359434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-095916e5-14d7-4655-b1e2-264bc3606cc9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.362011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-095916e5-14d7-4655-b1e2-264bc3606cc9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.362981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-095916e5-14d7-4655-b1e2-264bc3606cc9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.363915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-095916e5-14d7-4655-b1e2-264bc3606cc9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.365551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-095916e5-14d7-4655-b1e2-264bc3606cc9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.516479 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-095916e5-14d7-4655-b1e2-264bc3606cc9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.213596 Oct 11 19:52:53.517835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1322/2602] 10.222.0.27 () {58 vars in 1174 bytes} [Tue Oct 11 19:52:53 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:52:53.533420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-71a3e8f0-fa05-49a1-aeb5-72d39256bf99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:53.540632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-71a3e8f0-fa05-49a1-aeb5-72d39256bf99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:53.542244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-71a3e8f0-fa05-49a1-aeb5-72d39256bf99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '264dda6e3c7a4280a08204fda9003f54'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:53.548284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a3e8f0-fa05-49a1-aeb5-72d39256bf99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.549109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a3e8f0-fa05-49a1-aeb5-72d39256bf99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.549920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a3e8f0-fa05-49a1-aeb5-72d39256bf99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.550884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a3e8f0-fa05-49a1-aeb5-72d39256bf99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.551746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a3e8f0-fa05-49a1-aeb5-72d39256bf99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.552460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71a3e8f0-fa05-49a1-aeb5-72d39256bf99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.626043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-143573f2-5790-4a89-b9de-cf8087e758b1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:53.636947 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-143573f2-5790-4a89-b9de-cf8087e758b1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1317 microversion: 2.1 time: 0.589174 Oct 11 19:52:53.637543 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1281/2603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:53 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:53.644241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f0b0972d-dda5-419c-a3c5-77cff5586ed3 req-06bdd528-f0a8-4cfc-aad9-de3a3d5d4cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0929e96c-9da0-4034-ae0e-38f7330002f5", "tag": "71f8f1b2-5864-4201-894f-6d7e1edc96c4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:53.655639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0b0972d-dda5-419c-a3c5-77cff5586ed3 req-06bdd528-f0a8-4cfc-aad9-de3a3d5d4cde service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.656261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0b0972d-dda5-419c-a3c5-77cff5586ed3 req-06bdd528-f0a8-4cfc-aad9-de3a3d5d4cde service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.656548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0b0972d-dda5-419c-a3c5-77cff5586ed3 req-06bdd528-f0a8-4cfc-aad9-de3a3d5d4cde service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.665805 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-71a3e8f0-fa05-49a1-aeb5-72d39256bf99 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.138041 Oct 11 19:52:53.678291 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f0b0972d-dda5-419c-a3c5-77cff5586ed3 req-06bdd528-f0a8-4cfc-aad9-de3a3d5d4cde service nova] Creating event network-changed:71f8f1b2-5864-4201-894f-6d7e1edc96c4 for instance 0929e96c-9da0-4034-ae0e-38f7330002f5 on n-h2-860864-3 Oct 11 19:52:53.681668 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1323/2604] 10.222.0.27 () {58 vars in 1184 bytes} [Tue Oct 11 19:52:53 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:52:53.685931 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f0b0972d-dda5-419c-a3c5-77cff5586ed3 req-06bdd528-f0a8-4cfc-aad9-de3a3d5d4cde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043915 Oct 11 19:52:53.687184 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1282/2605] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:53.690259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:53.702566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:53.703433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Searching by: {'deleted': False, 'project_id': '264dda6e3c7a4280a08204fda9003f54'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:53.710282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.711284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.711903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.713046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.713664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.714255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.813204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05b10183-a9e8-4505-bca4-34bc8c51471e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:53.814121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05b10183-a9e8-4505-bca4-34bc8c51471e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:53.825886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b10183-a9e8-4505-bca4-34bc8c51471e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.830370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b10183-a9e8-4505-bca4-34bc8c51471e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.830975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b10183-a9e8-4505-bca4-34bc8c51471e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.831820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b10183-a9e8-4505-bca4-34bc8c51471e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.832664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b10183-a9e8-4505-bca4-34bc8c51471e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.833215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b10183-a9e8-4505-bca4-34bc8c51471e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:53.877708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:52:53.966028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:53.973423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:53.974163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:53.974792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:54.031813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-05b10183-a9e8-4505-bca4-34bc8c51471e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:54.063103 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05b10183-a9e8-4505-bca4-34bc8c51471e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.255067 Oct 11 19:52:54.065622 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1283/2606] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:53 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:54.072342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e29ae970-9b81-4bd7-a87d-0bdbf433aefa tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:54.073124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e29ae970-9b81-4bd7-a87d-0bdbf433aefa tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:54.080979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e29ae970-9b81-4bd7-a87d-0bdbf433aefa tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:54.081733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e29ae970-9b81-4bd7-a87d-0bdbf433aefa tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:54.082316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e29ae970-9b81-4bd7-a87d-0bdbf433aefa tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:54.083489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e29ae970-9b81-4bd7-a87d-0bdbf433aefa tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:54.084247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e29ae970-9b81-4bd7-a87d-0bdbf433aefa tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:54.085117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e29ae970-9b81-4bd7-a87d-0bdbf433aefa tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:54.796521 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a93131b-80c4-4eb2-a3fd-66c3527d6eb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 1.113614 Oct 11 19:52:54.797433 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1324/2607] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:52:53 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:54.816213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ade25d1-02c2-4e1b-9583-6c25fbfe3f42 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:54.822448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e29ae970-9b81-4bd7-a87d-0bdbf433aefa tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:54.842618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ade25d1-02c2-4e1b-9583-6c25fbfe3f42 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:54.845374 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e29ae970-9b81-4bd7-a87d-0bdbf433aefa tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 200 len: 1506 microversion: 2.1 time: 0.778394 Oct 11 19:52:54.850204 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1284/2608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:54 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 1506 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:54.855962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-279cd818-2d9c-44a3-9322-1c963021d30c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:54.858302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade25d1-02c2-4e1b-9583-6c25fbfe3f42 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:54.861294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade25d1-02c2-4e1b-9583-6c25fbfe3f42 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:54.861661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-279cd818-2d9c-44a3-9322-1c963021d30c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:54.862555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade25d1-02c2-4e1b-9583-6c25fbfe3f42 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:54.866450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade25d1-02c2-4e1b-9583-6c25fbfe3f42 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:54.867204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade25d1-02c2-4e1b-9583-6c25fbfe3f42 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:54.868340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade25d1-02c2-4e1b-9583-6c25fbfe3f42 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:54.880777 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-279cd818-2d9c-44a3-9322-1c963021d30c tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.023899 Oct 11 19:52:54.901427 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1285/2609] 10.222.0.27 () {58 vars in 1178 bytes} [Tue Oct 11 19:52:54 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:52:54.914316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec385c4b-4829-4f76-b0e8-34328d3ff68a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:54.915042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ec385c4b-4829-4f76-b0e8-34328d3ff68a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: fead6667-c8f7-4c5d-a46b-150040f0e863] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:54.931992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec385c4b-4829-4f76-b0e8-34328d3ff68a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:54.932624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec385c4b-4829-4f76-b0e8-34328d3ff68a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:54.933065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec385c4b-4829-4f76-b0e8-34328d3ff68a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:54.934736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec385c4b-4829-4f76-b0e8-34328d3ff68a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:54.936940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec385c4b-4829-4f76-b0e8-34328d3ff68a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:54.938845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec385c4b-4829-4f76-b0e8-34328d3ff68a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.317866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8ade25d1-02c2-4e1b-9583-6c25fbfe3f42 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:55.350644 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ade25d1-02c2-4e1b-9583-6c25fbfe3f42 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1317 microversion: 2.1 time: 0.551088 Oct 11 19:52:55.370651 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1325/2610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:54 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:55.384320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-45f5347c-86ba-4dde-97a5-9eefa8f1280d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:55.384952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-45f5347c-86ba-4dde-97a5-9eefa8f1280d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:55.392561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f5347c-86ba-4dde-97a5-9eefa8f1280d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.395411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f5347c-86ba-4dde-97a5-9eefa8f1280d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.395411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f5347c-86ba-4dde-97a5-9eefa8f1280d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.395411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f5347c-86ba-4dde-97a5-9eefa8f1280d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.396138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f5347c-86ba-4dde-97a5-9eefa8f1280d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.396586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f5347c-86ba-4dde-97a5-9eefa8f1280d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.440116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-45f5347c-86ba-4dde-97a5-9eefa8f1280d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:55.517987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec385c4b-4829-4f76-b0e8-34328d3ff68a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:55.530690 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ec385c4b-4829-4f76-b0e8-34328d3ff68a tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863" status: 200 len: 1505 microversion: 2.1 time: 0.629587 Oct 11 19:52:55.531287 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1286/2611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:54 2022] GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863 => generated 1505 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:55.545333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:55.559233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:55.561673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Searching by: {'deleted': False, 'project_id': '264dda6e3c7a4280a08204fda9003f54'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:52:55.579059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.580283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.581215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.583056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.583777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.588172 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-45f5347c-86ba-4dde-97a5-9eefa8f1280d tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 204 len: 0 microversion: 2.1 time: 0.214945 Oct 11 19:52:55.591794 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1326/2612] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:55 2022] DELETE /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:55.592382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.605401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0cf151eb-6b05-4eee-a8a9-54fc7a53728b tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:55.606239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0cf151eb-6b05-4eee-a8a9-54fc7a53728b tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:55.633214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf151eb-6b05-4eee-a8a9-54fc7a53728b tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.636825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf151eb-6b05-4eee-a8a9-54fc7a53728b tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.637336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf151eb-6b05-4eee-a8a9-54fc7a53728b tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.638640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf151eb-6b05-4eee-a8a9-54fc7a53728b tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.639942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf151eb-6b05-4eee-a8a9-54fc7a53728b tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.640482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf151eb-6b05-4eee-a8a9-54fc7a53728b tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.690157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:52:55.768572 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9092d06b-b0e4-47e3-8700-a6dfc93755b3 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.233743 Oct 11 19:52:55.771116 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1287/2613] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 19:52:55 2022] GET /compute/v2.1/servers => generated 681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:55.781970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-2d626ea0-cc7d-4d1b-a089-d736d5c513bd req-aeac486c-e95a-417f-ac3d-ad7d8fbb5533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f1f8956-214c-4f94-b8a9-c7bb03b56104", "tag": "3003e5ed-e486-4f4c-954b-6ab7b07147e9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:55.807095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2d626ea0-cc7d-4d1b-a089-d736d5c513bd req-aeac486c-e95a-417f-ac3d-ad7d8fbb5533 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.810673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2d626ea0-cc7d-4d1b-a089-d736d5c513bd req-aeac486c-e95a-417f-ac3d-ad7d8fbb5533 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.811492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2d626ea0-cc7d-4d1b-a089-d736d5c513bd req-aeac486c-e95a-417f-ac3d-ad7d8fbb5533 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.812784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-0cf151eb-6b05-4eee-a8a9-54fc7a53728b tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:55.844552 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2d626ea0-cc7d-4d1b-a089-d736d5c513bd req-aeac486c-e95a-417f-ac3d-ad7d8fbb5533 service nova] Creating event network-changed:3003e5ed-e486-4f4c-954b-6ab7b07147e9 for instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 on n-h1-860864-3 Oct 11 19:52:55.855205 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-2d626ea0-cc7d-4d1b-a089-d736d5c513bd req-aeac486c-e95a-417f-ac3d-ad7d8fbb5533 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080753 Oct 11 19:52:55.856537 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1288/2614] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:55.859295 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0cf151eb-6b05-4eee-a8a9-54fc7a53728b tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.265366 Oct 11 19:52:55.859873 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1327/2615] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:55 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:55.866981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7223291f-1b1a-421a-a0d0-3a72838c2c62 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:55.868471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7223291f-1b1a-421a-a0d0-3a72838c2c62 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: fead6667-c8f7-4c5d-a46b-150040f0e863] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:55.873383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ef832221-3802-446e-a2d0-635f9a1d5871 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:55.882741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef832221-3802-446e-a2d0-635f9a1d5871 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:55.900187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7223291f-1b1a-421a-a0d0-3a72838c2c62 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.902390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7223291f-1b1a-421a-a0d0-3a72838c2c62 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.903830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7223291f-1b1a-421a-a0d0-3a72838c2c62 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.908969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef832221-3802-446e-a2d0-635f9a1d5871 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.909864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7223291f-1b1a-421a-a0d0-3a72838c2c62 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.910671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7223291f-1b1a-421a-a0d0-3a72838c2c62 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.913087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7223291f-1b1a-421a-a0d0-3a72838c2c62 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.913839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef832221-3802-446e-a2d0-635f9a1d5871 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.917343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef832221-3802-446e-a2d0-635f9a1d5871 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.920557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef832221-3802-446e-a2d0-635f9a1d5871 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:55.922607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef832221-3802-446e-a2d0-635f9a1d5871 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:55.924045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef832221-3802-446e-a2d0-635f9a1d5871 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:55.941808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:55.983335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7223291f-1b1a-421a-a0d0-3a72838c2c62 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: fead6667-c8f7-4c5d-a46b-150040f0e863] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:56.047081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:56.132437 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7223291f-1b1a-421a-a0d0-3a72838c2c62 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863" status: 204 len: 0 microversion: 2.1 time: 0.273719 Oct 11 19:52:56.137817 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1289/2616] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:55 2022] DELETE /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:56.145854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:56.146983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:56.157946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:56.159627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:56.160660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:56.161668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:56.162595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:56.163806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:56.185828 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] HTTP exception thrown: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Request method failure captured: Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 HTTP/1.1 Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclsyYKdZmpXoi8AI_MmTQf-JAKNS3L5ZMZry14ADD5g5ssIzgBWh7RdlVZTfd0-13Pi2M5tslT9o02tbGHYLbMuaQRx66XjyUCOJCmqRAC3STiO7DegcU-MCJeZMorEfAsD-poMVVdew01sfWs37pPrrydBjUu3X1xy8G67kLMYBLs Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_264dda6e3c7a4280a08204fda9003f54", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}] Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 258cb2ba63914f1a9dc997cc297f787e Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'd4683095-d0c3-42c7-aa5c-203a404a7143'} Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:56.189562 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:56.193551 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:52:56.196062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Returning 404 to user: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:56.200320 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-03744219-93af-4d01-ba4a-c88dc9d912a7 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143" status: 404 len: 111 microversion: 2.1 time: 0.057075 Oct 11 19:52:56.204237 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1290/2617] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:56 2022] DELETE /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:56.257173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ef832221-3802-446e-a2d0-635f9a1d5871 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:56.266250 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ef832221-3802-446e-a2d0-635f9a1d5871 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1682 microversion: 2.1 time: 0.403736 Oct 11 19:52:56.274643 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1328/2618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:55 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1682 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:56.299018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d10c8d99-1da4-4692-8a0f-a5c9745b2a03 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:56.299595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d10c8d99-1da4-4692-8a0f-a5c9745b2a03 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:56.307731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d10c8d99-1da4-4692-8a0f-a5c9745b2a03 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:56.309374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d10c8d99-1da4-4692-8a0f-a5c9745b2a03 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:56.310064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d10c8d99-1da4-4692-8a0f-a5c9745b2a03 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:56.311228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d10c8d99-1da4-4692-8a0f-a5c9745b2a03 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:56.311964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d10c8d99-1da4-4692-8a0f-a5c9745b2a03 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:56.312545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d10c8d99-1da4-4692-8a0f-a5c9745b2a03 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:56.345069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d10c8d99-1da4-4692-8a0f-a5c9745b2a03 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:56.445850 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d10c8d99-1da4-4692-8a0f-a5c9745b2a03 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 204 len: 0 microversion: 2.1 time: 0.156706 Oct 11 19:52:56.446983 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1329/2619] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:56 2022] DELETE /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:56.455286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78cfd4f2-a80b-4840-92f9-ccf2333dd268 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:56.455876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78cfd4f2-a80b-4840-92f9-ccf2333dd268 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: efc7c3f0-fdf4-425e-97c9-534e4f3144a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:56.463380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cfd4f2-a80b-4840-92f9-ccf2333dd268 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:56.463925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cfd4f2-a80b-4840-92f9-ccf2333dd268 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:56.464363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cfd4f2-a80b-4840-92f9-ccf2333dd268 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:56.465054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cfd4f2-a80b-4840-92f9-ccf2333dd268 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:56.466045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cfd4f2-a80b-4840-92f9-ccf2333dd268 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:56.466045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cfd4f2-a80b-4840-92f9-ccf2333dd268 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:56.480527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-983999895", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "179bdb24-2393-4528-a92b-683309c7d75f"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:56.502630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78cfd4f2-a80b-4840-92f9-ccf2333dd268 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: efc7c3f0-fdf4-425e-97c9-534e4f3144a3] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:56.502916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:56.547134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] validate_networks() for [('179bdb24-2393-4528-a92b-683309c7d75f', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:52:56.636169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78cfd4f2-a80b-4840-92f9-ccf2333dd268 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "DELETE /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3" status: 204 len: 0 microversion: 2.1 time: 0.187266 Oct 11 19:52:56.650878 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1330/2620] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:56 2022] DELETE /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:56.661334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dcfe806d-9042-49c6-aba1-007e8e738a00 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:56.661772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dcfe806d-9042-49c6-aba1-007e8e738a00 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:56.670829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dcfe806d-9042-49c6-aba1-007e8e738a00 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:56.671640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dcfe806d-9042-49c6-aba1-007e8e738a00 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:56.673442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dcfe806d-9042-49c6-aba1-007e8e738a00 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:56.674477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dcfe806d-9042-49c6-aba1-007e8e738a00 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:56.675628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dcfe806d-9042-49c6-aba1-007e8e738a00 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:56.676254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dcfe806d-9042-49c6-aba1-007e8e738a00 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:56.945470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dcfe806d-9042-49c6-aba1-007e8e738a00 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:56.967230 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dcfe806d-9042-49c6-aba1-007e8e738a00 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1317 microversion: 2.1 time: 0.306412 Oct 11 19:52:56.968214 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1331/2621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:56 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:56.976326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f4dbd0dc-59fb-4e69-9d49-6619785b535f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:56.977756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f4dbd0dc-59fb-4e69-9d49-6619785b535f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: fead6667-c8f7-4c5d-a46b-150040f0e863] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:56.987920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4dbd0dc-59fb-4e69-9d49-6619785b535f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:56.988627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4dbd0dc-59fb-4e69-9d49-6619785b535f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:56.989313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4dbd0dc-59fb-4e69-9d49-6619785b535f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:56.990403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4dbd0dc-59fb-4e69-9d49-6619785b535f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:56.991160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4dbd0dc-59fb-4e69-9d49-6619785b535f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:56.991748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4dbd0dc-59fb-4e69-9d49-6619785b535f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.282132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f4dbd0dc-59fb-4e69-9d49-6619785b535f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:57.300175 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f4dbd0dc-59fb-4e69-9d49-6619785b535f tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863" status: 200 len: 1511 microversion: 2.1 time: 0.330466 Oct 11 19:52:57.301251 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1332/2622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:56 2022] GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863 => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:57.307243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7a04b78-4bd0-444f-8ceb-8ae6153c9614 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:57.308059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7a04b78-4bd0-444f-8ceb-8ae6153c9614 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:57.315429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7a04b78-4bd0-444f-8ceb-8ae6153c9614 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.316938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7a04b78-4bd0-444f-8ceb-8ae6153c9614 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.317602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7a04b78-4bd0-444f-8ceb-8ae6153c9614 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.318672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7a04b78-4bd0-444f-8ceb-8ae6153c9614 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.319193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7a04b78-4bd0-444f-8ceb-8ae6153c9614 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.319891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7a04b78-4bd0-444f-8ceb-8ae6153c9614 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.349621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7a04b78-4bd0-444f-8ceb-8ae6153c9614 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:52:57.353746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:52:57.354209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:52:57.354708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:52:57.355131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:52:57.355580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:52:57.373304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.373797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.374442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.375294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.376302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.376302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.403840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Getting quotas for project f310bb3ee8be485ab7539076d3572ff5. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:52:57.409810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Getting quotas for user dbecbe35beba44029ba3a09d32330ed5 and project f310bb3ee8be485ab7539076d3572ff5. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:52:57.424928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:52:57.427700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:52:57.470234 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7a04b78-4bd0-444f-8ceb-8ae6153c9614 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 204 len: 0 microversion: 2.1 time: 0.167124 Oct 11 19:52:57.471837 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1333/2623] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:52:57 2022] DELETE /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:52:57.481315 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-25736e5e-ecd8-43eb-b3e9-39061baf2cdf tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.276858 Oct 11 19:52:57.488281 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1291/2624] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:52:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:52:57.491991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d8f55fb9-4a60-4a6a-9c98-6960ce62131c tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:57.493088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d8f55fb9-4a60-4a6a-9c98-6960ce62131c tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:57.494945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f9ea07d-24e3-4654-a2a8-b5de1286498c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:57.495852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f9ea07d-24e3-4654-a2a8-b5de1286498c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:57.503981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f9ea07d-24e3-4654-a2a8-b5de1286498c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.505210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f9ea07d-24e3-4654-a2a8-b5de1286498c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.506282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f9ea07d-24e3-4654-a2a8-b5de1286498c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.507347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d8f55fb9-4a60-4a6a-9c98-6960ce62131c tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.507560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f9ea07d-24e3-4654-a2a8-b5de1286498c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.507754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d8f55fb9-4a60-4a6a-9c98-6960ce62131c tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.507881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f9ea07d-24e3-4654-a2a8-b5de1286498c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.508763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d8f55fb9-4a60-4a6a-9c98-6960ce62131c tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.508984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f9ea07d-24e3-4654-a2a8-b5de1286498c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.510143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d8f55fb9-4a60-4a6a-9c98-6960ce62131c tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.510655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d8f55fb9-4a60-4a6a-9c98-6960ce62131c tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.511266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d8f55fb9-4a60-4a6a-9c98-6960ce62131c tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.651351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-d8f55fb9-4a60-4a6a-9c98-6960ce62131c tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:57.694148 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d8f55fb9-4a60-4a6a-9c98-6960ce62131c tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.220249 Oct 11 19:52:57.697734 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1334/2625] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:57 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:57.719459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2f9ea07d-24e3-4654-a2a8-b5de1286498c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:57.725438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:57.726058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: d4683095-d0c3-42c7-aa5c-203a404a7143] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:57.730027 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f9ea07d-24e3-4654-a2a8-b5de1286498c tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1682 microversion: 2.1 time: 0.239929 Oct 11 19:52:57.730636 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1292/2626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:57 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1682 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:57.737745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6713e264-3c3d-4326-9c5a-cc86d329cdde tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:57.738352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6713e264-3c3d-4326-9c5a-cc86d329cdde tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:57.751165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.751687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.752118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.753235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.753712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.754144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.771215 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] HTTP exception thrown: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Request method failure captured: Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 HTTP/1.1 Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclsyYKdZmpXoi8AI_MmTQf-JAKNS3L5ZMZry14ADD5g5ssIzgBWh7RdlVZTfd0-13Pi2M5tslT9o02tbGHYLbMuaQRx66XjyUCOJCmqRAC3STiO7DegcU-MCJeZMorEfAsD-poMVVdew01sfWs37pPrrydBjUu3X1xy8G67kLMYBLs Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_264dda6e3c7a4280a08204fda9003f54", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}] Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 258cb2ba63914f1a9dc997cc297f787e Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'd4683095-d0c3-42c7-aa5c-203a404a7143'} Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:57.772894 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Returning 404 to user: Instance d4683095-d0c3-42c7-aa5c-203a404a7143 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ce1232f4-a6ee-4b83-a21a-ddb416c56818 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143" status: 404 len: 111 microversion: 2.1 time: 0.061512 Oct 11 19:52:57.778230 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1335/2627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:57 2022] GET /compute/v2.1/servers/d4683095-d0c3-42c7-aa5c-203a404a7143 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:52:57.785106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e475b5a-f5e9-4c36-b96d-7ea678238cb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:57.785655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e475b5a-f5e9-4c36-b96d-7ea678238cb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: efc7c3f0-fdf4-425e-97c9-534e4f3144a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:57.794789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e475b5a-f5e9-4c36-b96d-7ea678238cb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.795280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e475b5a-f5e9-4c36-b96d-7ea678238cb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.795935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e475b5a-f5e9-4c36-b96d-7ea678238cb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.796486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e475b5a-f5e9-4c36-b96d-7ea678238cb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:57.796941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e475b5a-f5e9-4c36-b96d-7ea678238cb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:57.797365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e475b5a-f5e9-4c36-b96d-7ea678238cb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:57.840903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6713e264-3c3d-4326-9c5a-cc86d329cdde tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:57.849322 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6713e264-3c3d-4326-9c5a-cc86d329cdde tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1224 microversion: 2.1 time: 0.117216 Oct 11 19:52:57.850039 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1293/2628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:57 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:57.989630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e475b5a-f5e9-4c36-b96d-7ea678238cb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:57.992154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb2ad280-1906-490e-8618-217677f695a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:57.993289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cb2ad280-1906-490e-8618-217677f695a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:58.002262 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e475b5a-f5e9-4c36-b96d-7ea678238cb4 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3" status: 200 len: 1521 microversion: 2.1 time: 0.220757 Oct 11 19:52:58.003990 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1336/2629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:57 2022] GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:58.004609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb2ad280-1906-490e-8618-217677f695a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:58.005561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb2ad280-1906-490e-8618-217677f695a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:58.006050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb2ad280-1906-490e-8618-217677f695a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:58.009906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb2ad280-1906-490e-8618-217677f695a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:58.011834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb2ad280-1906-490e-8618-217677f695a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:58.012459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb2ad280-1906-490e-8618-217677f695a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:58.188506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb2ad280-1906-490e-8618-217677f695a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:58.239504 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cb2ad280-1906-490e-8618-217677f695a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1317 microversion: 2.1 time: 0.251630 Oct 11 19:52:58.240113 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1294/2630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:57 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:58.326043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ba93a1b-c94c-4444-9d66-07aea983bd0d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:58.326801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ba93a1b-c94c-4444-9d66-07aea983bd0d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: fead6667-c8f7-4c5d-a46b-150040f0e863] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:58.328780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:58.334097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ba93a1b-c94c-4444-9d66-07aea983bd0d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:58.337993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ba93a1b-c94c-4444-9d66-07aea983bd0d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:58.340931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ba93a1b-c94c-4444-9d66-07aea983bd0d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:58.341977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ba93a1b-c94c-4444-9d66-07aea983bd0d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:58.342713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ba93a1b-c94c-4444-9d66-07aea983bd0d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:58.343370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ba93a1b-c94c-4444-9d66-07aea983bd0d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:58.530922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8ba93a1b-c94c-4444-9d66-07aea983bd0d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:58.540394 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ba93a1b-c94c-4444-9d66-07aea983bd0d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863" status: 200 len: 1511 microversion: 2.1 time: 0.218183 Oct 11 19:52:58.541351 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1337/2631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:58 2022] GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:58.728438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ebd208e-202c-4160-a7f3-fc3786567bbd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:58.729042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1ebd208e-202c-4160-a7f3-fc3786567bbd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:58.737755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebd208e-202c-4160-a7f3-fc3786567bbd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:58.738253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebd208e-202c-4160-a7f3-fc3786567bbd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:58.738762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebd208e-202c-4160-a7f3-fc3786567bbd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:58.739626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebd208e-202c-4160-a7f3-fc3786567bbd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:58.740515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebd208e-202c-4160-a7f3-fc3786567bbd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:58.741111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebd208e-202c-4160-a7f3-fc3786567bbd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:58.760895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54bc517f-8132-46f2-9c34-5fb62aadd251 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:58.761788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-54bc517f-8132-46f2-9c34-5fb62aadd251 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:58.771144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bc517f-8132-46f2-9c34-5fb62aadd251 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:58.772842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bc517f-8132-46f2-9c34-5fb62aadd251 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:58.773548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bc517f-8132-46f2-9c34-5fb62aadd251 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:58.779338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bc517f-8132-46f2-9c34-5fb62aadd251 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:58.780128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bc517f-8132-46f2-9c34-5fb62aadd251 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:58.780833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54bc517f-8132-46f2-9c34-5fb62aadd251 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:58.843315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-1ebd208e-202c-4160-a7f3-fc3786567bbd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:52:58.879873 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1ebd208e-202c-4160-a7f3-fc3786567bbd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.155878 Oct 11 19:52:58.900071 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1295/2632] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:58 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:52:58.911910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c4fb5b4b-605e-4956-ac06-20b7e2c5da1e tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:58.913396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4fb5b4b-605e-4956-ac06-20b7e2c5da1e tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:58.923807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4fb5b4b-605e-4956-ac06-20b7e2c5da1e tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:58.924805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4fb5b4b-605e-4956-ac06-20b7e2c5da1e tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:58.925613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4fb5b4b-605e-4956-ac06-20b7e2c5da1e tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:58.927559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4fb5b4b-605e-4956-ac06-20b7e2c5da1e tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:58.928375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4fb5b4b-605e-4956-ac06-20b7e2c5da1e tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:58.929249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4fb5b4b-605e-4956-ac06-20b7e2c5da1e tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:59.021274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c4fb5b4b-605e-4956-ac06-20b7e2c5da1e tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:59.024727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54bc517f-8132-46f2-9c34-5fb62aadd251 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:59.033559 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c4fb5b4b-605e-4956-ac06-20b7e2c5da1e tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1228 microversion: 2.1 time: 0.130455 Oct 11 19:52:59.033826 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-54bc517f-8132-46f2-9c34-5fb62aadd251 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1682 microversion: 2.1 time: 0.276443 Oct 11 19:52:59.034944 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1338/2633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:58 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1682 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:52:59.040418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5db88fd2-7d3c-4146-9ce1-96d29e38dd2e tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:59.041244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5db88fd2-7d3c-4146-9ce1-96d29e38dd2e tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: efc7c3f0-fdf4-425e-97c9-534e4f3144a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:59.047231 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1296/2634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:58 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1228 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:59.047774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5db88fd2-7d3c-4146-9ce1-96d29e38dd2e tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:59.048464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5db88fd2-7d3c-4146-9ce1-96d29e38dd2e tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:59.049091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5db88fd2-7d3c-4146-9ce1-96d29e38dd2e tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:59.049983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5db88fd2-7d3c-4146-9ce1-96d29e38dd2e tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:59.050678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5db88fd2-7d3c-4146-9ce1-96d29e38dd2e tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:59.051287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5db88fd2-7d3c-4146-9ce1-96d29e38dd2e tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:59.197972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5db88fd2-7d3c-4146-9ce1-96d29e38dd2e tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:59.208233 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5db88fd2-7d3c-4146-9ce1-96d29e38dd2e tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3" status: 200 len: 1521 microversion: 2.1 time: 0.172071 Oct 11 19:52:59.208972 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1339/2635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:59 2022] GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:59.263695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2164a06a-d52e-4531-9fce-6ed17cfb9906 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:59.265012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2164a06a-d52e-4531-9fce-6ed17cfb9906 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:59.272344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2164a06a-d52e-4531-9fce-6ed17cfb9906 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:59.272928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2164a06a-d52e-4531-9fce-6ed17cfb9906 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:59.273515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2164a06a-d52e-4531-9fce-6ed17cfb9906 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:59.274405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2164a06a-d52e-4531-9fce-6ed17cfb9906 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:59.275000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2164a06a-d52e-4531-9fce-6ed17cfb9906 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:59.275433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2164a06a-d52e-4531-9fce-6ed17cfb9906 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:59.512667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2164a06a-d52e-4531-9fce-6ed17cfb9906 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:52:59.529502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2164a06a-d52e-4531-9fce-6ed17cfb9906 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1317 microversion: 2.1 time: 0.269834 Oct 11 19:52:59.530654 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1297/2636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:59 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:52:59.566834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3db00f40-a000-40be-9b6e-7f6997ba0a3e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:59.567667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3db00f40-a000-40be-9b6e-7f6997ba0a3e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: fead6667-c8f7-4c5d-a46b-150040f0e863] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:59.579192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3db00f40-a000-40be-9b6e-7f6997ba0a3e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:59.580061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3db00f40-a000-40be-9b6e-7f6997ba0a3e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:59.580717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3db00f40-a000-40be-9b6e-7f6997ba0a3e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:59.581612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3db00f40-a000-40be-9b6e-7f6997ba0a3e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:59.582258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3db00f40-a000-40be-9b6e-7f6997ba0a3e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:59.582916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3db00f40-a000-40be-9b6e-7f6997ba0a3e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:59.588964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:52:59.656084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ab283ecd-5d47-4389-b1c5-5c23de6724f5 req-6a062453-5d49-4454-b30a-00e1ff49e8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0929e96c-9da0-4034-ae0e-38f7330002f5", "name": "network-vif-plugged", "status": "completed", "tag": "71f8f1b2-5864-4201-894f-6d7e1edc96c4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:52:59.672574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab283ecd-5d47-4389-b1c5-5c23de6724f5 req-6a062453-5d49-4454-b30a-00e1ff49e8f4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:59.682966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab283ecd-5d47-4389-b1c5-5c23de6724f5 req-6a062453-5d49-4454-b30a-00e1ff49e8f4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:59.684006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab283ecd-5d47-4389-b1c5-5c23de6724f5 req-6a062453-5d49-4454-b30a-00e1ff49e8f4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:59.704638 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ab283ecd-5d47-4389-b1c5-5c23de6724f5 req-6a062453-5d49-4454-b30a-00e1ff49e8f4 service nova] Creating event network-vif-plugged:71f8f1b2-5864-4201-894f-6d7e1edc96c4 for instance 0929e96c-9da0-4034-ae0e-38f7330002f5 on n-h2-860864-3 Oct 11 19:52:59.713640 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ab283ecd-5d47-4389-b1c5-5c23de6724f5 req-6a062453-5d49-4454-b30a-00e1ff49e8f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062065 Oct 11 19:52:59.715297 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1298/2637] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:52:59.918752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-86e2f085-8ad6-4797-8fc9-e68ca762fa6d tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:52:59.920303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-86e2f085-8ad6-4797-8fc9-e68ca762fa6d tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:52:59.928172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86e2f085-8ad6-4797-8fc9-e68ca762fa6d tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:59.928973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86e2f085-8ad6-4797-8fc9-e68ca762fa6d tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:59.929573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86e2f085-8ad6-4797-8fc9-e68ca762fa6d tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:52:59.931217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86e2f085-8ad6-4797-8fc9-e68ca762fa6d tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:52:59.931846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86e2f085-8ad6-4797-8fc9-e68ca762fa6d tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:52:59.932431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-86e2f085-8ad6-4797-8fc9-e68ca762fa6d tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:00.104588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-86e2f085-8ad6-4797-8fc9-e68ca762fa6d tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:00.137321 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-86e2f085-8ad6-4797-8fc9-e68ca762fa6d tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.224718 Oct 11 19:53:00.138477 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1299/2638] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:52:59 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:53:00.144550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec75472d-0545-4026-aa4c-0aae5315af1f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:00.145406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ec75472d-0545-4026-aa4c-0aae5315af1f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:00.155472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec75472d-0545-4026-aa4c-0aae5315af1f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:00.156187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec75472d-0545-4026-aa4c-0aae5315af1f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:00.156782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec75472d-0545-4026-aa4c-0aae5315af1f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:00.157703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec75472d-0545-4026-aa4c-0aae5315af1f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:00.158324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec75472d-0545-4026-aa4c-0aae5315af1f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:00.159023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec75472d-0545-4026-aa4c-0aae5315af1f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:00.764884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3db00f40-a000-40be-9b6e-7f6997ba0a3e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:00.772907 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3db00f40-a000-40be-9b6e-7f6997ba0a3e tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863" status: 200 len: 1511 microversion: 2.1 time: 1.211034 Oct 11 19:53:00.787133 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1340/2639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:52:59 2022] GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863 => generated 1511 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:00.795720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70edafe8-244a-461c-ba2b-7a103f38a620 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:00.796562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-70edafe8-244a-461c-ba2b-7a103f38a620 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:00.802958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70edafe8-244a-461c-ba2b-7a103f38a620 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:00.803647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70edafe8-244a-461c-ba2b-7a103f38a620 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:00.804433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70edafe8-244a-461c-ba2b-7a103f38a620 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:00.805400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70edafe8-244a-461c-ba2b-7a103f38a620 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:00.806092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70edafe8-244a-461c-ba2b-7a103f38a620 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:00.806697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70edafe8-244a-461c-ba2b-7a103f38a620 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:01.041056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-70edafe8-244a-461c-ba2b-7a103f38a620 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:01.049698 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-70edafe8-244a-461c-ba2b-7a103f38a620 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1284 microversion: 2.1 time: 0.261071 Oct 11 19:53:01.051023 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1341/2640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:00 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:01.069546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-912b6af7-59c5-4bf9-9ce8-9a0a9a51d4f9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:01.070159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-912b6af7-59c5-4bf9-9ce8-9a0a9a51d4f9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: efc7c3f0-fdf4-425e-97c9-534e4f3144a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:01.084105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-912b6af7-59c5-4bf9-9ce8-9a0a9a51d4f9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:01.084774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-912b6af7-59c5-4bf9-9ce8-9a0a9a51d4f9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:01.085315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-912b6af7-59c5-4bf9-9ce8-9a0a9a51d4f9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:01.086225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-912b6af7-59c5-4bf9-9ce8-9a0a9a51d4f9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:01.087488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-912b6af7-59c5-4bf9-9ce8-9a0a9a51d4f9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:01.088014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-912b6af7-59c5-4bf9-9ce8-9a0a9a51d4f9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:01.163521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec75472d-0545-4026-aa4c-0aae5315af1f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:01.176989 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ec75472d-0545-4026-aa4c-0aae5315af1f tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1682 microversion: 2.1 time: 1.036315 Oct 11 19:53:01.178899 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1300/2641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:00 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1682 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:01.204983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a19f505e-eeee-4644-960a-9640acca308f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:01.207529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a19f505e-eeee-4644-960a-9640acca308f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:01.231702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a19f505e-eeee-4644-960a-9640acca308f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:01.232468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a19f505e-eeee-4644-960a-9640acca308f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:01.233846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a19f505e-eeee-4644-960a-9640acca308f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:01.236501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a19f505e-eeee-4644-960a-9640acca308f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:01.237998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a19f505e-eeee-4644-960a-9640acca308f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:01.238653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a19f505e-eeee-4644-960a-9640acca308f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:01.891863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-912b6af7-59c5-4bf9-9ce8-9a0a9a51d4f9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:01.913004 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-912b6af7-59c5-4bf9-9ce8-9a0a9a51d4f9 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3" status: 200 len: 1521 microversion: 2.1 time: 0.860607 Oct 11 19:53:01.934815 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1342/2642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:01 2022] GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3 => generated 1521 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:01.944415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-445f3f3c-5a1e-4e84-bbc5-85521c96a5e1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:01.948453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-445f3f3c-5a1e-4e84-bbc5-85521c96a5e1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:01.964131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-445f3f3c-5a1e-4e84-bbc5-85521c96a5e1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:01.966339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-445f3f3c-5a1e-4e84-bbc5-85521c96a5e1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:01.967175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-445f3f3c-5a1e-4e84-bbc5-85521c96a5e1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:01.969638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-445f3f3c-5a1e-4e84-bbc5-85521c96a5e1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:01.970596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-445f3f3c-5a1e-4e84-bbc5-85521c96a5e1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:01.972460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-445f3f3c-5a1e-4e84-bbc5-85521c96a5e1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.044977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a19f505e-eeee-4644-960a-9640acca308f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:02.055949 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a19f505e-eeee-4644-960a-9640acca308f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1317 microversion: 2.1 time: 0.874703 Oct 11 19:53:02.069659 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1301/2643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:01 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1317 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:02.085529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-2f8c303d-c6c4-48b3-89b4-b46d5b9bae45 req-e9dc7fbf-33cc-4413-8907-eb135f4e541d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fead6667-c8f7-4c5d-a46b-150040f0e863", "name": "network-vif-deleted", "tag": "3bf3cb15-f7ba-4733-b3d9-b660d06e3908"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:02.114509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2f8c303d-c6c4-48b3-89b4-b46d5b9bae45 req-e9dc7fbf-33cc-4413-8907-eb135f4e541d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.115271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2f8c303d-c6c4-48b3-89b4-b46d5b9bae45 req-e9dc7fbf-33cc-4413-8907-eb135f4e541d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.116605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2f8c303d-c6c4-48b3-89b4-b46d5b9bae45 req-e9dc7fbf-33cc-4413-8907-eb135f4e541d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.154109 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2f8c303d-c6c4-48b3-89b4-b46d5b9bae45 req-e9dc7fbf-33cc-4413-8907-eb135f4e541d service nova] Creating event network-vif-deleted:3bf3cb15-f7ba-4733-b3d9-b660d06e3908 for instance fead6667-c8f7-4c5d-a46b-150040f0e863 on n-h1-860864-3 Oct 11 19:53:02.164490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-445f3f3c-5a1e-4e84-bbc5-85521c96a5e1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:02.168350 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-2f8c303d-c6c4-48b3-89b4-b46d5b9bae45 req-e9dc7fbf-33cc-4413-8907-eb135f4e541d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094238 Oct 11 19:53:02.168966 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1302/2644] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:02.185904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b2f1facf-9857-4423-92b8-c2c1731d886e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:02.186516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b2f1facf-9857-4423-92b8-c2c1731d886e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:02.202620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2f1facf-9857-4423-92b8-c2c1731d886e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.203198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2f1facf-9857-4423-92b8-c2c1731d886e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.206351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2f1facf-9857-4423-92b8-c2c1731d886e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.207325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2f1facf-9857-4423-92b8-c2c1731d886e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.207980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2f1facf-9857-4423-92b8-c2c1731d886e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.208614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2f1facf-9857-4423-92b8-c2c1731d886e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.244716 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-445f3f3c-5a1e-4e84-bbc5-85521c96a5e1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.298637 Oct 11 19:53:02.274883 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1343/2645] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:01 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:02.283636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c5a99060-8696-49e4-ad89-0dc82f9e5dd1 req-5cdaacb2-5ac6-4a6e-9dc2-ceb58ee53643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1f8956-214c-4f94-b8a9-c7bb03b56104", "name": "network-vif-plugged", "status": "completed", "tag": "3003e5ed-e486-4f4c-954b-6ab7b07147e9"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:02.303331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c5a99060-8696-49e4-ad89-0dc82f9e5dd1 req-5cdaacb2-5ac6-4a6e-9dc2-ceb58ee53643 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.306800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c5a99060-8696-49e4-ad89-0dc82f9e5dd1 req-5cdaacb2-5ac6-4a6e-9dc2-ceb58ee53643 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.309527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c5a99060-8696-49e4-ad89-0dc82f9e5dd1 req-5cdaacb2-5ac6-4a6e-9dc2-ceb58ee53643 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.343593 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c5a99060-8696-49e4-ad89-0dc82f9e5dd1 req-5cdaacb2-5ac6-4a6e-9dc2-ceb58ee53643 service nova] Creating event network-vif-plugged:3003e5ed-e486-4f4c-954b-6ab7b07147e9 for instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 on n-h1-860864-3 Oct 11 19:53:02.356519 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c5a99060-8696-49e4-ad89-0dc82f9e5dd1 req-5cdaacb2-5ac6-4a6e-9dc2-ceb58ee53643 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078942 Oct 11 19:53:02.363133 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1344/2646] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:02.380358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:02.381233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: fead6667-c8f7-4c5d-a46b-150040f0e863] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:02.400311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.401166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.403196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.404654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.406696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.408603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.449269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-b2f1facf-9857-4423-92b8-c2c1731d886e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lazy-loading 'services' on Instance uuid 5db170ae-e6b1-4057-8d54-6bba8c210919 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:02.463981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.465190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.465830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.466480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lazy-loading 'fault' on Instance uuid fead6667-c8f7-4c5d-a46b-150040f0e863 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:02.625796 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b2f1facf-9857-4423-92b8-c2c1731d886e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/os-volume_attachments/08f4f5cb-024a-4616-b88a-2d161557dea0" status: 202 len: 0 microversion: 2.1 time: 0.438503 Oct 11 19:53:02.630436 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1303/2647] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 19:53:02 2022] DELETE /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/os-volume_attachments/08f4f5cb-024a-4616-b88a-2d161557dea0 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:53:02.634894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc438ee89be4ecca0895c161377c9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf853b49896343b7852bb83640b7ef73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:02.649596 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d38d8d4f-bb74-4435-944d-3dbe919d6b25 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863" status: 200 len: 1308 microversion: 2.1 time: 0.280643 Oct 11 19:53:02.653766 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1345/2648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:02 2022] GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863 => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:02.672977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5049c6ce-343e-4696-910a-ccf90ba23bfe tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:02.673737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-401b4c22-10f0-42c2-9b9c-e31f328a4820 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:02.674336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5049c6ce-343e-4696-910a-ccf90ba23bfe tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:02.675358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-401b4c22-10f0-42c2-9b9c-e31f328a4820 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:02.688307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401b4c22-10f0-42c2-9b9c-e31f328a4820 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.689664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5049c6ce-343e-4696-910a-ccf90ba23bfe tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.690735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401b4c22-10f0-42c2-9b9c-e31f328a4820 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.692088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401b4c22-10f0-42c2-9b9c-e31f328a4820 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.692836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401b4c22-10f0-42c2-9b9c-e31f328a4820 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.693137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5049c6ce-343e-4696-910a-ccf90ba23bfe tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.693777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5049c6ce-343e-4696-910a-ccf90ba23bfe tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.694987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5049c6ce-343e-4696-910a-ccf90ba23bfe tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:02.697703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5049c6ce-343e-4696-910a-ccf90ba23bfe tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.698325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5049c6ce-343e-4696-910a-ccf90ba23bfe tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:02.700373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401b4c22-10f0-42c2-9b9c-e31f328a4820 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:02.700982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401b4c22-10f0-42c2-9b9c-e31f328a4820 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:03.051951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5049c6ce-343e-4696-910a-ccf90ba23bfe tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:03.067980 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5049c6ce-343e-4696-910a-ccf90ba23bfe tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1282 microversion: 2.1 time: 0.432666 Oct 11 19:53:03.068936 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1304/2649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:02 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1282 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:03.087717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4cb8f89f-161e-4806-b227-03fc833ac39a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:03.088942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4cb8f89f-161e-4806-b227-03fc833ac39a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: efc7c3f0-fdf4-425e-97c9-534e4f3144a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:03.116118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cb8f89f-161e-4806-b227-03fc833ac39a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:03.118593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cb8f89f-161e-4806-b227-03fc833ac39a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:03.119166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cb8f89f-161e-4806-b227-03fc833ac39a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:03.120115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cb8f89f-161e-4806-b227-03fc833ac39a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:03.122230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cb8f89f-161e-4806-b227-03fc833ac39a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:03.123374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cb8f89f-161e-4806-b227-03fc833ac39a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:03.143649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-401b4c22-10f0-42c2-9b9c-e31f328a4820 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:03.152712 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-401b4c22-10f0-42c2-9b9c-e31f328a4820 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1615 microversion: 2.1 time: 0.497521 Oct 11 19:53:03.173674 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1346/2650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:02 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1615 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:03.182069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-75c7b03a-d882-4211-8aac-d1603cf047d5 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:03.183104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-75c7b03a-d882-4211-8aac-d1603cf047d5 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:03.190584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75c7b03a-d882-4211-8aac-d1603cf047d5 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:03.191249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75c7b03a-d882-4211-8aac-d1603cf047d5 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:03.192059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75c7b03a-d882-4211-8aac-d1603cf047d5 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:03.192929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75c7b03a-d882-4211-8aac-d1603cf047d5 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:03.193546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75c7b03a-d882-4211-8aac-d1603cf047d5 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:03.194813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75c7b03a-d882-4211-8aac-d1603cf047d5 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:03.425594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4cb8f89f-161e-4806-b227-03fc833ac39a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258cb2ba63914f1a9dc997cc297f787e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264dda6e3c7a4280a08204fda9003f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:03.434838 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4cb8f89f-161e-4806-b227-03fc833ac39a tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3" status: 200 len: 1479 microversion: 2.1 time: 0.361978 Oct 11 19:53:03.435428 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1305/2651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:03 2022] GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3 => generated 1479 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:03.475797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a37e2fdb-b8fb-492f-ae01-3a7ec548822c req-a4feabe0-0bcb-4ba1-a991-2d2e7c6c6dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc7c3f0-fdf4-425e-97c9-534e4f3144a3", "name": "network-vif-deleted", "tag": "16be72e7-e842-4ef5-9aa9-2df41883dbfe"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:03.524872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a37e2fdb-b8fb-492f-ae01-3a7ec548822c req-a4feabe0-0bcb-4ba1-a991-2d2e7c6c6dac service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:03.525627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a37e2fdb-b8fb-492f-ae01-3a7ec548822c req-a4feabe0-0bcb-4ba1-a991-2d2e7c6c6dac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:03.527005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a37e2fdb-b8fb-492f-ae01-3a7ec548822c req-a4feabe0-0bcb-4ba1-a991-2d2e7c6c6dac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:03.564841 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a37e2fdb-b8fb-492f-ae01-3a7ec548822c req-a4feabe0-0bcb-4ba1-a991-2d2e7c6c6dac service nova] Creating event network-vif-deleted:16be72e7-e842-4ef5-9aa9-2df41883dbfe for instance efc7c3f0-fdf4-425e-97c9-534e4f3144a3 on n-h2-860864-3 Oct 11 19:53:03.578863 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a37e2fdb-b8fb-492f-ae01-3a7ec548822c req-a4feabe0-0bcb-4ba1-a991-2d2e7c6c6dac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140917 Oct 11 19:53:03.580025 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1306/2652] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:03.593031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-88895f0c-c3cf-4d7c-b933-35510ec1c595 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:03.595630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-88895f0c-c3cf-4d7c-b933-35510ec1c595 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:03.617074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88895f0c-c3cf-4d7c-b933-35510ec1c595 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:03.620877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88895f0c-c3cf-4d7c-b933-35510ec1c595 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:03.621583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88895f0c-c3cf-4d7c-b933-35510ec1c595 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:03.624050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88895f0c-c3cf-4d7c-b933-35510ec1c595 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:03.624804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88895f0c-c3cf-4d7c-b933-35510ec1c595 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:03.627521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88895f0c-c3cf-4d7c-b933-35510ec1c595 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:03.786957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=12 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:03.963107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=18 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:04.526808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-88895f0c-c3cf-4d7c-b933-35510ec1c595 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:04.537011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-75c7b03a-d882-4211-8aac-d1603cf047d5 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:04.549524 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-75c7b03a-d882-4211-8aac-d1603cf047d5 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1317 microversion: 2.1 time: 1.374289 Oct 11 19:53:04.550337 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1347/2653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:03 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1317 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:04.563287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:04.566571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: fead6667-c8f7-4c5d-a46b-150040f0e863] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:04.581102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:04.581226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:04.581614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:04.593472 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-88895f0c-c3cf-4d7c-b933-35510ec1c595 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 1.010456 Oct 11 19:53:04.595557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:04.596284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:04.596970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:04.597690 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1307/2654] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:03 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:04.622039 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] HTTP exception thrown: Instance fead6667-c8f7-4c5d-a46b-150040f0e863 could not be found. Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Request method failure captured: Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863 HTTP/1.1 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclgz6UKqkB4Ox6Upo2uZQq4VVZBN2IZQ9I4mFVNkcaU7ZekkTP3IJ7vVlLLATuCb7Oa7I82wSxuaTpXNS53cElfP7R5458QC7nMBleHemhrbI7UvqNXGfyWgIU39sEorjDL0U0lroqW5eIHN87ldiInV7_FhNN9OLaK7-yGKicCkV0 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bf853b49896343b7852bb83640b7ef73 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-MultipleCreateTestJSON-473280983 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf853b49896343b7852bb83640b7ef73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf853b49896343b7852bb83640b7ef73", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf853b49896343b7852bb83640b7ef73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf853b49896343b7852bb83640b7ef73"}]}] Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-MultipleCreateTestJSON-473280983 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bf853b49896343b7852bb83640b7ef73 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-MultipleCreateTestJSON-473280983 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-MultipleCreateTestJSON-473280983-project Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 6fc438ee89be4ecca0895c161377c9c3 Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-MultipleCreateTestJSON-473280983-project Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance fead6667-c8f7-4c5d-a46b-150040f0e863 could not be found. Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'fead6667-c8f7-4c5d-a46b-150040f0e863'} Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fead6667-c8f7-4c5d-a46b-150040f0e863 could not be found. Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fead6667-c8f7-4c5d-a46b-150040f0e863 could not be found. Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:04.628765 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:04.634186 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:04.634186 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:04.634186 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:04.634186 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:53:04.634186 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:53:04.634186 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fead6667-c8f7-4c5d-a46b-150040f0e863 could not be found. Oct 11 19:53:04.634186 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:04.634628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-27fe86ec-8665-4863-94ff-a1a5b8b3536c tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:04.634628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-27fe86ec-8665-4863-94ff-a1a5b8b3536c tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:04.635733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Returning 404 to user: Instance fead6667-c8f7-4c5d-a46b-150040f0e863 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:53:04.636959 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-47932795-d961-42c6-8797-85a6c0ac5d42 tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863" status: 404 len: 111 microversion: 2.1 time: 0.084490 Oct 11 19:53:04.638249 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1348/2655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:04 2022] GET /compute/v2.1/servers/fead6667-c8f7-4c5d-a46b-150040f0e863 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:53:04.645281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-047c5ef1-b904-4a2b-82d0-1d969ca93065 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:04.649560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-047c5ef1-b904-4a2b-82d0-1d969ca93065 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:04.663221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-047c5ef1-b904-4a2b-82d0-1d969ca93065 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:04.667323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-047c5ef1-b904-4a2b-82d0-1d969ca93065 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:04.668166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27fe86ec-8665-4863-94ff-a1a5b8b3536c tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:04.668670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27fe86ec-8665-4863-94ff-a1a5b8b3536c tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:04.669115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27fe86ec-8665-4863-94ff-a1a5b8b3536c tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:04.669434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-047c5ef1-b904-4a2b-82d0-1d969ca93065 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:04.669822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27fe86ec-8665-4863-94ff-a1a5b8b3536c tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:04.670277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27fe86ec-8665-4863-94ff-a1a5b8b3536c tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:04.670839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27fe86ec-8665-4863-94ff-a1a5b8b3536c tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:04.672957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-047c5ef1-b904-4a2b-82d0-1d969ca93065 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:04.673623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-047c5ef1-b904-4a2b-82d0-1d969ca93065 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:04.674246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-047c5ef1-b904-4a2b-82d0-1d969ca93065 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:04.739676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:05.035530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-047c5ef1-b904-4a2b-82d0-1d969ca93065 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34a23ce45c8419693d5fb67010548ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104b4ee892e441b79f520b0591ec0e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:05.051018 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-047c5ef1-b904-4a2b-82d0-1d969ca93065 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 200 len: 1615 microversion: 2.1 time: 0.411194 Oct 11 19:53:05.064783 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1349/2656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:04 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 1615 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:05.088704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-eadc890f-cbf8-4e6c-bb67-0ac63dff1129 req-1d8f3a6c-23b3-4ce4-8c0e-39adf9b3c881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768", "name": "network-vif-deleted", "tag": "031b5fb2-9390-4322-88f9-961fd24d7144"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:05.126344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-eadc890f-cbf8-4e6c-bb67-0ac63dff1129 req-1d8f3a6c-23b3-4ce4-8c0e-39adf9b3c881 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.127314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-eadc890f-cbf8-4e6c-bb67-0ac63dff1129 req-1d8f3a6c-23b3-4ce4-8c0e-39adf9b3c881 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.127990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-eadc890f-cbf8-4e6c-bb67-0ac63dff1129 req-1d8f3a6c-23b3-4ce4-8c0e-39adf9b3c881 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.143928 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-eadc890f-cbf8-4e6c-bb67-0ac63dff1129 req-1d8f3a6c-23b3-4ce4-8c0e-39adf9b3c881 service nova] Creating event network-vif-deleted:031b5fb2-9390-4322-88f9-961fd24d7144 for instance e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 on n-h1-860864-3 Oct 11 19:53:05.165888 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-eadc890f-cbf8-4e6c-bb67-0ac63dff1129 req-1d8f3a6c-23b3-4ce4-8c0e-39adf9b3c881 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084159 Oct 11 19:53:05.167293 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1350/2657] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:05.184232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:05.192877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: efc7c3f0-fdf4-425e-97c9-534e4f3144a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:05.194588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-27fe86ec-8665-4863-94ff-a1a5b8b3536c tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:05.200710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.201394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.202009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.203491 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-27fe86ec-8665-4863-94ff-a1a5b8b3536c tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1324 microversion: 2.1 time: 0.604611 Oct 11 19:53:05.203705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.204188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.204978 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1308/2658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:04 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1324 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:05.206360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.215352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:05.216281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] [instance: b2931952-99d6-499e-afc6-c6cad13d6f13] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:05.234858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.237591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.239244 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] HTTP exception thrown: Instance efc7c3f0-fdf4-425e-97c9-534e4f3144a3 could not be found. Oct 11 19:53:05.240906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.241679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Request method failure captured: Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3 HTTP/1.1 Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclsyYKdZmpXoi8AI_MmTQf-JAKNS3L5ZMZry14ADD5g5ssIzgBWh7RdlVZTfd0-13Pi2M5tslT9o02tbGHYLbMuaQRx66XjyUCOJCmqRAC3STiO7DegcU-MCJeZMorEfAsD-poMVVdew01sfWs37pPrrydBjUu3X1xy8G67kLMYBLs Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_264dda6e3c7a4280a08204fda9003f54", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}] Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 258cb2ba63914f1a9dc997cc297f787e Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance efc7c3f0-fdf4-425e-97c9-534e4f3144a3 could not be found. Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'efc7c3f0-fdf4-425e-97c9-534e4f3144a3'} Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc7c3f0-fdf4-425e-97c9-534e4f3144a3 could not be found. Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc7c3f0-fdf4-425e-97c9-534e4f3144a3 could not be found. Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.244753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:05.249204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.249204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:05.249204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:05.249204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:05.249204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:53:05.249204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:53:05.249204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc7c3f0-fdf4-425e-97c9-534e4f3144a3 could not be found. Oct 11 19:53:05.249204 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.249783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.249783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.252680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Returning 404 to user: Instance efc7c3f0-fdf4-425e-97c9-534e4f3144a3 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:53:05.253905 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f91f102a-cdbb-46da-b5f6-02127dda6092 tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3" status: 404 len: 111 microversion: 2.1 time: 0.083693 Oct 11 19:53:05.256685 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1351/2659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:05 2022] GET /compute/v2.1/servers/efc7c3f0-fdf4-425e-97c9-534e4f3144a3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:53:05.265598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:05.269479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] [instance: e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:05.284286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.285046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.285647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.286549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.287525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.288238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.296253 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] HTTP exception thrown: Instance b2931952-99d6-499e-afc6-c6cad13d6f13 could not be found. Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Request method failure captured: Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 HTTP/1.1 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRclgz6UKqkB4Ox6Upo2uZQq4VVZBN2IZQ9I4mFVNkcaU7ZekkTP3IJ7vVlLLATuCb7Oa7I82wSxuaTpXNS53cElfP7R5458QC7nMBleHemhrbI7UvqNXGfyWgIU39sEorjDL0U0lroqW5eIHN87ldiInV7_FhNN9OLaK7-yGKicCkV0 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bf853b49896343b7852bb83640b7ef73 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-MultipleCreateTestJSON-473280983 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf853b49896343b7852bb83640b7ef73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf853b49896343b7852bb83640b7ef73", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf853b49896343b7852bb83640b7ef73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf853b49896343b7852bb83640b7ef73"}]}] Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-MultipleCreateTestJSON-473280983 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bf853b49896343b7852bb83640b7ef73 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-MultipleCreateTestJSON-473280983 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-MultipleCreateTestJSON-473280983-project Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 6fc438ee89be4ecca0895c161377c9c3 Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-MultipleCreateTestJSON-473280983-project Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance b2931952-99d6-499e-afc6-c6cad13d6f13 could not be found. Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'b2931952-99d6-499e-afc6-c6cad13d6f13'} Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2931952-99d6-499e-afc6-c6cad13d6f13 could not be found. Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2931952-99d6-499e-afc6-c6cad13d6f13 could not be found. Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:05.298301 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.303237 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:05.303237 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:05.303237 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:05.303237 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:53:05.303237 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:53:05.303237 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2931952-99d6-499e-afc6-c6cad13d6f13 could not be found. Oct 11 19:53:05.303237 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.306724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] Returning 404 to user: Instance b2931952-99d6-499e-afc6-c6cad13d6f13 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:53:05.307790 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3c5a0621-84a1-40b7-a40d-e1da1593aa8d tempest-MultipleCreateTestJSON-473280983 tempest-MultipleCreateTestJSON-473280983-project] 10.222.0.27 "GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13" status: 404 len: 111 microversion: 2.1 time: 0.101764 Oct 11 19:53:05.308854 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1309/2660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:05 2022] GET /compute/v2.1/servers/b2931952-99d6-499e-afc6-c6cad13d6f13 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:53:05.320151 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] HTTP exception thrown: Instance e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 could not be found. Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Request method failure captured: Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 HTTP/1.1 Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclsyYKdZmpXoi8AI_MmTQf-JAKNS3L5ZMZry14ADD5g5ssIzgBWh7RdlVZTfd0-13Pi2M5tslT9o02tbGHYLbMuaQRx66XjyUCOJCmqRAC3STiO7DegcU-MCJeZMorEfAsD-poMVVdew01sfWs37pPrrydBjUu3X1xy8G67kLMYBLs Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_264dda6e3c7a4280a08204fda9003f54", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/264dda6e3c7a4280a08204fda9003f54"}]}] Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 264dda6e3c7a4280a08204fda9003f54 Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1226828419 Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 258cb2ba63914f1a9dc997cc297f787e Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ListServersNegativeTestJSON-1226828419-project Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 could not be found. Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768'} Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 could not be found. Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 could not be found. Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.325655 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:05.329281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.329281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:05.329281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:05.329281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:05.329281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:53:05.329281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:53:05.329281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 could not be found. Oct 11 19:53:05.329281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:05.329281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] Returning 404 to user: Instance e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:53:05.329281 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f84b8ea8-6ac2-4f3b-b549-a016cb83f2be tempest-ListServersNegativeTestJSON-1226828419 tempest-ListServersNegativeTestJSON-1226828419-project] 10.222.0.27 "GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768" status: 404 len: 111 microversion: 2.1 time: 0.066097 Oct 11 19:53:05.332460 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1352/2661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:05 2022] GET /compute/v2.1/servers/e7c1d7ab-c9fa-46a1-a63b-4a5be5cf9768 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:53:05.574683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2be34fb5-9926-42e2-9e26-dc36e6a9be52 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:05.577731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2be34fb5-9926-42e2-9e26-dc36e6a9be52 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:05.589421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2be34fb5-9926-42e2-9e26-dc36e6a9be52 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.592092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2be34fb5-9926-42e2-9e26-dc36e6a9be52 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.593438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2be34fb5-9926-42e2-9e26-dc36e6a9be52 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.595987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2be34fb5-9926-42e2-9e26-dc36e6a9be52 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.597891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2be34fb5-9926-42e2-9e26-dc36e6a9be52 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.598617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2be34fb5-9926-42e2-9e26-dc36e6a9be52 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.634709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-305234cc-150a-40c9-8bcc-e346d7fe0ef2 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:05.635981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-305234cc-150a-40c9-8bcc-e346d7fe0ef2 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:05.643774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305234cc-150a-40c9-8bcc-e346d7fe0ef2 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.644535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305234cc-150a-40c9-8bcc-e346d7fe0ef2 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.649937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305234cc-150a-40c9-8bcc-e346d7fe0ef2 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.652451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305234cc-150a-40c9-8bcc-e346d7fe0ef2 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.655383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305234cc-150a-40c9-8bcc-e346d7fe0ef2 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.656046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305234cc-150a-40c9-8bcc-e346d7fe0ef2 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:05.888578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-305234cc-150a-40c9-8bcc-e346d7fe0ef2 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:05.926881 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-305234cc-150a-40c9-8bcc-e346d7fe0ef2 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.300776 Oct 11 19:53:05.942612 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1353/2662] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:05 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:05.963554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4f6936d6-af71-4906-9237-e4a7279ba89b req-62c3692b-51ed-4726-8faf-eac3a2f7b5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2931952-99d6-499e-afc6-c6cad13d6f13", "name": "network-vif-deleted", "tag": "de2d0b3e-340e-470e-8627-79415fe34f52"}, {"server_uuid": "5a52feaa-0925-49de-bb88-68790063b724", "name": "network-vif-deleted", "tag": "e9769511-f249-4f8b-83a8-d2aa8cbf950e"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:05.981216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4f6936d6-af71-4906-9237-e4a7279ba89b req-62c3692b-51ed-4726-8faf-eac3a2f7b5de service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:05.981864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4f6936d6-af71-4906-9237-e4a7279ba89b req-62c3692b-51ed-4726-8faf-eac3a2f7b5de service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:05.983572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4f6936d6-af71-4906-9237-e4a7279ba89b req-62c3692b-51ed-4726-8faf-eac3a2f7b5de service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:06.001296 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4f6936d6-af71-4906-9237-e4a7279ba89b req-62c3692b-51ed-4726-8faf-eac3a2f7b5de service nova] Creating event network-vif-deleted:de2d0b3e-340e-470e-8627-79415fe34f52 for instance b2931952-99d6-499e-afc6-c6cad13d6f13 on n-h2-860864-3 Oct 11 19:53:06.002184 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4f6936d6-af71-4906-9237-e4a7279ba89b req-62c3692b-51ed-4726-8faf-eac3a2f7b5de service nova] Creating event network-vif-deleted:e9769511-f249-4f8b-83a8-d2aa8cbf950e for instance 5a52feaa-0925-49de-bb88-68790063b724 on n-h2-860864-3 Oct 11 19:53:06.010222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4f6936d6-af71-4906-9237-e4a7279ba89b req-62c3692b-51ed-4726-8faf-eac3a2f7b5de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062093 Oct 11 19:53:06.011599 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1354/2663] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:06.080395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:06.081743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] [instance: 5a52feaa-0925-49de-bb88-68790063b724] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:06.101301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:06.102682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:06.104938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:06.106140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:06.108836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:06.112823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:06.114825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2be34fb5-9926-42e2-9e26-dc36e6a9be52 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:06.132291 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2be34fb5-9926-42e2-9e26-dc36e6a9be52 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1467 microversion: 2.1 time: 0.555527 Oct 11 19:53:06.162759 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1310/2664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:05 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1467 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:06.175354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2ef05bb-e9f6-47e9-8fda-df43adfda65d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:06.175354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d2ef05bb-e9f6-47e9-8fda-df43adfda65d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:06.177830 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] HTTP exception thrown: Instance 5a52feaa-0925-49de-bb88-68790063b724 could not be found. Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Request method failure captured: Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 HTTP/1.1 Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjl0McOb_J9c-I0PIIC-gqI6mBxGVFjfqlnAoY3BH2UBqPRyAr8gWlVbK3BRa9Bk80O19pcF0cEgQW47NDixzO5bFIfs80NlWxjBgjTuaJiIS3whnfzyOlRCuDoJHFvBK9fbHAObe8SK2rK3BRAmO61ibFgIVbz4H7aye3BMOzHRfA Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 104b4ee892e441b79f520b0591ec0e33 Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesAdminNegativeTest-793087563 Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/104b4ee892e441b79f520b0591ec0e33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_104b4ee892e441b79f520b0591ec0e33", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/104b4ee892e441b79f520b0591ec0e33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/104b4ee892e441b79f520b0591ec0e33"}]}] Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesAdminNegativeTest-793087563 Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 104b4ee892e441b79f520b0591ec0e33 Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-793087563 Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesAdminNegativeTest-793087563-project Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: f34a23ce45c8419693d5fb67010548ad Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesAdminNegativeTest-793087563-project Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5a52feaa-0925-49de-bb88-68790063b724 could not be found. Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5a52feaa-0925-49de-bb88-68790063b724'} Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a52feaa-0925-49de-bb88-68790063b724 could not be found. Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a52feaa-0925-49de-bb88-68790063b724 could not be found. Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:06.181495 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:06.186322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:06.186322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:06.186322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:06.186322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:53:06.186322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:53:06.186322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a52feaa-0925-49de-bb88-68790063b724 could not be found. Oct 11 19:53:06.186322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:06.191094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Returning 404 to user: Instance 5a52feaa-0925-49de-bb88-68790063b724 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:53:06.192260 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2b179ac3-34ef-47e7-9517-43497d42b1e6 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724" status: 404 len: 111 microversion: 2.1 time: 0.118267 Oct 11 19:53:06.198482 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1355/2665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:06 2022] GET /compute/v2.1/servers/5a52feaa-0925-49de-bb88-68790063b724 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:53:06.204839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2ef05bb-e9f6-47e9-8fda-df43adfda65d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:06.205347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2ef05bb-e9f6-47e9-8fda-df43adfda65d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:06.205785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2ef05bb-e9f6-47e9-8fda-df43adfda65d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:06.208236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2ef05bb-e9f6-47e9-8fda-df43adfda65d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:06.209315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2ef05bb-e9f6-47e9-8fda-df43adfda65d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:06.209315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2ef05bb-e9f6-47e9-8fda-df43adfda65d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:06.230331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-557d6cfa-8c82-44f9-8c09-ca5782c2fa41 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] Calling method '.version_select at 0x7f83d0810d30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:06.296994 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-557d6cfa-8c82-44f9-8c09-ca5782c2fa41 tempest-VolumesAdminNegativeTest-793087563 tempest-VolumesAdminNegativeTest-793087563-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994430814" status: 202 len: 0 microversion: 2.1 time: 0.092674 Oct 11 19:53:06.300793 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1356/2666] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 19:53:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994430814 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:53:06.313797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb708cb1-15be-42f3-affa-f3653ba3434f tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:06.315464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bb708cb1-15be-42f3-affa-f3653ba3434f tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:06.331010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb708cb1-15be-42f3-affa-f3653ba3434f tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:06.332157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb708cb1-15be-42f3-affa-f3653ba3434f tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:06.332767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb708cb1-15be-42f3-affa-f3653ba3434f tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:06.338005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb708cb1-15be-42f3-affa-f3653ba3434f tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:06.339009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb708cb1-15be-42f3-affa-f3653ba3434f tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:06.339624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb708cb1-15be-42f3-affa-f3653ba3434f tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:06.874165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bb708cb1-15be-42f3-affa-f3653ba3434f tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:06.891737 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bb708cb1-15be-42f3-affa-f3653ba3434f tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1324 microversion: 2.1 time: 0.589202 Oct 11 19:53:06.892259 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1357/2667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:06 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1324 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:06.933572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d2ef05bb-e9f6-47e9-8fda-df43adfda65d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:06.948367 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d2ef05bb-e9f6-47e9-8fda-df43adfda65d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 200 len: 1468 microversion: 2.1 time: 0.784172 Oct 11 19:53:06.949508 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1311/2668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:06 2022] GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 1468 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:06.965683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ddcf6d93-6f20-4fbf-ad64-c444e36e0384 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:06.966614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ddcf6d93-6f20-4fbf-ad64-c444e36e0384 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:06.974200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d15cac8d-9b17-4138-b60c-a6d9f9cc97a2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-503939918"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:06.980729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d15cac8d-9b17-4138-b60c-a6d9f9cc97a2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:06.986921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddcf6d93-6f20-4fbf-ad64-c444e36e0384 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:06.987426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddcf6d93-6f20-4fbf-ad64-c444e36e0384 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:07.001954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d15cac8d-9b17-4138-b60c-a6d9f9cc97a2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:07.002465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d15cac8d-9b17-4138-b60c-a6d9f9cc97a2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:07.002835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddcf6d93-6f20-4fbf-ad64-c444e36e0384 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:07.002978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d15cac8d-9b17-4138-b60c-a6d9f9cc97a2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:07.004030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddcf6d93-6f20-4fbf-ad64-c444e36e0384 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:07.004731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddcf6d93-6f20-4fbf-ad64-c444e36e0384 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:07.005825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddcf6d93-6f20-4fbf-ad64-c444e36e0384 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:07.013499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d15cac8d-9b17-4138-b60c-a6d9f9cc97a2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:07.014671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d15cac8d-9b17-4138-b60c-a6d9f9cc97a2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:07.015133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d15cac8d-9b17-4138-b60c-a6d9f9cc97a2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:07.237840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-ddcf6d93-6f20-4fbf-ad64-c444e36e0384 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:07.283489 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ddcf6d93-6f20-4fbf-ad64-c444e36e0384 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.323044 Oct 11 19:53:07.295401 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1358/2669] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:06 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:07.394673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:07.530267 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d15cac8d-9b17-4138-b60c-a6d9f9cc97a2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "POST /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5/action" status: 202 len: 0 microversion: 2.1 time: 0.560433 Oct 11 19:53:07.531563 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1312/2670] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:53:06 2022] POST /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 11 19:53:07.549795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c2c92f34-6acd-4d56-85b7-327bd2a20f7d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d07f7280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:07.659930 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c2c92f34-6acd-4d56-85b7-327bd2a20f7d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.121204 Oct 11 19:53:07.662468 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1359/2671] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:07 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:07.912787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:07.918899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f3092239-f261-4a9f-951f-49328a15ef6b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:07.922801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f3092239-f261-4a9f-951f-49328a15ef6b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:07.939773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3092239-f261-4a9f-951f-49328a15ef6b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:07.942544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3092239-f261-4a9f-951f-49328a15ef6b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:07.943703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3092239-f261-4a9f-951f-49328a15ef6b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:07.944736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3092239-f261-4a9f-951f-49328a15ef6b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:07.947015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3092239-f261-4a9f-951f-49328a15ef6b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:07.948770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3092239-f261-4a9f-951f-49328a15ef6b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:08.264377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-aba78dd1-14cd-47de-b44d-820e85990bf1 req-f394a2e3-920f-4ec3-883e-f87ce47ba058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d992e753-9653-4f74-8b23-b01c1e706f2c", "tag": "0b0d56ac-ceeb-4778-bd9a-84c79e6cf05d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:08.299196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-aba78dd1-14cd-47de-b44d-820e85990bf1 req-f394a2e3-920f-4ec3-883e-f87ce47ba058 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:08.300908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-aba78dd1-14cd-47de-b44d-820e85990bf1 req-f394a2e3-920f-4ec3-883e-f87ce47ba058 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:08.301422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-aba78dd1-14cd-47de-b44d-820e85990bf1 req-f394a2e3-920f-4ec3-883e-f87ce47ba058 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:08.346299 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-aba78dd1-14cd-47de-b44d-820e85990bf1 req-f394a2e3-920f-4ec3-883e-f87ce47ba058 service nova] Creating event network-changed:0b0d56ac-ceeb-4778-bd9a-84c79e6cf05d for instance d992e753-9653-4f74-8b23-b01c1e706f2c on n-h2-860864-3 Oct 11 19:53:08.377910 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-aba78dd1-14cd-47de-b44d-820e85990bf1 req-f394a2e3-920f-4ec3-883e-f87ce47ba058 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119906 Oct 11 19:53:08.379074 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1360/2672] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:08.387998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2102534-6da4-4960-9dce-53df157a82df tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:08.388937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2102534-6da4-4960-9dce-53df157a82df tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:08.396572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2102534-6da4-4960-9dce-53df157a82df tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:08.397925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2102534-6da4-4960-9dce-53df157a82df tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:08.399367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2102534-6da4-4960-9dce-53df157a82df tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:08.400389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2102534-6da4-4960-9dce-53df157a82df tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:08.401091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2102534-6da4-4960-9dce-53df157a82df tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:08.402042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2102534-6da4-4960-9dce-53df157a82df tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:08.581668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f3092239-f261-4a9f-951f-49328a15ef6b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:08.592328 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f3092239-f261-4a9f-951f-49328a15ef6b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1324 microversion: 2.1 time: 0.680947 Oct 11 19:53:08.595073 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1313/2673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:07 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1324 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:08.708990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-a2102534-6da4-4960-9dce-53df157a82df tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:08.731885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1781973842", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:08.751712 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2102534-6da4-4960-9dce-53df157a82df tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.371150 Oct 11 19:53:08.755594 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1361/2674] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:08 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:08.769572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8c45f264-236a-43ae-8cd2-abe0ea2c044c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d07e9700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:08.827016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] validate_networks() for [('1b725589-e176-46d6-a6c0-e64fce57877f', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:53:08.836711 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8c45f264-236a-43ae-8cd2-abe0ea2c044c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.079088 Oct 11 19:53:08.845486 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1362/2675] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:08 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:09.621572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-703bc477-c46f-4470-b10a-a8f6c8d5cab3 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:09.622257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-703bc477-c46f-4470-b10a-a8f6c8d5cab3 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:09.638227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-703bc477-c46f-4470-b10a-a8f6c8d5cab3 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:09.638786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-703bc477-c46f-4470-b10a-a8f6c8d5cab3 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:09.639230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-703bc477-c46f-4470-b10a-a8f6c8d5cab3 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:09.639939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-703bc477-c46f-4470-b10a-a8f6c8d5cab3 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:09.640569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-703bc477-c46f-4470-b10a-a8f6c8d5cab3 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:09.643671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-703bc477-c46f-4470-b10a-a8f6c8d5cab3 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:09.663845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:10.683457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:53:10.683954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:53:10.684354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:53:10.684766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:53:10.685180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:53:10.704937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:10.714031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:10.715030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:10.718762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:10.719436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:10.723513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:10.772351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Getting quotas for project 1054c39db17f47659b28044f47cf35fb. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:53:10.787284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Getting quotas for user cf5fb759a9b5468999eb237b84f83f53 and project 1054c39db17f47659b28044f47cf35fb. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:53:10.825028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:53:10.831990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:53:10.896149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-703bc477-c46f-4470-b10a-a8f6c8d5cab3 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:10.910925 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-703bc477-c46f-4470-b10a-a8f6c8d5cab3 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1324 microversion: 2.1 time: 1.295264 Oct 11 19:53:10.928036 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1363/2676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:09 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1324 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:10.933489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5b79bb9a-35a2-4079-ae56-c111305ac752 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:10.934117 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f996734f-1e1f-4240-a257-8304a3a746b4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.337038 Oct 11 19:53:10.934632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5b79bb9a-35a2-4079-ae56-c111305ac752 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:10.942727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b79bb9a-35a2-4079-ae56-c111305ac752 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:10.944013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b79bb9a-35a2-4079-ae56-c111305ac752 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:10.944608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b79bb9a-35a2-4079-ae56-c111305ac752 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:10.944737 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1314/2677] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:53:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:53:10.946131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b79bb9a-35a2-4079-ae56-c111305ac752 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:10.946799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b79bb9a-35a2-4079-ae56-c111305ac752 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:10.947377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b79bb9a-35a2-4079-ae56-c111305ac752 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:10.955076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c96749a-b785-435a-a2da-a76e112932e7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7536b80>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:11.032846 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c96749a-b785-435a-a2da-a76e112932e7 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.085129 Oct 11 19:53:11.033530 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1315/2678] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:10 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:11.066672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b5b59582-0c7b-4b2c-b392-2522803c27af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:11.083944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5b59582-0c7b-4b2c-b392-2522803c27af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:11.084667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5b59582-0c7b-4b2c-b392-2522803c27af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:11.085263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5b59582-0c7b-4b2c-b392-2522803c27af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:11.142160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b5b59582-0c7b-4b2c-b392-2522803c27af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Going to try to stop instance {{(pid=126955) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 19:53:11.190367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-5b79bb9a-35a2-4079-ae56-c111305ac752 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:11.250015 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5b79bb9a-35a2-4079-ae56-c111305ac752 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.318898 Oct 11 19:53:11.264450 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1364/2679] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:10 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:11.284166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-134eecff-c39e-4cf6-a7e1-e7970653506d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:11.291537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-134eecff-c39e-4cf6-a7e1-e7970653506d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:11.307937 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b5b59582-0c7b-4b2c-b392-2522803c27af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/action" status: 202 len: 0 microversion: 2.1 time: 0.254701 Oct 11 19:53:11.309565 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1316/2680] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:53:11 2022] POST /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:53:11.322697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aa56b31f-fe4a-424e-aed7-91cfbe91e925 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:11.324178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aa56b31f-fe4a-424e-aed7-91cfbe91e925 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:11.338549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56b31f-fe4a-424e-aed7-91cfbe91e925 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:11.342090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56b31f-fe4a-424e-aed7-91cfbe91e925 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:11.342791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56b31f-fe4a-424e-aed7-91cfbe91e925 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:11.354116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56b31f-fe4a-424e-aed7-91cfbe91e925 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:11.355032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56b31f-fe4a-424e-aed7-91cfbe91e925 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:11.356702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56b31f-fe4a-424e-aed7-91cfbe91e925 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:11.638891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-134eecff-c39e-4cf6-a7e1-e7970653506d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:11.684222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-134eecff-c39e-4cf6-a7e1-e7970653506d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1223 microversion: 2.1 time: 0.418391 Oct 11 19:53:11.686488 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1365/2681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:11 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1223 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:11.936569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fcd43053-ce22-41a0-9f1b-86be7a3b9f9d tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:11.938420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fcd43053-ce22-41a0-9f1b-86be7a3b9f9d tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:11.955272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd43053-ce22-41a0-9f1b-86be7a3b9f9d tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:11.958776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd43053-ce22-41a0-9f1b-86be7a3b9f9d tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:11.960185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd43053-ce22-41a0-9f1b-86be7a3b9f9d tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:11.962501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd43053-ce22-41a0-9f1b-86be7a3b9f9d tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:11.964256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd43053-ce22-41a0-9f1b-86be7a3b9f9d tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:11.965655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcd43053-ce22-41a0-9f1b-86be7a3b9f9d tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:12.012118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aa56b31f-fe4a-424e-aed7-91cfbe91e925 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:12.030910 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aa56b31f-fe4a-424e-aed7-91cfbe91e925 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1677 microversion: 2.1 time: 0.715770 Oct 11 19:53:12.038138 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1317/2682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:11 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1677 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:12.049946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c030d8de-e135-4603-bfce-c74759c96797 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cd2d7160>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:12.258602 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c030d8de-e135-4603-bfce-c74759c96797 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.212319 Oct 11 19:53:12.266571 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1318/2683] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:12 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:12.285970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-878b740d-1b48-4a56-8c65-05098e4e2c62 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:12.288797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-878b740d-1b48-4a56-8c65-05098e4e2c62 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:12.308802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878b740d-1b48-4a56-8c65-05098e4e2c62 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:12.309542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878b740d-1b48-4a56-8c65-05098e4e2c62 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:12.310209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878b740d-1b48-4a56-8c65-05098e4e2c62 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:12.311120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878b740d-1b48-4a56-8c65-05098e4e2c62 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:12.311898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878b740d-1b48-4a56-8c65-05098e4e2c62 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:12.313051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-878b740d-1b48-4a56-8c65-05098e4e2c62 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:13.067472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-878b740d-1b48-4a56-8c65-05098e4e2c62 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:13.148439 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-878b740d-1b48-4a56-8c65-05098e4e2c62 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.868745 Oct 11 19:53:13.153407 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1319/2684] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:12 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:53:13.165123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3dbeeb9d-386f-41be-a239-a61ceae7347f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:13.165756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3dbeeb9d-386f-41be-a239-a61ceae7347f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:13.183256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dbeeb9d-386f-41be-a239-a61ceae7347f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:13.184973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dbeeb9d-386f-41be-a239-a61ceae7347f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:13.187348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dbeeb9d-386f-41be-a239-a61ceae7347f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:13.189280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dbeeb9d-386f-41be-a239-a61ceae7347f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:13.192653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dbeeb9d-386f-41be-a239-a61ceae7347f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:13.193215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dbeeb9d-386f-41be-a239-a61ceae7347f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:13.551692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3dbeeb9d-386f-41be-a239-a61ceae7347f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:13.562629 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3dbeeb9d-386f-41be-a239-a61ceae7347f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1283 microversion: 2.1 time: 0.406905 Oct 11 19:53:13.566952 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1320/2685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:13 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1283 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:13.572425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c47182ae-873f-4be1-8069-e129cf8669ed tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:13.581548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fcd43053-ce22-41a0-9f1b-86be7a3b9f9d tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:13.590832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c47182ae-873f-4be1-8069-e129cf8669ed tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:13.593513 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fcd43053-ce22-41a0-9f1b-86be7a3b9f9d tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1324 microversion: 2.1 time: 1.663852 Oct 11 19:53:13.603270 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1366/2686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:11 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1324 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:13.616854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c47182ae-873f-4be1-8069-e129cf8669ed tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:13.619970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-081583eb-b381-4dab-9916-d6abb9923618 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0835670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:13.620823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c47182ae-873f-4be1-8069-e129cf8669ed tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:13.621486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c47182ae-873f-4be1-8069-e129cf8669ed tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:13.622431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c47182ae-873f-4be1-8069-e129cf8669ed tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:13.630783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c47182ae-873f-4be1-8069-e129cf8669ed tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:13.640918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c47182ae-873f-4be1-8069-e129cf8669ed tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:13.709262 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-081583eb-b381-4dab-9916-d6abb9923618 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.104498 Oct 11 19:53:13.713106 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1367/2687] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:13 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:14.152508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c47182ae-873f-4be1-8069-e129cf8669ed tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:14.171331 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c47182ae-873f-4be1-8069-e129cf8669ed tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1677 microversion: 2.1 time: 0.600792 Oct 11 19:53:14.172227 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1321/2688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:13 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1677 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:14.188895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-433bf7fd-10ac-4166-bb8b-74db1876ddfd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:14.189862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-433bf7fd-10ac-4166-bb8b-74db1876ddfd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:14.215080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433bf7fd-10ac-4166-bb8b-74db1876ddfd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:14.218615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433bf7fd-10ac-4166-bb8b-74db1876ddfd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:14.221214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433bf7fd-10ac-4166-bb8b-74db1876ddfd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:14.222691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433bf7fd-10ac-4166-bb8b-74db1876ddfd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:14.224997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433bf7fd-10ac-4166-bb8b-74db1876ddfd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:14.228726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-433bf7fd-10ac-4166-bb8b-74db1876ddfd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:14.596205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-31f21e60-a072-4668-8b5e-def313839b61 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:14.599341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-31f21e60-a072-4668-8b5e-def313839b61 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:14.607437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-433bf7fd-10ac-4166-bb8b-74db1876ddfd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:14.621019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31f21e60-a072-4668-8b5e-def313839b61 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:14.629949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31f21e60-a072-4668-8b5e-def313839b61 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:14.633626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31f21e60-a072-4668-8b5e-def313839b61 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:14.634825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31f21e60-a072-4668-8b5e-def313839b61 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:14.636615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31f21e60-a072-4668-8b5e-def313839b61 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:14.638995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31f21e60-a072-4668-8b5e-def313839b61 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:14.697477 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-433bf7fd-10ac-4166-bb8b-74db1876ddfd tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.517692 Oct 11 19:53:14.714254 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1368/2689] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:14 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:14.734197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2bcfbbc6-619f-4f1d-8d5c-081bbad959c8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:14.737351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2bcfbbc6-619f-4f1d-8d5c-081bbad959c8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:14.757179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bcfbbc6-619f-4f1d-8d5c-081bbad959c8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:14.758900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bcfbbc6-619f-4f1d-8d5c-081bbad959c8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:14.763710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bcfbbc6-619f-4f1d-8d5c-081bbad959c8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:14.764824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bcfbbc6-619f-4f1d-8d5c-081bbad959c8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:14.765550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bcfbbc6-619f-4f1d-8d5c-081bbad959c8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:14.766318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bcfbbc6-619f-4f1d-8d5c-081bbad959c8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:16.007160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-31f21e60-a072-4668-8b5e-def313839b61 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:16.020473 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-31f21e60-a072-4668-8b5e-def313839b61 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1323 microversion: 2.1 time: 1.431073 Oct 11 19:53:16.048484 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1322/2690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:14 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1323 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:16.068618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-effb6aae-64c5-4784-a75d-38839bd46005 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7530a60>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:16.141041 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-effb6aae-64c5-4784-a75d-38839bd46005 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.091105 Oct 11 19:53:16.142770 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1323/2691] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:16 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:16.160657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-43a2545a-4192-4576-82fc-60988242d65b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:16.161570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-43a2545a-4192-4576-82fc-60988242d65b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:16.170569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43a2545a-4192-4576-82fc-60988242d65b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:16.171386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43a2545a-4192-4576-82fc-60988242d65b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:16.171992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43a2545a-4192-4576-82fc-60988242d65b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:16.172851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43a2545a-4192-4576-82fc-60988242d65b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:16.177201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2bcfbbc6-619f-4f1d-8d5c-081bbad959c8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:16.185229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43a2545a-4192-4576-82fc-60988242d65b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:16.185997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43a2545a-4192-4576-82fc-60988242d65b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:16.191694 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2bcfbbc6-619f-4f1d-8d5c-081bbad959c8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1324 microversion: 2.1 time: 1.474334 Oct 11 19:53:16.195122 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1369/2692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:14 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1324 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:16.208171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6488985c-6df4-4b44-85fe-637f1017d0ad tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:16.210268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6488985c-6df4-4b44-85fe-637f1017d0ad tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:16.223388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6488985c-6df4-4b44-85fe-637f1017d0ad tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:16.229359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6488985c-6df4-4b44-85fe-637f1017d0ad tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:16.231991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6488985c-6df4-4b44-85fe-637f1017d0ad tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:16.232953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6488985c-6df4-4b44-85fe-637f1017d0ad tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:16.236191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6488985c-6df4-4b44-85fe-637f1017d0ad tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:16.236830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6488985c-6df4-4b44-85fe-637f1017d0ad tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:17.018759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-6488985c-6df4-4b44-85fe-637f1017d0ad tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:17.076223 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6488985c-6df4-4b44-85fe-637f1017d0ad tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.879380 Oct 11 19:53:17.081237 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1370/2693] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:16 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:17.087955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d97860aa-3ee8-437f-b676-082a4c65a764 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:17.091607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d97860aa-3ee8-437f-b676-082a4c65a764 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:17.108321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97860aa-3ee8-437f-b676-082a4c65a764 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:17.109109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97860aa-3ee8-437f-b676-082a4c65a764 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:17.110684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97860aa-3ee8-437f-b676-082a4c65a764 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:17.111643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97860aa-3ee8-437f-b676-082a4c65a764 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:17.119280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97860aa-3ee8-437f-b676-082a4c65a764 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:17.119990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d97860aa-3ee8-437f-b676-082a4c65a764 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:17.462055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-43a2545a-4192-4576-82fc-60988242d65b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:17.477619 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-43a2545a-4192-4576-82fc-60988242d65b tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1677 microversion: 2.1 time: 1.333472 Oct 11 19:53:17.479836 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1324/2694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:16 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1677 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:17.488498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c005a466-100f-41f3-9bf6-e2f58cbbbd28 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7530e50>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:17.574556 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c005a466-100f-41f3-9bf6-e2f58cbbbd28 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.092513 Oct 11 19:53:17.576608 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1325/2695] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:17 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:17.584738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-377008bd-796a-45af-8955-f395ae5bbfd5 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:17.585757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-377008bd-796a-45af-8955-f395ae5bbfd5 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:17.595181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:17.596881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-377008bd-796a-45af-8955-f395ae5bbfd5 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:17.599340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-377008bd-796a-45af-8955-f395ae5bbfd5 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:17.600095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-377008bd-796a-45af-8955-f395ae5bbfd5 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:17.601253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-377008bd-796a-45af-8955-f395ae5bbfd5 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:17.603532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-377008bd-796a-45af-8955-f395ae5bbfd5 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:17.604170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-377008bd-796a-45af-8955-f395ae5bbfd5 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:17.769411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d97860aa-3ee8-437f-b676-082a4c65a764 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:17.787237 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d97860aa-3ee8-437f-b676-082a4c65a764 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1323 microversion: 2.1 time: 0.703741 Oct 11 19:53:17.799718 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1371/2696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:17 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1323 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:17.817551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-731a433d-56b0-4980-8e86-548380a7c70b req-6a83b9a7-fd9e-4c5e-a897-61832d8655b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0929e96c-9da0-4034-ae0e-38f7330002f5", "name": "network-vif-plugged", "status": "completed", "tag": "71f8f1b2-5864-4201-894f-6d7e1edc96c4"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:17.841881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-731a433d-56b0-4980-8e86-548380a7c70b req-6a83b9a7-fd9e-4c5e-a897-61832d8655b1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:17.850585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-731a433d-56b0-4980-8e86-548380a7c70b req-6a83b9a7-fd9e-4c5e-a897-61832d8655b1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:17.851299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-731a433d-56b0-4980-8e86-548380a7c70b req-6a83b9a7-fd9e-4c5e-a897-61832d8655b1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:17.870308 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-731a433d-56b0-4980-8e86-548380a7c70b req-6a83b9a7-fd9e-4c5e-a897-61832d8655b1 service nova] Creating event network-vif-plugged:71f8f1b2-5864-4201-894f-6d7e1edc96c4 for instance 0929e96c-9da0-4034-ae0e-38f7330002f5 on n-h2-860864-3 Oct 11 19:53:17.892452 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-731a433d-56b0-4980-8e86-548380a7c70b req-6a83b9a7-fd9e-4c5e-a897-61832d8655b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089780 Oct 11 19:53:17.893828 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1372/2697] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:17.999659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-377008bd-796a-45af-8955-f395ae5bbfd5 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:18.009474 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-377008bd-796a-45af-8955-f395ae5bbfd5 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1324 microversion: 2.1 time: 0.431464 Oct 11 19:53:18.036225 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1326/2698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:17 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1324 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:18.110792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10410951-7859-45d5-8967-0fddc4fb3bc6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:18.111737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10410951-7859-45d5-8967-0fddc4fb3bc6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:18.136752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10410951-7859-45d5-8967-0fddc4fb3bc6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:18.137553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10410951-7859-45d5-8967-0fddc4fb3bc6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:18.138166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10410951-7859-45d5-8967-0fddc4fb3bc6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:18.143573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10410951-7859-45d5-8967-0fddc4fb3bc6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:18.144382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10410951-7859-45d5-8967-0fddc4fb3bc6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:18.145000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10410951-7859-45d5-8967-0fddc4fb3bc6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:18.252846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b39a218c-a703-49b2-ac6a-f7993d4ea7da req-51435652-f784-4b9e-bd3b-540eb9374fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0583d05-1d47-4efb-a936-5e747c44c9c2", "tag": "f0945e06-d4cf-49ce-a31f-4ceba757cea1"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:18.280439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b39a218c-a703-49b2-ac6a-f7993d4ea7da req-51435652-f784-4b9e-bd3b-540eb9374fe0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:18.283987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b39a218c-a703-49b2-ac6a-f7993d4ea7da req-51435652-f784-4b9e-bd3b-540eb9374fe0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:18.284757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b39a218c-a703-49b2-ac6a-f7993d4ea7da req-51435652-f784-4b9e-bd3b-540eb9374fe0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:18.307322 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b39a218c-a703-49b2-ac6a-f7993d4ea7da req-51435652-f784-4b9e-bd3b-540eb9374fe0 service nova] Creating event network-changed:f0945e06-d4cf-49ce-a31f-4ceba757cea1 for instance f0583d05-1d47-4efb-a936-5e747c44c9c2 on n-h1-860864-3 Oct 11 19:53:18.314779 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b39a218c-a703-49b2-ac6a-f7993d4ea7da req-51435652-f784-4b9e-bd3b-540eb9374fe0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066571 Oct 11 19:53:18.315973 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1327/2699] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:18.436548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-10410951-7859-45d5-8967-0fddc4fb3bc6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:18.510618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-10263204-6819-4d92-820b-6e14d9a845d9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:18.511567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-10263204-6819-4d92-820b-6e14d9a845d9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:18.512173 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10410951-7859-45d5-8967-0fddc4fb3bc6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.406440 Oct 11 19:53:18.526889 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1373/2700] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:18 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:18.527010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10263204-6819-4d92-820b-6e14d9a845d9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:18.527010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10263204-6819-4d92-820b-6e14d9a845d9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:18.527010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10263204-6819-4d92-820b-6e14d9a845d9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:18.540317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10263204-6819-4d92-820b-6e14d9a845d9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:18.540317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10263204-6819-4d92-820b-6e14d9a845d9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:18.540317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10263204-6819-4d92-820b-6e14d9a845d9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:18.591817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6cbab6b2-7068-4d69-9db2-6bec5a2f6dd9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d07f74c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:18.619909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:18.688115 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6cbab6b2-7068-4d69-9db2-6bec5a2f6dd9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.098971 Oct 11 19:53:18.688622 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1374/2701] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:18 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:18.825967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-08b03970-8fbc-4798-bc18-cbeaac172b9a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:18.826625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-08b03970-8fbc-4798-bc18-cbeaac172b9a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:18.846011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08b03970-8fbc-4798-bc18-cbeaac172b9a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:18.849382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08b03970-8fbc-4798-bc18-cbeaac172b9a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:18.850053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08b03970-8fbc-4798-bc18-cbeaac172b9a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:18.851325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08b03970-8fbc-4798-bc18-cbeaac172b9a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:18.855089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08b03970-8fbc-4798-bc18-cbeaac172b9a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:18.855863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08b03970-8fbc-4798-bc18-cbeaac172b9a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:19.237443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-10263204-6819-4d92-820b-6e14d9a845d9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:19.249932 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-10263204-6819-4d92-820b-6e14d9a845d9 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1677 microversion: 2.1 time: 0.746498 Oct 11 19:53:19.258235 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1328/2702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:18 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1677 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:19.272578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-508c3bc0-9923-4c29-ae8e-6f8bb691fca9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:19.273200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-508c3bc0-9923-4c29-ae8e-6f8bb691fca9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:19.302174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-508c3bc0-9923-4c29-ae8e-6f8bb691fca9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:19.303025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-508c3bc0-9923-4c29-ae8e-6f8bb691fca9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:19.303488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-508c3bc0-9923-4c29-ae8e-6f8bb691fca9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:19.305631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-508c3bc0-9923-4c29-ae8e-6f8bb691fca9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:19.306113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-508c3bc0-9923-4c29-ae8e-6f8bb691fca9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:19.310288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-508c3bc0-9923-4c29-ae8e-6f8bb691fca9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:19.866953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-08b03970-8fbc-4798-bc18-cbeaac172b9a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:19.884732 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-08b03970-8fbc-4798-bc18-cbeaac172b9a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1323 microversion: 2.1 time: 1.062792 Oct 11 19:53:19.895754 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1375/2703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:18 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1323 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:19.911852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-be964da2-9221-4ac7-b534-5a5e01389eb8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:19.912477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-be964da2-9221-4ac7-b534-5a5e01389eb8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:19.920461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be964da2-9221-4ac7-b534-5a5e01389eb8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:19.920968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be964da2-9221-4ac7-b534-5a5e01389eb8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:19.921420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be964da2-9221-4ac7-b534-5a5e01389eb8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:19.922243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be964da2-9221-4ac7-b534-5a5e01389eb8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:19.922749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be964da2-9221-4ac7-b534-5a5e01389eb8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:19.923184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be964da2-9221-4ac7-b534-5a5e01389eb8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:20.106225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-508c3bc0-9923-4c29-ae8e-6f8bb691fca9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:20.131356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-be964da2-9221-4ac7-b534-5a5e01389eb8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:20.140800 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-508c3bc0-9923-4c29-ae8e-6f8bb691fca9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1324 microversion: 2.1 time: 0.879357 Oct 11 19:53:20.141493 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1329/2704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:19 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1324 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:20.159492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1332c76a-fee5-4da7-a268-38f41596e694 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7530dc0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:20.197053 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-be964da2-9221-4ac7-b534-5a5e01389eb8 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.301748 Oct 11 19:53:20.225541 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1376/2705] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:19 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:20.231263 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1332c76a-fee5-4da7-a268-38f41596e694 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.082222 Oct 11 19:53:20.232135 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1330/2706] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:20 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:20.244475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-553bcbfa-3f3b-4fd5-83bc-6dea233b6120 req-032f5ae4-df01-4fd3-9576-341fc858acc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d992e753-9653-4f74-8b23-b01c1e706f2c", "name": "network-vif-plugged", "status": "completed", "tag": "0b0d56ac-ceeb-4778-bd9a-84c79e6cf05d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:20.284203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae52e09c-3857-477c-8af3-f546ab2c64eb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:20.284951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae52e09c-3857-477c-8af3-f546ab2c64eb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:20.286968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-553bcbfa-3f3b-4fd5-83bc-6dea233b6120 req-032f5ae4-df01-4fd3-9576-341fc858acc2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:20.297868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-553bcbfa-3f3b-4fd5-83bc-6dea233b6120 req-032f5ae4-df01-4fd3-9576-341fc858acc2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:20.299115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-553bcbfa-3f3b-4fd5-83bc-6dea233b6120 req-032f5ae4-df01-4fd3-9576-341fc858acc2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:20.301708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae52e09c-3857-477c-8af3-f546ab2c64eb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:20.307035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae52e09c-3857-477c-8af3-f546ab2c64eb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:20.307716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae52e09c-3857-477c-8af3-f546ab2c64eb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:20.309306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae52e09c-3857-477c-8af3-f546ab2c64eb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:20.310488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae52e09c-3857-477c-8af3-f546ab2c64eb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:20.313514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae52e09c-3857-477c-8af3-f546ab2c64eb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:20.332889 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-553bcbfa-3f3b-4fd5-83bc-6dea233b6120 req-032f5ae4-df01-4fd3-9576-341fc858acc2 service nova] Creating event network-vif-plugged:0b0d56ac-ceeb-4778-bd9a-84c79e6cf05d for instance d992e753-9653-4f74-8b23-b01c1e706f2c on n-h2-860864-3 Oct 11 19:53:20.372197 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-553bcbfa-3f3b-4fd5-83bc-6dea233b6120 req-032f5ae4-df01-4fd3-9576-341fc858acc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113585 Oct 11 19:53:20.381562 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1377/2707] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:20.742383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:20.804220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:20.921485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-96fe2c9c-b414-42e3-b369-aeca28a2b3ba tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:20.922203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-96fe2c9c-b414-42e3-b369-aeca28a2b3ba tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:20.957120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96fe2c9c-b414-42e3-b369-aeca28a2b3ba tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:20.957760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96fe2c9c-b414-42e3-b369-aeca28a2b3ba tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:20.958221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96fe2c9c-b414-42e3-b369-aeca28a2b3ba tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:20.965248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96fe2c9c-b414-42e3-b369-aeca28a2b3ba tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:20.965810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96fe2c9c-b414-42e3-b369-aeca28a2b3ba tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:20.966265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96fe2c9c-b414-42e3-b369-aeca28a2b3ba tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:21.040747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ae52e09c-3857-477c-8af3-f546ab2c64eb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:21.052753 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ae52e09c-3857-477c-8af3-f546ab2c64eb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1677 microversion: 2.1 time: 0.774268 Oct 11 19:53:21.053346 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1331/2708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:20 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1677 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:21.169189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f9b2471-b8a0-4a7c-92c1-09a14f90b428 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:21.186250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8f9b2471-b8a0-4a7c-92c1-09a14f90b428 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:21.203985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9b2471-b8a0-4a7c-92c1-09a14f90b428 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:21.204530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9b2471-b8a0-4a7c-92c1-09a14f90b428 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:21.210441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9b2471-b8a0-4a7c-92c1-09a14f90b428 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:21.213419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9b2471-b8a0-4a7c-92c1-09a14f90b428 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:21.222495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9b2471-b8a0-4a7c-92c1-09a14f90b428 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:21.222495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9b2471-b8a0-4a7c-92c1-09a14f90b428 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:21.631924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8f9b2471-b8a0-4a7c-92c1-09a14f90b428 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:21.640779 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f9b2471-b8a0-4a7c-92c1-09a14f90b428 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1324 microversion: 2.1 time: 0.475370 Oct 11 19:53:21.644961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-96fe2c9c-b414-42e3-b369-aeca28a2b3ba tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:21.646180 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1332/2709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:21 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1324 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:21.657071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-87c32fab-4015-4d75-8352-64cb2a74220e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:21.658488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-87c32fab-4015-4d75-8352-64cb2a74220e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:21.666961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87c32fab-4015-4d75-8352-64cb2a74220e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:21.667632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:21.667993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87c32fab-4015-4d75-8352-64cb2a74220e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:21.668732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87c32fab-4015-4d75-8352-64cb2a74220e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:21.669721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87c32fab-4015-4d75-8352-64cb2a74220e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:21.670576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87c32fab-4015-4d75-8352-64cb2a74220e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:21.671268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87c32fab-4015-4d75-8352-64cb2a74220e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:21.672648 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-96fe2c9c-b414-42e3-b369-aeca28a2b3ba tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1323 microversion: 2.1 time: 0.757294 Oct 11 19:53:21.691962 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1378/2710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:20 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1323 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:21.703842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f112196e-df2d-4d67-9c1f-d426a6162833 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d073b700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:21.769756 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f112196e-df2d-4d67-9c1f-d426a6162833 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.076096 Oct 11 19:53:21.771080 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1379/2711] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:21 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:21.841006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-87c32fab-4015-4d75-8352-64cb2a74220e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:21.896572 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-87c32fab-4015-4d75-8352-64cb2a74220e tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.248841 Oct 11 19:53:21.899122 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1333/2712] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:21 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:22.081706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5f76bd0c-4436-460d-ad51-c3bc8b4382ff tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:22.082462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5f76bd0c-4436-460d-ad51-c3bc8b4382ff tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:22.084623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:22.097230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f76bd0c-4436-460d-ad51-c3bc8b4382ff tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:22.097990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f76bd0c-4436-460d-ad51-c3bc8b4382ff tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:22.099305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f76bd0c-4436-460d-ad51-c3bc8b4382ff tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:22.100226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f76bd0c-4436-460d-ad51-c3bc8b4382ff tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:22.105284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f76bd0c-4436-460d-ad51-c3bc8b4382ff tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:22.106315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f76bd0c-4436-460d-ad51-c3bc8b4382ff tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:22.668499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7f58c062-765d-4e75-b1ae-74e6ba7604f0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:22.677390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7f58c062-765d-4e75-b1ae-74e6ba7604f0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:22.694039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f58c062-765d-4e75-b1ae-74e6ba7604f0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:22.697511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f58c062-765d-4e75-b1ae-74e6ba7604f0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:22.698073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f58c062-765d-4e75-b1ae-74e6ba7604f0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:22.698940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f58c062-765d-4e75-b1ae-74e6ba7604f0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:22.701857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f58c062-765d-4e75-b1ae-74e6ba7604f0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:22.702665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f58c062-765d-4e75-b1ae-74e6ba7604f0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:22.940507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5f76bd0c-4436-460d-ad51-c3bc8b4382ff tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:22.953172 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5f76bd0c-4436-460d-ad51-c3bc8b4382ff tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1654 microversion: 2.1 time: 0.875484 Oct 11 19:53:22.953772 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1380/2713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:22 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1654 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:22.965637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-434879dc-5143-4fed-bf7e-2dbf9fac840e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:22.967463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-434879dc-5143-4fed-bf7e-2dbf9fac840e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:22.983775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7f58c062-765d-4e75-b1ae-74e6ba7604f0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:22.992214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-434879dc-5143-4fed-bf7e-2dbf9fac840e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:22.993360 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7f58c062-765d-4e75-b1ae-74e6ba7604f0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1521 microversion: 2.1 time: 0.327631 Oct 11 19:53:22.994091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-434879dc-5143-4fed-bf7e-2dbf9fac840e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:22.995730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-434879dc-5143-4fed-bf7e-2dbf9fac840e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:22.996146 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1334/2714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:22 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:22.999089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-434879dc-5143-4fed-bf7e-2dbf9fac840e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:22.999978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-434879dc-5143-4fed-bf7e-2dbf9fac840e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.000582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-434879dc-5143-4fed-bf7e-2dbf9fac840e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.011105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e11da92f-cb3d-4865-9bb7-b813fb161da4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c75503a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:23.105283 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e11da92f-cb3d-4865-9bb7-b813fb161da4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.107813 Oct 11 19:53:23.114938 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1335/2715] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:22 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:23.124508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-299a5f4e-1eba-4bfa-bcf3-a5893667dba5 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:23.135111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-299a5f4e-1eba-4bfa-bcf3-a5893667dba5 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:23.170726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-299a5f4e-1eba-4bfa-bcf3-a5893667dba5 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.171228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-299a5f4e-1eba-4bfa-bcf3-a5893667dba5 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.171672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-299a5f4e-1eba-4bfa-bcf3-a5893667dba5 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.172391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-299a5f4e-1eba-4bfa-bcf3-a5893667dba5 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.172846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-299a5f4e-1eba-4bfa-bcf3-a5893667dba5 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.173272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-299a5f4e-1eba-4bfa-bcf3-a5893667dba5 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.188855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-434879dc-5143-4fed-bf7e-2dbf9fac840e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:23.198386 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-434879dc-5143-4fed-bf7e-2dbf9fac840e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1323 microversion: 2.1 time: 0.243553 Oct 11 19:53:23.215429 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1381/2716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:22 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1323 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:23.227374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8f8eb1bf-16cd-4077-bdb6-54f44f933444 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:23.234511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f8eb1bf-16cd-4077-bdb6-54f44f933444 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.235384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f8eb1bf-16cd-4077-bdb6-54f44f933444 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.236057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f8eb1bf-16cd-4077-bdb6-54f44f933444 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.292718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8f8eb1bf-16cd-4077-bdb6-54f44f933444 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Going to try to start instance {{(pid=126956) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 19:53:23.351157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:23.368911 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8f8eb1bf-16cd-4077-bdb6-54f44f933444 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/action" status: 202 len: 0 microversion: 2.1 time: 0.151974 Oct 11 19:53:23.370681 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1382/2717] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:53:23 2022] POST /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:53:23.393668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d0e82d8d-0fc2-4c44-8712-bf8290320aa2 req-d01ef0f0-b8c2-43c6-adb6-b8a55d83b418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0583d05-1d47-4efb-a936-5e747c44c9c2", "name": "network-vif-plugged", "status": "completed", "tag": "f0945e06-d4cf-49ce-a31f-4ceba757cea1"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:23.424967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d0e82d8d-0fc2-4c44-8712-bf8290320aa2 req-d01ef0f0-b8c2-43c6-adb6-b8a55d83b418 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.425498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d0e82d8d-0fc2-4c44-8712-bf8290320aa2 req-d01ef0f0-b8c2-43c6-adb6-b8a55d83b418 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.425943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d0e82d8d-0fc2-4c44-8712-bf8290320aa2 req-d01ef0f0-b8c2-43c6-adb6-b8a55d83b418 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.455272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-299a5f4e-1eba-4bfa-bcf3-a5893667dba5 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:23.457352 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d0e82d8d-0fc2-4c44-8712-bf8290320aa2 req-d01ef0f0-b8c2-43c6-adb6-b8a55d83b418 service nova] Creating event network-vif-plugged:f0945e06-d4cf-49ce-a31f-4ceba757cea1 for instance f0583d05-1d47-4efb-a936-5e747c44c9c2 on n-h1-860864-3 Oct 11 19:53:23.465090 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d0e82d8d-0fc2-4c44-8712-bf8290320aa2 req-d01ef0f0-b8c2-43c6-adb6-b8a55d83b418 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092201 Oct 11 19:53:23.474638 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1383/2718] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:23.483090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:23.486693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:23.516458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.518547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.520349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.521425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.523156 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-299a5f4e-1eba-4bfa-bcf3-a5893667dba5 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1927 microversion: 2.75 time: 0.406129 Oct 11 19:53:23.524549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.525236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.529006 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1336/2719] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:23 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1927 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:23.540300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2d8a5622-b490-4d9e-a2ed-63b9c3c61423 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:23.551001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2d8a5622-b490-4d9e-a2ed-63b9c3c61423 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:23.558135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8a5622-b490-4d9e-a2ed-63b9c3c61423 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.558987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8a5622-b490-4d9e-a2ed-63b9c3c61423 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.559658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8a5622-b490-4d9e-a2ed-63b9c3c61423 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.561921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8a5622-b490-4d9e-a2ed-63b9c3c61423 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.564941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8a5622-b490-4d9e-a2ed-63b9c3c61423 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.565635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8a5622-b490-4d9e-a2ed-63b9c3c61423 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.585798 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] HTTP exception thrown: Instance is not a member of specified network Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Request method failure captured: Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c/ips/invalid HTTP/1.1 Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcmXMpNp2RGjiNOFyo1KOsqQ-EPV2lKU7YMpJqjabmYYCk-JhgsEFY3KhP5Vpp2V-eXJfjDOu8WcDKGQ1mLLzR3h-sILTjdPRrCUpRO1uyIq3ztnnRiFhbP63N4LSjsPPsCZ9oEyEfexx_Agi4ad5gS5WEs1-w6Q9Cmjy9eYpto2V0w Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f310bb3ee8be485ab7539076d3572ff5 Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1144391963 Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f310bb3ee8be485ab7539076d3572ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f310bb3ee8be485ab7539076d3572ff5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f310bb3ee8be485ab7539076d3572ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f310bb3ee8be485ab7539076d3572ff5"}]}] Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1144391963 Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f310bb3ee8be485ab7539076d3572ff5 Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1144391963 Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerAddressesNegativeTestJSON-1144391963-project Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: dbecbe35beba44029ba3a09d32330ed5 Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1144391963-project Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance is not a member of specified network Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': 'd992e753-9653-4f74-8b23-b01c1e706f2c', 'id': 'invalid'} Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 11 19:53:23.615672 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:23.624435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Returning 404 to user: Instance is not a member of specified network {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:53:23.626693 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-330f17d2-316c-4a82-8b93-a6c6c2562b7b tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.150500 Oct 11 19:53:23.635357 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1384/2720] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:53:23 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c/ips/invalid => generated 91 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:53:23.645249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a75858d6-e296-4be8-b819-d31d2f2e32d8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:23.646119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a75858d6-e296-4be8-b819-d31d2f2e32d8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Failed to fetch instance by id 999 {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 19:53:23.649133 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a75858d6-e296-4be8-b819-d31d2f2e32d8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] HTTP exception thrown: Instance 999 could not be found. Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a75858d6-e296-4be8-b819-d31d2f2e32d8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Request method failure captured: Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcmXMpNp2RGjiNOFyo1KOsqQ-EPV2lKU7YMpJqjabmYYCk-JhgsEFY3KhP5Vpp2V-eXJfjDOu8WcDKGQ1mLLzR3h-sILTjdPRrCUpRO1uyIq3ztnnRiFhbP63N4LSjsPPsCZ9oEyEfexx_Agi4ad5gS5WEs1-w6Q9Cmjy9eYpto2V0w Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f310bb3ee8be485ab7539076d3572ff5 Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1144391963 Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f310bb3ee8be485ab7539076d3572ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f310bb3ee8be485ab7539076d3572ff5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f310bb3ee8be485ab7539076d3572ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f310bb3ee8be485ab7539076d3572ff5"}]}] Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1144391963 Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f310bb3ee8be485ab7539076d3572ff5 Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1144391963 Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerAddressesNegativeTestJSON-1144391963-project Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: dbecbe35beba44029ba3a09d32330ed5 Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1144391963-project Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 999 could not be found. Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': '999'} Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 11 19:53:23.651749 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:23.659038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a75858d6-e296-4be8-b819-d31d2f2e32d8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Returning 404 to user: Instance 999 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:53:23.660255 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a75858d6-e296-4be8-b819-d31d2f2e32d8 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.023469 Oct 11 19:53:23.665681 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1385/2721] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 11 19:53:23 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:53:23.673437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa1c6f1c-d997-4e51-8bb0-791048db57e0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:23.674209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa1c6f1c-d997-4e51-8bb0-791048db57e0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:23.685578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa1c6f1c-d997-4e51-8bb0-791048db57e0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.686356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa1c6f1c-d997-4e51-8bb0-791048db57e0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.687054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa1c6f1c-d997-4e51-8bb0-791048db57e0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.688937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa1c6f1c-d997-4e51-8bb0-791048db57e0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.689646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa1c6f1c-d997-4e51-8bb0-791048db57e0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.690262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa1c6f1c-d997-4e51-8bb0-791048db57e0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.769617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa1c6f1c-d997-4e51-8bb0-791048db57e0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:53:23.969416 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa1c6f1c-d997-4e51-8bb0-791048db57e0 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 204 len: 0 microversion: 2.1 time: 0.301893 Oct 11 19:53:23.973142 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1386/2722] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:53:23 2022] DELETE /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:53:23.981731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-984f2bae-e1f5-490c-8c62-a9c072ecf39a tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:23.982450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-984f2bae-e1f5-490c-8c62-a9c072ecf39a tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:23.993477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2d8a5622-b490-4d9e-a2ed-63b9c3c61423 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:23.996282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-984f2bae-e1f5-490c-8c62-a9c072ecf39a tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:23.996787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-984f2bae-e1f5-490c-8c62-a9c072ecf39a tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:23.997233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-984f2bae-e1f5-490c-8c62-a9c072ecf39a tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:23.997925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-984f2bae-e1f5-490c-8c62-a9c072ecf39a tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:24.000570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-984f2bae-e1f5-490c-8c62-a9c072ecf39a tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:24.001009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-984f2bae-e1f5-490c-8c62-a9c072ecf39a tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:24.006818 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2d8a5622-b490-4d9e-a2ed-63b9c3c61423 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1663 microversion: 2.1 time: 0.476375 Oct 11 19:53:24.007569 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1337/2723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:23 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1663 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:24.121818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3f7ca4cf-0433-4cb3-994b-a748b6b8bc3c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7550430>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:24.190403 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3f7ca4cf-0433-4cb3-994b-a748b6b8bc3c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.073106 Oct 11 19:53:24.191965 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1338/2724] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:24 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:24.229242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0a940e0e-3afd-4011-8187-ce65fa265305 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:24.229837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0a940e0e-3afd-4011-8187-ce65fa265305 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:24.265855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a940e0e-3afd-4011-8187-ce65fa265305 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:24.266366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a940e0e-3afd-4011-8187-ce65fa265305 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:24.266847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a940e0e-3afd-4011-8187-ce65fa265305 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:24.267564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a940e0e-3afd-4011-8187-ce65fa265305 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:24.268019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a940e0e-3afd-4011-8187-ce65fa265305 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:24.274915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a940e0e-3afd-4011-8187-ce65fa265305 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:24.453404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-984f2bae-e1f5-490c-8c62-a9c072ecf39a tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:24.465575 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-984f2bae-e1f5-490c-8c62-a9c072ecf39a tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1527 microversion: 2.1 time: 0.490895 Oct 11 19:53:24.481595 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1387/2725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:23 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1527 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:24.569187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a21a2d1-42a4-4ee7-8ce2-48a996e1aeb6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:24.569811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7a21a2d1-42a4-4ee7-8ce2-48a996e1aeb6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:24.583409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a21a2d1-42a4-4ee7-8ce2-48a996e1aeb6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:24.583995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a21a2d1-42a4-4ee7-8ce2-48a996e1aeb6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:24.584531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a21a2d1-42a4-4ee7-8ce2-48a996e1aeb6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:24.585337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a21a2d1-42a4-4ee7-8ce2-48a996e1aeb6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:24.585798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a21a2d1-42a4-4ee7-8ce2-48a996e1aeb6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:24.587117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a21a2d1-42a4-4ee7-8ce2-48a996e1aeb6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:24.840338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-7a21a2d1-42a4-4ee7-8ce2-48a996e1aeb6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:24.872516 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a21a2d1-42a4-4ee7-8ce2-48a996e1aeb6 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1933 microversion: 2.75 time: 0.312301 Oct 11 19:53:24.896204 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1388/2726] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:24 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1933 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:25.031625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c36ce1ca-fd88-4c8b-a696-1ada91b513e3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:25.032684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c36ce1ca-fd88-4c8b-a696-1ada91b513e3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:25.052686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce1ca-fd88-4c8b-a696-1ada91b513e3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:25.060372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce1ca-fd88-4c8b-a696-1ada91b513e3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:25.061389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce1ca-fd88-4c8b-a696-1ada91b513e3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:25.062390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce1ca-fd88-4c8b-a696-1ada91b513e3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:25.063122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce1ca-fd88-4c8b-a696-1ada91b513e3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:25.063776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c36ce1ca-fd88-4c8b-a696-1ada91b513e3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:25.609833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0a940e0e-3afd-4011-8187-ce65fa265305 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:25.627087 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0a940e0e-3afd-4011-8187-ce65fa265305 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1323 microversion: 2.1 time: 1.399406 Oct 11 19:53:25.629017 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1339/2727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:24 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1323 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:25.640183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e96854d-4ef6-4b80-b73c-ee1dd9da06e6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c756df70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:25.713703 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e96854d-4ef6-4b80-b73c-ee1dd9da06e6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.083008 Oct 11 19:53:25.714287 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1340/2728] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:25 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:25.732277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-82d512dc-fcc9-45df-af3b-3a47b8925bf7 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:25.733941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-82d512dc-fcc9-45df-af3b-3a47b8925bf7 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:25.748335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82d512dc-fcc9-45df-af3b-3a47b8925bf7 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:25.751188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82d512dc-fcc9-45df-af3b-3a47b8925bf7 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:25.752098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82d512dc-fcc9-45df-af3b-3a47b8925bf7 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:25.753782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82d512dc-fcc9-45df-af3b-3a47b8925bf7 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:25.755833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82d512dc-fcc9-45df-af3b-3a47b8925bf7 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:25.757673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82d512dc-fcc9-45df-af3b-3a47b8925bf7 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:26.717570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c36ce1ca-fd88-4c8b-a696-1ada91b513e3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:26.734065 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c36ce1ca-fd88-4c8b-a696-1ada91b513e3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1663 microversion: 2.1 time: 1.706264 Oct 11 19:53:26.750629 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1389/2729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:25 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1663 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:26.750629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0eba565d-9c2d-44be-b3b3-a9654ef3a4b1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:26.750629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0eba565d-9c2d-44be-b3b3-a9654ef3a4b1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:26.768103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eba565d-9c2d-44be-b3b3-a9654ef3a4b1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:26.769248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eba565d-9c2d-44be-b3b3-a9654ef3a4b1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:26.769696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eba565d-9c2d-44be-b3b3-a9654ef3a4b1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:26.770423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eba565d-9c2d-44be-b3b3-a9654ef3a4b1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:26.770922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eba565d-9c2d-44be-b3b3-a9654ef3a4b1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:26.771357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eba565d-9c2d-44be-b3b3-a9654ef3a4b1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:26.907425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-82d512dc-fcc9-45df-af3b-3a47b8925bf7 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:26.919588 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-82d512dc-fcc9-45df-af3b-3a47b8925bf7 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1527 microversion: 2.1 time: 1.203454 Oct 11 19:53:26.921624 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1341/2730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:25 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1527 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:26.937183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4518b3a8-a9c8-46b0-ab57-ecc0a9bcf6f8 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:26.938086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4518b3a8-a9c8-46b0-ab57-ecc0a9bcf6f8 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:26.946791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4518b3a8-a9c8-46b0-ab57-ecc0a9bcf6f8 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:26.949825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4518b3a8-a9c8-46b0-ab57-ecc0a9bcf6f8 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:26.950451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4518b3a8-a9c8-46b0-ab57-ecc0a9bcf6f8 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:26.959284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4518b3a8-a9c8-46b0-ab57-ecc0a9bcf6f8 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:26.960098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4518b3a8-a9c8-46b0-ab57-ecc0a9bcf6f8 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:26.960793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4518b3a8-a9c8-46b0-ab57-ecc0a9bcf6f8 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:27.051633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-0eba565d-9c2d-44be-b3b3-a9654ef3a4b1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] Lazy-loading 'services' on Instance uuid a90c3142-40c1-4b20-8618-63c1a1c21e90 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:27.090944 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0eba565d-9c2d-44be-b3b3-a9654ef3a4b1 tempest-ServersAdmin275Test-1192667450 tempest-ServersAdmin275Test-1192667450-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1918 microversion: 2.75 time: 0.349422 Oct 11 19:53:27.091799 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1390/2731] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:26 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1918 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:27.097839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff14ebc1-cee9-417f-9c2c-12f3bb3aa92f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0840940>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:27.161197 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff14ebc1-cee9-417f-9c2c-12f3bb3aa92f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.067914 Oct 11 19:53:27.162619 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1391/2732] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:27 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:27.170335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4344676a-7ec3-4d6b-b08e-8e1b70fe4087 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:27.171875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4344676a-7ec3-4d6b-b08e-8e1b70fe4087 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:27.180050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4344676a-7ec3-4d6b-b08e-8e1b70fe4087 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:27.180898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4344676a-7ec3-4d6b-b08e-8e1b70fe4087 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:27.181622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4344676a-7ec3-4d6b-b08e-8e1b70fe4087 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:27.182846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4344676a-7ec3-4d6b-b08e-8e1b70fe4087 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:27.183538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4344676a-7ec3-4d6b-b08e-8e1b70fe4087 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:27.184188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4344676a-7ec3-4d6b-b08e-8e1b70fe4087 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:27.231883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4344676a-7ec3-4d6b-b08e-8e1b70fe4087 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:53:27.416479 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4344676a-7ec3-4d6b-b08e-8e1b70fe4087 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 204 len: 0 microversion: 2.75 time: 0.251316 Oct 11 19:53:27.420962 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1392/2733] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 19:53:27 2022] DELETE /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 19:53:27.432586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:27.437222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:27.454459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:27.456047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:27.459312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:27.460203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:27.461103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:27.461705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:27.749193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:27.766826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:27.768645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:27.782478 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4b47a494-be53-4539-ac4c-d3959bb1df82 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1443 microversion: 2.75 time: 0.359850 Oct 11 19:53:27.793264 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1393/2734] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:27 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1443 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:27.801572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10c36cac-19f8-4ecc-a3e1-d00049ba3da2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:27.806191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10c36cac-19f8-4ecc-a3e1-d00049ba3da2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:27.818807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10c36cac-19f8-4ecc-a3e1-d00049ba3da2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:27.822451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10c36cac-19f8-4ecc-a3e1-d00049ba3da2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:27.823474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10c36cac-19f8-4ecc-a3e1-d00049ba3da2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:27.824049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10c36cac-19f8-4ecc-a3e1-d00049ba3da2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:27.824538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10c36cac-19f8-4ecc-a3e1-d00049ba3da2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:27.824977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10c36cac-19f8-4ecc-a3e1-d00049ba3da2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:28.251496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4518b3a8-a9c8-46b0-ab57-ecc0a9bcf6f8 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:28.260850 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4518b3a8-a9c8-46b0-ab57-ecc0a9bcf6f8 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1516 microversion: 2.1 time: 1.338147 Oct 11 19:53:28.286956 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1342/2735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:26 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1516 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:28.297277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7d343167-6480-4171-9a56-e5f08a007b42 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:28.298141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7d343167-6480-4171-9a56-e5f08a007b42 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:28.318425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d343167-6480-4171-9a56-e5f08a007b42 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:28.319269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d343167-6480-4171-9a56-e5f08a007b42 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:28.321086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d343167-6480-4171-9a56-e5f08a007b42 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:28.322063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d343167-6480-4171-9a56-e5f08a007b42 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:28.323029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d343167-6480-4171-9a56-e5f08a007b42 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:28.326319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d343167-6480-4171-9a56-e5f08a007b42 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:28.690864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-10c36cac-19f8-4ecc-a3e1-d00049ba3da2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:28.704819 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10c36cac-19f8-4ecc-a3e1-d00049ba3da2 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1667 microversion: 2.1 time: 0.910197 Oct 11 19:53:28.706220 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1394/2736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:27 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1667 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:28.717025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2bb081ae-e731-4a52-96ed-9b0cfb9cf4c2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d073bc10>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:28.804130 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2bb081ae-e731-4a52-96ed-9b0cfb9cf4c2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.096303 Oct 11 19:53:28.805324 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1395/2737] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:28 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:28.815704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9cdedf56-bc08-4894-8a70-3175205721cf tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:28.820060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9cdedf56-bc08-4894-8a70-3175205721cf tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:28.838181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9cdedf56-bc08-4894-8a70-3175205721cf tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:28.839074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9cdedf56-bc08-4894-8a70-3175205721cf tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:28.839752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9cdedf56-bc08-4894-8a70-3175205721cf tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:28.840879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9cdedf56-bc08-4894-8a70-3175205721cf tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:28.841547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9cdedf56-bc08-4894-8a70-3175205721cf tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:28.843631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9cdedf56-bc08-4894-8a70-3175205721cf tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:28.898386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-9cdedf56-bc08-4894-8a70-3175205721cf tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lazy-loading 'flavor' on Instance uuid f0583d05-1d47-4efb-a936-5e747c44c9c2 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:29.058493 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9cdedf56-bc08-4894-8a70-3175205721cf tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "POST /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2/action" status: 200 len: 32 microversion: 2.1 time: 0.251817 Oct 11 19:53:29.064284 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1396/2738] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:53:28 2022] POST /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2/action => generated 32 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:53:29.083439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:29.084589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:29.092437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:29.093266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:29.094130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:29.095816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:29.096529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:29.097162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:29.125819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:29.472563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:29.530464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d343167-6480-4171-9a56-e5f08a007b42 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:29.540620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7d343167-6480-4171-9a56-e5f08a007b42 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1527 microversion: 2.1 time: 1.252288 Oct 11 19:53:29.542158 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1343/2739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:28 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1527 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:29.543930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:29.546005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ca619bcb2714746a1c74cff0ad64f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bba0e59b5314bb29bebe8c96e748ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:29.547915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9425dfcd-44ec-447b-9695-b2943e4a7dec tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:29.548721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9425dfcd-44ec-447b-9695-b2943e4a7dec tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:29.556330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9425dfcd-44ec-447b-9695-b2943e4a7dec tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:29.557441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9425dfcd-44ec-447b-9695-b2943e4a7dec tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:29.558121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9425dfcd-44ec-447b-9695-b2943e4a7dec tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:29.560239 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-79d56124-b095-468d-b7a0-a36bdb9bd99b tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 200 len: 1443 microversion: 2.75 time: 0.494361 Oct 11 19:53:29.564972 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1397/2740] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:29 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 1443 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:53:29.572651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9425dfcd-44ec-447b-9695-b2943e4a7dec tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:29.573161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9425dfcd-44ec-447b-9695-b2943e4a7dec tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:29.573609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9425dfcd-44ec-447b-9695-b2943e4a7dec tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:29.821659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d56c7847-c254-42ea-a2ab-7d999440509a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d06d11f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:29.887084 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d56c7847-c254-42ea-a2ab-7d999440509a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.070146 Oct 11 19:53:29.888213 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1398/2741] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:29 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:30.561453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-396a71c2-84da-4f6e-a42b-09f5b4ec6cde req-859b135f-47b4-47d7-9c64-1b3f299b04b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d992e753-9653-4f74-8b23-b01c1e706f2c", "name": "network-vif-deleted", "tag": "0b0d56ac-ceeb-4778-bd9a-84c79e6cf05d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:30.610163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-396a71c2-84da-4f6e-a42b-09f5b4ec6cde req-859b135f-47b4-47d7-9c64-1b3f299b04b9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:30.610163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-396a71c2-84da-4f6e-a42b-09f5b4ec6cde req-859b135f-47b4-47d7-9c64-1b3f299b04b9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:30.622710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-396a71c2-84da-4f6e-a42b-09f5b4ec6cde req-859b135f-47b4-47d7-9c64-1b3f299b04b9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:30.637567 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-396a71c2-84da-4f6e-a42b-09f5b4ec6cde req-859b135f-47b4-47d7-9c64-1b3f299b04b9 service nova] Creating event network-vif-deleted:0b0d56ac-ceeb-4778-bd9a-84c79e6cf05d for instance d992e753-9653-4f74-8b23-b01c1e706f2c on n-h2-860864-3 Oct 11 19:53:30.643906 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-396a71c2-84da-4f6e-a42b-09f5b4ec6cde req-859b135f-47b4-47d7-9c64-1b3f299b04b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087267 Oct 11 19:53:30.645756 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1399/2742] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:53:30.665210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:30.667190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:30.692367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:30.693956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:30.694408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:30.698812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:30.699553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:30.702007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:30.780099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:30.780959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:30.781578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:30.786697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lazy-loading 'fault' on Instance uuid d992e753-9653-4f74-8b23-b01c1e706f2c {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:53:31.296159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbecbe35beba44029ba3a09d32330ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f310bb3ee8be485ab7539076d3572ff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:31.312014 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e9a37bcd-d14e-4cd9-81f1-5693ad6fcfa9 tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 200 len: 1314 microversion: 2.1 time: 0.663669 Oct 11 19:53:31.322952 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1400/2743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:30 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:31.335561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9425dfcd-44ec-447b-9695-b2943e4a7dec tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:31.340140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:31.341378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] [instance: a90c3142-40c1-4b20-8618-63c1a1c21e90] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:31.350715 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9425dfcd-44ec-447b-9695-b2943e4a7dec tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 1.807093 Oct 11 19:53:31.358261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:31.360130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:31.360573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:31.363020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:31.363500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:31.364057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:31.375874 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1344/2744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:29 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:31.406582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d128d48d-b3cf-487c-b431-3e92e67031a0 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7550a60>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:31.409558 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] HTTP exception thrown: Instance a90c3142-40c1-4b20-8618-63c1a1c21e90 could not be found. Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Request method failure captured: Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 HTTP/1.1 Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRclo0fLNkdk7Stm1W_10p_9cIhGBOHfOmOsl4UDlkyC38sdRNrsb4WOFGm_6s_yDSuSyKue16GOwsm86CbyQTsikUd99j3YwohPR4K3YUGTB6JUjQ58wYpf3RJYNrNe-wMXE4C-fJJhXHIqUjgTafriMu8eVrX-9fH6j4tb2zJva0Cg Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.75 Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 8bba0e59b5314bb29bebe8c96e748ef9 Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAdmin275Test-663201444 Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8bba0e59b5314bb29bebe8c96e748ef9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8bba0e59b5314bb29bebe8c96e748ef9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bba0e59b5314bb29bebe8c96e748ef9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bba0e59b5314bb29bebe8c96e748ef9"}]}] Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAdmin275Test-663201444 Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 8bba0e59b5314bb29bebe8c96e748ef9 Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAdmin275Test-663201444 Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAdmin275Test-663201444-project Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 0ca619bcb2714746a1c74cff0ad64f8b Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAdmin275Test-663201444-project Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance a90c3142-40c1-4b20-8618-63c1a1c21e90 could not be found. Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a90c3142-40c1-4b20-8618-63c1a1c21e90'} Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90c3142-40c1-4b20-8618-63c1a1c21e90 could not be found. Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90c3142-40c1-4b20-8618-63c1a1c21e90 could not be found. Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:31.421753 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:31.426333 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:31.426333 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:31.426333 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:31.426333 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:53:31.426333 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:53:31.426333 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90c3142-40c1-4b20-8618-63c1a1c21e90 could not be found. Oct 11 19:53:31.426333 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:31.426333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] Returning 404 to user: Instance a90c3142-40c1-4b20-8618-63c1a1c21e90 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:53:31.426333 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-67c4ed0a-ad56-4ad2-b305-93696c643498 tempest-ServersAdmin275Test-663201444 tempest-ServersAdmin275Test-663201444-project] 10.222.0.27 "GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90" status: 404 len: 111 microversion: 2.75 time: 0.105953 Oct 11 19:53:31.426333 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1401/2745] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:53:31 2022] GET /compute/v2.1/servers/a90c3142-40c1-4b20-8618-63c1a1c21e90 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:53:31.569430 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d128d48d-b3cf-487c-b431-3e92e67031a0 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.192288 Oct 11 19:53:31.572794 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1345/2746] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:31 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:32.341574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:32.343139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] [instance: d992e753-9653-4f74-8b23-b01c1e706f2c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:32.360316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:32.360898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:32.361715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:32.365947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:32.366792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:32.367523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:32.381809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b53c2d6-d41e-4301-b792-7f540a683a8a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:32.382446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2b53c2d6-d41e-4301-b792-7f540a683a8a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:32.400708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b53c2d6-d41e-4301-b792-7f540a683a8a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:32.401224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b53c2d6-d41e-4301-b792-7f540a683a8a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:32.401672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b53c2d6-d41e-4301-b792-7f540a683a8a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:32.402404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b53c2d6-d41e-4301-b792-7f540a683a8a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:32.402897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b53c2d6-d41e-4301-b792-7f540a683a8a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:32.403331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b53c2d6-d41e-4301-b792-7f540a683a8a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:32.411715 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] HTTP exception thrown: Instance d992e753-9653-4f74-8b23-b01c1e706f2c could not be found. Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Request method failure captured: Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c HTTP/1.1 Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcmXMpNp2RGjiNOFyo1KOsqQ-EPV2lKU7YMpJqjabmYYCk-JhgsEFY3KhP5Vpp2V-eXJfjDOu8WcDKGQ1mLLzR3h-sILTjdPRrCUpRO1uyIq3ztnnRiFhbP63N4LSjsPPsCZ9oEyEfexx_Agi4ad5gS5WEs1-w6Q9Cmjy9eYpto2V0w Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f310bb3ee8be485ab7539076d3572ff5 Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1144391963 Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f310bb3ee8be485ab7539076d3572ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f310bb3ee8be485ab7539076d3572ff5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f310bb3ee8be485ab7539076d3572ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f310bb3ee8be485ab7539076d3572ff5"}]}] Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1144391963 Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f310bb3ee8be485ab7539076d3572ff5 Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1144391963 Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerAddressesNegativeTestJSON-1144391963-project Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: dbecbe35beba44029ba3a09d32330ed5 Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1144391963-project Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance d992e753-9653-4f74-8b23-b01c1e706f2c could not be found. Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'd992e753-9653-4f74-8b23-b01c1e706f2c'} Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d992e753-9653-4f74-8b23-b01c1e706f2c could not be found. Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d992e753-9653-4f74-8b23-b01c1e706f2c could not be found. Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:32.416813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:53:32.421693 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:32.421693 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:53:32.421693 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:53:32.421693 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:53:32.421693 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:53:32.421693 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:53:32.421693 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d992e753-9653-4f74-8b23-b01c1e706f2c could not be found. Oct 11 19:53:32.421693 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:53:32.424082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] Returning 404 to user: Instance d992e753-9653-4f74-8b23-b01c1e706f2c could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:53:32.425588 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-015effaa-e85d-494d-bebb-bc0e94cdc5fc tempest-ServerAddressesNegativeTestJSON-1144391963 tempest-ServerAddressesNegativeTestJSON-1144391963-project] 10.222.0.27 "GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c" status: 404 len: 111 microversion: 2.1 time: 0.089816 Oct 11 19:53:32.437421 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1402/2747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:32 2022] GET /compute/v2.1/servers/d992e753-9653-4f74-8b23-b01c1e706f2c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:53:32.589535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-64f3818e-11fe-442f-aafe-e7955de56770 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d07120d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:32.682455 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-64f3818e-11fe-442f-aafe-e7955de56770 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.098651 Oct 11 19:53:32.683073 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1403/2748] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:32 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:33.092840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2b53c2d6-d41e-4301-b792-7f540a683a8a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:33.113787 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2b53c2d6-d41e-4301-b792-7f540a683a8a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 0.731614 Oct 11 19:53:33.116471 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1346/2749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:32 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:33.701082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9acc5cba-5ee3-4c5d-b43e-1195a5f4b9f4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d07a3280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:33.793280 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9acc5cba-5ee3-4c5d-b43e-1195a5f4b9f4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.097298 Oct 11 19:53:33.794183 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1404/2750] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:33 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:34.138079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aafca24e-892d-4387-a01c-34dd4d944c17 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:34.138708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aafca24e-892d-4387-a01c-34dd4d944c17 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:34.158412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aafca24e-892d-4387-a01c-34dd4d944c17 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:34.159690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aafca24e-892d-4387-a01c-34dd4d944c17 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:34.160784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aafca24e-892d-4387-a01c-34dd4d944c17 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:34.161995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aafca24e-892d-4387-a01c-34dd4d944c17 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:34.163323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aafca24e-892d-4387-a01c-34dd4d944c17 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:34.165354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aafca24e-892d-4387-a01c-34dd4d944c17 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:34.761173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aafca24e-892d-4387-a01c-34dd4d944c17 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:34.772464 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aafca24e-892d-4387-a01c-34dd4d944c17 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 0.638301 Oct 11 19:53:34.782471 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1347/2751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:34 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:34.810487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0f7198a-4d22-4471-b074-1c1db8347e7b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d06d1160>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:34.912008 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0f7198a-4d22-4471-b074-1c1db8347e7b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.106516 Oct 11 19:53:34.914492 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1405/2752] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:34 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:35.806689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-42db21c2-45ff-4238-9e6e-54c1155ad4d4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:35.807303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-42db21c2-45ff-4238-9e6e-54c1155ad4d4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:35.823789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42db21c2-45ff-4238-9e6e-54c1155ad4d4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:35.824295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42db21c2-45ff-4238-9e6e-54c1155ad4d4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:35.824732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42db21c2-45ff-4238-9e6e-54c1155ad4d4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:35.825447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42db21c2-45ff-4238-9e6e-54c1155ad4d4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:35.825893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42db21c2-45ff-4238-9e6e-54c1155ad4d4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:35.841039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42db21c2-45ff-4238-9e6e-54c1155ad4d4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:35.929125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d22dcca2-c985-4578-bc4f-8f0d3e2966f1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0746b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:35.999148 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d22dcca2-c985-4578-bc4f-8f0d3e2966f1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.073776 Oct 11 19:53:36.007381 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1406/2753] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:35 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:37.016837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1bb7044-901c-402e-a558-480ea0a96d77 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d08351f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:37.113137 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1bb7044-901c-402e-a558-480ea0a96d77 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.101826 Oct 11 19:53:37.113728 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1407/2754] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:37 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:37.621599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-42db21c2-45ff-4238-9e6e-54c1155ad4d4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:37.630450 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-42db21c2-45ff-4238-9e6e-54c1155ad4d4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 1.828689 Oct 11 19:53:37.642770 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1348/2755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:35 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:38.128987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e7fd69da-d819-46ba-8be8-e2401c755463 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc4afca0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:38.207973 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e7fd69da-d819-46ba-8be8-e2401c755463 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1454 microversion: 2.1 time: 0.083790 Oct 11 19:53:38.217440 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1408/2756] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:38 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:38.671355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62902cbc-6c69-4baf-bbe8-6098ed30e5fc tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:38.671970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-62902cbc-6c69-4baf-bbe8-6098ed30e5fc tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:38.684956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62902cbc-6c69-4baf-bbe8-6098ed30e5fc tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:38.685449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62902cbc-6c69-4baf-bbe8-6098ed30e5fc tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:38.685889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62902cbc-6c69-4baf-bbe8-6098ed30e5fc tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:38.687339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62902cbc-6c69-4baf-bbe8-6098ed30e5fc tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:38.687985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62902cbc-6c69-4baf-bbe8-6098ed30e5fc tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:38.688765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62902cbc-6c69-4baf-bbe8-6098ed30e5fc tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:38.757602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:39.225818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-010706f7-a8ca-47f1-82ed-7edf68832195 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0746d30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:39.315790 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-010706f7-a8ca-47f1-82ed-7edf68832195 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1463 microversion: 2.1 time: 0.095131 Oct 11 19:53:39.342504 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1409/2757] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:39 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1463 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:39.376949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bdf353dd-44e5-4a60-ac5d-e231fd24f398 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cddd09d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:39.461080 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bdf353dd-44e5-4a60-ac5d-e231fd24f398 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 200 len: 1463 microversion: 2.1 time: 0.113487 Oct 11 19:53:39.464700 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1410/2758] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:39 2022] GET /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 1463 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:39.478136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11b1a2ec-f06f-41c5-b764-56fc2afb0dd2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:39.478854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-11b1a2ec-f06f-41c5-b764-56fc2afb0dd2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:39.491905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11b1a2ec-f06f-41c5-b764-56fc2afb0dd2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:39.493699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11b1a2ec-f06f-41c5-b764-56fc2afb0dd2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:39.494170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11b1a2ec-f06f-41c5-b764-56fc2afb0dd2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:39.496215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11b1a2ec-f06f-41c5-b764-56fc2afb0dd2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:39.496710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11b1a2ec-f06f-41c5-b764-56fc2afb0dd2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:39.498251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11b1a2ec-f06f-41c5-b764-56fc2afb0dd2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:40.166222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-62902cbc-6c69-4baf-bbe8-6098ed30e5fc tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:40.182162 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-62902cbc-6c69-4baf-bbe8-6098ed30e5fc tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 1.516531 Oct 11 19:53:40.183089 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1349/2759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:38 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:40.508468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-11b1a2ec-f06f-41c5-b764-56fc2afb0dd2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:40.517503 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-11b1a2ec-f06f-41c5-b764-56fc2afb0dd2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 200 len: 1468 microversion: 2.1 time: 1.045063 Oct 11 19:53:40.533780 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1411/2760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:39 2022] GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 1468 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:40.536072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-751460625", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:40.542966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cfe768a9-5304-48e7-9835-838c82e7ee1d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1682726578"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:40.545945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cfe768a9-5304-48e7-9835-838c82e7ee1d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:40.553181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe768a9-5304-48e7-9835-838c82e7ee1d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:40.554313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe768a9-5304-48e7-9835-838c82e7ee1d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:40.555896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe768a9-5304-48e7-9835-838c82e7ee1d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:40.557030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe768a9-5304-48e7-9835-838c82e7ee1d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:40.558126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe768a9-5304-48e7-9835-838c82e7ee1d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:40.559118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe768a9-5304-48e7-9835-838c82e7ee1d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:40.642284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:53:40.908660 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cfe768a9-5304-48e7-9835-838c82e7ee1d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "POST /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104/action" status: 202 len: 0 microversion: 2.1 time: 0.369476 Oct 11 19:53:40.916007 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1412/2761] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:53:40 2022] POST /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 19:53:40.937777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a382333f-fc00-4524-a215-5281794acee3 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83ccb46550>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:41.019144 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a382333f-fc00-4524-a215-5281794acee3 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.100991 Oct 11 19:53:41.020535 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1413/2762] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:40 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:41.215688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-32485c23-ea54-496e-93a7-3927b2cf5184 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:41.216698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-32485c23-ea54-496e-93a7-3927b2cf5184 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:41.245585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32485c23-ea54-496e-93a7-3927b2cf5184 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:41.246901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32485c23-ea54-496e-93a7-3927b2cf5184 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:41.247545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32485c23-ea54-496e-93a7-3927b2cf5184 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:41.249326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32485c23-ea54-496e-93a7-3927b2cf5184 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:41.250159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32485c23-ea54-496e-93a7-3927b2cf5184 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:41.250873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32485c23-ea54-496e-93a7-3927b2cf5184 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:41.547727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:53:41.548713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:53:41.549406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:53:41.549980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:53:41.550577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:53:41.560899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:41.561638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:41.562077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:41.563011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:41.563632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:41.564426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:41.588071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Getting quotas for project 72d58f28f49447e298dbb540406db442. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:53:41.594197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Getting quotas for user bcf8064e6fb843b782f0d89718f1c8e5 and project 72d58f28f49447e298dbb540406db442. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:53:41.608577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:53:41.611149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:53:41.689887 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aac93350-360e-4efc-8bee-a4542e663ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505130 Oct 11 19:53:41.691839 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1350/2763] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:53:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:53:41.773501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-32485c23-ea54-496e-93a7-3927b2cf5184 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:41.784035 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-32485c23-ea54-496e-93a7-3927b2cf5184 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 0.580165 Oct 11 19:53:41.794999 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1414/2764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:41 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:41.898046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1514709996", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:42.019288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:53:42.037331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-de54d8dd-5f6e-42eb-9595-dd6dbbc3254f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d06d1040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:42.123718 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-de54d8dd-5f6e-42eb-9595-dd6dbbc3254f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.091560 Oct 11 19:53:42.130225 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1415/2765] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:42 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:42.813163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:53:42.813645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:53:42.814097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:53:42.814510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:53:42.814941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:53:42.817257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-60c1d982-d4cd-41be-833d-96871fcd6e01 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:42.820226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-60c1d982-d4cd-41be-833d-96871fcd6e01 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:42.831574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:42.832070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:42.833634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:42.836865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60c1d982-d4cd-41be-833d-96871fcd6e01 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:42.837585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:42.838131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:42.838256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60c1d982-d4cd-41be-833d-96871fcd6e01 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:42.838587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:42.842300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60c1d982-d4cd-41be-833d-96871fcd6e01 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:42.843357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60c1d982-d4cd-41be-833d-96871fcd6e01 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:42.843907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60c1d982-d4cd-41be-833d-96871fcd6e01 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:42.844624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60c1d982-d4cd-41be-833d-96871fcd6e01 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:42.889543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Getting quotas for project 72d58f28f49447e298dbb540406db442. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:53:42.901555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Getting quotas for user bcf8064e6fb843b782f0d89718f1c8e5 and project 72d58f28f49447e298dbb540406db442. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:53:42.916813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:53:42.919078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:53:43.044973 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-df28366d-7e48-4ef1-ba33-b8b30969bdd9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.150935 Oct 11 19:53:43.051551 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1351/2766] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:53:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:53:43.082048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b1fc312-51ce-467f-8fb0-e706bad2e205 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:43.082731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2b1fc312-51ce-467f-8fb0-e706bad2e205 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:43.182946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2b1fc312-51ce-467f-8fb0-e706bad2e205 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:43.199620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2b1fc312-51ce-467f-8fb0-e706bad2e205 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1214 microversion: 2.1 time: 0.142434 Oct 11 19:53:43.201821 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1352/2767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:43 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:43.227334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51fe6061-e52c-47c3-bc9a-4bc9b9434992 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc147dc0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:43.333655 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51fe6061-e52c-47c3-bc9a-4bc9b9434992 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.127784 Oct 11 19:53:43.334256 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1353/2768] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:43 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:43.381120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-60c1d982-d4cd-41be-833d-96871fcd6e01 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:43.391683 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-60c1d982-d4cd-41be-833d-96871fcd6e01 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 0.582292 Oct 11 19:53:43.394566 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1416/2769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:42 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:43.748178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1415445675", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:43.843281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] validate_networks() for [('baf55d51-7df2-4aeb-9852-b73c314856f4', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:53:44.227966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-19df5096-de44-4f5f-8cda-475d5d2d4ca7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:44.229217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-19df5096-de44-4f5f-8cda-475d5d2d4ca7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:44.240653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19df5096-de44-4f5f-8cda-475d5d2d4ca7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:44.243686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19df5096-de44-4f5f-8cda-475d5d2d4ca7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:44.244183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19df5096-de44-4f5f-8cda-475d5d2d4ca7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:44.245143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19df5096-de44-4f5f-8cda-475d5d2d4ca7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:44.245694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19df5096-de44-4f5f-8cda-475d5d2d4ca7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:44.246122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19df5096-de44-4f5f-8cda-475d5d2d4ca7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:44.383894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-19df5096-de44-4f5f-8cda-475d5d2d4ca7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:44.398153 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-19df5096-de44-4f5f-8cda-475d5d2d4ca7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1210 microversion: 2.1 time: 0.174836 Oct 11 19:53:44.444429 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1417/2770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:44 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1210 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:53:44.472073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1b086dff-df91-4e47-acf1-429e9ef01497 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0835700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:44.630683 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1b086dff-df91-4e47-acf1-429e9ef01497 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.179766 Oct 11 19:53:44.631338 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1418/2771] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:44 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:44.671491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-19e9a0f8-d7ab-4de8-863c-a1d04bc529fa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:44.672577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-19e9a0f8-d7ab-4de8-863c-a1d04bc529fa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:44.693648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e9a0f8-d7ab-4de8-863c-a1d04bc529fa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:44.694166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e9a0f8-d7ab-4de8-863c-a1d04bc529fa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:44.694635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e9a0f8-d7ab-4de8-863c-a1d04bc529fa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:44.700188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e9a0f8-d7ab-4de8-863c-a1d04bc529fa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:44.701718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e9a0f8-d7ab-4de8-863c-a1d04bc529fa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:44.703601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e9a0f8-d7ab-4de8-863c-a1d04bc529fa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:45.403615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-19e9a0f8-d7ab-4de8-863c-a1d04bc529fa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:45.415981 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-19e9a0f8-d7ab-4de8-863c-a1d04bc529fa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 0.783390 Oct 11 19:53:45.416594 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1419/2772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:44 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:45.431239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:53:45.431740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:53:45.432182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:53:45.432955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:53:45.433534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:53:45.456567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:45.457868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:45.460216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:45.462323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:45.464846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:45.466922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:45.555372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Getting quotas for project 8df2eebeffd440d988aa6f580c9bb221. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:53:45.579225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-558f8d98-b4d4-4314-853a-7b61a0cfef53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'create', calling method: .version_select at 0x7f83d06d1280>, body: {"keypair": {"name": "tempest-keypair-1106054146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE76hcAzAL2N5IxF440PZ0kGyVsAdYfLIPc0va1Oq5amw6jh2hkWPs4rxeg8ynqg9/zX0QC9vDOicVcmFWVXnw/NclZQfK7Uln/hicHx6yOaualSX0UGZGGXQU6RvddOJg=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:45.588286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Getting quotas for user d1ab8c29f18c4fc09858791a80527e5d and project 8df2eebeffd440d988aa6f580c9bb221. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:53:45.654880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-558f8d98-b4d4-4314-853a-7b61a0cfef53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for project efd1bdcd18f14e87925a5b41393b9add. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:53:45.667861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:53:45.686929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-558f8d98-b4d4-4314-853a-7b61a0cfef53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for user 0647dca89de240ba9fbc1c59ed2b6392 and project efd1bdcd18f14e87925a5b41393b9add. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:53:45.687710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:53:45.765142 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-558f8d98-b4d4-4314-853a-7b61a0cfef53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.347474 Oct 11 19:53:45.767021 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1420/2773] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:53:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:45.777590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-409be8b8-7258-466f-abc9-9c85ef2f286f req-6c101f50-bb7c-423e-9063-7412db41fe17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0929e96c-9da0-4034-ae0e-38f7330002f5", "name": "network-vif-unplugged", "status": "completed", "tag": "71f8f1b2-5864-4201-894f-6d7e1edc96c4"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:45.830287 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4f2afebb-b33d-4c78-8c3d-d8bca1c34787 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.330281 Oct 11 19:53:45.831659 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1354/2774] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:53:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:53:45.833118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-409be8b8-7258-466f-abc9-9c85ef2f286f req-6c101f50-bb7c-423e-9063-7412db41fe17 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:45.833629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-409be8b8-7258-466f-abc9-9c85ef2f286f req-6c101f50-bb7c-423e-9063-7412db41fe17 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:45.836897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-409be8b8-7258-466f-abc9-9c85ef2f286f req-6c101f50-bb7c-423e-9063-7412db41fe17 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:45.842708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0efcce0-7e19-4dad-93e3-af54833c662e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:45.846940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f0efcce0-7e19-4dad-93e3-af54833c662e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:45.858016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0efcce0-7e19-4dad-93e3-af54833c662e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:45.861487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0efcce0-7e19-4dad-93e3-af54833c662e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:45.862069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0efcce0-7e19-4dad-93e3-af54833c662e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:45.866636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0efcce0-7e19-4dad-93e3-af54833c662e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:45.867817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0efcce0-7e19-4dad-93e3-af54833c662e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:45.868279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0efcce0-7e19-4dad-93e3-af54833c662e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:45.889673 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-409be8b8-7258-466f-abc9-9c85ef2f286f req-6c101f50-bb7c-423e-9063-7412db41fe17 service nova] Creating event network-vif-unplugged:71f8f1b2-5864-4201-894f-6d7e1edc96c4 for instance 0929e96c-9da0-4034-ae0e-38f7330002f5 on n-h2-860864-3 Oct 11 19:53:45.912948 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-409be8b8-7258-466f-abc9-9c85ef2f286f req-6c101f50-bb7c-423e-9063-7412db41fe17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143238 Oct 11 19:53:45.913563 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1421/2775] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:45.931953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2885a3b5-e9cd-4d66-8e1d-995f791cf380 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc3390d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:46.035624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f0efcce0-7e19-4dad-93e3-af54833c662e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:46.064651 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f0efcce0-7e19-4dad-93e3-af54833c662e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1272 microversion: 2.1 time: 0.231489 Oct 11 19:53:46.065346 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1355/2776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:45 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:46.085155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8400d1a7-3395-4022-902e-915fa7476c56 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:46.085828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8400d1a7-3395-4022-902e-915fa7476c56 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:46.109412 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2885a3b5-e9cd-4d66-8e1d-995f791cf380 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.193786 Oct 11 19:53:46.110462 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1422/2777] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:45 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:46.232729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8400d1a7-3395-4022-902e-915fa7476c56 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:46.240210 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8400d1a7-3395-4022-902e-915fa7476c56 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1222 microversion: 2.1 time: 0.160537 Oct 11 19:53:46.250692 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1356/2778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:46 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:46.409936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-592586371", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:46.441956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5f02fbad-3274-40d9-8624-a640d2d3266a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:46.442778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f02fbad-3274-40d9-8624-a640d2d3266a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:46.444965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:46.479957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f02fbad-3274-40d9-8624-a640d2d3266a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:46.481090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f02fbad-3274-40d9-8624-a640d2d3266a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:46.482158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f02fbad-3274-40d9-8624-a640d2d3266a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:46.499359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f02fbad-3274-40d9-8624-a640d2d3266a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:46.501035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f02fbad-3274-40d9-8624-a640d2d3266a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:46.503316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f02fbad-3274-40d9-8624-a640d2d3266a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:46.578785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] validate_networks() for [('baf55d51-7df2-4aeb-9852-b73c314856f4', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:53:47.189828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5f02fbad-3274-40d9-8624-a640d2d3266a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:47.202261 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5f02fbad-3274-40d9-8624-a640d2d3266a tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 0.764566 Oct 11 19:53:47.209088 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1357/2779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:46 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:47.233554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-52e80685-2cd4-48bf-a0b6-047caa357fed tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:47.239634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-52e80685-2cd4-48bf-a0b6-047caa357fed tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:47.258902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e80685-2cd4-48bf-a0b6-047caa357fed tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:47.268647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e80685-2cd4-48bf-a0b6-047caa357fed tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:47.269263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e80685-2cd4-48bf-a0b6-047caa357fed tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:47.270266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e80685-2cd4-48bf-a0b6-047caa357fed tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:47.270882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e80685-2cd4-48bf-a0b6-047caa357fed tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:47.271436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e80685-2cd4-48bf-a0b6-047caa357fed tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:47.471127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-52e80685-2cd4-48bf-a0b6-047caa357fed tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:47.484043 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-52e80685-2cd4-48bf-a0b6-047caa357fed tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1272 microversion: 2.1 time: 0.262454 Oct 11 19:53:47.484798 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1358/2780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:47 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:47.502846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2577d028-8b7e-4643-a92d-8d082dd2a278 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc2e44c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:47.586774 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2577d028-8b7e-4643-a92d-8d082dd2a278 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.098997 Oct 11 19:53:47.587285 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1359/2781] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:47 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:48.233782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4850961d-8e68-4c4e-8860-634283e8c401 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:48.237945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4850961d-8e68-4c4e-8860-634283e8c401 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:48.259647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4850961d-8e68-4c4e-8860-634283e8c401 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:48.269255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4850961d-8e68-4c4e-8860-634283e8c401 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:48.278709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4850961d-8e68-4c4e-8860-634283e8c401 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:48.287440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4850961d-8e68-4c4e-8860-634283e8c401 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:48.291725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4850961d-8e68-4c4e-8860-634283e8c401 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:48.297585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4850961d-8e68-4c4e-8860-634283e8c401 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:49.018950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4850961d-8e68-4c4e-8860-634283e8c401 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:49.033218 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4850961d-8e68-4c4e-8860-634283e8c401 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 0.803554 Oct 11 19:53:49.040929 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1360/2782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:48 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:49.067432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c04cda5b-92c5-44ee-92f7-8ec1f4cd8e7e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:49.068444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c04cda5b-92c5-44ee-92f7-8ec1f4cd8e7e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:49.094684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c04cda5b-92c5-44ee-92f7-8ec1f4cd8e7e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:49.095492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c04cda5b-92c5-44ee-92f7-8ec1f4cd8e7e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:49.096170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c04cda5b-92c5-44ee-92f7-8ec1f4cd8e7e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:49.097116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c04cda5b-92c5-44ee-92f7-8ec1f4cd8e7e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:49.097796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c04cda5b-92c5-44ee-92f7-8ec1f4cd8e7e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:49.098450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c04cda5b-92c5-44ee-92f7-8ec1f4cd8e7e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:49.797781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:53:49.798936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:53:49.799788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:53:49.800378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:53:49.800953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:53:49.823792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:49.824535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:49.830991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:49.832102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:49.832905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:49.833504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:49.886299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Getting quotas for project 8df2eebeffd440d988aa6f580c9bb221. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:53:49.896275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Getting quotas for user d1ab8c29f18c4fc09858791a80527e5d and project 8df2eebeffd440d988aa6f580c9bb221. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:53:49.941653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:53:49.948968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:53:50.023583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:50.064115 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b68bc401-8034-4135-8c94-99457a388f03 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.659057 Oct 11 19:53:50.067543 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1423/2783] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:53:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 3663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:53:50.078848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-36f18143-c30d-42cd-bb09-562011a2e05b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc9a1820>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:50.164948 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-36f18143-c30d-42cd-bb09-562011a2e05b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.096051 Oct 11 19:53:50.174925 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1424/2784] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:50 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:50.192315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a8165e7b-f4e6-452b-bc9f-1d604b54e731 req-2104cdc1-3311-491a-b5dc-684eadc34a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1f8956-214c-4f94-b8a9-c7bb03b56104", "name": "network-vif-plugged", "status": "completed", "tag": "3003e5ed-e486-4f4c-954b-6ab7b07147e9"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:50.226203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a8165e7b-f4e6-452b-bc9f-1d604b54e731 req-2104cdc1-3311-491a-b5dc-684eadc34a4d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:50.227338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a8165e7b-f4e6-452b-bc9f-1d604b54e731 req-2104cdc1-3311-491a-b5dc-684eadc34a4d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:50.227790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a8165e7b-f4e6-452b-bc9f-1d604b54e731 req-2104cdc1-3311-491a-b5dc-684eadc34a4d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:50.269235 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a8165e7b-f4e6-452b-bc9f-1d604b54e731 req-2104cdc1-3311-491a-b5dc-684eadc34a4d service nova] Creating event network-vif-plugged:3003e5ed-e486-4f4c-954b-6ab7b07147e9 for instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 on n-h1-860864-3 Oct 11 19:53:50.286261 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a8165e7b-f4e6-452b-bc9f-1d604b54e731 req-2104cdc1-3311-491a-b5dc-684eadc34a4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109983 Oct 11 19:53:50.286922 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1425/2785] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:50.315209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6f2f9c8f-8a31-47ab-ad54-9cac3c87ac69 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:50.316393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6f2f9c8f-8a31-47ab-ad54-9cac3c87ac69 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:50.343044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f2f9c8f-8a31-47ab-ad54-9cac3c87ac69 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:50.343992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f2f9c8f-8a31-47ab-ad54-9cac3c87ac69 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:50.345454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f2f9c8f-8a31-47ab-ad54-9cac3c87ac69 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:50.349301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f2f9c8f-8a31-47ab-ad54-9cac3c87ac69 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:50.352494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f2f9c8f-8a31-47ab-ad54-9cac3c87ac69 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:50.356210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f2f9c8f-8a31-47ab-ad54-9cac3c87ac69 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:51.968931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c04cda5b-92c5-44ee-92f7-8ec1f4cd8e7e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:51.978284 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c04cda5b-92c5-44ee-92f7-8ec1f4cd8e7e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1314 microversion: 2.1 time: 2.935894 Oct 11 19:53:51.982255 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1361/2786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:49 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1314 bytes in 2940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:52.001974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6274b668-b8dd-476c-a613-5940beda7961 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:52.003819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6274b668-b8dd-476c-a613-5940beda7961 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:52.021232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274b668-b8dd-476c-a613-5940beda7961 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:52.022036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274b668-b8dd-476c-a613-5940beda7961 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:52.023465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274b668-b8dd-476c-a613-5940beda7961 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:52.024402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274b668-b8dd-476c-a613-5940beda7961 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:52.030625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274b668-b8dd-476c-a613-5940beda7961 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:52.031520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6274b668-b8dd-476c-a613-5940beda7961 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:52.197265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6f2f9c8f-8a31-47ab-ad54-9cac3c87ac69 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:52.213690 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6f2f9c8f-8a31-47ab-ad54-9cac3c87ac69 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 1.915119 Oct 11 19:53:52.217881 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1426/2787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:50 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:52.228938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9b120b8a-209a-41e8-ab18-76163d8b0dcd req-ea1609ce-2c3d-4e1c-910b-31d32f3f0a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541d55b8-ac01-4eed-8531-8a8dc44cd7cb", "tag": "d41bd563-4b89-4927-851e-d420f9109e99"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:52.274853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9b120b8a-209a-41e8-ab18-76163d8b0dcd req-ea1609ce-2c3d-4e1c-910b-31d32f3f0a48 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:52.275883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9b120b8a-209a-41e8-ab18-76163d8b0dcd req-ea1609ce-2c3d-4e1c-910b-31d32f3f0a48 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:52.277538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9b120b8a-209a-41e8-ab18-76163d8b0dcd req-ea1609ce-2c3d-4e1c-910b-31d32f3f0a48 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:52.330978 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9b120b8a-209a-41e8-ab18-76163d8b0dcd req-ea1609ce-2c3d-4e1c-910b-31d32f3f0a48 service nova] Creating event network-changed:d41bd563-4b89-4927-851e-d420f9109e99 for instance 541d55b8-ac01-4eed-8531-8a8dc44cd7cb on n-h1-860864-3 Oct 11 19:53:52.343402 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9b120b8a-209a-41e8-ab18-76163d8b0dcd req-ea1609ce-2c3d-4e1c-910b-31d32f3f0a48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121517 Oct 11 19:53:52.345111 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1427/2788] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:52.354713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-817190aa-2f17-4c9a-b020-ce7fd3bd9126 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc4d6700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:52.383917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6274b668-b8dd-476c-a613-5940beda7961 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:52.410779 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6274b668-b8dd-476c-a613-5940beda7961 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1273 microversion: 2.1 time: 0.426976 Oct 11 19:53:52.430552 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1362/2789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:51 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1273 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:52.489394 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-817190aa-2f17-4c9a-b020-ce7fd3bd9126 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.142740 Oct 11 19:53:52.490702 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1428/2790] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:52 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:53.005371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8887fb8-b6b7-495d-8548-d3248463a6c7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:53.006860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c8887fb8-b6b7-495d-8548-d3248463a6c7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:53.020356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8887fb8-b6b7-495d-8548-d3248463a6c7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:53.022022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8887fb8-b6b7-495d-8548-d3248463a6c7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:53.023957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8887fb8-b6b7-495d-8548-d3248463a6c7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:53.025868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8887fb8-b6b7-495d-8548-d3248463a6c7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:53.027420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8887fb8-b6b7-495d-8548-d3248463a6c7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:53.028945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8887fb8-b6b7-495d-8548-d3248463a6c7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:53.240791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e4cfd90-2890-446a-aa42-fec406cbc68b tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:53.241530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e4cfd90-2890-446a-aa42-fec406cbc68b tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:53.280445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4cfd90-2890-446a-aa42-fec406cbc68b tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:53.280964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4cfd90-2890-446a-aa42-fec406cbc68b tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:53.281386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4cfd90-2890-446a-aa42-fec406cbc68b tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:53.282100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4cfd90-2890-446a-aa42-fec406cbc68b tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:53.282571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4cfd90-2890-446a-aa42-fec406cbc68b tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:53.282999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4cfd90-2890-446a-aa42-fec406cbc68b tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:54.402946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c8887fb8-b6b7-495d-8548-d3248463a6c7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:54.413025 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8887fb8-b6b7-495d-8548-d3248463a6c7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1314 microversion: 2.1 time: 1.411393 Oct 11 19:53:54.440742 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1363/2791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:52 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1314 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:54.451604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5df2e583-013d-4787-ad77-b36fe1040af0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:54.454310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5df2e583-013d-4787-ad77-b36fe1040af0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:54.464668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df2e583-013d-4787-ad77-b36fe1040af0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:54.466062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df2e583-013d-4787-ad77-b36fe1040af0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:54.466829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df2e583-013d-4787-ad77-b36fe1040af0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:54.468461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df2e583-013d-4787-ad77-b36fe1040af0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:54.469731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df2e583-013d-4787-ad77-b36fe1040af0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:54.474130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5df2e583-013d-4787-ad77-b36fe1040af0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:55.015944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5df2e583-013d-4787-ad77-b36fe1040af0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:55.028064 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5df2e583-013d-4787-ad77-b36fe1040af0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1279 microversion: 2.1 time: 0.585926 Oct 11 19:53:55.028774 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1364/2792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:54 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1279 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:55.044302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e4cfd90-2890-446a-aa42-fec406cbc68b tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:55.048233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b82cb229-8963-4fb8-bc08-ff8463d9593b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc33b550>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:55.081184 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e4cfd90-2890-446a-aa42-fec406cbc68b tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 1.844515 Oct 11 19:53:55.095058 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1429/2793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:53 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:55.095058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9e6009cf-40a9-46bf-b5c0-f4b43aba511d req-7af5d7b7-2525-4ca4-94ec-cf9885f0bf5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "045c6ac7-f110-46b6-b43d-dee4dc6a4864", "tag": "870f5751-948d-4669-a1d8-77ea302d7d04"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:53:55.113232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9e6009cf-40a9-46bf-b5c0-f4b43aba511d req-7af5d7b7-2525-4ca4-94ec-cf9885f0bf5b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:55.113724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9e6009cf-40a9-46bf-b5c0-f4b43aba511d req-7af5d7b7-2525-4ca4-94ec-cf9885f0bf5b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:55.114147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9e6009cf-40a9-46bf-b5c0-f4b43aba511d req-7af5d7b7-2525-4ca4-94ec-cf9885f0bf5b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:55.128299 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b82cb229-8963-4fb8-bc08-ff8463d9593b tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.097709 Oct 11 19:53:55.130915 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1365/2794] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:55 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:55.138428 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9e6009cf-40a9-46bf-b5c0-f4b43aba511d req-7af5d7b7-2525-4ca4-94ec-cf9885f0bf5b service nova] Creating event network-changed:870f5751-948d-4669-a1d8-77ea302d7d04 for instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 on n-h1-860864-3 Oct 11 19:53:55.144783 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9e6009cf-40a9-46bf-b5c0-f4b43aba511d req-7af5d7b7-2525-4ca4-94ec-cf9885f0bf5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061472 Oct 11 19:53:55.146602 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1430/2795] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:53:55.437973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-52c1dac2-0bdb-40e1-9118-7c3daba03849 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:55.438634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-52c1dac2-0bdb-40e1-9118-7c3daba03849 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:55.462086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c1dac2-0bdb-40e1-9118-7c3daba03849 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:55.462991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c1dac2-0bdb-40e1-9118-7c3daba03849 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:55.463759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c1dac2-0bdb-40e1-9118-7c3daba03849 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:55.466395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c1dac2-0bdb-40e1-9118-7c3daba03849 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:55.474660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c1dac2-0bdb-40e1-9118-7c3daba03849 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:55.479931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c1dac2-0bdb-40e1-9118-7c3daba03849 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:55.528652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:56.066802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-85dd4b78-62a1-41bb-924d-985dc4054b46 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:56.068591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-85dd4b78-62a1-41bb-924d-985dc4054b46 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:56.123556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85dd4b78-62a1-41bb-924d-985dc4054b46 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:56.124078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85dd4b78-62a1-41bb-924d-985dc4054b46 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:56.124521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85dd4b78-62a1-41bb-924d-985dc4054b46 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:56.131284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85dd4b78-62a1-41bb-924d-985dc4054b46 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:56.135891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85dd4b78-62a1-41bb-924d-985dc4054b46 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:56.137814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85dd4b78-62a1-41bb-924d-985dc4054b46 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:56.240221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=22 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:57.398315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-85dd4b78-62a1-41bb-924d-985dc4054b46 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:57.418932 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-85dd4b78-62a1-41bb-924d-985dc4054b46 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1279 microversion: 2.1 time: 1.366692 Oct 11 19:53:57.427759 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1431/2796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:56 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1279 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:57.438822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bbaa65c1-06ea-4fa1-bc86-e0888f1b6123 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:57.439447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bbaa65c1-06ea-4fa1-bc86-e0888f1b6123 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:57.459276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbaa65c1-06ea-4fa1-bc86-e0888f1b6123 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:57.469358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbaa65c1-06ea-4fa1-bc86-e0888f1b6123 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:57.470492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbaa65c1-06ea-4fa1-bc86-e0888f1b6123 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:57.471350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbaa65c1-06ea-4fa1-bc86-e0888f1b6123 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:57.471821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbaa65c1-06ea-4fa1-bc86-e0888f1b6123 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:57.475463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbaa65c1-06ea-4fa1-bc86-e0888f1b6123 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:57.927560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-52c1dac2-0bdb-40e1-9118-7c3daba03849 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:57.955222 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-52c1dac2-0bdb-40e1-9118-7c3daba03849 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1314 microversion: 2.1 time: 2.511809 Oct 11 19:53:57.955920 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1366/2797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:55 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1314 bytes in 2523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:57.961262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7c571504-a339-4061-aaa5-d99ec5be3b0e tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cd286c10>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:58.070517 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7c571504-a339-4061-aaa5-d99ec5be3b0e tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.112988 Oct 11 19:53:58.073148 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1367/2798] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:53:57 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:58.454270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58bb3ed9-9e9d-4814-8acb-d65a8ae8f2be tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:58.456782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58bb3ed9-9e9d-4814-8acb-d65a8ae8f2be tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:58.482386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58bb3ed9-9e9d-4814-8acb-d65a8ae8f2be tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:58.484530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58bb3ed9-9e9d-4814-8acb-d65a8ae8f2be tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:58.485228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58bb3ed9-9e9d-4814-8acb-d65a8ae8f2be tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:58.487388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58bb3ed9-9e9d-4814-8acb-d65a8ae8f2be tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:58.489233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58bb3ed9-9e9d-4814-8acb-d65a8ae8f2be tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:58.489929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58bb3ed9-9e9d-4814-8acb-d65a8ae8f2be tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:59.708971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bbaa65c1-06ea-4fa1-bc86-e0888f1b6123 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:53:59.712942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:59.730107 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bbaa65c1-06ea-4fa1-bc86-e0888f1b6123 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 2.301092 Oct 11 19:53:59.731971 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1432/2799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:57 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:53:59.749172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f9456315-99c0-44a3-ab55-e360588a19a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:53:59.751258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f9456315-99c0-44a3-ab55-e360588a19a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:53:59.772609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9456315-99c0-44a3-ab55-e360588a19a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:59.774995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9456315-99c0-44a3-ab55-e360588a19a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:59.777382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9456315-99c0-44a3-ab55-e360588a19a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:59.778420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9456315-99c0-44a3-ab55-e360588a19a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:53:59.780666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9456315-99c0-44a3-ab55-e360588a19a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:53:59.782223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9456315-99c0-44a3-ab55-e360588a19a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:53:59.874042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:53:59.941845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=10 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:00.533854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f9456315-99c0-44a3-ab55-e360588a19a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:00.543610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58bb3ed9-9e9d-4814-8acb-d65a8ae8f2be tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:00.544146 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f9456315-99c0-44a3-ab55-e360588a19a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1314 microversion: 2.1 time: 0.807844 Oct 11 19:54:00.552342 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1433/2800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:59 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:00.556496 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58bb3ed9-9e9d-4814-8acb-d65a8ae8f2be tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1321 microversion: 2.1 time: 2.104967 Oct 11 19:54:00.558008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff14950f-125d-4702-8a84-66a2a6e3c392 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc2c35e0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:00.559200 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1368/2801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:53:58 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1321 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:54:00.568597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1674024902", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35295b7c-4089-4c98-81b0-9cc1d9c13721"}], "security_groups": [{"name": "tempest-securitygroup--27867804"}], "key_name": "tempest-keypair-1106054146", "user_data": "}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:00.628916 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff14950f-125d-4702-8a84-66a2a6e3c392 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.075432 Oct 11 19:54:00.629880 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1434/2802] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:00 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:00.640637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f4f6c019-4d68-4276-ae21-ab75590cfd5d req-8ae7c291-9d86-412b-811c-686ff2ec5d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541d55b8-ac01-4eed-8531-8a8dc44cd7cb", "name": "network-vif-plugged", "status": "completed", "tag": "d41bd563-4b89-4927-851e-d420f9109e99"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:00.665467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f4f6c019-4d68-4276-ae21-ab75590cfd5d req-8ae7c291-9d86-412b-811c-686ff2ec5d3c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:00.666175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f4f6c019-4d68-4276-ae21-ab75590cfd5d req-8ae7c291-9d86-412b-811c-686ff2ec5d3c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:00.666783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f4f6c019-4d68-4276-ae21-ab75590cfd5d req-8ae7c291-9d86-412b-811c-686ff2ec5d3c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:00.686091 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f4f6c019-4d68-4276-ae21-ab75590cfd5d req-8ae7c291-9d86-412b-811c-686ff2ec5d3c service nova] Creating event network-vif-plugged:d41bd563-4b89-4927-851e-d420f9109e99 for instance 541d55b8-ac01-4eed-8531-8a8dc44cd7cb on n-h1-860864-3 Oct 11 19:54:00.694718 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f4f6c019-4d68-4276-ae21-ab75590cfd5d req-8ae7c291-9d86-412b-811c-686ff2ec5d3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063610 Oct 11 19:54:00.700510 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1435/2803] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:00.706047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b6ab9436-49e1-41d5-9f28-5f96715215bd req-e285043a-0a80-49e6-b225-a6eec3e46b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac52ec7-a881-454c-89ea-25e9d288b87d", "tag": "9b2cc42b-faeb-475b-a070-fb2ed8d8904e"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:00.717724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b6ab9436-49e1-41d5-9f28-5f96715215bd req-e285043a-0a80-49e6-b225-a6eec3e46b88 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:00.718972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b6ab9436-49e1-41d5-9f28-5f96715215bd req-e285043a-0a80-49e6-b225-a6eec3e46b88 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:00.719583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b6ab9436-49e1-41d5-9f28-5f96715215bd req-e285043a-0a80-49e6-b225-a6eec3e46b88 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:00.733413 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b6ab9436-49e1-41d5-9f28-5f96715215bd req-e285043a-0a80-49e6-b225-a6eec3e46b88 service nova] Creating event network-changed:9b2cc42b-faeb-475b-a070-fb2ed8d8904e for instance 0ac52ec7-a881-454c-89ea-25e9d288b87d on n-h2-860864-3 Oct 11 19:54:00.739231 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b6ab9436-49e1-41d5-9f28-5f96715215bd req-e285043a-0a80-49e6-b225-a6eec3e46b88 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037024 Oct 11 19:54:00.740286 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1436/2804] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:00.766104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7fe2b6d5-f5ca-4fb6-bbdd-12f5b1cf594e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:00.766849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7fe2b6d5-f5ca-4fb6-bbdd-12f5b1cf594e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:00.778626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fe2b6d5-f5ca-4fb6-bbdd-12f5b1cf594e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:00.791250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fe2b6d5-f5ca-4fb6-bbdd-12f5b1cf594e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:00.794547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fe2b6d5-f5ca-4fb6-bbdd-12f5b1cf594e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:00.795769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fe2b6d5-f5ca-4fb6-bbdd-12f5b1cf594e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:00.796774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fe2b6d5-f5ca-4fb6-bbdd-12f5b1cf594e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:00.797658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fe2b6d5-f5ca-4fb6-bbdd-12f5b1cf594e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:01.447385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] validate_networks() for [('35295b7c-4089-4c98-81b0-9cc1d9c13721', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:54:01.664953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7fe2b6d5-f5ca-4fb6-bbdd-12f5b1cf594e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:01.676444 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7fe2b6d5-f5ca-4fb6-bbdd-12f5b1cf594e tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1522 microversion: 2.1 time: 0.922489 Oct 11 19:54:01.677051 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1437/2805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:00 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1522 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:01.863983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1028921674", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:01.999945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] validate_networks() for [('94a98399-e5d5-46d5-b3fe-da4714c7413b', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:54:03.160116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:54:03.161602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:54:03.162369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:54:03.163053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:54:03.163804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:54:03.191204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.192156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.192915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:03.193852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.194561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.196140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:03.236957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for project efd1bdcd18f14e87925a5b41393b9add. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:54:03.258369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for user 0647dca89de240ba9fbc1c59ed2b6392 and project efd1bdcd18f14e87925a5b41393b9add. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:54:03.297329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:54:03.301026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:54:03.400749 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-35d2463c-e9eb-4657-b924-17a09a13028b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.840103 Oct 11 19:54:03.407284 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1369/2806] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:54:00 2022] POST /compute/v2.1/servers => generated 407 bytes in 2842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:54:03.409471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-76cc918f-c1f0-4c25-a0ad-e528d8b40555 req-a0bc1460-e38e-460d-8456-09e44f567a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a346658c-09a4-43ec-a0ab-e2541e23e423", "tag": "958b0dc6-87d6-463a-b043-1a976667640b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:03.446036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-76cc918f-c1f0-4c25-a0ad-e528d8b40555 req-a0bc1460-e38e-460d-8456-09e44f567a10 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.446981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-76cc918f-c1f0-4c25-a0ad-e528d8b40555 req-a0bc1460-e38e-460d-8456-09e44f567a10 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.447531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-76cc918f-c1f0-4c25-a0ad-e528d8b40555 req-a0bc1460-e38e-460d-8456-09e44f567a10 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:03.461161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:54:03.462281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:54:03.462944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:54:03.463594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:54:03.464013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:54:03.465018 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-76cc918f-c1f0-4c25-a0ad-e528d8b40555 req-a0bc1460-e38e-460d-8456-09e44f567a10 service nova] Creating event network-changed:958b0dc6-87d6-463a-b043-1a976667640b for instance a346658c-09a4-43ec-a0ab-e2541e23e423 on n-h2-860864-3 Oct 11 19:54:03.481422 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-76cc918f-c1f0-4c25-a0ad-e528d8b40555 req-a0bc1460-e38e-460d-8456-09e44f567a10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077784 Oct 11 19:54:03.491429 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1370/2807] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:03.495000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.495542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.495988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:03.496770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.497609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1da2ff1f-f76e-4366-8322-b816a2246549 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:03.499959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1da2ff1f-f76e-4366-8322-b816a2246549 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:03.506315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.506919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:03.518292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da2ff1f-f76e-4366-8322-b816a2246549 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.518823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da2ff1f-f76e-4366-8322-b816a2246549 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.519276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da2ff1f-f76e-4366-8322-b816a2246549 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:03.520351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da2ff1f-f76e-4366-8322-b816a2246549 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.520474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da2ff1f-f76e-4366-8322-b816a2246549 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.520874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da2ff1f-f76e-4366-8322-b816a2246549 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:03.563371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Getting quotas for project bef5612f57424051949f9a1d3e085611. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:54:03.583162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Getting quotas for user 3f978f677e3e463c9599ed524cc33e34 and project bef5612f57424051949f9a1d3e085611. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:54:03.585284 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1da2ff1f-f76e-4366-8322-b816a2246549 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092088 Oct 11 19:54:03.589452 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1371/2808] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:54:03 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:54:03.596063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a41421c-ee97-46da-b9a9-4f4856569371 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:03.596690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a41421c-ee97-46da-b9a9-4f4856569371 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:03.611858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41421c-ee97-46da-b9a9-4f4856569371 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.612374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41421c-ee97-46da-b9a9-4f4856569371 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.612823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41421c-ee97-46da-b9a9-4f4856569371 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:03.613546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41421c-ee97-46da-b9a9-4f4856569371 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.621514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41421c-ee97-46da-b9a9-4f4856569371 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.621714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:54:03.621968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41421c-ee97-46da-b9a9-4f4856569371 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:03.624653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:54:03.729229 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9a77ab38-e8ba-4dda-bd11-e7f342f259b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.050000 Oct 11 19:54:03.730635 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1438/2809] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:54:03.746278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ab8d3a91-0a66-4a9a-ba20-b192bf1e35ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:03.748350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ab8d3a91-0a66-4a9a-ba20-b192bf1e35ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:03.766998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab8d3a91-0a66-4a9a-ba20-b192bf1e35ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.768361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab8d3a91-0a66-4a9a-ba20-b192bf1e35ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.769077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab8d3a91-0a66-4a9a-ba20-b192bf1e35ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:03.770064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab8d3a91-0a66-4a9a-ba20-b192bf1e35ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:03.772367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab8d3a91-0a66-4a9a-ba20-b192bf1e35ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:03.773738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab8d3a91-0a66-4a9a-ba20-b192bf1e35ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:04.297085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4a41421c-ee97-46da-b9a9-4f4856569371 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:04.312620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a41421c-ee97-46da-b9a9-4f4856569371 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1463 microversion: 2.1 time: 0.722023 Oct 11 19:54:04.315580 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1372/2810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:03 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1463 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:04.339737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0ec279c-fe36-4114-bfe2-2225bca8c048 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c75509d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:04.467276 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c0ec279c-fe36-4114-bfe2-2225bca8c048 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.143687 Oct 11 19:54:04.478331 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1373/2811] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:04 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:04.498281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eb2ae0bc-986e-4fad-a051-1e4e2a6b51e4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:04.501402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eb2ae0bc-986e-4fad-a051-1e4e2a6b51e4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:04.524123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb2ae0bc-986e-4fad-a051-1e4e2a6b51e4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:04.525785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb2ae0bc-986e-4fad-a051-1e4e2a6b51e4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:04.527923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb2ae0bc-986e-4fad-a051-1e4e2a6b51e4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:04.528811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb2ae0bc-986e-4fad-a051-1e4e2a6b51e4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:04.530292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb2ae0bc-986e-4fad-a051-1e4e2a6b51e4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:04.532111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb2ae0bc-986e-4fad-a051-1e4e2a6b51e4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:04.590608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ab8d3a91-0a66-4a9a-ba20-b192bf1e35ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:04.608491 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ab8d3a91-0a66-4a9a-ba20-b192bf1e35ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1321 microversion: 2.1 time: 0.874156 Oct 11 19:54:04.614797 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1439/2812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:03 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1321 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:04.641861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ccbe5fcd-578b-40fc-8065-63172216e792 req-13e00ed4-5c00-4e98-8aab-f710074a28f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045c6ac7-f110-46b6-b43d-dee4dc6a4864", "name": "network-vif-plugged", "status": "completed", "tag": "870f5751-948d-4669-a1d8-77ea302d7d04"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:04.678037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ccbe5fcd-578b-40fc-8065-63172216e792 req-13e00ed4-5c00-4e98-8aab-f710074a28f2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:04.682509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ccbe5fcd-578b-40fc-8065-63172216e792 req-13e00ed4-5c00-4e98-8aab-f710074a28f2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:04.684964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ccbe5fcd-578b-40fc-8065-63172216e792 req-13e00ed4-5c00-4e98-8aab-f710074a28f2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:04.752364 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ccbe5fcd-578b-40fc-8065-63172216e792 req-13e00ed4-5c00-4e98-8aab-f710074a28f2 service nova] Creating event network-vif-plugged:870f5751-948d-4669-a1d8-77ea302d7d04 for instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 on n-h1-860864-3 Oct 11 19:54:04.769698 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ccbe5fcd-578b-40fc-8065-63172216e792 req-13e00ed4-5c00-4e98-8aab-f710074a28f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150216 Oct 11 19:54:04.773812 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1440/2813] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:04.805255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5b539beb-75ac-4ce9-89d0-efd24edddcbe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:04.808056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5b539beb-75ac-4ce9-89d0-efd24edddcbe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:04.825308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b539beb-75ac-4ce9-89d0-efd24edddcbe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:04.826205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b539beb-75ac-4ce9-89d0-efd24edddcbe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:04.826814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b539beb-75ac-4ce9-89d0-efd24edddcbe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:04.831423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b539beb-75ac-4ce9-89d0-efd24edddcbe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:04.832227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b539beb-75ac-4ce9-89d0-efd24edddcbe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:04.832906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b539beb-75ac-4ce9-89d0-efd24edddcbe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:05.373215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eb2ae0bc-986e-4fad-a051-1e4e2a6b51e4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:05.386457 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eb2ae0bc-986e-4fad-a051-1e4e2a6b51e4 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1502 microversion: 2.1 time: 0.905052 Oct 11 19:54:05.388164 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1374/2814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:04 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1502 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:05.391156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5b539beb-75ac-4ce9-89d0-efd24edddcbe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:05.403900 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5b539beb-75ac-4ce9-89d0-efd24edddcbe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1235 microversion: 2.1 time: 0.625742 Oct 11 19:54:05.405724 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1441/2815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:04 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1235 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:05.419892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d2715567-bb47-48f8-86a1-9be200a00ab0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:05.420717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d2715567-bb47-48f8-86a1-9be200a00ab0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:05.432211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2715567-bb47-48f8-86a1-9be200a00ab0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:05.432721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2715567-bb47-48f8-86a1-9be200a00ab0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:05.435685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2715567-bb47-48f8-86a1-9be200a00ab0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:05.436873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2715567-bb47-48f8-86a1-9be200a00ab0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:05.437005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2715567-bb47-48f8-86a1-9be200a00ab0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:05.437381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2715567-bb47-48f8-86a1-9be200a00ab0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:05.545232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-729261664", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "7a6ff9a3-562e-460e-852c-3de4b0a9fb24"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:05.560518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d2715567-bb47-48f8-86a1-9be200a00ab0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:05.575439 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d2715567-bb47-48f8-86a1-9be200a00ab0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1213 microversion: 2.1 time: 0.165676 Oct 11 19:54:05.594982 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1442/2816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:05 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:05.594982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-668d3b86-c6c9-4cf1-a66f-89e848cc5dc6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:05.594982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-668d3b86-c6c9-4cf1-a66f-89e848cc5dc6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:05.599894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-668d3b86-c6c9-4cf1-a66f-89e848cc5dc6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:05.600389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-668d3b86-c6c9-4cf1-a66f-89e848cc5dc6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:05.600829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-668d3b86-c6c9-4cf1-a66f-89e848cc5dc6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:05.601614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-668d3b86-c6c9-4cf1-a66f-89e848cc5dc6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:05.602075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-668d3b86-c6c9-4cf1-a66f-89e848cc5dc6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:05.603287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-668d3b86-c6c9-4cf1-a66f-89e848cc5dc6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:05.651487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] validate_networks() for [('7a6ff9a3-562e-460e-852c-3de4b0a9fb24', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:54:05.657027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-668d3b86-c6c9-4cf1-a66f-89e848cc5dc6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:54:05.840566 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-668d3b86-c6c9-4cf1-a66f-89e848cc5dc6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 204 len: 0 microversion: 2.1 time: 0.258546 Oct 11 19:54:05.842324 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1443/2817] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:54:05 2022] DELETE /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:54:05.850414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-51c4285f-7453-40dd-b628-a655605e103d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:05.852008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-51c4285f-7453-40dd-b628-a655605e103d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:05.860567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c4285f-7453-40dd-b628-a655605e103d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:05.861283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c4285f-7453-40dd-b628-a655605e103d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:05.861892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c4285f-7453-40dd-b628-a655605e103d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:05.863096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c4285f-7453-40dd-b628-a655605e103d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:05.864554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c4285f-7453-40dd-b628-a655605e103d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:05.865287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c4285f-7453-40dd-b628-a655605e103d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:06.280973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-51c4285f-7453-40dd-b628-a655605e103d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:06.295319 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-51c4285f-7453-40dd-b628-a655605e103d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1313 microversion: 2.1 time: 0.450532 Oct 11 19:54:06.301413 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1444/2818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:05 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:06.316990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a7c6a8e9-4996-4c11-9457-d7c8ab06a22c tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Action: 'create', calling method: .version_select at 0x7f83d07f74c0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1649367144", "description": "tempest-description-1846892652"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:06.651438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:54:06.652271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:54:06.653055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:54:06.653570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:54:06.654223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:54:06.673823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:06.676628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:06.677359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:06.678417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:06.680813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:06.681501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:06.737306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Getting quotas for project 76591022a59449b7b24a2de96cba0fa0. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:54:06.756573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Getting quotas for user 87ead5931eec4b68a40cd635295de387 and project 76591022a59449b7b24a2de96cba0fa0. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:54:06.805487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:54:06.809410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:54:06.885146 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-be1185b6-5fca-45a2-bcfc-c11b2df90435 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495670 Oct 11 19:54:06.892513 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1375/2819] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:54:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:54:06.893898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-25615152-3bfd-4676-a668-d237528b6291 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc2f04c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:06.991587 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a7c6a8e9-4996-4c11-9457-d7c8ab06a22c tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.688570 Oct 11 19:54:06.994278 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1445/2820] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:54:06 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:07.005695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-90a29193-49f5-4b40-9b42-b992574ce536 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:07.009972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-90a29193-49f5-4b40-9b42-b992574ce536 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:07.022350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90a29193-49f5-4b40-9b42-b992574ce536 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:07.022876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90a29193-49f5-4b40-9b42-b992574ce536 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:07.024644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90a29193-49f5-4b40-9b42-b992574ce536 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:07.025705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90a29193-49f5-4b40-9b42-b992574ce536 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:07.027672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90a29193-49f5-4b40-9b42-b992574ce536 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:07.028295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90a29193-49f5-4b40-9b42-b992574ce536 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:07.067697 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-25615152-3bfd-4676-a668-d237528b6291 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.164562 Oct 11 19:54:07.069651 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1376/2821] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:06 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:07.088405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a1237abb-8d54-4efe-90d5-07f457331b93 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:07.089399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a1237abb-8d54-4efe-90d5-07f457331b93 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:07.097811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1237abb-8d54-4efe-90d5-07f457331b93 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:07.099017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1237abb-8d54-4efe-90d5-07f457331b93 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:07.099697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1237abb-8d54-4efe-90d5-07f457331b93 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:07.100627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1237abb-8d54-4efe-90d5-07f457331b93 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:07.113481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1237abb-8d54-4efe-90d5-07f457331b93 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:07.116610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1237abb-8d54-4efe-90d5-07f457331b93 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:08.316094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-90a29193-49f5-4b40-9b42-b992574ce536 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:08.330212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-90a29193-49f5-4b40-9b42-b992574ce536 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1321 microversion: 2.1 time: 1.330531 Oct 11 19:54:08.331471 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1446/2822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:06 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1321 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:08.355836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e5439f51-821d-4b71-80c6-04a05731b69c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:08.357028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e5439f51-821d-4b71-80c6-04a05731b69c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:08.360063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a1237abb-8d54-4efe-90d5-07f457331b93 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:08.365844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5439f51-821d-4b71-80c6-04a05731b69c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:08.366361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5439f51-821d-4b71-80c6-04a05731b69c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:08.375347 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a1237abb-8d54-4efe-90d5-07f457331b93 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 200 len: 1673 microversion: 2.1 time: 1.293535 Oct 11 19:54:08.376739 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1377/2823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:07 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 1673 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:08.388176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-722ee2d1-77c0-413e-9cc8-7ed56d896ad5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:08.397776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-722ee2d1-77c0-413e-9cc8-7ed56d896ad5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:08.399249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5439f51-821d-4b71-80c6-04a05731b69c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:08.401310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5439f51-821d-4b71-80c6-04a05731b69c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:08.403113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5439f51-821d-4b71-80c6-04a05731b69c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:08.403580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5439f51-821d-4b71-80c6-04a05731b69c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:08.435832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-722ee2d1-77c0-413e-9cc8-7ed56d896ad5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:08.438729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-722ee2d1-77c0-413e-9cc8-7ed56d896ad5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:08.439428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-722ee2d1-77c0-413e-9cc8-7ed56d896ad5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:08.440399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-722ee2d1-77c0-413e-9cc8-7ed56d896ad5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:08.445872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-722ee2d1-77c0-413e-9cc8-7ed56d896ad5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:08.447816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-722ee2d1-77c0-413e-9cc8-7ed56d896ad5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:08.458355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:08.590322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e5439f51-821d-4b71-80c6-04a05731b69c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:08.598408 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e5439f51-821d-4b71-80c6-04a05731b69c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1297 microversion: 2.1 time: 0.265670 Oct 11 19:54:08.611091 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1447/2824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:08 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1297 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:08.616500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e3a99fa5-cb18-451f-b724-7c5512c72e34 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:08.617388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e3a99fa5-cb18-451f-b724-7c5512c72e34 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:08.629787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a99fa5-cb18-451f-b724-7c5512c72e34 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:08.630579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a99fa5-cb18-451f-b724-7c5512c72e34 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:08.635441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a99fa5-cb18-451f-b724-7c5512c72e34 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:08.636570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a99fa5-cb18-451f-b724-7c5512c72e34 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:08.637226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a99fa5-cb18-451f-b724-7c5512c72e34 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:08.637823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3a99fa5-cb18-451f-b724-7c5512c72e34 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:08.701690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-722ee2d1-77c0-413e-9cc8-7ed56d896ad5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:08.716666 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-722ee2d1-77c0-413e-9cc8-7ed56d896ad5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1269 microversion: 2.1 time: 0.338506 Oct 11 19:54:08.717474 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1378/2825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:08 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1269 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:08.734505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2c44a586-694b-4347-a7b8-c4f7a0543ab0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1649367144"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:08.738603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2c44a586-694b-4347-a7b8-c4f7a0543ab0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:08.751443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c44a586-694b-4347-a7b8-c4f7a0543ab0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:08.751952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c44a586-694b-4347-a7b8-c4f7a0543ab0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:08.753825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c44a586-694b-4347-a7b8-c4f7a0543ab0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:08.754589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c44a586-694b-4347-a7b8-c4f7a0543ab0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:08.755071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c44a586-694b-4347-a7b8-c4f7a0543ab0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:08.755509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c44a586-694b-4347-a7b8-c4f7a0543ab0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:08.793298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e3a99fa5-cb18-451f-b724-7c5512c72e34 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:08.809133 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e3a99fa5-cb18-451f-b724-7c5512c72e34 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1219 microversion: 2.1 time: 0.190869 Oct 11 19:54:08.812888 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1448/2826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:08 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:08.830285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5bfa9ae-3612-4f87-b974-c90dd2e75e19 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:08.835150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b5bfa9ae-3612-4f87-b974-c90dd2e75e19 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:08.860473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5bfa9ae-3612-4f87-b974-c90dd2e75e19 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:08.863079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5bfa9ae-3612-4f87-b974-c90dd2e75e19 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:08.864142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5bfa9ae-3612-4f87-b974-c90dd2e75e19 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:08.870255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5bfa9ae-3612-4f87-b974-c90dd2e75e19 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:08.871926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5bfa9ae-3612-4f87-b974-c90dd2e75e19 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:08.874196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5bfa9ae-3612-4f87-b974-c90dd2e75e19 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:09.742863 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.network.security_group_api [None req-2c44a586-694b-4347-a7b8-c4f7a0543ab0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Adding security group b1dd93bd-2314-453a-8c2d-6f47e83fadd2 to port f0945e06-d4cf-49ce-a31f-4ceba757cea1 Oct 11 19:54:10.855028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b5bfa9ae-3612-4f87-b974-c90dd2e75e19 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:10.866712 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b5bfa9ae-3612-4f87-b974-c90dd2e75e19 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1462 microversion: 2.1 time: 2.052271 Oct 11 19:54:10.870701 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1449/2827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:08 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1462 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:10.879744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f90764e7-8144-43f2-93bb-3633bed8d03d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc3393a0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:11.088690 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f90764e7-8144-43f2-93bb-3633bed8d03d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1455 microversion: 2.1 time: 0.191148 Oct 11 19:54:11.089396 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1450/2828] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:10 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1455 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:11.105762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-76ccbae1-33b8-4db9-b612-6d5da5408124 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:11.111133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-76ccbae1-33b8-4db9-b612-6d5da5408124 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:11.143263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76ccbae1-33b8-4db9-b612-6d5da5408124 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:11.144210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76ccbae1-33b8-4db9-b612-6d5da5408124 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:11.144938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76ccbae1-33b8-4db9-b612-6d5da5408124 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:11.145939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76ccbae1-33b8-4db9-b612-6d5da5408124 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:11.146827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76ccbae1-33b8-4db9-b612-6d5da5408124 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:11.147639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-76ccbae1-33b8-4db9-b612-6d5da5408124 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:12.530711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-76ccbae1-33b8-4db9-b612-6d5da5408124 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:12.544236 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-76ccbae1-33b8-4db9-b612-6d5da5408124 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1321 microversion: 2.1 time: 1.443281 Oct 11 19:54:12.545844 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1451/2829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:11 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1321 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:12.559132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:12.560276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:12.580467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:12.583179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:12.583831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:12.584738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:12.591290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:12.591989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:12.624818 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] HTTP exception thrown: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Request method failure captured: Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 HTTP/1.1 Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjzw13fmGyGRNXoHvUb473ckUA7cWqxaBKtW2jows9ag-ajORVboepsiwu1MirYhVn15BpNvgHckmcjqMUOyz0B9EerxJAjyAgflUZL0q_Lx2OYVwdKetdMphFy0H2z2mhBjG0sBo9yM8eO4cnzytYT-42ABoKoD3KMoTAeyDN_qmk Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59971595644041418ea11fd1d795f42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59971595644041418ea11fd1d795f42c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}] Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bc6a1d30f20048159afd27eefdc831f9 Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5db170ae-e6b1-4057-8d54-6bba8c210919'} Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:54:12.636378 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:12.640769 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:12.640769 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:54:12.640769 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:54:12.640769 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:54:12.640769 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:54:12.640769 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:54:12.640769 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:12.640769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Returning 404 to user: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:54:12.640769 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-62e4163d-6592-47cd-b694-3ca62f95bd70 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 404 len: 111 microversion: 2.1 time: 0.091025 Oct 11 19:54:12.640769 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1452/2830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:12 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:54:12.644661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e11ade2-6516-494e-90a7-fdd681caeb76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:12.645319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e11ade2-6516-494e-90a7-fdd681caeb76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:12.664861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e11ade2-6516-494e-90a7-fdd681caeb76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:12.665304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e11ade2-6516-494e-90a7-fdd681caeb76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:12.665940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e11ade2-6516-494e-90a7-fdd681caeb76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:12.666854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e11ade2-6516-494e-90a7-fdd681caeb76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:12.677286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e11ade2-6516-494e-90a7-fdd681caeb76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:12.677910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e11ade2-6516-494e-90a7-fdd681caeb76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:12.733263 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2c44a586-694b-4347-a7b8-c4f7a0543ab0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "POST /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2/action" status: 202 len: 0 microversion: 2.1 time: 4.014896 Oct 11 19:54:12.734133 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1379/2831] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:08 2022] POST /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2/action => generated 0 bytes in 4016 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:54:12.739892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aa56c948-3d8f-48ee-b82b-1397e3c1d813 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:12.740805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aa56c948-3d8f-48ee-b82b-1397e3c1d813 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:12.780201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56c948-3d8f-48ee-b82b-1397e3c1d813 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:12.797336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56c948-3d8f-48ee-b82b-1397e3c1d813 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:12.798271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56c948-3d8f-48ee-b82b-1397e3c1d813 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:12.800813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56c948-3d8f-48ee-b82b-1397e3c1d813 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:12.803851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56c948-3d8f-48ee-b82b-1397e3c1d813 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:12.805166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa56c948-3d8f-48ee-b82b-1397e3c1d813 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:13.210650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e11ade2-6516-494e-90a7-fdd681caeb76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:13.238359 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e11ade2-6516-494e-90a7-fdd681caeb76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1363 microversion: 2.1 time: 0.598422 Oct 11 19:54:13.240550 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1453/2832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:12 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1363 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:13.242246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aa56c948-3d8f-48ee-b82b-1397e3c1d813 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:13.253613 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aa56c948-3d8f-48ee-b82b-1397e3c1d813 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1317 microversion: 2.1 time: 0.518132 Oct 11 19:54:13.255191 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1380/2833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:12 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:13.265140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e8912386-6271-449f-8c35-bccbd3b16be3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:13.265401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4b4f9233-7bdd-4279-a988-31114d37e39c req-0571ccf7-6301-40d7-86d2-ff6b15b711f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db170ae-e6b1-4057-8d54-6bba8c210919", "name": "network-vif-deleted", "tag": "3780f4c2-abd7-4eed-a9ea-b6d199050677"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:13.267831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e8912386-6271-449f-8c35-bccbd3b16be3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:13.283082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8912386-6271-449f-8c35-bccbd3b16be3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:13.284256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8912386-6271-449f-8c35-bccbd3b16be3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:13.284930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8912386-6271-449f-8c35-bccbd3b16be3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:13.287847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8912386-6271-449f-8c35-bccbd3b16be3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:13.289540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8912386-6271-449f-8c35-bccbd3b16be3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:13.290188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e8912386-6271-449f-8c35-bccbd3b16be3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:13.292999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4b4f9233-7bdd-4279-a988-31114d37e39c req-0571ccf7-6301-40d7-86d2-ff6b15b711f4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:13.293494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4b4f9233-7bdd-4279-a988-31114d37e39c req-0571ccf7-6301-40d7-86d2-ff6b15b711f4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:13.295892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4b4f9233-7bdd-4279-a988-31114d37e39c req-0571ccf7-6301-40d7-86d2-ff6b15b711f4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:13.321415 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4b4f9233-7bdd-4279-a988-31114d37e39c req-0571ccf7-6301-40d7-86d2-ff6b15b711f4 service nova] Creating event network-vif-deleted:3780f4c2-abd7-4eed-a9ea-b6d199050677 for instance 5db170ae-e6b1-4057-8d54-6bba8c210919 on n-h2-860864-3 Oct 11 19:54:13.333875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:13.334138 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4b4f9233-7bdd-4279-a988-31114d37e39c req-0571ccf7-6301-40d7-86d2-ff6b15b711f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074880 Oct 11 19:54:13.334697 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1381/2834] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:13.347930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-760637958", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "045c6ac7-f110-46b6-b43d-dee4dc6a4864"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:13.438815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] validate_networks() for None {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:54:13.526744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:13.611236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:13.818694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e8912386-6271-449f-8c35-bccbd3b16be3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:13.831831 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e8912386-6271-449f-8c35-bccbd3b16be3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1323 microversion: 2.1 time: 0.588699 Oct 11 19:54:13.832808 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1454/2835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:13 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:13.845793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-e203f4c7-eb66-4295-b3ab-8f4f59600e51 req-1f2087e9-74bc-46d4-a46b-fb1870d0b910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac52ec7-a881-454c-89ea-25e9d288b87d", "name": "network-vif-plugged", "status": "completed", "tag": "9b2cc42b-faeb-475b-a070-fb2ed8d8904e"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:13.856229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e203f4c7-eb66-4295-b3ab-8f4f59600e51 req-1f2087e9-74bc-46d4-a46b-fb1870d0b910 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:13.856709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e203f4c7-eb66-4295-b3ab-8f4f59600e51 req-1f2087e9-74bc-46d4-a46b-fb1870d0b910 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:13.857146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e203f4c7-eb66-4295-b3ab-8f4f59600e51 req-1f2087e9-74bc-46d4-a46b-fb1870d0b910 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:13.868469 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-e203f4c7-eb66-4295-b3ab-8f4f59600e51 req-1f2087e9-74bc-46d4-a46b-fb1870d0b910 service nova] Creating event network-vif-plugged:9b2cc42b-faeb-475b-a070-fb2ed8d8904e for instance 0ac52ec7-a881-454c-89ea-25e9d288b87d on n-h2-860864-3 Oct 11 19:54:13.875778 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-e203f4c7-eb66-4295-b3ab-8f4f59600e51 req-1f2087e9-74bc-46d4-a46b-fb1870d0b910 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041321 Oct 11 19:54:13.880358 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1455/2836] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:13.886630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8a05cf0f-97dc-45f1-8a7a-437fe9d20db1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc4af700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:13.943786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:54:13.944282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:54:13.944711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:54:13.946558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:54:13.947458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:54:13.956633 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8a05cf0f-97dc-45f1-8a7a-437fe9d20db1 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1464 microversion: 2.1 time: 0.074699 Oct 11 19:54:13.957872 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1456/2837] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:13 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1464 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:13.964998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5c2b2b69-c3fa-42d8-a757-018ee97000bc tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '.version_select at 0x7f83d07461f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:13.965475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:13.965973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:13.966422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:13.967337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:13.967949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:13.968506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:13.993234 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5c2b2b69-c3fa-42d8-a757-018ee97000bc tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095256113" status: 202 len: 0 microversion: 2.1 time: 0.033717 Oct 11 19:54:13.994561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Getting quotas for project 72d58f28f49447e298dbb540406db442. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:54:13.999057 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1457/2838] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 19:54:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095256113 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:54:14.007857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-767307f1-5085-47a6-aecf-63601f90deef tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1649367144"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:14.011034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-767307f1-5085-47a6-aecf-63601f90deef tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:14.023872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Getting quotas for user bcf8064e6fb843b782f0d89718f1c8e5 and project 72d58f28f49447e298dbb540406db442. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:54:14.024912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-767307f1-5085-47a6-aecf-63601f90deef tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:14.025629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-767307f1-5085-47a6-aecf-63601f90deef tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:14.026249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-767307f1-5085-47a6-aecf-63601f90deef tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:14.029002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-767307f1-5085-47a6-aecf-63601f90deef tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:14.029731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-767307f1-5085-47a6-aecf-63601f90deef tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:14.031082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-767307f1-5085-47a6-aecf-63601f90deef tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:14.044479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:54:14.048951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:54:14.128108 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc0106b9-aa75-41c9-a4e6-c79e49ee861c tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789182 Oct 11 19:54:14.129173 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1382/2839] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:54:14.135121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-04482128-e26e-465a-8347-4420fb082c89 req-7c73d95c-bced-4397-aa59-ad45705c40ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0583d05-1d47-4efb-a936-5e747c44c9c2", "tag": "f0945e06-d4cf-49ce-a31f-4ceba757cea1"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:14.154374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-04482128-e26e-465a-8347-4420fb082c89 req-7c73d95c-bced-4397-aa59-ad45705c40ab service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:14.155623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-04482128-e26e-465a-8347-4420fb082c89 req-7c73d95c-bced-4397-aa59-ad45705c40ab service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:14.157000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-04482128-e26e-465a-8347-4420fb082c89 req-7c73d95c-bced-4397-aa59-ad45705c40ab service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:14.176216 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-04482128-e26e-465a-8347-4420fb082c89 req-7c73d95c-bced-4397-aa59-ad45705c40ab service nova] Creating event network-changed:f0945e06-d4cf-49ce-a31f-4ceba757cea1 for instance f0583d05-1d47-4efb-a936-5e747c44c9c2 on n-h1-860864-3 Oct 11 19:54:14.183342 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-04482128-e26e-465a-8347-4420fb082c89 req-7c73d95c-bced-4397-aa59-ad45705c40ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052236 Oct 11 19:54:14.184716 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1383/2840] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:14.194310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec74daa8-7356-4d1e-a9db-363486ceccdd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:14.195765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ec74daa8-7356-4d1e-a9db-363486ceccdd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:14.209187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec74daa8-7356-4d1e-a9db-363486ceccdd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:14.209978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec74daa8-7356-4d1e-a9db-363486ceccdd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:14.211527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec74daa8-7356-4d1e-a9db-363486ceccdd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:14.213071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec74daa8-7356-4d1e-a9db-363486ceccdd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:14.214024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec74daa8-7356-4d1e-a9db-363486ceccdd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:14.215797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec74daa8-7356-4d1e-a9db-363486ceccdd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:14.573247 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.network.security_group_api [None req-767307f1-5085-47a6-aecf-63601f90deef tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Removing security group b1dd93bd-2314-453a-8c2d-6f47e83fadd2 from port f0945e06-d4cf-49ce-a31f-4ceba757cea1 Oct 11 19:54:14.740545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec74daa8-7356-4d1e-a9db-363486ceccdd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:14.773519 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ec74daa8-7356-4d1e-a9db-363486ceccdd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1321 microversion: 2.1 time: 0.583690 Oct 11 19:54:14.793355 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1384/2841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:14 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1321 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:14.823553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05c02af7-aaea-447f-8bed-934de3d12e62 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d078f790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:14.904872 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05c02af7-aaea-447f-8bed-934de3d12e62 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 200 len: 1464 microversion: 2.1 time: 0.109565 Oct 11 19:54:14.915366 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1385/2842] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:14 2022] GET /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 1464 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:14.920367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c9c95a7d-9eb2-46ef-9a5f-17c34dd79782 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:14.921017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c9c95a7d-9eb2-46ef-9a5f-17c34dd79782 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:14.927842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c95a7d-9eb2-46ef-9a5f-17c34dd79782 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:14.928340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c95a7d-9eb2-46ef-9a5f-17c34dd79782 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:14.928789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c95a7d-9eb2-46ef-9a5f-17c34dd79782 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:14.929569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c95a7d-9eb2-46ef-9a5f-17c34dd79782 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:14.930061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c95a7d-9eb2-46ef-9a5f-17c34dd79782 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:14.930512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9c95a7d-9eb2-46ef-9a5f-17c34dd79782 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:15.117604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c9c95a7d-9eb2-46ef-9a5f-17c34dd79782 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:15.128976 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c9c95a7d-9eb2-46ef-9a5f-17c34dd79782 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1209 microversion: 2.1 time: 0.212157 Oct 11 19:54:15.130310 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1386/2843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:14 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1209 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:15.137346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a1a5acb7-bbf0-43c4-bd13-63b370b80a53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:15.139047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a1a5acb7-bbf0-43c4-bd13-63b370b80a53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:15.151460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1a5acb7-bbf0-43c4-bd13-63b370b80a53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:15.152206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1a5acb7-bbf0-43c4-bd13-63b370b80a53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:15.153800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1a5acb7-bbf0-43c4-bd13-63b370b80a53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:15.155013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1a5acb7-bbf0-43c4-bd13-63b370b80a53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:15.155642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1a5acb7-bbf0-43c4-bd13-63b370b80a53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:15.156882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1a5acb7-bbf0-43c4-bd13-63b370b80a53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:15.645704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a1a5acb7-bbf0-43c4-bd13-63b370b80a53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:15.655475 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a1a5acb7-bbf0-43c4-bd13-63b370b80a53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1363 microversion: 2.1 time: 0.523236 Oct 11 19:54:15.666891 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1387/2844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:15 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:15.666891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c1c23496-bf26-4abd-b9bd-7d470efcca9b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:15.666891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c1c23496-bf26-4abd-b9bd-7d470efcca9b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:15.671855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1c23496-bf26-4abd-b9bd-7d470efcca9b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:15.672904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1c23496-bf26-4abd-b9bd-7d470efcca9b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:15.673438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1c23496-bf26-4abd-b9bd-7d470efcca9b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:15.674444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1c23496-bf26-4abd-b9bd-7d470efcca9b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:15.674928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1c23496-bf26-4abd-b9bd-7d470efcca9b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:15.675352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1c23496-bf26-4abd-b9bd-7d470efcca9b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.238100 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-767307f1-5085-47a6-aecf-63601f90deef tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "POST /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2/action" status: 202 len: 0 microversion: 2.1 time: 2.237473 Oct 11 19:54:16.240106 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1458/2845] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:13 2022] POST /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2/action => generated 0 bytes in 2240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:54:16.245136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0175dffe-091f-4b9c-bbcd-a7f58f709b6b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:16.246268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0175dffe-091f-4b9c-bbcd-a7f58f709b6b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:16.262084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0175dffe-091f-4b9c-bbcd-a7f58f709b6b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.262876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0175dffe-091f-4b9c-bbcd-a7f58f709b6b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.263470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0175dffe-091f-4b9c-bbcd-a7f58f709b6b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.264339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0175dffe-091f-4b9c-bbcd-a7f58f709b6b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.264970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0175dffe-091f-4b9c-bbcd-a7f58f709b6b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.265386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0175dffe-091f-4b9c-bbcd-a7f58f709b6b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.482104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c1c23496-bf26-4abd-b9bd-7d470efcca9b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:16.490504 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c1c23496-bf26-4abd-b9bd-7d470efcca9b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1317 microversion: 2.1 time: 0.833310 Oct 11 19:54:16.492129 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1388/2846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:15 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1317 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:16.496919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6a5b3851-85a4-4251-a517-4cc396ea1402 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:16.497745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6a5b3851-85a4-4251-a517-4cc396ea1402 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:16.503642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a5b3851-85a4-4251-a517-4cc396ea1402 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.504137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a5b3851-85a4-4251-a517-4cc396ea1402 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.504633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a5b3851-85a4-4251-a517-4cc396ea1402 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.505376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a5b3851-85a4-4251-a517-4cc396ea1402 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.505929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a5b3851-85a4-4251-a517-4cc396ea1402 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.506567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a5b3851-85a4-4251-a517-4cc396ea1402 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.647051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0175dffe-091f-4b9c-bbcd-a7f58f709b6b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:16.655837 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0175dffe-091f-4b9c-bbcd-a7f58f709b6b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1323 microversion: 2.1 time: 0.414406 Oct 11 19:54:16.656526 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1459/2847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:16 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1323 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:16.661135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-81ad7b81-c9f7-4769-ad36-96f02794072f req-9e5e682d-cc7c-4303-b418-aab8578e9765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f1dc40-ef33-40f8-b128-d5c6367e833e", "tag": "7033f16c-8fb2-4050-810b-a6de0ea759f0"}, {"name": "network-changed", "server_uuid": "99eb7ce1-c903-472e-b46a-6714f5362eb9", "tag": "a2e6b196-5acc-46eb-b34c-0fe50a81feea"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:16.672285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-81ad7b81-c9f7-4769-ad36-96f02794072f req-9e5e682d-cc7c-4303-b418-aab8578e9765 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.674114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-81ad7b81-c9f7-4769-ad36-96f02794072f req-9e5e682d-cc7c-4303-b418-aab8578e9765 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.674114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-81ad7b81-c9f7-4769-ad36-96f02794072f req-9e5e682d-cc7c-4303-b418-aab8578e9765 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.686078 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-81ad7b81-c9f7-4769-ad36-96f02794072f req-9e5e682d-cc7c-4303-b418-aab8578e9765 service nova] Creating event network-changed:7033f16c-8fb2-4050-810b-a6de0ea759f0 for instance 85f1dc40-ef33-40f8-b128-d5c6367e833e on n-h1-860864-3 Oct 11 19:54:16.686637 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-81ad7b81-c9f7-4769-ad36-96f02794072f req-9e5e682d-cc7c-4303-b418-aab8578e9765 service nova] Creating event network-changed:a2e6b196-5acc-46eb-b34c-0fe50a81feea for instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 on n-h1-860864-3 Oct 11 19:54:16.693085 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-81ad7b81-c9f7-4769-ad36-96f02794072f req-9e5e682d-cc7c-4303-b418-aab8578e9765 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035164 Oct 11 19:54:16.697282 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1460/2848] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:16.703085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa9c2beb-21d5-4d4c-adc7-694b637f9f95 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:16.703811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa9c2beb-21d5-4d4c-adc7-694b637f9f95 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:16.717477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9c2beb-21d5-4d4c-adc7-694b637f9f95 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.718004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9c2beb-21d5-4d4c-adc7-694b637f9f95 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.718446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9c2beb-21d5-4d4c-adc7-694b637f9f95 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.719179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9c2beb-21d5-4d4c-adc7-694b637f9f95 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.719638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9c2beb-21d5-4d4c-adc7-694b637f9f95 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.720072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9c2beb-21d5-4d4c-adc7-694b637f9f95 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.731296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6a5b3851-85a4-4251-a517-4cc396ea1402 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:16.739076 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6a5b3851-85a4-4251-a517-4cc396ea1402 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1467 microversion: 2.1 time: 0.245811 Oct 11 19:54:16.739645 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1389/2849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:16 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1467 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:16.744333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-6589e077-5ee6-4461-842e-d9a04b5c0e36 req-1bb64f2a-d67d-4c2d-8474-e360230c1486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a346658c-09a4-43ec-a0ab-e2541e23e423", "name": "network-vif-plugged", "status": "completed", "tag": "958b0dc6-87d6-463a-b043-1a976667640b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:16.749362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:16.756778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6589e077-5ee6-4461-842e-d9a04b5c0e36 req-1bb64f2a-d67d-4c2d-8474-e360230c1486 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.757294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6589e077-5ee6-4461-842e-d9a04b5c0e36 req-1bb64f2a-d67d-4c2d-8474-e360230c1486 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.757941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6589e077-5ee6-4461-842e-d9a04b5c0e36 req-1bb64f2a-d67d-4c2d-8474-e360230c1486 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.770767 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6589e077-5ee6-4461-842e-d9a04b5c0e36 req-1bb64f2a-d67d-4c2d-8474-e360230c1486 service nova] Creating event network-vif-plugged:958b0dc6-87d6-463a-b043-1a976667640b for instance a346658c-09a4-43ec-a0ab-e2541e23e423 on n-h2-860864-3 Oct 11 19:54:16.776136 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-6589e077-5ee6-4461-842e-d9a04b5c0e36 req-1bb64f2a-d67d-4c2d-8474-e360230c1486 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035407 Oct 11 19:54:16.776815 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1390/2850] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:16.782141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb77de04-ce61-43f0-9c48-fc2806603cb0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:16.782872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cb77de04-ce61-43f0-9c48-fc2806603cb0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:16.789489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb77de04-ce61-43f0-9c48-fc2806603cb0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.790225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb77de04-ce61-43f0-9c48-fc2806603cb0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.790868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb77de04-ce61-43f0-9c48-fc2806603cb0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.791722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb77de04-ce61-43f0-9c48-fc2806603cb0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.792339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb77de04-ce61-43f0-9c48-fc2806603cb0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.792914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb77de04-ce61-43f0-9c48-fc2806603cb0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.874110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb77de04-ce61-43f0-9c48-fc2806603cb0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:16.883552 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cb77de04-ce61-43f0-9c48-fc2806603cb0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1271 microversion: 2.1 time: 0.105497 Oct 11 19:54:16.884144 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1391/2851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:16 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:16.888625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-6743ea0c-78f7-4252-95e3-9fa976ac06d5 req-054d009f-e42f-4d14-ba3a-5d6e405bdbcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ee4391-e163-4a76-9151-04adeb0111a8", "tag": "8feec027-3d8b-4b4e-9712-8f57ab9fb853"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:16.890464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa9c2beb-21d5-4d4c-adc7-694b637f9f95 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:16.898765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6743ea0c-78f7-4252-95e3-9fa976ac06d5 req-054d009f-e42f-4d14-ba3a-5d6e405bdbcf service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.899259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6743ea0c-78f7-4252-95e3-9fa976ac06d5 req-054d009f-e42f-4d14-ba3a-5d6e405bdbcf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.899472 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa9c2beb-21d5-4d4c-adc7-694b637f9f95 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1321 microversion: 2.1 time: 0.200891 Oct 11 19:54:16.899695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6743ea0c-78f7-4252-95e3-9fa976ac06d5 req-054d009f-e42f-4d14-ba3a-5d6e405bdbcf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.900056 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1461/2852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:16 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:16.906395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb69fcd5-b376-417c-a042-124636565718 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Action: 'create', calling method: .version_select at 0x7f83d074d4c0>, body: {"pool": null} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:16.916153 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6743ea0c-78f7-4252-95e3-9fa976ac06d5 req-054d009f-e42f-4d14-ba3a-5d6e405bdbcf service nova] Creating event network-changed:8feec027-3d8b-4b4e-9712-8f57ab9fb853 for instance b7ee4391-e163-4a76-9151-04adeb0111a8 on n-h1-860864-3 Oct 11 19:54:16.921242 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-6743ea0c-78f7-4252-95e3-9fa976ac06d5 req-054d009f-e42f-4d14-ba3a-5d6e405bdbcf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035977 Oct 11 19:54:16.922013 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1392/2853] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:16.927548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6231f088-3b1a-4f1f-b53f-9e9a2a3817e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:16.928459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6231f088-3b1a-4f1f-b53f-9e9a2a3817e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:16.937058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6231f088-3b1a-4f1f-b53f-9e9a2a3817e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.938392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6231f088-3b1a-4f1f-b53f-9e9a2a3817e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.939088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6231f088-3b1a-4f1f-b53f-9e9a2a3817e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:16.939866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6231f088-3b1a-4f1f-b53f-9e9a2a3817e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:16.940326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6231f088-3b1a-4f1f-b53f-9e9a2a3817e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:16.940758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6231f088-3b1a-4f1f-b53f-9e9a2a3817e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:17.255709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6231f088-3b1a-4f1f-b53f-9e9a2a3817e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:17.267651 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6231f088-3b1a-4f1f-b53f-9e9a2a3817e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1363 microversion: 2.1 time: 0.344443 Oct 11 19:54:17.268409 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1393/2854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:16 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:17.288306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62ea3e0f-d83a-4eac-aa23-1ca223ab0852 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'create', calling method: .version_select at 0x7f83cc332790>, body: {"keypair": {"name": "tempest-keypair-1187545380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnFwQQet1bwxIKDXUBCZSWO1aruRD/1GUZYwxYQp0SKY7KqZsacRhKW6vh5Pfk0neIOJmYun2OtfombsGagDDMcEnr7dJuu9OY9goCenWEO+t2DKw7roKnWrKjXA1Iv5Q=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:17.309025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-62ea3e0f-d83a-4eac-aa23-1ca223ab0852 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Getting quotas for project 59971595644041418ea11fd1d795f42c. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:54:17.316016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-62ea3e0f-d83a-4eac-aa23-1ca223ab0852 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Getting quotas for user bc6a1d30f20048159afd27eefdc831f9 and project 59971595644041418ea11fd1d795f42c. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:54:17.344282 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-62ea3e0f-d83a-4eac-aa23-1ca223ab0852 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073857 Oct 11 19:54:17.358756 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1394/2855] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:54:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:17.366437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f99a7622-f8da-4d84-9e35-34270d51bc7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-777884154"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:17.380727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f99a7622-f8da-4d84-9e35-34270d51bc7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:17.398895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99a7622-f8da-4d84-9e35-34270d51bc7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:17.399912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99a7622-f8da-4d84-9e35-34270d51bc7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:17.401216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99a7622-f8da-4d84-9e35-34270d51bc7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:17.402758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99a7622-f8da-4d84-9e35-34270d51bc7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:17.403712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99a7622-f8da-4d84-9e35-34270d51bc7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:17.405548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f99a7622-f8da-4d84-9e35-34270d51bc7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:17.661791 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f99a7622-f8da-4d84-9e35-34270d51bc7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "POST /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5/action" status: 202 len: 0 microversion: 2.1 time: 0.298132 Oct 11 19:54:17.666441 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1395/2856] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:17 2022] POST /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 19:54:17.671964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ec207a0-454e-40e4-a3c5-670f3ee749a8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:17.672753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7ec207a0-454e-40e4-a3c5-670f3ee749a8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:17.686949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ec207a0-454e-40e4-a3c5-670f3ee749a8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:17.687460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ec207a0-454e-40e4-a3c5-670f3ee749a8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:17.687909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ec207a0-454e-40e4-a3c5-670f3ee749a8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:17.688684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ec207a0-454e-40e4-a3c5-670f3ee749a8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:17.689188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ec207a0-454e-40e4-a3c5-670f3ee749a8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:17.689615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ec207a0-454e-40e4-a3c5-670f3ee749a8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:17.966766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7ec207a0-454e-40e4-a3c5-670f3ee749a8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:17.983683 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7ec207a0-454e-40e4-a3c5-670f3ee749a8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1317 microversion: 2.1 time: 0.315820 Oct 11 19:54:17.984477 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1396/2857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:17 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:18.011527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-94acbb18-066a-46b1-83e8-1889e96ee293 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc128e50>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:18.101693 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-94acbb18-066a-46b1-83e8-1889e96ee293 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 200 len: 1454 microversion: 2.1 time: 0.100840 Oct 11 19:54:18.112419 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1397/2858] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:17 2022] GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:18.122810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-20008de7-64b5-4575-9caa-11ebe2a12a25 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:18.123751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-20008de7-64b5-4575-9caa-11ebe2a12a25 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:18.137444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20008de7-64b5-4575-9caa-11ebe2a12a25 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:18.138003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20008de7-64b5-4575-9caa-11ebe2a12a25 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:18.138481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20008de7-64b5-4575-9caa-11ebe2a12a25 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:18.139258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20008de7-64b5-4575-9caa-11ebe2a12a25 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:18.146796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20008de7-64b5-4575-9caa-11ebe2a12a25 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:18.147652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20008de7-64b5-4575-9caa-11ebe2a12a25 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:18.477225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-20008de7-64b5-4575-9caa-11ebe2a12a25 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:18.506358 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-20008de7-64b5-4575-9caa-11ebe2a12a25 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1323 microversion: 2.1 time: 0.392790 Oct 11 19:54:18.507361 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1398/2859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:18 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1323 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:18.513528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-07ea0cac-9e2c-48e4-8804-5ad459844ca0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:18.514783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-07ea0cac-9e2c-48e4-8804-5ad459844ca0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:18.529724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07ea0cac-9e2c-48e4-8804-5ad459844ca0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:18.530219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07ea0cac-9e2c-48e4-8804-5ad459844ca0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:18.530741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07ea0cac-9e2c-48e4-8804-5ad459844ca0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:18.531440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07ea0cac-9e2c-48e4-8804-5ad459844ca0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:18.532092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07ea0cac-9e2c-48e4-8804-5ad459844ca0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:18.532514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07ea0cac-9e2c-48e4-8804-5ad459844ca0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:18.760441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-07ea0cac-9e2c-48e4-8804-5ad459844ca0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:18.769328 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-07ea0cac-9e2c-48e4-8804-5ad459844ca0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1313 microversion: 2.1 time: 0.260029 Oct 11 19:54:18.795217 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1399/2860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:18 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:18.808426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-24e13c90-7ea7-40c2-8be6-01cf9cc9b2dc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:18.808622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-24e13c90-7ea7-40c2-8be6-01cf9cc9b2dc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:18.815328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24e13c90-7ea7-40c2-8be6-01cf9cc9b2dc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:18.815824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24e13c90-7ea7-40c2-8be6-01cf9cc9b2dc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:18.816267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24e13c90-7ea7-40c2-8be6-01cf9cc9b2dc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:18.817012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24e13c90-7ea7-40c2-8be6-01cf9cc9b2dc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:18.817765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24e13c90-7ea7-40c2-8be6-01cf9cc9b2dc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:18.818235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24e13c90-7ea7-40c2-8be6-01cf9cc9b2dc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:18.824660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:19.048647 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bb69fcd5-b376-417c-a042-124636565718 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.147406 Oct 11 19:54:19.049878 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1462/2861] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:54:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:19.053628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-24e13c90-7ea7-40c2-8be6-01cf9cc9b2dc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:19.063090 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-24e13c90-7ea7-40c2-8be6-01cf9cc9b2dc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1516 microversion: 2.1 time: 0.266597 Oct 11 19:54:19.064197 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1400/2862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:18 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:19.068862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-9b864bd3-8353-4c9f-97ca-375a9f507799 req-700f2687-0f45-4a6b-ab60-e403c36e7a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1f8956-214c-4f94-b8a9-c7bb03b56104", "name": "network-vif-unplugged", "status": "completed", "tag": "3003e5ed-e486-4f4c-954b-6ab7b07147e9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:19.079064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9b864bd3-8353-4c9f-97ca-375a9f507799 req-700f2687-0f45-4a6b-ab60-e403c36e7a24 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.080441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9b864bd3-8353-4c9f-97ca-375a9f507799 req-700f2687-0f45-4a6b-ab60-e403c36e7a24 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.080707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5f90d2b5-e95f-415d-baea-7d25c575593f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:19.081200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9b864bd3-8353-4c9f-97ca-375a9f507799 req-700f2687-0f45-4a6b-ab60-e403c36e7a24 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.081328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5f90d2b5-e95f-415d-baea-7d25c575593f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:19.096784 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-9b864bd3-8353-4c9f-97ca-375a9f507799 req-700f2687-0f45-4a6b-ab60-e403c36e7a24 service nova] Creating event network-vif-unplugged:3003e5ed-e486-4f4c-954b-6ab7b07147e9 for instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 on n-h1-860864-3 Oct 11 19:54:19.104210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f90d2b5-e95f-415d-baea-7d25c575593f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.104984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f90d2b5-e95f-415d-baea-7d25c575593f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.105598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f90d2b5-e95f-415d-baea-7d25c575593f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.107071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f90d2b5-e95f-415d-baea-7d25c575593f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.107643 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-9b864bd3-8353-4c9f-97ca-375a9f507799 req-700f2687-0f45-4a6b-ab60-e403c36e7a24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037769 Oct 11 19:54:19.107797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f90d2b5-e95f-415d-baea-7d25c575593f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.108266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f90d2b5-e95f-415d-baea-7d25c575593f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.109191 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1401/2863] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:19.115662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-90837a35-6f71-41bd-8225-a9026de8b02e req-af7e0a3d-76f1-4053-8ff0-e79c70752ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0583d05-1d47-4efb-a936-5e747c44c9c2", "tag": "f0945e06-d4cf-49ce-a31f-4ceba757cea1"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:19.127417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-90837a35-6f71-41bd-8225-a9026de8b02e req-af7e0a3d-76f1-4053-8ff0-e79c70752ae0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.127904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-90837a35-6f71-41bd-8225-a9026de8b02e req-af7e0a3d-76f1-4053-8ff0-e79c70752ae0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.128334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-90837a35-6f71-41bd-8225-a9026de8b02e req-af7e0a3d-76f1-4053-8ff0-e79c70752ae0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.142230 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-90837a35-6f71-41bd-8225-a9026de8b02e req-af7e0a3d-76f1-4053-8ff0-e79c70752ae0 service nova] Creating event network-changed:f0945e06-d4cf-49ce-a31f-4ceba757cea1 for instance f0583d05-1d47-4efb-a936-5e747c44c9c2 on n-h1-860864-3 Oct 11 19:54:19.147199 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-90837a35-6f71-41bd-8225-a9026de8b02e req-af7e0a3d-76f1-4053-8ff0-e79c70752ae0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036637 Oct 11 19:54:19.148282 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1402/2864] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:19.158303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fbd0af9c-228c-4565-8399-b323b319c7ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:19.159321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fbd0af9c-228c-4565-8399-b323b319c7ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:19.183031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbd0af9c-228c-4565-8399-b323b319c7ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.183785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbd0af9c-228c-4565-8399-b323b319c7ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.184409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbd0af9c-228c-4565-8399-b323b319c7ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.185843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbd0af9c-228c-4565-8399-b323b319c7ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.186462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbd0af9c-228c-4565-8399-b323b319c7ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.187523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbd0af9c-228c-4565-8399-b323b319c7ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.353674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5f90d2b5-e95f-415d-baea-7d25c575593f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:19.380869 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5f90d2b5-e95f-415d-baea-7d25c575593f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1363 microversion: 2.1 time: 0.317321 Oct 11 19:54:19.383753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fbd0af9c-228c-4565-8399-b323b319c7ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:19.384179 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1463/2865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:19 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:19.392265 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fbd0af9c-228c-4565-8399-b323b319c7ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1317 microversion: 2.1 time: 0.238451 Oct 11 19:54:19.399572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Action: 'action', calling method: .version_select at 0x7f83cebba8b0>, body: {"addFloatingIp": {"address": "172.25.2.237"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:19.406243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:19.407683 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1403/2866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:19 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:19.414795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9df098c2-887c-4bf3-bb80-ad908653f705 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:19.417643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9df098c2-887c-4bf3-bb80-ad908653f705 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:19.422341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.423802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.424325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.424861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df098c2-887c-4bf3-bb80-ad908653f705 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.425042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.425657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df098c2-887c-4bf3-bb80-ad908653f705 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.425790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.426166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.426562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df098c2-887c-4bf3-bb80-ad908653f705 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.427559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df098c2-887c-4bf3-bb80-ad908653f705 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.428299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df098c2-887c-4bf3-bb80-ad908653f705 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.428875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df098c2-887c-4bf3-bb80-ad908653f705 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.457791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-9df098c2-887c-4bf3-bb80-ad908653f705 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lazy-loading 'flavor' on Instance uuid a346658c-09a4-43ec-a0ab-e2541e23e423 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:54:19.515372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "refresh_cache-f0583d05-1d47-4efb-a936-5e747c44c9c2" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:54:19.515778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquired lock "refresh_cache-f0583d05-1d47-4efb-a936-5e747c44c9c2" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:54:19.565421 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9df098c2-887c-4bf3-bb80-ad908653f705 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423/action" status: 200 len: 32 microversion: 2.1 time: 0.156084 Oct 11 19:54:19.572532 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1404/2867] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:19 2022] POST /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:54:19.579073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-803955a0-d12a-44c7-a50c-432c54a6ac7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d08ae820>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:19.644313 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-803955a0-d12a-44c7-a50c-432c54a6ac7a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 200 len: 1454 microversion: 2.1 time: 0.069657 Oct 11 19:54:19.646191 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1405/2868] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:19 2022] GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:19.656578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c66d325-38df-42ac-a167-0620a06d66d7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:19.658191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5c66d325-38df-42ac-a167-0620a06d66d7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:19.667055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c66d325-38df-42ac-a167-0620a06d66d7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.667677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c66d325-38df-42ac-a167-0620a06d66d7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.668132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c66d325-38df-42ac-a167-0620a06d66d7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:19.668920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c66d325-38df-42ac-a167-0620a06d66d7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:19.669458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c66d325-38df-42ac-a167-0620a06d66d7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:19.670179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c66d325-38df-42ac-a167-0620a06d66d7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:20.501831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5c66d325-38df-42ac-a167-0620a06d66d7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:20.515618 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5c66d325-38df-42ac-a167-0620a06d66d7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1323 microversion: 2.1 time: 0.868265 Oct 11 19:54:20.516224 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1406/2869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:19 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1323 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:20.522276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-48c5dec5-556d-48a7-b98e-b028b456175e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:20.524588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-48c5dec5-556d-48a7-b98e-b028b456175e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:20.532567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c5dec5-556d-48a7-b98e-b028b456175e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:20.533284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c5dec5-556d-48a7-b98e-b028b456175e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:20.533939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c5dec5-556d-48a7-b98e-b028b456175e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:20.534884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c5dec5-556d-48a7-b98e-b028b456175e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:20.535619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c5dec5-556d-48a7-b98e-b028b456175e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:20.536146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c5dec5-556d-48a7-b98e-b028b456175e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:21.083069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-48c5dec5-556d-48a7-b98e-b028b456175e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:21.096969 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-48c5dec5-556d-48a7-b98e-b028b456175e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.578664 Oct 11 19:54:21.108913 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1407/2870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:20 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:21.119930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-898cf0cc-e8a4-436e-b939-bef6b7ecd944 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:21.121099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-898cf0cc-e8a4-436e-b939-bef6b7ecd944 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:21.130456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-898cf0cc-e8a4-436e-b939-bef6b7ecd944 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:21.131541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-898cf0cc-e8a4-436e-b939-bef6b7ecd944 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:21.132143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-898cf0cc-e8a4-436e-b939-bef6b7ecd944 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:21.133934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-898cf0cc-e8a4-436e-b939-bef6b7ecd944 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:21.134579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-898cf0cc-e8a4-436e-b939-bef6b7ecd944 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:21.135527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-898cf0cc-e8a4-436e-b939-bef6b7ecd944 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:21.586635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-898cf0cc-e8a4-436e-b939-bef6b7ecd944 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:21.597339 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-898cf0cc-e8a4-436e-b939-bef6b7ecd944 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1313 microversion: 2.1 time: 0.487041 Oct 11 19:54:21.598803 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1408/2871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:21 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:21.604521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4c5d464f-d1d3-41e3-9459-d8454bb495e5 req-de2b0423-6486-4d11-99fe-827c1227d0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9aeb85-447c-419f-9b63-c85927a11e8c", "tag": "11e3d19e-74f2-4036-9c86-305e9f486564"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:21.615021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4c5d464f-d1d3-41e3-9459-d8454bb495e5 req-de2b0423-6486-4d11-99fe-827c1227d0b3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:21.615841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4c5d464f-d1d3-41e3-9459-d8454bb495e5 req-de2b0423-6486-4d11-99fe-827c1227d0b3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:21.616585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4c5d464f-d1d3-41e3-9459-d8454bb495e5 req-de2b0423-6486-4d11-99fe-827c1227d0b3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:21.647331 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4c5d464f-d1d3-41e3-9459-d8454bb495e5 req-de2b0423-6486-4d11-99fe-827c1227d0b3 service nova] Creating event network-changed:11e3d19e-74f2-4036-9c86-305e9f486564 for instance 7b9aeb85-447c-419f-9b63-c85927a11e8c on n-h1-860864-3 Oct 11 19:54:21.653589 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4c5d464f-d1d3-41e3-9459-d8454bb495e5 req-de2b0423-6486-4d11-99fe-827c1227d0b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053374 Oct 11 19:54:21.654456 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1409/2872] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:21.666655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-933609682", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7591add0-fdf6-4241-8d33-bc1dba02813a"}], "security_groups": [{"name": "tempest-securitygroup--600931305"}], "key_name": "tempest-keypair-1187545380", "user_data": "}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:21.883132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] validate_networks() for [('7591add0-fdf6-4241-8d33-bc1dba02813a', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:54:22.695988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Building network info cache for instance {{(pid=126956) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 19:54:23.250373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:54:23.250979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:54:23.251281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:54:23.251688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:54:23.252094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:54:23.262081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:23.262878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:23.263522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:23.264449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:23.265034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:23.265714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:23.290920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Getting quotas for project 59971595644041418ea11fd1d795f42c. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:54:23.296767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Getting quotas for user bc6a1d30f20048159afd27eefdc831f9 and project 59971595644041418ea11fd1d795f42c. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:54:23.312421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:54:23.316568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:54:23.378641 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1b57b0a7-497e-46a1-9568-984aecfd279c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.718669 Oct 11 19:54:23.379992 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1410/2873] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:54:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:54:23.385131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58412b2d-1a4f-4be2-aec0-928676d3d74d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:23.385938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58412b2d-1a4f-4be2-aec0-928676d3d74d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:23.393564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58412b2d-1a4f-4be2-aec0-928676d3d74d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:23.394358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58412b2d-1a4f-4be2-aec0-928676d3d74d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:23.394984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58412b2d-1a4f-4be2-aec0-928676d3d74d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:23.396179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58412b2d-1a4f-4be2-aec0-928676d3d74d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:23.396790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58412b2d-1a4f-4be2-aec0-928676d3d74d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:23.397507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58412b2d-1a4f-4be2-aec0-928676d3d74d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:24.194046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58412b2d-1a4f-4be2-aec0-928676d3d74d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:24.208857 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58412b2d-1a4f-4be2-aec0-928676d3d74d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1363 microversion: 2.1 time: 0.827199 Oct 11 19:54:24.211063 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1411/2874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:23 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1363 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:24.237762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-960052ad-5fc7-446b-b2be-709b8989ea06 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:24.239011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-960052ad-5fc7-446b-b2be-709b8989ea06 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:24.260425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-960052ad-5fc7-446b-b2be-709b8989ea06 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:24.261748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-960052ad-5fc7-446b-b2be-709b8989ea06 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:24.263338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-960052ad-5fc7-446b-b2be-709b8989ea06 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:24.266316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-960052ad-5fc7-446b-b2be-709b8989ea06 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:24.267082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-960052ad-5fc7-446b-b2be-709b8989ea06 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:24.267828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-960052ad-5fc7-446b-b2be-709b8989ea06 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:24.541949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Updating instance_info_cache with network_info: [{"id": "f0945e06-d4cf-49ce-a31f-4ceba757cea1", "address": "fa:16:3e:fe:22:7a", "network": {"id": "1b725589-e176-46d6-a6c0-e64fce57877f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-67506322-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1054c39db17f47659b28044f47cf35fb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf0945e06-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126956) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:54:24.565031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Releasing lock "refresh_cache-f0583d05-1d47-4efb-a936-5e747c44c9c2" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:54:24.565993 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b93a25e3-8882-4824-b5bd-99ea5da952d0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "POST /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2/action" status: 202 len: 0 microversion: 2.1 time: 5.178293 Oct 11 19:54:24.566723 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1464/2875] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:19 2022] POST /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2/action => generated 0 bytes in 5182 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 19:54:24.581678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a3cafe0f-b6ef-4a66-bb56-7c55e007d8ea tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83ccb46a60>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:24.600193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-960052ad-5fc7-446b-b2be-709b8989ea06 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:24.619642 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-960052ad-5fc7-446b-b2be-709b8989ea06 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1317 microversion: 2.1 time: 0.406210 Oct 11 19:54:24.620249 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1412/2876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:24 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:24.646381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0ca9c8c1-4a9f-41d3-8b8f-ba964948d6f3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:24.651547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0ca9c8c1-4a9f-41d3-8b8f-ba964948d6f3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:24.663053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ca9c8c1-4a9f-41d3-8b8f-ba964948d6f3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:24.664568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ca9c8c1-4a9f-41d3-8b8f-ba964948d6f3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:24.665253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ca9c8c1-4a9f-41d3-8b8f-ba964948d6f3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:24.666295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ca9c8c1-4a9f-41d3-8b8f-ba964948d6f3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:24.667062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ca9c8c1-4a9f-41d3-8b8f-ba964948d6f3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:24.667934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ca9c8c1-4a9f-41d3-8b8f-ba964948d6f3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:24.715955 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a3cafe0f-b6ef-4a66-bb56-7c55e007d8ea tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 200 len: 1454 microversion: 2.1 time: 0.143728 Oct 11 19:54:24.720785 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1465/2877] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:24 2022] GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:24.733884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-db23194a-01c5-481e-a7c6-dfed98bacf4c req-7155f508-27c5-4f52-9d27-b8fa5014e3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99eb7ce1-c903-472e-b46a-6714f5362eb9", "name": "network-vif-plugged", "status": "completed", "tag": "a2e6b196-5acc-46eb-b34c-0fe50a81feea"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:24.747350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:24.793448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-db23194a-01c5-481e-a7c6-dfed98bacf4c req-7155f508-27c5-4f52-9d27-b8fa5014e3ad service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:24.793945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-db23194a-01c5-481e-a7c6-dfed98bacf4c req-7155f508-27c5-4f52-9d27-b8fa5014e3ad service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:24.798238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-db23194a-01c5-481e-a7c6-dfed98bacf4c req-7155f508-27c5-4f52-9d27-b8fa5014e3ad service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:24.832002 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-db23194a-01c5-481e-a7c6-dfed98bacf4c req-7155f508-27c5-4f52-9d27-b8fa5014e3ad service nova] Creating event network-vif-plugged:a2e6b196-5acc-46eb-b34c-0fe50a81feea for instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 on n-h1-860864-3 Oct 11 19:54:24.843232 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-db23194a-01c5-481e-a7c6-dfed98bacf4c req-7155f508-27c5-4f52-9d27-b8fa5014e3ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119945 Oct 11 19:54:24.845701 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1466/2878] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:24.891626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-166b5cc9-4516-4dce-aef9-9cf82533d31a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:24.891626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-166b5cc9-4516-4dce-aef9-9cf82533d31a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:24.902921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-166b5cc9-4516-4dce-aef9-9cf82533d31a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:24.903486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-166b5cc9-4516-4dce-aef9-9cf82533d31a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:24.904597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-166b5cc9-4516-4dce-aef9-9cf82533d31a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:24.905787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-166b5cc9-4516-4dce-aef9-9cf82533d31a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:24.906254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-166b5cc9-4516-4dce-aef9-9cf82533d31a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:24.906859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-166b5cc9-4516-4dce-aef9-9cf82533d31a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:24.979769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0ca9c8c1-4a9f-41d3-8b8f-ba964948d6f3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:24.988961 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0ca9c8c1-4a9f-41d3-8b8f-ba964948d6f3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1323 microversion: 2.1 time: 0.358557 Oct 11 19:54:24.994988 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1413/2879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:24 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1323 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:25.011635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb621cbd-1e79-4ca4-b073-c266be7d4c52 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:25.032028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cb621cbd-1e79-4ca4-b073-c266be7d4c52 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:25.042504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb621cbd-1e79-4ca4-b073-c266be7d4c52 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:25.043019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb621cbd-1e79-4ca4-b073-c266be7d4c52 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:25.044544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb621cbd-1e79-4ca4-b073-c266be7d4c52 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:25.045287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb621cbd-1e79-4ca4-b073-c266be7d4c52 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:25.046250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb621cbd-1e79-4ca4-b073-c266be7d4c52 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:25.046725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb621cbd-1e79-4ca4-b073-c266be7d4c52 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:25.330484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-166b5cc9-4516-4dce-aef9-9cf82533d31a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:25.344862 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-166b5cc9-4516-4dce-aef9-9cf82533d31a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.479252 Oct 11 19:54:25.365593 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1467/2880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:24 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:25.371734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-5c19e466-c0c5-4f4c-a089-1f7050603e04 req-33a54769-1a59-4d7e-816a-09cdda047a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0583d05-1d47-4efb-a936-5e747c44c9c2", "tag": "f0945e06-d4cf-49ce-a31f-4ceba757cea1"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:25.400305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5c19e466-c0c5-4f4c-a089-1f7050603e04 req-33a54769-1a59-4d7e-816a-09cdda047a31 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:25.403070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5c19e466-c0c5-4f4c-a089-1f7050603e04 req-33a54769-1a59-4d7e-816a-09cdda047a31 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:25.407543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5c19e466-c0c5-4f4c-a089-1f7050603e04 req-33a54769-1a59-4d7e-816a-09cdda047a31 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:25.425689 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-5c19e466-c0c5-4f4c-a089-1f7050603e04 req-33a54769-1a59-4d7e-816a-09cdda047a31 service nova] Creating event network-changed:f0945e06-d4cf-49ce-a31f-4ceba757cea1 for instance f0583d05-1d47-4efb-a936-5e747c44c9c2 on n-h1-860864-3 Oct 11 19:54:25.441981 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-5c19e466-c0c5-4f4c-a089-1f7050603e04 req-33a54769-1a59-4d7e-816a-09cdda047a31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074639 Oct 11 19:54:25.451399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb621cbd-1e79-4ca4-b073-c266be7d4c52 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:25.455603 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1468/2881] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:25.461594 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cb621cbd-1e79-4ca4-b073-c266be7d4c52 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1313 microversion: 2.1 time: 0.464816 Oct 11 19:54:25.466490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-974e288a-db62-4aec-8b7b-4553f83c9cfd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:25.468508 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1414/2882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:24 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:25.473503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Action: 'action', calling method: .version_select at 0x7f83cebba9d0>, body: {"removeFloatingIp": {"address": "172.25.2.237"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:25.478135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-974e288a-db62-4aec-8b7b-4553f83c9cfd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:25.494159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-974e288a-db62-4aec-8b7b-4553f83c9cfd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:25.506461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-974e288a-db62-4aec-8b7b-4553f83c9cfd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:25.506982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-974e288a-db62-4aec-8b7b-4553f83c9cfd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:25.508944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-974e288a-db62-4aec-8b7b-4553f83c9cfd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:25.509417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-974e288a-db62-4aec-8b7b-4553f83c9cfd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:25.509848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-974e288a-db62-4aec-8b7b-4553f83c9cfd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:25.716345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-974e288a-db62-4aec-8b7b-4553f83c9cfd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:25.733834 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-974e288a-db62-4aec-8b7b-4553f83c9cfd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 200 len: 1307 microversion: 2.1 time: 0.274744 Oct 11 19:54:25.734437 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1469/2883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:25 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 1307 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:25.752581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5445dbae-25a8-4f25-ac5b-d88f427f55f7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:25.753193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5445dbae-25a8-4f25-ac5b-d88f427f55f7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:25.766560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5445dbae-25a8-4f25-ac5b-d88f427f55f7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:25.768463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5445dbae-25a8-4f25-ac5b-d88f427f55f7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:25.769108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5445dbae-25a8-4f25-ac5b-d88f427f55f7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:25.770471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5445dbae-25a8-4f25-ac5b-d88f427f55f7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:25.771125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5445dbae-25a8-4f25-ac5b-d88f427f55f7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:25.771716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5445dbae-25a8-4f25-ac5b-d88f427f55f7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:25.795513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:25.805446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:25.805909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:25.806351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:25.808490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:25.808959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:25.809394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:26.031021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5445dbae-25a8-4f25-ac5b-d88f427f55f7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:26.040307 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5445dbae-25a8-4f25-ac5b-d88f427f55f7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1363 microversion: 2.1 time: 0.293878 Oct 11 19:54:26.055614 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1470/2884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:25 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:26.065656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d21f6bfc-d398-420f-92c9-7228f22f3870 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:26.066767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d21f6bfc-d398-420f-92c9-7228f22f3870 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:26.079523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d21f6bfc-d398-420f-92c9-7228f22f3870 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:26.081274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d21f6bfc-d398-420f-92c9-7228f22f3870 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:26.082372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d21f6bfc-d398-420f-92c9-7228f22f3870 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:26.083270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d21f6bfc-d398-420f-92c9-7228f22f3870 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:26.084480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d21f6bfc-d398-420f-92c9-7228f22f3870 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:26.085068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d21f6bfc-d398-420f-92c9-7228f22f3870 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:26.337832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "refresh_cache-f0583d05-1d47-4efb-a936-5e747c44c9c2" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:54:26.338488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquired lock "refresh_cache-f0583d05-1d47-4efb-a936-5e747c44c9c2" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:54:26.411908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d21f6bfc-d398-420f-92c9-7228f22f3870 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:26.423452 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d21f6bfc-d398-420f-92c9-7228f22f3870 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1317 microversion: 2.1 time: 0.366412 Oct 11 19:54:26.434131 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1471/2885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:26 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:26.451581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-91062021-5e65-4c98-ae57-9b6110cd4995 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc365790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:26.516558 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-91062021-5e65-4c98-ae57-9b6110cd4995 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 200 len: 1454 microversion: 2.1 time: 0.081122 Oct 11 19:54:26.517432 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1472/2886] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:26 2022] GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:26.542710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f299b2d-850b-4715-aa16-f177e63ccce2 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:26.543982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f299b2d-850b-4715-aa16-f177e63ccce2 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:26.551731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f299b2d-850b-4715-aa16-f177e63ccce2 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:26.552661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f299b2d-850b-4715-aa16-f177e63ccce2 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:26.553279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f299b2d-850b-4715-aa16-f177e63ccce2 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:26.554198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f299b2d-850b-4715-aa16-f177e63ccce2 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:26.554885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f299b2d-850b-4715-aa16-f177e63ccce2 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:26.555491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f299b2d-850b-4715-aa16-f177e63ccce2 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:26.777444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f299b2d-850b-4715-aa16-f177e63ccce2 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:26.800610 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f299b2d-850b-4715-aa16-f177e63ccce2 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1323 microversion: 2.1 time: 0.272748 Oct 11 19:54:26.806353 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1473/2887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:26 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:26.816281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-79a0a5fd-b282-42c0-b81a-3f5e37d97e76 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:26.817277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-79a0a5fd-b282-42c0-b81a-3f5e37d97e76 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:26.825431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79a0a5fd-b282-42c0-b81a-3f5e37d97e76 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:26.834132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79a0a5fd-b282-42c0-b81a-3f5e37d97e76 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:26.834986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79a0a5fd-b282-42c0-b81a-3f5e37d97e76 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:26.836987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79a0a5fd-b282-42c0-b81a-3f5e37d97e76 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:26.837658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79a0a5fd-b282-42c0-b81a-3f5e37d97e76 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:26.838303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-79a0a5fd-b282-42c0-b81a-3f5e37d97e76 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:27.267421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-79a0a5fd-b282-42c0-b81a-3f5e37d97e76 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:27.285656 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-79a0a5fd-b282-42c0-b81a-3f5e37d97e76 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.477799 Oct 11 19:54:27.302217 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1474/2888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:26 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:27.302217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3cf2c035-4d40-483d-b868-cfb19078a644 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:27.302217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3cf2c035-4d40-483d-b868-cfb19078a644 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:27.321676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cf2c035-4d40-483d-b868-cfb19078a644 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:27.322635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cf2c035-4d40-483d-b868-cfb19078a644 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:27.323077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cf2c035-4d40-483d-b868-cfb19078a644 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:27.323780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cf2c035-4d40-483d-b868-cfb19078a644 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:27.324322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cf2c035-4d40-483d-b868-cfb19078a644 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:27.324745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cf2c035-4d40-483d-b868-cfb19078a644 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:27.923307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3cf2c035-4d40-483d-b868-cfb19078a644 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:27.933748 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3cf2c035-4d40-483d-b868-cfb19078a644 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1313 microversion: 2.1 time: 0.646141 Oct 11 19:54:27.934404 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1475/2889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:27 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:27.946444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Building network info cache for instance {{(pid=126955) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 19:54:27.961198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3413bf0b-7bbf-485f-8222-d8d47e011b06 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:27.964213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3413bf0b-7bbf-485f-8222-d8d47e011b06 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:27.992986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3413bf0b-7bbf-485f-8222-d8d47e011b06 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:27.993900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3413bf0b-7bbf-485f-8222-d8d47e011b06 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:28.003876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3413bf0b-7bbf-485f-8222-d8d47e011b06 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:28.006804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3413bf0b-7bbf-485f-8222-d8d47e011b06 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:28.009000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3413bf0b-7bbf-485f-8222-d8d47e011b06 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:28.010706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3413bf0b-7bbf-485f-8222-d8d47e011b06 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:28.381484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3413bf0b-7bbf-485f-8222-d8d47e011b06 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:28.391522 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3413bf0b-7bbf-485f-8222-d8d47e011b06 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 200 len: 1362 microversion: 2.1 time: 0.455065 Oct 11 19:54:28.402971 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1476/2890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:27 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 1362 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:28.416912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9a3f7909-dae1-46a1-990f-2202c30e8906 req-9102b658-c887-4ea2-9961-418c3254f015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f1dc40-ef33-40f8-b128-d5c6367e833e", "name": "network-vif-plugged", "status": "completed", "tag": "7033f16c-8fb2-4050-810b-a6de0ea759f0"}, {"server_uuid": "0929e96c-9da0-4034-ae0e-38f7330002f5", "name": "network-vif-plugged", "status": "completed", "tag": "71f8f1b2-5864-4201-894f-6d7e1edc96c4"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:28.452354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9a3f7909-dae1-46a1-990f-2202c30e8906 req-9102b658-c887-4ea2-9961-418c3254f015 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:28.453905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9a3f7909-dae1-46a1-990f-2202c30e8906 req-9102b658-c887-4ea2-9961-418c3254f015 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:28.455253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9a3f7909-dae1-46a1-990f-2202c30e8906 req-9102b658-c887-4ea2-9961-418c3254f015 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:28.488006 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9a3f7909-dae1-46a1-990f-2202c30e8906 req-9102b658-c887-4ea2-9961-418c3254f015 service nova] Creating event network-vif-plugged:7033f16c-8fb2-4050-810b-a6de0ea759f0 for instance 85f1dc40-ef33-40f8-b128-d5c6367e833e on n-h1-860864-3 Oct 11 19:54:28.489112 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9a3f7909-dae1-46a1-990f-2202c30e8906 req-9102b658-c887-4ea2-9961-418c3254f015 service nova] Creating event network-vif-plugged:71f8f1b2-5864-4201-894f-6d7e1edc96c4 for instance 0929e96c-9da0-4034-ae0e-38f7330002f5 on n-h2-860864-3 Oct 11 19:54:28.511776 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9a3f7909-dae1-46a1-990f-2202c30e8906 req-9102b658-c887-4ea2-9961-418c3254f015 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104901 Oct 11 19:54:28.513812 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1477/2891] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:28.520696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9a92f7aa-83a3-4b84-bc38-35606597bb1f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:28.521812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9a92f7aa-83a3-4b84-bc38-35606597bb1f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:28.532244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a92f7aa-83a3-4b84-bc38-35606597bb1f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:28.532999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a92f7aa-83a3-4b84-bc38-35606597bb1f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:28.533593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a92f7aa-83a3-4b84-bc38-35606597bb1f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:28.534965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a92f7aa-83a3-4b84-bc38-35606597bb1f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:28.535717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a92f7aa-83a3-4b84-bc38-35606597bb1f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:28.536405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a92f7aa-83a3-4b84-bc38-35606597bb1f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:28.568635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:28.848754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9a92f7aa-83a3-4b84-bc38-35606597bb1f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:28.861370 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9a92f7aa-83a3-4b84-bc38-35606597bb1f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1363 microversion: 2.1 time: 0.345730 Oct 11 19:54:28.863013 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1478/2892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:28 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:28.874176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e4c6909-bc74-4069-9082-425af46198d9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:28.875395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e4c6909-bc74-4069-9082-425af46198d9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:28.903556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c6909-bc74-4069-9082-425af46198d9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:28.904365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c6909-bc74-4069-9082-425af46198d9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:28.904907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c6909-bc74-4069-9082-425af46198d9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:28.905713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c6909-bc74-4069-9082-425af46198d9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:28.906270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c6909-bc74-4069-9082-425af46198d9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:28.906830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c6909-bc74-4069-9082-425af46198d9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:29.108456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Updating instance_info_cache with network_info: [{"id": "f0945e06-d4cf-49ce-a31f-4ceba757cea1", "address": "fa:16:3e:fe:22:7a", "network": {"id": "1b725589-e176-46d6-a6c0-e64fce57877f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-67506322-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1054c39db17f47659b28044f47cf35fb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf0945e06-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126955) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:54:29.127672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Releasing lock "refresh_cache-f0583d05-1d47-4efb-a936-5e747c44c9c2" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:54:29.128708 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4b77a1b8-33f7-46a4-bdae-7edd7fe6999d tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "POST /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2/action" status: 202 len: 0 microversion: 2.1 time: 3.658991 Oct 11 19:54:29.129674 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1415/2893] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:25 2022] POST /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2/action => generated 0 bytes in 3660 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 19:54:29.142890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8e5001ab-57bd-43b2-ac3a-b9104f2dccb9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0783d30>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:29.176524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e4c6909-bc74-4069-9082-425af46198d9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:29.185677 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e4c6909-bc74-4069-9082-425af46198d9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1317 microversion: 2.1 time: 0.321256 Oct 11 19:54:29.186450 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1479/2894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:28 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:29.203862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5521fa66-dbf9-42f4-95e9-f5348e945425 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:29.205848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5521fa66-dbf9-42f4-95e9-f5348e945425 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:29.214302 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8e5001ab-57bd-43b2-ac3a-b9104f2dccb9 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 200 len: 1454 microversion: 2.1 time: 0.082850 Oct 11 19:54:29.215532 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1416/2895] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:29 2022] GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:29.226403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5521fa66-dbf9-42f4-95e9-f5348e945425 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:29.231044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5521fa66-dbf9-42f4-95e9-f5348e945425 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:29.231546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5521fa66-dbf9-42f4-95e9-f5348e945425 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:29.232281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5521fa66-dbf9-42f4-95e9-f5348e945425 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:29.232529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b78e1681-700e-43e5-93c1-102c67fa15f0 req-56a363e1-dbb3-4c4e-882e-9c893e514709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0583d05-1d47-4efb-a936-5e747c44c9c2", "tag": "f0945e06-d4cf-49ce-a31f-4ceba757cea1"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:29.232744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5521fa66-dbf9-42f4-95e9-f5348e945425 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:29.233171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5521fa66-dbf9-42f4-95e9-f5348e945425 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:29.250691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b78e1681-700e-43e5-93c1-102c67fa15f0 req-56a363e1-dbb3-4c4e-882e-9c893e514709 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:29.252064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b78e1681-700e-43e5-93c1-102c67fa15f0 req-56a363e1-dbb3-4c4e-882e-9c893e514709 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:29.252854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b78e1681-700e-43e5-93c1-102c67fa15f0 req-56a363e1-dbb3-4c4e-882e-9c893e514709 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:29.268521 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b78e1681-700e-43e5-93c1-102c67fa15f0 req-56a363e1-dbb3-4c4e-882e-9c893e514709 service nova] Creating event network-changed:f0945e06-d4cf-49ce-a31f-4ceba757cea1 for instance f0583d05-1d47-4efb-a936-5e747c44c9c2 on n-h1-860864-3 Oct 11 19:54:29.275076 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b78e1681-700e-43e5-93c1-102c67fa15f0 req-56a363e1-dbb3-4c4e-882e-9c893e514709 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058112 Oct 11 19:54:29.292072 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1417/2896] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:29.297855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1f1f90fe-2bad-4235-a17c-35d6d46c75d5 req-f3348b4e-0717-4abb-b2c3-b7033fa3cc08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985ba888-5655-480f-8d6b-f39d4a4065fa", "tag": "7c7804ab-9b0e-4b95-8522-a13a6bca1b13"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:29.333786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1f1f90fe-2bad-4235-a17c-35d6d46c75d5 req-f3348b4e-0717-4abb-b2c3-b7033fa3cc08 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:29.338953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1f1f90fe-2bad-4235-a17c-35d6d46c75d5 req-f3348b4e-0717-4abb-b2c3-b7033fa3cc08 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:29.339536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1f1f90fe-2bad-4235-a17c-35d6d46c75d5 req-f3348b4e-0717-4abb-b2c3-b7033fa3cc08 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:29.356172 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1f1f90fe-2bad-4235-a17c-35d6d46c75d5 req-f3348b4e-0717-4abb-b2c3-b7033fa3cc08 service nova] Creating event network-changed:7c7804ab-9b0e-4b95-8522-a13a6bca1b13 for instance 985ba888-5655-480f-8d6b-f39d4a4065fa on n-h2-860864-3 Oct 11 19:54:29.375249 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1f1f90fe-2bad-4235-a17c-35d6d46c75d5 req-f3348b4e-0717-4abb-b2c3-b7033fa3cc08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081342 Oct 11 19:54:29.376748 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1418/2897] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:29.386197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-116771cd-2cd6-418d-982f-22338eddd72f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:29.387660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-116771cd-2cd6-418d-982f-22338eddd72f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:29.395528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116771cd-2cd6-418d-982f-22338eddd72f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:29.396558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116771cd-2cd6-418d-982f-22338eddd72f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:29.397001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116771cd-2cd6-418d-982f-22338eddd72f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:29.398509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116771cd-2cd6-418d-982f-22338eddd72f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:29.399236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116771cd-2cd6-418d-982f-22338eddd72f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:29.399923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116771cd-2cd6-418d-982f-22338eddd72f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:29.514479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5521fa66-dbf9-42f4-95e9-f5348e945425 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:29.527626 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5521fa66-dbf9-42f4-95e9-f5348e945425 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1518 microversion: 2.1 time: 0.340006 Oct 11 19:54:29.543343 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1480/2898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:29 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1518 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:29.544187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99b3bb4d-bb46-42aa-97b8-2ff241c16702 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:29.550172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-99b3bb4d-bb46-42aa-97b8-2ff241c16702 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:29.553000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b3bb4d-bb46-42aa-97b8-2ff241c16702 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:29.553180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b3bb4d-bb46-42aa-97b8-2ff241c16702 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:29.553629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b3bb4d-bb46-42aa-97b8-2ff241c16702 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:29.554993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b3bb4d-bb46-42aa-97b8-2ff241c16702 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:29.555447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b3bb4d-bb46-42aa-97b8-2ff241c16702 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:29.555943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b3bb4d-bb46-42aa-97b8-2ff241c16702 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:29.693982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-116771cd-2cd6-418d-982f-22338eddd72f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:29.705411 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-116771cd-2cd6-418d-982f-22338eddd72f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.326821 Oct 11 19:54:29.706639 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1419/2899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:29 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:29.712635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2087d32b-2a7e-4db9-9d72-a51dd7d6503f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '.version_select at 0x7f83d06d0b80>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:29.794374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-99b3bb4d-bb46-42aa-97b8-2ff241c16702 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:29.805607 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99b3bb4d-bb46-42aa-97b8-2ff241c16702 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1313 microversion: 2.1 time: 0.271621 Oct 11 19:54:29.806382 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1481/2900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:29 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:29.811610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-421f3439-e94d-437a-ac55-7341487c5ab3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:29.812220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-421f3439-e94d-437a-ac55-7341487c5ab3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:29.818721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-421f3439-e94d-437a-ac55-7341487c5ab3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:29.819223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-421f3439-e94d-437a-ac55-7341487c5ab3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:29.819723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-421f3439-e94d-437a-ac55-7341487c5ab3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:29.820882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-421f3439-e94d-437a-ac55-7341487c5ab3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:29.821349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-421f3439-e94d-437a-ac55-7341487c5ab3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:29.823023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-421f3439-e94d-437a-ac55-7341487c5ab3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:30.166997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-421f3439-e94d-437a-ac55-7341487c5ab3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:30.178360 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-421f3439-e94d-437a-ac55-7341487c5ab3 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 200 len: 1362 microversion: 2.1 time: 0.371094 Oct 11 19:54:30.181099 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1482/2901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:29 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:30.216621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1fe6196c-5d79-4383-876f-310b37021e35 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Action: 'create', calling method: .version_select at 0x7f83d07a3310>, body: {"pool": null} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:31.515555 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2087d32b-2a7e-4db9-9d72-a51dd7d6503f tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/a569930b-b7e6-4e8d-8686-cb2313fcb5da" status: 202 len: 0 microversion: 2.1 time: 1.807591 Oct 11 19:54:31.516480 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1420/2902] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:54:29 2022] DELETE /compute/v2.1/os-floating-ips/a569930b-b7e6-4e8d-8686-cb2313fcb5da => generated 0 bytes in 1809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:54:31.523278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-525aa2fc-0f94-4132-b767-7e2f510e2e0d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:31.523956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-525aa2fc-0f94-4132-b767-7e2f510e2e0d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:31.532252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-525aa2fc-0f94-4132-b767-7e2f510e2e0d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:31.533027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-525aa2fc-0f94-4132-b767-7e2f510e2e0d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:31.533475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-525aa2fc-0f94-4132-b767-7e2f510e2e0d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:31.534188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-525aa2fc-0f94-4132-b767-7e2f510e2e0d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:31.534882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-525aa2fc-0f94-4132-b767-7e2f510e2e0d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:31.535544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-525aa2fc-0f94-4132-b767-7e2f510e2e0d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:31.540215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:31.793252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-525aa2fc-0f94-4132-b767-7e2f510e2e0d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:31.806050 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-525aa2fc-0f94-4132-b767-7e2f510e2e0d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1363 microversion: 2.1 time: 0.287275 Oct 11 19:54:31.806550 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1421/2903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:31 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:31.814435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1e77fd9c-6001-46e5-bcb8-2a917094e196 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:31.815671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1e77fd9c-6001-46e5-bcb8-2a917094e196 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:31.826392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e77fd9c-6001-46e5-bcb8-2a917094e196 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:31.827277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e77fd9c-6001-46e5-bcb8-2a917094e196 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:31.828251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e77fd9c-6001-46e5-bcb8-2a917094e196 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:31.829469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e77fd9c-6001-46e5-bcb8-2a917094e196 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:31.830277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e77fd9c-6001-46e5-bcb8-2a917094e196 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:31.831043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e77fd9c-6001-46e5-bcb8-2a917094e196 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:32.090072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e77fd9c-6001-46e5-bcb8-2a917094e196 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:32.100098 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1e77fd9c-6001-46e5-bcb8-2a917094e196 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.292087 Oct 11 19:54:32.124430 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1422/2904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:31 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:32.134622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-028e1ea2-eb19-4dba-a5e7-d143d388938a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c74c6af0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:32.202510 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-028e1ea2-eb19-4dba-a5e7-d143d388938a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 200 len: 1454 microversion: 2.1 time: 0.076631 Oct 11 19:54:32.203557 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1423/2905] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:32 2022] GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:32.208246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-27d71213-7b2b-49ef-8b1d-72ef108f09ec req-dafa218c-de4f-4d0e-9440-4b79eeb95ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9aeb85-447c-419f-9b63-c85927a11e8c", "name": "network-vif-plugged", "status": "completed", "tag": "11e3d19e-74f2-4036-9c86-305e9f486564"}, {"server_uuid": "b7ee4391-e163-4a76-9151-04adeb0111a8", "name": "network-vif-plugged", "status": "completed", "tag": "8feec027-3d8b-4b4e-9712-8f57ab9fb853"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:32.221906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-27d71213-7b2b-49ef-8b1d-72ef108f09ec req-dafa218c-de4f-4d0e-9440-4b79eeb95ac6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:32.222394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-27d71213-7b2b-49ef-8b1d-72ef108f09ec req-dafa218c-de4f-4d0e-9440-4b79eeb95ac6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:32.222874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-27d71213-7b2b-49ef-8b1d-72ef108f09ec req-dafa218c-de4f-4d0e-9440-4b79eeb95ac6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:32.237328 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-27d71213-7b2b-49ef-8b1d-72ef108f09ec req-dafa218c-de4f-4d0e-9440-4b79eeb95ac6 service nova] Creating event network-vif-plugged:11e3d19e-74f2-4036-9c86-305e9f486564 for instance 7b9aeb85-447c-419f-9b63-c85927a11e8c on n-h1-860864-3 Oct 11 19:54:32.237855 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-27d71213-7b2b-49ef-8b1d-72ef108f09ec req-dafa218c-de4f-4d0e-9440-4b79eeb95ac6 service nova] Creating event network-vif-plugged:8feec027-3d8b-4b4e-9712-8f57ab9fb853 for instance b7ee4391-e163-4a76-9151-04adeb0111a8 on n-h1-860864-3 Oct 11 19:54:32.245515 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-27d71213-7b2b-49ef-8b1d-72ef108f09ec req-dafa218c-de4f-4d0e-9440-4b79eeb95ac6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040644 Oct 11 19:54:32.246379 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1424/2906] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:32.252730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cd9d0d9a-cbf3-4b26-aee8-e21a698fd681 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:32.253615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cd9d0d9a-cbf3-4b26-aee8-e21a698fd681 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:32.262762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd9d0d9a-cbf3-4b26-aee8-e21a698fd681 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:32.263260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd9d0d9a-cbf3-4b26-aee8-e21a698fd681 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:32.263721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd9d0d9a-cbf3-4b26-aee8-e21a698fd681 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:32.264421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd9d0d9a-cbf3-4b26-aee8-e21a698fd681 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:32.264882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd9d0d9a-cbf3-4b26-aee8-e21a698fd681 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:32.275790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd9d0d9a-cbf3-4b26-aee8-e21a698fd681 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:32.359414 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1fe6196c-5d79-4383-876f-310b37021e35 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.162226 Oct 11 19:54:32.360655 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1483/2907] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:54:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:32.392799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9002943-fcc0-4b9a-9aea-d1916a4a9d10 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:32.396016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d9002943-fcc0-4b9a-9aea-d1916a4a9d10 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:32.417278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9002943-fcc0-4b9a-9aea-d1916a4a9d10 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:32.418208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9002943-fcc0-4b9a-9aea-d1916a4a9d10 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:32.419930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9002943-fcc0-4b9a-9aea-d1916a4a9d10 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:32.423224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9002943-fcc0-4b9a-9aea-d1916a4a9d10 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:32.425229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9002943-fcc0-4b9a-9aea-d1916a4a9d10 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:32.425664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9002943-fcc0-4b9a-9aea-d1916a4a9d10 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:32.548499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cd9d0d9a-cbf3-4b26-aee8-e21a698fd681 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:32.561370 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cd9d0d9a-cbf3-4b26-aee8-e21a698fd681 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.313444 Oct 11 19:54:32.562337 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1425/2908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:32 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:32.567278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4263ba97-cf23-483e-838a-9941b86526a6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:32.568108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4263ba97-cf23-483e-838a-9941b86526a6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:32.575538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4263ba97-cf23-483e-838a-9941b86526a6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:32.576310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4263ba97-cf23-483e-838a-9941b86526a6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:32.576899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4263ba97-cf23-483e-838a-9941b86526a6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:32.577753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4263ba97-cf23-483e-838a-9941b86526a6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:32.578393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4263ba97-cf23-483e-838a-9941b86526a6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:32.579138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4263ba97-cf23-483e-838a-9941b86526a6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:32.647362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d9002943-fcc0-4b9a-9aea-d1916a4a9d10 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:32.657403 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9002943-fcc0-4b9a-9aea-d1916a4a9d10 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1313 microversion: 2.1 time: 0.278250 Oct 11 19:54:32.659026 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1484/2909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:32 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:32.664010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4f95c9a9-6b80-4bb3-ba1c-0dac8ba2b1e3 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '.version_select at 0x7f83d07fb820>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:32.859208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4263ba97-cf23-483e-838a-9941b86526a6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:32.870127 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4263ba97-cf23-483e-838a-9941b86526a6 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 200 len: 1362 microversion: 2.1 time: 0.306494 Oct 11 19:54:32.871198 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1426/2910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:32 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:32.878975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1219964347", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:32.946920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] validate_networks() for [('94a98399-e5d5-46d5-b3fe-da4714c7413b', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:54:33.062722 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4f95c9a9-6b80-4bb3-ba1c-0dac8ba2b1e3 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b1dd93bd-2314-453a-8c2d-6f47e83fadd2" status: 202 len: 0 microversion: 2.1 time: 0.402438 Oct 11 19:54:33.069299 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1485/2911] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:54:32 2022] DELETE /compute/v2.1/os-security-groups/b1dd93bd-2314-453a-8c2d-6f47e83fadd2 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:54:33.076822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1077851776", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "7a6ff9a3-562e-460e-852c-3de4b0a9fb24"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:33.186516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] validate_networks() for [('7a6ff9a3-562e-460e-852c-3de4b0a9fb24', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:54:33.279450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:33.305285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=28 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:33.589999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:54:33.591223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:54:33.591941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:54:33.592577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:54:33.593206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:54:33.608825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:33.609678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:33.610463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:33.611446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:33.612143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:33.612894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:33.634436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Getting quotas for project bef5612f57424051949f9a1d3e085611. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:54:33.641458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Getting quotas for user 3f978f677e3e463c9599ed524cc33e34 and project bef5612f57424051949f9a1d3e085611. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:54:33.654365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:33.656297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:54:33.659194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:54:33.724721 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-48c80833-95d2-4c62-a9c6-709fa9e714b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852156 Oct 11 19:54:33.726255 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1427/2912] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:54:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:54:33.732915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21dab4bb-3344-4727-977d-574ee6bd5e9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:33.733879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-21dab4bb-3344-4727-977d-574ee6bd5e9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:33.744334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21dab4bb-3344-4727-977d-574ee6bd5e9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:33.745355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21dab4bb-3344-4727-977d-574ee6bd5e9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:33.746032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21dab4bb-3344-4727-977d-574ee6bd5e9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:33.747054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21dab4bb-3344-4727-977d-574ee6bd5e9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:33.747903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21dab4bb-3344-4727-977d-574ee6bd5e9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:33.748545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21dab4bb-3344-4727-977d-574ee6bd5e9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:33.841977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:54:33.842499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:54:33.843131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:54:33.843646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:54:33.844196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:54:33.862336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:33.862974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:33.864497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:33.864497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:33.865031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:33.865698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:33.895283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Getting quotas for project 76591022a59449b7b24a2de96cba0fa0. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:54:33.901785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Getting quotas for user 87ead5931eec4b68a40cd635295de387 and project 76591022a59449b7b24a2de96cba0fa0. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:54:33.916500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:54:33.919329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:54:33.924198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-21dab4bb-3344-4727-977d-574ee6bd5e9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:33.934041 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21dab4bb-3344-4727-977d-574ee6bd5e9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1363 microversion: 2.1 time: 0.206458 Oct 11 19:54:33.954649 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1428/2913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:33 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:33.954649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-26d3dbda-3ce4-4fc5-8ecc-628bbf4272e6 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:33.954649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-26d3dbda-3ce4-4fc5-8ecc-628bbf4272e6 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:33.961684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26d3dbda-3ce4-4fc5-8ecc-628bbf4272e6 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:33.961684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26d3dbda-3ce4-4fc5-8ecc-628bbf4272e6 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:33.961684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26d3dbda-3ce4-4fc5-8ecc-628bbf4272e6 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:33.962572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26d3dbda-3ce4-4fc5-8ecc-628bbf4272e6 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:33.964516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26d3dbda-3ce4-4fc5-8ecc-628bbf4272e6 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:33.964516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26d3dbda-3ce4-4fc5-8ecc-628bbf4272e6 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:33.995486 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b30c16db-a38b-4423-a819-229031dc2564 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922524 Oct 11 19:54:34.005090 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1486/2914] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:54:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:54:34.005090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ded38b1f-81eb-4986-acd6-ed9db6b4e2fe tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0768550>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:34.022200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-26d3dbda-3ce4-4fc5-8ecc-628bbf4272e6 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:54:34.081516 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ded38b1f-81eb-4986-acd6-ed9db6b4e2fe tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 200 len: 1454 microversion: 2.1 time: 0.080892 Oct 11 19:54:34.082315 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1487/2915] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:33 2022] GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:34.103990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8c69a82f-e46e-4067-8415-87bf317636fb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:34.104604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8c69a82f-e46e-4067-8415-87bf317636fb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:34.125758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c69a82f-e46e-4067-8415-87bf317636fb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:34.126263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c69a82f-e46e-4067-8415-87bf317636fb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:34.127967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c69a82f-e46e-4067-8415-87bf317636fb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:34.128686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c69a82f-e46e-4067-8415-87bf317636fb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:34.129142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c69a82f-e46e-4067-8415-87bf317636fb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:34.129610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c69a82f-e46e-4067-8415-87bf317636fb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:34.189520 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-26d3dbda-3ce4-4fc5-8ecc-628bbf4272e6 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 204 len: 0 microversion: 2.1 time: 0.246044 Oct 11 19:54:34.195863 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1429/2916] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:54:33 2022] DELETE /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:54:34.203689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-57b5dd47-cdc9-4055-bdf4-4e73ac89a735 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:34.204989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-57b5dd47-cdc9-4055-bdf4-4e73ac89a735 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:34.215633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57b5dd47-cdc9-4055-bdf4-4e73ac89a735 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:34.218303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57b5dd47-cdc9-4055-bdf4-4e73ac89a735 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:34.219307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57b5dd47-cdc9-4055-bdf4-4e73ac89a735 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:34.220365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57b5dd47-cdc9-4055-bdf4-4e73ac89a735 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:34.221050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57b5dd47-cdc9-4055-bdf4-4e73ac89a735 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:34.221699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57b5dd47-cdc9-4055-bdf4-4e73ac89a735 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:34.546755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c69a82f-e46e-4067-8415-87bf317636fb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:34.548658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-57b5dd47-cdc9-4055-bdf4-4e73ac89a735 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:34.557913 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-57b5dd47-cdc9-4055-bdf4-4e73ac89a735 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1313 microversion: 2.1 time: 0.358846 Oct 11 19:54:34.558510 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1430/2917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:34 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:34.558751 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8c69a82f-e46e-4067-8415-87bf317636fb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.462082 Oct 11 19:54:34.563059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e32cdeb3-3ad3-41a5-b835-5aff5ed98f9f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:34.563680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e32cdeb3-3ad3-41a5-b835-5aff5ed98f9f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:34.568969 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1488/2918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:34 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:34.574175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e32cdeb3-3ad3-41a5-b835-5aff5ed98f9f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:34.577717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e32cdeb3-3ad3-41a5-b835-5aff5ed98f9f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:34.578224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e32cdeb3-3ad3-41a5-b835-5aff5ed98f9f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:34.579018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e32cdeb3-3ad3-41a5-b835-5aff5ed98f9f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:34.580596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e32cdeb3-3ad3-41a5-b835-5aff5ed98f9f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:34.580805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f2634f0a-c6a3-4bc0-b7e8-86566d9cbf29 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:34.581294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e32cdeb3-3ad3-41a5-b835-5aff5ed98f9f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:34.586190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f2634f0a-c6a3-4bc0-b7e8-86566d9cbf29 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:34.595618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2634f0a-c6a3-4bc0-b7e8-86566d9cbf29 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:34.598774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2634f0a-c6a3-4bc0-b7e8-86566d9cbf29 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:34.599368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2634f0a-c6a3-4bc0-b7e8-86566d9cbf29 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:34.601679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2634f0a-c6a3-4bc0-b7e8-86566d9cbf29 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:34.602320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2634f0a-c6a3-4bc0-b7e8-86566d9cbf29 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:34.608032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2634f0a-c6a3-4bc0-b7e8-86566d9cbf29 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:34.680396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e32cdeb3-3ad3-41a5-b835-5aff5ed98f9f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:34.698110 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e32cdeb3-3ad3-41a5-b835-5aff5ed98f9f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1221 microversion: 2.1 time: 0.138477 Oct 11 19:54:34.699001 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1431/2919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:34 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:34.713310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d07154f2-1e2b-476e-b777-1516e7d54f11 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:34.715276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d07154f2-1e2b-476e-b777-1516e7d54f11 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:34.848737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d07154f2-1e2b-476e-b777-1516e7d54f11 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:34.858907 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d07154f2-1e2b-476e-b777-1516e7d54f11 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 200 len: 1224 microversion: 2.1 time: 0.157817 Oct 11 19:54:34.859726 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1432/2920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:34 2022] GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 1224 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:34.875739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-52585cfb-3b49-4f89-824b-5788c9adf0a0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:34.877786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-52585cfb-3b49-4f89-824b-5788c9adf0a0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:34.903811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52585cfb-3b49-4f89-824b-5788c9adf0a0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:34.904340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52585cfb-3b49-4f89-824b-5788c9adf0a0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:34.904843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52585cfb-3b49-4f89-824b-5788c9adf0a0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:34.907531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52585cfb-3b49-4f89-824b-5788c9adf0a0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:34.908247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52585cfb-3b49-4f89-824b-5788c9adf0a0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:34.908746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52585cfb-3b49-4f89-824b-5788c9adf0a0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:35.284332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f2634f0a-c6a3-4bc0-b7e8-86566d9cbf29 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:35.294330 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f2634f0a-c6a3-4bc0-b7e8-86566d9cbf29 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 200 len: 1362 microversion: 2.1 time: 0.722304 Oct 11 19:54:35.310628 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1489/2921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:34 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 1362 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:35.315760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6ba65902-39bf-467f-bd54-97d7f5edb7a5 req-09f2c1db-4b97-4f6d-b3e8-e72c7d343874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985ba888-5655-480f-8d6b-f39d4a4065fa", "name": "network-vif-plugged", "status": "completed", "tag": "7c7804ab-9b0e-4b95-8522-a13a6bca1b13"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:35.325987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ba65902-39bf-467f-bd54-97d7f5edb7a5 req-09f2c1db-4b97-4f6d-b3e8-e72c7d343874 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:35.326764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ba65902-39bf-467f-bd54-97d7f5edb7a5 req-09f2c1db-4b97-4f6d-b3e8-e72c7d343874 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:35.327347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ba65902-39bf-467f-bd54-97d7f5edb7a5 req-09f2c1db-4b97-4f6d-b3e8-e72c7d343874 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:35.340993 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6ba65902-39bf-467f-bd54-97d7f5edb7a5 req-09f2c1db-4b97-4f6d-b3e8-e72c7d343874 service nova] Creating event network-vif-plugged:7c7804ab-9b0e-4b95-8522-a13a6bca1b13 for instance 985ba888-5655-480f-8d6b-f39d4a4065fa on n-h2-860864-3 Oct 11 19:54:35.346506 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6ba65902-39bf-467f-bd54-97d7f5edb7a5 req-09f2c1db-4b97-4f6d-b3e8-e72c7d343874 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034107 Oct 11 19:54:35.347334 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1490/2922] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:35.353983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cc22685c-7c47-4fcc-b659-471e2ac1a81b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:35.354897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cc22685c-7c47-4fcc-b659-471e2ac1a81b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:35.361267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc22685c-7c47-4fcc-b659-471e2ac1a81b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:35.361977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc22685c-7c47-4fcc-b659-471e2ac1a81b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:35.362587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc22685c-7c47-4fcc-b659-471e2ac1a81b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:35.363432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc22685c-7c47-4fcc-b659-471e2ac1a81b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:35.364035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc22685c-7c47-4fcc-b659-471e2ac1a81b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:35.364631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc22685c-7c47-4fcc-b659-471e2ac1a81b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:35.432972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-52585cfb-3b49-4f89-824b-5788c9adf0a0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:35.443844 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-52585cfb-3b49-4f89-824b-5788c9adf0a0 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1508 microversion: 2.1 time: 0.580175 Oct 11 19:54:35.459054 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1433/2923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:34 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1508 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:35.468258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-018c7c98-b146-4c5f-bcb3-b62eb144c0f6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d07f6f70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:35.530110 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-018c7c98-b146-4c5f-bcb3-b62eb144c0f6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 200 len: 1454 microversion: 2.1 time: 0.068208 Oct 11 19:54:35.530993 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1434/2924] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:35 2022] GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:35.546285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cc22685c-7c47-4fcc-b659-471e2ac1a81b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:35.559540 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cc22685c-7c47-4fcc-b659-471e2ac1a81b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1550 microversion: 2.1 time: 0.210842 Oct 11 19:54:35.560774 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1491/2925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:35 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1550 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:35.585566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f2abd9d-c463-4b03-9b07-6ddd026a865b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:35.589537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f2abd9d-c463-4b03-9b07-6ddd026a865b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:35.592519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4ad93165-e8b5-496a-bc3a-1a6b26cb1953 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:35.595206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4ad93165-e8b5-496a-bc3a-1a6b26cb1953 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:35.602675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f2abd9d-c463-4b03-9b07-6ddd026a865b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:35.603728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f2abd9d-c463-4b03-9b07-6ddd026a865b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:35.604393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f2abd9d-c463-4b03-9b07-6ddd026a865b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:35.605413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f2abd9d-c463-4b03-9b07-6ddd026a865b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:35.606143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f2abd9d-c463-4b03-9b07-6ddd026a865b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:35.607043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f2abd9d-c463-4b03-9b07-6ddd026a865b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:35.613757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ad93165-e8b5-496a-bc3a-1a6b26cb1953 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:35.614278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ad93165-e8b5-496a-bc3a-1a6b26cb1953 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:35.614761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ad93165-e8b5-496a-bc3a-1a6b26cb1953 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:35.615478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ad93165-e8b5-496a-bc3a-1a6b26cb1953 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:35.620192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ad93165-e8b5-496a-bc3a-1a6b26cb1953 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:35.620931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ad93165-e8b5-496a-bc3a-1a6b26cb1953 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:35.822801 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4ad93165-e8b5-496a-bc3a-1a6b26cb1953 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238882 Oct 11 19:54:35.823640 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1492/2926] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:54:35 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:35.828655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e4cfae6f-8c8c-4d7b-aade-d0e38e7276c4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:35.829751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e4cfae6f-8c8c-4d7b-aade-d0e38e7276c4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:35.840705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4cfae6f-8c8c-4d7b-aade-d0e38e7276c4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:35.841466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4cfae6f-8c8c-4d7b-aade-d0e38e7276c4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:35.842121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4cfae6f-8c8c-4d7b-aade-d0e38e7276c4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:35.842977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4cfae6f-8c8c-4d7b-aade-d0e38e7276c4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:35.843938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4cfae6f-8c8c-4d7b-aade-d0e38e7276c4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:35.844479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4cfae6f-8c8c-4d7b-aade-d0e38e7276c4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:36.078421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2f2abd9d-c463-4b03-9b07-6ddd026a865b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:36.089111 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f2abd9d-c463-4b03-9b07-6ddd026a865b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1313 microversion: 2.1 time: 0.509530 Oct 11 19:54:36.089731 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1435/2927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:35 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:54:36.119480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a9b68628-d2e0-45d2-bc65-be5d1bc33a5c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:36.120880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a9b68628-d2e0-45d2-bc65-be5d1bc33a5c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:36.135593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9b68628-d2e0-45d2-bc65-be5d1bc33a5c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:36.136092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9b68628-d2e0-45d2-bc65-be5d1bc33a5c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:36.136555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9b68628-d2e0-45d2-bc65-be5d1bc33a5c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:36.137317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9b68628-d2e0-45d2-bc65-be5d1bc33a5c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:36.140898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9b68628-d2e0-45d2-bc65-be5d1bc33a5c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:36.141347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9b68628-d2e0-45d2-bc65-be5d1bc33a5c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:36.316708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a9b68628-d2e0-45d2-bc65-be5d1bc33a5c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:36.331319 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a9b68628-d2e0-45d2-bc65-be5d1bc33a5c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1287 microversion: 2.1 time: 0.218662 Oct 11 19:54:36.331669 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1436/2928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:36 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1287 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:36.343980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ecb281ba-3a92-444c-883f-656c040c348d tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:36.344940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ecb281ba-3a92-444c-883f-656c040c348d tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:36.363124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecb281ba-3a92-444c-883f-656c040c348d tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:36.363878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecb281ba-3a92-444c-883f-656c040c348d tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:36.364556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecb281ba-3a92-444c-883f-656c040c348d tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:36.366690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecb281ba-3a92-444c-883f-656c040c348d tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:36.367334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecb281ba-3a92-444c-883f-656c040c348d tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:36.368587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecb281ba-3a92-444c-883f-656c040c348d tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:36.407714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e4cfae6f-8c8c-4d7b-aade-d0e38e7276c4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:36.417163 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e4cfae6f-8c8c-4d7b-aade-d0e38e7276c4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.592226 Oct 11 19:54:36.417748 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1493/2929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:35 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:36.435071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1ea6c4b-5938-4290-870a-740f24609f14 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:36.435952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1ea6c4b-5938-4290-870a-740f24609f14 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:36.442313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1ea6c4b-5938-4290-870a-740f24609f14 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:36.455348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1ea6c4b-5938-4290-870a-740f24609f14 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:36.456163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1ea6c4b-5938-4290-870a-740f24609f14 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:36.457137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1ea6c4b-5938-4290-870a-740f24609f14 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:36.457668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1ea6c4b-5938-4290-870a-740f24609f14 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:36.458119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1ea6c4b-5938-4290-870a-740f24609f14 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:36.493739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ecb281ba-3a92-444c-883f-656c040c348d tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:36.503165 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ecb281ba-3a92-444c-883f-656c040c348d tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 200 len: 1276 microversion: 2.1 time: 0.162881 Oct 11 19:54:36.511540 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1437/2930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:36 2022] GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:36.516532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d7fd591d-0498-49ae-887c-8fd051deadfa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:36.517140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d7fd591d-0498-49ae-887c-8fd051deadfa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:36.548882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7fd591d-0498-49ae-887c-8fd051deadfa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:36.549636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7fd591d-0498-49ae-887c-8fd051deadfa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:36.550288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7fd591d-0498-49ae-887c-8fd051deadfa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:36.551203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7fd591d-0498-49ae-887c-8fd051deadfa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:36.552143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7fd591d-0498-49ae-887c-8fd051deadfa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:36.552744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7fd591d-0498-49ae-887c-8fd051deadfa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:36.931143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f1ea6c4b-5938-4290-870a-740f24609f14 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:36.940678 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1ea6c4b-5938-4290-870a-740f24609f14 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 200 len: 1362 microversion: 2.1 time: 0.521826 Oct 11 19:54:36.941535 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1494/2931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:36 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 1362 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:36.946379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-46c0995c-0705-4911-a965-07108b15fadc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cddd0820>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:36.989630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d7fd591d-0498-49ae-887c-8fd051deadfa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:37.001104 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d7fd591d-0498-49ae-887c-8fd051deadfa tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1508 microversion: 2.1 time: 0.488256 Oct 11 19:54:37.001922 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1438/2932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:36 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:37.016742 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-46c0995c-0705-4911-a965-07108b15fadc tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 200 len: 1463 microversion: 2.1 time: 0.073908 Oct 11 19:54:37.017691 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1495/2933] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:36 2022] GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 1463 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:37.035648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ad967a91-0580-4f8a-8f95-fcf6ace132df tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d06d0e50>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:37.091383 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ad967a91-0580-4f8a-8f95-fcf6ace132df tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 200 len: 1463 microversion: 2.1 time: 0.059503 Oct 11 19:54:37.092318 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1439/2934] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:37 2022] GET /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 1463 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:37.106778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8e355479-c506-4928-8d24-067aef546689 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:37.107393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8e355479-c506-4928-8d24-067aef546689 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:37.118324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e355479-c506-4928-8d24-067aef546689 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:37.121445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1d3d9a71-e47b-471e-8073-44979931f9b6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:37.122515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1d3d9a71-e47b-471e-8073-44979931f9b6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:37.123271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e355479-c506-4928-8d24-067aef546689 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:37.123743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e355479-c506-4928-8d24-067aef546689 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:37.124481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e355479-c506-4928-8d24-067aef546689 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:37.128173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e355479-c506-4928-8d24-067aef546689 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:37.130906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e355479-c506-4928-8d24-067aef546689 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:37.145618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d3d9a71-e47b-471e-8073-44979931f9b6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:37.146124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d3d9a71-e47b-471e-8073-44979931f9b6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:37.146606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d3d9a71-e47b-471e-8073-44979931f9b6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:37.153685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d3d9a71-e47b-471e-8073-44979931f9b6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:37.155651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d3d9a71-e47b-471e-8073-44979931f9b6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:37.156115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d3d9a71-e47b-471e-8073-44979931f9b6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:37.997966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e355479-c506-4928-8d24-067aef546689 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:38.006297 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8e355479-c506-4928-8d24-067aef546689 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 200 len: 1481 microversion: 2.1 time: 0.904085 Oct 11 19:54:38.007663 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1496/2935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:37 2022] GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 1481 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:38.015634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1d3d9a71-e47b-471e-8073-44979931f9b6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:38.029062 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1d3d9a71-e47b-471e-8073-44979931f9b6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1463 microversion: 2.1 time: 0.914028 Oct 11 19:54:38.029321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7fb41c6d-9f3b-47cc-a812-d9fe13168a4e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:38.029994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7fb41c6d-9f3b-47cc-a812-d9fe13168a4e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:38.030899 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1440/2936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:37 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1463 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:38.036496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb41c6d-9f3b-47cc-a812-d9fe13168a4e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:38.037076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb41c6d-9f3b-47cc-a812-d9fe13168a4e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:38.037327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7baf4fec-b77b-4690-8cb3-0e16d568e50b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:38.037649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb41c6d-9f3b-47cc-a812-d9fe13168a4e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:38.037971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7baf4fec-b77b-4690-8cb3-0e16d568e50b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:38.039064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb41c6d-9f3b-47cc-a812-d9fe13168a4e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:38.039683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb41c6d-9f3b-47cc-a812-d9fe13168a4e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:38.040319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fb41c6d-9f3b-47cc-a812-d9fe13168a4e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:38.046710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7baf4fec-b77b-4690-8cb3-0e16d568e50b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:38.047209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7baf4fec-b77b-4690-8cb3-0e16d568e50b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:38.047648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7baf4fec-b77b-4690-8cb3-0e16d568e50b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:38.048353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7baf4fec-b77b-4690-8cb3-0e16d568e50b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:38.048942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7baf4fec-b77b-4690-8cb3-0e16d568e50b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:38.049377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7baf4fec-b77b-4690-8cb3-0e16d568e50b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:38.080434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:38.512105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7baf4fec-b77b-4690-8cb3-0e16d568e50b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:38.523640 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7baf4fec-b77b-4690-8cb3-0e16d568e50b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.491149 Oct 11 19:54:38.539449 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1441/2937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:38 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:38.547457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff3f070b-3894-4399-ae82-691eba56aa89 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:38.548082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ff3f070b-3894-4399-ae82-691eba56aa89 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:38.554640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff3f070b-3894-4399-ae82-691eba56aa89 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:38.555390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff3f070b-3894-4399-ae82-691eba56aa89 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:38.556005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff3f070b-3894-4399-ae82-691eba56aa89 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:38.556893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff3f070b-3894-4399-ae82-691eba56aa89 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:38.557515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff3f070b-3894-4399-ae82-691eba56aa89 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:38.558105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff3f070b-3894-4399-ae82-691eba56aa89 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:38.695950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7fb41c6d-9f3b-47cc-a812-d9fe13168a4e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:38.714388 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7fb41c6d-9f3b-47cc-a812-d9fe13168a4e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1317 microversion: 2.1 time: 0.694351 Oct 11 19:54:38.715431 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1497/2938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:38 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1317 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:38.736232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f056ece6-fb6a-4fc5-9731-88e1bb411053 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:38.737286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f056ece6-fb6a-4fc5-9731-88e1bb411053 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:38.745950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f056ece6-fb6a-4fc5-9731-88e1bb411053 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:38.748090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f056ece6-fb6a-4fc5-9731-88e1bb411053 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:38.749126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f056ece6-fb6a-4fc5-9731-88e1bb411053 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:38.751312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f056ece6-fb6a-4fc5-9731-88e1bb411053 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:38.754814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f056ece6-fb6a-4fc5-9731-88e1bb411053 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:38.755467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f056ece6-fb6a-4fc5-9731-88e1bb411053 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.103312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ff3f070b-3894-4399-ae82-691eba56aa89 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:39.111459 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ff3f070b-3894-4399-ae82-691eba56aa89 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 200 len: 1324 microversion: 2.1 time: 0.570756 Oct 11 19:54:39.112336 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1442/2939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:38 2022] GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 1324 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:39.131014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eac32537-54d0-45f1-a49d-e025c3468116 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:39.131735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eac32537-54d0-45f1-a49d-e025c3468116 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:39.138166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eac32537-54d0-45f1-a49d-e025c3468116 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.139338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eac32537-54d0-45f1-a49d-e025c3468116 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.139866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eac32537-54d0-45f1-a49d-e025c3468116 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.140676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eac32537-54d0-45f1-a49d-e025c3468116 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.141215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eac32537-54d0-45f1-a49d-e025c3468116 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.141878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eac32537-54d0-45f1-a49d-e025c3468116 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.209919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f056ece6-fb6a-4fc5-9731-88e1bb411053 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:39.219958 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f056ece6-fb6a-4fc5-9731-88e1bb411053 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 200 len: 1548 microversion: 2.1 time: 0.503222 Oct 11 19:54:39.224602 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1498/2940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:38 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 1548 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:39.369695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b7495d9-514e-4092-9d03-a5ed80ea65cb tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:39.388869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b7495d9-514e-4092-9d03-a5ed80ea65cb tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Searching by: {'deleted': False, 'project_id': 'dbc24479a51541309a4017d73bd45520'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:54:39.403775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7495d9-514e-4092-9d03-a5ed80ea65cb tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.404694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7495d9-514e-4092-9d03-a5ed80ea65cb tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.405352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7495d9-514e-4092-9d03-a5ed80ea65cb tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.406937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7495d9-514e-4092-9d03-a5ed80ea65cb tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.407682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7495d9-514e-4092-9d03-a5ed80ea65cb tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.408137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b7495d9-514e-4092-9d03-a5ed80ea65cb tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.451373 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b7495d9-514e-4092-9d03-a5ed80ea65cb tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.225372 Oct 11 19:54:39.452551 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1499/2941] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:54:39 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:54:39.459256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ccdb446f-02bc-47d0-b959-e3ecc5ca1250 req-351729b1-f036-4d3e-9987-a3f8f73fc0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81262ad-d0a5-4c11-ad76-efd8e0564d34", "tag": "63e79eeb-5abc-4b9b-97ae-07fc9a76fd42"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:39.469801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ccdb446f-02bc-47d0-b959-e3ecc5ca1250 req-351729b1-f036-4d3e-9987-a3f8f73fc0c2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.471070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ccdb446f-02bc-47d0-b959-e3ecc5ca1250 req-351729b1-f036-4d3e-9987-a3f8f73fc0c2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.471665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ccdb446f-02bc-47d0-b959-e3ecc5ca1250 req-351729b1-f036-4d3e-9987-a3f8f73fc0c2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.487214 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ccdb446f-02bc-47d0-b959-e3ecc5ca1250 req-351729b1-f036-4d3e-9987-a3f8f73fc0c2 service nova] Creating event network-changed:63e79eeb-5abc-4b9b-97ae-07fc9a76fd42 for instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 on n-h2-860864-3 Oct 11 19:54:39.504291 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ccdb446f-02bc-47d0-b959-e3ecc5ca1250 req-351729b1-f036-4d3e-9987-a3f8f73fc0c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049881 Oct 11 19:54:39.505451 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1500/2942] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:39.512205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40f5f6e3-13f0-4850-8aec-255891c4d6c4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:39.513280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-40f5f6e3-13f0-4850-8aec-255891c4d6c4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:39.519672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f5f6e3-13f0-4850-8aec-255891c4d6c4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.520406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f5f6e3-13f0-4850-8aec-255891c4d6c4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.520994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f5f6e3-13f0-4850-8aec-255891c4d6c4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.521852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f5f6e3-13f0-4850-8aec-255891c4d6c4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.522455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f5f6e3-13f0-4850-8aec-255891c4d6c4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.523106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f5f6e3-13f0-4850-8aec-255891c4d6c4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.662409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eac32537-54d0-45f1-a49d-e025c3468116 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5fb759a9b5468999eb237b84f83f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1054c39db17f47659b28044f47cf35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:39.677618 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eac32537-54d0-45f1-a49d-e025c3468116 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 200 len: 1508 microversion: 2.1 time: 0.564218 Oct 11 19:54:39.678269 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1443/2943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:39 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 1508 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:39.700524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0045779-5004-46ed-a6e4-72565dc334d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:39.701238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e0045779-5004-46ed-a6e4-72565dc334d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:39.707820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0045779-5004-46ed-a6e4-72565dc334d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.708340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0045779-5004-46ed-a6e4-72565dc334d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.708787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0045779-5004-46ed-a6e4-72565dc334d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.709505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0045779-5004-46ed-a6e4-72565dc334d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.709968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0045779-5004-46ed-a6e4-72565dc334d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.710960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0045779-5004-46ed-a6e4-72565dc334d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.842138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-40f5f6e3-13f0-4850-8aec-255891c4d6c4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:39.853102 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40f5f6e3-13f0-4850-8aec-255891c4d6c4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 200 len: 1468 microversion: 2.1 time: 0.345906 Oct 11 19:54:39.865483 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e0045779-5004-46ed-a6e4-72565dc334d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164932 Oct 11 19:54:39.865483 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1444/2944] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:54:39 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:39.865483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c8c88b44-deac-4de3-9fe2-bffc6fd0f16e req-ef6a0f04-2c2c-4c1e-9c30-6762120255b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ee4391-e163-4a76-9151-04adeb0111a8", "tag": "8feec027-3d8b-4b4e-9712-8f57ab9fb853"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:39.876313 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1501/2945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:39 2022] GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 1468 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:39.883927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c8c88b44-deac-4de3-9fe2-bffc6fd0f16e req-ef6a0f04-2c2c-4c1e-9c30-6762120255b1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.884879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:39.888839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c8c88b44-deac-4de3-9fe2-bffc6fd0f16e req-ef6a0f04-2c2c-4c1e-9c30-6762120255b1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.889915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c8c88b44-deac-4de3-9fe2-bffc6fd0f16e req-ef6a0f04-2c2c-4c1e-9c30-6762120255b1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.904146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Searching by: {'deleted': False} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:54:39.912337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.917161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.918236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.920309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.921084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.921733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.927725 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c8c88b44-deac-4de3-9fe2-bffc6fd0f16e req-ef6a0f04-2c2c-4c1e-9c30-6762120255b1 service nova] Creating event network-changed:8feec027-3d8b-4b4e-9712-8f57ab9fb853 for instance b7ee4391-e163-4a76-9151-04adeb0111a8 on n-h1-860864-3 Oct 11 19:54:39.938113 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c8c88b44-deac-4de3-9fe2-bffc6fd0f16e req-ef6a0f04-2c2c-4c1e-9c30-6762120255b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077996 Oct 11 19:54:39.938940 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1445/2946] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:39.948103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-01f56dbd-55c2-468c-8614-5316929804b0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:39.949074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-01f56dbd-55c2-468c-8614-5316929804b0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:39.973969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01f56dbd-55c2-468c-8614-5316929804b0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.977323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01f56dbd-55c2-468c-8614-5316929804b0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.978559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01f56dbd-55c2-468c-8614-5316929804b0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:39.979584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01f56dbd-55c2-468c-8614-5316929804b0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:39.980810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01f56dbd-55c2-468c-8614-5316929804b0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:39.981531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01f56dbd-55c2-468c-8614-5316929804b0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:40.036770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:40.082721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:54:40.167348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:40.167740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:40.168823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:40.802385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-01f56dbd-55c2-468c-8614-5316929804b0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:40.811780 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-01f56dbd-55c2-468c-8614-5316929804b0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.870938 Oct 11 19:54:40.817249 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1446/2947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:39 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:40.822506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7962d882-18a9-4dd1-94ea-3512f1b1dcae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:40.823169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7962d882-18a9-4dd1-94ea-3512f1b1dcae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:40.829727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7962d882-18a9-4dd1-94ea-3512f1b1dcae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:40.830230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7962d882-18a9-4dd1-94ea-3512f1b1dcae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:40.830718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7962d882-18a9-4dd1-94ea-3512f1b1dcae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:40.831415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7962d882-18a9-4dd1-94ea-3512f1b1dcae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:40.831877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7962d882-18a9-4dd1-94ea-3512f1b1dcae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:40.832307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7962d882-18a9-4dd1-94ea-3512f1b1dcae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:41.346271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7962d882-18a9-4dd1-94ea-3512f1b1dcae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:41.354224 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7962d882-18a9-4dd1-94ea-3512f1b1dcae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1317 microversion: 2.1 time: 0.536336 Oct 11 19:54:41.354850 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1447/2948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:40 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:41.359282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-42c907ef-9e58-441b-a9a6-e81cebed1aad tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7530d30>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:41.467662 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-42c907ef-9e58-441b-a9a6-e81cebed1aad tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-10-11T19%3A52%3A39Z" status: 200 len: 2374 microversion: 2.1 time: 0.111763 Oct 11 19:54:41.468366 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1448/2949] 10.222.0.27 () {58 vars in 1199 bytes} [Tue Oct 11 19:54:41 2022] GET /compute/v2.1/images?changes-since=2022-10-11T19%3A52%3A39Z => generated 2374 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:41.477502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5fc672a6-603c-4daf-8ac4-1c4b5ca924ce tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:41.477996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5fc672a6-603c-4daf-8ac4-1c4b5ca924ce tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:41.485476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fc672a6-603c-4daf-8ac4-1c4b5ca924ce tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:41.486068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fc672a6-603c-4daf-8ac4-1c4b5ca924ce tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:41.486604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fc672a6-603c-4daf-8ac4-1c4b5ca924ce tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:41.487379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fc672a6-603c-4daf-8ac4-1c4b5ca924ce tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:41.487917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fc672a6-603c-4daf-8ac4-1c4b5ca924ce tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:41.488423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5fc672a6-603c-4daf-8ac4-1c4b5ca924ce tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:41.802028 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0bec7f9-55a0-4303-8eef-69b7e529e186 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22424 microversion: 2.1 time: 1.924176 Oct 11 19:54:41.802963 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1502/2950] 10.222.0.27 () {58 vars in 1171 bytes} [Tue Oct 11 19:54:39 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22424 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:54:41.808259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:41.809773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] [instance: f0583d05-1d47-4efb-a936-5e747c44c9c2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:41.816770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:41.817255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:41.817683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:41.819178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:41.820286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:41.821035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:41.842031 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] HTTP exception thrown: Instance f0583d05-1d47-4efb-a936-5e747c44c9c2 could not be found. Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Request method failure captured: Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 HTTP/1.1 Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcmkjuNIS_pk8k7SL6x167B77oSE8MjwaGMPWybd_yoORlabN2kBoC5GRaBDYWybiIPpJjaIswBgg3b0VVHl38FqzsgnsZjsegKRfynETfKRe8s8l_ewtsbcZl-VCEUYGcczdpZPA-1x7mDvXpg-JN2QVZcP6K1_5Z5j9V1hT06HGvs Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1054c39db17f47659b28044f47cf35fb Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1388195354 Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1054c39db17f47659b28044f47cf35fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1054c39db17f47659b28044f47cf35fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1054c39db17f47659b28044f47cf35fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1054c39db17f47659b28044f47cf35fb"}]}] Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1388195354 Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1054c39db17f47659b28044f47cf35fb Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1388195354 Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerRescueTestJSONUnderV235-1388195354-project Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cf5fb759a9b5468999eb237b84f83f53 Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1388195354-project Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance f0583d05-1d47-4efb-a936-5e747c44c9c2 could not be found. Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'f0583d05-1d47-4efb-a936-5e747c44c9c2'} Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0583d05-1d47-4efb-a936-5e747c44c9c2 could not be found. Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0583d05-1d47-4efb-a936-5e747c44c9c2 could not be found. Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:41.844034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:54:41.848383 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:41.848383 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:41.848383 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:54:41.848383 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:54:41.848383 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:54:41.848383 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:54:41.848383 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0583d05-1d47-4efb-a936-5e747c44c9c2 could not be found. Oct 11 19:54:41.848383 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:41.848383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] Returning 404 to user: Instance f0583d05-1d47-4efb-a936-5e747c44c9c2 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:54:41.848383 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a6cea768-32c3-4917-bdfb-fa3ed7c8c728 tempest-ServerRescueTestJSONUnderV235-1388195354 tempest-ServerRescueTestJSONUnderV235-1388195354-project] 10.222.0.27 "GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2" status: 404 len: 111 microversion: 2.1 time: 0.041423 Oct 11 19:54:41.849742 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1503/2951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:41 2022] GET /compute/v2.1/servers/f0583d05-1d47-4efb-a936-5e747c44c9c2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:54:41.855065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-623fd65e-9f01-4b5f-b392-1c2484833733 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7575790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:41.933784 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-623fd65e-9f01-4b5f-b392-1c2484833733 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1580503648" status: 200 len: 485 microversion: 2.1 time: 0.082656 Oct 11 19:54:41.934605 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1504/2952] 10.222.0.27 () {58 vars in 1231 bytes} [Tue Oct 11 19:54:41 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1580503648 => generated 485 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:41.946570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b98428e-44f9-46b8-abd4-ad0e1c9962bd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:41.947608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b98428e-44f9-46b8-abd4-ad0e1c9962bd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:41.954776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b98428e-44f9-46b8-abd4-ad0e1c9962bd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:41.955270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b98428e-44f9-46b8-abd4-ad0e1c9962bd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:41.955705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b98428e-44f9-46b8-abd4-ad0e1c9962bd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:41.956395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b98428e-44f9-46b8-abd4-ad0e1c9962bd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:41.956845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b98428e-44f9-46b8-abd4-ad0e1c9962bd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:41.957260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b98428e-44f9-46b8-abd4-ad0e1c9962bd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.026052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5fc672a6-603c-4daf-8ac4-1c4b5ca924ce tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:42.034191 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5fc672a6-603c-4daf-8ac4-1c4b5ca924ce tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 200 len: 1324 microversion: 2.1 time: 0.564173 Oct 11 19:54:42.035470 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1449/2953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:41 2022] GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 1324 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:42.041228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5b8573cb-5526-49ea-ad6d-3f599f9ca4cd tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:42.046742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5b8573cb-5526-49ea-ad6d-3f599f9ca4cd tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Searching by: {'deleted': False, 'project_id': 'dbc24479a51541309a4017d73bd45520'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:54:42.053809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b8573cb-5526-49ea-ad6d-3f599f9ca4cd tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:42.054658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b8573cb-5526-49ea-ad6d-3f599f9ca4cd tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:42.055340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b8573cb-5526-49ea-ad6d-3f599f9ca4cd tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.056467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b8573cb-5526-49ea-ad6d-3f599f9ca4cd tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:42.057145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b8573cb-5526-49ea-ad6d-3f599f9ca4cd tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:42.057790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b8573cb-5526-49ea-ad6d-3f599f9ca4cd tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.096288 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5b8573cb-5526-49ea-ad6d-3f599f9ca4cd tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=72d58f28f49447e298dbb540406db442" status: 200 len: 15 microversion: 2.1 time: 0.059259 Oct 11 19:54:42.096891 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1450/2954] 10.222.0.27 () {58 vars in 1231 bytes} [Tue Oct 11 19:54:42 2022] GET /compute/v2.1/servers/detail?tenant_id=72d58f28f49447e298dbb540406db442 => generated 15 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:54:42.101758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8dc15037-38d5-4096-a045-4fbb121da970 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0721e50>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:42.206454 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8dc15037-38d5-4096-a045-4fbb121da970 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images?server=0929e96c-9da0-4034-ae0e-38f7330002f5" status: 200 len: 956 microversion: 2.1 time: 0.108282 Oct 11 19:54:42.207434 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1451/2955] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 11 19:54:42 2022] GET /compute/v2.1/images?server=0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 956 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:42.212838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-fb623ccf-1874-454f-95b9-26eb9f1fa641 req-5d780c26-b1f7-414a-9ac5-9962a557c313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0583d05-1d47-4efb-a936-5e747c44c9c2", "name": "network-vif-deleted", "tag": "f0945e06-d4cf-49ce-a31f-4ceba757cea1"}, {"name": "network-changed", "server_uuid": "f2251c32-cb71-4195-a9df-cf9ea9f3c20e", "tag": "0733a985-3c0e-4f3d-bc27-95bab6ff2222"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:42.226764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fb623ccf-1874-454f-95b9-26eb9f1fa641 req-5d780c26-b1f7-414a-9ac5-9962a557c313 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:42.227445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fb623ccf-1874-454f-95b9-26eb9f1fa641 req-5d780c26-b1f7-414a-9ac5-9962a557c313 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:42.228107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fb623ccf-1874-454f-95b9-26eb9f1fa641 req-5d780c26-b1f7-414a-9ac5-9962a557c313 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.240970 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-fb623ccf-1874-454f-95b9-26eb9f1fa641 req-5d780c26-b1f7-414a-9ac5-9962a557c313 service nova] Creating event network-vif-deleted:f0945e06-d4cf-49ce-a31f-4ceba757cea1 for instance f0583d05-1d47-4efb-a936-5e747c44c9c2 on n-h1-860864-3 Oct 11 19:54:42.242085 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-fb623ccf-1874-454f-95b9-26eb9f1fa641 req-5d780c26-b1f7-414a-9ac5-9962a557c313 service nova] Creating event network-changed:0733a985-3c0e-4f3d-bc27-95bab6ff2222 for instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e on n-h2-860864-3 Oct 11 19:54:42.250370 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-fb623ccf-1874-454f-95b9-26eb9f1fa641 req-5d780c26-b1f7-414a-9ac5-9962a557c313 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041512 Oct 11 19:54:42.251134 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1452/2956] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:42.256252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:42.262404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Searching by: {'tenant_id': '72d58f28f49447e298dbb540406db442', 'deleted': False} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:54:42.267588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:42.268254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:42.268896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.269626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:42.270082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:42.270510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.304235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:54:42.348091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:42.348568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:42.349014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.402298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b98428e-44f9-46b8-abd4-ad0e1c9962bd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:42.415549 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b98428e-44f9-46b8-abd4-ad0e1c9962bd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.479450 Oct 11 19:54:42.433485 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1505/2957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:41 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:42.438790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbdac227-eee3-41df-a38b-94566f5c3393 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc2c5af0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:42.498934 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cbdac227-eee3-41df-a38b-94566f5c3393 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 485 microversion: 2.1 time: 0.063898 Oct 11 19:54:42.499792 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1506/2958] 10.222.0.27 () {58 vars in 1317 bytes} [Tue Oct 11 19:54:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 485 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:42.504438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1f5be572-ae7b-4514-aa4f-97a098563d78 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:42.505214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1f5be572-ae7b-4514-aa4f-97a098563d78 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:42.512515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5be572-ae7b-4514-aa4f-97a098563d78 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:42.513218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5be572-ae7b-4514-aa4f-97a098563d78 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:42.513808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5be572-ae7b-4514-aa4f-97a098563d78 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.515307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5be572-ae7b-4514-aa4f-97a098563d78 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:42.515938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5be572-ae7b-4514-aa4f-97a098563d78 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:42.516529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5be572-ae7b-4514-aa4f-97a098563d78 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.682582 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b8c997b2-ded9-4b47-a848-1cf3b81913b5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=72d58f28f49447e298dbb540406db442" status: 200 len: 4824 microversion: 2.1 time: 0.429887 Oct 11 19:54:42.683492 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1453/2959] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 11 19:54:42 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=72d58f28f49447e298dbb540406db442 => generated 4824 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:42.695881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6b0abd11-0fde-481a-8eea-e60073e58699 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0702280>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:42.757719 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6b0abd11-0fde-481a-8eea-e60073e58699 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 485 microversion: 2.1 time: 0.065467 Oct 11 19:54:42.768946 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1454/2960] 10.222.0.27 () {58 vars in 1303 bytes} [Tue Oct 11 19:54:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 485 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:42.775172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-197044a8-d849-40b0-b5b6-67af11f59a5f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:42.781443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-197044a8-d849-40b0-b5b6-67af11f59a5f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Searching by: {'tenant_id': 'dbc24479a51541309a4017d73bd45520', 'deleted': False} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:54:42.787042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-197044a8-d849-40b0-b5b6-67af11f59a5f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:42.787789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-197044a8-d849-40b0-b5b6-67af11f59a5f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:42.788748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-197044a8-d849-40b0-b5b6-67af11f59a5f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.789596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-197044a8-d849-40b0-b5b6-67af11f59a5f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:42.790160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-197044a8-d849-40b0-b5b6-67af11f59a5f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:42.790764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-197044a8-d849-40b0-b5b6-67af11f59a5f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:42.840900 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-197044a8-d849-40b0-b5b6-67af11f59a5f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=dbc24479a51541309a4017d73bd45520" status: 200 len: 15 microversion: 2.1 time: 0.070357 Oct 11 19:54:42.855753 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1455/2961] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 11 19:54:42 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=dbc24479a51541309a4017d73bd45520 => generated 15 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:54:42.868677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-837eeb13-8f22-45d9-b1fc-d16929e6e7a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc2e41f0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.015829 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-837eeb13-8f22-45d9-b1fc-d16929e6e7a6 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.158797 Oct 11 19:54:43.028953 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1456/2962] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 11 19:54:42 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:43.034649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6bd8a9f-4f67-4443-8aac-18f962d420c7 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.045306 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6bd8a9f-4f67-4443-8aac-18f962d420c7 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014235 Oct 11 19:54:43.062187 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1457/2963] 10.222.0.27 () {58 vars in 1189 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:54:43.062187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-d0d249f7-4780-4ca1-bae5-bdbcd41cf167 req-6f0f43be-4b5e-4132-bf66-537637172a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0929e96c-9da0-4034-ae0e-38f7330002f5", "name": "network-vif-unplugged", "status": "completed", "tag": "71f8f1b2-5864-4201-894f-6d7e1edc96c4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:43.082330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d0d249f7-4780-4ca1-bae5-bdbcd41cf167 req-6f0f43be-4b5e-4132-bf66-537637172a68 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.082991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d0d249f7-4780-4ca1-bae5-bdbcd41cf167 req-6f0f43be-4b5e-4132-bf66-537637172a68 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.083271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d0d249f7-4780-4ca1-bae5-bdbcd41cf167 req-6f0f43be-4b5e-4132-bf66-537637172a68 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.097575 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-d0d249f7-4780-4ca1-bae5-bdbcd41cf167 req-6f0f43be-4b5e-4132-bf66-537637172a68 service nova] Creating event network-vif-unplugged:71f8f1b2-5864-4201-894f-6d7e1edc96c4 for instance 0929e96c-9da0-4034-ae0e-38f7330002f5 on n-h2-860864-3 Oct 11 19:54:43.106215 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-d0d249f7-4780-4ca1-bae5-bdbcd41cf167 req-6f0f43be-4b5e-4132-bf66-537637172a68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058357 Oct 11 19:54:43.106760 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1458/2964] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:43.115265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-524f7c08-afd7-419f-8284-af79bc0ad3b8 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d06fb160>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.215895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1f5be572-ae7b-4514-aa4f-97a098563d78 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:43.221219 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-524f7c08-afd7-419f-8284-af79bc0ad3b8 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.112833 Oct 11 19:54:43.222250 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1459/2965] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:43.230050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-acc9c963-557f-4476-9f63-4026ad5e0d0a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.231219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-acc9c963-557f-4476-9f63-4026ad5e0d0a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:43.239149 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1f5be572-ae7b-4514-aa4f-97a098563d78 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1317 microversion: 2.1 time: 0.737528 Oct 11 19:54:43.251029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acc9c963-557f-4476-9f63-4026ad5e0d0a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.251029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acc9c963-557f-4476-9f63-4026ad5e0d0a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.251029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acc9c963-557f-4476-9f63-4026ad5e0d0a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.251029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acc9c963-557f-4476-9f63-4026ad5e0d0a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.251029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acc9c963-557f-4476-9f63-4026ad5e0d0a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.251029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acc9c963-557f-4476-9f63-4026ad5e0d0a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.252876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1507/2966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:42 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1317 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:43.263729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f509223-78ff-4621-a54c-efe9730727f2 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:43.266574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0f509223-78ff-4621-a54c-efe9730727f2 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:43.274106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f509223-78ff-4621-a54c-efe9730727f2 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.275059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f509223-78ff-4621-a54c-efe9730727f2 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.275705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f509223-78ff-4621-a54c-efe9730727f2 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.276851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f509223-78ff-4621-a54c-efe9730727f2 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.277510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f509223-78ff-4621-a54c-efe9730727f2 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.278136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f509223-78ff-4621-a54c-efe9730727f2 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.403644 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f509223-78ff-4621-a54c-efe9730727f2 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action" status: 202 len: 0 microversion: 2.1 time: 0.149196 Oct 11 19:54:43.404917 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1508/2967] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:43 2022] POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:54:43.410204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d7b0d3db-08ec-4bac-9477-b4f04bf60271 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7560820>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.456537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-acc9c963-557f-4476-9f63-4026ad5e0d0a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:43.466465 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-acc9c963-557f-4476-9f63-4026ad5e0d0a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 200 len: 1324 microversion: 2.1 time: 0.243640 Oct 11 19:54:43.480050 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1460/2968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 1324 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:43.485804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.493222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:43.494144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '72d58f28f49447e298dbb540406db442'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:54:43.500759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.501402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.502049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.503024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.504569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.504569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.536490 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d7b0d3db-08ec-4bac-9477-b4f04bf60271 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.129773 Oct 11 19:54:43.537629 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1509/2969] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:43.537811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:54:43.544498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0db4b2e-a0ac-4006-9260-bc2e45db23ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.545419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a0db4b2e-a0ac-4006-9260-bc2e45db23ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:43.552399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0db4b2e-a0ac-4006-9260-bc2e45db23ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.553203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0db4b2e-a0ac-4006-9260-bc2e45db23ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.555145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0db4b2e-a0ac-4006-9260-bc2e45db23ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.556022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0db4b2e-a0ac-4006-9260-bc2e45db23ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.556744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0db4b2e-a0ac-4006-9260-bc2e45db23ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.557315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0db4b2e-a0ac-4006-9260-bc2e45db23ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.575423 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e83295b5-c03e-47df-b03c-f7bee81af34d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.093959 Oct 11 19:54:43.576674 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1461/2970] 10.222.0.27 () {58 vars in 1150 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:43.584038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-791c6ce1-fd63-4065-bbbd-d9fe6568014f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c74c6550>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.728103 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-791c6ce1-fd63-4065-bbbd-d9fe6568014f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-10-11T19%3A52%3A34Z" status: 200 len: 6333 microversion: 2.1 time: 0.150215 Oct 11 19:54:43.730883 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1462/2971] 10.222.0.27 () {58 vars in 1220 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-11T19%3A52%3A34Z => generated 6333 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:43.740377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-61c32cd1-c749-41bb-940a-17d06188807d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:43.748407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-61c32cd1-c749-41bb-940a-17d06188807d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:43.760955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a0db4b2e-a0ac-4006-9260-bc2e45db23ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:43.764013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c32cd1-c749-41bb-940a-17d06188807d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.764153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c32cd1-c749-41bb-940a-17d06188807d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.766089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c32cd1-c749-41bb-940a-17d06188807d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.766914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c32cd1-c749-41bb-940a-17d06188807d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.767386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c32cd1-c749-41bb-940a-17d06188807d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.767827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c32cd1-c749-41bb-940a-17d06188807d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.774089 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a0db4b2e-a0ac-4006-9260-bc2e45db23ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.233646 Oct 11 19:54:43.774961 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1510/2972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:43.780536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-25473fb9-ed6c-4f44-93a9-f3cc940852f8 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d06f0d30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.845283 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-25473fb9-ed6c-4f44-93a9-f3cc940852f8 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1580503648" status: 200 len: 665 microversion: 2.1 time: 0.068632 Oct 11 19:54:43.846290 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1511/2973] 10.222.0.27 () {58 vars in 1252 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1580503648 => generated 665 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:43.864466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-63401fa1-bfb5-4222-9d12-f745fcba2e78 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c755a940>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.934477 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-63401fa1-bfb5-4222-9d12-f745fcba2e78 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1467 microversion: 2.1 time: 0.073747 Oct 11 19:54:43.935294 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1512/2974] 10.222.0.27 () {58 vars in 1338 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1467 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:54:43.948341 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-61c32cd1-c749-41bb-940a-17d06188807d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action" status: 202 len: 0 microversion: 2.1 time: 0.215294 Oct 11 19:54:43.955086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a9ac856-5c87-4938-9b1f-11e3abf3e118 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7560820>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.957847 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1463/2975] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:43 2022] POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:54:43.974819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-42d29f7e-f1b5-4a3c-be0e-957f904fd058 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:43.976842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-42d29f7e-f1b5-4a3c-be0e-957f904fd058 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:43.985231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42d29f7e-f1b5-4a3c-be0e-957f904fd058 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.986059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42d29f7e-f1b5-4a3c-be0e-957f904fd058 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.986805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42d29f7e-f1b5-4a3c-be0e-957f904fd058 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:43.987735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42d29f7e-f1b5-4a3c-be0e-957f904fd058 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:43.988489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42d29f7e-f1b5-4a3c-be0e-957f904fd058 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:43.989129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42d29f7e-f1b5-4a3c-be0e-957f904fd058 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:44.037857 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a9ac856-5c87-4938-9b1f-11e3abf3e118 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1467 microversion: 2.1 time: 0.087619 Oct 11 19:54:44.039476 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1513/2976] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1467 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:54:44.078458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b4d3e57e-99e1-4ea7-b2de-c43b83bfccea tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c755a700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:44.191160 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-42d29f7e-f1b5-4a3c-be0e-957f904fd058 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1613 microversion: 2.1 time: 0.228772 Oct 11 19:54:44.192712 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1464/2977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:43 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1613 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:44.218067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-717bee12-3b21-41ce-9aee-78c113dcc059 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:44.222932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-717bee12-3b21-41ce-9aee-78c113dcc059 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:44.226338 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b4d3e57e-99e1-4ea7-b2de-c43b83bfccea tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.161560 Oct 11 19:54:44.227894 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1514/2978] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 11 19:54:44 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:44.231461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-717bee12-3b21-41ce-9aee-78c113dcc059 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:44.231961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-717bee12-3b21-41ce-9aee-78c113dcc059 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:44.232403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-717bee12-3b21-41ce-9aee-78c113dcc059 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:44.233197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-717bee12-3b21-41ce-9aee-78c113dcc059 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:44.233569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-717bee12-3b21-41ce-9aee-78c113dcc059 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:44.234357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-717bee12-3b21-41ce-9aee-78c113dcc059 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:44.251524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bfeca7e7-e87f-47f8-ba06-6fa2e75c32ea tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83c7560a60>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:44.373397 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bfeca7e7-e87f-47f8-ba06-6fa2e75c32ea tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.128021 Oct 11 19:54:44.374739 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1515/2979] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 11 19:54:44 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:44.381639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e2851609-2df0-41c5-879c-34e2a49383e0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:44.382616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e2851609-2df0-41c5-879c-34e2a49383e0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:44.391268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2851609-2df0-41c5-879c-34e2a49383e0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:44.392298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2851609-2df0-41c5-879c-34e2a49383e0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:44.393041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2851609-2df0-41c5-879c-34e2a49383e0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:44.394075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2851609-2df0-41c5-879c-34e2a49383e0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:44.394736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2851609-2df0-41c5-879c-34e2a49383e0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:44.395331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2851609-2df0-41c5-879c-34e2a49383e0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:44.575184 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-717bee12-3b21-41ce-9aee-78c113dcc059 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1613 microversion: 2.1 time: 0.359723 Oct 11 19:54:44.590976 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1465/2980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:44 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1613 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:54:44.601255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-20100932-edc1-4770-8df7-1ad4e1441a41 req-3174bd86-9b78-4724-8761-3be19fe363b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985ba888-5655-480f-8d6b-f39d4a4065fa", "tag": "7c7804ab-9b0e-4b95-8522-a13a6bca1b13"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:44.612593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-20100932-edc1-4770-8df7-1ad4e1441a41 req-3174bd86-9b78-4724-8761-3be19fe363b6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:44.613248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-20100932-edc1-4770-8df7-1ad4e1441a41 req-3174bd86-9b78-4724-8761-3be19fe363b6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:44.613896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-20100932-edc1-4770-8df7-1ad4e1441a41 req-3174bd86-9b78-4724-8761-3be19fe363b6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:44.620941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:44.633750 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-20100932-edc1-4770-8df7-1ad4e1441a41 req-3174bd86-9b78-4724-8761-3be19fe363b6 service nova] Creating event network-changed:7c7804ab-9b0e-4b95-8522-a13a6bca1b13 for instance 985ba888-5655-480f-8d6b-f39d4a4065fa on n-h2-860864-3 Oct 11 19:54:44.646368 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-20100932-edc1-4770-8df7-1ad4e1441a41 req-3174bd86-9b78-4724-8761-3be19fe363b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053724 Oct 11 19:54:44.649450 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1466/2981] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:44.655502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3d12c7d0-e2a6-4175-8a25-798faacc5a0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d08ae670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:44.731559 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3d12c7d0-e2a6-4175-8a25-798faacc5a0d tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/d10025cd-51f6-4b3b-a33d-5e8072e792b3" status: 200 len: 784 microversion: 2.1 time: 0.080392 Oct 11 19:54:44.746760 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1467/2982] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:54:44 2022] GET /compute/v2.1/images/d10025cd-51f6-4b3b-a33d-5e8072e792b3 => generated 784 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:44.760967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c2b7e345-614e-4b30-842a-243762de2aab tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:44.761342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e2851609-2df0-41c5-879c-34e2a49383e0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:44.761968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c2b7e345-614e-4b30-842a-243762de2aab tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:44.772340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2b7e345-614e-4b30-842a-243762de2aab tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:44.773450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2b7e345-614e-4b30-842a-243762de2aab tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:44.773991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2b7e345-614e-4b30-842a-243762de2aab tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:44.774415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e2851609-2df0-41c5-879c-34e2a49383e0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1317 microversion: 2.1 time: 0.398073 Oct 11 19:54:44.774886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2b7e345-614e-4b30-842a-243762de2aab tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:44.775428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2b7e345-614e-4b30-842a-243762de2aab tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:44.786556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2b7e345-614e-4b30-842a-243762de2aab tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:44.786832 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1516/2983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:44 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:44.793819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a12df970-9531-409e-9692-b5eee261063f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:44.810879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a12df970-9531-409e-9692-b5eee261063f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Searching by: {'host': 'n-h1-860864-3', 'deleted': False} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:54:44.816587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a12df970-9531-409e-9692-b5eee261063f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:44.817073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a12df970-9531-409e-9692-b5eee261063f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:44.817518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a12df970-9531-409e-9692-b5eee261063f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:44.818238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a12df970-9531-409e-9692-b5eee261063f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:44.818717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a12df970-9531-409e-9692-b5eee261063f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:44.819144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a12df970-9531-409e-9692-b5eee261063f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:45.037182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-a12df970-9531-409e-9692-b5eee261063f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:54:45.058667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c2b7e345-614e-4b30-842a-243762de2aab tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:45.067002 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c2b7e345-614e-4b30-842a-243762de2aab tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 200 len: 1324 microversion: 2.1 time: 0.318079 Oct 11 19:54:45.082920 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1468/2984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:44 2022] GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:45.095214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a3db40bc-0ac8-4be9-97e6-3915db18f791 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d08ae3a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:45.135252 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a12df970-9531-409e-9692-b5eee261063f tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h1-860864-3&all_tenants=1" status: 200 len: 2309 microversion: 2.1 time: 0.352832 Oct 11 19:54:45.136714 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1517/2985] 10.222.0.27 () {58 vars in 1190 bytes} [Tue Oct 11 19:54:44 2022] GET /compute/v2.1/servers?host=n-h1-860864-3&all_tenants=1 => generated 2309 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:45.156605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62d25bda-4772-4aa8-ab71-aaaf41d96e6f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:45.157234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-62d25bda-4772-4aa8-ab71-aaaf41d96e6f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:45.166663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62d25bda-4772-4aa8-ab71-aaaf41d96e6f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:45.167168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62d25bda-4772-4aa8-ab71-aaaf41d96e6f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:45.167613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62d25bda-4772-4aa8-ab71-aaaf41d96e6f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:45.171074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62d25bda-4772-4aa8-ab71-aaaf41d96e6f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:45.171784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62d25bda-4772-4aa8-ab71-aaaf41d96e6f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:45.172381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62d25bda-4772-4aa8-ab71-aaaf41d96e6f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:45.186743 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a3db40bc-0ac8-4be9-97e6-3915db18f791 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.093401 Oct 11 19:54:45.187653 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1469/2986] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 19:54:45 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:45.192437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8979f82b-54ba-476a-b3b7-661fff8e8981 req-fa3288a4-a0f8-4b51-926f-59e5b7375463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81262ad-d0a5-4c11-ad76-efd8e0564d34", "name": "network-vif-plugged", "status": "completed", "tag": "63e79eeb-5abc-4b9b-97ae-07fc9a76fd42"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:45.223029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8979f82b-54ba-476a-b3b7-661fff8e8981 req-fa3288a4-a0f8-4b51-926f-59e5b7375463 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:45.223889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8979f82b-54ba-476a-b3b7-661fff8e8981 req-fa3288a4-a0f8-4b51-926f-59e5b7375463 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:45.224541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8979f82b-54ba-476a-b3b7-661fff8e8981 req-fa3288a4-a0f8-4b51-926f-59e5b7375463 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:45.237859 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8979f82b-54ba-476a-b3b7-661fff8e8981 req-fa3288a4-a0f8-4b51-926f-59e5b7375463 service nova] Creating event network-vif-plugged:63e79eeb-5abc-4b9b-97ae-07fc9a76fd42 for instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 on n-h2-860864-3 Oct 11 19:54:45.244563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8979f82b-54ba-476a-b3b7-661fff8e8981 req-fa3288a4-a0f8-4b51-926f-59e5b7375463 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055455 Oct 11 19:54:45.245799 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1470/2987] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:45.251388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6583ce54-3ab0-4e08-9350-5209b0651f1d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:45.258566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6583ce54-3ab0-4e08-9350-5209b0651f1d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:54:45.266472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6583ce54-3ab0-4e08-9350-5209b0651f1d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:45.267318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6583ce54-3ab0-4e08-9350-5209b0651f1d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:45.268936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6583ce54-3ab0-4e08-9350-5209b0651f1d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:45.269983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6583ce54-3ab0-4e08-9350-5209b0651f1d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:45.274291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6583ce54-3ab0-4e08-9350-5209b0651f1d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:45.275039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6583ce54-3ab0-4e08-9350-5209b0651f1d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:45.424015 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6583ce54-3ab0-4e08-9350-5209b0651f1d tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.176708 Oct 11 19:54:45.425068 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1471/2988] 10.222.0.27 () {58 vars in 1196 bytes} [Tue Oct 11 19:54:45 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:54:45.430636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-38349381-e530-4782-bf3a-6e1fe0e3cb8a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83cc4aa5e0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:45.635120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-62d25bda-4772-4aa8-ab71-aaaf41d96e6f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:45.657467 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-62d25bda-4772-4aa8-ab71-aaaf41d96e6f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.517291 Oct 11 19:54:45.658282 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1518/2989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:45 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:45.664463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b3360735-18aa-4460-aacf-d10cb43d7bd8 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:45.667382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b3360735-18aa-4460-aacf-d10cb43d7bd8 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:45.673799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3360735-18aa-4460-aacf-d10cb43d7bd8 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:45.674475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3360735-18aa-4460-aacf-d10cb43d7bd8 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:45.675138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3360735-18aa-4460-aacf-d10cb43d7bd8 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:45.676649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3360735-18aa-4460-aacf-d10cb43d7bd8 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:45.677459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3360735-18aa-4460-aacf-d10cb43d7bd8 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:45.677568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3360735-18aa-4460-aacf-d10cb43d7bd8 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:45.813385 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b3360735-18aa-4460-aacf-d10cb43d7bd8 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action" status: 202 len: 0 microversion: 2.1 time: 0.148899 Oct 11 19:54:45.813385 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1519/2990] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:45 2022] POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:54:45.818320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b3efc2b7-3b9f-4967-931f-4c1b7c9768b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:45.818961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b3efc2b7-3b9f-4967-931f-4c1b7c9768b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:45.827136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:45.831973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3efc2b7-3b9f-4967-931f-4c1b7c9768b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:45.832545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3efc2b7-3b9f-4967-931f-4c1b7c9768b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:45.833234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3efc2b7-3b9f-4967-931f-4c1b7c9768b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:45.834074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3efc2b7-3b9f-4967-931f-4c1b7c9768b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:45.834636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3efc2b7-3b9f-4967-931f-4c1b7c9768b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:45.836119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3efc2b7-3b9f-4967-931f-4c1b7c9768b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.006857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b3efc2b7-3b9f-4967-931f-4c1b7c9768b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:46.015660 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b3efc2b7-3b9f-4967-931f-4c1b7c9768b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1317 microversion: 2.1 time: 0.202634 Oct 11 19:54:46.016498 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1520/2991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:45 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:46.021582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:46.024361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:46.030996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:46.031686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:46.032931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.033686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:46.034309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:46.034927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.085370 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-38349381-e530-4782-bf3a-6e1fe0e3cb8a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "DELETE /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4" status: 204 len: 0 microversion: 2.1 time: 0.659070 Oct 11 19:54:46.086154 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1472/2992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:45 2022] DELETE /compute/v2.1/images/50287a66-8f3b-48bb-89ee-71d9f766a2f4 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:54:46.094617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7df197d9-6ff6-473f-b149-d541814bb778 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d07890d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:46.152151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:54:46.152663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:54:46.153347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:54:46.153831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:54:46.154308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:54:46.244215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:46.259040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:46.259654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:46.260256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.261343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:46.261919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:46.262634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.268205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:46.297365 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cb3526bc-d57b-4515-904d-981d409dc1f0 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action" status: 202 len: 1066 microversion: 2.1 time: 0.279469 Oct 11 19:54:46.298406 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1521/2993] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:46 2022] POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action => generated 1066 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 19:54:46.320881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-65c29cb7-a1e8-4efd-8371-4d942deb12ff tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:46.321457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-65c29cb7-a1e8-4efd-8371-4d942deb12ff tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:46.331714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c29cb7-a1e8-4efd-8371-4d942deb12ff tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:46.332482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c29cb7-a1e8-4efd-8371-4d942deb12ff tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:46.332838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c29cb7-a1e8-4efd-8371-4d942deb12ff tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.333505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c29cb7-a1e8-4efd-8371-4d942deb12ff tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:46.334019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c29cb7-a1e8-4efd-8371-4d942deb12ff tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:46.334448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c29cb7-a1e8-4efd-8371-4d942deb12ff tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.499267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-65c29cb7-a1e8-4efd-8371-4d942deb12ff tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:46.507611 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-65c29cb7-a1e8-4efd-8371-4d942deb12ff tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 200 len: 1324 microversion: 2.1 time: 0.207513 Oct 11 19:54:46.515618 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1522/2994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:46 2022] GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 1324 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:46.527682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5c2c6b36-a170-4c85-a5ee-cff6f6f7f65d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:46.533097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5c2c6b36-a170-4c85-a5ee-cff6f6f7f65d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:46.544367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2c6b36-a170-4c85-a5ee-cff6f6f7f65d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:46.545201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2c6b36-a170-4c85-a5ee-cff6f6f7f65d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:46.545720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2c6b36-a170-4c85-a5ee-cff6f6f7f65d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.546944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2c6b36-a170-4c85-a5ee-cff6f6f7f65d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:46.547449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2c6b36-a170-4c85-a5ee-cff6f6f7f65d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:46.548031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c2c6b36-a170-4c85-a5ee-cff6f6f7f65d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.646965 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7df197d9-6ff6-473f-b149-d541814bb778 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "DELETE /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c" status: 204 len: 0 microversion: 2.1 time: 0.556371 Oct 11 19:54:46.648258 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1473/2995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:46 2022] DELETE /compute/v2.1/images/61e1ef9c-9753-450a-8bfe-d813ebec206c => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:54:46.657285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b990a92e-159b-4028-ac97-b155ffb3f45a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0702940>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:46.733864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5c2c6b36-a170-4c85-a5ee-cff6f6f7f65d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:46.745339 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5c2c6b36-a170-4c85-a5ee-cff6f6f7f65d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.226197 Oct 11 19:54:46.746866 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1523/2996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:46 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:46.752525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d46053d8-f551-4277-9322-3ddef617a8da tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:46.753552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d46053d8-f551-4277-9322-3ddef617a8da tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:46.761016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d46053d8-f551-4277-9322-3ddef617a8da tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:46.761747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d46053d8-f551-4277-9322-3ddef617a8da tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:46.762428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d46053d8-f551-4277-9322-3ddef617a8da tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.763540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d46053d8-f551-4277-9322-3ddef617a8da tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:46.764416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d46053d8-f551-4277-9322-3ddef617a8da tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:46.765071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d46053d8-f551-4277-9322-3ddef617a8da tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:46.939064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d46053d8-f551-4277-9322-3ddef617a8da tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:46.951537 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d46053d8-f551-4277-9322-3ddef617a8da tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.203298 Oct 11 19:54:46.952452 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1524/2997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:46 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:47.041477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2fc92a3d-7165-4e4b-9968-e901cfa2e22a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:47.042162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2fc92a3d-7165-4e4b-9968-e901cfa2e22a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:47.049436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc92a3d-7165-4e4b-9968-e901cfa2e22a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.049928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc92a3d-7165-4e4b-9968-e901cfa2e22a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.050583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc92a3d-7165-4e4b-9968-e901cfa2e22a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.051509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc92a3d-7165-4e4b-9968-e901cfa2e22a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.052358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc92a3d-7165-4e4b-9968-e901cfa2e22a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.052789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc92a3d-7165-4e4b-9968-e901cfa2e22a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.214678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2fc92a3d-7165-4e4b-9968-e901cfa2e22a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:47.223176 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2fc92a3d-7165-4e4b-9968-e901cfa2e22a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1317 microversion: 2.1 time: 0.186608 Oct 11 19:54:47.224094 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1525/2998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:47 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:47.502887 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b990a92e-159b-4028-ac97-b155ffb3f45a tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "DELETE /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49" status: 204 len: 0 microversion: 2.1 time: 0.850458 Oct 11 19:54:47.503542 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1474/2999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:46 2022] DELETE /compute/v2.1/images/25a654a9-82c0-4e6b-8bc3-a7be47112f49 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:54:47.511422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a8a558a2-3be4-49ed-b69f-2a8fcf6d5150 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:47.511910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a8a558a2-3be4-49ed-b69f-2a8fcf6d5150 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:47.517874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8a558a2-3be4-49ed-b69f-2a8fcf6d5150 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.518295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8a558a2-3be4-49ed-b69f-2a8fcf6d5150 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.518843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8a558a2-3be4-49ed-b69f-2a8fcf6d5150 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.519528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8a558a2-3be4-49ed-b69f-2a8fcf6d5150 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.519974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8a558a2-3be4-49ed-b69f-2a8fcf6d5150 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.520386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8a558a2-3be4-49ed-b69f-2a8fcf6d5150 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.532655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-59a97caa-cf42-4416-aa0a-cdb5bc5ec61a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:47.533609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-59a97caa-cf42-4416-aa0a-cdb5bc5ec61a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:47.543229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a97caa-cf42-4416-aa0a-cdb5bc5ec61a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.544054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a97caa-cf42-4416-aa0a-cdb5bc5ec61a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.545058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a97caa-cf42-4416-aa0a-cdb5bc5ec61a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.545951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a97caa-cf42-4416-aa0a-cdb5bc5ec61a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.546418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a97caa-cf42-4416-aa0a-cdb5bc5ec61a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.546892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59a97caa-cf42-4416-aa0a-cdb5bc5ec61a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.550401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a8a558a2-3be4-49ed-b69f-2a8fcf6d5150 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:54:47.630288 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a8a558a2-3be4-49ed-b69f-2a8fcf6d5150 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 204 len: 0 microversion: 2.1 time: 0.122320 Oct 11 19:54:47.631150 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1526/3000] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:54:47 2022] DELETE /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:54:47.641602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3b727f7a-5cda-428b-b78e-3b1200f12182 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:47.642987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3b727f7a-5cda-428b-b78e-3b1200f12182 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:47.651556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b727f7a-5cda-428b-b78e-3b1200f12182 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.652206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b727f7a-5cda-428b-b78e-3b1200f12182 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.652712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b727f7a-5cda-428b-b78e-3b1200f12182 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.653512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b727f7a-5cda-428b-b78e-3b1200f12182 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.654066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b727f7a-5cda-428b-b78e-3b1200f12182 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.654495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b727f7a-5cda-428b-b78e-3b1200f12182 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.716024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-59a97caa-cf42-4416-aa0a-cdb5bc5ec61a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:47.729999 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-59a97caa-cf42-4416-aa0a-cdb5bc5ec61a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 200 len: 1519 microversion: 2.1 time: 0.200821 Oct 11 19:54:47.731075 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1475/3001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:47 2022] GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:47.753988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Action: 'action', calling method: .version_select at 0x7f83cebba8b0>, body: {"addFloatingIp": {"address": "172.25.2.66"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:47.756492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:47.768093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.768763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.769305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.770139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.770738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.771268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.800721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "refresh_cache-99eb7ce1-c903-472e-b46a-6714f5362eb9" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:54:47.801423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquired lock "refresh_cache-99eb7ce1-c903-472e-b46a-6714f5362eb9" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:54:47.810957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3b727f7a-5cda-428b-b78e-3b1200f12182 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:47.818653 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3b727f7a-5cda-428b-b78e-3b1200f12182 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1473 microversion: 2.1 time: 0.182142 Oct 11 19:54:47.819231 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1527/3002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:47 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1473 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:47.825176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a80d0d8a-f10f-412d-bd77-7bc0e33ecbf7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:47.825791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a80d0d8a-f10f-412d-bd77-7bc0e33ecbf7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:47.839653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80d0d8a-f10f-412d-bd77-7bc0e33ecbf7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.840277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80d0d8a-f10f-412d-bd77-7bc0e33ecbf7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.840718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80d0d8a-f10f-412d-bd77-7bc0e33ecbf7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:47.841409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80d0d8a-f10f-412d-bd77-7bc0e33ecbf7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:47.842088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80d0d8a-f10f-412d-bd77-7bc0e33ecbf7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:47.842495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a80d0d8a-f10f-412d-bd77-7bc0e33ecbf7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:48.157224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a80d0d8a-f10f-412d-bd77-7bc0e33ecbf7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:48.166984 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a80d0d8a-f10f-412d-bd77-7bc0e33ecbf7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.345774 Oct 11 19:54:48.167671 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1528/3003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:47 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:48.192488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b804e848-b7a4-4bd0-9db7-d871787e6bd1 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:48.193205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b804e848-b7a4-4bd0-9db7-d871787e6bd1 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:48.201332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b804e848-b7a4-4bd0-9db7-d871787e6bd1 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:48.202163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b804e848-b7a4-4bd0-9db7-d871787e6bd1 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:48.202736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b804e848-b7a4-4bd0-9db7-d871787e6bd1 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:48.203507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b804e848-b7a4-4bd0-9db7-d871787e6bd1 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:48.204037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b804e848-b7a4-4bd0-9db7-d871787e6bd1 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:48.204529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b804e848-b7a4-4bd0-9db7-d871787e6bd1 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:48.496290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b804e848-b7a4-4bd0-9db7-d871787e6bd1 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:48.504868 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b804e848-b7a4-4bd0-9db7-d871787e6bd1 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.322732 Oct 11 19:54:48.505496 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1529/3004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:48 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:48.512135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0f83b66-1cdd-4414-b17d-35020c3fa21a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:48.513025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d0f83b66-1cdd-4414-b17d-35020c3fa21a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:48.520774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0f83b66-1cdd-4414-b17d-35020c3fa21a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:48.521545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0f83b66-1cdd-4414-b17d-35020c3fa21a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:48.522229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0f83b66-1cdd-4414-b17d-35020c3fa21a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:48.524239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0f83b66-1cdd-4414-b17d-35020c3fa21a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:48.524763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0f83b66-1cdd-4414-b17d-35020c3fa21a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:48.525265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0f83b66-1cdd-4414-b17d-35020c3fa21a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:48.797847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0f83b66-1cdd-4414-b17d-35020c3fa21a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:48.811921 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0f83b66-1cdd-4414-b17d-35020c3fa21a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1317 microversion: 2.1 time: 0.305203 Oct 11 19:54:48.813407 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1530/3005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:48 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:48.842118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-31a4ea4e-11e7-44c5-a53b-50e0f5e247ab tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:48.842762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-31a4ea4e-11e7-44c5-a53b-50e0f5e247ab tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:48.850669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31a4ea4e-11e7-44c5-a53b-50e0f5e247ab tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:48.851504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31a4ea4e-11e7-44c5-a53b-50e0f5e247ab tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:48.852095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31a4ea4e-11e7-44c5-a53b-50e0f5e247ab tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:48.852952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31a4ea4e-11e7-44c5-a53b-50e0f5e247ab tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:48.853854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31a4ea4e-11e7-44c5-a53b-50e0f5e247ab tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:48.854605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31a4ea4e-11e7-44c5-a53b-50e0f5e247ab tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:49.126588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-31a4ea4e-11e7-44c5-a53b-50e0f5e247ab tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:49.135142 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-31a4ea4e-11e7-44c5-a53b-50e0f5e247ab tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1473 microversion: 2.1 time: 0.296771 Oct 11 19:54:49.135811 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1531/3006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:48 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1473 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:49.155312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-975f931d-bee8-43eb-9afb-8ff1ecf14d9a req-0c2434a9-2c47-401b-9860-1686b84adfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2251c32-cb71-4195-a9df-cf9ea9f3c20e", "name": "network-vif-plugged", "status": "completed", "tag": "0733a985-3c0e-4f3d-bc27-95bab6ff2222"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:49.168948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-975f931d-bee8-43eb-9afb-8ff1ecf14d9a req-0c2434a9-2c47-401b-9860-1686b84adfe5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:49.169552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-975f931d-bee8-43eb-9afb-8ff1ecf14d9a req-0c2434a9-2c47-401b-9860-1686b84adfe5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:49.170113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-975f931d-bee8-43eb-9afb-8ff1ecf14d9a req-0c2434a9-2c47-401b-9860-1686b84adfe5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:49.182289 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-975f931d-bee8-43eb-9afb-8ff1ecf14d9a req-0c2434a9-2c47-401b-9860-1686b84adfe5 service nova] Creating event network-vif-plugged:0733a985-3c0e-4f3d-bc27-95bab6ff2222 for instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e on n-h2-860864-3 Oct 11 19:54:49.187681 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-975f931d-bee8-43eb-9afb-8ff1ecf14d9a req-0c2434a9-2c47-401b-9860-1686b84adfe5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035904 Oct 11 19:54:49.188633 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1532/3007] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:49.196100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-034893c8-78c4-41f2-93bd-b23ab3c3d4e2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:49.197008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-034893c8-78c4-41f2-93bd-b23ab3c3d4e2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:49.203354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-034893c8-78c4-41f2-93bd-b23ab3c3d4e2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:49.203914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-034893c8-78c4-41f2-93bd-b23ab3c3d4e2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:49.204251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-034893c8-78c4-41f2-93bd-b23ab3c3d4e2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:49.205095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-034893c8-78c4-41f2-93bd-b23ab3c3d4e2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:49.205553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-034893c8-78c4-41f2-93bd-b23ab3c3d4e2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:49.205988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-034893c8-78c4-41f2-93bd-b23ab3c3d4e2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:49.383790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Building network info cache for instance {{(pid=126955) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 19:54:49.415466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-034893c8-78c4-41f2-93bd-b23ab3c3d4e2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:49.424499 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-034893c8-78c4-41f2-93bd-b23ab3c3d4e2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.233182 Oct 11 19:54:49.425918 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1533/3008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:49 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:54:49.436417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-465268c1-144b-42ac-b635-e9706ac5791b req-9121c853-859c-4d79-af35-3fc5a6a3b6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99eb7ce1-c903-472e-b46a-6714f5362eb9", "tag": "a2e6b196-5acc-46eb-b34c-0fe50a81feea"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:49.447969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-465268c1-144b-42ac-b635-e9706ac5791b req-9121c853-859c-4d79-af35-3fc5a6a3b6a4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:49.448828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-465268c1-144b-42ac-b635-e9706ac5791b req-9121c853-859c-4d79-af35-3fc5a6a3b6a4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:49.449421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-465268c1-144b-42ac-b635-e9706ac5791b req-9121c853-859c-4d79-af35-3fc5a6a3b6a4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:49.466874 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-465268c1-144b-42ac-b635-e9706ac5791b req-9121c853-859c-4d79-af35-3fc5a6a3b6a4 service nova] Creating event network-changed:a2e6b196-5acc-46eb-b34c-0fe50a81feea for instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 on n-h1-860864-3 Oct 11 19:54:49.472306 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-465268c1-144b-42ac-b635-e9706ac5791b req-9121c853-859c-4d79-af35-3fc5a6a3b6a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045028 Oct 11 19:54:49.473184 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1534/3009] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:49.529664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6201522a-c747-4da3-8a26-344423c99770 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:49.530478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6201522a-c747-4da3-8a26-344423c99770 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:49.537044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201522a-c747-4da3-8a26-344423c99770 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:49.537746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201522a-c747-4da3-8a26-344423c99770 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:49.538227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201522a-c747-4da3-8a26-344423c99770 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:49.538994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201522a-c747-4da3-8a26-344423c99770 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:49.539445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201522a-c747-4da3-8a26-344423c99770 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:49.540151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201522a-c747-4da3-8a26-344423c99770 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:49.874131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6201522a-c747-4da3-8a26-344423c99770 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:49.887203 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6201522a-c747-4da3-8a26-344423c99770 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.361535 Oct 11 19:54:49.889023 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1535/3010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:49 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:54:49.907029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1918830f-b213-45bb-b2b2-e056c713d752 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:49.907656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1918830f-b213-45bb-b2b2-e056c713d752 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:49.916094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1918830f-b213-45bb-b2b2-e056c713d752 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:49.916800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1918830f-b213-45bb-b2b2-e056c713d752 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:49.917397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1918830f-b213-45bb-b2b2-e056c713d752 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:49.918515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1918830f-b213-45bb-b2b2-e056c713d752 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:49.919158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1918830f-b213-45bb-b2b2-e056c713d752 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:49.920196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1918830f-b213-45bb-b2b2-e056c713d752 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:50.151626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:50.532957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1918830f-b213-45bb-b2b2-e056c713d752 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:50.552589 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1918830f-b213-45bb-b2b2-e056c713d752 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1317 microversion: 2.1 time: 0.662153 Oct 11 19:54:50.553518 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1536/3011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:49 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:50.561886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3951706d-c424-4caa-932a-3b281ad4e5bb tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:50.562561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3951706d-c424-4caa-932a-3b281ad4e5bb tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:50.570888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3951706d-c424-4caa-932a-3b281ad4e5bb tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:50.571392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3951706d-c424-4caa-932a-3b281ad4e5bb tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:50.571861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3951706d-c424-4caa-932a-3b281ad4e5bb tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:50.572830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3951706d-c424-4caa-932a-3b281ad4e5bb tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:50.573294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3951706d-c424-4caa-932a-3b281ad4e5bb tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:50.579331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3951706d-c424-4caa-932a-3b281ad4e5bb tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:50.691806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3951706d-c424-4caa-932a-3b281ad4e5bb tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:50.699007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:50.710496 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3951706d-c424-4caa-932a-3b281ad4e5bb tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 200 len: 1431 microversion: 2.1 time: 0.154781 Oct 11 19:54:50.723623 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1537/3012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:50 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 1431 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:50.734451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-75a8db23-5bff-4738-af92-2628f934a258 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:50.735252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-75a8db23-5bff-4738-af92-2628f934a258 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:50.744963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75a8db23-5bff-4738-af92-2628f934a258 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:50.746347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75a8db23-5bff-4738-af92-2628f934a258 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:50.747411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75a8db23-5bff-4738-af92-2628f934a258 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:50.748649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75a8db23-5bff-4738-af92-2628f934a258 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:50.751225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75a8db23-5bff-4738-af92-2628f934a258 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:50.751919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-75a8db23-5bff-4738-af92-2628f934a258 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.206678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Updating instance_info_cache with network_info: [{"id": "a2e6b196-5acc-46eb-b34c-0fe50a81feea", "address": "fa:16:3e:9d:f2:17", "network": {"id": "7a6ff9a3-562e-460e-852c-3de4b0a9fb24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-882790043-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "76591022a59449b7b24a2de96cba0fa0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa2e6b196-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126955) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:54:51.226802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-75a8db23-5bff-4738-af92-2628f934a258 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:51.232098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Releasing lock "refresh_cache-99eb7ce1-c903-472e-b46a-6714f5362eb9" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:54:51.233563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c9d12e9f-b181-4e8a-a82b-e559d8858d1a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "POST /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9/action" status: 202 len: 0 microversion: 2.1 time: 3.483369 Oct 11 19:54:51.234599 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1476/3013] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:47 2022] POST /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9/action => generated 0 bytes in 3485 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 11 19:54:51.239512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-82a26078-4d34-470d-8a65-513e5d5cc34f req-427c782e-ac39-49f3-99c0-8093b2b2dbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1f8956-214c-4f94-b8a9-c7bb03b56104", "name": "network-vif-deleted", "tag": "3003e5ed-e486-4f4c-954b-6ab7b07147e9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:51.249313 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-75a8db23-5bff-4738-af92-2628f934a258 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.524132 Oct 11 19:54:51.250895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-82a26078-4d34-470d-8a65-513e5d5cc34f req-427c782e-ac39-49f3-99c0-8093b2b2dbd0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.251608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-82a26078-4d34-470d-8a65-513e5d5cc34f req-427c782e-ac39-49f3-99c0-8093b2b2dbd0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.252528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-82a26078-4d34-470d-8a65-513e5d5cc34f req-427c782e-ac39-49f3-99c0-8093b2b2dbd0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.256411 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1538/3014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:50 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:51.267096 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-82a26078-4d34-470d-8a65-513e5d5cc34f req-427c782e-ac39-49f3-99c0-8093b2b2dbd0 service nova] Creating event network-vif-deleted:3003e5ed-e486-4f4c-954b-6ab7b07147e9 for instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 on n-h1-860864-3 Oct 11 19:54:51.267682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a1e40cdb-d1dc-47c6-9134-c256dc1f2256 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:51.268297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a1e40cdb-d1dc-47c6-9134-c256dc1f2256 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:51.277792 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-82a26078-4d34-470d-8a65-513e5d5cc34f req-427c782e-ac39-49f3-99c0-8093b2b2dbd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041671 Oct 11 19:54:51.278397 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1477/3015] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:51.290926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.66"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:51.291149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1e40cdb-d1dc-47c6-9134-c256dc1f2256 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.294068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:51.302726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1e40cdb-d1dc-47c6-9134-c256dc1f2256 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.303273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1e40cdb-d1dc-47c6-9134-c256dc1f2256 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.304906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1e40cdb-d1dc-47c6-9134-c256dc1f2256 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.305459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1e40cdb-d1dc-47c6-9134-c256dc1f2256 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.306260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1e40cdb-d1dc-47c6-9134-c256dc1f2256 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.312567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.313113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.313726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.314257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.314829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.315287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.350333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "refresh_cache-a81262ad-d0a5-4c11-ad76-efd8e0564d34" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:54:51.351339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquired lock "refresh_cache-a81262ad-d0a5-4c11-ad76-efd8e0564d34" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:54:51.556331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a1e40cdb-d1dc-47c6-9134-c256dc1f2256 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:51.564404 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a1e40cdb-d1dc-47c6-9134-c256dc1f2256 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.300542 Oct 11 19:54:51.565161 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1539/3016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:51 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:51.579850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98a3077a-86e4-4d20-b020-5b10c85c885a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:51.580603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-98a3077a-86e4-4d20-b020-5b10c85c885a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:51.587281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a3077a-86e4-4d20-b020-5b10c85c885a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.587930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a3077a-86e4-4d20-b020-5b10c85c885a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.588468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a3077a-86e4-4d20-b020-5b10c85c885a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.589258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a3077a-86e4-4d20-b020-5b10c85c885a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.589804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a3077a-86e4-4d20-b020-5b10c85c885a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.590332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98a3077a-86e4-4d20-b020-5b10c85c885a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.882241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-98a3077a-86e4-4d20-b020-5b10c85c885a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:51.894748 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98a3077a-86e4-4d20-b020-5b10c85c885a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1507 microversion: 2.1 time: 0.319014 Oct 11 19:54:51.896345 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1540/3017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:51 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:54:51.903633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:51.904332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 5f1f8956-214c-4f94-b8a9-c7bb03b56104] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:51.915821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.916565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.917177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.918065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.918909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.919513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.936038 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] HTTP exception thrown: Instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 could not be found. Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Request method failure captured: Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 HTTP/1.1 Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcmBUhKA8h6W0kD82d11Y0h4GXTo93-8tOWPp4LjBIEcw-fx-k6hRiFheNglwq6r-7wNBYE0YgEGGSS3-vAij1yLgcsOlbycCBQQ0pRvvMEGHLtLlt4nRg-15pdgghGCBHeAGTcB5I5ZsjyDs6h_vB5_Hx8U-PPRBGDlKdBaryqMoY0 Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 60660b00dcde45ab82615713f086851e Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ListImageFiltersTestJSON-1858433970 Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/60660b00dcde45ab82615713f086851e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_60660b00dcde45ab82615713f086851e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60660b00dcde45ab82615713f086851e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60660b00dcde45ab82615713f086851e"}]}] Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ListImageFiltersTestJSON-1858433970 Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 60660b00dcde45ab82615713f086851e Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1858433970 Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ListImageFiltersTestJSON-1858433970-project Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 6d10af74e94344029b7d19060dadc700 Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ListImageFiltersTestJSON-1858433970-project Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 could not be found. Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5f1f8956-214c-4f94-b8a9-c7bb03b56104'} Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 could not be found. Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 could not be found. Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:54:51.938045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:51.943557 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:51.943557 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:54:51.943557 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:54:51.943557 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:54:51.943557 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:54:51.943557 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 could not be found. Oct 11 19:54:51.943557 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:54:51.943557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Returning 404 to user: Instance 5f1f8956-214c-4f94-b8a9-c7bb03b56104 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:54:51.943557 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-730782a4-b5fe-4f7e-a723-a68864b3c716 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104" status: 404 len: 111 microversion: 2.1 time: 0.041928 Oct 11 19:54:51.943557 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1541/3018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:51 2022] GET /compute/v2.1/servers/5f1f8956-214c-4f94-b8a9-c7bb03b56104 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:54:51.948662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-060e36f0-a056-4e95-94a1-408c2271dc12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:51.949204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-060e36f0-a056-4e95-94a1-408c2271dc12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:51.955316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-060e36f0-a056-4e95-94a1-408c2271dc12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.955823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-060e36f0-a056-4e95-94a1-408c2271dc12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.956451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-060e36f0-a056-4e95-94a1-408c2271dc12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.957144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-060e36f0-a056-4e95-94a1-408c2271dc12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:51.957596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-060e36f0-a056-4e95-94a1-408c2271dc12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:51.958015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-060e36f0-a056-4e95-94a1-408c2271dc12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:51.986869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-060e36f0-a056-4e95-94a1-408c2271dc12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:54:52.083753 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-060e36f0-a056-4e95-94a1-408c2271dc12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 204 len: 0 microversion: 2.1 time: 0.142581 Oct 11 19:54:52.084395 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1542/3019] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:54:51 2022] DELETE /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:54:52.092104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-219e0b2e-d85f-4d3b-9cff-2552f2074eb4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:52.092972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-219e0b2e-d85f-4d3b-9cff-2552f2074eb4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:52.099864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219e0b2e-d85f-4d3b-9cff-2552f2074eb4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:52.100352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219e0b2e-d85f-4d3b-9cff-2552f2074eb4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:52.101571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219e0b2e-d85f-4d3b-9cff-2552f2074eb4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:52.102283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219e0b2e-d85f-4d3b-9cff-2552f2074eb4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:52.102764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219e0b2e-d85f-4d3b-9cff-2552f2074eb4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:52.103221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219e0b2e-d85f-4d3b-9cff-2552f2074eb4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:52.131284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-219e0b2e-d85f-4d3b-9cff-2552f2074eb4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:54:52.237298 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-219e0b2e-d85f-4d3b-9cff-2552f2074eb4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 204 len: 0 microversion: 2.1 time: 0.149762 Oct 11 19:54:52.240833 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1543/3020] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:54:52 2022] DELETE /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:54:52.245155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-daa0cfe8-0966-4013-8b14-d038d672435a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:52.245865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-daa0cfe8-0966-4013-8b14-d038d672435a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:52.252599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daa0cfe8-0966-4013-8b14-d038d672435a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:52.253208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daa0cfe8-0966-4013-8b14-d038d672435a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:52.253711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daa0cfe8-0966-4013-8b14-d038d672435a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:52.254552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daa0cfe8-0966-4013-8b14-d038d672435a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:52.255035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daa0cfe8-0966-4013-8b14-d038d672435a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:52.255463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-daa0cfe8-0966-4013-8b14-d038d672435a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:52.339049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:52.480181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-daa0cfe8-0966-4013-8b14-d038d672435a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:52.488305 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-daa0cfe8-0966-4013-8b14-d038d672435a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1513 microversion: 2.1 time: 0.248587 Oct 11 19:54:52.488886 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1544/3021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:52 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:52.495676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1d620b92-a2ad-4a0d-b2dc-6744dccc75b2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:52.496499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1d620b92-a2ad-4a0d-b2dc-6744dccc75b2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:52.503501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d620b92-a2ad-4a0d-b2dc-6744dccc75b2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:52.504809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d620b92-a2ad-4a0d-b2dc-6744dccc75b2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:52.505415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d620b92-a2ad-4a0d-b2dc-6744dccc75b2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:52.506340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d620b92-a2ad-4a0d-b2dc-6744dccc75b2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:52.507472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d620b92-a2ad-4a0d-b2dc-6744dccc75b2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:52.508553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d620b92-a2ad-4a0d-b2dc-6744dccc75b2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:52.723245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1d620b92-a2ad-4a0d-b2dc-6744dccc75b2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:52.731709 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1d620b92-a2ad-4a0d-b2dc-6744dccc75b2 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 200 len: 1474 microversion: 2.1 time: 0.241511 Oct 11 19:54:52.732289 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1545/3022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:52 2022] GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 1474 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:52.737246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-201a6f03-9b7a-4f37-873c-f48d43c4dc17 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:52.738120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-201a6f03-9b7a-4f37-873c-f48d43c4dc17 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:52.745083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a6f03-9b7a-4f37-873c-f48d43c4dc17 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:52.745793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a6f03-9b7a-4f37-873c-f48d43c4dc17 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:52.746385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a6f03-9b7a-4f37-873c-f48d43c4dc17 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:52.747251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a6f03-9b7a-4f37-873c-f48d43c4dc17 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:52.747865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a6f03-9b7a-4f37-873c-f48d43c4dc17 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:52.748291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a6f03-9b7a-4f37-873c-f48d43c4dc17 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:52.973231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-201a6f03-9b7a-4f37-873c-f48d43c4dc17 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:52.981906 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-201a6f03-9b7a-4f37-873c-f48d43c4dc17 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.248430 Oct 11 19:54:52.999056 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1546/3023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:52 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:53.004456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2417e8ae-c2f8-49c7-a23c-7b09115a877d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:53.005361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2417e8ae-c2f8-49c7-a23c-7b09115a877d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:53.014947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2417e8ae-c2f8-49c7-a23c-7b09115a877d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:53.015841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2417e8ae-c2f8-49c7-a23c-7b09115a877d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:53.016975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2417e8ae-c2f8-49c7-a23c-7b09115a877d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:53.018442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2417e8ae-c2f8-49c7-a23c-7b09115a877d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:53.019310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2417e8ae-c2f8-49c7-a23c-7b09115a877d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:53.019945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2417e8ae-c2f8-49c7-a23c-7b09115a877d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:53.234014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2417e8ae-c2f8-49c7-a23c-7b09115a877d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:53.247905 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2417e8ae-c2f8-49c7-a23c-7b09115a877d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.246501 Oct 11 19:54:53.248789 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1547/3024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:52 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:53.396472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-98d32805-4f76-4271-a6fb-0d5ca2075a5e req-24b3a428-614e-42cf-abb3-1268f120942b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99eb7ce1-c903-472e-b46a-6714f5362eb9", "tag": "a2e6b196-5acc-46eb-b34c-0fe50a81feea"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:53.407532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-98d32805-4f76-4271-a6fb-0d5ca2075a5e req-24b3a428-614e-42cf-abb3-1268f120942b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:53.408330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-98d32805-4f76-4271-a6fb-0d5ca2075a5e req-24b3a428-614e-42cf-abb3-1268f120942b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:53.409266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-98d32805-4f76-4271-a6fb-0d5ca2075a5e req-24b3a428-614e-42cf-abb3-1268f120942b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:53.423642 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-98d32805-4f76-4271-a6fb-0d5ca2075a5e req-24b3a428-614e-42cf-abb3-1268f120942b service nova] Creating event network-changed:a2e6b196-5acc-46eb-b34c-0fe50a81feea for instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 on n-h1-860864-3 Oct 11 19:54:53.430656 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-98d32805-4f76-4271-a6fb-0d5ca2075a5e req-24b3a428-614e-42cf-abb3-1268f120942b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037831 Oct 11 19:54:53.432386 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1548/3025] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:54:53.513987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a73a328-3381-4cb5-9719-b1fb1a9193d1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:53.514915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a73a328-3381-4cb5-9719-b1fb1a9193d1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:53.521459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a73a328-3381-4cb5-9719-b1fb1a9193d1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:53.522241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a73a328-3381-4cb5-9719-b1fb1a9193d1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:53.523038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a73a328-3381-4cb5-9719-b1fb1a9193d1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:53.524168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a73a328-3381-4cb5-9719-b1fb1a9193d1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:53.524795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a73a328-3381-4cb5-9719-b1fb1a9193d1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:53.525510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a73a328-3381-4cb5-9719-b1fb1a9193d1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:53.541677 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.network.neutron [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] re-assign floating IP 172.25.2.66 from instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 Oct 11 19:54:53.627684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Building network info cache for instance {{(pid=126955) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 19:54:54.218297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a73a328-3381-4cb5-9719-b1fb1a9193d1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:54.227559 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a73a328-3381-4cb5-9719-b1fb1a9193d1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1513 microversion: 2.1 time: 0.717613 Oct 11 19:54:54.250425 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1549/3026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:53 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1513 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:54:54.259175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0e54f02-a412-4481-9a55-52c4c62c8ac4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:54.259721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a0e54f02-a412-4481-9a55-52c4c62c8ac4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:54.278221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e54f02-a412-4481-9a55-52c4c62c8ac4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:54.278756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e54f02-a412-4481-9a55-52c4c62c8ac4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:54.279201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e54f02-a412-4481-9a55-52c4c62c8ac4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:54.279903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e54f02-a412-4481-9a55-52c4c62c8ac4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:54.283156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e54f02-a412-4481-9a55-52c4c62c8ac4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:54.283597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e54f02-a412-4481-9a55-52c4c62c8ac4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:54.615727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a0e54f02-a412-4481-9a55-52c4c62c8ac4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:54.629006 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a0e54f02-a412-4481-9a55-52c4c62c8ac4 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 200 len: 1474 microversion: 2.1 time: 0.374164 Oct 11 19:54:54.631094 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1550/3027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:54 2022] GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 1474 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:54.637824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c5fa4280-b563-47cf-82cd-25f1e59c1cc2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:54.638868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c5fa4280-b563-47cf-82cd-25f1e59c1cc2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:54.646940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5fa4280-b563-47cf-82cd-25f1e59c1cc2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:54.649103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5fa4280-b563-47cf-82cd-25f1e59c1cc2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:54.649759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5fa4280-b563-47cf-82cd-25f1e59c1cc2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:54.651111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5fa4280-b563-47cf-82cd-25f1e59c1cc2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:54.651868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5fa4280-b563-47cf-82cd-25f1e59c1cc2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:54.653133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5fa4280-b563-47cf-82cd-25f1e59c1cc2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:54.916862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:54.977275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c5fa4280-b563-47cf-82cd-25f1e59c1cc2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:54.986549 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c5fa4280-b563-47cf-82cd-25f1e59c1cc2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.352978 Oct 11 19:54:55.001746 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1551/3028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:54 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:55.009053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-46efe71b-4051-48c7-bc14-5bf749ae1b3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:55.009734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-46efe71b-4051-48c7-bc14-5bf749ae1b3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:55.018578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Updating instance_info_cache with network_info: [{"id": "a2e6b196-5acc-46eb-b34c-0fe50a81feea", "address": "fa:16:3e:9d:f2:17", "network": {"id": "7a6ff9a3-562e-460e-852c-3de4b0a9fb24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-882790043-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "76591022a59449b7b24a2de96cba0fa0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa2e6b196-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126955) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:54:55.032776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Building network info cache for instance {{(pid=126955) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 19:54:55.035606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46efe71b-4051-48c7-bc14-5bf749ae1b3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:55.036365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46efe71b-4051-48c7-bc14-5bf749ae1b3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:55.036967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46efe71b-4051-48c7-bc14-5bf749ae1b3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:55.037902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46efe71b-4051-48c7-bc14-5bf749ae1b3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:55.038801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46efe71b-4051-48c7-bc14-5bf749ae1b3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:55.039395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46efe71b-4051-48c7-bc14-5bf749ae1b3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:55.067758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:55.287789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-46efe71b-4051-48c7-bc14-5bf749ae1b3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:55.301244 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-46efe71b-4051-48c7-bc14-5bf749ae1b3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.298184 Oct 11 19:54:55.313478 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1552/3029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:55 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:55.313478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e06c72d8-c6d1-4136-9a0a-f449689f9131 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:55.313954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e06c72d8-c6d1-4136-9a0a-f449689f9131 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:55.325488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06c72d8-c6d1-4136-9a0a-f449689f9131 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:55.326231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06c72d8-c6d1-4136-9a0a-f449689f9131 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:55.327000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06c72d8-c6d1-4136-9a0a-f449689f9131 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:55.328889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06c72d8-c6d1-4136-9a0a-f449689f9131 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:55.329642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06c72d8-c6d1-4136-9a0a-f449689f9131 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:55.330156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e06c72d8-c6d1-4136-9a0a-f449689f9131 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:55.342718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=12 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:55.558589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e06c72d8-c6d1-4136-9a0a-f449689f9131 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:55.567259 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e06c72d8-c6d1-4136-9a0a-f449689f9131 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1513 microversion: 2.1 time: 0.260755 Oct 11 19:54:55.567837 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1553/3030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:55 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1513 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:55.573058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f880658e-23fc-435c-bbf0-83d928b2daf3 req-6a2a1d1b-b6a9-4306-9013-a9eb622029a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81262ad-d0a5-4c11-ad76-efd8e0564d34", "tag": "63e79eeb-5abc-4b9b-97ae-07fc9a76fd42"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:55.582317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f880658e-23fc-435c-bbf0-83d928b2daf3 req-6a2a1d1b-b6a9-4306-9013-a9eb622029a6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:55.583095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f880658e-23fc-435c-bbf0-83d928b2daf3 req-6a2a1d1b-b6a9-4306-9013-a9eb622029a6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:55.583693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f880658e-23fc-435c-bbf0-83d928b2daf3 req-6a2a1d1b-b6a9-4306-9013-a9eb622029a6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:55.595966 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f880658e-23fc-435c-bbf0-83d928b2daf3 req-6a2a1d1b-b6a9-4306-9013-a9eb622029a6 service nova] Creating event network-changed:63e79eeb-5abc-4b9b-97ae-07fc9a76fd42 for instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 on n-h2-860864-3 Oct 11 19:54:55.601368 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f880658e-23fc-435c-bbf0-83d928b2daf3 req-6a2a1d1b-b6a9-4306-9013-a9eb622029a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031601 Oct 11 19:54:55.602157 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1554/3031] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:55.661533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9945aacc-0577-401e-89af-4a731f0474cd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:55.662794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9945aacc-0577-401e-89af-4a731f0474cd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:55.671253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9945aacc-0577-401e-89af-4a731f0474cd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:55.671972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9945aacc-0577-401e-89af-4a731f0474cd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:55.672566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9945aacc-0577-401e-89af-4a731f0474cd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:55.673345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9945aacc-0577-401e-89af-4a731f0474cd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:55.673803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9945aacc-0577-401e-89af-4a731f0474cd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:55.674298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9945aacc-0577-401e-89af-4a731f0474cd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:55.832767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Updating instance_info_cache with network_info: [{"id": "63e79eeb-5abc-4b9b-97ae-07fc9a76fd42", "address": "fa:16:3e:24:16:7d", "network": {"id": "7a6ff9a3-562e-460e-852c-3de4b0a9fb24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-882790043-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "76591022a59449b7b24a2de96cba0fa0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap63e79eeb-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126955) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:54:55.846956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Releasing lock "refresh_cache-a81262ad-d0a5-4c11-ad76-efd8e0564d34" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:54:55.848293 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca4fd37a-1502-4e8f-8ec7-d5e9340cabdb tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "POST /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34/action" status: 202 len: 0 microversion: 2.1 time: 4.564963 Oct 11 19:54:55.849220 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1478/3032] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:51 2022] POST /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34/action => generated 0 bytes in 4570 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 19:54:55.864210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9945aacc-0577-401e-89af-4a731f0474cd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:55.872782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.66"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:55.880856 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9945aacc-0577-401e-89af-4a731f0474cd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 200 len: 1474 microversion: 2.1 time: 0.224091 Oct 11 19:54:55.881450 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1555/3033] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:55 2022] GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 1474 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:56.013236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4786f04d-321a-4934-8205-15c8f5cd0bbd tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:56.014052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4786f04d-321a-4934-8205-15c8f5cd0bbd tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:56.014883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:56.021029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4786f04d-321a-4934-8205-15c8f5cd0bbd tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:56.021553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4786f04d-321a-4934-8205-15c8f5cd0bbd tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:56.021877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:56.022402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4786f04d-321a-4934-8205-15c8f5cd0bbd tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:56.023113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:56.023406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4786f04d-321a-4934-8205-15c8f5cd0bbd tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:56.023548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:56.023875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4786f04d-321a-4934-8205-15c8f5cd0bbd tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:56.024376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4786f04d-321a-4934-8205-15c8f5cd0bbd tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:56.024461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:56.024868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:56.025289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:56.594968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4786f04d-321a-4934-8205-15c8f5cd0bbd tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:56.608451 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4786f04d-321a-4934-8205-15c8f5cd0bbd tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.599764 Oct 11 19:54:56.609668 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1556/3034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:56 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:54:56.614874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ea2a5a3b-56e7-47f4-bd6a-17bbcb3033e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:56.615752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ea2a5a3b-56e7-47f4-bd6a-17bbcb3033e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:56.623790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea2a5a3b-56e7-47f4-bd6a-17bbcb3033e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:56.625527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea2a5a3b-56e7-47f4-bd6a-17bbcb3033e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:56.627213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea2a5a3b-56e7-47f4-bd6a-17bbcb3033e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:56.628628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea2a5a3b-56e7-47f4-bd6a-17bbcb3033e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:56.629370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea2a5a3b-56e7-47f4-bd6a-17bbcb3033e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:56.630193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea2a5a3b-56e7-47f4-bd6a-17bbcb3033e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:56.792241 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] HTTP exception thrown: Floating IP 172.25.2.66 is not associated with instance 99eb7ce1-c903-472e-b46a-6714f5362eb9. Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Request method failure captured: Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9/action HTTP/1.1 Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 48 Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnbDIk3ck9VBiVt9aQGkTWqPQ-jEULaIwVLj5QT6YM3LrWeSQS_5PrxXCW606FwZS1FGHRiI5XwNy-9PiCfv8ypAnBlzezzv7XMWMOkHWWJcy8zsT-MnBkAPtDw8sgPeQXw3Oktzce1MXs6qy9cMmYJdwVBcczFCIdNfBOzksZlupY Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 76591022a59449b7b24a2de96cba0fa0 Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/76591022a59449b7b24a2de96cba0fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_76591022a59449b7b24a2de96cba0fa0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76591022a59449b7b24a2de96cba0fa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76591022a59449b7b24a2de96cba0fa0"}]}] Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 76591022a59449b7b24a2de96cba0fa0 Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FloatingIPsAssociationTestJSON-199861992-project Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 87ead5931eec4b68a40cd635295de387 Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-199861992-project Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: {"removeFloatingIp": {"address": "172.25.2.66"}} Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: exception: Floating IP 172.25.2.66 is not associated with instance 99eb7ce1-c903-472e-b46a-6714f5362eb9. Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '99eb7ce1-c903-472e-b46a-6714f5362eb9', 'body': {'removeFloatingIp': {'address': '172.25.2.66'}}} Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.66 is not associated with instance 99eb7ce1-c903-472e-b46a-6714f5362eb9. Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.66 is not associated with instance 99eb7ce1-c903-472e-b46a-6714f5362eb9. Oct 11 19:54:56.794663 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:54:56.800027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Returning 409 to user: Floating IP 172.25.2.66 is not associated with instance 99eb7ce1-c903-472e-b46a-6714f5362eb9. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:54:56.800899 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b772fa0b-38f2-47d1-ac9f-0be2d12e602b tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "POST /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9/action" status: 409 len: 145 microversion: 2.1 time: 0.947533 Oct 11 19:54:56.805295 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1479/3035] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:55 2022] POST /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9/action => generated 145 bytes in 949 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 11 19:54:56.808661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff5b8c08-51e6-487c-a42c-a02b6cd7c78c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:56.809316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ff5b8c08-51e6-487c-a42c-a02b6cd7c78c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:56.817001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff5b8c08-51e6-487c-a42c-a02b6cd7c78c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:56.817505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff5b8c08-51e6-487c-a42c-a02b6cd7c78c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:56.817945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff5b8c08-51e6-487c-a42c-a02b6cd7c78c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:56.818787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff5b8c08-51e6-487c-a42c-a02b6cd7c78c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:56.819213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff5b8c08-51e6-487c-a42c-a02b6cd7c78c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:56.819743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff5b8c08-51e6-487c-a42c-a02b6cd7c78c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:57.023840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ea2a5a3b-56e7-47f4-bd6a-17bbcb3033e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:57.033736 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ea2a5a3b-56e7-47f4-bd6a-17bbcb3033e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1522 microversion: 2.1 time: 0.422743 Oct 11 19:54:57.042617 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1557/3036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:56 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:57.042617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Action: 'action', calling method: .version_select at 0x7f83cebba9d0>, body: {"removeFloatingIp": {"address": "172.25.2.66"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:57.208892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ff5b8c08-51e6-487c-a42c-a02b6cd7c78c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:57.218585 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ff5b8c08-51e6-487c-a42c-a02b6cd7c78c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1513 microversion: 2.1 time: 0.414965 Oct 11 19:54:57.220085 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1480/3037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:56 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1513 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:57.228201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21c8703e-9c5f-44bc-9202-a9cacc90269c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:57.229233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-21c8703e-9c5f-44bc-9202-a9cacc90269c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:57.236346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c8703e-9c5f-44bc-9202-a9cacc90269c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:57.236844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c8703e-9c5f-44bc-9202-a9cacc90269c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:57.237276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c8703e-9c5f-44bc-9202-a9cacc90269c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:57.237976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c8703e-9c5f-44bc-9202-a9cacc90269c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:57.238426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c8703e-9c5f-44bc-9202-a9cacc90269c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:57.238887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21c8703e-9c5f-44bc-9202-a9cacc90269c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:57.360991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:57.371862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:57.372369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:57.372951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:57.375000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:57.375668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:57.376394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:57.993092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-21c8703e-9c5f-44bc-9202-a9cacc90269c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:58.011652 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21c8703e-9c5f-44bc-9202-a9cacc90269c tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 200 len: 1474 microversion: 2.1 time: 0.790047 Oct 11 19:54:58.013763 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1481/3038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:57 2022] GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 1474 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:58.020991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-83360c36-b434-46eb-8994-d6c0dad81ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:58.028417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-83360c36-b434-46eb-8994-d6c0dad81ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:58.049020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:58.050998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83360c36-b434-46eb-8994-d6c0dad81ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:58.051763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83360c36-b434-46eb-8994-d6c0dad81ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:58.052742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83360c36-b434-46eb-8994-d6c0dad81ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:58.060314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83360c36-b434-46eb-8994-d6c0dad81ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:58.061520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83360c36-b434-46eb-8994-d6c0dad81ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:58.062205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83360c36-b434-46eb-8994-d6c0dad81ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:58.251808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "refresh_cache-a81262ad-d0a5-4c11-ad76-efd8e0564d34" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:54:58.252295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquired lock "refresh_cache-a81262ad-d0a5-4c11-ad76-efd8e0564d34" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:54:58.343829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-83360c36-b434-46eb-8994-d6c0dad81ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:58.360125 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-83360c36-b434-46eb-8994-d6c0dad81ccf tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.344000 Oct 11 19:54:58.362186 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1482/3039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:58 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:58.367951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f0aff6e4-a411-40d3-8896-31f61db66e85 req-4129265a-9023-45b2-80e4-70d941ad3d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0929e96c-9da0-4034-ae0e-38f7330002f5", "name": "network-vif-deleted", "tag": "71f8f1b2-5864-4201-894f-6d7e1edc96c4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:58.384420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0aff6e4-a411-40d3-8896-31f61db66e85 req-4129265a-9023-45b2-80e4-70d941ad3d29 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:58.385762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0aff6e4-a411-40d3-8896-31f61db66e85 req-4129265a-9023-45b2-80e4-70d941ad3d29 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:58.386420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0aff6e4-a411-40d3-8896-31f61db66e85 req-4129265a-9023-45b2-80e4-70d941ad3d29 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:58.399413 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f0aff6e4-a411-40d3-8896-31f61db66e85 req-4129265a-9023-45b2-80e4-70d941ad3d29 service nova] Creating event network-vif-deleted:71f8f1b2-5864-4201-894f-6d7e1edc96c4 for instance 0929e96c-9da0-4034-ae0e-38f7330002f5 on n-h2-860864-3 Oct 11 19:54:58.408940 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f0aff6e4-a411-40d3-8896-31f61db66e85 req-4129265a-9023-45b2-80e4-70d941ad3d29 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041604 Oct 11 19:54:58.408940 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1483/3040] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:54:58.412634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-acf458a6-51b0-4369-938b-869c07a4a792 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:58.415343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-acf458a6-51b0-4369-938b-869c07a4a792 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:58.422610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf458a6-51b0-4369-938b-869c07a4a792 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:58.423347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf458a6-51b0-4369-938b-869c07a4a792 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:58.424259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf458a6-51b0-4369-938b-869c07a4a792 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:58.424980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf458a6-51b0-4369-938b-869c07a4a792 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:58.425436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf458a6-51b0-4369-938b-869c07a4a792 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:58.425861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf458a6-51b0-4369-938b-869c07a4a792 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:58.728128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-acf458a6-51b0-4369-938b-869c07a4a792 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:58.736822 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-acf458a6-51b0-4369-938b-869c07a4a792 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1502 microversion: 2.1 time: 0.328901 Oct 11 19:54:58.737603 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1484/3041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:58 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:58.743344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:58.743946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:58.750262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:58.750793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:58.751362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:58.752255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:58.752699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:58.753132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:58.793965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:58.794745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:58.795816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:58.796427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lazy-loading 'fault' on Instance uuid f2251c32-cb71-4195-a9df-cf9ea9f3c20e {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:54:58.866686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:58.891395 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c3a14bc8-9ecc-482d-9c35-562051758b4c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 200 len: 1307 microversion: 2.1 time: 0.152525 Oct 11 19:54:58.906688 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1485/3042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:58 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 1307 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:58.911325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dcc0f72e-40ec-436d-9e21-123a47b67506 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:58.911962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dcc0f72e-40ec-436d-9e21-123a47b67506 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:58.919726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcc0f72e-40ec-436d-9e21-123a47b67506 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:58.920425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcc0f72e-40ec-436d-9e21-123a47b67506 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:58.921122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcc0f72e-40ec-436d-9e21-123a47b67506 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:58.921971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcc0f72e-40ec-436d-9e21-123a47b67506 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:58.922627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcc0f72e-40ec-436d-9e21-123a47b67506 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:58.923207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcc0f72e-40ec-436d-9e21-123a47b67506 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:59.207181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dcc0f72e-40ec-436d-9e21-123a47b67506 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:59.217367 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dcc0f72e-40ec-436d-9e21-123a47b67506 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1516 microversion: 2.1 time: 0.315954 Oct 11 19:54:59.217960 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1486/3043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:58 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:59.223021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:59.224425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:59.232503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:59.233294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:59.234011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:59.234757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:59.235217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:59.235637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:59.275309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Building network info cache for instance {{(pid=126956) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 19:54:59.291128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:59.291600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:59.292120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:59.292518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lazy-loading 'fault' on Instance uuid 0929e96c-9da0-4034-ae0e-38f7330002f5 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:54:59.376755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d10af74e94344029b7d19060dadc700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60660b00dcde45ab82615713f086851e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:59.394303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=2,nova_cell1:RELEASE=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:54:59.409821 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bb139e0e-d54c-4ca9-9a9b-8d99c47b63bd tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 200 len: 1308 microversion: 2.1 time: 0.190814 Oct 11 19:54:59.416278 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1487/3044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:59 2022] GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:59.431169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-950bdbb4-2483-43dd-b379-9434036728e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:59.436320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-950bdbb4-2483-43dd-b379-9434036728e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: ac6e2e8d-e392-4cf1-aae2-0901cf149a09] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:59.445555 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-950bdbb4-2483-43dd-b379-9434036728e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] HTTP exception thrown: Instance ac6e2e8d-e392-4cf1-aae2-0901cf149a09 could not be found. Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-950bdbb4-2483-43dd-b379-9434036728e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Request method failure captured: Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/ac6e2e8d-e392-4cf1-aae2-0901cf149a09/action HTTP/1.1 Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 14 Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnHf-gY9GoFThGWTuyLZOFCjiBlppqFx09S1rxIOZhPN4k_d-_Y9sZYcmKSj4UOYvu9oafZcIYglvMprUUmJuXwAUoSMveDAF_xAfvCOrPvWGeWuOLI47ySPf1501t-RY5r2Fgp6Sqr-jc81_0LijQqzlDf3IXjp_i8MKsYX5dySSY Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8df2eebeffd440d988aa6f580c9bb221", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}] Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d1ab8c29f18c4fc09858791a80527e5d Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: {"rescue": {}} Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ac6e2e8d-e392-4cf1-aae2-0901cf149a09 could not be found. Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ac6e2e8d-e392-4cf1-aae2-0901cf149a09', 'body': {'rescue': {}}} Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac6e2e8d-e392-4cf1-aae2-0901cf149a09 could not be found. Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac6e2e8d-e392-4cf1-aae2-0901cf149a09 could not be found. Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:54:59.454296 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:54:59.458417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:54:59.458417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:54:59.458417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:54:59.458417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:54:59.458417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac6e2e8d-e392-4cf1-aae2-0901cf149a09 could not be found. Oct 11 19:54:59.458417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:54:59.458417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-950bdbb4-2483-43dd-b379-9434036728e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Returning 404 to user: Instance ac6e2e8d-e392-4cf1-aae2-0901cf149a09 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:54:59.458417 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-950bdbb4-2483-43dd-b379-9434036728e5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/ac6e2e8d-e392-4cf1-aae2-0901cf149a09/action" status: 404 len: 111 microversion: 2.1 time: 0.039481 Oct 11 19:54:59.463496 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1488/3045] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:59 2022] POST /compute/v2.1/servers/ac6e2e8d-e392-4cf1-aae2-0901cf149a09/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:54:59.476419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-92fbe8bd-ec91-4ec7-9919-f69b3b502171 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:59.477174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-92fbe8bd-ec91-4ec7-9919-f69b3b502171 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:59.497109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92fbe8bd-ec91-4ec7-9919-f69b3b502171 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:59.497646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92fbe8bd-ec91-4ec7-9919-f69b3b502171 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:59.498461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92fbe8bd-ec91-4ec7-9919-f69b3b502171 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:59.503262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92fbe8bd-ec91-4ec7-9919-f69b3b502171 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:59.504441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92fbe8bd-ec91-4ec7-9919-f69b3b502171 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:59.505358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92fbe8bd-ec91-4ec7-9919-f69b3b502171 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:59.758402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-92fbe8bd-ec91-4ec7-9919-f69b3b502171 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:54:59.766731 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-92fbe8bd-ec91-4ec7-9919-f69b3b502171 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.302113 Oct 11 19:54:59.780691 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1489/3046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:59 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:54:59.790829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-caadf489-e1f3-42bd-8d40-bb302beff616 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:54:59.791827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-caadf489-e1f3-42bd-8d40-bb302beff616 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:59.799282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caadf489-e1f3-42bd-8d40-bb302beff616 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:59.800045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caadf489-e1f3-42bd-8d40-bb302beff616 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:59.800693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caadf489-e1f3-42bd-8d40-bb302beff616 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:59.801631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caadf489-e1f3-42bd-8d40-bb302beff616 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:59.802377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caadf489-e1f3-42bd-8d40-bb302beff616 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:59.803080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caadf489-e1f3-42bd-8d40-bb302beff616 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:59.894492 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-caadf489-e1f3-42bd-8d40-bb302beff616 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action" status: 202 len: 0 microversion: 2.1 time: 0.111310 Oct 11 19:54:59.896519 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1490/3047] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:59 2022] POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:54:59.905935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-532542d0-b26d-42f2-a900-e6bd61260b18 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:54:59.907495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-532542d0-b26d-42f2-a900-e6bd61260b18 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:54:59.916721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-532542d0-b26d-42f2-a900-e6bd61260b18 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:59.917790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-532542d0-b26d-42f2-a900-e6bd61260b18 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:59.918595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-532542d0-b26d-42f2-a900-e6bd61260b18 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:54:59.919861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-532542d0-b26d-42f2-a900-e6bd61260b18 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:54:59.920578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-532542d0-b26d-42f2-a900-e6bd61260b18 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:54:59.921387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-532542d0-b26d-42f2-a900-e6bd61260b18 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.049179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Updating instance_info_cache with network_info: [{"id": "63e79eeb-5abc-4b9b-97ae-07fc9a76fd42", "address": "fa:16:3e:24:16:7d", "network": {"id": "7a6ff9a3-562e-460e-852c-3de4b0a9fb24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-882790043-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "76591022a59449b7b24a2de96cba0fa0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap63e79eeb-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126956) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:55:00.072208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Releasing lock "refresh_cache-a81262ad-d0a5-4c11-ad76-efd8e0564d34" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:55:00.073963 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-67e55858-96fe-4a7a-a389-fecf8492de9f tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "POST /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34/action" status: 202 len: 0 microversion: 2.1 time: 3.038582 Oct 11 19:55:00.082099 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1558/3048] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:54:57 2022] POST /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34/action => generated 0 bytes in 3047 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 19:55:00.099007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:00.099631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:00.103028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:00.109302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.110633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.111071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.111894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.112347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.112919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.132144 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e HTTP/1.1 Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'f2251c32-cb71-4195-a9df-cf9ea9f3c20e'} Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:00.133961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:00.140773 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:00.140773 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:00.140773 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:00.140773 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:00.140773 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:00.140773 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:00.140773 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:00.140773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:00.140773 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-38985e6f-5c68-4a36-baa5-cf71ea18bbf1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 404 len: 111 microversion: 2.1 time: 0.052579 Oct 11 19:55:00.140773 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1559/3049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:00 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:00.152054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3b1ececb-55f4-48ea-9146-bd1c4ceba96a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:00.152573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3b1ececb-55f4-48ea-9146-bd1c4ceba96a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:00.157029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-532542d0-b26d-42f2-a900-e6bd61260b18 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:00.159741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1ececb-55f4-48ea-9146-bd1c4ceba96a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.160429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1ececb-55f4-48ea-9146-bd1c4ceba96a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.161046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1ececb-55f4-48ea-9146-bd1c4ceba96a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.161895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1ececb-55f4-48ea-9146-bd1c4ceba96a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.163822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1ececb-55f4-48ea-9146-bd1c4ceba96a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.164431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1ececb-55f4-48ea-9146-bd1c4ceba96a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.170394 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-532542d0-b26d-42f2-a900-e6bd61260b18 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1521 microversion: 2.1 time: 0.269619 Oct 11 19:55:00.171279 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1491/3050] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:54:59 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:00.185636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-019a738d-d33e-4829-bdcb-246cfb23780f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:00.186742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-019a738d-d33e-4829-bdcb-246cfb23780f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:00.194289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-019a738d-d33e-4829-bdcb-246cfb23780f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.195166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-019a738d-d33e-4829-bdcb-246cfb23780f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.195962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-019a738d-d33e-4829-bdcb-246cfb23780f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.196997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-019a738d-d33e-4829-bdcb-246cfb23780f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.197902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-019a738d-d33e-4829-bdcb-246cfb23780f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.198630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-019a738d-d33e-4829-bdcb-246cfb23780f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.215498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3b1ececb-55f4-48ea-9146-bd1c4ceba96a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:55:00.323022 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3b1ececb-55f4-48ea-9146-bd1c4ceba96a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 204 len: 0 microversion: 2.1 time: 0.184163 Oct 11 19:55:00.323889 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1560/3051] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:55:00 2022] DELETE /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:00.338930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.66"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:00.341818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:00.347830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.348645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.349079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.349772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.350223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.351989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.378585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "refresh_cache-99eb7ce1-c903-472e-b46a-6714f5362eb9" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:55:00.378991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquired lock "refresh_cache-99eb7ce1-c903-472e-b46a-6714f5362eb9" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:55:00.430822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-019a738d-d33e-4829-bdcb-246cfb23780f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:00.440318 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-019a738d-d33e-4829-bdcb-246cfb23780f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.264920 Oct 11 19:55:00.459415 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1492/3052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:00 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:00.470690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:00.471594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] [instance: 0929e96c-9da0-4034-ae0e-38f7330002f5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:00.479214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.479951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.480638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.481594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.482279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.482974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.502508 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] HTTP exception thrown: Instance 0929e96c-9da0-4034-ae0e-38f7330002f5 could not be found. Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Request method failure captured: Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 HTTP/1.1 Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcmBUhKA8h6W0kD82d11Y0h4GXTo93-8tOWPp4LjBIEcw-fx-k6hRiFheNglwq6r-7wNBYE0YgEGGSS3-vAij1yLgcsOlbycCBQQ0pRvvMEGHLtLlt4nRg-15pdgghGCBHeAGTcB5I5ZsjyDs6h_vB5_Hx8U-PPRBGDlKdBaryqMoY0 Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 60660b00dcde45ab82615713f086851e Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ListImageFiltersTestJSON-1858433970 Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/60660b00dcde45ab82615713f086851e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_60660b00dcde45ab82615713f086851e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60660b00dcde45ab82615713f086851e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60660b00dcde45ab82615713f086851e"}]}] Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ListImageFiltersTestJSON-1858433970 Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 60660b00dcde45ab82615713f086851e Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1858433970 Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ListImageFiltersTestJSON-1858433970-project Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 6d10af74e94344029b7d19060dadc700 Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ListImageFiltersTestJSON-1858433970-project Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 0929e96c-9da0-4034-ae0e-38f7330002f5 could not be found. Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '0929e96c-9da0-4034-ae0e-38f7330002f5'} Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0929e96c-9da0-4034-ae0e-38f7330002f5 could not be found. Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0929e96c-9da0-4034-ae0e-38f7330002f5 could not be found. Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:00.505114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:00.511387 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:00.511387 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:00.511387 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:00.511387 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:00.511387 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:00.511387 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0929e96c-9da0-4034-ae0e-38f7330002f5 could not be found. Oct 11 19:55:00.511387 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:00.511387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Returning 404 to user: Instance 0929e96c-9da0-4034-ae0e-38f7330002f5 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:00.511387 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c97eab28-c410-4e0b-83f2-d8df85799c99 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5" status: 404 len: 111 microversion: 2.1 time: 0.046792 Oct 11 19:55:00.511387 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1493/3053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:00 2022] GET /compute/v2.1/servers/0929e96c-9da0-4034-ae0e-38f7330002f5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:00.519846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-73a6b5b5-c05e-41b2-a256-22f1dda4dbdf req-efc661da-5f35-455e-8638-6d877cabacb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2251c32-cb71-4195-a9df-cf9ea9f3c20e", "name": "network-vif-deleted", "tag": "0733a985-3c0e-4f3d-bc27-95bab6ff2222"}, {"name": "network-changed", "server_uuid": "a81262ad-d0a5-4c11-ad76-efd8e0564d34", "tag": "63e79eeb-5abc-4b9b-97ae-07fc9a76fd42"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:00.533089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-73a6b5b5-c05e-41b2-a256-22f1dda4dbdf req-efc661da-5f35-455e-8638-6d877cabacb5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:00.533915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-73a6b5b5-c05e-41b2-a256-22f1dda4dbdf req-efc661da-5f35-455e-8638-6d877cabacb5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:00.534593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-73a6b5b5-c05e-41b2-a256-22f1dda4dbdf req-efc661da-5f35-455e-8638-6d877cabacb5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:00.551973 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-73a6b5b5-c05e-41b2-a256-22f1dda4dbdf req-efc661da-5f35-455e-8638-6d877cabacb5 service nova] Creating event network-vif-deleted:0733a985-3c0e-4f3d-bc27-95bab6ff2222 for instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e on n-h2-860864-3 Oct 11 19:55:00.552766 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-73a6b5b5-c05e-41b2-a256-22f1dda4dbdf req-efc661da-5f35-455e-8638-6d877cabacb5 service nova] Creating event network-changed:63e79eeb-5abc-4b9b-97ae-07fc9a76fd42 for instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 on n-h2-860864-3 Oct 11 19:55:00.567224 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-73a6b5b5-c05e-41b2-a256-22f1dda4dbdf req-efc661da-5f35-455e-8638-6d877cabacb5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049890 Oct 11 19:55:00.568088 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1494/3054] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:00.577746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fa0c7d7-b2de-47e8-a3a0-3637a673f277 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0702790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:01.124848 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9fa0c7d7-b2de-47e8-a3a0-3637a673f277 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "DELETE /compute/v2.1/images/defaae22-39fe-4df4-ab49-2645d27c279e" status: 204 len: 0 microversion: 2.1 time: 0.553914 Oct 11 19:55:01.128628 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1495/3055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:00 2022] DELETE /compute/v2.1/images/defaae22-39fe-4df4-ab49-2645d27c279e => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:01.132925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8cc978b4-2374-4624-a002-eeb530710480 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8cc978b4-2374-4624-a002-eeb530710480 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 163 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": 12345, "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 12345 Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:55:01.136936 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8cc978b4-2374-4624-a002-eeb530710480 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8cc978b4-2374-4624-a002-eeb530710480 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.011792 Oct 11 19:55:01.140954 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1496/3056] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:01 2022] POST /compute/v2.1/servers => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:55:01.143400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-941a4694-bab7-4d83-8a3f-8abba0b8ffd1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:01.144110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-941a4694-bab7-4d83-8a3f-8abba0b8ffd1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:01.151977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-941a4694-bab7-4d83-8a3f-8abba0b8ffd1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:01.152477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-941a4694-bab7-4d83-8a3f-8abba0b8ffd1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:01.152910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-941a4694-bab7-4d83-8a3f-8abba0b8ffd1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:01.153613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-941a4694-bab7-4d83-8a3f-8abba0b8ffd1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:01.154077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-941a4694-bab7-4d83-8a3f-8abba0b8ffd1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:01.154511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-941a4694-bab7-4d83-8a3f-8abba0b8ffd1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:01.286322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-941a4694-bab7-4d83-8a3f-8abba0b8ffd1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:01.295025 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-941a4694-bab7-4d83-8a3f-8abba0b8ffd1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.154864 Oct 11 19:55:01.295754 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1497/3057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:01 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:01.301031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dacd31b1-8a14-4ae9-b54b-2457eeb6fb40 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0728700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:01.789531 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dacd31b1-8a14-4ae9-b54b-2457eeb6fb40 tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "DELETE /compute/v2.1/images/ffb66135-1f7a-46d1-accc-f4a029128a5d" status: 204 len: 0 microversion: 2.1 time: 0.492707 Oct 11 19:55:01.790176 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1498/3058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:01 2022] DELETE /compute/v2.1/images/ffb66135-1f7a-46d1-accc-f4a029128a5d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:01.795210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d94ea1c0-afb5-4b69-89cc-7da9c81030fb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:01.796052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d94ea1c0-afb5-4b69-89cc-7da9c81030fb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:01.802173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d94ea1c0-afb5-4b69-89cc-7da9c81030fb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:01.802712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d94ea1c0-afb5-4b69-89cc-7da9c81030fb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:01.803160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d94ea1c0-afb5-4b69-89cc-7da9c81030fb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:01.803922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d94ea1c0-afb5-4b69-89cc-7da9c81030fb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:01.804383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d94ea1c0-afb5-4b69-89cc-7da9c81030fb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:01.804820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d94ea1c0-afb5-4b69-89cc-7da9c81030fb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:02.280594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d94ea1c0-afb5-4b69-89cc-7da9c81030fb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:02.294837 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d94ea1c0-afb5-4b69-89cc-7da9c81030fb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.503296 Oct 11 19:55:02.295747 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1499/3059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:01 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:02.300448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-273ebce3-454e-4af2-b02a-6b0d7f3b1812 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:02.301051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-273ebce3-454e-4af2-b02a-6b0d7f3b1812 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:02.307152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-273ebce3-454e-4af2-b02a-6b0d7f3b1812 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:02.307843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-273ebce3-454e-4af2-b02a-6b0d7f3b1812 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:02.308424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-273ebce3-454e-4af2-b02a-6b0d7f3b1812 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:02.309262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-273ebce3-454e-4af2-b02a-6b0d7f3b1812 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:02.309925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-273ebce3-454e-4af2-b02a-6b0d7f3b1812 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:02.310502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-273ebce3-454e-4af2-b02a-6b0d7f3b1812 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:03.034965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-273ebce3-454e-4af2-b02a-6b0d7f3b1812 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:03.044251 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-273ebce3-454e-4af2-b02a-6b0d7f3b1812 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1501 microversion: 2.1 time: 0.747366 Oct 11 19:55:03.045107 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1500/3060] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:02 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1501 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:03.049237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d5dfd8e6-1999-4a48-ab56-6b200a3c873f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] Calling method '.version_select at 0x7f83d0700a60>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:03.861198 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d5dfd8e6-1999-4a48-ab56-6b200a3c873f tempest-ListImageFiltersTestJSON-1858433970 tempest-ListImageFiltersTestJSON-1858433970-project] 10.222.0.27 "DELETE /compute/v2.1/images/bf9dbab6-95f5-4fa3-9469-39fb8f7e3dac" status: 204 len: 0 microversion: 2.1 time: 0.815264 Oct 11 19:55:03.867377 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1501/3061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:03 2022] DELETE /compute/v2.1/images/bf9dbab6-95f5-4fa3-9469-39fb8f7e3dac => generated 0 bytes in 821 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:03.874394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-afc359fb-c82e-4c6f-90e6-ecf3368aded5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:03.875050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-afc359fb-c82e-4c6f-90e6-ecf3368aded5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:03.887955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-afc359fb-c82e-4c6f-90e6-ecf3368aded5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:03.888950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-afc359fb-c82e-4c6f-90e6-ecf3368aded5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:03.890285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-afc359fb-c82e-4c6f-90e6-ecf3368aded5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:03.891341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-afc359fb-c82e-4c6f-90e6-ecf3368aded5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:03.891982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-afc359fb-c82e-4c6f-90e6-ecf3368aded5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:03.892558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-afc359fb-c82e-4c6f-90e6-ecf3368aded5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:04.045157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Building network info cache for instance {{(pid=126956) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 19:55:04.175640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-afc359fb-c82e-4c6f-90e6-ecf3368aded5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:04.186717 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-afc359fb-c82e-4c6f-90e6-ecf3368aded5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.316328 Oct 11 19:55:04.188111 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1502/3062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:03 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:04.195117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7dfecbf-6298-4859-b0b5-adc435c34421 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:04.196230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e7dfecbf-6298-4859-b0b5-adc435c34421 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:04.228840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7dfecbf-6298-4859-b0b5-adc435c34421 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:04.229697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7dfecbf-6298-4859-b0b5-adc435c34421 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:04.230331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7dfecbf-6298-4859-b0b5-adc435c34421 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:04.231503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7dfecbf-6298-4859-b0b5-adc435c34421 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:04.231964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7dfecbf-6298-4859-b0b5-adc435c34421 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:04.232545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7dfecbf-6298-4859-b0b5-adc435c34421 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:04.575909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e7dfecbf-6298-4859-b0b5-adc435c34421 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:04.589749 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e7dfecbf-6298-4859-b0b5-adc435c34421 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.400355 Oct 11 19:55:04.594786 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1503/3063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:04 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:04.611014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:04.614866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:04.648888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:04.651936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:04.652469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:04.656175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:04.656756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:04.660839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:04.740050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lazy-loading 'flavor' on Instance uuid 0ac52ec7-a881-454c-89ea-25e9d288b87d {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:55:04.773954 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] HTTP exception thrown: Cannot 'rescue' instance 0ac52ec7-a881-454c-89ea-25e9d288b87d while it is in vm_state paused Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Request method failure captured: Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action HTTP/1.1 Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 14 Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnHf-gY9GoFThGWTuyLZOFCjiBlppqFx09S1rxIOZhPN4k_d-_Y9sZYcmKSj4UOYvu9oafZcIYglvMprUUmJuXwAUoSMveDAF_xAfvCOrPvWGeWuOLI47ySPf1501t-RY5r2Fgp6Sqr-jc81_0LijQqzlDf3IXjp_i8MKsYX5dySSY Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8df2eebeffd440d988aa6f580c9bb221", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}] Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d1ab8c29f18c4fc09858791a80527e5d Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: {"rescue": {}} Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: exception: Cannot 'rescue' instance 0ac52ec7-a881-454c-89ea-25e9d288b87d while it is in vm_state paused Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '0ac52ec7-a881-454c-89ea-25e9d288b87d', 'body': {'rescue': {}}} Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0ac52ec7-a881-454c-89ea-25e9d288b87d in vm_state paused. Cannot rescue while the instance is in this state. Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 0ac52ec7-a881-454c-89ea-25e9d288b87d while it is in vm_state paused Oct 11 19:55:04.775871 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:04.780041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:04.780041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:04.780041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:04.780041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:04.780041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:04.780041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:04.780041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:04.780041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 0ac52ec7-a881-454c-89ea-25e9d288b87d while it is in vm_state paused Oct 11 19:55:04.780041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:04.781655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Returning 409 to user: Cannot 'rescue' instance 0ac52ec7-a881-454c-89ea-25e9d288b87d while it is in vm_state paused {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:04.782756 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1ef76574-ea59-4b80-8cbe-0c154c2fd3cc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action" status: 409 len: 144 microversion: 2.1 time: 0.186196 Oct 11 19:55:04.783557 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1504/3064] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:04 2022] POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action => generated 144 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:55:04.793600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1f47a9b4-8abf-481a-b5d3-1df8af158d38 req-3b371366-5451-4697-926a-49c07be152ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81262ad-d0a5-4c11-ad76-efd8e0564d34", "name": "network-vif-deleted", "tag": "63e79eeb-5abc-4b9b-97ae-07fc9a76fd42"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:04.807833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1f47a9b4-8abf-481a-b5d3-1df8af158d38 req-3b371366-5451-4697-926a-49c07be152ce service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:04.808777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1f47a9b4-8abf-481a-b5d3-1df8af158d38 req-3b371366-5451-4697-926a-49c07be152ce service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:04.809408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1f47a9b4-8abf-481a-b5d3-1df8af158d38 req-3b371366-5451-4697-926a-49c07be152ce service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:04.824149 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1f47a9b4-8abf-481a-b5d3-1df8af158d38 req-3b371366-5451-4697-926a-49c07be152ce service nova] Creating event network-vif-deleted:63e79eeb-5abc-4b9b-97ae-07fc9a76fd42 for instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 on n-h2-860864-3 Oct 11 19:55:04.829678 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1f47a9b4-8abf-481a-b5d3-1df8af158d38 req-3b371366-5451-4697-926a-49c07be152ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041065 Oct 11 19:55:04.830625 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1505/3065] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:04.838104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f3cc00c-13ed-4074-8fff-fd46e83a7d37 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:04.838889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8f3cc00c-13ed-4074-8fff-fd46e83a7d37 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:04.847193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f3cc00c-13ed-4074-8fff-fd46e83a7d37 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:04.848303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f3cc00c-13ed-4074-8fff-fd46e83a7d37 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:04.849005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f3cc00c-13ed-4074-8fff-fd46e83a7d37 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:04.850586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f3cc00c-13ed-4074-8fff-fd46e83a7d37 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:04.851263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f3cc00c-13ed-4074-8fff-fd46e83a7d37 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:04.851922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f3cc00c-13ed-4074-8fff-fd46e83a7d37 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:04.911947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Updating instance_info_cache with network_info: [{"id": "a2e6b196-5acc-46eb-b34c-0fe50a81feea", "address": "fa:16:3e:9d:f2:17", "network": {"id": "7a6ff9a3-562e-460e-852c-3de4b0a9fb24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-882790043-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "76591022a59449b7b24a2de96cba0fa0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa2e6b196-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126956) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:55:04.925801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Releasing lock "refresh_cache-99eb7ce1-c903-472e-b46a-6714f5362eb9" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:55:04.927204 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ab66314-6593-4eed-a5ab-62f8593506ca tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "POST /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9/action" status: 202 len: 0 microversion: 2.1 time: 4.595395 Oct 11 19:55:04.932417 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1561/3066] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:00 2022] POST /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9/action => generated 0 bytes in 4601 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 19:55:04.941305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-adb3e95f-2ffe-4e3a-b0dd-7d38f239c957 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '.version_select at 0x7f83c735f550>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:04.973017 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f3cc00c-13ed-4074-8fff-fd46e83a7d37 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action" status: 202 len: 0 microversion: 2.1 time: 0.140167 Oct 11 19:55:04.973675 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1506/3067] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:04 2022] POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:55:04.983017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6eeb4cd0-7a45-4a82-bb7f-ce9ef25de054 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:04.984874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6eeb4cd0-7a45-4a82-bb7f-ce9ef25de054 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:05.001678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eeb4cd0-7a45-4a82-bb7f-ce9ef25de054 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:05.004799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eeb4cd0-7a45-4a82-bb7f-ce9ef25de054 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:05.005377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eeb4cd0-7a45-4a82-bb7f-ce9ef25de054 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:05.007797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eeb4cd0-7a45-4a82-bb7f-ce9ef25de054 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:05.009051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eeb4cd0-7a45-4a82-bb7f-ce9ef25de054 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:05.010898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eeb4cd0-7a45-4a82-bb7f-ce9ef25de054 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:05.418936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6eeb4cd0-7a45-4a82-bb7f-ce9ef25de054 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:05.435320 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6eeb4cd0-7a45-4a82-bb7f-ce9ef25de054 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1508 microversion: 2.1 time: 0.456672 Oct 11 19:55:05.451339 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1507/3068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:04 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1508 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:05.458252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bf262fe8-3acd-4019-aef8-9da09736239a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:05.459138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bf262fe8-3acd-4019-aef8-9da09736239a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:05.466658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf262fe8-3acd-4019-aef8-9da09736239a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:05.467937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf262fe8-3acd-4019-aef8-9da09736239a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:05.468556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf262fe8-3acd-4019-aef8-9da09736239a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:05.469642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf262fe8-3acd-4019-aef8-9da09736239a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:05.475900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf262fe8-3acd-4019-aef8-9da09736239a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:05.477251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf262fe8-3acd-4019-aef8-9da09736239a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:05.499542 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-adb3e95f-2ffe-4e3a-b0dd-7d38f239c957 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/50d34a97-9ac3-4c2f-b3a5-e7edb0e0a3ff" status: 200 len: 183 microversion: 2.1 time: 0.565526 Oct 11 19:55:05.499988 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1562/3069] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 19:55:04 2022] GET /compute/v2.1/os-floating-ips/50d34a97-9ac3-4c2f-b3a5-e7edb0e0a3ff => generated 183 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:05.513270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.66"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:05.787343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bf262fe8-3acd-4019-aef8-9da09736239a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:05.797417 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bf262fe8-3acd-4019-aef8-9da09736239a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.344865 Oct 11 19:55:05.800106 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1508/3070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:05 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:05.818697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:05.827207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:05.829001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:05.829615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:05.830487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:05.831428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:05.832031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:06.143130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "refresh_cache-99eb7ce1-c903-472e-b46a-6714f5362eb9" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:55:06.143695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquired lock "refresh_cache-99eb7ce1-c903-472e-b46a-6714f5362eb9" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:55:06.469997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d39d93ab-90f9-410b-8002-0e6aa3d5eacb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:06.471297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d39d93ab-90f9-410b-8002-0e6aa3d5eacb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:06.480090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d39d93ab-90f9-410b-8002-0e6aa3d5eacb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:06.480784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d39d93ab-90f9-410b-8002-0e6aa3d5eacb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:06.481484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d39d93ab-90f9-410b-8002-0e6aa3d5eacb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:06.482497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d39d93ab-90f9-410b-8002-0e6aa3d5eacb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:06.483528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d39d93ab-90f9-410b-8002-0e6aa3d5eacb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:06.484296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d39d93ab-90f9-410b-8002-0e6aa3d5eacb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:06.526192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:06.853409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d39d93ab-90f9-410b-8002-0e6aa3d5eacb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:06.873552 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d39d93ab-90f9-410b-8002-0e6aa3d5eacb tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1516 microversion: 2.1 time: 0.406157 Oct 11 19:55:06.874895 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1509/3071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:06 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1516 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:06.904448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-19311fa1-3ba6-4d97-abbe-35dc1b91ecdc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:06.905016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-19311fa1-3ba6-4d97-abbe-35dc1b91ecdc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:06.929568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19311fa1-3ba6-4d97-abbe-35dc1b91ecdc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:06.938874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19311fa1-3ba6-4d97-abbe-35dc1b91ecdc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:06.940202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19311fa1-3ba6-4d97-abbe-35dc1b91ecdc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:06.944635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19311fa1-3ba6-4d97-abbe-35dc1b91ecdc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:06.945372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19311fa1-3ba6-4d97-abbe-35dc1b91ecdc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:06.945817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19311fa1-3ba6-4d97-abbe-35dc1b91ecdc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:07.169756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-19311fa1-3ba6-4d97-abbe-35dc1b91ecdc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:07.179008 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-19311fa1-3ba6-4d97-abbe-35dc1b91ecdc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1470 microversion: 2.1 time: 0.302383 Oct 11 19:55:07.197467 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1510/3072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:06 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1470 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:07.205571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-89bf881c-fe22-494e-9253-3480a7271b7a req-98d1979d-8e6f-4afd-97aa-6c37196860d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99eb7ce1-c903-472e-b46a-6714f5362eb9", "tag": "a2e6b196-5acc-46eb-b34c-0fe50a81feea"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:07.220259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-89bf881c-fe22-494e-9253-3480a7271b7a req-98d1979d-8e6f-4afd-97aa-6c37196860d1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:07.220259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-89bf881c-fe22-494e-9253-3480a7271b7a req-98d1979d-8e6f-4afd-97aa-6c37196860d1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:07.220583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-89bf881c-fe22-494e-9253-3480a7271b7a req-98d1979d-8e6f-4afd-97aa-6c37196860d1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:07.243708 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-89bf881c-fe22-494e-9253-3480a7271b7a req-98d1979d-8e6f-4afd-97aa-6c37196860d1 service nova] Creating event network-changed:a2e6b196-5acc-46eb-b34c-0fe50a81feea for instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 on n-h1-860864-3 Oct 11 19:55:07.254336 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-89bf881c-fe22-494e-9253-3480a7271b7a req-98d1979d-8e6f-4afd-97aa-6c37196860d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052199 Oct 11 19:55:07.255247 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1511/3073] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:07.411419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Building network info cache for instance {{(pid=126956) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 19:55:07.781064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-80c1d8d3-d41d-4395-b3af-9978ae0dd1d8 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Action: 'create', calling method: .version_select at 0x7f83cc2e4700>, body: {"keypair": {"name": "tempest-keypair-1250581046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV/E+Vp3OGUlxPqaFbWOBEe4Ecgb6eP65GrtWnmxF0W1O8cXtuesFbZj9+p5aERHmBMYc7eCaFpDsNpA/4957c2GEpuIRrYKtWzMSYWaujHSNWQtpBg+XMqAyLF9Yqllw=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:07.812405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-80c1d8d3-d41d-4395-b3af-9978ae0dd1d8 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:07.829085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-80c1d8d3-d41d-4395-b3af-9978ae0dd1d8 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for user 598cdce2768c46888daa1ec5b124b31a and project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:07.871559 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-80c1d8d3-d41d-4395-b3af-9978ae0dd1d8 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.614259 Oct 11 19:55:07.873181 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1512/3074] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 11 19:55:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 617 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 19:55:07.878887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21e738c9-5456-4573-81f3-341fd1603cfe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-647628092", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "916ae149-ec05-4f97-bdd1-9c7781a324b5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:08.004533 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-21e738c9-5456-4573-81f3-341fd1603cfe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Block Device 916ae149-ec05-4f97-bdd1-9c7781a324b5 is not bootable. Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21e738c9-5456-4573-81f3-341fd1603cfe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 357 Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-647628092", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "916ae149-ec05-4f97-bdd1-9c7781a324b5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: exception: Block Device 916ae149-ec05-4f97-bdd1-9c7781a324b5 is not bootable. Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-647628092', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '916ae149-ec05-4f97-bdd1-9c7781a324b5'}], 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 916ae149-ec05-4f97-bdd1-9c7781a324b5 is not bootable. Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:08.012105 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 916ae149-ec05-4f97-bdd1-9c7781a324b5 is not bootable. Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 916ae149-ec05-4f97-bdd1-9c7781a324b5 is not bootable. Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21e738c9-5456-4573-81f3-341fd1603cfe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Block Device 916ae149-ec05-4f97-bdd1-9c7781a324b5 is not bootable. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21e738c9-5456-4573-81f3-341fd1603cfe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.139874 Oct 11 19:55:08.016512 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1513/3075] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:07 2022] POST /compute/v2.1/servers => generated 110 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:55:08.021228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-86ef14f9-508a-433a-8042-1ee04a880cef tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83ccb36f70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:08.039110 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-86ef14f9-508a-433a-8042-1ee04a880cef tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1250581046" status: 200 len: 513 microversion: 2.2 time: 0.023031 Oct 11 19:55:08.040532 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1514/3076] 10.222.0.27 () {60 vars in 1258 bytes} [Tue Oct 11 19:55:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1250581046 => generated 513 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:08.046214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f4d668de-e439-42d2-86f3-02158247b3ef tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:08.047483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f4d668de-e439-42d2-86f3-02158247b3ef tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:08.056086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4d668de-e439-42d2-86f3-02158247b3ef tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:08.056889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4d668de-e439-42d2-86f3-02158247b3ef tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:08.057653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4d668de-e439-42d2-86f3-02158247b3ef tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:08.058783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4d668de-e439-42d2-86f3-02158247b3ef tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:08.059386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4d668de-e439-42d2-86f3-02158247b3ef tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:08.060162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4d668de-e439-42d2-86f3-02158247b3ef tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:08.565392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f4d668de-e439-42d2-86f3-02158247b3ef tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:08.597332 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f4d668de-e439-42d2-86f3-02158247b3ef tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.555043 Oct 11 19:55:08.597712 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1515/3077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:08 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:08.611720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-75538f9a-35c9-43d3-8aa5-8259a421bd59 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83d07281f0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:08.660079 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-75538f9a-35c9-43d3-8aa5-8259a421bd59 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250581046" status: 204 len: 0 microversion: 2.2 time: 0.061280 Oct 11 19:55:08.661345 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1516/3078] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Oct 11 19:55:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250581046 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:08.668721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7f2fd083-c6b6-49e4-b389-1da5142963f3 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:08.669465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7f2fd083-c6b6-49e4-b389-1da5142963f3 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:08.669951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Updating instance_info_cache with network_info: [{"id": "a2e6b196-5acc-46eb-b34c-0fe50a81feea", "address": "fa:16:3e:9d:f2:17", "network": {"id": "7a6ff9a3-562e-460e-852c-3de4b0a9fb24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-882790043-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "76591022a59449b7b24a2de96cba0fa0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa2e6b196-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126956) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:55:08.677248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f2fd083-c6b6-49e4-b389-1da5142963f3 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:08.677828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f2fd083-c6b6-49e4-b389-1da5142963f3 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:08.678756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f2fd083-c6b6-49e4-b389-1da5142963f3 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:08.679626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f2fd083-c6b6-49e4-b389-1da5142963f3 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:08.680238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f2fd083-c6b6-49e4-b389-1da5142963f3 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:08.680743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f2fd083-c6b6-49e4-b389-1da5142963f3 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:08.702001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Releasing lock "refresh_cache-99eb7ce1-c903-472e-b46a-6714f5362eb9" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:55:08.704257 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-369420d4-df0c-44c1-818a-9c6326305de8 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "POST /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9/action" status: 202 len: 0 microversion: 2.1 time: 3.194830 Oct 11 19:55:08.705494 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1563/3079] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:05 2022] POST /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9/action => generated 0 bytes in 3196 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 19:55:08.716655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-04a6b770-7e97-4beb-badf-3d12792ac43f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:08.717460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-04a6b770-7e97-4beb-badf-3d12792ac43f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:08.728731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04a6b770-7e97-4beb-badf-3d12792ac43f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:08.729240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04a6b770-7e97-4beb-badf-3d12792ac43f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:08.729683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04a6b770-7e97-4beb-badf-3d12792ac43f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:08.730451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04a6b770-7e97-4beb-badf-3d12792ac43f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:08.731323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04a6b770-7e97-4beb-badf-3d12792ac43f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:08.731904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04a6b770-7e97-4beb-badf-3d12792ac43f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:09.277363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-04a6b770-7e97-4beb-badf-3d12792ac43f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:09.282155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7f2fd083-c6b6-49e4-b389-1da5142963f3 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:09.286088 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-04a6b770-7e97-4beb-badf-3d12792ac43f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.574162 Oct 11 19:55:09.286567 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1564/3080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:08 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:09.291937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66e9351f-af0e-43d8-809e-a5af67145c64 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Action: 'create', calling method: .version_select at 0x7f83c7444790>, body: {"keypair": {"name": "tempest-keypair-1170814633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG79LzBQOuQq1FORYy1TUwcXKpN4yC5LFZCmsDjfo88eBpRUcP7OFvIk3To6Oqyg+tuufFLpdz56yrwp4uYlK9G7FBuGL/Hhgul9lgNqgtUY/9NZP/lrHQf08dEPaJmevQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:09.309652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-66e9351f-af0e-43d8-809e-a5af67145c64 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:09.312880 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7f2fd083-c6b6-49e4-b389-1da5142963f3 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1476 microversion: 2.1 time: 0.648890 Oct 11 19:55:09.314686 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1517/3081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:08 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1476 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:09.323689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:09.324906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:09.332636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:09.333567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:09.334047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-66e9351f-af0e-43d8-809e-a5af67145c64 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for user 598cdce2768c46888daa1ec5b124b31a and project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:09.335415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:09.336444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:09.337145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:09.337886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:09.359547 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] HTTP exception thrown: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Request method failure captured: Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 HTTP/1.1 Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnbDIk3ck9VBiVt9aQGkTWqPQ-jEULaIwVLj5QT6YM3LrWeSQS_5PrxXCW606FwZS1FGHRiI5XwNy-9PiCfv8ypAnBlzezzv7XMWMOkHWWJcy8zsT-MnBkAPtDw8sgPeQXw3Oktzce1MXs6qy9cMmYJdwVBcczFCIdNfBOzksZlupY Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 76591022a59449b7b24a2de96cba0fa0 Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/76591022a59449b7b24a2de96cba0fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_76591022a59449b7b24a2de96cba0fa0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76591022a59449b7b24a2de96cba0fa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76591022a59449b7b24a2de96cba0fa0"}]}] Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 76591022a59449b7b24a2de96cba0fa0 Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FloatingIPsAssociationTestJSON-199861992-project Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 87ead5931eec4b68a40cd635295de387 Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-199861992-project Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a81262ad-d0a5-4c11-ad76-efd8e0564d34'} Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:09.361621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. Oct 11 19:55:09.369220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:09.370559 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-66e9351f-af0e-43d8-809e-a5af67145c64 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.077892 Oct 11 19:55:09.371515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Returning 404 to user: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:09.372348 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1565/3082] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 11 19:55:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 19:55:09.373414 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f5747e59-d66f-4238-9a7f-af4978a56824 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 404 len: 111 microversion: 2.1 time: 0.057259 Oct 11 19:55:09.374261 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1518/3083] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:55:09 2022] DELETE /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:09.377962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b252e6b7-3d9c-4b8c-bf8e-4532157aaf3e req-5d953ccf-594f-4910-ac4c-46d69553f230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99eb7ce1-c903-472e-b46a-6714f5362eb9", "tag": "a2e6b196-5acc-46eb-b34c-0fe50a81feea"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:09.380030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71ff1f82-dc6a-4306-80bb-47b949cee661 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83d0702160>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:09.390718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b252e6b7-3d9c-4b8c-bf8e-4532157aaf3e req-5d953ccf-594f-4910-ac4c-46d69553f230 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:09.391091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b252e6b7-3d9c-4b8c-bf8e-4532157aaf3e req-5d953ccf-594f-4910-ac4c-46d69553f230 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:09.392013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b252e6b7-3d9c-4b8c-bf8e-4532157aaf3e req-5d953ccf-594f-4910-ac4c-46d69553f230 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:09.404409 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b252e6b7-3d9c-4b8c-bf8e-4532157aaf3e req-5d953ccf-594f-4910-ac4c-46d69553f230 service nova] Creating event network-changed:a2e6b196-5acc-46eb-b34c-0fe50a81feea for instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 on n-h1-860864-3 Oct 11 19:55:09.405498 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-71ff1f82-dc6a-4306-80bb-47b949cee661 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170814633" status: 204 len: 0 microversion: 2.2 time: 0.029775 Oct 11 19:55:09.406799 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1519/3084] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Oct 11 19:55:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170814633 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:09.415638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:09.416174 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b252e6b7-3d9c-4b8c-bf8e-4532157aaf3e req-5d953ccf-594f-4910-ac4c-46d69553f230 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042601 Oct 11 19:55:09.416319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: a81262ad-d0a5-4c11-ad76-efd8e0564d34] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:09.417304 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1566/3085] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:09.422443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-080f4786-f9d6-4560-bb80-959b2fef9535 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Action: 'create', calling method: .version_select at 0x7f83c7451550>, body: {"keypair": {"name": "tempest-keypair-2141297694", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:09.425886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:09.426408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:09.426906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:09.427787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:09.428839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:09.429507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:09.441528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-080f4786-f9d6-4560-bb80-959b2fef9535 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:09.448830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-080f4786-f9d6-4560-bb80-959b2fef9535 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for user 598cdce2768c46888daa1ec5b124b31a and project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:09.451385 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] HTTP exception thrown: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Request method failure captured: Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 HTTP/1.1 Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnbDIk3ck9VBiVt9aQGkTWqPQ-jEULaIwVLj5QT6YM3LrWeSQS_5PrxXCW606FwZS1FGHRiI5XwNy-9PiCfv8ypAnBlzezzv7XMWMOkHWWJcy8zsT-MnBkAPtDw8sgPeQXw3Oktzce1MXs6qy9cMmYJdwVBcczFCIdNfBOzksZlupY Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 76591022a59449b7b24a2de96cba0fa0 Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/76591022a59449b7b24a2de96cba0fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_76591022a59449b7b24a2de96cba0fa0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76591022a59449b7b24a2de96cba0fa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76591022a59449b7b24a2de96cba0fa0"}]}] Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 76591022a59449b7b24a2de96cba0fa0 Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FloatingIPsAssociationTestJSON-199861992-project Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 87ead5931eec4b68a40cd635295de387 Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-199861992-project Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a81262ad-d0a5-4c11-ad76-efd8e0564d34'} Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:09.453258 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Returning 404 to user: Instance a81262ad-d0a5-4c11-ad76-efd8e0564d34 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9e8638b4-5a73-4962-8f23-e176488290a5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34" status: 404 len: 111 microversion: 2.1 time: 0.046880 Oct 11 19:55:09.457152 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1520/3086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:09 2022] GET /compute/v2.1/servers/a81262ad-d0a5-4c11-ad76-efd8e0564d34 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:09.465033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7f2bc625-b3cc-4238-a0f4-af348b8655b3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '.version_select at 0x7f83d06fb4c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:09.491229 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-080f4786-f9d6-4560-bb80-959b2fef9535 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.072505 Oct 11 19:55:09.497673 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1567/3087] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 11 19:55:09 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 19:55:09.503626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-41754184-5e02-4cc9-a6ca-dcc04d75194d tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83c736bca0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:09.535345 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-41754184-5e02-4cc9-a6ca-dcc04d75194d tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141297694" status: 204 len: 0 microversion: 2.2 time: 0.035966 Oct 11 19:55:09.537549 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1568/3088] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Oct 11 19:55:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141297694 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:09.551524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae2f4f51-d271-42fa-b79e-bb7e1cc44422 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Action: 'create', calling method: .version_select at 0x7f83c7300f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1467220357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+tybTSx4xsolOGLuRR09yDEjNmtmabDxjFaY490q8zt2WcSyHCw4jd8Fm/m2Zk+GYh6yuaaS80gQFla6/XRipSnhYR8oFC9JtlnoBLck6+reQvWOvEn4ypBeRqPdrwDQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:09.590573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-ae2f4f51-d271-42fa-b79e-bb7e1cc44422 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:09.597799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-ae2f4f51-d271-42fa-b79e-bb7e1cc44422 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for user 598cdce2768c46888daa1ec5b124b31a and project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:09.636201 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae2f4f51-d271-42fa-b79e-bb7e1cc44422 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.090269 Oct 11 19:55:09.647699 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1569/3089] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 11 19:55:09 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 19:55:09.656238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c51532e-1749-42d2-9b9f-efddf04df9a6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:09.660750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c51532e-1749-42d2-9b9f-efddf04df9a6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:09.667807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c51532e-1749-42d2-9b9f-efddf04df9a6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:09.668263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c51532e-1749-42d2-9b9f-efddf04df9a6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:09.668732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c51532e-1749-42d2-9b9f-efddf04df9a6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:09.669446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c51532e-1749-42d2-9b9f-efddf04df9a6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:09.670548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c51532e-1749-42d2-9b9f-efddf04df9a6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:09.671093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c51532e-1749-42d2-9b9f-efddf04df9a6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:09.707496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-1c51532e-1749-42d2-9b9f-efddf04df9a6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lazy-loading 'flavor' on Instance uuid 0ac52ec7-a881-454c-89ea-25e9d288b87d {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:55:09.764432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=5,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:09.813510 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c51532e-1749-42d2-9b9f-efddf04df9a6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action" status: 200 len: 32 microversion: 2.1 time: 0.163908 Oct 11 19:55:09.822491 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1570/3090] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:09 2022] POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:55:09.829584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d62fb171-410c-4027-8303-de6574323387 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Action: 'create', calling method: .version_select at 0x7f83c736bc10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2011806686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHE03i/DIbvJu6LUrHAy6lD8HceXQL4du0PnPnFqQzifdIJgNcge4+Dn3OjzdqCgDxRiZr0gYkqUV4K08kDcJsAXY/45rFE6GlCqR+R+yS1NITUUKiw24yNqwOB1eAe7Q=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:09.856426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d62fb171-410c-4027-8303-de6574323387 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:09.863790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d62fb171-410c-4027-8303-de6574323387 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for user 598cdce2768c46888daa1ec5b124b31a and project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:09.898440 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d62fb171-410c-4027-8303-de6574323387 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.073061 Oct 11 19:55:09.900050 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1571/3091] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 11 19:55:09 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 19:55:09.911048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8149cfc6-2fed-417d-9ea6-86c35e57285c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:09.911794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8149cfc6-2fed-417d-9ea6-86c35e57285c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:09.922428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149cfc6-2fed-417d-9ea6-86c35e57285c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:09.922802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149cfc6-2fed-417d-9ea6-86c35e57285c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:09.923256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149cfc6-2fed-417d-9ea6-86c35e57285c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:09.923967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149cfc6-2fed-417d-9ea6-86c35e57285c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:09.924433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149cfc6-2fed-417d-9ea6-86c35e57285c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:09.924867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149cfc6-2fed-417d-9ea6-86c35e57285c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:10.504432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8149cfc6-2fed-417d-9ea6-86c35e57285c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:10.514261 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8149cfc6-2fed-417d-9ea6-86c35e57285c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.611379 Oct 11 19:55:10.517410 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1572/3092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:09 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:10.525375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-211b594c-8196-4b17-9e7b-b7cb8994c5f6 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Action: 'create', calling method: .version_select at 0x7f83c7373e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-345040652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIOOza8ZrMWCFXagN6uYusF1gQlS8e5TyqjEuHM1A6azXzhOyh3y1npgsVX1Qq48fITIydJlA0fN8u+4yGTrSUwkxRxk8fjvn0fsRGLH4ugPN11MfhTcTXKQNdF5nL2Yg=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:10.549092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-211b594c-8196-4b17-9e7b-b7cb8994c5f6 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:10.556150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-211b594c-8196-4b17-9e7b-b7cb8994c5f6 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for user 598cdce2768c46888daa1ec5b124b31a and project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:10.591759 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-211b594c-8196-4b17-9e7b-b7cb8994c5f6 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.072987 Oct 11 19:55:10.602640 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1573/3093] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 11 19:55:10 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 19:55:10.621459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6cb4a63-addc-4840-b768-d7d12d8b7716 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:10.622150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b6cb4a63-addc-4840-b768-d7d12d8b7716 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:10.632184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cb4a63-addc-4840-b768-d7d12d8b7716 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:10.632796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cb4a63-addc-4840-b768-d7d12d8b7716 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:10.633934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cb4a63-addc-4840-b768-d7d12d8b7716 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:10.634726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cb4a63-addc-4840-b768-d7d12d8b7716 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:10.635185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cb4a63-addc-4840-b768-d7d12d8b7716 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:10.635663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6cb4a63-addc-4840-b768-d7d12d8b7716 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:11.106409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b6cb4a63-addc-4840-b768-d7d12d8b7716 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:11.119779 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b6cb4a63-addc-4840-b768-d7d12d8b7716 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1476 microversion: 2.1 time: 0.515839 Oct 11 19:55:11.122459 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1574/3094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:10 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1476 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:11.142142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-09b101a4-8bcf-4b8e-bef7-16c1dd6fb60f tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83c735fa60>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:11.152413 n-d-860864-3 devstack@n-api.service[126956]: WARNING oslo_db.sqlalchemy.utils [None req-09b101a4-8bcf-4b8e-bef7-16c1dd6fb60f tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 19:55:11.166590 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-09b101a4-8bcf-4b8e-bef7-16c1dd6fb60f tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.042120 Oct 11 19:55:11.167791 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1575/3095] 10.222.0.27 () {60 vars in 1177 bytes} [Tue Oct 11 19:55:11 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:11.180295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-075e2963-a86c-453e-8ca5-aa5269cbcfa7 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83c73b0160>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:11.213653 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-075e2963-a86c-453e-8ca5-aa5269cbcfa7 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-345040652" status: 204 len: 0 microversion: 2.2 time: 0.038168 Oct 11 19:55:11.218731 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1576/3096] 10.222.0.27 () {60 vars in 1318 bytes} [Tue Oct 11 19:55:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-345040652 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:55:11.231336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-76a4716b-c326-4ab5-9dc9-2239ae0dbe49 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83c7451ee0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:11.257745 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-76a4716b-c326-4ab5-9dc9-2239ae0dbe49 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2011806686" status: 204 len: 0 microversion: 2.2 time: 0.036732 Oct 11 19:55:11.258450 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1577/3097] 10.222.0.27 () {60 vars in 1321 bytes} [Tue Oct 11 19:55:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2011806686 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:11.280283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-360a01e2-635b-49f8-82a6-1d37622cba58 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83c73b0040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:11.303422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:11.319368 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-360a01e2-635b-49f8-82a6-1d37622cba58 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1467220357" status: 204 len: 0 microversion: 2.2 time: 0.054768 Oct 11 19:55:11.330189 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1578/3098] 10.222.0.27 () {60 vars in 1321 bytes} [Tue Oct 11 19:55:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1467220357 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:55:11.341445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b4ba11c6-cf02-4397-b4b9-624dfe117881 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Action: 'create', calling method: .version_select at 0x7f83c73680d0>, body: {"keypair": {"name": "tempest-keypair-451375369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGczyJeSgHeAiI8vr1OEhe/8KQUScYD7IzkUJL+kACfR3O37T5M8NNEhAjKsMhtASJdqO+JtCaHtGdER2NJMvEMCmh6oVIxfq9hRz2MjnFLQyjcz010uZ4vgKZPiwvHfSg=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:11.363257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-b4ba11c6-cf02-4397-b4b9-624dfe117881 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:11.374653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-b4ba11c6-cf02-4397-b4b9-624dfe117881 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for user 598cdce2768c46888daa1ec5b124b31a and project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:11.430286 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b4ba11c6-cf02-4397-b4b9-624dfe117881 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.098145 Oct 11 19:55:11.430908 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1579/3099] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 11 19:55:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 19:55:11.444763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5fce5f7-5165-443b-aae7-f9135957bcb3 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83c7368700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:11.459057 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5fce5f7-5165-443b-aae7-f9135957bcb3 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-451375369" status: 200 len: 512 microversion: 2.2 time: 0.020083 Oct 11 19:55:11.460791 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1580/3100] 10.222.0.27 () {60 vars in 1255 bytes} [Tue Oct 11 19:55:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-451375369 => generated 512 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:11.477603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bf40ef60-8acf-4081-8ab0-04f698430836 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83c735f670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:11.492369 n-d-860864-3 devstack@n-api.service[126956]: WARNING oslo_db.sqlalchemy.utils [None req-bf40ef60-8acf-4081-8ab0-04f698430836 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 19:55:11.499722 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bf40ef60-8acf-4081-8ab0-04f698430836 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.027359 Oct 11 19:55:11.507560 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1581/3101] 10.222.0.27 () {60 vars in 1177 bytes} [Tue Oct 11 19:55:11 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:11.517714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-69a49a15-f6c2-49fe-aea5-d0d12718038b tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83c743f700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:11.547825 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-69a49a15-f6c2-49fe-aea5-d0d12718038b tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451375369" status: 204 len: 0 microversion: 2.2 time: 0.034158 Oct 11 19:55:11.548435 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1582/3102] 10.222.0.27 () {60 vars in 1258 bytes} [Tue Oct 11 19:55:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451375369 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:11.569646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8149bd59-72b0-476e-9b04-2e081bd622d8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:11.570267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8149bd59-72b0-476e-9b04-2e081bd622d8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:11.577337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149bd59-72b0-476e-9b04-2e081bd622d8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:11.577819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149bd59-72b0-476e-9b04-2e081bd622d8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:11.578257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149bd59-72b0-476e-9b04-2e081bd622d8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:11.579584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149bd59-72b0-476e-9b04-2e081bd622d8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:11.580048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149bd59-72b0-476e-9b04-2e081bd622d8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:11.580557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8149bd59-72b0-476e-9b04-2e081bd622d8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:11.660262 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7f2bc625-b3cc-4238-a0f4-af348b8655b3 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/50d34a97-9ac3-4c2f-b3a5-e7edb0e0a3ff" status: 202 len: 0 microversion: 2.1 time: 2.200219 Oct 11 19:55:11.661529 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1521/3103] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:55:09 2022] DELETE /compute/v2.1/os-floating-ips/50d34a97-9ac3-4c2f-b3a5-e7edb0e0a3ff => generated 0 bytes in 2202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:55:11.667460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-17c31fb4-47ef-491b-a74b-2124d75f5e00 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Action: 'create', calling method: .version_select at 0x7f83d0666790>, body: {"keypair": {"name": "tempest-keypair-1592121410", "type": "x509"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:11.700577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-17c31fb4-47ef-491b-a74b-2124d75f5e00 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:11.709110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-17c31fb4-47ef-491b-a74b-2124d75f5e00 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for user 598cdce2768c46888daa1ec5b124b31a and project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:11.729674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.processutils [None req-17c31fb4-47ef-491b-a74b-2124d75f5e00 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpre7p1m8d/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpre7p1m8d/temp.key -subj /CN=598cdce2768c46888daa1ec5b124b31a -extensions v3_req_client {{(pid=126955) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 11 19:55:11.987582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8149bd59-72b0-476e-9b04-2e081bd622d8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:12.000928 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8149bd59-72b0-476e-9b04-2e081bd622d8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.451450 Oct 11 19:55:12.001890 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1583/3104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:11 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:12.015364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6cd95795-30d9-4222-b9ed-26e3e52fd8d5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:12.017713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6cd95795-30d9-4222-b9ed-26e3e52fd8d5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:12.031058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cd95795-30d9-4222-b9ed-26e3e52fd8d5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.031542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cd95795-30d9-4222-b9ed-26e3e52fd8d5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.031985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cd95795-30d9-4222-b9ed-26e3e52fd8d5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:12.039693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cd95795-30d9-4222-b9ed-26e3e52fd8d5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.040187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cd95795-30d9-4222-b9ed-26e3e52fd8d5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.040612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cd95795-30d9-4222-b9ed-26e3e52fd8d5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:12.096443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6cd95795-30d9-4222-b9ed-26e3e52fd8d5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:55:12.280667 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6cd95795-30d9-4222-b9ed-26e3e52fd8d5 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "DELETE /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 204 len: 0 microversion: 2.1 time: 0.277130 Oct 11 19:55:12.281706 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1584/3105] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:55:12 2022] DELETE /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:12.289130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.processutils [None req-17c31fb4-47ef-491b-a74b-2124d75f5e00 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpre7p1m8d/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpre7p1m8d/temp.key -subj /CN=598cdce2768c46888daa1ec5b124b31a -extensions v3_req_client" returned: 0 in 0.559s {{(pid=126955) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 11 19:55:12.291357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.processutils [None req-17c31fb4-47ef-491b-a74b-2124d75f5e00 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpre7p1m8d/temp.key -password pass: {{(pid=126955) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 11 19:55:12.298977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-12800330-3565-46fb-a493-364e151259d6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:12.300642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-12800330-3565-46fb-a493-364e151259d6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:12.309201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12800330-3565-46fb-a493-364e151259d6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.309949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12800330-3565-46fb-a493-364e151259d6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.310460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12800330-3565-46fb-a493-364e151259d6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:12.311341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12800330-3565-46fb-a493-364e151259d6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.312028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12800330-3565-46fb-a493-364e151259d6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.312463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12800330-3565-46fb-a493-364e151259d6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:12.371545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.processutils [None req-17c31fb4-47ef-491b-a74b-2124d75f5e00 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpre7p1m8d/temp.key -password pass:" returned: 0 in 0.075s {{(pid=126955) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 11 19:55:12.444340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:12.459585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-17c31fb4-47ef-491b-a74b-2124d75f5e00 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:12.466622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-17c31fb4-47ef-491b-a74b-2124d75f5e00 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Getting quotas for user 598cdce2768c46888daa1ec5b124b31a and project 558b4f43e58f49599bf5d78f00fa48c5. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:12.491511 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-17c31fb4-47ef-491b-a74b-2124d75f5e00 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.828723 Oct 11 19:55:12.497578 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1522/3106] 10.222.0.27 () {62 vars in 1198 bytes} [Tue Oct 11 19:55:11 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 830 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:55:12.498614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-14a275ab-aa75-44ed-ad14-8a7907107517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1742909546", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "destination_type": "local"}, {"source_type": "volume", "uuid": "2463466b-a519-42ae-8478-412d63a1f832", "destination_type": "invalid"}], "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:12.502131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-12800330-3565-46fb-a493-364e151259d6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-14a275ab-aa75-44ed-ad14-8a7907107517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 495 Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1742909546", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "destination_type": "local"}, {"source_type": "volume", "uuid": "2463466b-a519-42ae-8478-412d63a1f832", "destination_type": "invalid"}], "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1742909546', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '2463466b-a519-42ae-8478-412d63a1f832', 'destination_type': 'invalid'}], 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:12.504753 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-14a275ab-aa75-44ed-ad14-8a7907107517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:12.510420 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-14a275ab-aa75-44ed-ad14-8a7907107517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.012641 Oct 11 19:55:12.512958 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1523/3107] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:12 2022] POST /compute/v2.1/servers => generated 155 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:55:12.516376 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-12800330-3565-46fb-a493-364e151259d6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1476 microversion: 2.1 time: 0.232202 Oct 11 19:55:12.516967 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1585/3108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:12 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:12.522746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9728d98-5558-47a8-b2ce-c0d38356e29a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:12.523542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d9728d98-5558-47a8-b2ce-c0d38356e29a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:12.533812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9728d98-5558-47a8-b2ce-c0d38356e29a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.534491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9728d98-5558-47a8-b2ce-c0d38356e29a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.535177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9728d98-5558-47a8-b2ce-c0d38356e29a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:12.535502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-fb836630-ecb4-47ab-a772-27e20e8a410a req-7f44f1c3-8407-49bb-92ab-fa2992675615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045c6ac7-f110-46b6-b43d-dee4dc6a4864", "name": "network-vif-unplugged", "status": "completed", "tag": "870f5751-948d-4669-a1d8-77ea302d7d04"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:12.536828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9728d98-5558-47a8-b2ce-c0d38356e29a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.537309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9728d98-5558-47a8-b2ce-c0d38356e29a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.538681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9728d98-5558-47a8-b2ce-c0d38356e29a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:12.547600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fb836630-ecb4-47ab-a772-27e20e8a410a req-7f44f1c3-8407-49bb-92ab-fa2992675615 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.548249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fb836630-ecb4-47ab-a772-27e20e8a410a req-7f44f1c3-8407-49bb-92ab-fa2992675615 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.548786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fb836630-ecb4-47ab-a772-27e20e8a410a req-7f44f1c3-8407-49bb-92ab-fa2992675615 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:12.564395 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-fb836630-ecb4-47ab-a772-27e20e8a410a req-7f44f1c3-8407-49bb-92ab-fa2992675615 service nova] Creating event network-vif-unplugged:870f5751-948d-4669-a1d8-77ea302d7d04 for instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 on n-h1-860864-3 Oct 11 19:55:12.581618 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-fb836630-ecb4-47ab-a772-27e20e8a410a req-7f44f1c3-8407-49bb-92ab-fa2992675615 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067233 Oct 11 19:55:12.582507 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1524/3109] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:12.594176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d779995f-222c-4878-be70-e6621ad33c89 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83d0702b80>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:12.608432 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d779995f-222c-4878-be70-e6621ad33c89 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1592121410" status: 200 len: 1534 microversion: 2.2 time: 0.022280 Oct 11 19:55:12.615542 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1525/3110] 10.222.0.27 () {60 vars in 1258 bytes} [Tue Oct 11 19:55:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1592121410 => generated 1534 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:12.617330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65e4c5a4-094a-4948-b016-a2a29788c8fd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:12.618357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-65e4c5a4-094a-4948-b016-a2a29788c8fd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:12.626450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65e4c5a4-094a-4948-b016-a2a29788c8fd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.626973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65e4c5a4-094a-4948-b016-a2a29788c8fd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.627418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65e4c5a4-094a-4948-b016-a2a29788c8fd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:12.628253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65e4c5a4-094a-4948-b016-a2a29788c8fd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.628704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65e4c5a4-094a-4948-b016-a2a29788c8fd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.629125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65e4c5a4-094a-4948-b016-a2a29788c8fd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:12.764323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d9728d98-5558-47a8-b2ce-c0d38356e29a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:12.773726 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9728d98-5558-47a8-b2ce-c0d38356e29a tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1524 microversion: 2.1 time: 0.255459 Oct 11 19:55:12.774313 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1586/3111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:12 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1524 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:12.779123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4cd1aa68-d54b-45ac-8af4-524045b515f5 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83c7421040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:12.783800 n-d-860864-3 devstack@n-api.service[126956]: WARNING oslo_db.sqlalchemy.utils [None req-4cd1aa68-d54b-45ac-8af4-524045b515f5 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 19:55:12.792758 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4cd1aa68-d54b-45ac-8af4-524045b515f5 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.017153 Oct 11 19:55:12.793587 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1587/3112] 10.222.0.27 () {60 vars in 1177 bytes} [Tue Oct 11 19:55:12 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:12.805365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3079e49a-0ee9-4184-98cb-1b194c03d6e2 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] Calling method '.version_select at 0x7f83c73b09d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:12.827441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-65e4c5a4-094a-4948-b016-a2a29788c8fd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:12.828285 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3079e49a-0ee9-4184-98cb-1b194c03d6e2 tempest-KeyPairsV22TestJSON-262364583 tempest-KeyPairsV22TestJSON-262364583-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592121410" status: 204 len: 0 microversion: 2.2 time: 0.027908 Oct 11 19:55:12.828909 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1588/3113] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Oct 11 19:55:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592121410 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:55:12.840473 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-65e4c5a4-094a-4948-b016-a2a29788c8fd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.228369 Oct 11 19:55:12.841054 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1526/3114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:12 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:12.864699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b94c8a14-b356-4463-9933-85bcc099dd96 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:12.865500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b94c8a14-b356-4463-9933-85bcc099dd96 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:12.873719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b94c8a14-b356-4463-9933-85bcc099dd96 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.874336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b94c8a14-b356-4463-9933-85bcc099dd96 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.874907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b94c8a14-b356-4463-9933-85bcc099dd96 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:12.875802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b94c8a14-b356-4463-9933-85bcc099dd96 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:12.876360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b94c8a14-b356-4463-9933-85bcc099dd96 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:12.876881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b94c8a14-b356-4463-9933-85bcc099dd96 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:13.031040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1019247d-f32f-4f88-85e0-5fb754120f59 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:13.031655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1019247d-f32f-4f88-85e0-5fb754120f59 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:13.040564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1019247d-f32f-4f88-85e0-5fb754120f59 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:13.041068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1019247d-f32f-4f88-85e0-5fb754120f59 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:13.041507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1019247d-f32f-4f88-85e0-5fb754120f59 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:13.041732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b94c8a14-b356-4463-9933-85bcc099dd96 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:13.042209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1019247d-f32f-4f88-85e0-5fb754120f59 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:13.042752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1019247d-f32f-4f88-85e0-5fb754120f59 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:13.043176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1019247d-f32f-4f88-85e0-5fb754120f59 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:13.050920 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b94c8a14-b356-4463-9933-85bcc099dd96 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.190139 Oct 11 19:55:13.051500 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1589/3115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:12 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:13.230697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1019247d-f32f-4f88-85e0-5fb754120f59 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:13.234513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8057cc37-f423-4f19-b7ce-dad595a2fe17 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2026735074", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8057cc37-f423-4f19-b7ce-dad595a2fe17 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 492 Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2026735074", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2026735074', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:13.238671 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 19:55:13.242113 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:13.244429 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1019247d-f32f-4f88-85e0-5fb754120f59 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.211783 Oct 11 19:55:13.244429 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1527/3116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:13 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:13.245259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8057cc37-f423-4f19-b7ce-dad595a2fe17 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:13.246092 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8057cc37-f423-4f19-b7ce-dad595a2fe17 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.016060 Oct 11 19:55:13.250044 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1590/3117] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:13 2022] POST /compute/v2.1/servers => generated 624 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:55:13.254920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6caecf39-c3e1-4a4e-94b3-e99d5b121936 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:13.255522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6caecf39-c3e1-4a4e-94b3-e99d5b121936 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:13.262296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6caecf39-c3e1-4a4e-94b3-e99d5b121936 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:13.262827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6caecf39-c3e1-4a4e-94b3-e99d5b121936 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:13.263258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6caecf39-c3e1-4a4e-94b3-e99d5b121936 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:13.263943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6caecf39-c3e1-4a4e-94b3-e99d5b121936 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:13.264391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6caecf39-c3e1-4a4e-94b3-e99d5b121936 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:13.264806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6caecf39-c3e1-4a4e-94b3-e99d5b121936 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:13.438415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6caecf39-c3e1-4a4e-94b3-e99d5b121936 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:13.450220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6caecf39-c3e1-4a4e-94b3-e99d5b121936 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.199068 Oct 11 19:55:13.451396 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1528/3118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:13 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:13.483207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f948f5e-472e-4fbb-a09c-c219966396b6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:13.483797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f948f5e-472e-4fbb-a09c-c219966396b6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:13.510003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f948f5e-472e-4fbb-a09c-c219966396b6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:13.510701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f948f5e-472e-4fbb-a09c-c219966396b6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:13.511104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f948f5e-472e-4fbb-a09c-c219966396b6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:13.512107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f948f5e-472e-4fbb-a09c-c219966396b6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:13.512641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f948f5e-472e-4fbb-a09c-c219966396b6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:13.513189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f948f5e-472e-4fbb-a09c-c219966396b6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:13.540213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8c73ce33-9b7e-4820-b6c9-90ccf83160c2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:13.540821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8c73ce33-9b7e-4820-b6c9-90ccf83160c2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:13.557941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c73ce33-9b7e-4820-b6c9-90ccf83160c2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:13.558603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c73ce33-9b7e-4820-b6c9-90ccf83160c2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:13.559367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c73ce33-9b7e-4820-b6c9-90ccf83160c2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:13.560160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c73ce33-9b7e-4820-b6c9-90ccf83160c2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:13.561314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c73ce33-9b7e-4820-b6c9-90ccf83160c2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:13.561831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c73ce33-9b7e-4820-b6c9-90ccf83160c2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:13.868440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f948f5e-472e-4fbb-a09c-c219966396b6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:13.880911 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f948f5e-472e-4fbb-a09c-c219966396b6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.402468 Oct 11 19:55:13.893628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8c73ce33-9b7e-4820-b6c9-90ccf83160c2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:13.898672 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1591/3119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:13 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:13.903703 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8c73ce33-9b7e-4820-b6c9-90ccf83160c2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1476 microversion: 2.1 time: 0.367592 Oct 11 19:55:13.905584 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1529/3120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:13 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1476 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:13.922792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44e16423-0da3-40d7-a861-5be660b254fa tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:13.923676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-44e16423-0da3-40d7-a861-5be660b254fa tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:13.930159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44e16423-0da3-40d7-a861-5be660b254fa tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:13.930883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44e16423-0da3-40d7-a861-5be660b254fa tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:13.931483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44e16423-0da3-40d7-a861-5be660b254fa tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:13.932507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44e16423-0da3-40d7-a861-5be660b254fa tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:13.933334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44e16423-0da3-40d7-a861-5be660b254fa tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:13.933915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44e16423-0da3-40d7-a861-5be660b254fa tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:14.011429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97517e03-6fb2-4d4b-8d5c-3abb1830b9c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97517e03-6fb2-4d4b-8d5c-3abb1830b9c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 416 Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:14.015575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:55:14.019317 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:14.033048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97517e03-6fb2-4d4b-8d5c-3abb1830b9c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:14.036088 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97517e03-6fb2-4d4b-8d5c-3abb1830b9c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.028308 Oct 11 19:55:14.040394 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1530/3121] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:14 2022] POST /compute/v2.1/servers => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:55:14.049451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-adbd78d9-2f0e-447d-af85-738862cde65a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:14.050370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-adbd78d9-2f0e-447d-af85-738862cde65a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:14.060132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adbd78d9-2f0e-447d-af85-738862cde65a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:14.060909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adbd78d9-2f0e-447d-af85-738862cde65a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:14.061851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adbd78d9-2f0e-447d-af85-738862cde65a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:14.062909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adbd78d9-2f0e-447d-af85-738862cde65a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:14.063532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adbd78d9-2f0e-447d-af85-738862cde65a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:14.064110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adbd78d9-2f0e-447d-af85-738862cde65a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:14.844696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-44e16423-0da3-40d7-a861-5be660b254fa tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:14.857467 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-44e16423-0da3-40d7-a861-5be660b254fa tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1524 microversion: 2.1 time: 0.955423 Oct 11 19:55:14.860519 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1592/3122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:13 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1524 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:14.878124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10ac1576-802d-4c95-8566-5319c84e4663 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:14.881108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10ac1576-802d-4c95-8566-5319c84e4663 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:14.892911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ac1576-802d-4c95-8566-5319c84e4663 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:14.893439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ac1576-802d-4c95-8566-5319c84e4663 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:14.893847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ac1576-802d-4c95-8566-5319c84e4663 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:14.894566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ac1576-802d-4c95-8566-5319c84e4663 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:14.895026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ac1576-802d-4c95-8566-5319c84e4663 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:14.895448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ac1576-802d-4c95-8566-5319c84e4663 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:14.920938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-adbd78d9-2f0e-447d-af85-738862cde65a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:14.935427 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-adbd78d9-2f0e-447d-af85-738862cde65a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.891061 Oct 11 19:55:14.937227 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1531/3123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:14 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:14.962679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-beefad4a-b9d5-4eaa-bf32-dbe9977fc0b8 req-0ed76383-f5a6-483b-b91b-f47abbae645a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045c6ac7-f110-46b6-b43d-dee4dc6a4864", "name": "network-vif-plugged", "status": "completed", "tag": "870f5751-948d-4669-a1d8-77ea302d7d04"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:14.975162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-beefad4a-b9d5-4eaa-bf32-dbe9977fc0b8 req-0ed76383-f5a6-483b-b91b-f47abbae645a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:14.976058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-beefad4a-b9d5-4eaa-bf32-dbe9977fc0b8 req-0ed76383-f5a6-483b-b91b-f47abbae645a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:14.976643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-beefad4a-b9d5-4eaa-bf32-dbe9977fc0b8 req-0ed76383-f5a6-483b-b91b-f47abbae645a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:14.994318 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-beefad4a-b9d5-4eaa-bf32-dbe9977fc0b8 req-0ed76383-f5a6-483b-b91b-f47abbae645a service nova] Creating event network-vif-plugged:870f5751-948d-4669-a1d8-77ea302d7d04 for instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 on n-h1-860864-3 Oct 11 19:55:15.002761 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-beefad4a-b9d5-4eaa-bf32-dbe9977fc0b8 req-0ed76383-f5a6-483b-b91b-f47abbae645a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047679 Oct 11 19:55:15.004172 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1532/3124] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:15.011235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2078ca78-47e9-4073-982e-6d940ff4fb49 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:15.012094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2078ca78-47e9-4073-982e-6d940ff4fb49 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:15.020446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2078ca78-47e9-4073-982e-6d940ff4fb49 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:15.021290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2078ca78-47e9-4073-982e-6d940ff4fb49 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:15.021942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2078ca78-47e9-4073-982e-6d940ff4fb49 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:15.023153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2078ca78-47e9-4073-982e-6d940ff4fb49 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:15.023948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2078ca78-47e9-4073-982e-6d940ff4fb49 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:15.025008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2078ca78-47e9-4073-982e-6d940ff4fb49 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:15.347766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-10ac1576-802d-4c95-8566-5319c84e4663 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:15.359905 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10ac1576-802d-4c95-8566-5319c84e4663 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.497289 Oct 11 19:55:15.360805 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1593/3125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:14 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:15.384412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-986a445c-a5de-4995-8976-6fb0fccf07da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:15.385041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-986a445c-a5de-4995-8976-6fb0fccf07da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:15.391692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986a445c-a5de-4995-8976-6fb0fccf07da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:15.392195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986a445c-a5de-4995-8976-6fb0fccf07da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:15.393544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986a445c-a5de-4995-8976-6fb0fccf07da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:15.394253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986a445c-a5de-4995-8976-6fb0fccf07da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:15.394734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986a445c-a5de-4995-8976-6fb0fccf07da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:15.395477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986a445c-a5de-4995-8976-6fb0fccf07da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:15.435287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2078ca78-47e9-4073-982e-6d940ff4fb49 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:15.443026 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2078ca78-47e9-4073-982e-6d940ff4fb49 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1476 microversion: 2.1 time: 0.437572 Oct 11 19:55:15.443625 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1533/3126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:15 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1476 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:15.752873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-986a445c-a5de-4995-8976-6fb0fccf07da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:15.762173 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-986a445c-a5de-4995-8976-6fb0fccf07da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.386085 Oct 11 19:55:15.765614 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1594/3127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:15 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:15.794361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7983f400-2cba-41be-97bf-d7dc24118b3c req-5f7923af-0896-4ae5-883b-78d69bb7500e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99eb7ce1-c903-472e-b46a-6714f5362eb9", "name": "network-vif-deleted", "tag": "a2e6b196-5acc-46eb-b34c-0fe50a81feea"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:15.810680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7983f400-2cba-41be-97bf-d7dc24118b3c req-5f7923af-0896-4ae5-883b-78d69bb7500e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:15.816523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7983f400-2cba-41be-97bf-d7dc24118b3c req-5f7923af-0896-4ae5-883b-78d69bb7500e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:15.817253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7983f400-2cba-41be-97bf-d7dc24118b3c req-5f7923af-0896-4ae5-883b-78d69bb7500e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:15.832390 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7983f400-2cba-41be-97bf-d7dc24118b3c req-5f7923af-0896-4ae5-883b-78d69bb7500e service nova] Creating event network-vif-deleted:a2e6b196-5acc-46eb-b34c-0fe50a81feea for instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 on n-h1-860864-3 Oct 11 19:55:15.852980 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7983f400-2cba-41be-97bf-d7dc24118b3c req-5f7923af-0896-4ae5-883b-78d69bb7500e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062084 Oct 11 19:55:15.857225 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1534/3128] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:15.883144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d7d26361-2104-46c2-b191-5dc1a36167c4 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:15.884369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d7d26361-2104-46c2-b191-5dc1a36167c4 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:15.891930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d26361-2104-46c2-b191-5dc1a36167c4 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:15.892425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d26361-2104-46c2-b191-5dc1a36167c4 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:15.893071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d26361-2104-46c2-b191-5dc1a36167c4 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:15.893941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d26361-2104-46c2-b191-5dc1a36167c4 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:15.894590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d26361-2104-46c2-b191-5dc1a36167c4 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:15.895225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7d26361-2104-46c2-b191-5dc1a36167c4 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:15.922462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-87882cfc-9a88-4bf7-9a26-aef44df1fb7f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-322684271", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": -1, "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:15.943144 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-87882cfc-9a88-4bf7-9a26-aef44df1fb7f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Flavor -1 could not be found. Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-87882cfc-9a88-4bf7-9a26-aef44df1fb7f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 205 Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-322684271", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": -1, "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: exception: Flavor -1 could not be found. Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-322684271', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': -1, 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:15.947165 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 11 19:55:15.952144 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:15.954408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-87882cfc-9a88-4bf7-9a26-aef44df1fb7f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:15.956188 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-87882cfc-9a88-4bf7-9a26-aef44df1fb7f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.040009 Oct 11 19:55:15.957741 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1535/3129] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:15 2022] POST /compute/v2.1/servers => generated 73 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:55:15.967997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-80f909ae-f0b7-413c-a118-4112cecb68da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:15.970441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-80f909ae-f0b7-413c-a118-4112cecb68da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:15.979298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f909ae-f0b7-413c-a118-4112cecb68da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:15.980113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d7d26361-2104-46c2-b191-5dc1a36167c4 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:15.980847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f909ae-f0b7-413c-a118-4112cecb68da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:15.981503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f909ae-f0b7-413c-a118-4112cecb68da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:15.982620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f909ae-f0b7-413c-a118-4112cecb68da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:15.984273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f909ae-f0b7-413c-a118-4112cecb68da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:15.984902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f909ae-f0b7-413c-a118-4112cecb68da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:15.988345 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d7d26361-2104-46c2-b191-5dc1a36167c4 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1482 microversion: 2.1 time: 0.109987 Oct 11 19:55:15.992696 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1595/3130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:15 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1482 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:16.253785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-80f909ae-f0b7-413c-a118-4112cecb68da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:16.265758 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-80f909ae-f0b7-413c-a118-4112cecb68da tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.302087 Oct 11 19:55:16.266353 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1536/3131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:15 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:16.291973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-001891d7-c13a-4a2a-9fa9-421cc340a774 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:16.292918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-001891d7-c13a-4a2a-9fa9-421cc340a774 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:16.301319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-001891d7-c13a-4a2a-9fa9-421cc340a774 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:16.302236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-001891d7-c13a-4a2a-9fa9-421cc340a774 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:16.303930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-001891d7-c13a-4a2a-9fa9-421cc340a774 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:16.304904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-001891d7-c13a-4a2a-9fa9-421cc340a774 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:16.305887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-001891d7-c13a-4a2a-9fa9-421cc340a774 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:16.306562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-001891d7-c13a-4a2a-9fa9-421cc340a774 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:16.385982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b6a250a-2fc3-4ac2-a653-512c0bec9f0e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:16.388060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8b6a250a-2fc3-4ac2-a653-512c0bec9f0e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:16.402963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b6a250a-2fc3-4ac2-a653-512c0bec9f0e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:16.403533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b6a250a-2fc3-4ac2-a653-512c0bec9f0e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:16.404198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b6a250a-2fc3-4ac2-a653-512c0bec9f0e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:16.405118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b6a250a-2fc3-4ac2-a653-512c0bec9f0e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:16.406650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b6a250a-2fc3-4ac2-a653-512c0bec9f0e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:16.407112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b6a250a-2fc3-4ac2-a653-512c0bec9f0e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:16.735575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-001891d7-c13a-4a2a-9fa9-421cc340a774 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:16.744777 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-001891d7-c13a-4a2a-9fa9-421cc340a774 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.457561 Oct 11 19:55:16.746912 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1596/3132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:16 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:16.750299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b6a250a-2fc3-4ac2-a653-512c0bec9f0e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:16.753066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9ae6b38-a269-43fe-a0d2-65b04506af04 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:16.754587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d9ae6b38-a269-43fe-a0d2-65b04506af04 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:16.763109 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b6a250a-2fc3-4ac2-a653-512c0bec9f0e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.382443 Oct 11 19:55:16.763614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9ae6b38-a269-43fe-a0d2-65b04506af04 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:16.764345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9ae6b38-a269-43fe-a0d2-65b04506af04 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:16.764720 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1537/3133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:16 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:16.765301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9ae6b38-a269-43fe-a0d2-65b04506af04 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:16.766244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9ae6b38-a269-43fe-a0d2-65b04506af04 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:16.766961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9ae6b38-a269-43fe-a0d2-65b04506af04 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:16.768445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9ae6b38-a269-43fe-a0d2-65b04506af04 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:16.916431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cf787ec9-5cdf-4fc8-aa98-c7d7f7d3a873 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-225764497", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cf787ec9-5cdf-4fc8-aa98-c7d7f7d3a873 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 172 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-225764497", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-225764497', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi -1 Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:55:16.921711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:16.927302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cf787ec9-5cdf-4fc8-aa98-c7d7f7d3a873 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:16.929820 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cf787ec9-5cdf-4fc8-aa98-c7d7f7d3a873 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.018567 Oct 11 19:55:16.931396 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1538/3134] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:16 2022] POST /compute/v2.1/servers => generated 145 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:55:16.940455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06c99775-11d4-4891-8c43-f5f675f8f1de tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:16.941332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-06c99775-11d4-4891-8c43-f5f675f8f1de tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:16.951764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06c99775-11d4-4891-8c43-f5f675f8f1de tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:16.952448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06c99775-11d4-4891-8c43-f5f675f8f1de tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:16.953191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06c99775-11d4-4891-8c43-f5f675f8f1de tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:16.954588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06c99775-11d4-4891-8c43-f5f675f8f1de tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:16.955458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06c99775-11d4-4891-8c43-f5f675f8f1de tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:16.956085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06c99775-11d4-4891-8c43-f5f675f8f1de tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.033587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d9ae6b38-a269-43fe-a0d2-65b04506af04 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:17.045518 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9ae6b38-a269-43fe-a0d2-65b04506af04 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1462 microversion: 2.1 time: 0.296900 Oct 11 19:55:17.047151 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1597/3135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:16 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1462 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:17.053586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:17.054570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:17.061655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.062501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.063317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.064271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.064977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.065601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.095650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:17.111623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.112425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.113205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.113863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lazy-loading 'fault' on Instance uuid 99eb7ce1-c903-472e-b46a-6714f5362eb9 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:55:17.185439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87ead5931eec4b68a40cd635295de387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76591022a59449b7b24a2de96cba0fa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:17.194318 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bbe2138b-6548-4afb-a6af-cc62baf37ce0 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 200 len: 1313 microversion: 2.1 time: 0.145496 Oct 11 19:55:17.195341 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1598/3136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:17 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:17.202356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-15c9bc0c-4920-4056-85f1-2e2346769d47 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:17.203182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-15c9bc0c-4920-4056-85f1-2e2346769d47 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:17.210937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15c9bc0c-4920-4056-85f1-2e2346769d47 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.211832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15c9bc0c-4920-4056-85f1-2e2346769d47 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.212707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15c9bc0c-4920-4056-85f1-2e2346769d47 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.213647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15c9bc0c-4920-4056-85f1-2e2346769d47 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.214333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15c9bc0c-4920-4056-85f1-2e2346769d47 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.215251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15c9bc0c-4920-4056-85f1-2e2346769d47 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.258920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-06c99775-11d4-4891-8c43-f5f675f8f1de tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:17.267531 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-06c99775-11d4-4891-8c43-f5f675f8f1de tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.331881 Oct 11 19:55:17.279250 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1539/3137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:16 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:17.306149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ea0a1f0-e894-479d-8325-e63f64f6392f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:17.307194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7ea0a1f0-e894-479d-8325-e63f64f6392f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:17.315149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ea0a1f0-e894-479d-8325-e63f64f6392f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.315848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ea0a1f0-e894-479d-8325-e63f64f6392f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.316631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ea0a1f0-e894-479d-8325-e63f64f6392f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.317552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ea0a1f0-e894-479d-8325-e63f64f6392f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.318293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ea0a1f0-e894-479d-8325-e63f64f6392f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.319043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ea0a1f0-e894-479d-8325-e63f64f6392f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.439830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-15c9bc0c-4920-4056-85f1-2e2346769d47 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:17.456069 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-15c9bc0c-4920-4056-85f1-2e2346769d47 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1462 microversion: 2.1 time: 0.258502 Oct 11 19:55:17.462998 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1599/3138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:17 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1462 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:17.491010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:17.495993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:17.511197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.512154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.514620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.515814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.517414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.518876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.521115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7ea0a1f0-e894-479d-8325-e63f64f6392f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:17.535153 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7ea0a1f0-e894-479d-8325-e63f64f6392f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.233399 Oct 11 19:55:17.549719 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1540/3139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:17 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:17.637496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:55:17.637926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:55:17.638405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:55:17.638846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:55:17.643907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:55:17.748154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:17.757868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.758380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.758859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.759583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.760039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.764639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.793971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-693565b6-8b36-4d6e-9f6b-0480636972ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:17.795453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-693565b6-8b36-4d6e-9f6b-0480636972ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:17.809988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-693565b6-8b36-4d6e-9f6b-0480636972ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.810910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-693565b6-8b36-4d6e-9f6b-0480636972ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.811574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-693565b6-8b36-4d6e-9f6b-0480636972ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.812687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-693565b6-8b36-4d6e-9f6b-0480636972ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.814093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-693565b6-8b36-4d6e-9f6b-0480636972ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.818024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-693565b6-8b36-4d6e-9f6b-0480636972ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.820927 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c3f7195-6bba-4cc8-9163-865326381a06 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action" status: 202 len: 1066 microversion: 2.1 time: 0.335597 Oct 11 19:55:17.823922 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1600/3140] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:17 2022] POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action => generated 1066 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 11 19:55:17.840423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e18009d-7972-49b6-a06c-6cef1f52603e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1503085238", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:17.845967 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1e18009d-7972-49b6-a06c-6cef1f52603e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e18009d-7972-49b6-a06c-6cef1f52603e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 216 Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1503085238", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1503085238', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:17.848136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:17.852601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:17.852601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:17.852601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:17.852601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:17.852601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:17.852601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:17.852601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 19:55:17.852601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:17.855304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e18009d-7972-49b6-a06c-6cef1f52603e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:17.856770 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1e18009d-7972-49b6-a06c-6cef1f52603e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.021765 Oct 11 19:55:17.860705 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1601/3141] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:17 2022] POST /compute/v2.1/servers => generated 123 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:55:17.868008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e6f19cb-1eca-4942-9f8a-56f786598704 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:17.868664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e6f19cb-1eca-4942-9f8a-56f786598704 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:17.892422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e6f19cb-1eca-4942-9f8a-56f786598704 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.893217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e6f19cb-1eca-4942-9f8a-56f786598704 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.895115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e6f19cb-1eca-4942-9f8a-56f786598704 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:17.896019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e6f19cb-1eca-4942-9f8a-56f786598704 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:17.896652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e6f19cb-1eca-4942-9f8a-56f786598704 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:17.897949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e6f19cb-1eca-4942-9f8a-56f786598704 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:18.229784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e6f19cb-1eca-4942-9f8a-56f786598704 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:18.237883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-693565b6-8b36-4d6e-9f6b-0480636972ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:18.248580 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-693565b6-8b36-4d6e-9f6b-0480636972ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.459890 Oct 11 19:55:18.249615 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1541/3142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:17 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:18.254846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97f87111-9f54-4bd0-bf5d-bcce4dbbfb69 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:18.255441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97f87111-9f54-4bd0-bf5d-bcce4dbbfb69 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:18.260376 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e6f19cb-1eca-4942-9f8a-56f786598704 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.398237 Oct 11 19:55:18.262138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f87111-9f54-4bd0-bf5d-bcce4dbbfb69 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:18.266819 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1602/3143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:17 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:18.268105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f87111-9f54-4bd0-bf5d-bcce4dbbfb69 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:18.273394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f87111-9f54-4bd0-bf5d-bcce4dbbfb69 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:18.274424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f87111-9f54-4bd0-bf5d-bcce4dbbfb69 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:18.275141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f87111-9f54-4bd0-bf5d-bcce4dbbfb69 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:18.276435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f87111-9f54-4bd0-bf5d-bcce4dbbfb69 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:18.307204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:18.461063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97f87111-9f54-4bd0-bf5d-bcce4dbbfb69 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:18.490502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97f87111-9f54-4bd0-bf5d-bcce4dbbfb69 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.238049 Oct 11 19:55:18.492498 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1542/3144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:18 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:18.500904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:18.501976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] [instance: 99eb7ce1-c903-472e-b46a-6714f5362eb9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:18.522142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:18.522736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:18.523155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:18.523923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:18.524388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:18.525973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:18.543236 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] HTTP exception thrown: Instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 could not be found. Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Request method failure captured: Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 HTTP/1.1 Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnbDIk3ck9VBiVt9aQGkTWqPQ-jEULaIwVLj5QT6YM3LrWeSQS_5PrxXCW606FwZS1FGHRiI5XwNy-9PiCfv8ypAnBlzezzv7XMWMOkHWWJcy8zsT-MnBkAPtDw8sgPeQXw3Oktzce1MXs6qy9cMmYJdwVBcczFCIdNfBOzksZlupY Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 76591022a59449b7b24a2de96cba0fa0 Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/76591022a59449b7b24a2de96cba0fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_76591022a59449b7b24a2de96cba0fa0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76591022a59449b7b24a2de96cba0fa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/76591022a59449b7b24a2de96cba0fa0"}]}] Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 76591022a59449b7b24a2de96cba0fa0 Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-199861992 Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FloatingIPsAssociationTestJSON-199861992-project Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 87ead5931eec4b68a40cd635295de387 Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-199861992-project Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 could not be found. Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '99eb7ce1-c903-472e-b46a-6714f5362eb9'} Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 could not be found. Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 could not be found. Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:18.544892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 could not be found. Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] Returning 404 to user: Instance 99eb7ce1-c903-472e-b46a-6714f5362eb9 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ffe40182-c752-463a-a125-46938fc1fdb7 tempest-FloatingIPsAssociationTestJSON-199861992 tempest-FloatingIPsAssociationTestJSON-199861992-project] 10.222.0.27 "GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9" status: 404 len: 111 microversion: 2.1 time: 0.051472 Oct 11 19:55:18.548809 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1543/3145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:18 2022] GET /compute/v2.1/servers/99eb7ce1-c903-472e-b46a-6714f5362eb9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:18.566737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dd15cec5-210b-40a4-b6f4-53cbb8d00e12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:18.567584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dd15cec5-210b-40a4-b6f4-53cbb8d00e12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:18.581253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c4f5dd0-03f0-47bf-bb70-264a21e527ec tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:18.587266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c4f5dd0-03f0-47bf-bb70-264a21e527ec tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:18.590848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd15cec5-210b-40a4-b6f4-53cbb8d00e12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:18.591371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd15cec5-210b-40a4-b6f4-53cbb8d00e12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:18.591812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd15cec5-210b-40a4-b6f4-53cbb8d00e12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:18.592534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd15cec5-210b-40a4-b6f4-53cbb8d00e12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:18.592998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd15cec5-210b-40a4-b6f4-53cbb8d00e12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:18.593430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd15cec5-210b-40a4-b6f4-53cbb8d00e12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:18.605589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c4f5dd0-03f0-47bf-bb70-264a21e527ec tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:18.608026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c4f5dd0-03f0-47bf-bb70-264a21e527ec tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:18.615453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c4f5dd0-03f0-47bf-bb70-264a21e527ec tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:18.621344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c4f5dd0-03f0-47bf-bb70-264a21e527ec tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:18.622092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c4f5dd0-03f0-47bf-bb70-264a21e527ec tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:18.626738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c4f5dd0-03f0-47bf-bb70-264a21e527ec tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:18.722894 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c4f5dd0-03f0-47bf-bb70-264a21e527ec tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/ips" status: 200 len: 144 microversion: 2.1 time: 0.459230 Oct 11 19:55:18.723855 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1603/3146] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 19:55:18 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/ips => generated 144 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:18.977105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dd15cec5-210b-40a4-b6f4-53cbb8d00e12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:18.989894 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dd15cec5-210b-40a4-b6f4-53cbb8d00e12 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.441994 Oct 11 19:55:18.994252 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1544/3147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:18 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:19.176755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4f8330a8-c5af-46c4-bbb5-c87d9c31e18d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-366516180", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "key_name": "tempest-key-1584412238", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:19.249355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-4f8330a8-c5af-46c4-bbb5-c87d9c31e18d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] validate_networks() for [('94a98399-e5d5-46d5-b3fe-da4714c7413b', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:55:19.277157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-01270b75-14b7-41b8-9af8-41d611dc215a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:19.280649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-01270b75-14b7-41b8-9af8-41d611dc215a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:19.289716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01270b75-14b7-41b8-9af8-41d611dc215a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:19.290632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01270b75-14b7-41b8-9af8-41d611dc215a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:19.291370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01270b75-14b7-41b8-9af8-41d611dc215a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:19.292738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01270b75-14b7-41b8-9af8-41d611dc215a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:19.293542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01270b75-14b7-41b8-9af8-41d611dc215a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:19.294312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01270b75-14b7-41b8-9af8-41d611dc215a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:19.732421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-01270b75-14b7-41b8-9af8-41d611dc215a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:19.741267 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-01270b75-14b7-41b8-9af8-41d611dc215a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.469233 Oct 11 19:55:19.764081 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1545/3148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:19 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:19.770491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-10fbc4cc-3fbd-49d3-a6bf-a6864f0e8e98 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:19.771539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-10fbc4cc-3fbd-49d3-a6bf-a6864f0e8e98 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:19.779001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10fbc4cc-3fbd-49d3-a6bf-a6864f0e8e98 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:19.779883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10fbc4cc-3fbd-49d3-a6bf-a6864f0e8e98 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:19.780574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10fbc4cc-3fbd-49d3-a6bf-a6864f0e8e98 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:19.781617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10fbc4cc-3fbd-49d3-a6bf-a6864f0e8e98 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:19.782772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10fbc4cc-3fbd-49d3-a6bf-a6864f0e8e98 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:19.783442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10fbc4cc-3fbd-49d3-a6bf-a6864f0e8e98 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:20.401199 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4f8330a8-c5af-46c4-bbb5-c87d9c31e18d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Invalid key_name provided. Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4f8330a8-c5af-46c4-bbb5-c87d9c31e18d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 246 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-366516180", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "key_name": "tempest-key-1584412238", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid key_name provided. Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-366516180', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'key_name': 'tempest-key-1584412238', 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1584412238 not found for user 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:20.405067 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 11 19:55:20.409549 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:20.417679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4f8330a8-c5af-46c4-bbb5-c87d9c31e18d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid key_name provided. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:20.418927 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4f8330a8-c5af-46c4-bbb5-c87d9c31e18d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.246400 Oct 11 19:55:20.420106 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1604/3149] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:19 2022] POST /compute/v2.1/servers => generated 70 bytes in 1248 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:55:20.429942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5acbd0d-aeac-4674-b943-951a3661dfe6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:20.431228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f5acbd0d-aeac-4674-b943-951a3661dfe6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:20.439996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5acbd0d-aeac-4674-b943-951a3661dfe6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:20.440710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5acbd0d-aeac-4674-b943-951a3661dfe6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:20.441347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5acbd0d-aeac-4674-b943-951a3661dfe6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:20.444449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5acbd0d-aeac-4674-b943-951a3661dfe6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:20.445169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5acbd0d-aeac-4674-b943-951a3661dfe6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:20.445834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5acbd0d-aeac-4674-b943-951a3661dfe6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:20.585261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-10fbc4cc-3fbd-49d3-a6bf-a6864f0e8e98 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:20.603302 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-10fbc4cc-3fbd-49d3-a6bf-a6864f0e8e98 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.834132 Oct 11 19:55:20.605264 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1546/3150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:19 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:20.771479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-78fce2ff-7d0e-4d0d-bb91-93ffdd10a3ee tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:20.772537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-78fce2ff-7d0e-4d0d-bb91-93ffdd10a3ee tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:20.779132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78fce2ff-7d0e-4d0d-bb91-93ffdd10a3ee tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:20.779966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78fce2ff-7d0e-4d0d-bb91-93ffdd10a3ee tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:20.780649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78fce2ff-7d0e-4d0d-bb91-93ffdd10a3ee tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:20.781888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78fce2ff-7d0e-4d0d-bb91-93ffdd10a3ee tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:20.782596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78fce2ff-7d0e-4d0d-bb91-93ffdd10a3ee tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:20.783266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78fce2ff-7d0e-4d0d-bb91-93ffdd10a3ee tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:20.954818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f5acbd0d-aeac-4674-b943-951a3661dfe6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:20.966640 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5acbd0d-aeac-4674-b943-951a3661dfe6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.542363 Oct 11 19:55:20.967811 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1605/3151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:20 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:20.992017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a11aa143-9b2b-4ca8-a35f-f708c72e8014 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:20.993228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a11aa143-9b2b-4ca8-a35f-f708c72e8014 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:21.005701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a11aa143-9b2b-4ca8-a35f-f708c72e8014 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:21.009311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a11aa143-9b2b-4ca8-a35f-f708c72e8014 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:21.010103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a11aa143-9b2b-4ca8-a35f-f708c72e8014 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:21.010892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a11aa143-9b2b-4ca8-a35f-f708c72e8014 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:21.011355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a11aa143-9b2b-4ca8-a35f-f708c72e8014 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:21.011786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a11aa143-9b2b-4ca8-a35f-f708c72e8014 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:21.289586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-78fce2ff-7d0e-4d0d-bb91-93ffdd10a3ee tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:21.301861 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-78fce2ff-7d0e-4d0d-bb91-93ffdd10a3ee tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.534246 Oct 11 19:55:21.304366 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1547/3152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:20 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:21.390849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2cea479a-df2d-487d-b6fc-3d088340095d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43afbbd5-4d8e-456b-b470-51d540c2c5e3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:21.392159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=24 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:21.394316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2cea479a-df2d-487d-b6fc-3d088340095d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:21.409913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cea479a-df2d-487d-b6fc-3d088340095d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:21.414938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cea479a-df2d-487d-b6fc-3d088340095d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:21.415989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cea479a-df2d-487d-b6fc-3d088340095d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:21.417427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cea479a-df2d-487d-b6fc-3d088340095d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:21.418109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cea479a-df2d-487d-b6fc-3d088340095d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:21.418788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cea479a-df2d-487d-b6fc-3d088340095d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:21.651859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a11aa143-9b2b-4ca8-a35f-f708c72e8014 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:21.675632 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a11aa143-9b2b-4ca8-a35f-f708c72e8014 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.687886 Oct 11 19:55:21.677947 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1606/3153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:20 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:21.686116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e3e0eda8-ff69-48f6-9654-37a6685c1a2e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:21.690980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e3e0eda8-ff69-48f6-9654-37a6685c1a2e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:21.705889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3e0eda8-ff69-48f6-9654-37a6685c1a2e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:21.708681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3e0eda8-ff69-48f6-9654-37a6685c1a2e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:21.710016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3e0eda8-ff69-48f6-9654-37a6685c1a2e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:21.713145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3e0eda8-ff69-48f6-9654-37a6685c1a2e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:21.713908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3e0eda8-ff69-48f6-9654-37a6685c1a2e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:21.714617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3e0eda8-ff69-48f6-9654-37a6685c1a2e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:21.893601 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2cea479a-df2d-487d-b6fc-3d088340095d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506582 Oct 11 19:55:21.896586 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1548/3154] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 19:55:21 2022] POST /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments => generated 194 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:21.912303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7697b15b-265d-41ff-98db-0c639d4cbe2e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1191470869", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:22.260494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.security_group_api [None req-7697b15b-265d-41ff-98db-0c639d4cbe2e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Neutron security group does_not_exist not found {{(pid=126955) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 11 19:55:22.262456 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7697b15b-265d-41ff-98db-0c639d4cbe2e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 11 19:55:22.272047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e3e0eda8-ff69-48f6-9654-37a6685c1a2e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7697b15b-265d-41ff-98db-0c639d4cbe2e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 258 Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1191470869", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1191470869', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 11 19:55:22.277120 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:22.281151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7697b15b-265d-41ff-98db-0c639d4cbe2e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:22.286732 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7697b15b-265d-41ff-98db-0c639d4cbe2e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.379787 Oct 11 19:55:22.286732 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1549/3155] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:21 2022] POST /compute/v2.1/servers => generated 106 bytes in 381 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:55:22.292525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-46d8b4d9-744d-4e55-86b4-a275355cde83 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:22.296701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-46d8b4d9-744d-4e55-86b4-a275355cde83 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:22.299095 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e3e0eda8-ff69-48f6-9654-37a6685c1a2e tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.617664 Oct 11 19:55:22.301522 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1607/3156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:21 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:22.317066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46d8b4d9-744d-4e55-86b4-a275355cde83 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:22.319365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46d8b4d9-744d-4e55-86b4-a275355cde83 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:22.320084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46d8b4d9-744d-4e55-86b4-a275355cde83 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:22.321009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46d8b4d9-744d-4e55-86b4-a275355cde83 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:22.321639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46d8b4d9-744d-4e55-86b4-a275355cde83 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:22.322253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46d8b4d9-744d-4e55-86b4-a275355cde83 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:22.332622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e12e3960-06f1-48df-92ac-1f2599bfbb8e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:22.333241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e12e3960-06f1-48df-92ac-1f2599bfbb8e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:22.341509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e12e3960-06f1-48df-92ac-1f2599bfbb8e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:22.342489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e12e3960-06f1-48df-92ac-1f2599bfbb8e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:22.343106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e12e3960-06f1-48df-92ac-1f2599bfbb8e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:22.343980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e12e3960-06f1-48df-92ac-1f2599bfbb8e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:22.344577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e12e3960-06f1-48df-92ac-1f2599bfbb8e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:22.345157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e12e3960-06f1-48df-92ac-1f2599bfbb8e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:22.478033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=12 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:22.775975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e12e3960-06f1-48df-92ac-1f2599bfbb8e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:22.787092 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e12e3960-06f1-48df-92ac-1f2599bfbb8e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.460016 Oct 11 19:55:22.790545 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1608/3157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:22 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:22.848915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-46d8b4d9-744d-4e55-86b4-a275355cde83 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:22.860653 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-46d8b4d9-744d-4e55-86b4-a275355cde83 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.576952 Oct 11 19:55:22.863215 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1550/3158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:22 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:22.892237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-81d7c7e5-342e-4bd2-824c-b2cae16b15a1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:22.892950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-81d7c7e5-342e-4bd2-824c-b2cae16b15a1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:22.905079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d7c7e5-342e-4bd2-824c-b2cae16b15a1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:22.906230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d7c7e5-342e-4bd2-824c-b2cae16b15a1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:22.906940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d7c7e5-342e-4bd2-824c-b2cae16b15a1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:22.907886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d7c7e5-342e-4bd2-824c-b2cae16b15a1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:22.908595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d7c7e5-342e-4bd2-824c-b2cae16b15a1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:22.914920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d7c7e5-342e-4bd2-824c-b2cae16b15a1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:23.582188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-81d7c7e5-342e-4bd2-824c-b2cae16b15a1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:23.598849 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-81d7c7e5-342e-4bd2-824c-b2cae16b15a1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.711500 Oct 11 19:55:23.614018 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1609/3159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:22 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:23.630579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-edc0ec97-e344-4a60-8395-c74f42ac9f8a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:23.634085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-edc0ec97-e344-4a60-8395-c74f42ac9f8a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:23.639664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eeb6f26e-f66c-4312-ae4b-c51d91e3edd2 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Action: 'create', calling method: .version_select at 0x7f83cc19ba60>, body: {"keypair": {"name": "tempest-keypair-849669695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPiukVc4+sa+Azud/wq1NYrJRpe1KFGMiRHQYt0yTKHyRZGbVIrBhpE2JPR7EGkBOBTAjtf74T2w2ioKBlDHLCO1qGscWkfrLM4uQbNtzWnT0s/0/6p6VkqfcXebIn0cA=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:23.651915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edc0ec97-e344-4a60-8395-c74f42ac9f8a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:23.653795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edc0ec97-e344-4a60-8395-c74f42ac9f8a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:23.654757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edc0ec97-e344-4a60-8395-c74f42ac9f8a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:23.656789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edc0ec97-e344-4a60-8395-c74f42ac9f8a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:23.657969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edc0ec97-e344-4a60-8395-c74f42ac9f8a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:23.658746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edc0ec97-e344-4a60-8395-c74f42ac9f8a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:23.708043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-eeb6f26e-f66c-4312-ae4b-c51d91e3edd2 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Getting quotas for project 1ef09f5386314639b7a5d6a3a6bc6320. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:23.755754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-eeb6f26e-f66c-4312-ae4b-c51d91e3edd2 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Getting quotas for user e57648a513c14c3b9f81b1c1e1eafcd8 and project 1ef09f5386314639b7a5d6a3a6bc6320. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:23.826625 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eeb6f26e-f66c-4312-ae4b-c51d91e3edd2 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.503622 Oct 11 19:55:23.827478 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1551/3160] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:55:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:23.842212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d35f2a18-238d-4c1c-baf5-81dd6ff83fbf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:23.852993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d35f2a18-238d-4c1c-baf5-81dd6ff83fbf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:23.890345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f2a18-238d-4c1c-baf5-81dd6ff83fbf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:23.890881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f2a18-238d-4c1c-baf5-81dd6ff83fbf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:23.891497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f2a18-238d-4c1c-baf5-81dd6ff83fbf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:23.892368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f2a18-238d-4c1c-baf5-81dd6ff83fbf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:23.892980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f2a18-238d-4c1c-baf5-81dd6ff83fbf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:23.893565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35f2a18-238d-4c1c-baf5-81dd6ff83fbf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:24.095772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-edc0ec97-e344-4a60-8395-c74f42ac9f8a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:24.105606 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-edc0ec97-e344-4a60-8395-c74f42ac9f8a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.490422 Oct 11 19:55:24.118436 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1610/3161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:23 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:24.144911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-05685b56-2d9d-43d2-9172-aa06489d7d28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:24.145876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-05685b56-2d9d-43d2-9172-aa06489d7d28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 76297494-d4b7-47eb-a6c0-fd07a5cbaf51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:24.159433 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-05685b56-2d9d-43d2-9172-aa06489d7d28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance 76297494-d4b7-47eb-a6c0-fd07a5cbaf51 could not be found. Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-05685b56-2d9d-43d2-9172-aa06489d7d28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/76297494-d4b7-47eb-a6c0-fd07a5cbaf51 HTTP/1.1 Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 76297494-d4b7-47eb-a6c0-fd07a5cbaf51 could not be found. Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '76297494-d4b7-47eb-a6c0-fd07a5cbaf51'} Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76297494-d4b7-47eb-a6c0-fd07a5cbaf51 could not be found. Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76297494-d4b7-47eb-a6c0-fd07a5cbaf51 could not be found. Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:24.166277 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:24.170381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:24.170381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:24.170381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:24.170381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:24.170381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:24.170381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:24.170381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76297494-d4b7-47eb-a6c0-fd07a5cbaf51 could not be found. Oct 11 19:55:24.170381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:24.187514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-05685b56-2d9d-43d2-9172-aa06489d7d28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance 76297494-d4b7-47eb-a6c0-fd07a5cbaf51 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:24.190450 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-05685b56-2d9d-43d2-9172-aa06489d7d28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "DELETE /compute/v2.1/servers/76297494-d4b7-47eb-a6c0-fd07a5cbaf51" status: 404 len: 111 microversion: 2.1 time: 0.070039 Oct 11 19:55:24.191727 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1611/3162] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:55:24 2022] DELETE /compute/v2.1/servers/76297494-d4b7-47eb-a6c0-fd07a5cbaf51 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:24.199307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1d0b0d69-a8ec-4f0b-9944-8f3814ebb757 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:24.200422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1d0b0d69-a8ec-4f0b-9944-8f3814ebb757 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:24.208312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d0b0d69-a8ec-4f0b-9944-8f3814ebb757 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:24.209169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d0b0d69-a8ec-4f0b-9944-8f3814ebb757 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:24.212222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d0b0d69-a8ec-4f0b-9944-8f3814ebb757 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:24.213232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d0b0d69-a8ec-4f0b-9944-8f3814ebb757 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:24.214673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d0b0d69-a8ec-4f0b-9944-8f3814ebb757 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:24.215343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d0b0d69-a8ec-4f0b-9944-8f3814ebb757 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:24.805325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d35f2a18-238d-4c1c-baf5-81dd6ff83fbf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:24.820839 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d35f2a18-238d-4c1c-baf5-81dd6ff83fbf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.983344 Oct 11 19:55:24.827009 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1552/3163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:23 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:24.872821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b7482427-76b7-4b58-8d4f-eb72423c048a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:24.878318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b7482427-76b7-4b58-8d4f-eb72423c048a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:24.897673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7482427-76b7-4b58-8d4f-eb72423c048a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:24.900542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7482427-76b7-4b58-8d4f-eb72423c048a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:24.902058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7482427-76b7-4b58-8d4f-eb72423c048a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:24.915729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7482427-76b7-4b58-8d4f-eb72423c048a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:24.916499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7482427-76b7-4b58-8d4f-eb72423c048a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:24.917126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7482427-76b7-4b58-8d4f-eb72423c048a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:24.956794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1d0b0d69-a8ec-4f0b-9944-8f3814ebb757 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:24.975191 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1d0b0d69-a8ec-4f0b-9944-8f3814ebb757 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.779634 Oct 11 19:55:24.992681 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1612/3164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:24 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:25.002129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11e1a534-ba80-4e38-9bd2-fa28207589d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:25.003412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-11e1a534-ba80-4e38-9bd2-fa28207589d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:25.019559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e1a534-ba80-4e38-9bd2-fa28207589d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:25.020930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e1a534-ba80-4e38-9bd2-fa28207589d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:25.021546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e1a534-ba80-4e38-9bd2-fa28207589d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:25.023931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e1a534-ba80-4e38-9bd2-fa28207589d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:25.025016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e1a534-ba80-4e38-9bd2-fa28207589d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:25.027384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e1a534-ba80-4e38-9bd2-fa28207589d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:25.597034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7482427-76b7-4b58-8d4f-eb72423c048a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:25.606513 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b7482427-76b7-4b58-8d4f-eb72423c048a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.778163 Oct 11 19:55:25.622552 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1553/3165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:24 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:25.622790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-595993b7-b06b-42aa-9ab4-43ea4a3cb2fb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:25.623743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-595993b7-b06b-42aa-9ab4-43ea4a3cb2fb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:25.641118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-595993b7-b06b-42aa-9ab4-43ea4a3cb2fb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:25.642203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-11e1a534-ba80-4e38-9bd2-fa28207589d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:25.645374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-595993b7-b06b-42aa-9ab4-43ea4a3cb2fb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:25.646098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-595993b7-b06b-42aa-9ab4-43ea4a3cb2fb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:25.650115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-595993b7-b06b-42aa-9ab4-43ea4a3cb2fb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:25.650875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-595993b7-b06b-42aa-9ab4-43ea4a3cb2fb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:25.652141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-595993b7-b06b-42aa-9ab4-43ea4a3cb2fb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:25.660764 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-11e1a534-ba80-4e38-9bd2-fa28207589d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.666524 Oct 11 19:55:25.661509 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1613/3166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:24 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:25.676779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ea5a7df2-8aea-4b19-a767-860cf1e86756 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:25.681856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ea5a7df2-8aea-4b19-a767-860cf1e86756 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:25.708361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea5a7df2-8aea-4b19-a767-860cf1e86756 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:25.710557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea5a7df2-8aea-4b19-a767-860cf1e86756 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:25.711031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea5a7df2-8aea-4b19-a767-860cf1e86756 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:25.711778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea5a7df2-8aea-4b19-a767-860cf1e86756 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:25.712247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea5a7df2-8aea-4b19-a767-860cf1e86756 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:25.712680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea5a7df2-8aea-4b19-a767-860cf1e86756 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:26.291480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ea5a7df2-8aea-4b19-a767-860cf1e86756 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:26.305541 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ea5a7df2-8aea-4b19-a767-860cf1e86756 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.642496 Oct 11 19:55:26.309757 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1614/3167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:25 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:26.321895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c36c2da-5c51-43f5-9c83-cb338d88fb9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:26.327804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6c36c2da-5c51-43f5-9c83-cb338d88fb9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:26.342161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c36c2da-5c51-43f5-9c83-cb338d88fb9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:26.345400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c36c2da-5c51-43f5-9c83-cb338d88fb9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:26.348148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c36c2da-5c51-43f5-9c83-cb338d88fb9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:26.348911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-595993b7-b06b-42aa-9ab4-43ea4a3cb2fb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:26.352412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c36c2da-5c51-43f5-9c83-cb338d88fb9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:26.355575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c36c2da-5c51-43f5-9c83-cb338d88fb9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:26.356322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c36c2da-5c51-43f5-9c83-cb338d88fb9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:26.368641 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-595993b7-b06b-42aa-9ab4-43ea4a3cb2fb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.749919 Oct 11 19:55:26.369365 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1554/3168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:25 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:26.378382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-482c96f8-b415-4c29-b96c-08da6e25bd0d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:26.390002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-482c96f8-b415-4c29-b96c-08da6e25bd0d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:26.409689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-482c96f8-b415-4c29-b96c-08da6e25bd0d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:26.417255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-482c96f8-b415-4c29-b96c-08da6e25bd0d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:26.418019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-482c96f8-b415-4c29-b96c-08da6e25bd0d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:26.418965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-482c96f8-b415-4c29-b96c-08da6e25bd0d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:26.424072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-482c96f8-b415-4c29-b96c-08da6e25bd0d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:26.424764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-482c96f8-b415-4c29-b96c-08da6e25bd0d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:26.617166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6c36c2da-5c51-43f5-9c83-cb338d88fb9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:26.624033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:26.634194 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6c36c2da-5c51-43f5-9c83-cb338d88fb9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.317692 Oct 11 19:55:26.643713 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1615/3169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:26 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:26.654455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a61f986-c7bf-42b2-b84d-8fc4389bb227 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:26.657397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0a61f986-c7bf-42b2-b84d-8fc4389bb227 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Failed to fetch instance by id 9223372036854775808 {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 19:55:26.658146 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0a61f986-c7bf-42b2-b84d-8fc4389bb227 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a61f986-c7bf-42b2-b84d-8fc4389bb227 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 9223372036854775808 could not be found. Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '9223372036854775808'} Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:26.672044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:26.676170 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:26.676170 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:26.676170 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:26.676170 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 11 19:55:26.676170 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:26.676170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a61f986-c7bf-42b2-b84d-8fc4389bb227 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:26.676170 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a61f986-c7bf-42b2-b84d-8fc4389bb227 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.035881 Oct 11 19:55:26.676727 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1616/3170] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Oct 11 19:55:26 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:55:26.697614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9502f59e-a8f1-4e42-b244-1ea9f3281c88 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-922539158"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:26.700716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9502f59e-a8f1-4e42-b244-1ea9f3281c88 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:26.717411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=95,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:26.721783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9502f59e-a8f1-4e42-b244-1ea9f3281c88 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:26.723089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9502f59e-a8f1-4e42-b244-1ea9f3281c88 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:26.724455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9502f59e-a8f1-4e42-b244-1ea9f3281c88 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:26.725977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9502f59e-a8f1-4e42-b244-1ea9f3281c88 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:26.728636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9502f59e-a8f1-4e42-b244-1ea9f3281c88 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:26.729908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9502f59e-a8f1-4e42-b244-1ea9f3281c88 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:26.939278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-482c96f8-b415-4c29-b96c-08da6e25bd0d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:26.958108 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-482c96f8-b415-4c29-b96c-08da6e25bd0d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1502 microversion: 2.1 time: 0.586310 Oct 11 19:55:26.976755 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1555/3171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:26 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1502 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:26.990439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-31cb0af1-4b6a-49de-9a0d-29b628ab4c57 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:26.996851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-31cb0af1-4b6a-49de-9a0d-29b628ab4c57 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:27.008525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31cb0af1-4b6a-49de-9a0d-29b628ab4c57 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.012642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31cb0af1-4b6a-49de-9a0d-29b628ab4c57 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.013281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31cb0af1-4b6a-49de-9a0d-29b628ab4c57 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.014212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31cb0af1-4b6a-49de-9a0d-29b628ab4c57 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.014884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31cb0af1-4b6a-49de-9a0d-29b628ab4c57 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.015477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31cb0af1-4b6a-49de-9a0d-29b628ab4c57 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.282233 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9502f59e-a8f1-4e42-b244-1ea9f3281c88 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.604060 Oct 11 19:55:27.286105 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1617/3172] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:26 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 11 19:55:27.295302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae2f5d40-c10d-4a18-a81e-3c1668e61690"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:27.298078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:27.312091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.314225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.315679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.320272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.321015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.321675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.366460 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] HTTP exception thrown: Cannot 'attach_volume' instance 0ac52ec7-a881-454c-89ea-25e9d288b87d while it is in vm_state rescued Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Request method failure captured: Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/os-volume_attachments HTTP/1.1 Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 74 Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnHf-gY9GoFThGWTuyLZOFCjiBlppqFx09S1rxIOZhPN4k_d-_Y9sZYcmKSj4UOYvu9oafZcIYglvMprUUmJuXwAUoSMveDAF_xAfvCOrPvWGeWuOLI47ySPf1501t-RY5r2Fgp6Sqr-jc81_0LijQqzlDf3IXjp_i8MKsYX5dySSY Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8df2eebeffd440d988aa6f580c9bb221", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}] Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d1ab8c29f18c4fc09858791a80527e5d Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: {"volumeAttachment": {"volumeId": "ae2f5d40-c10d-4a18-a81e-3c1668e61690"}} Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: exception: Cannot 'attach_volume' instance 0ac52ec7-a881-454c-89ea-25e9d288b87d while it is in vm_state rescued Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': '0ac52ec7-a881-454c-89ea-25e9d288b87d', 'body': {'volumeAttachment': {'volumeId': 'ae2f5d40-c10d-4a18-a81e-3c1668e61690'}}} Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0ac52ec7-a881-454c-89ea-25e9d288b87d in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 11 19:55:27.368208 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0ac52ec7-a881-454c-89ea-25e9d288b87d while it is in vm_state rescued Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0ac52ec7-a881-454c-89ea-25e9d288b87d while it is in vm_state rescued Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:27.375408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Returning 409 to user: Cannot 'attach_volume' instance 0ac52ec7-a881-454c-89ea-25e9d288b87d while it is in vm_state rescued {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:27.376944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-31cb0af1-4b6a-49de-9a0d-29b628ab4c57 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:27.377387 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1fd20354-1d67-4ab6-bb4e-d7236c6aa829 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.079460 Oct 11 19:55:27.377387 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1618/3173] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 19:55:27 2022] POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/os-volume_attachments => generated 152 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:55:27.384501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c8d78fc-86b0-42e3-9718-f028fd3b79d7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:27.384863 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-31cb0af1-4b6a-49de-9a0d-29b628ab4c57 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.406527 Oct 11 19:55:27.385061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c8d78fc-86b0-42e3-9718-f028fd3b79d7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:27.385473 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1556/3174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:26 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:27.405976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c8d78fc-86b0-42e3-9718-f028fd3b79d7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.407260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c8d78fc-86b0-42e3-9718-f028fd3b79d7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.407605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c8d78fc-86b0-42e3-9718-f028fd3b79d7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.408343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c8d78fc-86b0-42e3-9718-f028fd3b79d7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.408709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3c42f8db-93a5-437b-90bb-91c6a8bc94d7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:27.408831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c8d78fc-86b0-42e3-9718-f028fd3b79d7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.409207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c8d78fc-86b0-42e3-9718-f028fd3b79d7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.409366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3c42f8db-93a5-437b-90bb-91c6a8bc94d7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:27.450359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c42f8db-93a5-437b-90bb-91c6a8bc94d7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.452440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c42f8db-93a5-437b-90bb-91c6a8bc94d7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.457192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c42f8db-93a5-437b-90bb-91c6a8bc94d7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.458831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c42f8db-93a5-437b-90bb-91c6a8bc94d7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.460225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c42f8db-93a5-437b-90bb-91c6a8bc94d7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.462610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c42f8db-93a5-437b-90bb-91c6a8bc94d7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.603562 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c8d78fc-86b0-42e3-9718-f028fd3b79d7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action" status: 202 len: 0 microversion: 2.1 time: 0.227842 Oct 11 19:55:27.608134 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1619/3175] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:27 2022] POST /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:55:27.619144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13845e86-4fa3-4716-9470-0466ce4330b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:27.621000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-13845e86-4fa3-4716-9470-0466ce4330b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:27.638283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13845e86-4fa3-4716-9470-0466ce4330b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.641421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13845e86-4fa3-4716-9470-0466ce4330b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.641907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13845e86-4fa3-4716-9470-0466ce4330b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.642672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13845e86-4fa3-4716-9470-0466ce4330b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.646337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13845e86-4fa3-4716-9470-0466ce4330b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.647503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13845e86-4fa3-4716-9470-0466ce4330b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.918216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3c42f8db-93a5-437b-90bb-91c6a8bc94d7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:27.930110 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3c42f8db-93a5-437b-90bb-91c6a8bc94d7 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.530682 Oct 11 19:55:27.932416 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1557/3176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:27 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:27.943701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c8a7165-d0a8-4801-9527-1fa2694b355c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:27.944345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c8a7165-d0a8-4801-9527-1fa2694b355c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:27.959877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8a7165-d0a8-4801-9527-1fa2694b355c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.961738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8a7165-d0a8-4801-9527-1fa2694b355c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.962829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8a7165-d0a8-4801-9527-1fa2694b355c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:27.966273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8a7165-d0a8-4801-9527-1fa2694b355c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:27.966953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8a7165-d0a8-4801-9527-1fa2694b355c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:27.967712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8a7165-d0a8-4801-9527-1fa2694b355c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:28.086503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13845e86-4fa3-4716-9470-0466ce4330b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:28.103126 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13845e86-4fa3-4716-9470-0466ce4330b1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.490432 Oct 11 19:55:28.103721 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1620/3177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:27 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:28.132823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6344f3c-69e2-4e74-8d6f-8bd71f594de6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:28.134982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6344f3c-69e2-4e74-8d6f-8bd71f594de6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Failed to fetch instance by id -1 {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 19:55:28.135788 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-d6344f3c-69e2-4e74-8d6f-8bd71f594de6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance -1 could not be found. Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6344f3c-69e2-4e74-8d6f-8bd71f594de6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance -1 could not be found. Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '-1'} Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:28.137698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:28.141742 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:28.141742 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:28.141742 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 11 19:55:28.141742 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:28.143331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6344f3c-69e2-4e74-8d6f-8bd71f594de6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance -1 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:28.152004 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6344f3c-69e2-4e74-8d6f-8bd71f594de6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.023263 Oct 11 19:55:28.152795 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1621/3178] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:55:28 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 19:55:28.161709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62611c25-98fa-4816-b6b5-92dcaff3ef10 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:28.166155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-62611c25-98fa-4816-b6b5-92dcaff3ef10 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:28.185187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62611c25-98fa-4816-b6b5-92dcaff3ef10 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:28.186423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62611c25-98fa-4816-b6b5-92dcaff3ef10 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:28.187663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62611c25-98fa-4816-b6b5-92dcaff3ef10 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:28.189262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62611c25-98fa-4816-b6b5-92dcaff3ef10 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:28.189961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62611c25-98fa-4816-b6b5-92dcaff3ef10 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:28.202649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62611c25-98fa-4816-b6b5-92dcaff3ef10 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:28.636194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6c8a7165-d0a8-4801-9527-1fa2694b355c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:28.650954 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c8a7165-d0a8-4801-9527-1fa2694b355c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1510 microversion: 2.1 time: 0.717261 Oct 11 19:55:28.652188 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1558/3179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:27 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1510 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:28.817615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-62611c25-98fa-4816-b6b5-92dcaff3ef10 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:28.826923 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-62611c25-98fa-4816-b6b5-92dcaff3ef10 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.669543 Oct 11 19:55:28.832516 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1622/3180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:28 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:28.861871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-69f61e81-f166-4847-b932-6f510ebfb9c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:28.862501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-69f61e81-f166-4847-b932-6f510ebfb9c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:28.883753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69f61e81-f166-4847-b932-6f510ebfb9c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:28.884658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69f61e81-f166-4847-b932-6f510ebfb9c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:28.887087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69f61e81-f166-4847-b932-6f510ebfb9c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:28.889095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69f61e81-f166-4847-b932-6f510ebfb9c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:28.889833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69f61e81-f166-4847-b932-6f510ebfb9c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:28.892791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69f61e81-f166-4847-b932-6f510ebfb9c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:28.958350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8cfc9d0c-25c1-4558-9ae3-545ba10ec4c6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:28.958996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8cfc9d0c-25c1-4558-9ae3-545ba10ec4c6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:28.973872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cfc9d0c-25c1-4558-9ae3-545ba10ec4c6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:28.974621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cfc9d0c-25c1-4558-9ae3-545ba10ec4c6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:28.975525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cfc9d0c-25c1-4558-9ae3-545ba10ec4c6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:28.988394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cfc9d0c-25c1-4558-9ae3-545ba10ec4c6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:28.989104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cfc9d0c-25c1-4558-9ae3-545ba10ec4c6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:28.989740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cfc9d0c-25c1-4558-9ae3-545ba10ec4c6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:29.377122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-69f61e81-f166-4847-b932-6f510ebfb9c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:29.394503 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-69f61e81-f166-4847-b932-6f510ebfb9c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.537274 Oct 11 19:55:29.398478 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1559/3181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:28 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:29.420877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fca1773-5dfc-4bf5-b441-69d1030fbdcf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:29.421878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9fca1773-5dfc-4bf5-b441-69d1030fbdcf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: ae410492-c8ed-4d26-946e-a4b21df05495] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:29.432264 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9fca1773-5dfc-4bf5-b441-69d1030fbdcf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance ae410492-c8ed-4d26-946e-a4b21df05495 could not be found. Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fca1773-5dfc-4bf5-b441-69d1030fbdcf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/ae410492-c8ed-4d26-946e-a4b21df05495/action HTTP/1.1 Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 19 Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: {"forceDelete": {}} Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ae410492-c8ed-4d26-946e-a4b21df05495 could not be found. Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ae410492-c8ed-4d26-946e-a4b21df05495', 'body': {'forceDelete': {}}} Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae410492-c8ed-4d26-946e-a4b21df05495 could not be found. Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae410492-c8ed-4d26-946e-a4b21df05495 could not be found. Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:29.441161 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:29.448911 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:29.448911 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:29.448911 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae410492-c8ed-4d26-946e-a4b21df05495 could not be found. Oct 11 19:55:29.448911 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:29.448911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fca1773-5dfc-4bf5-b441-69d1030fbdcf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance ae410492-c8ed-4d26-946e-a4b21df05495 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:29.448911 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9fca1773-5dfc-4bf5-b441-69d1030fbdcf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/ae410492-c8ed-4d26-946e-a4b21df05495/action" status: 404 len: 111 microversion: 2.1 time: 0.027233 Oct 11 19:55:29.448911 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1560/3182] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:29 2022] POST /compute/v2.1/servers/ae410492-c8ed-4d26-946e-a4b21df05495/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:55:29.453955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-926f6c4f-61d8-4de5-89a6-2997222ca00f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:29.457064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-926f6c4f-61d8-4de5-89a6-2997222ca00f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:29.467568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-926f6c4f-61d8-4de5-89a6-2997222ca00f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:29.468070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-926f6c4f-61d8-4de5-89a6-2997222ca00f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:29.468508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-926f6c4f-61d8-4de5-89a6-2997222ca00f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:29.469400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-926f6c4f-61d8-4de5-89a6-2997222ca00f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:29.470334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-926f6c4f-61d8-4de5-89a6-2997222ca00f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:29.471021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-926f6c4f-61d8-4de5-89a6-2997222ca00f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:29.476540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:29.691311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8cfc9d0c-25c1-4558-9ae3-545ba10ec4c6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:29.701955 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8cfc9d0c-25c1-4558-9ae3-545ba10ec4c6 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.748296 Oct 11 19:55:29.727267 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1623/3183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:28 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:29.733437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f29a647a-0213-42cb-a9e1-d9eb331790b8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:29.734580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f29a647a-0213-42cb-a9e1-d9eb331790b8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:29.749864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f29a647a-0213-42cb-a9e1-d9eb331790b8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:29.750365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f29a647a-0213-42cb-a9e1-d9eb331790b8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:29.751021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f29a647a-0213-42cb-a9e1-d9eb331790b8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:29.754500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f29a647a-0213-42cb-a9e1-d9eb331790b8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:29.757921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f29a647a-0213-42cb-a9e1-d9eb331790b8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:29.758563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f29a647a-0213-42cb-a9e1-d9eb331790b8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:29.764365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-926f6c4f-61d8-4de5-89a6-2997222ca00f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:29.821511 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-926f6c4f-61d8-4de5-89a6-2997222ca00f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.350169 Oct 11 19:55:29.822481 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1561/3184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:29 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:29.848272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30aecb14-0825-47f9-ad1a-392d64396782 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:29.848903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30aecb14-0825-47f9-ad1a-392d64396782 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:29.870520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30aecb14-0825-47f9-ad1a-392d64396782 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:29.871664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30aecb14-0825-47f9-ad1a-392d64396782 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:29.872505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30aecb14-0825-47f9-ad1a-392d64396782 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:29.874647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30aecb14-0825-47f9-ad1a-392d64396782 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:29.877678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30aecb14-0825-47f9-ad1a-392d64396782 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:29.879603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30aecb14-0825-47f9-ad1a-392d64396782 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:30.083179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f29a647a-0213-42cb-a9e1-d9eb331790b8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:30.096186 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f29a647a-0213-42cb-a9e1-d9eb331790b8 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1510 microversion: 2.1 time: 0.365680 Oct 11 19:55:30.097002 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1624/3185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:29 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:30.241590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-30aecb14-0825-47f9-ad1a-392d64396782 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:30.262361 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-30aecb14-0825-47f9-ad1a-392d64396782 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.415946 Oct 11 19:55:30.279335 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1562/3186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:29 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:30.290951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1e0beed-03cf-45f9-ade0-0ff089ed5ad3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:30.293357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e1e0beed-03cf-45f9-ade0-0ff089ed5ad3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: d3ca6f87-5c44-4b81-a0a4-01de8860fb53] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:30.306967 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-e1e0beed-03cf-45f9-ade0-0ff089ed5ad3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance d3ca6f87-5c44-4b81-a0a4-01de8860fb53 could not be found. Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1e0beed-03cf-45f9-ade0-0ff089ed5ad3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/d3ca6f87-5c44-4b81-a0a4-01de8860fb53/action HTTP/1.1 Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 39 Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: {"os-getConsoleOutput": {"length": 10}} Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance d3ca6f87-5c44-4b81-a0a4-01de8860fb53 could not be found. Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'd3ca6f87-5c44-4b81-a0a4-01de8860fb53', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ca6f87-5c44-4b81-a0a4-01de8860fb53 could not be found. Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ca6f87-5c44-4b81-a0a4-01de8860fb53 could not be found. Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:30.317778 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:30.323395 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:30.323395 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:30.323395 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:30.323395 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:30.323395 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ca6f87-5c44-4b81-a0a4-01de8860fb53 could not be found. Oct 11 19:55:30.323395 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:30.323395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1e0beed-03cf-45f9-ade0-0ff089ed5ad3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance d3ca6f87-5c44-4b81-a0a4-01de8860fb53 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:30.326475 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e1e0beed-03cf-45f9-ade0-0ff089ed5ad3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/d3ca6f87-5c44-4b81-a0a4-01de8860fb53/action" status: 404 len: 111 microversion: 2.1 time: 0.040349 Oct 11 19:55:30.327443 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1625/3187] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:30 2022] POST /compute/v2.1/servers/d3ca6f87-5c44-4b81-a0a4-01de8860fb53/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:30.337300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a75c02e3-0d77-47fc-9558-9505a6183796 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:30.338193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a75c02e3-0d77-47fc-9558-9505a6183796 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:30.349374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a75c02e3-0d77-47fc-9558-9505a6183796 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:30.350608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a75c02e3-0d77-47fc-9558-9505a6183796 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:30.351357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a75c02e3-0d77-47fc-9558-9505a6183796 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:30.352404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a75c02e3-0d77-47fc-9558-9505a6183796 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:30.352979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a75c02e3-0d77-47fc-9558-9505a6183796 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:30.353516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a75c02e3-0d77-47fc-9558-9505a6183796 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:30.730067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-da23f518-f192-427c-8dbe-d182d85682e1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:30.730958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-da23f518-f192-427c-8dbe-d182d85682e1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:30.757214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a75c02e3-0d77-47fc-9558-9505a6183796 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:30.758735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da23f518-f192-427c-8dbe-d182d85682e1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:30.762057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da23f518-f192-427c-8dbe-d182d85682e1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:30.768948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da23f518-f192-427c-8dbe-d182d85682e1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:30.772659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da23f518-f192-427c-8dbe-d182d85682e1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:30.775142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da23f518-f192-427c-8dbe-d182d85682e1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:30.776636 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a75c02e3-0d77-47fc-9558-9505a6183796 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.443710 Oct 11 19:55:30.777095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da23f518-f192-427c-8dbe-d182d85682e1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:30.778391 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1563/3188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:30 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:30.805974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3bc991e3-d0a1-4f19-a7e2-086ca10ca6e1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:30.806730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3bc991e3-d0a1-4f19-a7e2-086ca10ca6e1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:30.831495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bc991e3-d0a1-4f19-a7e2-086ca10ca6e1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:30.832004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bc991e3-d0a1-4f19-a7e2-086ca10ca6e1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:30.848350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bc991e3-d0a1-4f19-a7e2-086ca10ca6e1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:30.849223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bc991e3-d0a1-4f19-a7e2-086ca10ca6e1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:30.849746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bc991e3-d0a1-4f19-a7e2-086ca10ca6e1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:30.850859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bc991e3-d0a1-4f19-a7e2-086ca10ca6e1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:31.157204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-da23f518-f192-427c-8dbe-d182d85682e1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:31.170325 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-da23f518-f192-427c-8dbe-d182d85682e1 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.445655 Oct 11 19:55:31.173268 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1626/3189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:30 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:31.189310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99c35e5d-f884-467e-927b-a819f9c006c2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:31.190236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-99c35e5d-f884-467e-927b-a819f9c006c2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:31.203984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99c35e5d-f884-467e-927b-a819f9c006c2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:31.205257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99c35e5d-f884-467e-927b-a819f9c006c2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:31.207572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99c35e5d-f884-467e-927b-a819f9c006c2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:31.210690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99c35e5d-f884-467e-927b-a819f9c006c2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:31.212997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99c35e5d-f884-467e-927b-a819f9c006c2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:31.214187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99c35e5d-f884-467e-927b-a819f9c006c2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:31.617596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3bc991e3-d0a1-4f19-a7e2-086ca10ca6e1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:31.636702 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3bc991e3-d0a1-4f19-a7e2-086ca10ca6e1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.829433 Oct 11 19:55:31.638116 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1564/3190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:30 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:31.664742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7b5ea8b-9b7b-4613-b0ce-24d30a632f5f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:31.665755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e7b5ea8b-9b7b-4613-b0ce-24d30a632f5f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 361554ed-d02d-4ff2-99cd-d2fd72c4dabb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:31.675200 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e7b5ea8b-9b7b-4613-b0ce-24d30a632f5f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance 361554ed-d02d-4ff2-99cd-d2fd72c4dabb could not be found. Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7b5ea8b-9b7b-4613-b0ce-24d30a632f5f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/361554ed-d02d-4ff2-99cd-d2fd72c4dabb HTTP/1.1 Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 361554ed-d02d-4ff2-99cd-d2fd72c4dabb could not be found. Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '361554ed-d02d-4ff2-99cd-d2fd72c4dabb'} Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361554ed-d02d-4ff2-99cd-d2fd72c4dabb could not be found. Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361554ed-d02d-4ff2-99cd-d2fd72c4dabb could not be found. Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:31.687538 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:31.692238 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:31.692238 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:31.692238 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:31.692238 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361554ed-d02d-4ff2-99cd-d2fd72c4dabb could not be found. Oct 11 19:55:31.692238 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:31.694706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7b5ea8b-9b7b-4613-b0ce-24d30a632f5f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance 361554ed-d02d-4ff2-99cd-d2fd72c4dabb could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:31.696516 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e7b5ea8b-9b7b-4613-b0ce-24d30a632f5f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/361554ed-d02d-4ff2-99cd-d2fd72c4dabb" status: 404 len: 111 microversion: 2.1 time: 0.036288 Oct 11 19:55:31.703087 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1565/3191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:31 2022] GET /compute/v2.1/servers/361554ed-d02d-4ff2-99cd-d2fd72c4dabb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:31.727457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6760df0f-be04-43a9-9ad5-25315d6218b7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:31.732201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6760df0f-be04-43a9-9ad5-25315d6218b7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:31.746764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:31.770115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6760df0f-be04-43a9-9ad5-25315d6218b7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:31.770115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6760df0f-be04-43a9-9ad5-25315d6218b7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:31.770115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6760df0f-be04-43a9-9ad5-25315d6218b7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:31.770115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6760df0f-be04-43a9-9ad5-25315d6218b7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:31.770115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6760df0f-be04-43a9-9ad5-25315d6218b7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:31.770115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6760df0f-be04-43a9-9ad5-25315d6218b7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:31.786128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-99c35e5d-f884-467e-927b-a819f9c006c2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:31.804325 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99c35e5d-f884-467e-927b-a819f9c006c2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1516 microversion: 2.1 time: 0.623528 Oct 11 19:55:31.821140 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1627/3192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:31 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1516 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:32.051588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6760df0f-be04-43a9-9ad5-25315d6218b7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:32.068294 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6760df0f-be04-43a9-9ad5-25315d6218b7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.359899 Oct 11 19:55:32.070138 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1566/3193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:31 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:32.096881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93b49972-758b-4440-b930-c91a7c06e296 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:32.097730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-93b49972-758b-4440-b930-c91a7c06e296 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:32.112303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b49972-758b-4440-b930-c91a7c06e296 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:32.118564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b49972-758b-4440-b930-c91a7c06e296 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:32.119189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b49972-758b-4440-b930-c91a7c06e296 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:32.126349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b49972-758b-4440-b930-c91a7c06e296 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:32.129881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b49972-758b-4440-b930-c91a7c06e296 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:32.132111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b49972-758b-4440-b930-c91a7c06e296 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:32.201793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c3d57ba8-ff68-431b-90e2-83b7f464edcb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:32.204295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c3d57ba8-ff68-431b-90e2-83b7f464edcb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:32.234700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3d57ba8-ff68-431b-90e2-83b7f464edcb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:32.237320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3d57ba8-ff68-431b-90e2-83b7f464edcb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:32.238012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3d57ba8-ff68-431b-90e2-83b7f464edcb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:32.239491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3d57ba8-ff68-431b-90e2-83b7f464edcb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:32.243676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3d57ba8-ff68-431b-90e2-83b7f464edcb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:32.244630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3d57ba8-ff68-431b-90e2-83b7f464edcb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:32.594668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-93b49972-758b-4440-b930-c91a7c06e296 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:32.605380 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-93b49972-758b-4440-b930-c91a7c06e296 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.513214 Oct 11 19:55:32.606276 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1628/3194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:32 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:32.725258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-bf695af3-6e9e-408a-9938-37c489bad25b req-129e409b-8175-4b88-86b2-a0a3fbad7812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee4391-e163-4a76-9151-04adeb0111a8", "name": "network-vif-plugged", "status": "completed", "tag": "8feec027-3d8b-4b4e-9712-8f57ab9fb853"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:32.744329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c3d57ba8-ff68-431b-90e2-83b7f464edcb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:32.749358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bf695af3-6e9e-408a-9938-37c489bad25b req-129e409b-8175-4b88-86b2-a0a3fbad7812 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:32.754005 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c3d57ba8-ff68-431b-90e2-83b7f464edcb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.557999 Oct 11 19:55:32.757504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bf695af3-6e9e-408a-9938-37c489bad25b req-129e409b-8175-4b88-86b2-a0a3fbad7812 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:32.757995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bf695af3-6e9e-408a-9938-37c489bad25b req-129e409b-8175-4b88-86b2-a0a3fbad7812 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:32.758661 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1567/3195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:32 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:33.114270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2e3ee67-9f2e-4e11-b522-2bd8f8283cee tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1207057429", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:33.121733 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bf695af3-6e9e-408a-9938-37c489bad25b req-129e409b-8175-4b88-86b2-a0a3fbad7812 service nova] Creating event network-vif-plugged:8feec027-3d8b-4b4e-9712-8f57ab9fb853 for instance b7ee4391-e163-4a76-9151-04adeb0111a8 on n-h1-860864-3 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2e3ee67-9f2e-4e11-b522-2bd8f8283cee tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 238 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1207057429", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1207057429', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:33.131846 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 19:55:33.136829 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:33.139814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2e3ee67-9f2e-4e11-b522-2bd8f8283cee tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:33.140939 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d2e3ee67-9f2e-4e11-b522-2bd8f8283cee tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030633 Oct 11 19:55:33.144421 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1568/3196] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:55:33.153514 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-bf695af3-6e9e-408a-9938-37c489bad25b req-129e409b-8175-4b88-86b2-a0a3fbad7812 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.433561 Oct 11 19:55:33.154475 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1629/3197] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:55:33.155360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a22d1de7-e822-43ee-9458-e634d8ae0f20 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:33.157013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a22d1de7-e822-43ee-9458-e634d8ae0f20 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:33.173348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a22d1de7-e822-43ee-9458-e634d8ae0f20 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:33.174089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a22d1de7-e822-43ee-9458-e634d8ae0f20 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:33.174907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a22d1de7-e822-43ee-9458-e634d8ae0f20 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:33.175943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a22d1de7-e822-43ee-9458-e634d8ae0f20 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:33.176639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a22d1de7-e822-43ee-9458-e634d8ae0f20 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:33.177290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a22d1de7-e822-43ee-9458-e634d8ae0f20 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:33.435129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a22d1de7-e822-43ee-9458-e634d8ae0f20 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:33.458206 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a22d1de7-e822-43ee-9458-e634d8ae0f20 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.311418 Oct 11 19:55:33.463882 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1569/3198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:33 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:33.489402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4ac31b8b-223a-45ed-9fa8-a371d1854528 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:33.490577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ac31b8b-223a-45ed-9fa8-a371d1854528 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:33.502860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac31b8b-223a-45ed-9fa8-a371d1854528 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:33.507329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac31b8b-223a-45ed-9fa8-a371d1854528 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:33.511122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac31b8b-223a-45ed-9fa8-a371d1854528 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:33.512278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac31b8b-223a-45ed-9fa8-a371d1854528 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:33.514156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac31b8b-223a-45ed-9fa8-a371d1854528 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:33.515180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac31b8b-223a-45ed-9fa8-a371d1854528 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:33.654601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-195857069", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:33.766929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:33.800763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ac31b8b-223a-45ed-9fa8-a371d1854528 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:33.814375 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4ac31b8b-223a-45ed-9fa8-a371d1854528 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.329042 Oct 11 19:55:33.815465 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1570/3199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:33 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:33.821108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11b57eb1-317a-45b0-a501-f011bc1aefe9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:33.822669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-11b57eb1-317a-45b0-a501-f011bc1aefe9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:33.831486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11b57eb1-317a-45b0-a501-f011bc1aefe9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:33.833497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11b57eb1-317a-45b0-a501-f011bc1aefe9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:33.836187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11b57eb1-317a-45b0-a501-f011bc1aefe9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:33.840013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11b57eb1-317a-45b0-a501-f011bc1aefe9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:33.840751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11b57eb1-317a-45b0-a501-f011bc1aefe9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:33.842801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11b57eb1-317a-45b0-a501-f011bc1aefe9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:34.108352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11b57eb1-317a-45b0-a501-f011bc1aefe9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:34.117757 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11b57eb1-317a-45b0-a501-f011bc1aefe9 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.300950 Oct 11 19:55:34.119601 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1571/3200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:33 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:34.126984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc33cefe-b81e-4451-a301-c569cbaddeaa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1607707697", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc33cefe-b81e-4451-a301-c569cbaddeaa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 235 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1607707697", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1607707697', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.138354 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc33cefe-b81e-4451-a301-c569cbaddeaa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:34.143497 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc33cefe-b81e-4451-a301-c569cbaddeaa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.019421 Oct 11 19:55:34.145247 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1572/3201] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:34 2022] POST /compute/v2.1/servers => generated 133 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:55:34.150555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5dca3bc9-32dc-4b1f-8afe-095f9d9bb8fe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:34.151181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5dca3bc9-32dc-4b1f-8afe-095f9d9bb8fe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:34.159397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dca3bc9-32dc-4b1f-8afe-095f9d9bb8fe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:34.159900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dca3bc9-32dc-4b1f-8afe-095f9d9bb8fe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:34.160333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dca3bc9-32dc-4b1f-8afe-095f9d9bb8fe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:34.161227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dca3bc9-32dc-4b1f-8afe-095f9d9bb8fe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:34.161698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dca3bc9-32dc-4b1f-8afe-095f9d9bb8fe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:34.162817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5dca3bc9-32dc-4b1f-8afe-095f9d9bb8fe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:34.320647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5dca3bc9-32dc-4b1f-8afe-095f9d9bb8fe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:34.335622 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5dca3bc9-32dc-4b1f-8afe-095f9d9bb8fe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.189501 Oct 11 19:55:34.336153 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1573/3202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:34 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:34.363412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5bbcf3ea-409c-4687-bc6f-bab54b6fae11 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:34.363957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5bbcf3ea-409c-4687-bc6f-bab54b6fae11 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:34.372026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bbcf3ea-409c-4687-bc6f-bab54b6fae11 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:34.372527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bbcf3ea-409c-4687-bc6f-bab54b6fae11 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:34.372976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bbcf3ea-409c-4687-bc6f-bab54b6fae11 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:34.373937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bbcf3ea-409c-4687-bc6f-bab54b6fae11 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:34.374698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bbcf3ea-409c-4687-bc6f-bab54b6fae11 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:34.375304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bbcf3ea-409c-4687-bc6f-bab54b6fae11 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:34.537790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5bbcf3ea-409c-4687-bc6f-bab54b6fae11 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:34.555222 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5bbcf3ea-409c-4687-bc6f-bab54b6fae11 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.195484 Oct 11 19:55:34.556222 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1574/3203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:34 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:34.583062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03978f83-f9a6-4c59-ad46-bc792828f5ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:34.583859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-03978f83-f9a6-4c59-ad46-bc792828f5ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 5c99be2c-939a-47eb-a642-bc172e949831] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:34.591706 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-03978f83-f9a6-4c59-ad46-bc792828f5ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance 5c99be2c-939a-47eb-a642-bc172e949831 could not be found. Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03978f83-f9a6-4c59-ad46-bc792828f5ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/5c99be2c-939a-47eb-a642-bc172e949831/action HTTP/1.1 Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 13 Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: {"pause": {}} Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 5c99be2c-939a-47eb-a642-bc172e949831 could not be found. Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '5c99be2c-939a-47eb-a642-bc172e949831', 'body': {'pause': {}}} Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c99be2c-939a-47eb-a642-bc172e949831 could not be found. Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c99be2c-939a-47eb-a642-bc172e949831 could not be found. Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:34.602954 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:34.607790 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:34.607790 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:34.607790 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c99be2c-939a-47eb-a642-bc172e949831 could not be found. Oct 11 19:55:34.607790 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:34.607790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03978f83-f9a6-4c59-ad46-bc792828f5ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance 5c99be2c-939a-47eb-a642-bc172e949831 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:34.607790 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-03978f83-f9a6-4c59-ad46-bc792828f5ae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/5c99be2c-939a-47eb-a642-bc172e949831/action" status: 404 len: 111 microversion: 2.1 time: 0.029642 Oct 11 19:55:34.607790 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1575/3204] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:34 2022] POST /compute/v2.1/servers/5c99be2c-939a-47eb-a642-bc172e949831/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:55:34.617361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2601a82b-1af7-4442-b1c3-623aaa7a6948 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:34.618825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2601a82b-1af7-4442-b1c3-623aaa7a6948 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:34.629491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2601a82b-1af7-4442-b1c3-623aaa7a6948 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:34.630095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2601a82b-1af7-4442-b1c3-623aaa7a6948 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:34.630701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2601a82b-1af7-4442-b1c3-623aaa7a6948 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:34.631904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2601a82b-1af7-4442-b1c3-623aaa7a6948 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:34.632478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2601a82b-1af7-4442-b1c3-623aaa7a6948 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:34.632971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2601a82b-1af7-4442-b1c3-623aaa7a6948 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:34.831976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2601a82b-1af7-4442-b1c3-623aaa7a6948 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:34.845303 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2601a82b-1af7-4442-b1c3-623aaa7a6948 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.235050 Oct 11 19:55:34.846640 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1576/3205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:34 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:34.852258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-55ec3241-bba7-492f-8aa7-2db767066a99 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'create', calling method: .version_select at 0x7f83d07000d0>, body: {"keypair": {"name": "tempest-keypair-1407913434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuBJDgmK8VCow2yBIxMvppEH7mCPqxNNCNFWybs1TdR8/2LytVhYJwGL94Btm5520Gff3jIX1Byv8z1zGTexXaPvDM6+ddPqWcp1kRIoSAMc8o3DnL7z/kq1a6IUSwJag=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:34.869393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-55ec3241-bba7-492f-8aa7-2db767066a99 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Getting quotas for project 8df2eebeffd440d988aa6f580c9bb221. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:34.875334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-55ec3241-bba7-492f-8aa7-2db767066a99 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Getting quotas for user d1ab8c29f18c4fc09858791a80527e5d and project 8df2eebeffd440d988aa6f580c9bb221. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:34.907986 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-55ec3241-bba7-492f-8aa7-2db767066a99 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059992 Oct 11 19:55:34.908925 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1577/3206] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:55:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:34.924271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4554cd9c-53d5-4bb2-b453-9fee659bc179 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:34.924906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4554cd9c-53d5-4bb2-b453-9fee659bc179 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:34.940713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4554cd9c-53d5-4bb2-b453-9fee659bc179 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:34.941230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4554cd9c-53d5-4bb2-b453-9fee659bc179 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:34.941672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4554cd9c-53d5-4bb2-b453-9fee659bc179 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:34.942388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4554cd9c-53d5-4bb2-b453-9fee659bc179 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:34.942871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4554cd9c-53d5-4bb2-b453-9fee659bc179 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:34.946786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4554cd9c-53d5-4bb2-b453-9fee659bc179 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:35.175713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4554cd9c-53d5-4bb2-b453-9fee659bc179 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:35.189886 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4554cd9c-53d5-4bb2-b453-9fee659bc179 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.279877 Oct 11 19:55:35.202855 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1578/3207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:34 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:35.202855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a74f6d8-6a1c-4a1d-8a30-ebe510c145d5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:35.202855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8a74f6d8-6a1c-4a1d-8a30-ebe510c145d5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:35.202855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a74f6d8-6a1c-4a1d-8a30-ebe510c145d5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:35.203363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a74f6d8-6a1c-4a1d-8a30-ebe510c145d5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:35.203759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a74f6d8-6a1c-4a1d-8a30-ebe510c145d5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:35.205000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a74f6d8-6a1c-4a1d-8a30-ebe510c145d5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:35.205000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a74f6d8-6a1c-4a1d-8a30-ebe510c145d5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:35.205397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a74f6d8-6a1c-4a1d-8a30-ebe510c145d5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:35.418024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8a74f6d8-6a1c-4a1d-8a30-ebe510c145d5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:35.429095 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a74f6d8-6a1c-4a1d-8a30-ebe510c145d5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.237158 Oct 11 19:55:35.442919 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1579/3208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:35 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:35.442919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d1c70d9f-1564-41aa-9a92-8ff75c689398 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:35.442919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d1c70d9f-1564-41aa-9a92-8ff75c689398 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:35.450138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1c70d9f-1564-41aa-9a92-8ff75c689398 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:35.450138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1c70d9f-1564-41aa-9a92-8ff75c689398 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:35.450410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1c70d9f-1564-41aa-9a92-8ff75c689398 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:35.451058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1c70d9f-1564-41aa-9a92-8ff75c689398 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:35.451589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1c70d9f-1564-41aa-9a92-8ff75c689398 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:35.451948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1c70d9f-1564-41aa-9a92-8ff75c689398 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:35.551297 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d1c70d9f-1564-41aa-9a92-8ff75c689398 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 202 len: 0 microversion: 2.1 time: 0.113006 Oct 11 19:55:35.551958 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1580/3209] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:35 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:55:35.569146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a8bfa45-10ad-4c89-b702-4d15569a8266 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:35.570187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8a8bfa45-10ad-4c89-b702-4d15569a8266 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:35.584376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a8bfa45-10ad-4c89-b702-4d15569a8266 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:35.585212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a8bfa45-10ad-4c89-b702-4d15569a8266 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:35.585777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a8bfa45-10ad-4c89-b702-4d15569a8266 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:35.586691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a8bfa45-10ad-4c89-b702-4d15569a8266 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:35.587401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a8bfa45-10ad-4c89-b702-4d15569a8266 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:35.587933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a8bfa45-10ad-4c89-b702-4d15569a8266 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:35.994140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8a8bfa45-10ad-4c89-b702-4d15569a8266 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:35.998097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:36.008041 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a8bfa45-10ad-4c89-b702-4d15569a8266 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1511 microversion: 2.1 time: 0.450316 Oct 11 19:55:36.008650 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1581/3210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:35 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:36.470638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc42c20b-0d52-4a17-a6a7-fff14da53b91 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:36.471527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc42c20b-0d52-4a17-a6a7-fff14da53b91 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:36.489426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc42c20b-0d52-4a17-a6a7-fff14da53b91 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:36.490261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc42c20b-0d52-4a17-a6a7-fff14da53b91 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:36.494975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc42c20b-0d52-4a17-a6a7-fff14da53b91 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:36.499055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc42c20b-0d52-4a17-a6a7-fff14da53b91 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:36.499657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc42c20b-0d52-4a17-a6a7-fff14da53b91 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:36.500775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc42c20b-0d52-4a17-a6a7-fff14da53b91 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:36.764576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fc42c20b-0d52-4a17-a6a7-fff14da53b91 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:36.774284 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc42c20b-0d52-4a17-a6a7-fff14da53b91 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1471 microversion: 2.1 time: 0.318941 Oct 11 19:55:36.777193 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1582/3211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:36 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:37.031599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-583f8977-f2b0-483d-865a-eadb21b245bd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:37.032747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-583f8977-f2b0-483d-865a-eadb21b245bd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:37.041581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-583f8977-f2b0-483d-865a-eadb21b245bd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:37.043099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-583f8977-f2b0-483d-865a-eadb21b245bd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:37.044272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-583f8977-f2b0-483d-865a-eadb21b245bd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:37.045839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-583f8977-f2b0-483d-865a-eadb21b245bd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:37.047212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-583f8977-f2b0-483d-865a-eadb21b245bd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:37.047657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-583f8977-f2b0-483d-865a-eadb21b245bd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:37.314600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-583f8977-f2b0-483d-865a-eadb21b245bd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:37.331528 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-583f8977-f2b0-483d-865a-eadb21b245bd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1491 microversion: 2.1 time: 0.300811 Oct 11 19:55:37.335475 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1583/3212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:37 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1491 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:37.361035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:37.362179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:37.371517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:37.372360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:37.373015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:37.374753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:37.376033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:37.377247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:37.413513 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Cannot 'pause' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state paused Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action HTTP/1.1 Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 13 Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: {"pause": {}} Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: exception: Cannot 'pause' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state paused Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '85f1dc40-ef33-40f8-b128-d5c6367e833e', 'body': {'pause': {}}} Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e in vm_state paused. Cannot pause while the instance is in this state. Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state paused Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:37.415187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:37.420571 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:37.420571 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:37.420571 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:37.420571 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state paused Oct 11 19:55:37.420571 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:37.422054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 409 to user: Cannot 'pause' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state paused {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:37.423124 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b3e81b9-33d0-4196-9a50-80f15bf310c0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 409 len: 143 microversion: 2.1 time: 0.067781 Oct 11 19:55:37.424162 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1584/3213] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:37 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 143 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:55:37.451658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c665e79d-3f4e-4498-b5c0-de78435a88e9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:37.455335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c665e79d-3f4e-4498-b5c0-de78435a88e9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:37.465481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c665e79d-3f4e-4498-b5c0-de78435a88e9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:37.466592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c665e79d-3f4e-4498-b5c0-de78435a88e9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:37.467042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c665e79d-3f4e-4498-b5c0-de78435a88e9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:37.468100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c665e79d-3f4e-4498-b5c0-de78435a88e9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:37.468806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c665e79d-3f4e-4498-b5c0-de78435a88e9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:37.469508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c665e79d-3f4e-4498-b5c0-de78435a88e9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:37.598334 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c665e79d-3f4e-4498-b5c0-de78435a88e9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 202 len: 0 microversion: 2.1 time: 0.154035 Oct 11 19:55:37.602233 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1585/3214] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:37 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:55:37.614618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b09af43-9941-4728-aacf-81715c72c5ab tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:37.617699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9b09af43-9941-4728-aacf-81715c72c5ab tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:37.629296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b09af43-9941-4728-aacf-81715c72c5ab tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:37.629797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b09af43-9941-4728-aacf-81715c72c5ab tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:37.630271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b09af43-9941-4728-aacf-81715c72c5ab tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:37.635003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b09af43-9941-4728-aacf-81715c72c5ab tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:37.636500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b09af43-9941-4728-aacf-81715c72c5ab tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:37.637224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b09af43-9941-4728-aacf-81715c72c5ab tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:37.846395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9b09af43-9941-4728-aacf-81715c72c5ab tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:37.866406 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9b09af43-9941-4728-aacf-81715c72c5ab tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1498 microversion: 2.1 time: 0.253566 Oct 11 19:55:37.871283 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1586/3215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:37 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1498 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:37.880800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-679287675", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "baf55d51-7df2-4aeb-9852-b73c314856f4"}], "security_groups": [{"name": "tempest-securitygroup--1393728063"}], "key_name": "tempest-keypair-1407913434", "user_data": "}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:42.768465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:43.697444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=25 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:44.559888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:55:44.750339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] validate_networks() for [('baf55d51-7df2-4aeb-9852-b73c314856f4', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:55:44.885957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:44.961059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:55:44.961728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:55:44.962281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:55:44.963631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:55:44.964126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:55:44.985746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:44.986863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:44.988066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:44.989791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:44.992510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:44.994059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:45.023766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Getting quotas for project 6c55a426691c4e53ab0e77715dd251a2. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:45.029894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Getting quotas for user 35e16fd8c73b4d609b7f4cad18389978 and project 6c55a426691c4e53ab0e77715dd251a2. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:45.044243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:55:45.047521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:55:45.114651 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-192f2646-ef4d-4f21-9e93-e1999d42c1e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.948306 Oct 11 19:55:45.117176 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1630/3216] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 11953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 19:55:45.129247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f3babbe8-f343-4363-9863-90b27f5ac4bc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:45.135109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f3babbe8-f343-4363-9863-90b27f5ac4bc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:45.147345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3babbe8-f343-4363-9863-90b27f5ac4bc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:45.148106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3babbe8-f343-4363-9863-90b27f5ac4bc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:45.148720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3babbe8-f343-4363-9863-90b27f5ac4bc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:45.149709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3babbe8-f343-4363-9863-90b27f5ac4bc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:45.150576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3babbe8-f343-4363-9863-90b27f5ac4bc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:45.151155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3babbe8-f343-4363-9863-90b27f5ac4bc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:45.395504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:55:45.396149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f3babbe8-f343-4363-9863-90b27f5ac4bc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:45.398731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:55:45.399443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:55:45.400865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:55:45.401787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:55:45.420799 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f3babbe8-f343-4363-9863-90b27f5ac4bc tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1477 microversion: 2.1 time: 0.295229 Oct 11 19:55:45.421508 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1631/3217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:45 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:45.425210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:45.428821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:45.430228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:45.432537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:45.434052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:45.435009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e5778064-de3f-4f92-a7ed-89d13e09e3d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:45.435542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:45.440195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e5778064-de3f-4f92-a7ed-89d13e09e3d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:45.452253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5778064-de3f-4f92-a7ed-89d13e09e3d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:45.453493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5778064-de3f-4f92-a7ed-89d13e09e3d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:45.454152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5778064-de3f-4f92-a7ed-89d13e09e3d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:45.455623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5778064-de3f-4f92-a7ed-89d13e09e3d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:45.456282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5778064-de3f-4f92-a7ed-89d13e09e3d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:45.456994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5778064-de3f-4f92-a7ed-89d13e09e3d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:45.467749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Getting quotas for project 8df2eebeffd440d988aa6f580c9bb221. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:45.478019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Getting quotas for user d1ab8c29f18c4fc09858791a80527e5d and project 8df2eebeffd440d988aa6f580c9bb221. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:45.496049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:55:45.498997 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e5778064-de3f-4f92-a7ed-89d13e09e3d8 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075620 Oct 11 19:55:45.499704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:55:45.500179 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1632/3218] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:55:45 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:45.505340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f567968d-572a-4614-91db-c7174c33571f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:45.507976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f567968d-572a-4614-91db-c7174c33571f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:45.515235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f567968d-572a-4614-91db-c7174c33571f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:45.515966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f567968d-572a-4614-91db-c7174c33571f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:45.516733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f567968d-572a-4614-91db-c7174c33571f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:45.517856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f567968d-572a-4614-91db-c7174c33571f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:45.518502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f567968d-572a-4614-91db-c7174c33571f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:45.519395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f567968d-572a-4614-91db-c7174c33571f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:45.580989 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-76a566c1-28f7-4a0a-af2c-e479dd0e3b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 7.708308 Oct 11 19:55:45.581722 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1587/3219] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 7710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:55:45.593930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-80cc366d-c7f2-4f1b-805d-dd83cab12333 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:45.596926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-80cc366d-c7f2-4f1b-805d-dd83cab12333 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:45.619654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80cc366d-c7f2-4f1b-805d-dd83cab12333 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:45.621498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80cc366d-c7f2-4f1b-805d-dd83cab12333 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:45.621498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80cc366d-c7f2-4f1b-805d-dd83cab12333 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:45.630483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80cc366d-c7f2-4f1b-805d-dd83cab12333 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:45.634814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80cc366d-c7f2-4f1b-805d-dd83cab12333 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:45.635481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80cc366d-c7f2-4f1b-805d-dd83cab12333 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.002207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f567968d-572a-4614-91db-c7174c33571f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:46.020089 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f567968d-572a-4614-91db-c7174c33571f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.514137 Oct 11 19:55:46.022060 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1633/3220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:45 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:46.029887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-569bf64f-534f-42bc-b721-8c3c9a9715e3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:46.039723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-80cc366d-c7f2-4f1b-805d-dd83cab12333 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:46.044558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-569bf64f-534f-42bc-b721-8c3c9a9715e3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:46.049214 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-80cc366d-c7f2-4f1b-805d-dd83cab12333 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.465617 Oct 11 19:55:46.052232 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1588/3221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:45 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:46.057966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fbbc4a9-c41b-4aa7-985c-458cbd5d0496 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:46.064123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-569bf64f-534f-42bc-b721-8c3c9a9715e3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.064896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-569bf64f-534f-42bc-b721-8c3c9a9715e3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.065743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9fbbc4a9-c41b-4aa7-985c-458cbd5d0496 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:46.066417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-569bf64f-534f-42bc-b721-8c3c9a9715e3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.067388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-569bf64f-534f-42bc-b721-8c3c9a9715e3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.070452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-569bf64f-534f-42bc-b721-8c3c9a9715e3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.071440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-569bf64f-534f-42bc-b721-8c3c9a9715e3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.086113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbbc4a9-c41b-4aa7-985c-458cbd5d0496 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.086306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbbc4a9-c41b-4aa7-985c-458cbd5d0496 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.086818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbbc4a9-c41b-4aa7-985c-458cbd5d0496 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.099166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbbc4a9-c41b-4aa7-985c-458cbd5d0496 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.100764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbbc4a9-c41b-4aa7-985c-458cbd5d0496 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.101588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbbc4a9-c41b-4aa7-985c-458cbd5d0496 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.184408 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9fbbc4a9-c41b-4aa7-985c-458cbd5d0496 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments/43afbbd5-4d8e-456b-b470-51d540c2c5e3" status: 200 len: 194 microversion: 2.1 time: 0.130083 Oct 11 19:55:46.185698 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1589/3222] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Oct 11 19:55:46 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments/43afbbd5-4d8e-456b-b470-51d540c2c5e3 => generated 194 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:46.211014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f4be6f99-04bc-422d-9b34-8c2afaf80acc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:46.218112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f4be6f99-04bc-422d-9b34-8c2afaf80acc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:46.240792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-569bf64f-534f-42bc-b721-8c3c9a9715e3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:46.252653 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-569bf64f-534f-42bc-b721-8c3c9a9715e3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1212 microversion: 2.1 time: 0.228468 Oct 11 19:55:46.259396 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1634/3223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:46 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1212 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:46.268599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f0949da-d542-4826-80c4-53aed79a7986 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:46.271278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0f0949da-d542-4826-80c4-53aed79a7986 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:46.284983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f0949da-d542-4826-80c4-53aed79a7986 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.285577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f0949da-d542-4826-80c4-53aed79a7986 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.292628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f0949da-d542-4826-80c4-53aed79a7986 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.293473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f0949da-d542-4826-80c4-53aed79a7986 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.293953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f0949da-d542-4826-80c4-53aed79a7986 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.294413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f0949da-d542-4826-80c4-53aed79a7986 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.348713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f4be6f99-04bc-422d-9b34-8c2afaf80acc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:46.357576 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f4be6f99-04bc-422d-9b34-8c2afaf80acc tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1245 microversion: 2.1 time: 0.170161 Oct 11 19:55:46.376092 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1590/3224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:46 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1245 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:46.389997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c41c0be-6961-49f8-b3a7-b61a9b12c3d3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1123293635"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:46.393281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c41c0be-6961-49f8-b3a7-b61a9b12c3d3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:46.433339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c41c0be-6961-49f8-b3a7-b61a9b12c3d3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.434146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c41c0be-6961-49f8-b3a7-b61a9b12c3d3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.434982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c41c0be-6961-49f8-b3a7-b61a9b12c3d3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.436790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c41c0be-6961-49f8-b3a7-b61a9b12c3d3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.437523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c41c0be-6961-49f8-b3a7-b61a9b12c3d3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.438217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c41c0be-6961-49f8-b3a7-b61a9b12c3d3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.618936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0f0949da-d542-4826-80c4-53aed79a7986 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:46.627634 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f0949da-d542-4826-80c4-53aed79a7986 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.367094 Oct 11 19:55:46.649059 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1635/3225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:46 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:46.660292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4cd2e743-e870-4713-9b55-b2443031e8e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:46.662459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4cd2e743-e870-4713-9b55-b2443031e8e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:46.670229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd2e743-e870-4713-9b55-b2443031e8e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.671124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd2e743-e870-4713-9b55-b2443031e8e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.671851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd2e743-e870-4713-9b55-b2443031e8e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.672934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd2e743-e870-4713-9b55-b2443031e8e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.673685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd2e743-e870-4713-9b55-b2443031e8e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.674345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cd2e743-e870-4713-9b55-b2443031e8e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.802029 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c41c0be-6961-49f8-b3a7-b61a9b12c3d3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.420021 Oct 11 19:55:46.804338 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1591/3226] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:46 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 11 19:55:46.821670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:46.827509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:46.847731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.848253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.848862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.852108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.852679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.853141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.887134 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e/action HTTP/1.1 Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 28 Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: {"reboot": {"type": "SOFT"}} Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f2251c32-cb71-4195-a9df-cf9ea9f3c20e', 'body': {'reboot': {'type': 'SOFT'}}} Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:46.897455 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-94583a95-65c9-405e-9c2c-7221779c83b2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e/action" status: 404 len: 111 microversion: 2.1 time: 0.087264 Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1592/3227] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:46 2022] POST /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e/action => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d84bd8cd-e4fa-48f5-8a1e-544de82130bb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:46.908525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d84bd8cd-e4fa-48f5-8a1e-544de82130bb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:46.915475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d84bd8cd-e4fa-48f5-8a1e-544de82130bb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.915948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d84bd8cd-e4fa-48f5-8a1e-544de82130bb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.916396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d84bd8cd-e4fa-48f5-8a1e-544de82130bb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.917111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d84bd8cd-e4fa-48f5-8a1e-544de82130bb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:46.917576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d84bd8cd-e4fa-48f5-8a1e-544de82130bb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:46.918559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d84bd8cd-e4fa-48f5-8a1e-544de82130bb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:46.969210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4cd2e743-e870-4713-9b55-b2443031e8e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:46.984576 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4cd2e743-e870-4713-9b55-b2443031e8e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1477 microversion: 2.1 time: 0.331824 Oct 11 19:55:46.987220 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1636/3228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:46 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1477 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:47.277248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d55f1afe-5b03-41e5-b616-9666b8a8ea6e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:47.278971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d55f1afe-5b03-41e5-b616-9666b8a8ea6e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:47.291862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d55f1afe-5b03-41e5-b616-9666b8a8ea6e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:47.292577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d55f1afe-5b03-41e5-b616-9666b8a8ea6e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:47.294870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d55f1afe-5b03-41e5-b616-9666b8a8ea6e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:47.295877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d55f1afe-5b03-41e5-b616-9666b8a8ea6e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:47.297794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d55f1afe-5b03-41e5-b616-9666b8a8ea6e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:47.300744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d55f1afe-5b03-41e5-b616-9666b8a8ea6e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:47.453132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d55f1afe-5b03-41e5-b616-9666b8a8ea6e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:47.471211 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d55f1afe-5b03-41e5-b616-9666b8a8ea6e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1286 microversion: 2.1 time: 0.198320 Oct 11 19:55:47.472364 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1637/3229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:47 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:47.477152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a57c5dae-19cf-4185-85a6-3a576f2cc3e3 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:47.477992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a57c5dae-19cf-4185-85a6-3a576f2cc3e3 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:47.489396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a57c5dae-19cf-4185-85a6-3a576f2cc3e3 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:47.489906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a57c5dae-19cf-4185-85a6-3a576f2cc3e3 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:47.491053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a57c5dae-19cf-4185-85a6-3a576f2cc3e3 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:47.491769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a57c5dae-19cf-4185-85a6-3a576f2cc3e3 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:47.495128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a57c5dae-19cf-4185-85a6-3a576f2cc3e3 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:47.499566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a57c5dae-19cf-4185-85a6-3a576f2cc3e3 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:47.527130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d84bd8cd-e4fa-48f5-8a1e-544de82130bb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:47.547962 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d84bd8cd-e4fa-48f5-8a1e-544de82130bb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.644081 Oct 11 19:55:47.552540 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1593/3230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:46 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:47.575190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8c3bdbb6-5f25-4694-970b-1ee0831ff16f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:47.576164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8c3bdbb6-5f25-4694-970b-1ee0831ff16f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:47.589800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c3bdbb6-5f25-4694-970b-1ee0831ff16f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:47.593062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c3bdbb6-5f25-4694-970b-1ee0831ff16f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:47.605243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c3bdbb6-5f25-4694-970b-1ee0831ff16f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:47.606893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c3bdbb6-5f25-4694-970b-1ee0831ff16f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:47.608376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c3bdbb6-5f25-4694-970b-1ee0831ff16f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:47.609943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8c3bdbb6-5f25-4694-970b-1ee0831ff16f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:47.664767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a57c5dae-19cf-4185-85a6-3a576f2cc3e3 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:47.678314 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a57c5dae-19cf-4185-85a6-3a576f2cc3e3 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1297 microversion: 2.1 time: 0.204702 Oct 11 19:55:47.679458 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1638/3231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:47 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1297 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:48.012117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0eab7f8a-a673-49ae-a1b5-68153ae06c0d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:48.012856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0eab7f8a-a673-49ae-a1b5-68153ae06c0d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:48.028106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eab7f8a-a673-49ae-a1b5-68153ae06c0d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.029382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eab7f8a-a673-49ae-a1b5-68153ae06c0d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.029983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eab7f8a-a673-49ae-a1b5-68153ae06c0d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:48.031571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8c3bdbb6-5f25-4694-970b-1ee0831ff16f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:48.031929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eab7f8a-a673-49ae-a1b5-68153ae06c0d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.032559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eab7f8a-a673-49ae-a1b5-68153ae06c0d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.033230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0eab7f8a-a673-49ae-a1b5-68153ae06c0d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:48.043357 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8c3bdbb6-5f25-4694-970b-1ee0831ff16f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.470996 Oct 11 19:55:48.044407 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1594/3232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:47 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:48.066784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53cefc42-b63c-4af7-aaa3-76494ac97f34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:48.070157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-53cefc42-b63c-4af7-aaa3-76494ac97f34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:48.093643 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-53cefc42-b63c-4af7-aaa3-76494ac97f34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance 9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4 could not be found. Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53cefc42-b63c-4af7-aaa3-76494ac97f34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4/action HTTP/1.1 Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 28 Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: {"reboot": {"type": "SOFT"}} Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4 could not be found. Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4', 'body': {'reboot': {'type': 'SOFT'}}} Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4 could not be found. Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4 could not be found. Oct 11 19:55:48.096552 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:48.101699 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:48.101699 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:48.101699 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:48.101699 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:48.101699 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:48.101699 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:48.101699 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:48.101699 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4 could not be found. Oct 11 19:55:48.101699 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:48.108821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53cefc42-b63c-4af7-aaa3-76494ac97f34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance 9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:48.110152 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-53cefc42-b63c-4af7-aaa3-76494ac97f34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4/action" status: 404 len: 111 microversion: 2.1 time: 0.047477 Oct 11 19:55:48.111594 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1595/3233] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:48 2022] POST /compute/v2.1/servers/9d8f2bc6-b7fd-4d9d-b963-b6367bcce6e4/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:55:48.130071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0eefdcb6-c2ab-45da-98d1-1697571942bc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:48.130970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0eefdcb6-c2ab-45da-98d1-1697571942bc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:48.149174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0eefdcb6-c2ab-45da-98d1-1697571942bc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.149690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0eefdcb6-c2ab-45da-98d1-1697571942bc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.150216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0eefdcb6-c2ab-45da-98d1-1697571942bc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:48.154997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0eefdcb6-c2ab-45da-98d1-1697571942bc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.155886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0eefdcb6-c2ab-45da-98d1-1697571942bc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.156582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0eefdcb6-c2ab-45da-98d1-1697571942bc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:48.646333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0eab7f8a-a673-49ae-a1b5-68153ae06c0d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:48.658466 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0eab7f8a-a673-49ae-a1b5-68153ae06c0d tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1477 microversion: 2.1 time: 0.651101 Oct 11 19:55:48.660255 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1639/3234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:48 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1477 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:48.670980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-71f84f6b-938c-4594-9867-ade662cc305d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:48.672027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-71f84f6b-938c-4594-9867-ade662cc305d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:48.683417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71f84f6b-938c-4594-9867-ade662cc305d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.684168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71f84f6b-938c-4594-9867-ade662cc305d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.684770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71f84f6b-938c-4594-9867-ade662cc305d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:48.685784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71f84f6b-938c-4594-9867-ade662cc305d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.687071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71f84f6b-938c-4594-9867-ade662cc305d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.687662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-71f84f6b-938c-4594-9867-ade662cc305d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:48.734321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0eefdcb6-c2ab-45da-98d1-1697571942bc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:48.747327 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0eefdcb6-c2ab-45da-98d1-1697571942bc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.626775 Oct 11 19:55:48.748647 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1596/3235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:48 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:48.754000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-822e13f6-70d8-4da7-b324-a2554af09e97 req-c35e3771-afa7-452f-850d-5018aeed6812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee4391-e163-4a76-9151-04adeb0111a8", "name": "network-vif-unplugged", "status": "completed", "tag": "8feec027-3d8b-4b4e-9712-8f57ab9fb853"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:48.765744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-822e13f6-70d8-4da7-b324-a2554af09e97 req-c35e3771-afa7-452f-850d-5018aeed6812 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.766504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-822e13f6-70d8-4da7-b324-a2554af09e97 req-c35e3771-afa7-452f-850d-5018aeed6812 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.767418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-822e13f6-70d8-4da7-b324-a2554af09e97 req-c35e3771-afa7-452f-850d-5018aeed6812 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:48.800158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-71f84f6b-938c-4594-9867-ade662cc305d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:48.812885 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-822e13f6-70d8-4da7-b324-a2554af09e97 req-c35e3771-afa7-452f-850d-5018aeed6812 service nova] Creating event network-vif-unplugged:8feec027-3d8b-4b4e-9712-8f57ab9fb853 for instance b7ee4391-e163-4a76-9151-04adeb0111a8 on n-h1-860864-3 Oct 11 19:55:48.818368 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-71f84f6b-938c-4594-9867-ade662cc305d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1274 microversion: 2.1 time: 0.156619 Oct 11 19:55:48.822030 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1640/3236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:48 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:48.829366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2675fe2b-f69f-4c3a-87ec-ff6a495ca564 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:48.830317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2675fe2b-f69f-4c3a-87ec-ff6a495ca564 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:48.832966 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-822e13f6-70d8-4da7-b324-a2554af09e97 req-c35e3771-afa7-452f-850d-5018aeed6812 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082934 Oct 11 19:55:48.835191 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1597/3237] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:48.849670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f4bd13c7-3a2f-4837-9602-bc74df80a8eb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:48.850982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2675fe2b-f69f-4c3a-87ec-ff6a495ca564 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.851571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2675fe2b-f69f-4c3a-87ec-ff6a495ca564 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.852105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f4bd13c7-3a2f-4837-9602-bc74df80a8eb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:48.853260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2675fe2b-f69f-4c3a-87ec-ff6a495ca564 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:48.854078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2675fe2b-f69f-4c3a-87ec-ff6a495ca564 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.854594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2675fe2b-f69f-4c3a-87ec-ff6a495ca564 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.854986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2675fe2b-f69f-4c3a-87ec-ff6a495ca564 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:48.870751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4bd13c7-3a2f-4837-9602-bc74df80a8eb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.874954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4bd13c7-3a2f-4837-9602-bc74df80a8eb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.875682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4bd13c7-3a2f-4837-9602-bc74df80a8eb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:48.876608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4bd13c7-3a2f-4837-9602-bc74df80a8eb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:48.878799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4bd13c7-3a2f-4837-9602-bc74df80a8eb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:48.879936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4bd13c7-3a2f-4837-9602-bc74df80a8eb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:49.009739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2675fe2b-f69f-4c3a-87ec-ff6a495ca564 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:49.029750 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2675fe2b-f69f-4c3a-87ec-ff6a495ca564 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1303 microversion: 2.1 time: 0.206122 Oct 11 19:55:49.031162 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1641/3238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:48 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1303 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:49.036533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d26a3b4-09d3-46f8-8ea6-6f23b0013576 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa6f24c7-60b0-4960-8539-f9f497297379"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:49.042510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4d26a3b4-09d3-46f8-8ea6-6f23b0013576 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:49.051768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d26a3b4-09d3-46f8-8ea6-6f23b0013576 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:49.052195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d26a3b4-09d3-46f8-8ea6-6f23b0013576 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:49.053323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d26a3b4-09d3-46f8-8ea6-6f23b0013576 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:49.054874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d26a3b4-09d3-46f8-8ea6-6f23b0013576 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:49.055536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d26a3b4-09d3-46f8-8ea6-6f23b0013576 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:49.056137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d26a3b4-09d3-46f8-8ea6-6f23b0013576 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:49.369859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f4bd13c7-3a2f-4837-9602-bc74df80a8eb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:49.386836 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f4bd13c7-3a2f-4837-9602-bc74df80a8eb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.550241 Oct 11 19:55:49.393808 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1598/3239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:48 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:49.417057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:49.421571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:49.441915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:49.443958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:49.444717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:49.445995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:49.446847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:49.447556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:49.483643 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e/action HTTP/1.1 Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 65 Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f2251c32-cb71-4195-a9df-cf9ea9f3c20e', 'body': {'rebuild': {'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3'}}} Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 19:55:49.485852 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e2c27ec-9fb0-4c9a-8fea-1d0588e6885b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e/action" status: 404 len: 111 microversion: 2.1 time: 0.074282 Oct 11 19:55:49.495755 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1599/3240] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:49 2022] POST /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:55:49.498874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc2707ce-5e8a-4970-b004-73217b04ca6c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:49.498874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc2707ce-5e8a-4970-b004-73217b04ca6c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:49.504274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc2707ce-5e8a-4970-b004-73217b04ca6c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:49.504764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc2707ce-5e8a-4970-b004-73217b04ca6c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:49.505369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc2707ce-5e8a-4970-b004-73217b04ca6c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:49.506515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc2707ce-5e8a-4970-b004-73217b04ca6c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:49.507495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc2707ce-5e8a-4970-b004-73217b04ca6c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:49.507929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc2707ce-5e8a-4970-b004-73217b04ca6c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:49.567275 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4d26a3b4-09d3-46f8-8ea6-6f23b0013576 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "POST /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533773 Oct 11 19:55:49.570036 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1642/3241] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 19:55:49 2022] POST /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:49.689976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1bd13113-08d3-4ac1-8186-c9cfc77377a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:49.691861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1bd13113-08d3-4ac1-8186-c9cfc77377a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:49.700858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd13113-08d3-4ac1-8186-c9cfc77377a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:49.701509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd13113-08d3-4ac1-8186-c9cfc77377a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:49.701958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd13113-08d3-4ac1-8186-c9cfc77377a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:49.702815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd13113-08d3-4ac1-8186-c9cfc77377a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:49.703910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd13113-08d3-4ac1-8186-c9cfc77377a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:49.704576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd13113-08d3-4ac1-8186-c9cfc77377a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:50.405258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fc2707ce-5e8a-4970-b004-73217b04ca6c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:50.417313 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc2707ce-5e8a-4970-b004-73217b04ca6c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.924079 Oct 11 19:55:50.419670 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1600/3242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:49 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:50.424716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bbfe8656-7735-4bba-93c8-b3297dcd3ba2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:50.431500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bbfe8656-7735-4bba-93c8-b3297dcd3ba2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:50.466020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfe8656-7735-4bba-93c8-b3297dcd3ba2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:50.473677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfe8656-7735-4bba-93c8-b3297dcd3ba2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:50.479456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfe8656-7735-4bba-93c8-b3297dcd3ba2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:50.491400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfe8656-7735-4bba-93c8-b3297dcd3ba2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:50.492289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfe8656-7735-4bba-93c8-b3297dcd3ba2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:50.493131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfe8656-7735-4bba-93c8-b3297dcd3ba2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:50.555998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:51.634860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1bd13113-08d3-4ac1-8186-c9cfc77377a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:51.649666 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1bd13113-08d3-4ac1-8186-c9cfc77377a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1477 microversion: 2.1 time: 1.965495 Oct 11 19:55:51.654952 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1643/3243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:49 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1477 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:51.687496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d45bd9a6-5bde-4860-9173-f6132209860b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:51.691056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d45bd9a6-5bde-4860-9173-f6132209860b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:51.713377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d45bd9a6-5bde-4860-9173-f6132209860b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:51.714448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d45bd9a6-5bde-4860-9173-f6132209860b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:51.716402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d45bd9a6-5bde-4860-9173-f6132209860b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:51.717327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d45bd9a6-5bde-4860-9173-f6132209860b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:51.720198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d45bd9a6-5bde-4860-9173-f6132209860b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:51.720807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d45bd9a6-5bde-4860-9173-f6132209860b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:52.153071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bbfe8656-7735-4bba-93c8-b3297dcd3ba2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:52.162978 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bbfe8656-7735-4bba-93c8-b3297dcd3ba2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1316 microversion: 2.1 time: 1.741060 Oct 11 19:55:52.169845 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1601/3244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:50 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1316 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:52.174791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-192b10a4-29c0-4544-bae0-c90f06c27455 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:52.196943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-192b10a4-29c0-4544-bae0-c90f06c27455 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:52.214479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-192b10a4-29c0-4544-bae0-c90f06c27455 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:52.221963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-192b10a4-29c0-4544-bae0-c90f06c27455 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:52.222719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-192b10a4-29c0-4544-bae0-c90f06c27455 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:52.225785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-192b10a4-29c0-4544-bae0-c90f06c27455 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:52.232094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-192b10a4-29c0-4544-bae0-c90f06c27455 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:52.233338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-192b10a4-29c0-4544-bae0-c90f06c27455 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:52.310981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d45bd9a6-5bde-4860-9173-f6132209860b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:52.328536 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d45bd9a6-5bde-4860-9173-f6132209860b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1371 microversion: 2.1 time: 0.670442 Oct 11 19:55:52.346557 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1644/3245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:51 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1371 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:52.353434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-90575a34-a09e-4cb6-9774-57288f9c98ef req-9dda9cb3-04c9-46ce-9cc3-8114b1ed40e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045c6ac7-f110-46b6-b43d-dee4dc6a4864", "name": "network-vif-plugged", "status": "completed", "tag": "870f5751-948d-4669-a1d8-77ea302d7d04"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:52.383196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-90575a34-a09e-4cb6-9774-57288f9c98ef req-9dda9cb3-04c9-46ce-9cc3-8114b1ed40e2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:52.383708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-90575a34-a09e-4cb6-9774-57288f9c98ef req-9dda9cb3-04c9-46ce-9cc3-8114b1ed40e2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:52.384165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-90575a34-a09e-4cb6-9774-57288f9c98ef req-9dda9cb3-04c9-46ce-9cc3-8114b1ed40e2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:52.432052 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-90575a34-a09e-4cb6-9774-57288f9c98ef req-9dda9cb3-04c9-46ce-9cc3-8114b1ed40e2 service nova] Creating event network-vif-plugged:870f5751-948d-4669-a1d8-77ea302d7d04 for instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 on n-h1-860864-3 Oct 11 19:55:52.480080 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-90575a34-a09e-4cb6-9774-57288f9c98ef req-9dda9cb3-04c9-46ce-9cc3-8114b1ed40e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113645 Oct 11 19:55:52.481608 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1645/3246] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:52.682110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba7ee578-c9fa-41df-b109-bd5501585634 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:52.683702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba7ee578-c9fa-41df-b109-bd5501585634 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:52.697139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba7ee578-c9fa-41df-b109-bd5501585634 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:52.698032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba7ee578-c9fa-41df-b109-bd5501585634 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:52.704530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba7ee578-c9fa-41df-b109-bd5501585634 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:52.705606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba7ee578-c9fa-41df-b109-bd5501585634 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:52.706256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba7ee578-c9fa-41df-b109-bd5501585634 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:52.706915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba7ee578-c9fa-41df-b109-bd5501585634 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:52.776425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:53.269340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-192b10a4-29c0-4544-bae0-c90f06c27455 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:53.282886 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-192b10a4-29c0-4544-bae0-c90f06c27455 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 1.111719 Oct 11 19:55:53.288864 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1602/3247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:52 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:53.299208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ab8e12be-d4ce-4f6e-b0ca-618d3dfea749 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:53.300171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ab8e12be-d4ce-4f6e-b0ca-618d3dfea749 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:53.314105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8e12be-d4ce-4f6e-b0ca-618d3dfea749 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:53.314630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8e12be-d4ce-4f6e-b0ca-618d3dfea749 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:53.315076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8e12be-d4ce-4f6e-b0ca-618d3dfea749 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:53.315781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8e12be-d4ce-4f6e-b0ca-618d3dfea749 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:53.316241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8e12be-d4ce-4f6e-b0ca-618d3dfea749 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:53.316665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8e12be-d4ce-4f6e-b0ca-618d3dfea749 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:53.549413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba7ee578-c9fa-41df-b109-bd5501585634 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:53.558619 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba7ee578-c9fa-41df-b109-bd5501585634 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1477 microversion: 2.1 time: 0.880919 Oct 11 19:55:53.559200 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1646/3248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:52 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1477 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:55:53.567866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-631f213f-9947-410e-bdab-f90de5c8e8cd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:53.578788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-631f213f-9947-410e-bdab-f90de5c8e8cd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 5087d98d-75b5-4d1a-b7e0-08d0d2b12e61] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:53.591988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-631f213f-9947-410e-bdab-f90de5c8e8cd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance 5087d98d-75b5-4d1a-b7e0-08d0d2b12e61 could not be found. Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-631f213f-9947-410e-bdab-f90de5c8e8cd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/5087d98d-75b5-4d1a-b7e0-08d0d2b12e61/action HTTP/1.1 Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 65 Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5087d98d-75b5-4d1a-b7e0-08d0d2b12e61 could not be found. Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5087d98d-75b5-4d1a-b7e0-08d0d2b12e61', 'body': {'rebuild': {'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3'}}} Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5087d98d-75b5-4d1a-b7e0-08d0d2b12e61 could not be found. Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 19:55:53.598837 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5087d98d-75b5-4d1a-b7e0-08d0d2b12e61 could not be found. Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5087d98d-75b5-4d1a-b7e0-08d0d2b12e61 could not be found. Oct 11 19:55:53.604345 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:53.609725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-631f213f-9947-410e-bdab-f90de5c8e8cd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance 5087d98d-75b5-4d1a-b7e0-08d0d2b12e61 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:53.612062 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-631f213f-9947-410e-bdab-f90de5c8e8cd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/5087d98d-75b5-4d1a-b7e0-08d0d2b12e61/action" status: 404 len: 111 microversion: 2.1 time: 0.047963 Oct 11 19:55:53.613055 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1647/3249] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:53 2022] POST /compute/v2.1/servers/5087d98d-75b5-4d1a-b7e0-08d0d2b12e61/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:53.629183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-075bf93d-7ade-437e-ad6e-a3f501d6fa11 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:53.633910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-075bf93d-7ade-437e-ad6e-a3f501d6fa11 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:53.651641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-075bf93d-7ade-437e-ad6e-a3f501d6fa11 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:53.652167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-075bf93d-7ade-437e-ad6e-a3f501d6fa11 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:53.653143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-075bf93d-7ade-437e-ad6e-a3f501d6fa11 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:53.655142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-075bf93d-7ade-437e-ad6e-a3f501d6fa11 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:53.655703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-075bf93d-7ade-437e-ad6e-a3f501d6fa11 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:53.656144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-075bf93d-7ade-437e-ad6e-a3f501d6fa11 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:54.243332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ab8e12be-d4ce-4f6e-b0ca-618d3dfea749 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:54.267236 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ab8e12be-d4ce-4f6e-b0ca-618d3dfea749 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1316 microversion: 2.1 time: 0.976947 Oct 11 19:55:54.268175 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1603/3250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:53 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1316 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:54.279083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d68be8e8-f1b8-4f16-bcbc-8f15af8c6417 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:54.280353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d68be8e8-f1b8-4f16-bcbc-8f15af8c6417 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:54.282799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:54.293466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d68be8e8-f1b8-4f16-bcbc-8f15af8c6417 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:54.293965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d68be8e8-f1b8-4f16-bcbc-8f15af8c6417 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:54.295855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d68be8e8-f1b8-4f16-bcbc-8f15af8c6417 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:54.297685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d68be8e8-f1b8-4f16-bcbc-8f15af8c6417 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:54.299247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d68be8e8-f1b8-4f16-bcbc-8f15af8c6417 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:54.300313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d68be8e8-f1b8-4f16-bcbc-8f15af8c6417 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:54.768065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-075bf93d-7ade-437e-ad6e-a3f501d6fa11 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:54.783744 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-075bf93d-7ade-437e-ad6e-a3f501d6fa11 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1371 microversion: 2.1 time: 1.161934 Oct 11 19:55:54.784673 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1648/3251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:53 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1371 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:54.796401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6f48dd85-c506-4831-be2e-f665b902e5cc req-54d6f904-dde7-4420-ba44-267ccac70720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2742468-e532-49c8-8797-5f3572f6786f", "tag": "1c5eacd7-fba5-46ee-b79b-51ac38302947"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:54.823672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6f48dd85-c506-4831-be2e-f665b902e5cc req-54d6f904-dde7-4420-ba44-267ccac70720 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:54.824613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6f48dd85-c506-4831-be2e-f665b902e5cc req-54d6f904-dde7-4420-ba44-267ccac70720 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:54.831895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6f48dd85-c506-4831-be2e-f665b902e5cc req-54d6f904-dde7-4420-ba44-267ccac70720 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:54.854857 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6f48dd85-c506-4831-be2e-f665b902e5cc req-54d6f904-dde7-4420-ba44-267ccac70720 service nova] Creating event network-changed:1c5eacd7-fba5-46ee-b79b-51ac38302947 for instance f2742468-e532-49c8-8797-5f3572f6786f on n-h2-860864-3 Oct 11 19:55:54.876889 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6f48dd85-c506-4831-be2e-f665b902e5cc req-54d6f904-dde7-4420-ba44-267ccac70720 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085150 Oct 11 19:55:54.877886 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1649/3252] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:54.897862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4c0c8985-d4f1-4365-9971-26cc54591cff req-8bfd31e3-4452-4316-b6bc-1a8f056cdad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee4391-e163-4a76-9151-04adeb0111a8", "name": "network-vif-plugged", "status": "completed", "tag": "8feec027-3d8b-4b4e-9712-8f57ab9fb853"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:54.918714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4c0c8985-d4f1-4365-9971-26cc54591cff req-8bfd31e3-4452-4316-b6bc-1a8f056cdad9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:54.919697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4c0c8985-d4f1-4365-9971-26cc54591cff req-8bfd31e3-4452-4316-b6bc-1a8f056cdad9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:54.919814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4c0c8985-d4f1-4365-9971-26cc54591cff req-8bfd31e3-4452-4316-b6bc-1a8f056cdad9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:54.954492 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4c0c8985-d4f1-4365-9971-26cc54591cff req-8bfd31e3-4452-4316-b6bc-1a8f056cdad9 service nova] Creating event network-vif-plugged:8feec027-3d8b-4b4e-9712-8f57ab9fb853 for instance b7ee4391-e163-4a76-9151-04adeb0111a8 on n-h1-860864-3 Oct 11 19:55:54.962467 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4c0c8985-d4f1-4365-9971-26cc54591cff req-8bfd31e3-4452-4316-b6bc-1a8f056cdad9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082863 Oct 11 19:55:54.965053 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1650/3253] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:54.979420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c1c1e2d7-79f1-4598-8a8e-d538a39bdf82 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:54.980139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1c1e2d7-79f1-4598-8a8e-d538a39bdf82 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:55.000675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c1e2d7-79f1-4598-8a8e-d538a39bdf82 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:55.001450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c1e2d7-79f1-4598-8a8e-d538a39bdf82 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:55.002069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c1e2d7-79f1-4598-8a8e-d538a39bdf82 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:55.003032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c1e2d7-79f1-4598-8a8e-d538a39bdf82 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:55.011236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c1e2d7-79f1-4598-8a8e-d538a39bdf82 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:55.012027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c1e2d7-79f1-4598-8a8e-d538a39bdf82 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:55.017086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:55.063954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:55.175053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d68be8e8-f1b8-4f16-bcbc-8f15af8c6417 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:55.219183 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d68be8e8-f1b8-4f16-bcbc-8f15af8c6417 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.947053 Oct 11 19:55:55.219796 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1604/3254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:54 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:55.260290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eeb13c06-7c15-468d-91eb-ca2a1e49d636 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:55.260912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eeb13c06-7c15-468d-91eb-ca2a1e49d636 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:55.277874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb13c06-7c15-468d-91eb-ca2a1e49d636 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:55.278580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb13c06-7c15-468d-91eb-ca2a1e49d636 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:55.279499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb13c06-7c15-468d-91eb-ca2a1e49d636 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:55.281240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb13c06-7c15-468d-91eb-ca2a1e49d636 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:55.282933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb13c06-7c15-468d-91eb-ca2a1e49d636 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:55.284190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb13c06-7c15-468d-91eb-ca2a1e49d636 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:55.457216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:55.779669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eeb13c06-7c15-468d-91eb-ca2a1e49d636 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:55.797292 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eeb13c06-7c15-468d-91eb-ca2a1e49d636 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.547682 Oct 11 19:55:55.814372 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1605/3255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:55 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:55.814372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-94e0e45a-7f03-43bd-b103-b5100309f693 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:55.814372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-94e0e45a-7f03-43bd-b103-b5100309f693 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:55.834106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94e0e45a-7f03-43bd-b103-b5100309f693 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:55.834734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94e0e45a-7f03-43bd-b103-b5100309f693 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:55.835672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94e0e45a-7f03-43bd-b103-b5100309f693 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:55.840015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94e0e45a-7f03-43bd-b103-b5100309f693 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:55.840706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94e0e45a-7f03-43bd-b103-b5100309f693 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:55.841217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94e0e45a-7f03-43bd-b103-b5100309f693 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:56.042068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c1c1e2d7-79f1-4598-8a8e-d538a39bdf82 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:56.093184 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c1c1e2d7-79f1-4598-8a8e-d538a39bdf82 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1477 microversion: 2.1 time: 1.123054 Oct 11 19:55:56.094454 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1651/3256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:54 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1477 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:56.103897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2485cca4-ab36-4296-a6ac-0acf8fcc7428 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:56.104909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2485cca4-ab36-4296-a6ac-0acf8fcc7428 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:56.119659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2485cca4-ab36-4296-a6ac-0acf8fcc7428 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:56.121018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2485cca4-ab36-4296-a6ac-0acf8fcc7428 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:56.125758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2485cca4-ab36-4296-a6ac-0acf8fcc7428 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:56.127042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2485cca4-ab36-4296-a6ac-0acf8fcc7428 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:56.127742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2485cca4-ab36-4296-a6ac-0acf8fcc7428 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:56.128411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2485cca4-ab36-4296-a6ac-0acf8fcc7428 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:56.356115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:55:56.606574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-94e0e45a-7f03-43bd-b103-b5100309f693 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:56.617854 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-94e0e45a-7f03-43bd-b103-b5100309f693 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1316 microversion: 2.1 time: 0.816320 Oct 11 19:55:56.618926 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1606/3257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:55 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1316 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:56.624267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-55bf28b4-1524-42fc-bebc-8406bbfe2676 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:56.624986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-55bf28b4-1524-42fc-bebc-8406bbfe2676 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 78ea6297-b69f-4c02-9ad5-cb71e321d075] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:56.631063 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-55bf28b4-1524-42fc-bebc-8406bbfe2676 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance 78ea6297-b69f-4c02-9ad5-cb71e321d075 could not be found. Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-55bf28b4-1524-42fc-bebc-8406bbfe2676 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/78ea6297-b69f-4c02-9ad5-cb71e321d075/action HTTP/1.1 Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 15 Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: {"restore": {}} Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 78ea6297-b69f-4c02-9ad5-cb71e321d075 could not be found. Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '78ea6297-b69f-4c02-9ad5-cb71e321d075', 'body': {'restore': {}}} Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78ea6297-b69f-4c02-9ad5-cb71e321d075 could not be found. Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78ea6297-b69f-4c02-9ad5-cb71e321d075 could not be found. Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:56.633074 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:56.637502 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:56.637502 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:56.637502 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78ea6297-b69f-4c02-9ad5-cb71e321d075 could not be found. Oct 11 19:55:56.637502 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:55:56.638452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-55bf28b4-1524-42fc-bebc-8406bbfe2676 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance 78ea6297-b69f-4c02-9ad5-cb71e321d075 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:56.640612 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-55bf28b4-1524-42fc-bebc-8406bbfe2676 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/78ea6297-b69f-4c02-9ad5-cb71e321d075/action" status: 404 len: 111 microversion: 2.1 time: 0.020152 Oct 11 19:55:56.641565 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1607/3258] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:56 2022] POST /compute/v2.1/servers/78ea6297-b69f-4c02-9ad5-cb71e321d075/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:55:56.651802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ad65593e-8ddb-4baf-b4c2-77a57780b092 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:56.652778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ad65593e-8ddb-4baf-b4c2-77a57780b092 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:56.665882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad65593e-8ddb-4baf-b4c2-77a57780b092 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:56.667300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad65593e-8ddb-4baf-b4c2-77a57780b092 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:56.667970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad65593e-8ddb-4baf-b4c2-77a57780b092 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:56.668942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad65593e-8ddb-4baf-b4c2-77a57780b092 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:56.669729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad65593e-8ddb-4baf-b4c2-77a57780b092 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:56.671086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad65593e-8ddb-4baf-b4c2-77a57780b092 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:57.443634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2485cca4-ab36-4296-a6ac-0acf8fcc7428 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:57.459542 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2485cca4-ab36-4296-a6ac-0acf8fcc7428 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1371 microversion: 2.1 time: 1.361145 Oct 11 19:55:57.470550 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1652/3259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:56 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1371 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:57.470550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-28ffa8cb-91ea-4e52-9f9b-eab311a3ccd8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:57.470550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-28ffa8cb-91ea-4e52-9f9b-eab311a3ccd8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:57.478640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ad65593e-8ddb-4baf-b4c2-77a57780b092 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:57.489002 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ad65593e-8ddb-4baf-b4c2-77a57780b092 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.841857 Oct 11 19:55:57.491375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28ffa8cb-91ea-4e52-9f9b-eab311a3ccd8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:57.498694 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1608/3260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:56 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:57.513633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28ffa8cb-91ea-4e52-9f9b-eab311a3ccd8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:57.513633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28ffa8cb-91ea-4e52-9f9b-eab311a3ccd8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:57.513633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28ffa8cb-91ea-4e52-9f9b-eab311a3ccd8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:57.513633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28ffa8cb-91ea-4e52-9f9b-eab311a3ccd8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:57.513633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28ffa8cb-91ea-4e52-9f9b-eab311a3ccd8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:57.521848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-6cba03a8-9896-4a6c-9fd9-f9e1d3fd71a7 req-afd2daac-14ad-4030-9035-a6e70aef9f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4b045-264a-41c3-b8e8-5a038c485877", "tag": "8c56ce9b-8903-45a8-b9a9-f1cca5c18f44"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:57.532708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6cba03a8-9896-4a6c-9fd9-f9e1d3fd71a7 req-afd2daac-14ad-4030-9035-a6e70aef9f0f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:57.533481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6cba03a8-9896-4a6c-9fd9-f9e1d3fd71a7 req-afd2daac-14ad-4030-9035-a6e70aef9f0f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:57.534083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6cba03a8-9896-4a6c-9fd9-f9e1d3fd71a7 req-afd2daac-14ad-4030-9035-a6e70aef9f0f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:57.556165 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6cba03a8-9896-4a6c-9fd9-f9e1d3fd71a7 req-afd2daac-14ad-4030-9035-a6e70aef9f0f service nova] Creating event network-changed:8c56ce9b-8903-45a8-b9a9-f1cca5c18f44 for instance e1c4b045-264a-41c3-b8e8-5a038c485877 on n-h2-860864-3 Oct 11 19:55:57.562459 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-6cba03a8-9896-4a6c-9fd9-f9e1d3fd71a7 req-afd2daac-14ad-4030-9035-a6e70aef9f0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061457 Oct 11 19:55:57.563738 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1609/3261] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:55:57.571893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1284189893", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4b0daf4d-df4b-45e2-976e-b739b3e9fb73"}], "security_groups": [{"name": "tempest-securitygroup--2080911181"}], "key_name": "tempest-keypair-849669695", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b7dfea25-4d2b-4667-ad7d-aeca098ce084", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:57.794071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-28ffa8cb-91ea-4e52-9f9b-eab311a3ccd8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:57.804616 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-28ffa8cb-91ea-4e52-9f9b-eab311a3ccd8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1462 microversion: 2.1 time: 0.343021 Oct 11 19:55:57.830561 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1653/3262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:57 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1462 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:57.843135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7242de3b-fc2e-4f6d-a00f-3fc4571827f7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:57.844046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7242de3b-fc2e-4f6d-a00f-3fc4571827f7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:57.852797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7242de3b-fc2e-4f6d-a00f-3fc4571827f7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:57.853558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7242de3b-fc2e-4f6d-a00f-3fc4571827f7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:57.854183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7242de3b-fc2e-4f6d-a00f-3fc4571827f7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:57.855117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7242de3b-fc2e-4f6d-a00f-3fc4571827f7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:57.855742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7242de3b-fc2e-4f6d-a00f-3fc4571827f7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:57.856338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7242de3b-fc2e-4f6d-a00f-3fc4571827f7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:57.864099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] validate_networks() for [('4b0daf4d-df4b-45e2-976e-b739b3e9fb73', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:55:58.262600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7242de3b-fc2e-4f6d-a00f-3fc4571827f7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:58.277046 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7242de3b-fc2e-4f6d-a00f-3fc4571827f7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.442004 Oct 11 19:55:58.278283 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1654/3263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:57 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:58.290993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-560ac6d4-f943-4e55-89b5-dd8ce96de0ae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:58.291644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-560ac6d4-f943-4e55-89b5-dd8ce96de0ae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:58.314775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-560ac6d4-f943-4e55-89b5-dd8ce96de0ae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:58.315274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-560ac6d4-f943-4e55-89b5-dd8ce96de0ae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:58.315730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-560ac6d4-f943-4e55-89b5-dd8ce96de0ae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:58.316478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-560ac6d4-f943-4e55-89b5-dd8ce96de0ae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:58.316946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-560ac6d4-f943-4e55-89b5-dd8ce96de0ae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:58.317395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-560ac6d4-f943-4e55-89b5-dd8ce96de0ae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.113410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-560ac6d4-f943-4e55-89b5-dd8ce96de0ae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:59.123681 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-560ac6d4-f943-4e55-89b5-dd8ce96de0ae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1316 microversion: 2.1 time: 0.844373 Oct 11 19:55:59.125337 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1655/3264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:58 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1316 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:59.149348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-72c4d79f-811a-4e85-8881-8d9f039f2b38 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:59.151903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-72c4d79f-811a-4e85-8881-8d9f039f2b38 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:59.166341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72c4d79f-811a-4e85-8881-8d9f039f2b38 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.167133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72c4d79f-811a-4e85-8881-8d9f039f2b38 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.168619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72c4d79f-811a-4e85-8881-8d9f039f2b38 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.171674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72c4d79f-811a-4e85-8881-8d9f039f2b38 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.172228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72c4d79f-811a-4e85-8881-8d9f039f2b38 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.172895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72c4d79f-811a-4e85-8881-8d9f039f2b38 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.179914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Getting quotas for project 1ef09f5386314639b7a5d6a3a6bc6320. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:59.196543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Getting quotas for user e57648a513c14c3b9f81b1c1e1eafcd8 and project 1ef09f5386314639b7a5d6a3a6bc6320. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:59.229951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:55:59.230466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:55:59.231075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:55:59.231489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:55:59.231933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:55:59.256515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.257323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.257991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.259482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.260152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.260745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.281400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Getting quotas for project 1ef09f5386314639b7a5d6a3a6bc6320. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:55:59.288388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Getting quotas for user e57648a513c14c3b9f81b1c1e1eafcd8 and project 1ef09f5386314639b7a5d6a3a6bc6320. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:55:59.315029 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-72c4d79f-811a-4e85-8881-8d9f039f2b38 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action" status: 202 len: 0 microversion: 2.1 time: 0.187891 Oct 11 19:55:59.318690 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1656/3265] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:59 2022] POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:55:59.324140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:55:59.324836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:59.331341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.331935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.332298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.332998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.333450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.334460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.368677 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Cannot 'restore' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action HTTP/1.1 Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 15 Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: {"restore": {}} Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: exception: Cannot 'restore' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '85f1dc40-ef33-40f8-b128-d5c6367e833e', 'body': {'restore': {}}} Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e in vm_state active. Cannot restore while the instance is in this state. Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:55:59.370811 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:55:59.379965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:55:59.379965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:55:59.379965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:55:59.379965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:55:59.379965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:55:59.379965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 409 to user: Cannot 'restore' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:55:59.379965 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e77fb3c9-2488-49ef-89b1-3d0981844fad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 409 len: 145 microversion: 2.1 time: 0.053202 Oct 11 19:55:59.379965 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1657/3266] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:55:59 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 145 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:55:59.381310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-325be4e6-9bd6-4359-85e1-f015a45103ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:59.382488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-325be4e6-9bd6-4359-85e1-f015a45103ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:59.388862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325be4e6-9bd6-4359-85e1-f015a45103ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.389358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325be4e6-9bd6-4359-85e1-f015a45103ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.389794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325be4e6-9bd6-4359-85e1-f015a45103ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.390762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325be4e6-9bd6-4359-85e1-f015a45103ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.391647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325be4e6-9bd6-4359-85e1-f015a45103ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.392096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-325be4e6-9bd6-4359-85e1-f015a45103ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.434398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:55:59.437238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7dfea25-4d2b-4667-ad7d-aeca098ce084',volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:55:59.667026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-325be4e6-9bd6-4359-85e1-f015a45103ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:55:59.678773 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-325be4e6-9bd6-4359-85e1-f015a45103ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1371 microversion: 2.1 time: 0.303636 Oct 11 19:55:59.679946 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1658/3267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:59 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:55:59.685511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:59.686586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:59.694825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.696027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.696857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.697979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.699425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.700914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.702158 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f6f6d4a9-dc26-4a62-9d61-18417367dd7a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.136087 Oct 11 19:55:59.702745 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1610/3268] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:55:57 2022] POST /compute/v2.1/servers => generated 407 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:55:59.710033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b2591c90-0613-4c0e-9b5f-4f94bbeb478a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:55:59.710970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b2591c90-0613-4c0e-9b5f-4f94bbeb478a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:55:59.718501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2591c90-0613-4c0e-9b5f-4f94bbeb478a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.719879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2591c90-0613-4c0e-9b5f-4f94bbeb478a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.720517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2591c90-0613-4c0e-9b5f-4f94bbeb478a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.721455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2591c90-0613-4c0e-9b5f-4f94bbeb478a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.722082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2591c90-0613-4c0e-9b5f-4f94bbeb478a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.722703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2591c90-0613-4c0e-9b5f-4f94bbeb478a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.772091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:55:59.772864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:55:59.773708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:55:59.774345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lazy-loading 'fault' on Instance uuid 045c6ac7-f110-46b6-b43d-dee4dc6a4864 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:56:00.022823 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0afc88b3-bd45-481a-807b-6a3324ce5d6c tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1596 microversion: 2.1 time: 0.341327 Oct 11 19:56:00.023414 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1659/3269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:59 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1596 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:00.034061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-57e2c54b-ad45-4966-82ac-99e0038d3314 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:00.034891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-57e2c54b-ad45-4966-82ac-99e0038d3314 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:00.041924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b2591c90-0613-4c0e-9b5f-4f94bbeb478a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:00.065642 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b2591c90-0613-4c0e-9b5f-4f94bbeb478a tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.349821 Oct 11 19:56:00.066597 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1611/3270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:55:59 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:00.072160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9bab981a-8388-4524-bec6-04a5c796f2dc tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:00.075221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9bab981a-8388-4524-bec6-04a5c796f2dc tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:00.092455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bab981a-8388-4524-bec6-04a5c796f2dc tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:00.093187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bab981a-8388-4524-bec6-04a5c796f2dc tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:00.094632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bab981a-8388-4524-bec6-04a5c796f2dc tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:00.095644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bab981a-8388-4524-bec6-04a5c796f2dc tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:00.100069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bab981a-8388-4524-bec6-04a5c796f2dc tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:00.100898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9bab981a-8388-4524-bec6-04a5c796f2dc tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:00.138352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-57e2c54b-ad45-4966-82ac-99e0038d3314 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:00.145657 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-57e2c54b-ad45-4966-82ac-99e0038d3314 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1121 microversion: 2.1 time: 0.121158 Oct 11 19:56:00.152400 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1660/3271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:00 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1121 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:00.165232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-340165c1-ef83-4355-a54e-48546234da97 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:00.166135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-340165c1-ef83-4355-a54e-48546234da97 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:00.189203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340165c1-ef83-4355-a54e-48546234da97 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:00.189721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340165c1-ef83-4355-a54e-48546234da97 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:00.190351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340165c1-ef83-4355-a54e-48546234da97 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:00.191907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340165c1-ef83-4355-a54e-48546234da97 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:00.192370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340165c1-ef83-4355-a54e-48546234da97 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:00.193132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340165c1-ef83-4355-a54e-48546234da97 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:00.256384 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9bab981a-8388-4524-bec6-04a5c796f2dc tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action" status: 202 len: 0 microversion: 2.1 time: 0.188039 Oct 11 19:56:00.257573 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1612/3272] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:56:00 2022] POST /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:56:00.265750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f13be103-70c9-49c7-9084-b371e819d30d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:00.266357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f13be103-70c9-49c7-9084-b371e819d30d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:00.293829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f13be103-70c9-49c7-9084-b371e819d30d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:00.295108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f13be103-70c9-49c7-9084-b371e819d30d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:00.298090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f13be103-70c9-49c7-9084-b371e819d30d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:00.300480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f13be103-70c9-49c7-9084-b371e819d30d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:00.302479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f13be103-70c9-49c7-9084-b371e819d30d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:00.303373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f13be103-70c9-49c7-9084-b371e819d30d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:00.670178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-340165c1-ef83-4355-a54e-48546234da97 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:00.687312 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-340165c1-ef83-4355-a54e-48546234da97 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.531889 Oct 11 19:56:00.688206 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1661/3273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:00 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:00.692696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5d5700c-5aa0-4fc0-92ac-ffd5d94575f5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:00.694029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b5d5700c-5aa0-4fc0-92ac-ffd5d94575f5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:00.712083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5d5700c-5aa0-4fc0-92ac-ffd5d94575f5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:00.715266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5d5700c-5aa0-4fc0-92ac-ffd5d94575f5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:00.716844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5d5700c-5aa0-4fc0-92ac-ffd5d94575f5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:00.716968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f13be103-70c9-49c7-9084-b371e819d30d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:00.718140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5d5700c-5aa0-4fc0-92ac-ffd5d94575f5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:00.721007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5d5700c-5aa0-4fc0-92ac-ffd5d94575f5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:00.723112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5d5700c-5aa0-4fc0-92ac-ffd5d94575f5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:00.726081 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f13be103-70c9-49c7-9084-b371e819d30d tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1316 microversion: 2.1 time: 0.466588 Oct 11 19:56:00.729930 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1613/3274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:00 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:00.747647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a119459-8718-4d50-8bd4-0b39b0151cf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:00.751193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a119459-8718-4d50-8bd4-0b39b0151cf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:00.758745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a119459-8718-4d50-8bd4-0b39b0151cf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:00.760425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a119459-8718-4d50-8bd4-0b39b0151cf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:00.761926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a119459-8718-4d50-8bd4-0b39b0151cf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:00.762936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a119459-8718-4d50-8bd4-0b39b0151cf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:00.763655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a119459-8718-4d50-8bd4-0b39b0151cf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:00.764315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a119459-8718-4d50-8bd4-0b39b0151cf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:01.275997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4a119459-8718-4d50-8bd4-0b39b0151cf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:01.279438 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b5d5700c-5aa0-4fc0-92ac-ffd5d94575f5 tempest-ServersAdminTestJSON-1530811815 tempest-ServersAdminTestJSON-1530811815-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1613 microversion: 2.1 time: 0.578130 Oct 11 19:56:01.284539 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a119459-8718-4d50-8bd4-0b39b0151cf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1371 microversion: 2.1 time: 0.553110 Oct 11 19:56:01.286077 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1662/3275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:00 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1613 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:01.288349 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1614/3276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:00 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1371 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:01.310280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11341a2c-6793-4d7d-9ac8-f36176dee0bf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:01.312322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65a27766-947d-472a-9751-801c87865d8d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:01.313860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-11341a2c-6793-4d7d-9ac8-f36176dee0bf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:01.319206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-65a27766-947d-472a-9751-801c87865d8d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:01.335494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65a27766-947d-472a-9751-801c87865d8d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:01.335991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65a27766-947d-472a-9751-801c87865d8d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:01.336435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65a27766-947d-472a-9751-801c87865d8d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:01.337147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65a27766-947d-472a-9751-801c87865d8d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:01.337614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65a27766-947d-472a-9751-801c87865d8d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:01.338044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65a27766-947d-472a-9751-801c87865d8d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:01.341509 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-11341a2c-6793-4d7d-9ac8-f36176dee0bf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance 4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e could not be found. Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11341a2c-6793-4d7d-9ac8-f36176dee0bf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e/action HTTP/1.1 Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 14 Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: {"resume": {}} Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e could not be found. Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e', 'body': {'resume': {}}} Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e could not be found. Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e could not be found. Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:01.350873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:01.355528 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:56:01.355528 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:56:01.355528 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e could not be found. Oct 11 19:56:01.355528 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:01.355528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11341a2c-6793-4d7d-9ac8-f36176dee0bf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance 4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:56:01.355528 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-11341a2c-6793-4d7d-9ac8-f36176dee0bf tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e/action" status: 404 len: 111 microversion: 2.1 time: 0.066600 Oct 11 19:56:01.355528 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1663/3277] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:56:01 2022] POST /compute/v2.1/servers/4abf05c5-ddb5-4962-a4b0-cf2bfa5ff35e/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:56:01.361838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-04eb6405-b7de-4486-bb12-46024e385870 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:01.362348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-04eb6405-b7de-4486-bb12-46024e385870 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:01.382913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04eb6405-b7de-4486-bb12-46024e385870 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:01.383420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04eb6405-b7de-4486-bb12-46024e385870 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:01.383857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04eb6405-b7de-4486-bb12-46024e385870 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:01.384562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04eb6405-b7de-4486-bb12-46024e385870 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:01.385016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04eb6405-b7de-4486-bb12-46024e385870 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:01.385713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04eb6405-b7de-4486-bb12-46024e385870 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:01.471624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-04eb6405-b7de-4486-bb12-46024e385870 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:56:01.555660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:01.579772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-65a27766-947d-472a-9751-801c87865d8d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:01.593896 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-65a27766-947d-472a-9751-801c87865d8d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1219 microversion: 2.1 time: 0.303612 Oct 11 19:56:01.597497 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1615/3278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:01 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1219 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:01.610212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c4143304-920a-4905-83fd-661a5f5da92e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:01.611338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4143304-920a-4905-83fd-661a5f5da92e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:01.625356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4143304-920a-4905-83fd-661a5f5da92e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:01.626265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4143304-920a-4905-83fd-661a5f5da92e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:01.626800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4143304-920a-4905-83fd-661a5f5da92e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:01.628013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4143304-920a-4905-83fd-661a5f5da92e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:01.628931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4143304-920a-4905-83fd-661a5f5da92e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:01.629602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4143304-920a-4905-83fd-661a5f5da92e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:01.637714 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-04eb6405-b7de-4486-bb12-46024e385870 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 204 len: 0 microversion: 2.1 time: 0.280411 Oct 11 19:56:01.638311 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1664/3279] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:56:01 2022] DELETE /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:56:01.660449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3349a58-4b57-48b5-ab09-7477537ca95f tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:01.661184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3349a58-4b57-48b5-ab09-7477537ca95f tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:01.686370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3349a58-4b57-48b5-ab09-7477537ca95f tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:01.687172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3349a58-4b57-48b5-ab09-7477537ca95f tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:01.687851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3349a58-4b57-48b5-ab09-7477537ca95f tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:01.688807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3349a58-4b57-48b5-ab09-7477537ca95f tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:01.689516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3349a58-4b57-48b5-ab09-7477537ca95f tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:01.690168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3349a58-4b57-48b5-ab09-7477537ca95f tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.079589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c4143304-920a-4905-83fd-661a5f5da92e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:02.088639 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c4143304-920a-4905-83fd-661a5f5da92e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.488532 Oct 11 19:56:02.089230 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1616/3280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:01 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:02.108912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c3349a58-4b57-48b5-ab09-7477537ca95f tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:02.118573 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3349a58-4b57-48b5-ab09-7477537ca95f tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1469 microversion: 2.1 time: 0.469665 Oct 11 19:56:02.120784 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1665/3281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:01 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1469 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:02.126287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0328d548-ac1c-40ed-a438-4148f70a0485 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:02.127204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0328d548-ac1c-40ed-a438-4148f70a0485 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:02.135799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0328d548-ac1c-40ed-a438-4148f70a0485 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.136596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0328d548-ac1c-40ed-a438-4148f70a0485 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.137066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a1c351f1-1a74-4f4f-a3dd-33b89e3ab804 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:02.137489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0328d548-ac1c-40ed-a438-4148f70a0485 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.137691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a1c351f1-1a74-4f4f-a3dd-33b89e3ab804 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:02.138606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0328d548-ac1c-40ed-a438-4148f70a0485 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.139257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0328d548-ac1c-40ed-a438-4148f70a0485 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.139878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0328d548-ac1c-40ed-a438-4148f70a0485 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.149302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1c351f1-1a74-4f4f-a3dd-33b89e3ab804 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.149803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1c351f1-1a74-4f4f-a3dd-33b89e3ab804 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.150247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1c351f1-1a74-4f4f-a3dd-33b89e3ab804 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.150981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1c351f1-1a74-4f4f-a3dd-33b89e3ab804 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.157468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1c351f1-1a74-4f4f-a3dd-33b89e3ab804 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.158083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1c351f1-1a74-4f4f-a3dd-33b89e3ab804 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.392366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0328d548-ac1c-40ed-a438-4148f70a0485 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:02.400155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a1c351f1-1a74-4f4f-a3dd-33b89e3ab804 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:02.407426 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0328d548-ac1c-40ed-a438-4148f70a0485 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.285371 Oct 11 19:56:02.408263 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1666/3282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:02 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:02.409409 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a1c351f1-1a74-4f4f-a3dd-33b89e3ab804 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1316 microversion: 2.1 time: 0.297200 Oct 11 19:56:02.410130 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1617/3283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:02 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:02.418032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bc8ff548-9322-4a7a-a3dd-43c36b1286ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:02.418689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bc8ff548-9322-4a7a-a3dd-43c36b1286ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:02.425532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8ff548-9322-4a7a-a3dd-43c36b1286ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.426039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8ff548-9322-4a7a-a3dd-43c36b1286ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.426693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8ff548-9322-4a7a-a3dd-43c36b1286ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.427440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8ff548-9322-4a7a-a3dd-43c36b1286ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.427906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8ff548-9322-4a7a-a3dd-43c36b1286ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.428620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc8ff548-9322-4a7a-a3dd-43c36b1286ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.452722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:02.453209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:02.463423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.464220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.464851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.465612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.466091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.466518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.511863 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Cannot 'resume' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action HTTP/1.1 Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 14 Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: {"resume": {}} Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: exception: Cannot 'resume' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '85f1dc40-ef33-40f8-b128-d5c6367e833e', 'body': {'resume': {}}} Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e in vm_state active. Cannot resume while the instance is in this state. Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:02.521524 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:02.526577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:02.526577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:02.526577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:02.526577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:56:02.526577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:56:02.526577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:56:02.526577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:02.526577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 409 to user: Cannot 'resume' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:56:02.530336 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-30d69b8e-6c10-4814-a03a-5c9c41428f09 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 409 len: 144 microversion: 2.1 time: 0.082556 Oct 11 19:56:02.534288 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1618/3284] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:56:02 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 144 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:56:02.544001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec17fd50-5d8d-407d-876a-c8f8b07be11e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:02.544936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ec17fd50-5d8d-407d-876a-c8f8b07be11e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:02.556446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec17fd50-5d8d-407d-876a-c8f8b07be11e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.557402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec17fd50-5d8d-407d-876a-c8f8b07be11e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.558055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec17fd50-5d8d-407d-876a-c8f8b07be11e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.559115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec17fd50-5d8d-407d-876a-c8f8b07be11e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.559822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec17fd50-5d8d-407d-876a-c8f8b07be11e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.560619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec17fd50-5d8d-407d-876a-c8f8b07be11e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.565335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:02.822463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc8ff548-9322-4a7a-a3dd-43c36b1286ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:02.845767 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bc8ff548-9322-4a7a-a3dd-43c36b1286ad tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1371 microversion: 2.1 time: 0.436632 Oct 11 19:56:02.847023 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1667/3285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:02 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1371 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:02.874395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6388b946-a4d8-46c7-ac95-0eb731aa9b7d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:02.875576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6388b946-a4d8-46c7-ac95-0eb731aa9b7d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:02.878940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:02.883407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6388b946-a4d8-46c7-ac95-0eb731aa9b7d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.884211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6388b946-a4d8-46c7-ac95-0eb731aa9b7d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.884893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6388b946-a4d8-46c7-ac95-0eb731aa9b7d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.885858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6388b946-a4d8-46c7-ac95-0eb731aa9b7d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.886562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6388b946-a4d8-46c7-ac95-0eb731aa9b7d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.887213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6388b946-a4d8-46c7-ac95-0eb731aa9b7d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.922162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec17fd50-5d8d-407d-876a-c8f8b07be11e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:02.939222 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ec17fd50-5d8d-407d-876a-c8f8b07be11e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.396143 Oct 11 19:56:02.941299 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1619/3286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:02 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:02.968241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56f46bd6-ee72-4595-af71-2d9e0b54a15c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:02.968984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56f46bd6-ee72-4595-af71-2d9e0b54a15c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:02.988438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f46bd6-ee72-4595-af71-2d9e0b54a15c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.994667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f46bd6-ee72-4595-af71-2d9e0b54a15c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.995796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f46bd6-ee72-4595-af71-2d9e0b54a15c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:02.996709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f46bd6-ee72-4595-af71-2d9e0b54a15c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:02.997028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f46bd6-ee72-4595-af71-2d9e0b54a15c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:02.998726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6388b946-a4d8-46c7-ac95-0eb731aa9b7d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:03.000690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f46bd6-ee72-4595-af71-2d9e0b54a15c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:03.008222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6388b946-a4d8-46c7-ac95-0eb731aa9b7d tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1237 microversion: 2.1 time: 0.155538 Oct 11 19:56:03.010483 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1668/3287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:02 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1237 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:03.148149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-09910cb7-eec2-478e-a037-a0e822babcfb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:03.148766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-09910cb7-eec2-478e-a037-a0e822babcfb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:03.159562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09910cb7-eec2-478e-a037-a0e822babcfb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:03.160076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09910cb7-eec2-478e-a037-a0e822babcfb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:03.160524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09910cb7-eec2-478e-a037-a0e822babcfb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:03.161241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09910cb7-eec2-478e-a037-a0e822babcfb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:03.162261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09910cb7-eec2-478e-a037-a0e822babcfb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:03.162744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09910cb7-eec2-478e-a037-a0e822babcfb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:03.704664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56f46bd6-ee72-4595-af71-2d9e0b54a15c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:03.728163 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56f46bd6-ee72-4595-af71-2d9e0b54a15c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.763771 Oct 11 19:56:03.733145 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1620/3288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:02 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:03.747879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-02a345ac-78e5-4c92-ab9a-c49d2044e262 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:03.751438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-02a345ac-78e5-4c92-ab9a-c49d2044e262 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:03.774275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02a345ac-78e5-4c92-ab9a-c49d2044e262 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:03.777961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02a345ac-78e5-4c92-ab9a-c49d2044e262 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:03.778502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02a345ac-78e5-4c92-ab9a-c49d2044e262 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:03.779826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02a345ac-78e5-4c92-ab9a-c49d2044e262 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:03.784356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02a345ac-78e5-4c92-ab9a-c49d2044e262 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:03.786028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02a345ac-78e5-4c92-ab9a-c49d2044e262 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:03.979679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-09910cb7-eec2-478e-a037-a0e822babcfb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:03.991265 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-09910cb7-eec2-478e-a037-a0e822babcfb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 200 len: 1469 microversion: 2.1 time: 0.845178 Oct 11 19:56:04.008786 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1669/3289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:03 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 1469 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:56:04.027486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f15b16fc-d02a-490e-8436-d3a087a49b54 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:04.028788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f15b16fc-d02a-490e-8436-d3a087a49b54 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:04.042856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f15b16fc-d02a-490e-8436-d3a087a49b54 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:04.043939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f15b16fc-d02a-490e-8436-d3a087a49b54 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:04.044683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f15b16fc-d02a-490e-8436-d3a087a49b54 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:04.045957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f15b16fc-d02a-490e-8436-d3a087a49b54 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:04.046784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f15b16fc-d02a-490e-8436-d3a087a49b54 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:04.047643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f15b16fc-d02a-490e-8436-d3a087a49b54 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.211834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-02a345ac-78e5-4c92-ab9a-c49d2044e262 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:05.228409 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-02a345ac-78e5-4c92-ab9a-c49d2044e262 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1316 microversion: 2.1 time: 1.492287 Oct 11 19:56:05.229569 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1621/3290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:03 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1316 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:05.238248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-121e029b-9f12-4166-b8c9-de96f0d325f6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-121e029b-9f12-4166-b8c9-de96f0d325f6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 160 Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "94a98399-e5d5-46d5-b3fe-da4714c7413b"}]}} Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'networks': [{'uuid': '94a98399-e5d5-46d5-b3fe-da4714c7413b'}]}}} Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi '' Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:56:05.242647 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:56:05.248328 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.252110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-121e029b-9f12-4166-b8c9-de96f0d325f6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:56:05.253207 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-121e029b-9f12-4166-b8c9-de96f0d325f6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.022443 Oct 11 19:56:05.258680 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1622/3291] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:56:05 2022] POST /compute/v2.1/servers => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:56:05.265164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-d2d06a39-bc23-4515-b00b-dfdfe5ae5480 req-2108c7ee-f05a-4ec7-be55-a0f8c55e900e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9aeb85-447c-419f-9b63-c85927a11e8c", "name": "network-vif-deleted", "tag": "11e3d19e-74f2-4036-9c86-305e9f486564"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:05.282453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d2d06a39-bc23-4515-b00b-dfdfe5ae5480 req-2108c7ee-f05a-4ec7-be55-a0f8c55e900e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.283395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d2d06a39-bc23-4515-b00b-dfdfe5ae5480 req-2108c7ee-f05a-4ec7-be55-a0f8c55e900e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.284063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d2d06a39-bc23-4515-b00b-dfdfe5ae5480 req-2108c7ee-f05a-4ec7-be55-a0f8c55e900e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.299116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f15b16fc-d02a-490e-8436-d3a087a49b54 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:05.308978 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-d2d06a39-bc23-4515-b00b-dfdfe5ae5480 req-2108c7ee-f05a-4ec7-be55-a0f8c55e900e service nova] Creating event network-vif-deleted:11e3d19e-74f2-4036-9c86-305e9f486564 for instance 7b9aeb85-447c-419f-9b63-c85927a11e8c on n-h1-860864-3 Oct 11 19:56:05.319831 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-d2d06a39-bc23-4515-b00b-dfdfe5ae5480 req-2108c7ee-f05a-4ec7-be55-a0f8c55e900e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059406 Oct 11 19:56:05.321402 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1623/3292] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:05.326371 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f15b16fc-d02a-490e-8436-d3a087a49b54 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1371 microversion: 2.1 time: 1.314699 Oct 11 19:56:05.326371 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1670/3293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:04 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1371 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:05.329394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1a9b81a7-b7c1-4c61-815f-32fb501b2368 req-a33b425d-7be1-45d0-8760-402216f7dc4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2742468-e532-49c8-8797-5f3572f6786f", "name": "network-vif-plugged", "status": "completed", "tag": "1c5eacd7-fba5-46ee-b79b-51ac38302947"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:05.331052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3e9984f0-5176-4acb-aed4-7e36df9ae0a1 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:05.331710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3e9984f0-5176-4acb-aed4-7e36df9ae0a1 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:05.337942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e9984f0-5176-4acb-aed4-7e36df9ae0a1 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.338438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e9984f0-5176-4acb-aed4-7e36df9ae0a1 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.338897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e9984f0-5176-4acb-aed4-7e36df9ae0a1 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.339592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e9984f0-5176-4acb-aed4-7e36df9ae0a1 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.340042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e9984f0-5176-4acb-aed4-7e36df9ae0a1 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.340716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e9984f0-5176-4acb-aed4-7e36df9ae0a1 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.343370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1a9b81a7-b7c1-4c61-815f-32fb501b2368 req-a33b425d-7be1-45d0-8760-402216f7dc4a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.344114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1a9b81a7-b7c1-4c61-815f-32fb501b2368 req-a33b425d-7be1-45d0-8760-402216f7dc4a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.344862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1a9b81a7-b7c1-4c61-815f-32fb501b2368 req-a33b425d-7be1-45d0-8760-402216f7dc4a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.359220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1a9b81a7-b7c1-4c61-815f-32fb501b2368 req-a33b425d-7be1-45d0-8760-402216f7dc4a service nova] Creating event network-vif-plugged:1c5eacd7-fba5-46ee-b79b-51ac38302947 for instance f2742468-e532-49c8-8797-5f3572f6786f on n-h2-860864-3 Oct 11 19:56:05.369452 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1a9b81a7-b7c1-4c61-815f-32fb501b2368 req-a33b425d-7be1-45d0-8760-402216f7dc4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044295 Oct 11 19:56:05.387778 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1624/3294] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:05.400057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-79873f70-91b7-4c6a-8989-1d578461cbe5 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:05.402579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-79873f70-91b7-4c6a-8989-1d578461cbe5 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:05.434138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79873f70-91b7-4c6a-8989-1d578461cbe5 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.436114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79873f70-91b7-4c6a-8989-1d578461cbe5 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.437099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79873f70-91b7-4c6a-8989-1d578461cbe5 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.438899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79873f70-91b7-4c6a-8989-1d578461cbe5 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.439440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79873f70-91b7-4c6a-8989-1d578461cbe5 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.439941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79873f70-91b7-4c6a-8989-1d578461cbe5 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.490713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3e9984f0-5176-4acb-aed4-7e36df9ae0a1 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:05.497154 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-79873f70-91b7-4c6a-8989-1d578461cbe5 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.107667 Oct 11 19:56:05.498096 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1625/3295] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:56:05 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments => generated 371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:05.507465 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3e9984f0-5176-4acb-aed4-7e36df9ae0a1 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1237 microversion: 2.1 time: 0.180131 Oct 11 19:56:05.507667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:05.508173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 7b9aeb85-447c-419f-9b63-c85927a11e8c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:05.508989 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1671/3296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:05 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1237 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:05.527888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.528384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.528838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.529360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bc0ed6b0-e2de-4c62-bfc7-d62a02fe3637 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:05.529529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.530310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bc0ed6b0-e2de-4c62-bfc7-d62a02fe3637 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:05.534891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.535575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.544645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc0ed6b0-e2de-4c62-bfc7-d62a02fe3637 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.545860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc0ed6b0-e2de-4c62-bfc7-d62a02fe3637 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.546612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc0ed6b0-e2de-4c62-bfc7-d62a02fe3637 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.547718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc0ed6b0-e2de-4c62-bfc7-d62a02fe3637 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.548368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc0ed6b0-e2de-4c62-bfc7-d62a02fe3637 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.549496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc0ed6b0-e2de-4c62-bfc7-d62a02fe3637 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.571664 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] HTTP exception thrown: Instance 7b9aeb85-447c-419f-9b63-c85927a11e8c could not be found. Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Request method failure captured: Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c HTTP/1.1 Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnCirbaxZ7xN_z6Lb4UZ-palqVBtXWVdW6rgdMw9nnLaFjHxoGuVl2wo8KZqT87XD0Qkuwhd2XiJ3D0dQuUu_KeBROxr4jkCM3NAJx6eiW50lYTJlSORTHdGV0r28WPp5EKzH900BwzdY1Oc6CNdtcQqeCtQmZzfZc57P3VUpiR1Ro Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 72d58f28f49447e298dbb540406db442 Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersAdminTestJSON-1522826495 Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72d58f28f49447e298dbb540406db442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72d58f28f49447e298dbb540406db442", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72d58f28f49447e298dbb540406db442"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72d58f28f49447e298dbb540406db442"}]}] Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersAdminTestJSON-1522826495 Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 72d58f28f49447e298dbb540406db442 Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersAdminTestJSON-1522826495 Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersAdminTestJSON-1522826495-project Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bcf8064e6fb843b782f0d89718f1c8e5 Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersAdminTestJSON-1522826495-project Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 7b9aeb85-447c-419f-9b63-c85927a11e8c could not be found. Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '7b9aeb85-447c-419f-9b63-c85927a11e8c'} Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9aeb85-447c-419f-9b63-c85927a11e8c could not be found. Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9aeb85-447c-419f-9b63-c85927a11e8c could not be found. Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:05.573717 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.580085 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:05.580085 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:05.580085 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:05.580085 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:56:05.580085 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:56:05.580085 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9aeb85-447c-419f-9b63-c85927a11e8c could not be found. Oct 11 19:56:05.580085 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:05.580085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Returning 404 to user: Instance 7b9aeb85-447c-419f-9b63-c85927a11e8c could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:56:05.580085 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f206700d-d99a-43ca-a088-fe4a3e212581 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c" status: 404 len: 111 microversion: 2.1 time: 0.079416 Oct 11 19:56:05.589846 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1626/3297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:05 2022] GET /compute/v2.1/servers/7b9aeb85-447c-419f-9b63-c85927a11e8c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:56:05.594868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-74e71802-61bf-4372-8167-a2f41720ba7b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:05.595542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-74e71802-61bf-4372-8167-a2f41720ba7b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:05.604608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e71802-61bf-4372-8167-a2f41720ba7b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.607625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e71802-61bf-4372-8167-a2f41720ba7b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.608335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e71802-61bf-4372-8167-a2f41720ba7b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.610089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e71802-61bf-4372-8167-a2f41720ba7b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.611002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e71802-61bf-4372-8167-a2f41720ba7b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.611665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e71802-61bf-4372-8167-a2f41720ba7b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.659963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-74e71802-61bf-4372-8167-a2f41720ba7b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:56:05.814854 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-74e71802-61bf-4372-8167-a2f41720ba7b tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "DELETE /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 204 len: 0 microversion: 2.1 time: 0.223182 Oct 11 19:56:05.818860 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1627/3298] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:56:05 2022] DELETE /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:56:05.829474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f73cd72b-3d79-4402-96a7-1870d5e59d81 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:05.830072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f73cd72b-3d79-4402-96a7-1870d5e59d81 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:05.836754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73cd72b-3d79-4402-96a7-1870d5e59d81 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.837418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73cd72b-3d79-4402-96a7-1870d5e59d81 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.837871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73cd72b-3d79-4402-96a7-1870d5e59d81 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.838626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73cd72b-3d79-4402-96a7-1870d5e59d81 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.839090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73cd72b-3d79-4402-96a7-1870d5e59d81 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.839574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73cd72b-3d79-4402-96a7-1870d5e59d81 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.875885 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f73cd72b-3d79-4402-96a7-1870d5e59d81 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments/43afbbd5-4d8e-456b-b470-51d540c2c5e3" status: 200 len: 194 microversion: 2.1 time: 0.050873 Oct 11 19:56:05.883700 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1628/3299] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Oct 11 19:56:05 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments/43afbbd5-4d8e-456b-b470-51d540c2c5e3 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:05.890658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5e685b2-6aff-413a-a680-4a7efc55fe5a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:05.891711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e5e685b2-6aff-413a-a680-4a7efc55fe5a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:05.898904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5e685b2-6aff-413a-a680-4a7efc55fe5a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.899740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5e685b2-6aff-413a-a680-4a7efc55fe5a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.900377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5e685b2-6aff-413a-a680-4a7efc55fe5a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:05.901302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5e685b2-6aff-413a-a680-4a7efc55fe5a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:05.901956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5e685b2-6aff-413a-a680-4a7efc55fe5a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:05.902602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5e685b2-6aff-413a-a680-4a7efc55fe5a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:06.453625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc0ed6b0-e2de-4c62-bfc7-d62a02fe3637 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:06.477226 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bc0ed6b0-e2de-4c62-bfc7-d62a02fe3637 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.963457 Oct 11 19:56:06.501384 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1672/3300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:05 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:06.515262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0ecc20e-6bfd-4024-bbd7-ddaad31cc84d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:06.516080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d0ecc20e-6bfd-4024-bbd7-ddaad31cc84d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:06.538899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0ecc20e-6bfd-4024-bbd7-ddaad31cc84d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:06.539441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0ecc20e-6bfd-4024-bbd7-ddaad31cc84d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:06.539930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0ecc20e-6bfd-4024-bbd7-ddaad31cc84d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:06.541258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0ecc20e-6bfd-4024-bbd7-ddaad31cc84d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:06.541735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0ecc20e-6bfd-4024-bbd7-ddaad31cc84d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:06.542180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0ecc20e-6bfd-4024-bbd7-ddaad31cc84d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:06.549766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e5e685b2-6aff-413a-a680-4a7efc55fe5a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:06.560250 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e5e685b2-6aff-413a-a680-4a7efc55fe5a tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1469 microversion: 2.1 time: 0.673630 Oct 11 19:56:06.560853 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1629/3301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:05 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1469 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:06.581040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1f29d6c9-0952-48d3-b9b1-5a251df09fc2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:06.582028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f29d6c9-0952-48d3-b9b1-5a251df09fc2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:06.593349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f29d6c9-0952-48d3-b9b1-5a251df09fc2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:06.595593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f29d6c9-0952-48d3-b9b1-5a251df09fc2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:06.596176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f29d6c9-0952-48d3-b9b1-5a251df09fc2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:06.597102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f29d6c9-0952-48d3-b9b1-5a251df09fc2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:06.599383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f29d6c9-0952-48d3-b9b1-5a251df09fc2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:06.599941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f29d6c9-0952-48d3-b9b1-5a251df09fc2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:06.759745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-d0ecc20e-6bfd-4024-bbd7-ddaad31cc84d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lazy-loading 'services' on Instance uuid 985ba888-5655-480f-8d6b-f39d4a4065fa {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:56:06.919429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1f29d6c9-0952-48d3-b9b1-5a251df09fc2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:06.935660 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1f29d6c9-0952-48d3-b9b1-5a251df09fc2 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1316 microversion: 2.1 time: 0.368888 Oct 11 19:56:06.936961 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1630/3302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:06 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:06.948592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a250ac30-c22a-4988-8422-8aaca429569f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:06.950459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a250ac30-c22a-4988-8422-8aaca429569f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:06.953683 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0ecc20e-6bfd-4024-bbd7-ddaad31cc84d tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "DELETE /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments/43afbbd5-4d8e-456b-b470-51d540c2c5e3" status: 202 len: 0 microversion: 2.1 time: 0.450018 Oct 11 19:56:06.955765 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1673/3303] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 19:56:06 2022] DELETE /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments/43afbbd5-4d8e-456b-b470-51d540c2c5e3 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:56:06.971552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a250ac30-c22a-4988-8422-8aaca429569f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:06.973672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a250ac30-c22a-4988-8422-8aaca429569f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:06.977348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a250ac30-c22a-4988-8422-8aaca429569f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:06.978126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3f95e3a6-bbce-4003-8e6d-1b60cc6633cb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:06.979051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3f95e3a6-bbce-4003-8e6d-1b60cc6633cb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:06.981493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a250ac30-c22a-4988-8422-8aaca429569f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:06.982334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a250ac30-c22a-4988-8422-8aaca429569f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:06.984042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a250ac30-c22a-4988-8422-8aaca429569f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:07.003959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f95e3a6-bbce-4003-8e6d-1b60cc6633cb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:07.004457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f95e3a6-bbce-4003-8e6d-1b60cc6633cb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:07.004899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f95e3a6-bbce-4003-8e6d-1b60cc6633cb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:07.019209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f95e3a6-bbce-4003-8e6d-1b60cc6633cb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:07.027590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f95e3a6-bbce-4003-8e6d-1b60cc6633cb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:07.029653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f95e3a6-bbce-4003-8e6d-1b60cc6633cb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:07.463712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3f95e3a6-bbce-4003-8e6d-1b60cc6633cb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:07.473694 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3f95e3a6-bbce-4003-8e6d-1b60cc6633cb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.516404 Oct 11 19:56:07.504261 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1674/3304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:06 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:07.517114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-30fbc8a2-5d22-4252-bbd5-96d65b4ce1e6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:07.522227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-30fbc8a2-5d22-4252-bbd5-96d65b4ce1e6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:07.547854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30fbc8a2-5d22-4252-bbd5-96d65b4ce1e6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:07.550159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30fbc8a2-5d22-4252-bbd5-96d65b4ce1e6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:07.550767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30fbc8a2-5d22-4252-bbd5-96d65b4ce1e6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:07.551610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30fbc8a2-5d22-4252-bbd5-96d65b4ce1e6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:07.552194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30fbc8a2-5d22-4252-bbd5-96d65b4ce1e6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:07.552932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-30fbc8a2-5d22-4252-bbd5-96d65b4ce1e6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:07.589673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a250ac30-c22a-4988-8422-8aaca429569f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:07.599470 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a250ac30-c22a-4988-8422-8aaca429569f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1371 microversion: 2.1 time: 0.660719 Oct 11 19:56:07.622985 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1631/3305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:06 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1371 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:07.628402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b181ceb9-c77b-4b66-9d4e-104da328ff6d req-1080cc5f-ffb1-44b1-b92a-53f61fa0c188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4b045-264a-41c3-b8e8-5a038c485877", "name": "network-vif-plugged", "status": "completed", "tag": "8c56ce9b-8903-45a8-b9a9-f1cca5c18f44"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:07.649682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b181ceb9-c77b-4b66-9d4e-104da328ff6d req-1080cc5f-ffb1-44b1-b92a-53f61fa0c188 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:07.656441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b181ceb9-c77b-4b66-9d4e-104da328ff6d req-1080cc5f-ffb1-44b1-b92a-53f61fa0c188 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:07.657144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b181ceb9-c77b-4b66-9d4e-104da328ff6d req-1080cc5f-ffb1-44b1-b92a-53f61fa0c188 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:07.691111 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b181ceb9-c77b-4b66-9d4e-104da328ff6d req-1080cc5f-ffb1-44b1-b92a-53f61fa0c188 service nova] Creating event network-vif-plugged:8c56ce9b-8903-45a8-b9a9-f1cca5c18f44 for instance e1c4b045-264a-41c3-b8e8-5a038c485877 on n-h2-860864-3 Oct 11 19:56:07.697987 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b181ceb9-c77b-4b66-9d4e-104da328ff6d req-1080cc5f-ffb1-44b1-b92a-53f61fa0c188 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073459 Oct 11 19:56:07.700586 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1632/3306] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:07.708811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0b38701-dfad-41e4-8920-4520fff0c6c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:07.730926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e0b38701-dfad-41e4-8920-4520fff0c6c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: d3f57104-ae16-42d5-af45-cde420d8d4a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:07.753404 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e0b38701-dfad-41e4-8920-4520fff0c6c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance d3f57104-ae16-42d5-af45-cde420d8d4a8 could not be found. Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0b38701-dfad-41e4-8920-4520fff0c6c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/d3f57104-ae16-42d5-af45-cde420d8d4a8/action HTTP/1.1 Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 14 Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: {"shelve": {}} Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance d3f57104-ae16-42d5-af45-cde420d8d4a8 could not be found. Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'd3f57104-ae16-42d5-af45-cde420d8d4a8', 'body': {'shelve': {}}} Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3f57104-ae16-42d5-af45-cde420d8d4a8 could not be found. Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3f57104-ae16-42d5-af45-cde420d8d4a8 could not be found. Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:07.769007 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:07.774208 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:56:07.774208 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:56:07.774208 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3f57104-ae16-42d5-af45-cde420d8d4a8 could not be found. Oct 11 19:56:07.774208 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:07.778262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0b38701-dfad-41e4-8920-4520fff0c6c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance d3f57104-ae16-42d5-af45-cde420d8d4a8 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:56:07.781561 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e0b38701-dfad-41e4-8920-4520fff0c6c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/d3f57104-ae16-42d5-af45-cde420d8d4a8/action" status: 404 len: 111 microversion: 2.1 time: 0.079671 Oct 11 19:56:07.788952 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1633/3307] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:56:07 2022] POST /compute/v2.1/servers/d3f57104-ae16-42d5-af45-cde420d8d4a8/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:56:07.820124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d8975129-1eb4-4364-bb53-efb966dd88af tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:07.826075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d8975129-1eb4-4364-bb53-efb966dd88af tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:07.855010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8975129-1eb4-4364-bb53-efb966dd88af tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:07.855856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8975129-1eb4-4364-bb53-efb966dd88af tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:07.856481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8975129-1eb4-4364-bb53-efb966dd88af tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:07.859726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8975129-1eb4-4364-bb53-efb966dd88af tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:07.860408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8975129-1eb4-4364-bb53-efb966dd88af tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:07.861185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8975129-1eb4-4364-bb53-efb966dd88af tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:08.081569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-30fbc8a2-5d22-4252-bbd5-96d65b4ce1e6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:08.091219 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-30fbc8a2-5d22-4252-bbd5-96d65b4ce1e6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1305 microversion: 2.1 time: 0.580973 Oct 11 19:56:08.092063 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1675/3308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:07 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1305 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:08.097811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c2f19b9-8099-4f60-947a-99b0ae2a05a3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:08.108624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6c2f19b9-8099-4f60-947a-99b0ae2a05a3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:08.125759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2f19b9-8099-4f60-947a-99b0ae2a05a3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:08.126732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2f19b9-8099-4f60-947a-99b0ae2a05a3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:08.145532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2f19b9-8099-4f60-947a-99b0ae2a05a3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:08.149554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2f19b9-8099-4f60-947a-99b0ae2a05a3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:08.152614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2f19b9-8099-4f60-947a-99b0ae2a05a3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:08.154438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c2f19b9-8099-4f60-947a-99b0ae2a05a3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:08.195090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d8975129-1eb4-4364-bb53-efb966dd88af tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:08.213190 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d8975129-1eb4-4364-bb53-efb966dd88af tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1469 microversion: 2.1 time: 0.420606 Oct 11 19:56:08.238652 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1634/3309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:07 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1469 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:08.238652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-83c7fe94-3762-4133-a26e-12081f25e0e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:08.238652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-83c7fe94-3762-4133-a26e-12081f25e0e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:08.252801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83c7fe94-3762-4133-a26e-12081f25e0e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:08.253425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83c7fe94-3762-4133-a26e-12081f25e0e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:08.254934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83c7fe94-3762-4133-a26e-12081f25e0e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:08.258444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83c7fe94-3762-4133-a26e-12081f25e0e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:08.259258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83c7fe94-3762-4133-a26e-12081f25e0e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:08.259928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83c7fe94-3762-4133-a26e-12081f25e0e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:08.611634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6c2f19b9-8099-4f60-947a-99b0ae2a05a3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:08.614110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-83c7fe94-3762-4133-a26e-12081f25e0e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:08.623026 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-83c7fe94-3762-4133-a26e-12081f25e0e6 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1465 microversion: 2.1 time: 0.396494 Oct 11 19:56:08.625180 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1635/3310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:08 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1465 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:08.627451 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6c2f19b9-8099-4f60-947a-99b0ae2a05a3 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.534063 Oct 11 19:56:08.630228 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1676/3311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:08 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:08.631350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5580d838-fe19-4239-83b4-896802598889 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:08.632199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5580d838-fe19-4239-83b4-896802598889 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:08.651087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1182964708", "metadata": {"image_type": "test"}}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:08.652442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5580d838-fe19-4239-83b4-896802598889 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:08.654215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5580d838-fe19-4239-83b4-896802598889 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:08.654696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5580d838-fe19-4239-83b4-896802598889 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:08.655438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5580d838-fe19-4239-83b4-896802598889 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:08.656060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5580d838-fe19-4239-83b4-896802598889 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:08.656749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5580d838-fe19-4239-83b4-896802598889 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:08.659942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:08.669210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:08.672781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:08.676002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:08.678895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:08.687454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:08.689630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:08.756883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Getting quotas for project 6c55a426691c4e53ab0e77715dd251a2. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:56:08.778863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Getting quotas for user 35e16fd8c73b4d609b7f4cad18389978 and project 6c55a426691c4e53ab0e77715dd251a2. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:56:09.188834 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-72a5c77f-f424-4081-a9d0-57082b5d926c tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "POST /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f/action" status: 202 len: 0 microversion: 2.1 time: 0.541960 Oct 11 19:56:09.197774 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1677/3312] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:56:08 2022] POST /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 11 19:56:09.212068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0069861a-2d52-415e-a493-28b5e941e829 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:09.213282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0069861a-2d52-415e-a493-28b5e941e829 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:09.217789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5580d838-fe19-4239-83b4-896802598889 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:09.228376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0069861a-2d52-415e-a493-28b5e941e829 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:09.230330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0069861a-2d52-415e-a493-28b5e941e829 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:09.232413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0069861a-2d52-415e-a493-28b5e941e829 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:09.232627 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5580d838-fe19-4239-83b4-896802598889 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1371 microversion: 2.1 time: 0.602427 Oct 11 19:56:09.233435 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1636/3313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:08 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1371 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:09.233906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0069861a-2d52-415e-a493-28b5e941e829 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:09.235802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0069861a-2d52-415e-a493-28b5e941e829 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:09.237487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0069861a-2d52-415e-a493-28b5e941e829 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:09.256909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f0cac0c0-9fb8-4cd5-8c00-cdfd355abb62 req-e02edd96-78b4-4b1b-85d7-fff247e1f9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541d55b8-ac01-4eed-8531-8a8dc44cd7cb", "name": "network-vif-deleted", "tag": "d41bd563-4b89-4927-851e-d420f9109e99"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:09.306738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:09.311495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:09.316306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0cac0c0-9fb8-4cd5-8c00-cdfd355abb62 req-e02edd96-78b4-4b1b-85d7-fff247e1f9a6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:09.327780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0cac0c0-9fb8-4cd5-8c00-cdfd355abb62 req-e02edd96-78b4-4b1b-85d7-fff247e1f9a6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:09.330799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f0cac0c0-9fb8-4cd5-8c00-cdfd355abb62 req-e02edd96-78b4-4b1b-85d7-fff247e1f9a6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:09.331132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:09.382077 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f0cac0c0-9fb8-4cd5-8c00-cdfd355abb62 req-e02edd96-78b4-4b1b-85d7-fff247e1f9a6 service nova] Creating event network-vif-deleted:d41bd563-4b89-4927-851e-d420f9109e99 for instance 541d55b8-ac01-4eed-8531-8a8dc44cd7cb on n-h1-860864-3 Oct 11 19:56:09.406332 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f0cac0c0-9fb8-4cd5-8c00-cdfd355abb62 req-e02edd96-78b4-4b1b-85d7-fff247e1f9a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170268 Oct 11 19:56:09.412408 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1637/3314] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:09.424838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-de12af7f-087b-4cc4-9cb5-62944a2321f9 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:09.437815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-de12af7f-087b-4cc4-9cb5-62944a2321f9 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:09.453915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de12af7f-087b-4cc4-9cb5-62944a2321f9 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:09.455839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de12af7f-087b-4cc4-9cb5-62944a2321f9 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:09.455839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de12af7f-087b-4cc4-9cb5-62944a2321f9 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:09.456893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de12af7f-087b-4cc4-9cb5-62944a2321f9 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:09.459091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de12af7f-087b-4cc4-9cb5-62944a2321f9 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:09.460127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de12af7f-087b-4cc4-9cb5-62944a2321f9 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:09.926478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0069861a-2d52-415e-a493-28b5e941e829 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:09.937563 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0069861a-2d52-415e-a493-28b5e941e829 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.733901 Oct 11 19:56:09.941127 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1678/3315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:09 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:09.947720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-de12af7f-087b-4cc4-9cb5-62944a2321f9 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:09.956393 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-de12af7f-087b-4cc4-9cb5-62944a2321f9 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1305 microversion: 2.1 time: 0.542693 Oct 11 19:56:09.964234 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1638/3316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:09 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1305 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:09.969189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:09.969846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a471789-1f8c-4d46-bcbc-8cc2417b6b78 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83cc2c3dc0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:09.971225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:10.009773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.010422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.011000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.012034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.014296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.014993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.062620 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a471789-1f8c-4d46-bcbc-8cc2417b6b78 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 200 len: 1424 microversion: 2.1 time: 0.105897 Oct 11 19:56:10.065727 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1679/3317] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:09 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 1424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:10.075594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:10.078988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-73e99e27-cb0b-4795-8cf5-9b4f856a834b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:10.080639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-73e99e27-cb0b-4795-8cf5-9b4f856a834b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:10.095436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e99e27-cb0b-4795-8cf5-9b4f856a834b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.096246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e99e27-cb0b-4795-8cf5-9b4f856a834b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.097145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e99e27-cb0b-4795-8cf5-9b4f856a834b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.098475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e99e27-cb0b-4795-8cf5-9b4f856a834b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.099923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e99e27-cb0b-4795-8cf5-9b4f856a834b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.101008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e99e27-cb0b-4795-8cf5-9b4f856a834b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.107399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:10.123534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.142831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.144117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.144621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lazy-loading 'fault' on Instance uuid 541d55b8-ac01-4eed-8531-8a8dc44cd7cb {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:56:10.146884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:10.153060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-73e99e27-cb0b-4795-8cf5-9b4f856a834b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lazy-loading 'flavor' on Instance uuid 85f1dc40-ef33-40f8-b128-d5c6367e833e {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:56:10.273308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:10.281258 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e9c07a0f-f288-4031-b32b-57021b8c55a2 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 200 len: 1304 microversion: 2.1 time: 0.315715 Oct 11 19:56:10.288445 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1639/3318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:09 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 1304 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:10.294351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9779ea12-e57c-4fa4-a618-1e8c0af65f47 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:10.297121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9779ea12-e57c-4fa4-a618-1e8c0af65f47 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:10.312413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9779ea12-e57c-4fa4-a618-1e8c0af65f47 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.313872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9779ea12-e57c-4fa4-a618-1e8c0af65f47 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.315081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9779ea12-e57c-4fa4-a618-1e8c0af65f47 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.317119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9779ea12-e57c-4fa4-a618-1e8c0af65f47 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.319105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9779ea12-e57c-4fa4-a618-1e8c0af65f47 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.322131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9779ea12-e57c-4fa4-a618-1e8c0af65f47 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.559887 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-73e99e27-cb0b-4795-8cf5-9b4f856a834b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 202 len: 0 microversion: 2.1 time: 0.492855 Oct 11 19:56:10.560568 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1680/3319] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:56:10 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:56:10.590268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c61ce489-b92e-403e-809a-3a78339acadc req-57181536-b34d-4316-ae9f-39cfd7c9cbdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0795791f-2f7c-418b-8c82-7f1bfb623e93", "tag": "22ee4a7b-aafc-48ad-8a2b-8316827168cb"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:10.639124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c61ce489-b92e-403e-809a-3a78339acadc req-57181536-b34d-4316-ae9f-39cfd7c9cbdb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.642319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c61ce489-b92e-403e-809a-3a78339acadc req-57181536-b34d-4316-ae9f-39cfd7c9cbdb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.648915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c61ce489-b92e-403e-809a-3a78339acadc req-57181536-b34d-4316-ae9f-39cfd7c9cbdb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.674806 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c61ce489-b92e-403e-809a-3a78339acadc req-57181536-b34d-4316-ae9f-39cfd7c9cbdb service nova] Creating event network-changed:22ee4a7b-aafc-48ad-8a2b-8316827168cb for instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 on n-h1-860864-3 Oct 11 19:56:10.702003 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c61ce489-b92e-403e-809a-3a78339acadc req-57181536-b34d-4316-ae9f-39cfd7c9cbdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121649 Oct 11 19:56:10.703754 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1681/3320] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:10.724081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7630122-f352-481d-aea2-bf974a55e9f0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:10.725114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7630122-f352-481d-aea2-bf974a55e9f0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:10.750020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7630122-f352-481d-aea2-bf974a55e9f0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.751079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7630122-f352-481d-aea2-bf974a55e9f0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.751676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7630122-f352-481d-aea2-bf974a55e9f0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.752544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7630122-f352-481d-aea2-bf974a55e9f0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.753193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7630122-f352-481d-aea2-bf974a55e9f0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.758276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7630122-f352-481d-aea2-bf974a55e9f0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.759973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9779ea12-e57c-4fa4-a618-1e8c0af65f47 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:10.779833 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9779ea12-e57c-4fa4-a618-1e8c0af65f47 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1565 microversion: 2.1 time: 0.489147 Oct 11 19:56:10.780590 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1640/3321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:10 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1565 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:10.812379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-acdf26f5-7c31-4630-80e2-764a63c07d28 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:10.814977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-acdf26f5-7c31-4630-80e2-764a63c07d28 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:10.835954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acdf26f5-7c31-4630-80e2-764a63c07d28 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.836464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acdf26f5-7c31-4630-80e2-764a63c07d28 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.839772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acdf26f5-7c31-4630-80e2-764a63c07d28 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:10.840732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acdf26f5-7c31-4630-80e2-764a63c07d28 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:10.841438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acdf26f5-7c31-4630-80e2-764a63c07d28 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:10.842048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acdf26f5-7c31-4630-80e2-764a63c07d28 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:11.050194 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-acdf26f5-7c31-4630-80e2-764a63c07d28 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.242529 Oct 11 19:56:11.059887 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1641/3322] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:56:10 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-interface => generated 284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:56:11.073831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6eed9a1f-78c3-4d2b-862f-5340d762df9a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:11.075558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6eed9a1f-78c3-4d2b-862f-5340d762df9a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:11.091334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eed9a1f-78c3-4d2b-862f-5340d762df9a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:11.099783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eed9a1f-78c3-4d2b-862f-5340d762df9a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:11.100514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eed9a1f-78c3-4d2b-862f-5340d762df9a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:11.101563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eed9a1f-78c3-4d2b-862f-5340d762df9a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:11.102194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eed9a1f-78c3-4d2b-862f-5340d762df9a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:11.102839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eed9a1f-78c3-4d2b-862f-5340d762df9a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:11.550199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b7630122-f352-481d-aea2-bf974a55e9f0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:11.571396 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7630122-f352-481d-aea2-bf974a55e9f0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 0.864940 Oct 11 19:56:11.572699 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1682/3323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:10 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:11.578402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c78cfb78-c648-4545-9979-bf72a149c0ea tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c72e0310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:11.694218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6eed9a1f-78c3-4d2b-862f-5340d762df9a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:11.703624 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c78cfb78-c648-4545-9979-bf72a149c0ea tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 200 len: 1424 microversion: 2.1 time: 0.128686 Oct 11 19:56:11.705655 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1683/3324] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:11 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:11.705970 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6eed9a1f-78c3-4d2b-862f-5340d762df9a tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1305 microversion: 2.1 time: 0.642030 Oct 11 19:56:11.711608 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1642/3325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:11 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1305 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:11.717940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:11.718823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 541d55b8-ac01-4eed-8531-8a8dc44cd7cb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:11.732167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:11.735134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:11.735708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:11.736586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:11.738773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:11.739333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:11.773702 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] HTTP exception thrown: Instance 541d55b8-ac01-4eed-8531-8a8dc44cd7cb could not be found. Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Request method failure captured: Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb HTTP/1.1 Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnCirbaxZ7xN_z6Lb4UZ-palqVBtXWVdW6rgdMw9nnLaFjHxoGuVl2wo8KZqT87XD0Qkuwhd2XiJ3D0dQuUu_KeBROxr4jkCM3NAJx6eiW50lYTJlSORTHdGV0r28WPp5EKzH900BwzdY1Oc6CNdtcQqeCtQmZzfZc57P3VUpiR1Ro Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 72d58f28f49447e298dbb540406db442 Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAdminTestJSON-1522826495 Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72d58f28f49447e298dbb540406db442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72d58f28f49447e298dbb540406db442", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72d58f28f49447e298dbb540406db442"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72d58f28f49447e298dbb540406db442"}]}] Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAdminTestJSON-1522826495 Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 72d58f28f49447e298dbb540406db442 Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAdminTestJSON-1522826495 Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAdminTestJSON-1522826495-project Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bcf8064e6fb843b782f0d89718f1c8e5 Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAdminTestJSON-1522826495-project Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 541d55b8-ac01-4eed-8531-8a8dc44cd7cb could not be found. Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '541d55b8-ac01-4eed-8531-8a8dc44cd7cb'} Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541d55b8-ac01-4eed-8531-8a8dc44cd7cb could not be found. Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541d55b8-ac01-4eed-8531-8a8dc44cd7cb could not be found. Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:11.780715 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:11.785718 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:11.785718 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:11.785718 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:11.785718 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:56:11.785718 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:56:11.785718 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541d55b8-ac01-4eed-8531-8a8dc44cd7cb could not be found. Oct 11 19:56:11.785718 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:11.786302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Returning 404 to user: Instance 541d55b8-ac01-4eed-8531-8a8dc44cd7cb could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:56:11.787494 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1e50bd8a-95ac-4bb9-93ec-2e5e53367ef8 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb" status: 404 len: 111 microversion: 2.1 time: 0.079812 Oct 11 19:56:11.788375 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1684/3326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:11 2022] GET /compute/v2.1/servers/541d55b8-ac01-4eed-8531-8a8dc44cd7cb => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:56:11.796790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d023c429-4fe6-4891-8c99-ab12a9005552 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:11.797584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d023c429-4fe6-4891-8c99-ab12a9005552 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:11.806468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d023c429-4fe6-4891-8c99-ab12a9005552 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:11.810562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d023c429-4fe6-4891-8c99-ab12a9005552 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:11.811039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d023c429-4fe6-4891-8c99-ab12a9005552 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:11.811785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d023c429-4fe6-4891-8c99-ab12a9005552 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:11.812353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d023c429-4fe6-4891-8c99-ab12a9005552 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:11.812790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d023c429-4fe6-4891-8c99-ab12a9005552 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:11.867910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d023c429-4fe6-4891-8c99-ab12a9005552 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:56:12.072931 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d023c429-4fe6-4891-8c99-ab12a9005552 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "DELETE /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 204 len: 0 microversion: 2.1 time: 0.277694 Oct 11 19:56:12.079027 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1643/3327] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:56:11 2022] DELETE /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:56:12.083222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a04bb62f-792c-462f-9962-0f4e158227e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:12.086003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a04bb62f-792c-462f-9962-0f4e158227e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:12.095907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a04bb62f-792c-462f-9962-0f4e158227e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:12.096411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a04bb62f-792c-462f-9962-0f4e158227e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:12.096862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a04bb62f-792c-462f-9962-0f4e158227e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:12.097596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a04bb62f-792c-462f-9962-0f4e158227e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:12.098045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a04bb62f-792c-462f-9962-0f4e158227e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:12.098517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a04bb62f-792c-462f-9962-0f4e158227e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:12.400777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a04bb62f-792c-462f-9962-0f4e158227e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:12.412124 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a04bb62f-792c-462f-9962-0f4e158227e5 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1468 microversion: 2.1 time: 0.332214 Oct 11 19:56:12.426561 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1685/3328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:12 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:12.614779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d0f839cd-1c08-49cc-bc4c-8167aa787388 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:12.614779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d0f839cd-1c08-49cc-bc4c-8167aa787388 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:12.620166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0f839cd-1c08-49cc-bc4c-8167aa787388 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:12.620676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0f839cd-1c08-49cc-bc4c-8167aa787388 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:12.621124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0f839cd-1c08-49cc-bc4c-8167aa787388 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:12.621871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0f839cd-1c08-49cc-bc4c-8167aa787388 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:12.635520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0f839cd-1c08-49cc-bc4c-8167aa787388 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:12.636007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0f839cd-1c08-49cc-bc4c-8167aa787388 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:12.727336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93c2226d-9c01-4f04-b122-cbf7cbf61a40 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c74b54c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:14.203703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d0f839cd-1c08-49cc-bc4c-8167aa787388 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:14.216662 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d0f839cd-1c08-49cc-bc4c-8167aa787388 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 1.621850 Oct 11 19:56:14.219225 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1644/3329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:12 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:14.230991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ceaf83b2-9940-4c97-a910-7863cc322063 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:14.231981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ceaf83b2-9940-4c97-a910-7863cc322063 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:14.244279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaf83b2-9940-4c97-a910-7863cc322063 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:14.247277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaf83b2-9940-4c97-a910-7863cc322063 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:14.250728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaf83b2-9940-4c97-a910-7863cc322063 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:14.251733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaf83b2-9940-4c97-a910-7863cc322063 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:14.254269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaf83b2-9940-4c97-a910-7863cc322063 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:14.254992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ceaf83b2-9940-4c97-a910-7863cc322063 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:15.165092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ceaf83b2-9940-4c97-a910-7863cc322063 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:15.183713 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ceaf83b2-9940-4c97-a910-7863cc322063 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1305 microversion: 2.1 time: 0.956353 Oct 11 19:56:15.187902 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1645/3330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:14 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1305 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:15.205762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:15.206300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:15.215897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:15.229195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:15.230514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:15.237106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:15.237833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:15.238801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:15.312179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:15.315030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:15.315517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:15.316183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lazy-loading 'fault' on Instance uuid 045c6ac7-f110-46b6-b43d-dee4dc6a4864 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:56:15.570065 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-93c2226d-9c01-4f04-b122-cbf7cbf61a40 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 200 len: 1424 microversion: 2.1 time: 2.854365 Oct 11 19:56:15.570682 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1686/3331] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:12 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 1424 bytes in 2856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:56:15.593772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-bb0ff78c-c6d7-4ee5-a0fc-f341d4b2be0c req-c6dc1585-3239-4ca5-a585-c889f9bbd704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045c6ac7-f110-46b6-b43d-dee4dc6a4864", "name": "network-vif-deleted", "tag": "870f5751-948d-4669-a1d8-77ea302d7d04"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:15.643965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bb0ff78c-c6d7-4ee5-a0fc-f341d4b2be0c req-c6dc1585-3239-4ca5-a585-c889f9bbd704 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:15.650099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bb0ff78c-c6d7-4ee5-a0fc-f341d4b2be0c req-c6dc1585-3239-4ca5-a585-c889f9bbd704 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:15.657147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bb0ff78c-c6d7-4ee5-a0fc-f341d4b2be0c req-c6dc1585-3239-4ca5-a585-c889f9bbd704 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:15.715433 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bb0ff78c-c6d7-4ee5-a0fc-f341d4b2be0c req-c6dc1585-3239-4ca5-a585-c889f9bbd704 service nova] Creating event network-vif-deleted:870f5751-948d-4669-a1d8-77ea302d7d04 for instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 on n-h1-860864-3 Oct 11 19:56:15.743854 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-bb0ff78c-c6d7-4ee5-a0fc-f341d4b2be0c req-c6dc1585-3239-4ca5-a585-c889f9bbd704 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164816 Oct 11 19:56:15.753348 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1687/3332] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:15.809445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c1c26574-9ecd-4e98-95e5-0a92dc485fe9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:15.817556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1c26574-9ecd-4e98-95e5-0a92dc485fe9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:15.845818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c26574-9ecd-4e98-95e5-0a92dc485fe9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:15.846328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c26574-9ecd-4e98-95e5-0a92dc485fe9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:15.846802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c26574-9ecd-4e98-95e5-0a92dc485fe9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:15.847528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c26574-9ecd-4e98-95e5-0a92dc485fe9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:15.851536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c26574-9ecd-4e98-95e5-0a92dc485fe9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:15.852280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1c26574-9ecd-4e98-95e5-0a92dc485fe9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:15.971025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf8064e6fb843b782f0d89718f1c8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d58f28f49447e298dbb540406db442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:15.983921 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9967661f-3ad9-4cd4-991c-443de974c7cb tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 200 len: 1303 microversion: 2.1 time: 0.794474 Oct 11 19:56:15.998550 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1646/3333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:15 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 1303 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:16.000307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-110ab16f-3606-4d5f-b119-9cd170e1c4d6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:16.009040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-110ab16f-3606-4d5f-b119-9cd170e1c4d6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:16.017761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-110ab16f-3606-4d5f-b119-9cd170e1c4d6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:16.026821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-110ab16f-3606-4d5f-b119-9cd170e1c4d6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:16.027839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-110ab16f-3606-4d5f-b119-9cd170e1c4d6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:16.029318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-110ab16f-3606-4d5f-b119-9cd170e1c4d6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:16.029793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-110ab16f-3606-4d5f-b119-9cd170e1c4d6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:16.030226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-110ab16f-3606-4d5f-b119-9cd170e1c4d6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:16.404658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-110ab16f-3606-4d5f-b119-9cd170e1c4d6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:16.419147 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-110ab16f-3606-4d5f-b119-9cd170e1c4d6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1682 microversion: 2.1 time: 0.428976 Oct 11 19:56:16.420076 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1647/3334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:15 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1682 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:16.427636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-72059e4f-08e6-418e-ac89-2a3c0bb96722 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:16.432730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-72059e4f-08e6-418e-ac89-2a3c0bb96722 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:16.447715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72059e4f-08e6-418e-ac89-2a3c0bb96722 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:16.448770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72059e4f-08e6-418e-ac89-2a3c0bb96722 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:16.449523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72059e4f-08e6-418e-ac89-2a3c0bb96722 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:16.450423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72059e4f-08e6-418e-ac89-2a3c0bb96722 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:16.451070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72059e4f-08e6-418e-ac89-2a3c0bb96722 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:16.451660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72059e4f-08e6-418e-ac89-2a3c0bb96722 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:16.705963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c1c26574-9ecd-4e98-95e5-0a92dc485fe9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:16.719946 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c1c26574-9ecd-4e98-95e5-0a92dc485fe9 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 0.959074 Oct 11 19:56:16.740948 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1688/3335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:15 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:16.756714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c51a9df0-6ef3-4bf3-bc00-4e5aad7d4d93 req-aae0dbe9-3626-4694-bc85-09de07ef7420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2742468-e532-49c8-8797-5f3572f6786f", "name": "network-vif-plugged", "status": "completed", "tag": "1c5eacd7-fba5-46ee-b79b-51ac38302947"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:16.769064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c51a9df0-6ef3-4bf3-bc00-4e5aad7d4d93 req-aae0dbe9-3626-4694-bc85-09de07ef7420 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:16.769533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c51a9df0-6ef3-4bf3-bc00-4e5aad7d4d93 req-aae0dbe9-3626-4694-bc85-09de07ef7420 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:16.773281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c51a9df0-6ef3-4bf3-bc00-4e5aad7d4d93 req-aae0dbe9-3626-4694-bc85-09de07ef7420 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:16.804103 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c51a9df0-6ef3-4bf3-bc00-4e5aad7d4d93 req-aae0dbe9-3626-4694-bc85-09de07ef7420 service nova] Creating event network-vif-plugged:1c5eacd7-fba5-46ee-b79b-51ac38302947 for instance f2742468-e532-49c8-8797-5f3572f6786f on n-h2-860864-3 Oct 11 19:56:16.818172 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c51a9df0-6ef3-4bf3-bc00-4e5aad7d4d93 req-aae0dbe9-3626-4694-bc85-09de07ef7420 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075102 Oct 11 19:56:16.827008 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1689/3336] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:16.833249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-5d75b1b8-7367-4755-8d7e-b4b8adf11007 req-892d7a09-dd1e-49e0-bdbd-915f7ed435ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4b045-264a-41c3-b8e8-5a038c485877", "tag": "8c56ce9b-8903-45a8-b9a9-f1cca5c18f44"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:16.855243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5d75b1b8-7367-4755-8d7e-b4b8adf11007 req-892d7a09-dd1e-49e0-bdbd-915f7ed435ce service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:16.856826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5d75b1b8-7367-4755-8d7e-b4b8adf11007 req-892d7a09-dd1e-49e0-bdbd-915f7ed435ce service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:16.867139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5d75b1b8-7367-4755-8d7e-b4b8adf11007 req-892d7a09-dd1e-49e0-bdbd-915f7ed435ce service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:16.880723 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-5d75b1b8-7367-4755-8d7e-b4b8adf11007 req-892d7a09-dd1e-49e0-bdbd-915f7ed435ce service nova] Creating event network-changed:8c56ce9b-8903-45a8-b9a9-f1cca5c18f44 for instance e1c4b045-264a-41c3-b8e8-5a038c485877 on n-h2-860864-3 Oct 11 19:56:16.896955 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-5d75b1b8-7367-4755-8d7e-b4b8adf11007 req-892d7a09-dd1e-49e0-bdbd-915f7ed435ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065571 Oct 11 19:56:16.898242 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1690/3337] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:16.916716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-26149d3e-16c9-40cf-aab5-0b5e77edcea1 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c75753a0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:16.992593 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-26149d3e-16c9-40cf-aab5-0b5e77edcea1 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 200 len: 1424 microversion: 2.1 time: 0.092906 Oct 11 19:56:16.993639 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1691/3338] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:16 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 1424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:17.015066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:17.018852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] [instance: 045c6ac7-f110-46b6-b43d-dee4dc6a4864] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:17.033855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:17.036949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:17.042516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:17.043523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:17.044232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:17.045476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:17.080090 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] HTTP exception thrown: Instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 could not be found. Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Request method failure captured: Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 HTTP/1.1 Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnCirbaxZ7xN_z6Lb4UZ-palqVBtXWVdW6rgdMw9nnLaFjHxoGuVl2wo8KZqT87XD0Qkuwhd2XiJ3D0dQuUu_KeBROxr4jkCM3NAJx6eiW50lYTJlSORTHdGV0r28WPp5EKzH900BwzdY1Oc6CNdtcQqeCtQmZzfZc57P3VUpiR1Ro Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 72d58f28f49447e298dbb540406db442 Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAdminTestJSON-1522826495 Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72d58f28f49447e298dbb540406db442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72d58f28f49447e298dbb540406db442", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72d58f28f49447e298dbb540406db442"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72d58f28f49447e298dbb540406db442"}]}] Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAdminTestJSON-1522826495 Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 72d58f28f49447e298dbb540406db442 Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAdminTestJSON-1522826495 Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAdminTestJSON-1522826495-project Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bcf8064e6fb843b782f0d89718f1c8e5 Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAdminTestJSON-1522826495-project Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 could not be found. Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '045c6ac7-f110-46b6-b43d-dee4dc6a4864'} Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 could not be found. Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 could not be found. Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:17.082091 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:17.087737 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:17.087737 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:17.087737 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:17.087737 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:56:17.087737 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:56:17.087737 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 could not be found. Oct 11 19:56:17.087737 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:56:17.089752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] Returning 404 to user: Instance 045c6ac7-f110-46b6-b43d-dee4dc6a4864 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:56:17.090976 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5249f3e-12c6-4ce6-a007-e12fdb6c6858 tempest-ServersAdminTestJSON-1522826495 tempest-ServersAdminTestJSON-1522826495-project] 10.222.0.27 "GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864" status: 404 len: 111 microversion: 2.1 time: 0.082727 Oct 11 19:56:17.092026 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1692/3339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:17 2022] GET /compute/v2.1/servers/045c6ac7-f110-46b6-b43d-dee4dc6a4864 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:56:17.447430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2a16066f-d8bd-4766-ad61-c0411765ac8c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:17.448700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2a16066f-d8bd-4766-ad61-c0411765ac8c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:17.475887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a16066f-d8bd-4766-ad61-c0411765ac8c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:17.476553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a16066f-d8bd-4766-ad61-c0411765ac8c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:17.477190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a16066f-d8bd-4766-ad61-c0411765ac8c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:17.478096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a16066f-d8bd-4766-ad61-c0411765ac8c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:17.478764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a16066f-d8bd-4766-ad61-c0411765ac8c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:17.479516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a16066f-d8bd-4766-ad61-c0411765ac8c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:18.261083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-72059e4f-08e6-418e-ac89-2a3c0bb96722 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:18.274252 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-72059e4f-08e6-418e-ac89-2a3c0bb96722 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1305 microversion: 2.1 time: 1.852931 Oct 11 19:56:18.278959 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1648/3340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:16 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1305 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:18.303332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51eac2d9-3366-4ca1-b37c-0add1f20db66 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:18.304627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51eac2d9-3366-4ca1-b37c-0add1f20db66 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:18.314327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51eac2d9-3366-4ca1-b37c-0add1f20db66 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:18.318192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51eac2d9-3366-4ca1-b37c-0add1f20db66 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:18.318582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51eac2d9-3366-4ca1-b37c-0add1f20db66 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:18.319623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51eac2d9-3366-4ca1-b37c-0add1f20db66 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:18.320427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51eac2d9-3366-4ca1-b37c-0add1f20db66 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:18.321011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51eac2d9-3366-4ca1-b37c-0add1f20db66 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:18.380855 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51eac2d9-3366-4ca1-b37c-0add1f20db66 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments/fa6f24c7-60b0-4960-8539-f9f497297379" status: 200 len: 194 microversion: 2.1 time: 0.099591 Oct 11 19:56:18.385006 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1649/3341] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Oct 11 19:56:18 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments/fa6f24c7-60b0-4960-8539-f9f497297379 => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:18.392631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b991a23-fd40-4f22-a416-92d08c197a21 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:18.393980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b991a23-fd40-4f22-a416-92d08c197a21 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:18.403378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b991a23-fd40-4f22-a416-92d08c197a21 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:18.404051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b991a23-fd40-4f22-a416-92d08c197a21 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:18.405804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b991a23-fd40-4f22-a416-92d08c197a21 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:18.406783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b991a23-fd40-4f22-a416-92d08c197a21 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:18.407398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b991a23-fd40-4f22-a416-92d08c197a21 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:18.408004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b991a23-fd40-4f22-a416-92d08c197a21 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:18.824698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2a16066f-d8bd-4766-ad61-c0411765ac8c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:18.846515 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2a16066f-d8bd-4766-ad61-c0411765ac8c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 1.403739 Oct 11 19:56:18.865741 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1693/3342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:17 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:56:18.874207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a3ca5d13-5188-4bd7-b7f1-48e5d7f66ec8 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83cc3659d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:18.950289 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a3ca5d13-5188-4bd7-b7f1-48e5d7f66ec8 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 200 len: 1424 microversion: 2.1 time: 0.083087 Oct 11 19:56:18.952327 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1694/3343] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:18 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:18.961938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f06b6f3-97c0-4f88-87df-3bf691334a78 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:18.963156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0f06b6f3-97c0-4f88-87df-3bf691334a78 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:18.975647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f06b6f3-97c0-4f88-87df-3bf691334a78 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:18.976491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f06b6f3-97c0-4f88-87df-3bf691334a78 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:18.977275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f06b6f3-97c0-4f88-87df-3bf691334a78 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:18.978200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f06b6f3-97c0-4f88-87df-3bf691334a78 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:18.978912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f06b6f3-97c0-4f88-87df-3bf691334a78 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:18.979560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f06b6f3-97c0-4f88-87df-3bf691334a78 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:19.089895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-0f06b6f3-97c0-4f88-87df-3bf691334a78 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lazy-loading 'services' on Instance uuid 985ba888-5655-480f-8d6b-f39d4a4065fa {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:56:19.206055 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f06b6f3-97c0-4f88-87df-3bf691334a78 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "DELETE /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments/fa6f24c7-60b0-4960-8539-f9f497297379" status: 202 len: 0 microversion: 2.1 time: 0.251943 Oct 11 19:56:19.207055 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1695/3344] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 19:56:18 2022] DELETE /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments/fa6f24c7-60b0-4960-8539-f9f497297379 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:56:19.219419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-91816f5e-d18a-47ec-89b1-a983d6779c99 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2070826213"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:19.223569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-91816f5e-d18a-47ec-89b1-a983d6779c99 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:19.243767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91816f5e-d18a-47ec-89b1-a983d6779c99 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:19.245381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91816f5e-d18a-47ec-89b1-a983d6779c99 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:19.246064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91816f5e-d18a-47ec-89b1-a983d6779c99 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:19.247149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91816f5e-d18a-47ec-89b1-a983d6779c99 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:19.247928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91816f5e-d18a-47ec-89b1-a983d6779c99 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:19.248923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91816f5e-d18a-47ec-89b1-a983d6779c99 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:19.522106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b991a23-fd40-4f22-a416-92d08c197a21 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:19.535352 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b991a23-fd40-4f22-a416-92d08c197a21 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 1.148463 Oct 11 19:56:19.536685 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1650/3345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:18 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:19.550337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-68a089f4-3861-4ff1-81af-ecc18923c14c req-98010cd9-2ca7-4672-aaac-ac9de37a6cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee4391-e163-4a76-9151-04adeb0111a8", "name": "network-vif-unplugged", "status": "completed", "tag": "8feec027-3d8b-4b4e-9712-8f57ab9fb853"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:19.571130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-68a089f4-3861-4ff1-81af-ecc18923c14c req-98010cd9-2ca7-4672-aaac-ac9de37a6cf2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:19.573922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-68a089f4-3861-4ff1-81af-ecc18923c14c req-98010cd9-2ca7-4672-aaac-ac9de37a6cf2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:19.574387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-68a089f4-3861-4ff1-81af-ecc18923c14c req-98010cd9-2ca7-4672-aaac-ac9de37a6cf2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:19.596958 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-68a089f4-3861-4ff1-81af-ecc18923c14c req-98010cd9-2ca7-4672-aaac-ac9de37a6cf2 service nova] Creating event network-vif-unplugged:8feec027-3d8b-4b4e-9712-8f57ab9fb853 for instance b7ee4391-e163-4a76-9151-04adeb0111a8 on n-h1-860864-3 Oct 11 19:56:19.608877 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-91816f5e-d18a-47ec-89b1-a983d6779c99 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.395882 Oct 11 19:56:19.610034 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-68a089f4-3861-4ff1-81af-ecc18923c14c req-98010cd9-2ca7-4672-aaac-ac9de37a6cf2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071013 Oct 11 19:56:19.613255 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1696/3347] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:56:19 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 11 19:56:19.613733 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1651/3347] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:19.622579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fdd7ec8f-bedb-499e-8e62-3d7462ca4dcd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:19.623627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fdd7ec8f-bedb-499e-8e62-3d7462ca4dcd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:19.627560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9c770b8-6947-4a66-9289-d5095fec2a57 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:19.628920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f9c770b8-6947-4a66-9289-d5095fec2a57 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:19.633173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdd7ec8f-bedb-499e-8e62-3d7462ca4dcd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:19.634352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdd7ec8f-bedb-499e-8e62-3d7462ca4dcd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:19.637637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdd7ec8f-bedb-499e-8e62-3d7462ca4dcd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:19.637637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdd7ec8f-bedb-499e-8e62-3d7462ca4dcd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:19.637922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdd7ec8f-bedb-499e-8e62-3d7462ca4dcd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:19.638377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdd7ec8f-bedb-499e-8e62-3d7462ca4dcd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:19.648387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9c770b8-6947-4a66-9289-d5095fec2a57 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:19.651893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9c770b8-6947-4a66-9289-d5095fec2a57 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:19.653397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9c770b8-6947-4a66-9289-d5095fec2a57 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:19.655167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9c770b8-6947-4a66-9289-d5095fec2a57 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:19.656250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9c770b8-6947-4a66-9289-d5095fec2a57 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:19.657109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9c770b8-6947-4a66-9289-d5095fec2a57 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:20.283735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f9c770b8-6947-4a66-9289-d5095fec2a57 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:20.298698 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9c770b8-6947-4a66-9289-d5095fec2a57 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 0.675160 Oct 11 19:56:20.299822 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1652/3348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:19 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:20.308033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d3c82d65-145e-40bf-a7d5-5f3ec2a6ca76 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c7430f70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:20.339188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fdd7ec8f-bedb-499e-8e62-3d7462ca4dcd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:20.375358 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fdd7ec8f-bedb-499e-8e62-3d7462ca4dcd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1305 microversion: 2.1 time: 0.759243 Oct 11 19:56:20.387607 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1697/3349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:19 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1305 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:20.420655 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d3c82d65-145e-40bf-a7d5-5f3ec2a6ca76 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 200 len: 1424 microversion: 2.1 time: 0.119218 Oct 11 19:56:20.421249 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1653/3350] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:20 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 1424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:20.561421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c19531c-c3ea-48dd-9235-3ae3ea740a68 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:20.562142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c19531c-c3ea-48dd-9235-3ae3ea740a68 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:20.613841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c19531c-c3ea-48dd-9235-3ae3ea740a68 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:20.617769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c19531c-c3ea-48dd-9235-3ae3ea740a68 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:20.618684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c19531c-c3ea-48dd-9235-3ae3ea740a68 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:20.623936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c19531c-c3ea-48dd-9235-3ae3ea740a68 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:20.630661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c19531c-c3ea-48dd-9235-3ae3ea740a68 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:20.631387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c19531c-c3ea-48dd-9235-3ae3ea740a68 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:21.211912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c19531c-c3ea-48dd-9235-3ae3ea740a68 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:21.227872 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c19531c-c3ea-48dd-9235-3ae3ea740a68 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 0.670412 Oct 11 19:56:21.228420 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1698/3351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:20 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:21.325352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4fbf89c5-6e72-4393-90a3-ea1f6dcefda9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:21.326873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4fbf89c5-6e72-4393-90a3-ea1f6dcefda9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:21.345305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fbf89c5-6e72-4393-90a3-ea1f6dcefda9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:21.348040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fbf89c5-6e72-4393-90a3-ea1f6dcefda9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:21.348529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fbf89c5-6e72-4393-90a3-ea1f6dcefda9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:21.352107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fbf89c5-6e72-4393-90a3-ea1f6dcefda9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:21.356293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fbf89c5-6e72-4393-90a3-ea1f6dcefda9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:21.356986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4fbf89c5-6e72-4393-90a3-ea1f6dcefda9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:21.401984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fab156e7-6c47-4596-ae95-a162e17c9dfd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:21.403707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fab156e7-6c47-4596-ae95-a162e17c9dfd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:21.425966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab156e7-6c47-4596-ae95-a162e17c9dfd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:21.427990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab156e7-6c47-4596-ae95-a162e17c9dfd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:21.428613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab156e7-6c47-4596-ae95-a162e17c9dfd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:21.429529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab156e7-6c47-4596-ae95-a162e17c9dfd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:21.433451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab156e7-6c47-4596-ae95-a162e17c9dfd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:21.435503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fab156e7-6c47-4596-ae95-a162e17c9dfd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:21.741928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4fbf89c5-6e72-4393-90a3-ea1f6dcefda9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:21.752145 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4fbf89c5-6e72-4393-90a3-ea1f6dcefda9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1687 microversion: 2.1 time: 0.432633 Oct 11 19:56:21.764233 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1654/3352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:21 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1687 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:21.773615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6e651dc5-78b0-44eb-bdd5-b2d028c90306 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c7390790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:21.872408 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6e651dc5-78b0-44eb-bdd5-b2d028c90306 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 200 len: 1424 microversion: 2.1 time: 0.106984 Oct 11 19:56:21.883382 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1655/3353] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:21 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:21.904907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fab156e7-6c47-4596-ae95-a162e17c9dfd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:21.921343 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fab156e7-6c47-4596-ae95-a162e17c9dfd tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1293 microversion: 2.1 time: 0.521597 Oct 11 19:56:21.935420 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1699/3354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:21 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1293 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:56:22.258088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b820ad04-501b-4a54-b94b-87dd40222c0f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:22.259686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b820ad04-501b-4a54-b94b-87dd40222c0f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:22.269656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b820ad04-501b-4a54-b94b-87dd40222c0f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:22.271215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b820ad04-501b-4a54-b94b-87dd40222c0f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:22.271895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b820ad04-501b-4a54-b94b-87dd40222c0f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:22.273458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b820ad04-501b-4a54-b94b-87dd40222c0f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:22.274325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b820ad04-501b-4a54-b94b-87dd40222c0f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:22.274992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b820ad04-501b-4a54-b94b-87dd40222c0f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:22.662269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b820ad04-501b-4a54-b94b-87dd40222c0f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:22.668972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:22.673619 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b820ad04-501b-4a54-b94b-87dd40222c0f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 0.417379 Oct 11 19:56:22.686752 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1656/3355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:22 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:22.778487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cf362015-e4db-47f9-8011-878d39bcca5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:22.779446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cf362015-e4db-47f9-8011-878d39bcca5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:22.797435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf362015-e4db-47f9-8011-878d39bcca5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:22.798226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf362015-e4db-47f9-8011-878d39bcca5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:22.801508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf362015-e4db-47f9-8011-878d39bcca5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:22.803095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf362015-e4db-47f9-8011-878d39bcca5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:22.803778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf362015-e4db-47f9-8011-878d39bcca5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:22.807218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf362015-e4db-47f9-8011-878d39bcca5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:22.815438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:22.890310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-940b29d8-db62-4a74-91d8-bcdb5fad50a3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c73dea60>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:22.955870 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-940b29d8-db62-4a74-91d8-bcdb5fad50a3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 200 len: 1424 microversion: 2.1 time: 0.069923 Oct 11 19:56:22.956650 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1657/3356] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:22 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 1424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:56:22.971157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fa0e9294-34e4-422c-870a-dc0fd930ed17 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:22.972149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fa0e9294-34e4-422c-870a-dc0fd930ed17 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:22.995483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa0e9294-34e4-422c-870a-dc0fd930ed17 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:22.996420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa0e9294-34e4-422c-870a-dc0fd930ed17 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:22.997072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa0e9294-34e4-422c-870a-dc0fd930ed17 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:22.999054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa0e9294-34e4-422c-870a-dc0fd930ed17 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:22.999717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa0e9294-34e4-422c-870a-dc0fd930ed17 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:23.002619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa0e9294-34e4-422c-870a-dc0fd930ed17 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:24.355041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cf362015-e4db-47f9-8011-878d39bcca5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:24.371160 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cf362015-e4db-47f9-8011-878d39bcca5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1687 microversion: 2.1 time: 1.597346 Oct 11 19:56:24.373367 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1700/3357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:22 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1687 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:24.378398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fa0e9294-34e4-422c-870a-dc0fd930ed17 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:24.397035 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fa0e9294-34e4-422c-870a-dc0fd930ed17 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1293 microversion: 2.1 time: 1.436849 Oct 11 19:56:24.397602 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1658/3358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:22 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1293 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:24.417259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d767caf4-e31f-4da6-ab34-ddf1967ddfb0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:24.418141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d767caf4-e31f-4da6-ab34-ddf1967ddfb0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:24.429585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3447ea76-9cec-47b0-9cb9-89b3bcd92fd1 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c7430280>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:24.440346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d767caf4-e31f-4da6-ab34-ddf1967ddfb0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:24.441092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d767caf4-e31f-4da6-ab34-ddf1967ddfb0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:24.444362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d767caf4-e31f-4da6-ab34-ddf1967ddfb0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:24.453964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d767caf4-e31f-4da6-ab34-ddf1967ddfb0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:24.454708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d767caf4-e31f-4da6-ab34-ddf1967ddfb0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:24.460698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d767caf4-e31f-4da6-ab34-ddf1967ddfb0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:24.860078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d767caf4-e31f-4da6-ab34-ddf1967ddfb0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:24.874203 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d767caf4-e31f-4da6-ab34-ddf1967ddfb0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 0.499683 Oct 11 19:56:24.879547 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1701/3359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:24 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:25.400283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d7410077-fbcf-4a2b-98f1-83df24dad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:25.401827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d7410077-fbcf-4a2b-98f1-83df24dad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:25.422610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7410077-fbcf-4a2b-98f1-83df24dad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:25.423410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7410077-fbcf-4a2b-98f1-83df24dad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:25.424039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7410077-fbcf-4a2b-98f1-83df24dad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:25.427320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7410077-fbcf-4a2b-98f1-83df24dad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:25.432736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7410077-fbcf-4a2b-98f1-83df24dad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:25.436550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7410077-fbcf-4a2b-98f1-83df24dad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:26.414517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d7410077-fbcf-4a2b-98f1-83df24dad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:26.423348 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d7410077-fbcf-4a2b-98f1-83df24dad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1682 microversion: 2.1 time: 1.028584 Oct 11 19:56:26.434485 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1702/3360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:25 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1682 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:56:26.472367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-067019ef-14c9-4bb4-bbcb-62418f4e5765 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:26.473003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-067019ef-14c9-4bb4-bbcb-62418f4e5765 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:26.518263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-067019ef-14c9-4bb4-bbcb-62418f4e5765 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:26.524467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-067019ef-14c9-4bb4-bbcb-62418f4e5765 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:26.528334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-067019ef-14c9-4bb4-bbcb-62418f4e5765 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:26.529471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-067019ef-14c9-4bb4-bbcb-62418f4e5765 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:26.535765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-067019ef-14c9-4bb4-bbcb-62418f4e5765 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:26.546787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-067019ef-14c9-4bb4-bbcb-62418f4e5765 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:27.212675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-067019ef-14c9-4bb4-bbcb-62418f4e5765 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:27.222375 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-067019ef-14c9-4bb4-bbcb-62418f4e5765 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1293 microversion: 2.1 time: 0.766187 Oct 11 19:56:27.230645 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1703/3361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:26 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1293 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:27.241773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d9d0dd2b-cc01-4da4-870f-fabb07d88d98 req-efc60cfd-22e3-4da0-9a4a-1e57bc5a4fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee4391-e163-4a76-9151-04adeb0111a8", "name": "network-vif-plugged", "status": "completed", "tag": "8feec027-3d8b-4b4e-9712-8f57ab9fb853"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:27.276784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d9d0dd2b-cc01-4da4-870f-fabb07d88d98 req-efc60cfd-22e3-4da0-9a4a-1e57bc5a4fbe service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:27.281722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d9d0dd2b-cc01-4da4-870f-fabb07d88d98 req-efc60cfd-22e3-4da0-9a4a-1e57bc5a4fbe service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:27.282459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d9d0dd2b-cc01-4da4-870f-fabb07d88d98 req-efc60cfd-22e3-4da0-9a4a-1e57bc5a4fbe service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:27.319814 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d9d0dd2b-cc01-4da4-870f-fabb07d88d98 req-efc60cfd-22e3-4da0-9a4a-1e57bc5a4fbe service nova] Creating event network-vif-plugged:8feec027-3d8b-4b4e-9712-8f57ab9fb853 for instance b7ee4391-e163-4a76-9151-04adeb0111a8 on n-h1-860864-3 Oct 11 19:56:27.335840 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d9d0dd2b-cc01-4da4-870f-fabb07d88d98 req-efc60cfd-22e3-4da0-9a4a-1e57bc5a4fbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100310 Oct 11 19:56:27.337104 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1704/3362] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:27.347436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a6e6023-155e-48e2-8c2b-e11f2673ac70 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:27.350008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a6e6023-155e-48e2-8c2b-e11f2673ac70 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:27.367632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e6023-155e-48e2-8c2b-e11f2673ac70 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:27.368459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e6023-155e-48e2-8c2b-e11f2673ac70 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:27.370559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e6023-155e-48e2-8c2b-e11f2673ac70 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:27.371521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e6023-155e-48e2-8c2b-e11f2673ac70 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:27.373601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e6023-155e-48e2-8c2b-e11f2673ac70 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:27.374240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a6e6023-155e-48e2-8c2b-e11f2673ac70 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:27.993613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a6e6023-155e-48e2-8c2b-e11f2673ac70 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:28.004070 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a6e6023-155e-48e2-8c2b-e11f2673ac70 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 0.665502 Oct 11 19:56:28.006096 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1705/3363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:27 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:28.012821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a8906164-e0ce-42f2-ac51-14a53eb10e31 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:28.016668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a8906164-e0ce-42f2-ac51-14a53eb10e31 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:28.043791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8906164-e0ce-42f2-ac51-14a53eb10e31 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:28.044294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8906164-e0ce-42f2-ac51-14a53eb10e31 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:28.044734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8906164-e0ce-42f2-ac51-14a53eb10e31 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:28.045447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8906164-e0ce-42f2-ac51-14a53eb10e31 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:28.045917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8906164-e0ce-42f2-ac51-14a53eb10e31 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:28.046349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8906164-e0ce-42f2-ac51-14a53eb10e31 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:28.447032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a8906164-e0ce-42f2-ac51-14a53eb10e31 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:28.459685 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a8906164-e0ce-42f2-ac51-14a53eb10e31 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1682 microversion: 2.1 time: 0.450541 Oct 11 19:56:28.461626 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1706/3364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:28 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1682 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:28.480359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0748f62b-5b91-49ba-8b39-0c03f747e4b6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:28.483087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0748f62b-5b91-49ba-8b39-0c03f747e4b6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:28.497560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0748f62b-5b91-49ba-8b39-0c03f747e4b6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:28.508558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0748f62b-5b91-49ba-8b39-0c03f747e4b6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:28.509303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0748f62b-5b91-49ba-8b39-0c03f747e4b6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:28.511677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0748f62b-5b91-49ba-8b39-0c03f747e4b6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:28.515768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0748f62b-5b91-49ba-8b39-0c03f747e4b6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:28.517826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0748f62b-5b91-49ba-8b39-0c03f747e4b6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:29.124422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0748f62b-5b91-49ba-8b39-0c03f747e4b6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:29.137010 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0748f62b-5b91-49ba-8b39-0c03f747e4b6 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1293 microversion: 2.1 time: 0.670615 Oct 11 19:56:29.138230 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1707/3365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:28 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1293 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:29.149328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d7b368fc-9a32-4d58-9a97-ddd0f4735517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:29.184679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d7b368fc-9a32-4d58-9a97-ddd0f4735517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:29.210378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7b368fc-9a32-4d58-9a97-ddd0f4735517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:29.210929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7b368fc-9a32-4d58-9a97-ddd0f4735517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:29.211577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7b368fc-9a32-4d58-9a97-ddd0f4735517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:29.212091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7b368fc-9a32-4d58-9a97-ddd0f4735517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:29.215592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7b368fc-9a32-4d58-9a97-ddd0f4735517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:29.216252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7b368fc-9a32-4d58-9a97-ddd0f4735517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:29.664570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d7b368fc-9a32-4d58-9a97-ddd0f4735517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:29.693577 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d7b368fc-9a32-4d58-9a97-ddd0f4735517 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 0.545494 Oct 11 19:56:29.716218 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1708/3366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:29 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:29.734114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9fde2e0e-736f-4c24-9f34-743e7f6dd356 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:29.735382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9fde2e0e-736f-4c24-9f34-743e7f6dd356 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:29.743176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fde2e0e-736f-4c24-9f34-743e7f6dd356 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:29.744084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fde2e0e-736f-4c24-9f34-743e7f6dd356 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:29.744938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fde2e0e-736f-4c24-9f34-743e7f6dd356 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:29.746140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fde2e0e-736f-4c24-9f34-743e7f6dd356 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:29.746916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fde2e0e-736f-4c24-9f34-743e7f6dd356 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:29.748911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fde2e0e-736f-4c24-9f34-743e7f6dd356 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:30.512897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9fde2e0e-736f-4c24-9f34-743e7f6dd356 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:30.523975 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9fde2e0e-736f-4c24-9f34-743e7f6dd356 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1682 microversion: 2.1 time: 0.804592 Oct 11 19:56:30.525124 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1709/3367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:29 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1682 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:30.533526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3ede4441-abeb-4181-b73a-b17d753318bb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:30.534406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3ede4441-abeb-4181-b73a-b17d753318bb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:30.550249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ede4441-abeb-4181-b73a-b17d753318bb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:30.551077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ede4441-abeb-4181-b73a-b17d753318bb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:30.552252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ede4441-abeb-4181-b73a-b17d753318bb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:30.553312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ede4441-abeb-4181-b73a-b17d753318bb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:30.553945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ede4441-abeb-4181-b73a-b17d753318bb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:30.554624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ede4441-abeb-4181-b73a-b17d753318bb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:31.156679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3ede4441-abeb-4181-b73a-b17d753318bb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:31.171194 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3ede4441-abeb-4181-b73a-b17d753318bb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1293 microversion: 2.1 time: 0.644724 Oct 11 19:56:31.174839 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1710/3368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:30 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1293 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:31.180658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-73380194-5bb2-422b-8b8e-87da734e5762 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:31.181467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-73380194-5bb2-422b-8b8e-87da734e5762 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:31.209047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73380194-5bb2-422b-8b8e-87da734e5762 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:31.210929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73380194-5bb2-422b-8b8e-87da734e5762 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:31.217849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73380194-5bb2-422b-8b8e-87da734e5762 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:31.218999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73380194-5bb2-422b-8b8e-87da734e5762 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:31.219917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73380194-5bb2-422b-8b8e-87da734e5762 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:31.220520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73380194-5bb2-422b-8b8e-87da734e5762 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:32.266968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-73380194-5bb2-422b-8b8e-87da734e5762 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:32.275905 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-73380194-5bb2-422b-8b8e-87da734e5762 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1533 microversion: 2.1 time: 1.099406 Oct 11 19:56:32.276494 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1711/3369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:31 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1533 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:32.308340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0c7ca7e-26b9-4212-971a-1ca562747a8e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:32.311253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0c7ca7e-26b9-4212-971a-1ca562747a8e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:32.346229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0c7ca7e-26b9-4212-971a-1ca562747a8e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:32.350735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0c7ca7e-26b9-4212-971a-1ca562747a8e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:32.351415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0c7ca7e-26b9-4212-971a-1ca562747a8e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:32.352286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0c7ca7e-26b9-4212-971a-1ca562747a8e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:32.352875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0c7ca7e-26b9-4212-971a-1ca562747a8e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:32.353415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0c7ca7e-26b9-4212-971a-1ca562747a8e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:32.422033 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0c7ca7e-26b9-4212-971a-1ca562747a8e tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131720 Oct 11 19:56:32.431817 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1712/3370] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:56:32 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:56:32.437056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4fb5166f-61cc-446e-9016-f0c0537c4cbc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:32.438025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4fb5166f-61cc-446e-9016-f0c0537c4cbc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:32.476107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4fb5166f-61cc-446e-9016-f0c0537c4cbc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:32.477027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4fb5166f-61cc-446e-9016-f0c0537c4cbc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:32.477725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4fb5166f-61cc-446e-9016-f0c0537c4cbc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:32.478752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4fb5166f-61cc-446e-9016-f0c0537c4cbc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:32.479459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4fb5166f-61cc-446e-9016-f0c0537c4cbc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:32.481177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4fb5166f-61cc-446e-9016-f0c0537c4cbc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:32.847181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4fb5166f-61cc-446e-9016-f0c0537c4cbc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:32.859332 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4fb5166f-61cc-446e-9016-f0c0537c4cbc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1682 microversion: 2.1 time: 0.425959 Oct 11 19:56:32.860094 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1713/3371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:32 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1682 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:32.992175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:33.156516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-862074457", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "963eb12a-addf-44c1-a4c3-817337475ff3"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:33.200635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=89 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:34.394728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=7 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:36.258860 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3447ea76-9cec-47b0-9cb9-89b3bcd92fd1 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 200 len: 1433 microversion: 2.1 time: 11.842043 Oct 11 19:56:36.262660 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1659/3372] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:24 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 1433 bytes in 11865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:36.270254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c7c9098c-0ed7-4be9-939c-152fc3ae2e96 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:36.271773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c7c9098c-0ed7-4be9-939c-152fc3ae2e96 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:36.279916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c9098c-0ed7-4be9-939c-152fc3ae2e96 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:36.280379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c9098c-0ed7-4be9-939c-152fc3ae2e96 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:36.280926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c9098c-0ed7-4be9-939c-152fc3ae2e96 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:36.281515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c9098c-0ed7-4be9-939c-152fc3ae2e96 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:36.282220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c9098c-0ed7-4be9-939c-152fc3ae2e96 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:36.282683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c9098c-0ed7-4be9-939c-152fc3ae2e96 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:36.285639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] validate_networks() for [('963eb12a-addf-44c1-a4c3-817337475ff3', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:56:36.722703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c7c9098c-0ed7-4be9-939c-152fc3ae2e96 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:36.757246 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c7c9098c-0ed7-4be9-939c-152fc3ae2e96 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1293 microversion: 2.1 time: 0.492054 Oct 11 19:56:36.764380 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1660/3373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:36 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1293 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:36.786871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-52246c93-f7c9-4d04-8e51-36434d559a8c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:36.797730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-52246c93-f7c9-4d04-8e51-36434d559a8c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:36.822242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52246c93-f7c9-4d04-8e51-36434d559a8c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:36.826915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52246c93-f7c9-4d04-8e51-36434d559a8c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:36.829323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52246c93-f7c9-4d04-8e51-36434d559a8c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:36.830817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52246c93-f7c9-4d04-8e51-36434d559a8c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:36.836284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52246c93-f7c9-4d04-8e51-36434d559a8c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:36.837076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52246c93-f7c9-4d04-8e51-36434d559a8c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:36.911392 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-52246c93-f7c9-4d04-8e51-36434d559a8c tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.142914 Oct 11 19:56:36.912148 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1661/3374] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:56:36 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:56:36.922250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0f4dabb-ccd4-471e-902f-1b56a4b94560 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:36.931333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f0f4dabb-ccd4-471e-902f-1b56a4b94560 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:36.939961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0f4dabb-ccd4-471e-902f-1b56a4b94560 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:36.940550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0f4dabb-ccd4-471e-902f-1b56a4b94560 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:36.940988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0f4dabb-ccd4-471e-902f-1b56a4b94560 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:36.941702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0f4dabb-ccd4-471e-902f-1b56a4b94560 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:36.942895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0f4dabb-ccd4-471e-902f-1b56a4b94560 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:36.943404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0f4dabb-ccd4-471e-902f-1b56a4b94560 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:37.263227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f0f4dabb-ccd4-471e-902f-1b56a4b94560 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:37.278313 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f0f4dabb-ccd4-471e-902f-1b56a4b94560 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 0.359924 Oct 11 19:56:37.281077 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1662/3375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:36 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:37.290111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-74e6bafd-479c-4e28-91f8-3037813e4eb0 req-1e7a7da6-94c8-4bab-ab5c-41b4fb094dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0795791f-2f7c-418b-8c82-7f1bfb623e93", "name": "network-vif-plugged", "status": "completed", "tag": "22ee4a7b-aafc-48ad-8a2b-8316827168cb"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:37.322305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-74e6bafd-479c-4e28-91f8-3037813e4eb0 req-1e7a7da6-94c8-4bab-ab5c-41b4fb094dba service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:37.330021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-74e6bafd-479c-4e28-91f8-3037813e4eb0 req-1e7a7da6-94c8-4bab-ab5c-41b4fb094dba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:37.330745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-74e6bafd-479c-4e28-91f8-3037813e4eb0 req-1e7a7da6-94c8-4bab-ab5c-41b4fb094dba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:37.364149 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-74e6bafd-479c-4e28-91f8-3037813e4eb0 req-1e7a7da6-94c8-4bab-ab5c-41b4fb094dba service nova] Creating event network-vif-plugged:22ee4a7b-aafc-48ad-8a2b-8316827168cb for instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 on n-h1-860864-3 Oct 11 19:56:37.383032 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-74e6bafd-479c-4e28-91f8-3037813e4eb0 req-1e7a7da6-94c8-4bab-ab5c-41b4fb094dba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100505 Oct 11 19:56:37.383930 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1663/3376] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:37.406406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6780f62-9fa7-4104-a8cf-1fd97e541bd8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:37.407298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a6780f62-9fa7-4104-a8cf-1fd97e541bd8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:37.420505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6780f62-9fa7-4104-a8cf-1fd97e541bd8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:37.421027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6780f62-9fa7-4104-a8cf-1fd97e541bd8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:37.421476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6780f62-9fa7-4104-a8cf-1fd97e541bd8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:37.422215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6780f62-9fa7-4104-a8cf-1fd97e541bd8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:37.422710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6780f62-9fa7-4104-a8cf-1fd97e541bd8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:37.423140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6780f62-9fa7-4104-a8cf-1fd97e541bd8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:37.786816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6780f62-9fa7-4104-a8cf-1fd97e541bd8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:37.806093 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6780f62-9fa7-4104-a8cf-1fd97e541bd8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1682 microversion: 2.1 time: 0.420600 Oct 11 19:56:37.809628 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1664/3377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:37 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1682 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:37.819002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30491efc-39d4-4c38-8267-7abd5fde4dfe tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c73908b0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:37.885485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:56:37.886763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:56:37.887796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:56:37.888454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:56:37.888884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:56:37.908078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:37.908596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:37.909044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:37.909783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:37.910248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:37.911218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:37.961700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Getting quotas for project 3c560285045d4c17b0f4d86e31c6f584. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:56:37.975993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Getting quotas for user 246e8a514537477fb2ca87e3f4117f3e and project 3c560285045d4c17b0f4d86e31c6f584. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:56:38.008247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:56:38.012395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:56:38.113113 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f7cbb7a8-4a43-4ae4-8e09-02377e2fddae tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.236922 Oct 11 19:56:38.116990 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1714/3378] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:56:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 5256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:56:38.126490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-399c0a88-7b05-495e-8907-a42b623bc3af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:38.130783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-399c0a88-7b05-495e-8907-a42b623bc3af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:38.165095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-399c0a88-7b05-495e-8907-a42b623bc3af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:38.170153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-399c0a88-7b05-495e-8907-a42b623bc3af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:38.171168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-399c0a88-7b05-495e-8907-a42b623bc3af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:38.173001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-399c0a88-7b05-495e-8907-a42b623bc3af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:38.178187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-399c0a88-7b05-495e-8907-a42b623bc3af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:38.178958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-399c0a88-7b05-495e-8907-a42b623bc3af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:38.253492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-399c0a88-7b05-495e-8907-a42b623bc3af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:56:38.467358 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-399c0a88-7b05-495e-8907-a42b623bc3af tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "DELETE /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 204 len: 0 microversion: 2.1 time: 0.348680 Oct 11 19:56:38.468038 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1715/3379] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:56:38 2022] DELETE /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:56:38.480091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0b84656-6691-485a-a9e1-4bea0fa8cb3e tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:38.480912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d0b84656-6691-485a-a9e1-4bea0fa8cb3e tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:38.541623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b84656-6691-485a-a9e1-4bea0fa8cb3e tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:38.542118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b84656-6691-485a-a9e1-4bea0fa8cb3e tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:38.558411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b84656-6691-485a-a9e1-4bea0fa8cb3e tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:38.561512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b84656-6691-485a-a9e1-4bea0fa8cb3e tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:38.566277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b84656-6691-485a-a9e1-4bea0fa8cb3e tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:38.566789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b84656-6691-485a-a9e1-4bea0fa8cb3e tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:38.636714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:38.991430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0b84656-6691-485a-a9e1-4bea0fa8cb3e tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:39.010278 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0b84656-6691-485a-a9e1-4bea0fa8cb3e tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1293 microversion: 2.1 time: 0.538370 Oct 11 19:56:39.012938 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1716/3380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:38 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1293 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:39.024842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a4971a45-46fe-4e23-8a62-4119398c12a5 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:39.029227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a4971a45-46fe-4e23-8a62-4119398c12a5 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:39.230908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4971a45-46fe-4e23-8a62-4119398c12a5 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:39.240217 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a4971a45-46fe-4e23-8a62-4119398c12a5 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1231 microversion: 2.1 time: 0.223827 Oct 11 19:56:39.255851 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1717/3381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:39 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1231 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:39.265175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-467dd8a4-549c-43e6-bc8d-6a59fc2e85a4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:39.266115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-467dd8a4-549c-43e6-bc8d-6a59fc2e85a4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:39.276664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-467dd8a4-549c-43e6-bc8d-6a59fc2e85a4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:39.277481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-467dd8a4-549c-43e6-bc8d-6a59fc2e85a4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:39.278091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-467dd8a4-549c-43e6-bc8d-6a59fc2e85a4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:39.279094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-467dd8a4-549c-43e6-bc8d-6a59fc2e85a4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:39.279889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-467dd8a4-549c-43e6-bc8d-6a59fc2e85a4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:39.282051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-467dd8a4-549c-43e6-bc8d-6a59fc2e85a4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:39.641259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-467dd8a4-549c-43e6-bc8d-6a59fc2e85a4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:39.649558 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-467dd8a4-549c-43e6-bc8d-6a59fc2e85a4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 0.392279 Oct 11 19:56:39.655784 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1718/3382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:39 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:39.671196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f0474e10-5163-4ef3-b45d-462b04757503 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:39.671696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f0474e10-5163-4ef3-b45d-462b04757503 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:39.690363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0474e10-5163-4ef3-b45d-462b04757503 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:39.690816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0474e10-5163-4ef3-b45d-462b04757503 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:39.691264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0474e10-5163-4ef3-b45d-462b04757503 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:39.699180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0474e10-5163-4ef3-b45d-462b04757503 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:39.699679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0474e10-5163-4ef3-b45d-462b04757503 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:39.700128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0474e10-5163-4ef3-b45d-462b04757503 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:40.014872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f0474e10-5163-4ef3-b45d-462b04757503 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:40.032254 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f0474e10-5163-4ef3-b45d-462b04757503 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 200 len: 1671 microversion: 2.1 time: 0.375273 Oct 11 19:56:40.038271 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1719/3383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:39 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 1671 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:40.049024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3715e034-9783-459b-ac42-6f157ed98b47 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:40.049656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3715e034-9783-459b-ac42-6f157ed98b47 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:40.100335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3715e034-9783-459b-ac42-6f157ed98b47 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:40.101170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3715e034-9783-459b-ac42-6f157ed98b47 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:40.101817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3715e034-9783-459b-ac42-6f157ed98b47 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:40.102883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3715e034-9783-459b-ac42-6f157ed98b47 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:40.103519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3715e034-9783-459b-ac42-6f157ed98b47 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:40.104121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3715e034-9783-459b-ac42-6f157ed98b47 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:40.461835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3715e034-9783-459b-ac42-6f157ed98b47 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:40.474140 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3715e034-9783-459b-ac42-6f157ed98b47 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1682 microversion: 2.1 time: 0.434380 Oct 11 19:56:40.475414 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1720/3384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:40 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1682 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:40.493370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2d517e91-217f-4ef3-9597-4af5090e130b req-23350346-ea99-475d-9ab4-318194283bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f1dc40-ef33-40f8-b128-d5c6367e833e", "name": "network-vif-plugged", "status": "completed", "tag": "7033f16c-8fb2-4050-810b-a6de0ea759f0"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:40.550819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2d517e91-217f-4ef3-9597-4af5090e130b req-23350346-ea99-475d-9ab4-318194283bae service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:40.550819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2d517e91-217f-4ef3-9597-4af5090e130b req-23350346-ea99-475d-9ab4-318194283bae service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:40.550819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2d517e91-217f-4ef3-9597-4af5090e130b req-23350346-ea99-475d-9ab4-318194283bae service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:40.597081 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2d517e91-217f-4ef3-9597-4af5090e130b req-23350346-ea99-475d-9ab4-318194283bae service nova] Creating event network-vif-plugged:7033f16c-8fb2-4050-810b-a6de0ea759f0 for instance 85f1dc40-ef33-40f8-b128-d5c6367e833e on n-h1-860864-3 Oct 11 19:56:40.607273 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2d517e91-217f-4ef3-9597-4af5090e130b req-23350346-ea99-475d-9ab4-318194283bae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119491 Oct 11 19:56:40.617553 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1721/3385] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:40.637600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66e16f09-0e86-4c08-8bec-ad000d4a289b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:40.638302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-66e16f09-0e86-4c08-8bec-ad000d4a289b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:40.658868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66e16f09-0e86-4c08-8bec-ad000d4a289b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:40.659380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66e16f09-0e86-4c08-8bec-ad000d4a289b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:40.659820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66e16f09-0e86-4c08-8bec-ad000d4a289b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:40.670332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66e16f09-0e86-4c08-8bec-ad000d4a289b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:40.671285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66e16f09-0e86-4c08-8bec-ad000d4a289b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:40.672139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66e16f09-0e86-4c08-8bec-ad000d4a289b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:41.304782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-66e16f09-0e86-4c08-8bec-ad000d4a289b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:41.325103 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-66e16f09-0e86-4c08-8bec-ad000d4a289b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1483 microversion: 2.1 time: 0.706492 Oct 11 19:56:41.345716 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1722/3386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:40 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1483 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:41.359471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-39fbd329-232f-4fcf-98df-4b180f596e21 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:41.366556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-39fbd329-232f-4fcf-98df-4b180f596e21 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:41.390193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fbd329-232f-4fcf-98df-4b180f596e21 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:41.391077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fbd329-232f-4fcf-98df-4b180f596e21 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:41.391729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fbd329-232f-4fcf-98df-4b180f596e21 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:41.392732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fbd329-232f-4fcf-98df-4b180f596e21 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:41.393370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fbd329-232f-4fcf-98df-4b180f596e21 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:41.393955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fbd329-232f-4fcf-98df-4b180f596e21 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:41.666022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-39fbd329-232f-4fcf-98df-4b180f596e21 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:41.677334 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-39fbd329-232f-4fcf-98df-4b180f596e21 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1283 microversion: 2.1 time: 0.321380 Oct 11 19:56:41.699187 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1723/3387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:41 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1283 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:41.721853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9a979744-aff2-4866-a573-9abe48bff416 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:41.722590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9a979744-aff2-4866-a573-9abe48bff416 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:41.745681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a979744-aff2-4866-a573-9abe48bff416 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:41.746194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a979744-aff2-4866-a573-9abe48bff416 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:41.746664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a979744-aff2-4866-a573-9abe48bff416 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:41.754074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a979744-aff2-4866-a573-9abe48bff416 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:41.754887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a979744-aff2-4866-a573-9abe48bff416 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:41.762643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a979744-aff2-4866-a573-9abe48bff416 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:43.506989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9a979744-aff2-4866-a573-9abe48bff416 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:43.515421 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9a979744-aff2-4866-a573-9abe48bff416 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 1.814987 Oct 11 19:56:43.519598 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1724/3388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:41 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:43.527835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-012b0dd6-a34d-401e-9f45-d03b86f77eeb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:43.531263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-012b0dd6-a34d-401e-9f45-d03b86f77eeb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:43.547828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-012b0dd6-a34d-401e-9f45-d03b86f77eeb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:43.548619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-012b0dd6-a34d-401e-9f45-d03b86f77eeb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:43.552298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-012b0dd6-a34d-401e-9f45-d03b86f77eeb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:43.553258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-012b0dd6-a34d-401e-9f45-d03b86f77eeb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:43.553921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-012b0dd6-a34d-401e-9f45-d03b86f77eeb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:43.554540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-012b0dd6-a34d-401e-9f45-d03b86f77eeb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:44.165950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-012b0dd6-a34d-401e-9f45-d03b86f77eeb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:44.183094 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-012b0dd6-a34d-401e-9f45-d03b86f77eeb tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 200 len: 1671 microversion: 2.1 time: 0.661729 Oct 11 19:56:44.189970 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1725/3389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:43 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 1671 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:44.204063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-348330c0-401a-4882-a90d-aaee04a92184 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:44.211843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-348330c0-401a-4882-a90d-aaee04a92184 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:44.227241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-348330c0-401a-4882-a90d-aaee04a92184 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:44.228139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-348330c0-401a-4882-a90d-aaee04a92184 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:44.228808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-348330c0-401a-4882-a90d-aaee04a92184 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:44.229746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-348330c0-401a-4882-a90d-aaee04a92184 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:44.230421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-348330c0-401a-4882-a90d-aaee04a92184 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:44.231786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-348330c0-401a-4882-a90d-aaee04a92184 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:44.526057 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-348330c0-401a-4882-a90d-aaee04a92184 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.326044 Oct 11 19:56:44.527776 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1726/3390] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:56:44 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93/os-interface => generated 284 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:44.532632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eaf15ee5-7a70-4729-aced-629f4b4d503c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:44.533525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eaf15ee5-7a70-4729-aced-629f4b4d503c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:44.555861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaf15ee5-7a70-4729-aced-629f4b4d503c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:44.560416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaf15ee5-7a70-4729-aced-629f4b4d503c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:44.561102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaf15ee5-7a70-4729-aced-629f4b4d503c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:44.562084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaf15ee5-7a70-4729-aced-629f4b4d503c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:44.569448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaf15ee5-7a70-4729-aced-629f4b4d503c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:44.570938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaf15ee5-7a70-4729-aced-629f4b4d503c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:44.962232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eaf15ee5-7a70-4729-aced-629f4b4d503c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:44.973617 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eaf15ee5-7a70-4729-aced-629f4b4d503c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1682 microversion: 2.1 time: 0.444510 Oct 11 19:56:44.979377 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1727/3391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:44 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1682 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:44.984511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-26cbb2fc-11a9-475b-8a13-0989064e9c1e req-f1da34f0-bec7-4ef4-a51b-6df550c08acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2742468-e532-49c8-8797-5f3572f6786f", "name": "network-vif-unplugged", "status": "completed", "tag": "1c5eacd7-fba5-46ee-b79b-51ac38302947"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:45.016462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-26cbb2fc-11a9-475b-8a13-0989064e9c1e req-f1da34f0-bec7-4ef4-a51b-6df550c08acc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:45.025335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-26cbb2fc-11a9-475b-8a13-0989064e9c1e req-f1da34f0-bec7-4ef4-a51b-6df550c08acc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:45.027945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-26cbb2fc-11a9-475b-8a13-0989064e9c1e req-f1da34f0-bec7-4ef4-a51b-6df550c08acc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:45.085113 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-26cbb2fc-11a9-475b-8a13-0989064e9c1e req-f1da34f0-bec7-4ef4-a51b-6df550c08acc service nova] Creating event network-vif-unplugged:1c5eacd7-fba5-46ee-b79b-51ac38302947 for instance f2742468-e532-49c8-8797-5f3572f6786f on n-h2-860864-3 Oct 11 19:56:45.100087 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-26cbb2fc-11a9-475b-8a13-0989064e9c1e req-f1da34f0-bec7-4ef4-a51b-6df550c08acc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114145 Oct 11 19:56:45.100762 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1728/3392] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:45.111357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d8d9a4b-b46d-4a3f-9392-fe5c652305e7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:45.118126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4d8d9a4b-b46d-4a3f-9392-fe5c652305e7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:45.129396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d8d9a4b-b46d-4a3f-9392-fe5c652305e7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:45.130980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d8d9a4b-b46d-4a3f-9392-fe5c652305e7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:45.131620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d8d9a4b-b46d-4a3f-9392-fe5c652305e7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:45.132559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d8d9a4b-b46d-4a3f-9392-fe5c652305e7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:45.134602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d8d9a4b-b46d-4a3f-9392-fe5c652305e7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:45.135226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d8d9a4b-b46d-4a3f-9392-fe5c652305e7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:45.293254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4d8d9a4b-b46d-4a3f-9392-fe5c652305e7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:45.307194 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4d8d9a4b-b46d-4a3f-9392-fe5c652305e7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1289 microversion: 2.1 time: 0.199546 Oct 11 19:56:45.323344 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1729/3393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:45 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1289 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:45.339646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-deca5fec-f935-4191-9e69-b8777f7bffe7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:45.340276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-deca5fec-f935-4191-9e69-b8777f7bffe7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:45.369980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deca5fec-f935-4191-9e69-b8777f7bffe7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:45.370494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deca5fec-f935-4191-9e69-b8777f7bffe7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:45.370963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deca5fec-f935-4191-9e69-b8777f7bffe7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:45.371684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deca5fec-f935-4191-9e69-b8777f7bffe7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:45.372149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deca5fec-f935-4191-9e69-b8777f7bffe7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:45.372578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deca5fec-f935-4191-9e69-b8777f7bffe7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:45.857774 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-30491efc-39d4-4c38-8267-7abd5fde4dfe tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 200 len: 1433 microversion: 2.1 time: 8.046318 Oct 11 19:56:45.863253 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1665/3394] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:37 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 1433 bytes in 8053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:45.871463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b62498d0-be99-4915-b290-be8bdda56223 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:45.874078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b62498d0-be99-4915-b290-be8bdda56223 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:45.900383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62498d0-be99-4915-b290-be8bdda56223 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:45.901379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62498d0-be99-4915-b290-be8bdda56223 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:45.905001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62498d0-be99-4915-b290-be8bdda56223 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:45.906134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62498d0-be99-4915-b290-be8bdda56223 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:45.906923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62498d0-be99-4915-b290-be8bdda56223 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:45.907885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b62498d0-be99-4915-b290-be8bdda56223 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:46.068034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-deca5fec-f935-4191-9e69-b8777f7bffe7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:46.087195 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-deca5fec-f935-4191-9e69-b8777f7bffe7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 0.762382 Oct 11 19:56:46.089214 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1730/3395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:45 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:46.094327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87fef665-3b38-48f3-b667-8da1bed06e14 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:46.095151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-87fef665-3b38-48f3-b667-8da1bed06e14 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:46.109570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87fef665-3b38-48f3-b667-8da1bed06e14 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:46.114385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87fef665-3b38-48f3-b667-8da1bed06e14 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:46.119841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87fef665-3b38-48f3-b667-8da1bed06e14 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:46.122126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87fef665-3b38-48f3-b667-8da1bed06e14 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:46.124780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87fef665-3b38-48f3-b667-8da1bed06e14 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:46.125318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87fef665-3b38-48f3-b667-8da1bed06e14 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:46.130800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b62498d0-be99-4915-b290-be8bdda56223 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6a1d30f20048159afd27eefdc831f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59971595644041418ea11fd1d795f42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:46.142000 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b62498d0-be99-4915-b290-be8bdda56223 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 200 len: 1322 microversion: 2.1 time: 0.277203 Oct 11 19:56:46.143540 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1666/3396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:45 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:46.166733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-85862efb-cdca-4303-9989-b19226f02250 req-c1b0eeed-4a49-43a1-9448-4a6f2f996a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985ba888-5655-480f-8d6b-f39d4a4065fa", "name": "network-vif-deleted", "tag": "7c7804ab-9b0e-4b95-8522-a13a6bca1b13"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:46.193989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-85862efb-cdca-4303-9989-b19226f02250 req-c1b0eeed-4a49-43a1-9448-4a6f2f996a1d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:46.199214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-85862efb-cdca-4303-9989-b19226f02250 req-c1b0eeed-4a49-43a1-9448-4a6f2f996a1d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:46.212534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-85862efb-cdca-4303-9989-b19226f02250 req-c1b0eeed-4a49-43a1-9448-4a6f2f996a1d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:46.258690 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-85862efb-cdca-4303-9989-b19226f02250 req-c1b0eeed-4a49-43a1-9448-4a6f2f996a1d service nova] Creating event network-vif-deleted:7c7804ab-9b0e-4b95-8522-a13a6bca1b13 for instance 985ba888-5655-480f-8d6b-f39d4a4065fa on n-h2-860864-3 Oct 11 19:56:46.277381 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-85862efb-cdca-4303-9989-b19226f02250 req-c1b0eeed-4a49-43a1-9448-4a6f2f996a1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132103 Oct 11 19:56:46.278714 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1667/3397] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:46.284242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ed490aff-8be6-4706-8621-1cd6b97703cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:46.296546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ed490aff-8be6-4706-8621-1cd6b97703cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:46.314102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed490aff-8be6-4706-8621-1cd6b97703cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:46.316253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed490aff-8be6-4706-8621-1cd6b97703cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:46.318515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed490aff-8be6-4706-8621-1cd6b97703cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:46.319539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed490aff-8be6-4706-8621-1cd6b97703cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:46.320246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed490aff-8be6-4706-8621-1cd6b97703cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:46.320914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed490aff-8be6-4706-8621-1cd6b97703cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:46.817046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-87fef665-3b38-48f3-b667-8da1bed06e14 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:46.829425 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87fef665-3b38-48f3-b667-8da1bed06e14 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1465 microversion: 2.1 time: 0.738972 Oct 11 19:56:46.832026 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1731/3398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:46 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1465 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:46.842832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff1ecf59-78e4-4c9f-8f65-d5cd268b8130 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:46.848474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ff1ecf59-78e4-4c9f-8f65-d5cd268b8130 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:46.867906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff1ecf59-78e4-4c9f-8f65-d5cd268b8130 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:46.868768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff1ecf59-78e4-4c9f-8f65-d5cd268b8130 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:46.869399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff1ecf59-78e4-4c9f-8f65-d5cd268b8130 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:46.870317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff1ecf59-78e4-4c9f-8f65-d5cd268b8130 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:46.878965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff1ecf59-78e4-4c9f-8f65-d5cd268b8130 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:46.880797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff1ecf59-78e4-4c9f-8f65-d5cd268b8130 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:47.029025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ed490aff-8be6-4706-8621-1cd6b97703cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:47.044932 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ed490aff-8be6-4706-8621-1cd6b97703cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.758456 Oct 11 19:56:47.046067 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1668/3399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:46 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:47.081090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3c5b8d53-905e-4bf7-af8f-7e0e4a967162 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c7430670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:47.372976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ff1ecf59-78e4-4c9f-8f65-d5cd268b8130 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:47.383993 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff1ecf59-78e4-4c9f-8f65-d5cd268b8130 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1331 microversion: 2.1 time: 0.549853 Oct 11 19:56:47.391738 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1732/3400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:46 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1331 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:47.412419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-16ec413b-8c69-4791-8526-a33870edefa0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:47.413403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-16ec413b-8c69-4791-8526-a33870edefa0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:47.429742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16ec413b-8c69-4791-8526-a33870edefa0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:47.430555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16ec413b-8c69-4791-8526-a33870edefa0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:47.431840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16ec413b-8c69-4791-8526-a33870edefa0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:47.432764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16ec413b-8c69-4791-8526-a33870edefa0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:47.433397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16ec413b-8c69-4791-8526-a33870edefa0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:47.434700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16ec413b-8c69-4791-8526-a33870edefa0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:47.934470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:47.956514 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3c5b8d53-905e-4bf7-af8f-7e0e4a967162 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/d10025cd-51f6-4b3b-a33d-5e8072e792b3" status: 200 len: 784 microversion: 2.1 time: 0.905653 Oct 11 19:56:47.957843 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1669/3401] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:47 2022] GET /compute/v2.1/images/d10025cd-51f6-4b3b-a33d-5e8072e792b3 => generated 784 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:47.963613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-16ec413b-8c69-4791-8526-a33870edefa0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:47.968418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:47.969065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:47.974563 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-16ec413b-8c69-4791-8526-a33870edefa0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 0.581440 Oct 11 19:56:47.984620 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1733/3402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:47 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:47.987505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:47.988236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:47.989414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:47.994739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:47.995448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:47.996061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:48.002986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3c19a1f6-8507-43f9-a0f8-f71dee2aaf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:48.013235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3c19a1f6-8507-43f9-a0f8-f71dee2aaf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:48.028252 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] HTTP exception thrown: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Request method failure captured: Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa HTTP/1.1 Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcjzw13fmGyGRNXoHvUb473ckUA7cWqxaBKtW2jows9ag-ajORVboepsiwu1MirYhVn15BpNvgHckmcjqMUOyz0B9EerxJAjyAgflUZL0q_Lx2OYVwdKetdMphFy0H2z2mhBjG0sBo9yM8eO4cnzytYT-42ABoKoD3KMoTAeyDN_qmk Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59971595644041418ea11fd1d795f42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59971595644041418ea11fd1d795f42c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}] Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bc6a1d30f20048159afd27eefdc831f9 Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '985ba888-5655-480f-8d6b-f39d4a4065fa'} Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:48.029980 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:48.036437 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:48.036437 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:48.036437 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:48.036437 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:56:48.036437 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:56:48.036437 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:56:48.036437 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:48.036437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Returning 404 to user: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:56:48.036437 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-329cd24e-7b16-4b30-9552-bb3e7ee75167 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 404 len: 111 microversion: 2.1 time: 0.072487 Oct 11 19:56:48.037987 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1670/3403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:47 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:56:48.047778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-35a8b93e-9c3f-4965-b3b7-17fac8bfbcb4 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:48.053430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c19a1f6-8507-43f9-a0f8-f71dee2aaf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:48.068647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c19a1f6-8507-43f9-a0f8-f71dee2aaf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:48.073023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c19a1f6-8507-43f9-a0f8-f71dee2aaf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:48.073189 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-35a8b93e-9c3f-4965-b3b7-17fac8bfbcb4 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033448 Oct 11 19:56:48.086024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c19a1f6-8507-43f9-a0f8-f71dee2aaf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:48.086816 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1671/3404] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:56:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:48.086936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c19a1f6-8507-43f9-a0f8-f71dee2aaf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:48.086936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c19a1f6-8507-43f9-a0f8-f71dee2aaf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:48.088600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7cc92c72-3238-4b3c-b0c1-bf1af8c05ead tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '.version_select at 0x7f83c73ac040>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:48.137663 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7cc92c72-3238-4b3c-b0c1-bf1af8c05ead tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187545380" status: 202 len: 0 microversion: 2.1 time: 0.055851 Oct 11 19:56:48.138213 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1672/3405] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 19:56:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187545380 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:56:48.152247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-001e06f6-40f8-4762-babb-432c37688dd3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83cc13aa60>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:48.765300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3c19a1f6-8507-43f9-a0f8-f71dee2aaf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:48.781280 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3c19a1f6-8507-43f9-a0f8-f71dee2aaf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.792706 Oct 11 19:56:48.782178 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1734/3406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:47 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:48.788953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7257efcd-e25e-4639-85c5-9fd796952fb7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:48.789560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7257efcd-e25e-4639-85c5-9fd796952fb7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:48.826973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7257efcd-e25e-4639-85c5-9fd796952fb7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:48.827871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7257efcd-e25e-4639-85c5-9fd796952fb7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:48.828506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7257efcd-e25e-4639-85c5-9fd796952fb7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:48.830073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7257efcd-e25e-4639-85c5-9fd796952fb7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:48.830739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7257efcd-e25e-4639-85c5-9fd796952fb7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:48.831341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7257efcd-e25e-4639-85c5-9fd796952fb7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:49.235671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:49.468007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7257efcd-e25e-4639-85c5-9fd796952fb7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:49.471693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:56:49.497395 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-001e06f6-40f8-4762-babb-432c37688dd3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "DELETE /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 204 len: 0 microversion: 2.1 time: 1.354725 Oct 11 19:56:49.499131 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1673/3407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:48 2022] DELETE /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 0 bytes in 1360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:56:49.504974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d3afd945-002a-44f3-91ad-326bdf03b642 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:49.505837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d3afd945-002a-44f3-91ad-326bdf03b642 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:49.514212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7257efcd-e25e-4639-85c5-9fd796952fb7 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1331 microversion: 2.1 time: 0.724313 Oct 11 19:56:49.519560 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1735/3408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:48 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1331 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:49.542506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3afd945-002a-44f3-91ad-326bdf03b642 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:49.549885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-31d20097-871e-49d5-ba9c-c4a993da68d7 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:49.552119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3afd945-002a-44f3-91ad-326bdf03b642 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:49.556202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-31d20097-871e-49d5-ba9c-c4a993da68d7 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:49.565419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3afd945-002a-44f3-91ad-326bdf03b642 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:49.570789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3afd945-002a-44f3-91ad-326bdf03b642 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:49.572717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3afd945-002a-44f3-91ad-326bdf03b642 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:49.575799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3afd945-002a-44f3-91ad-326bdf03b642 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:49.601221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31d20097-871e-49d5-ba9c-c4a993da68d7 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:49.601359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31d20097-871e-49d5-ba9c-c4a993da68d7 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:49.610449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31d20097-871e-49d5-ba9c-c4a993da68d7 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:49.611577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31d20097-871e-49d5-ba9c-c4a993da68d7 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:49.612075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31d20097-871e-49d5-ba9c-c4a993da68d7 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:49.619740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-31d20097-871e-49d5-ba9c-c4a993da68d7 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:50.175587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d3afd945-002a-44f3-91ad-326bdf03b642 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:50.202705 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d3afd945-002a-44f3-91ad-326bdf03b642 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 0.701962 Oct 11 19:56:50.206144 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1674/3409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:49 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:50.244696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-cf6d97be-896a-4fe0-b889-6aadbdb0fa9c req-e62c4f36-6d9f-449f-b187-057da5945863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0795791f-2f7c-418b-8c82-7f1bfb623e93", "tag": "22ee4a7b-aafc-48ad-8a2b-8316827168cb"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:50.248281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-31d20097-871e-49d5-ba9c-c4a993da68d7 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:50.257422 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-31d20097-871e-49d5-ba9c-c4a993da68d7 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1483 microversion: 2.1 time: 0.735351 Oct 11 19:56:50.258014 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1736/3410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:49 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1483 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:50.276304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2adcbbf5-bb80-46a6-9867-06b8311a926b req-88ea2c9c-1f36-4d9f-99a9-e715717629ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b74878-0856-4c96-801f-9a14951d647f", "tag": "6ff9f802-da11-4f74-900d-b80cccb9041b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:50.284853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cf6d97be-896a-4fe0-b889-6aadbdb0fa9c req-e62c4f36-6d9f-449f-b187-057da5945863 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:50.285405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cf6d97be-896a-4fe0-b889-6aadbdb0fa9c req-e62c4f36-6d9f-449f-b187-057da5945863 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:50.286426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cf6d97be-896a-4fe0-b889-6aadbdb0fa9c req-e62c4f36-6d9f-449f-b187-057da5945863 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:50.313265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2adcbbf5-bb80-46a6-9867-06b8311a926b req-88ea2c9c-1f36-4d9f-99a9-e715717629ff service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:50.314812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2adcbbf5-bb80-46a6-9867-06b8311a926b req-88ea2c9c-1f36-4d9f-99a9-e715717629ff service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:50.316743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2adcbbf5-bb80-46a6-9867-06b8311a926b req-88ea2c9c-1f36-4d9f-99a9-e715717629ff service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:50.322407 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-cf6d97be-896a-4fe0-b889-6aadbdb0fa9c req-e62c4f36-6d9f-449f-b187-057da5945863 service nova] Creating event network-changed:22ee4a7b-aafc-48ad-8a2b-8316827168cb for instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 on n-h1-860864-3 Oct 11 19:56:50.334189 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-cf6d97be-896a-4fe0-b889-6aadbdb0fa9c req-e62c4f36-6d9f-449f-b187-057da5945863 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113395 Oct 11 19:56:50.342936 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1675/3411] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:50.345428 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2adcbbf5-bb80-46a6-9867-06b8311a926b req-88ea2c9c-1f36-4d9f-99a9-e715717629ff service nova] Creating event network-changed:6ff9f802-da11-4f74-900d-b80cccb9041b for instance 57b74878-0856-4c96-801f-9a14951d647f on n-h2-860864-3 Oct 11 19:56:50.353304 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2adcbbf5-bb80-46a6-9867-06b8311a926b req-88ea2c9c-1f36-4d9f-99a9-e715717629ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094085 Oct 11 19:56:50.354372 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1737/3412] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:50.362226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1f5b58af-683d-4ee5-af88-b654d8a7a756 req-a8796abd-8d48-4c53-9c6a-26aaee353c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee4391-e163-4a76-9151-04adeb0111a8", "name": "network-vif-unplugged", "status": "completed", "tag": "8feec027-3d8b-4b4e-9712-8f57ab9fb853"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:50.388967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1f5b58af-683d-4ee5-af88-b654d8a7a756 req-a8796abd-8d48-4c53-9c6a-26aaee353c33 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:50.390602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1f5b58af-683d-4ee5-af88-b654d8a7a756 req-a8796abd-8d48-4c53-9c6a-26aaee353c33 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:50.391242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1f5b58af-683d-4ee5-af88-b654d8a7a756 req-a8796abd-8d48-4c53-9c6a-26aaee353c33 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:50.394073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61a1139b-ff3f-4de9-b17f-7bf64311e6ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7843b57b-2a59-49ee-b87b-c8c7fa462b21"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:50.399406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-61a1139b-ff3f-4de9-b17f-7bf64311e6ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:50.408719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61a1139b-ff3f-4de9-b17f-7bf64311e6ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:50.409639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61a1139b-ff3f-4de9-b17f-7bf64311e6ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:50.411067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61a1139b-ff3f-4de9-b17f-7bf64311e6ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:50.412172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61a1139b-ff3f-4de9-b17f-7bf64311e6ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:50.412906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61a1139b-ff3f-4de9-b17f-7bf64311e6ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:50.413605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61a1139b-ff3f-4de9-b17f-7bf64311e6ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:50.466274 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1f5b58af-683d-4ee5-af88-b654d8a7a756 req-a8796abd-8d48-4c53-9c6a-26aaee353c33 service nova] Creating event network-vif-unplugged:8feec027-3d8b-4b4e-9712-8f57ab9fb853 for instance b7ee4391-e163-4a76-9151-04adeb0111a8 on n-h1-860864-3 Oct 11 19:56:50.478874 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1f5b58af-683d-4ee5-af88-b654d8a7a756 req-a8796abd-8d48-4c53-9c6a-26aaee353c33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131885 Oct 11 19:56:50.484119 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1676/3413] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:50.498162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bc28bcac-bff3-41e9-b872-508decf5e234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c73b3c10>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:51.044347 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-61a1139b-ff3f-4de9-b17f-7bf64311e6ef tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681675 Oct 11 19:56:51.047051 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1738/3414] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 19:56:50 2022] POST /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:56:51.083815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4426a1f3-060a-4729-b6a3-c859b6b8f61a tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:51.087278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4426a1f3-060a-4729-b6a3-c859b6b8f61a tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:51.104388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4426a1f3-060a-4729-b6a3-c859b6b8f61a tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:51.106405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4426a1f3-060a-4729-b6a3-c859b6b8f61a tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:51.109728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4426a1f3-060a-4729-b6a3-c859b6b8f61a tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:51.111007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4426a1f3-060a-4729-b6a3-c859b6b8f61a tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:51.111666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4426a1f3-060a-4729-b6a3-c859b6b8f61a tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:51.113958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4426a1f3-060a-4729-b6a3-c859b6b8f61a tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:51.116014 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-bc28bcac-bff3-41e9-b872-508decf5e234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] HTTP exception thrown: Image not found. Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bc28bcac-bff3-41e9-b872-508decf5e234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Request method failure captured: Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 HTTP/1.1 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRco085IlBROCePDllh9tKAIYPsSzgX5td84mGwngN8ACIhmD38iAbmWwzM0IlF25SsKal5NvNcJpnXGfRF9yEa4gpXqvcxRFWp1SKwq191GHg7ctW_Qyd0KomUZN3SBNA5Vo0xoS7Qw-YhoGvoI2heJICj3PqjklUZz3yuEwqqBr8gc Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 6c55a426691c4e53ab0e77715dd251a2 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesOneServerTestJSON-1145387263 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c55a426691c4e53ab0e77715dd251a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c55a426691c4e53ab0e77715dd251a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c55a426691c4e53ab0e77715dd251a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c55a426691c4e53ab0e77715dd251a2"}]}] Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesOneServerTestJSON-1145387263 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 6c55a426691c4e53ab0e77715dd251a2 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1145387263 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesOneServerTestJSON-1145387263-project Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 35e16fd8c73b4d609b7f4cad18389978 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesOneServerTestJSON-1145387263-project Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'c0b0694f-33cf-41ca-a890-cac7b0d83420'} Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c0b0694f-33cf-41ca-a890-cac7b0d83420 Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 19:56:51.119312 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c0b0694f-33cf-41ca-a890-cac7b0d83420 could not be found. Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bc28bcac-bff3-41e9-b872-508decf5e234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:56:51.125080 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bc28bcac-bff3-41e9-b872-508decf5e234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 404 len: 62 microversion: 2.1 time: 0.638752 Oct 11 19:56:51.132790 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1677/3415] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:50 2022] GET /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 62 bytes in 646 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:56:51.153507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4eabba02-4d91-4719-9b81-28a481784f4f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1554234782"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:51.178851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4eabba02-4d91-4719-9b81-28a481784f4f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:51.187410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4eabba02-4d91-4719-9b81-28a481784f4f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:51.192901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4eabba02-4d91-4719-9b81-28a481784f4f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:51.195541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4eabba02-4d91-4719-9b81-28a481784f4f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:51.197373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4eabba02-4d91-4719-9b81-28a481784f4f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:51.218859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4eabba02-4d91-4719-9b81-28a481784f4f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:51.220866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4eabba02-4d91-4719-9b81-28a481784f4f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:51.666343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4426a1f3-060a-4729-b6a3-c859b6b8f61a tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:51.680853 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4426a1f3-060a-4729-b6a3-c859b6b8f61a tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1331 microversion: 2.1 time: 0.628251 Oct 11 19:56:51.692090 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1739/3416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:51 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1331 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:51.713934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c50f8bbe-d421-4ce6-b13c-4f0558817c7c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:51.714924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c50f8bbe-d421-4ce6-b13c-4f0558817c7c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:51.731141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c50f8bbe-d421-4ce6-b13c-4f0558817c7c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:51.731721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c50f8bbe-d421-4ce6-b13c-4f0558817c7c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:51.732243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c50f8bbe-d421-4ce6-b13c-4f0558817c7c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:51.734421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c50f8bbe-d421-4ce6-b13c-4f0558817c7c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:51.736242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c50f8bbe-d421-4ce6-b13c-4f0558817c7c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:51.737011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c50f8bbe-d421-4ce6-b13c-4f0558817c7c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:52.684869 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4eabba02-4d91-4719-9b81-28a481784f4f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "POST /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f/action" status: 202 len: 0 microversion: 2.1 time: 1.551965 Oct 11 19:56:52.688767 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1678/3417] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:56:51 2022] POST /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f/action => generated 0 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 19:56:52.709276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4cba04f0-09f0-46b6-a224-6054d4f5c3ab tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:52.727892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4cba04f0-09f0-46b6-a224-6054d4f5c3ab tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:52.757975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cba04f0-09f0-46b6-a224-6054d4f5c3ab tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:52.758518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cba04f0-09f0-46b6-a224-6054d4f5c3ab tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:52.758991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cba04f0-09f0-46b6-a224-6054d4f5c3ab tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:52.764679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cba04f0-09f0-46b6-a224-6054d4f5c3ab tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:52.765210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cba04f0-09f0-46b6-a224-6054d4f5c3ab tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:52.765651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cba04f0-09f0-46b6-a224-6054d4f5c3ab tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:53.177156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4cba04f0-09f0-46b6-a224-6054d4f5c3ab tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:53.186303 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4cba04f0-09f0-46b6-a224-6054d4f5c3ab tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.494918 Oct 11 19:56:53.193495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c50f8bbe-d421-4ce6-b13c-4f0558817c7c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:53.203276 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c50f8bbe-d421-4ce6-b13c-4f0558817c7c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 1.509905 Oct 11 19:56:53.203935 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1679/3418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:52 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:53.209580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cf9bcb48-f398-48f0-91da-6ba3e220d8f8 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c73af940>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:53.213156 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1740/3419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:51 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:53.222242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2e3ccad4-61de-4dca-8078-315694b4d066 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:53.232562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2e3ccad4-61de-4dca-8078-315694b4d066 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:53.256585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e3ccad4-61de-4dca-8078-315694b4d066 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:53.257492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e3ccad4-61de-4dca-8078-315694b4d066 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:53.258237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e3ccad4-61de-4dca-8078-315694b4d066 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:53.259385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e3ccad4-61de-4dca-8078-315694b4d066 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:53.259976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e3ccad4-61de-4dca-8078-315694b4d066 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:53.260515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e3ccad4-61de-4dca-8078-315694b4d066 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:53.313723 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cf9bcb48-f398-48f0-91da-6ba3e220d8f8 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.108386 Oct 11 19:56:53.314909 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1680/3420] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:53 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:53.321154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-96eb3ba1-136e-4800-aa38-2e248bede659 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:53.326428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-96eb3ba1-136e-4800-aa38-2e248bede659 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:53.340549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96eb3ba1-136e-4800-aa38-2e248bede659 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:53.341426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96eb3ba1-136e-4800-aa38-2e248bede659 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:53.342164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96eb3ba1-136e-4800-aa38-2e248bede659 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:53.351047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96eb3ba1-136e-4800-aa38-2e248bede659 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:53.351892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96eb3ba1-136e-4800-aa38-2e248bede659 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:53.352572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96eb3ba1-136e-4800-aa38-2e248bede659 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:53.628415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2e3ccad4-61de-4dca-8078-315694b4d066 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:53.643452 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2e3ccad4-61de-4dca-8078-315694b4d066 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1331 microversion: 2.1 time: 0.428896 Oct 11 19:56:53.644201 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1741/3421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:53 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1331 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:53.884821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96eb3ba1-136e-4800-aa38-2e248bede659 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:53.894175 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-96eb3ba1-136e-4800-aa38-2e248bede659 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.578018 Oct 11 19:56:53.898003 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1681/3422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:53 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:53.924927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-15e84b64-8ff1-4e96-bd79-18da1f0a72eb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:53.926849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-15e84b64-8ff1-4e96-bd79-18da1f0a72eb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:53.938159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15e84b64-8ff1-4e96-bd79-18da1f0a72eb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:53.938966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15e84b64-8ff1-4e96-bd79-18da1f0a72eb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:53.939596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15e84b64-8ff1-4e96-bd79-18da1f0a72eb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:53.941153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15e84b64-8ff1-4e96-bd79-18da1f0a72eb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:53.942097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15e84b64-8ff1-4e96-bd79-18da1f0a72eb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:53.942726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15e84b64-8ff1-4e96-bd79-18da1f0a72eb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:54.241606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe64a957-6837-4075-99b1-d32203be9302 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:54.242227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fe64a957-6837-4075-99b1-d32203be9302 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:54.251968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe64a957-6837-4075-99b1-d32203be9302 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:54.252466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe64a957-6837-4075-99b1-d32203be9302 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:54.252909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe64a957-6837-4075-99b1-d32203be9302 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:54.267322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe64a957-6837-4075-99b1-d32203be9302 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:54.268030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe64a957-6837-4075-99b1-d32203be9302 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:54.268659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe64a957-6837-4075-99b1-d32203be9302 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:54.398063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-15e84b64-8ff1-4e96-bd79-18da1f0a72eb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:54.407084 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-15e84b64-8ff1-4e96-bd79-18da1f0a72eb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.485904 Oct 11 19:56:54.415782 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1742/3423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:53 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:54.429058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-72317739-ce30-4105-b94d-388ca248afe7 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c73285e0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:54.527474 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-72317739-ce30-4105-b94d-388ca248afe7 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.102230 Oct 11 19:56:54.528519 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1743/3424] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:54 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:54.549028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5f1d139e-643f-4245-ad3a-fd36c8a78335 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:54.558155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5f1d139e-643f-4245-ad3a-fd36c8a78335 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:54.592683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f1d139e-643f-4245-ad3a-fd36c8a78335 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:54.597604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fe64a957-6837-4075-99b1-d32203be9302 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:54.602325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f1d139e-643f-4245-ad3a-fd36c8a78335 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:54.603121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f1d139e-643f-4245-ad3a-fd36c8a78335 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:54.605821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f1d139e-643f-4245-ad3a-fd36c8a78335 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:54.606769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f1d139e-643f-4245-ad3a-fd36c8a78335 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:54.608392 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fe64a957-6837-4075-99b1-d32203be9302 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 0.370871 Oct 11 19:56:54.609205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f1d139e-643f-4245-ad3a-fd36c8a78335 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:54.612241 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1682/3425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:54 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:56:54.671455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6b96c333-698f-4727-9dad-df14847d3b76 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:54.672357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6b96c333-698f-4727-9dad-df14847d3b76 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:54.686694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b96c333-698f-4727-9dad-df14847d3b76 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:54.687521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b96c333-698f-4727-9dad-df14847d3b76 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:54.688150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b96c333-698f-4727-9dad-df14847d3b76 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:54.689035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b96c333-698f-4727-9dad-df14847d3b76 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:54.689771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b96c333-698f-4727-9dad-df14847d3b76 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:54.690421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b96c333-698f-4727-9dad-df14847d3b76 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:54.787030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5f1d139e-643f-4245-ad3a-fd36c8a78335 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.257120 Oct 11 19:56:54.790199 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1744/3426] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:56:54 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:56:54.803160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-063855e3-55ad-498d-bb66-adb8a691b595 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:54.804177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-063855e3-55ad-498d-bb66-adb8a691b595 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:54.822414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063855e3-55ad-498d-bb66-adb8a691b595 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:54.824404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063855e3-55ad-498d-bb66-adb8a691b595 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:54.826198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063855e3-55ad-498d-bb66-adb8a691b595 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:54.827184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063855e3-55ad-498d-bb66-adb8a691b595 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:54.830350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063855e3-55ad-498d-bb66-adb8a691b595 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:54.831122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063855e3-55ad-498d-bb66-adb8a691b595 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:55.155897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6b96c333-698f-4727-9dad-df14847d3b76 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:55.165097 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6b96c333-698f-4727-9dad-df14847d3b76 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1331 microversion: 2.1 time: 0.497470 Oct 11 19:56:55.173087 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1683/3427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:54 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1331 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:55.175430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-063855e3-55ad-498d-bb66-adb8a691b595 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:55.185495 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-063855e3-55ad-498d-bb66-adb8a691b595 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1671 microversion: 2.1 time: 0.391274 Oct 11 19:56:55.187933 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1745/3428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:54 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1671 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:55.545749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9bdd8377-9ecd-4681-91a4-369b3d502cb0 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83cc157a60>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:55.636225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0fde6f40-7201-49e4-b4e2-9b32308f9ceb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:55.637897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0fde6f40-7201-49e4-b4e2-9b32308f9ceb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:55.652589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fde6f40-7201-49e4-b4e2-9b32308f9ceb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:55.653939 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9bdd8377-9ecd-4681-91a4-369b3d502cb0 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.110222 Oct 11 19:56:55.654774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fde6f40-7201-49e4-b4e2-9b32308f9ceb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:55.655468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fde6f40-7201-49e4-b4e2-9b32308f9ceb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:55.657142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fde6f40-7201-49e4-b4e2-9b32308f9ceb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:55.657603 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1684/3429] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:55 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:55.659150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fde6f40-7201-49e4-b4e2-9b32308f9ceb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:55.659809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0fde6f40-7201-49e4-b4e2-9b32308f9ceb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:56.110774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-05f976da-bfff-423d-a9fe-d462ae562ac6 req-1911d81c-60e1-4ee1-a513-7021efd16fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b74878-0856-4c96-801f-9a14951d647f", "name": "network-vif-plugged", "status": "completed", "tag": "6ff9f802-da11-4f74-900d-b80cccb9041b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:56:56.155660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-05f976da-bfff-423d-a9fe-d462ae562ac6 req-1911d81c-60e1-4ee1-a513-7021efd16fc3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:56.161341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-05f976da-bfff-423d-a9fe-d462ae562ac6 req-1911d81c-60e1-4ee1-a513-7021efd16fc3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:56.169936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-05f976da-bfff-423d-a9fe-d462ae562ac6 req-1911d81c-60e1-4ee1-a513-7021efd16fc3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:56.209539 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-05f976da-bfff-423d-a9fe-d462ae562ac6 req-1911d81c-60e1-4ee1-a513-7021efd16fc3 service nova] Creating event network-vif-plugged:6ff9f802-da11-4f74-900d-b80cccb9041b for instance 57b74878-0856-4c96-801f-9a14951d647f on n-h2-860864-3 Oct 11 19:56:56.225563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-05f976da-bfff-423d-a9fe-d462ae562ac6 req-1911d81c-60e1-4ee1-a513-7021efd16fc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119347 Oct 11 19:56:56.226843 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1685/3430] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:56:56.233431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b83c2381-5405-4c75-a3bf-0e9bcb933bb9 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:56.234497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b83c2381-5405-4c75-a3bf-0e9bcb933bb9 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:56.276002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b83c2381-5405-4c75-a3bf-0e9bcb933bb9 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:56.281097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b83c2381-5405-4c75-a3bf-0e9bcb933bb9 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:56.282778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b83c2381-5405-4c75-a3bf-0e9bcb933bb9 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:56.283790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b83c2381-5405-4c75-a3bf-0e9bcb933bb9 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:56.284662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b83c2381-5405-4c75-a3bf-0e9bcb933bb9 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:56.285436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b83c2381-5405-4c75-a3bf-0e9bcb933bb9 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:56.687829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0fde6f40-7201-49e4-b4e2-9b32308f9ceb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:56.701237 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0fde6f40-7201-49e4-b4e2-9b32308f9ceb tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 1.064225 Oct 11 19:56:56.705907 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1746/3431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:55 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:56.732716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ab7a25d-f9be-4962-84e7-bad5e7022d5d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:56.739487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6ab7a25d-f9be-4962-84e7-bad5e7022d5d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:56.743002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b83c2381-5405-4c75-a3bf-0e9bcb933bb9 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:56.755866 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b83c2381-5405-4c75-a3bf-0e9bcb933bb9 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1331 microversion: 2.1 time: 0.527576 Oct 11 19:56:56.778364 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1686/3432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:56 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1331 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:56.782018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab7a25d-f9be-4962-84e7-bad5e7022d5d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:56.785094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab7a25d-f9be-4962-84e7-bad5e7022d5d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:56.787245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4692af6e-ddd4-450c-b9f9-bd1c7b3be873 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83cc1d2940>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:56.787987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab7a25d-f9be-4962-84e7-bad5e7022d5d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:56.793050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab7a25d-f9be-4962-84e7-bad5e7022d5d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:56.795007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab7a25d-f9be-4962-84e7-bad5e7022d5d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:56.798123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ab7a25d-f9be-4962-84e7-bad5e7022d5d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:57.102292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6ab7a25d-f9be-4962-84e7-bad5e7022d5d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:57.118005 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6ab7a25d-f9be-4962-84e7-bad5e7022d5d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1671 microversion: 2.1 time: 0.409198 Oct 11 19:56:57.119085 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1747/3433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:56 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1671 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:57.731958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-51f7c4bf-74d7-414b-8d64-f019906ba540 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:57.733372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-51f7c4bf-74d7-414b-8d64-f019906ba540 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:57.757445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51f7c4bf-74d7-414b-8d64-f019906ba540 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:57.758407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51f7c4bf-74d7-414b-8d64-f019906ba540 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:57.760156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51f7c4bf-74d7-414b-8d64-f019906ba540 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:57.764010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51f7c4bf-74d7-414b-8d64-f019906ba540 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:57.768228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51f7c4bf-74d7-414b-8d64-f019906ba540 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:57.768983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51f7c4bf-74d7-414b-8d64-f019906ba540 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:58.297573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-51f7c4bf-74d7-414b-8d64-f019906ba540 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:58.318351 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-51f7c4bf-74d7-414b-8d64-f019906ba540 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 0.585305 Oct 11 19:56:58.320370 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1748/3434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:57 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:58.353284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0e5db7ff-e059-4d6a-a05a-9225b6a67cce tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:58.354136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0e5db7ff-e059-4d6a-a05a-9225b6a67cce tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:58.365320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db7ff-e059-4d6a-a05a-9225b6a67cce tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:58.365942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db7ff-e059-4d6a-a05a-9225b6a67cce tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:58.366390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db7ff-e059-4d6a-a05a-9225b6a67cce tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:58.367123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db7ff-e059-4d6a-a05a-9225b6a67cce tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:58.367577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db7ff-e059-4d6a-a05a-9225b6a67cce tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:58.368661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e5db7ff-e059-4d6a-a05a-9225b6a67cce tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:58.766452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0e5db7ff-e059-4d6a-a05a-9225b6a67cce tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:58.783019 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0e5db7ff-e059-4d6a-a05a-9225b6a67cce tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1533 microversion: 2.1 time: 0.442718 Oct 11 19:56:58.795068 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1749/3435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:58 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1533 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:58.813270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fdf3f01b-ca9a-462f-8c25-1890a8569d44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:56:58.816288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fdf3f01b-ca9a-462f-8c25-1890a8569d44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:56:58.833940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf3f01b-ca9a-462f-8c25-1890a8569d44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:58.840165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf3f01b-ca9a-462f-8c25-1890a8569d44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:58.846729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf3f01b-ca9a-462f-8c25-1890a8569d44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:58.848399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf3f01b-ca9a-462f-8c25-1890a8569d44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:56:58.849107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf3f01b-ca9a-462f-8c25-1890a8569d44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:56:58.850273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fdf3f01b-ca9a-462f-8c25-1890a8569d44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:56:59.524934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fdf3f01b-ca9a-462f-8c25-1890a8569d44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:56:59.539579 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fdf3f01b-ca9a-462f-8c25-1890a8569d44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.742726 Oct 11 19:56:59.541698 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1750/3436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:56:58 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:56:59.575014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e5bc4f60-2889-445d-9027-8a3bfda66d83 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Action: 'create', calling method: .version_select at 0x7f83cc5234c0>, body: {"pool": "e50c37a5-7b35-497b-af44-fdc0119017a2"} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:01.075273 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4692af6e-ddd4-450c-b9f9-bd1c7b3be873 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 4.295514 Oct 11 19:57:01.078292 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1687/3437] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:56:56 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 4299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:01.091262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-48c41844-d1ba-478c-8001-50e2ee4d8ffe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:01.092260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-48c41844-d1ba-478c-8001-50e2ee4d8ffe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:01.101721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c41844-d1ba-478c-8001-50e2ee4d8ffe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:01.102756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c41844-d1ba-478c-8001-50e2ee4d8ffe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:01.103440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c41844-d1ba-478c-8001-50e2ee4d8ffe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:01.104549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c41844-d1ba-478c-8001-50e2ee4d8ffe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:01.105250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c41844-d1ba-478c-8001-50e2ee4d8ffe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:01.106053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48c41844-d1ba-478c-8001-50e2ee4d8ffe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:01.133664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:01.401208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-48c41844-d1ba-478c-8001-50e2ee4d8ffe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:01.410924 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-48c41844-d1ba-478c-8001-50e2ee4d8ffe tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1528 microversion: 2.1 time: 0.330523 Oct 11 19:57:01.416365 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1688/3438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:01 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1528 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:01.429687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b161ca2-8cb7-4d97-987d-05374c8b9363 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:01.437388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7b161ca2-8cb7-4d97-987d-05374c8b9363 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:01.454802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b161ca2-8cb7-4d97-987d-05374c8b9363 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:01.457798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b161ca2-8cb7-4d97-987d-05374c8b9363 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:01.460136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b161ca2-8cb7-4d97-987d-05374c8b9363 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:01.461155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b161ca2-8cb7-4d97-987d-05374c8b9363 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:01.464268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b161ca2-8cb7-4d97-987d-05374c8b9363 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:01.465009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b161ca2-8cb7-4d97-987d-05374c8b9363 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:01.560456 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7b161ca2-8cb7-4d97-987d-05374c8b9363 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 200 len: 322 microversion: 2.1 time: 0.141373 Oct 11 19:57:01.567331 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1689/3439] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:01 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:01.574303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5577bd2f-39c4-47f3-a8e5-868f580044a2 req-59d06e3a-82e7-4d74-859f-d6439847ae09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2742468-e532-49c8-8797-5f3572f6786f", "name": "network-vif-plugged", "status": "completed", "tag": "1c5eacd7-fba5-46ee-b79b-51ac38302947"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:01.587981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5577bd2f-39c4-47f3-a8e5-868f580044a2 req-59d06e3a-82e7-4d74-859f-d6439847ae09 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:01.588542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5577bd2f-39c4-47f3-a8e5-868f580044a2 req-59d06e3a-82e7-4d74-859f-d6439847ae09 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:01.589547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5577bd2f-39c4-47f3-a8e5-868f580044a2 req-59d06e3a-82e7-4d74-859f-d6439847ae09 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:01.606041 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5577bd2f-39c4-47f3-a8e5-868f580044a2 req-59d06e3a-82e7-4d74-859f-d6439847ae09 service nova] Creating event network-vif-plugged:1c5eacd7-fba5-46ee-b79b-51ac38302947 for instance f2742468-e532-49c8-8797-5f3572f6786f on n-h2-860864-3 Oct 11 19:57:01.619394 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5577bd2f-39c4-47f3-a8e5-868f580044a2 req-59d06e3a-82e7-4d74-859f-d6439847ae09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049030 Oct 11 19:57:01.624928 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1690/3440] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:01.631038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-042723cc-b98b-40c5-8e25-81f7e3c9e8e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:01.632299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-042723cc-b98b-40c5-8e25-81f7e3c9e8e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:01.640000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-042723cc-b98b-40c5-8e25-81f7e3c9e8e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:01.640821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-042723cc-b98b-40c5-8e25-81f7e3c9e8e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:01.641483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-042723cc-b98b-40c5-8e25-81f7e3c9e8e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:01.642666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-042723cc-b98b-40c5-8e25-81f7e3c9e8e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:01.643348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-042723cc-b98b-40c5-8e25-81f7e3c9e8e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:01.644013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-042723cc-b98b-40c5-8e25-81f7e3c9e8e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:02.489939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-042723cc-b98b-40c5-8e25-81f7e3c9e8e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:02.500792 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-042723cc-b98b-40c5-8e25-81f7e3c9e8e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.874355 Oct 11 19:57:02.521444 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1691/3441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:01 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:02.537004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df696591-14a3-443a-8dd5-8603ae01914f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c73b8ee0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:02.654337 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-df696591-14a3-443a-8dd5-8603ae01914f tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.131481 Oct 11 19:57:02.655783 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1692/3442] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:57:02 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:02.663789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b962530f-1b0c-4b2a-a366-244f3373d69e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:02.664779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b962530f-1b0c-4b2a-a366-244f3373d69e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:02.683080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b962530f-1b0c-4b2a-a366-244f3373d69e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:02.684246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b962530f-1b0c-4b2a-a366-244f3373d69e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:02.684925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b962530f-1b0c-4b2a-a366-244f3373d69e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:02.685887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b962530f-1b0c-4b2a-a366-244f3373d69e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:02.687337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b962530f-1b0c-4b2a-a366-244f3373d69e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:02.689876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b962530f-1b0c-4b2a-a366-244f3373d69e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:03.246945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b962530f-1b0c-4b2a-a366-244f3373d69e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:03.260805 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b962530f-1b0c-4b2a-a366-244f3373d69e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1510 microversion: 2.1 time: 0.601978 Oct 11 19:57:03.262174 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1693/3443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:02 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1510 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:03.267718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a50edce2-b680-4bfd-b93c-8ff7a20b9645 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:03.268666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a50edce2-b680-4bfd-b93c-8ff7a20b9645 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:03.276891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:03.280332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a50edce2-b680-4bfd-b93c-8ff7a20b9645 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:03.281122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a50edce2-b680-4bfd-b93c-8ff7a20b9645 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:03.281831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a50edce2-b680-4bfd-b93c-8ff7a20b9645 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:03.282742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a50edce2-b680-4bfd-b93c-8ff7a20b9645 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:03.283372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a50edce2-b680-4bfd-b93c-8ff7a20b9645 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:03.284310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a50edce2-b680-4bfd-b93c-8ff7a20b9645 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:03.896968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a50edce2-b680-4bfd-b93c-8ff7a20b9645 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:03.945457 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a50edce2-b680-4bfd-b93c-8ff7a20b9645 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.679429 Oct 11 19:57:03.946657 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1694/3444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:03 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:03.954216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-713e91ad-9e80-4819-9842-2a805c1626d3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83cc253700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:04.097487 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-713e91ad-9e80-4819-9842-2a805c1626d3 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.149445 Oct 11 19:57:04.107841 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1695/3445] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:57:03 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:04.116202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4c36834b-b5d1-4cf4-90f4-c6f5d7786754 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:04.123148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4c36834b-b5d1-4cf4-90f4-c6f5d7786754 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:04.141672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c36834b-b5d1-4cf4-90f4-c6f5d7786754 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:04.142649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c36834b-b5d1-4cf4-90f4-c6f5d7786754 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:04.143490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c36834b-b5d1-4cf4-90f4-c6f5d7786754 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:04.145919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c36834b-b5d1-4cf4-90f4-c6f5d7786754 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:04.147921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c36834b-b5d1-4cf4-90f4-c6f5d7786754 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:04.150887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c36834b-b5d1-4cf4-90f4-c6f5d7786754 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:04.432689 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e5bc4f60-2889-445d-9027-8a3bfda66d83 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.870643 Oct 11 19:57:04.442360 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1751/3446] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:56:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:04.447944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-94f89e11-b76f-49b8-9a68-d9a5653c3a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:04.450016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-94f89e11-b76f-49b8-9a68-d9a5653c3a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:04.462472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:04.465833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94f89e11-b76f-49b8-9a68-d9a5653c3a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:04.467806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94f89e11-b76f-49b8-9a68-d9a5653c3a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:04.468975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94f89e11-b76f-49b8-9a68-d9a5653c3a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:04.470968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94f89e11-b76f-49b8-9a68-d9a5653c3a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:04.474107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94f89e11-b76f-49b8-9a68-d9a5653c3a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:04.474882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94f89e11-b76f-49b8-9a68-d9a5653c3a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:04.475596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4c36834b-b5d1-4cf4-90f4-c6f5d7786754 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:04.493089 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4c36834b-b5d1-4cf4-90f4-c6f5d7786754 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.382743 Oct 11 19:57:04.493739 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1696/3447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:04 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:04.521762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.147"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:04.529145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:04.535920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:04.536844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:04.537740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:04.541405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:04.542227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:04.542956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:04.596099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:57:04.604365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquired lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:57:04.757419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-94f89e11-b76f-49b8-9a68-d9a5653c3a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:04.775526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:04.780650 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-94f89e11-b76f-49b8-9a68-d9a5653c3a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1510 microversion: 2.1 time: 0.336729 Oct 11 19:57:04.783339 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1752/3448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:04 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1510 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:04.796553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-874512d4-f3d9-45bc-92b8-5a8cbbb16b44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:04.797507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-874512d4-f3d9-45bc-92b8-5a8cbbb16b44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:04.811924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874512d4-f3d9-45bc-92b8-5a8cbbb16b44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:04.813595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874512d4-f3d9-45bc-92b8-5a8cbbb16b44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:04.815206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874512d4-f3d9-45bc-92b8-5a8cbbb16b44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:04.818018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874512d4-f3d9-45bc-92b8-5a8cbbb16b44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:04.818856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874512d4-f3d9-45bc-92b8-5a8cbbb16b44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:04.819504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874512d4-f3d9-45bc-92b8-5a8cbbb16b44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:05.123252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-874512d4-f3d9-45bc-92b8-5a8cbbb16b44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:05.138431 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-874512d4-f3d9-45bc-92b8-5a8cbbb16b44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.353472 Oct 11 19:57:05.139085 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1753/3449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:04 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:05.146829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:05.147623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:05.158904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:05.159827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:05.161140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:05.162118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:05.165480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:05.166278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:05.219427 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] HTTP exception thrown: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Request method failure captured: Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa HTTP/1.1 Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjzw13fmGyGRNXoHvUb473ckUA7cWqxaBKtW2jows9ag-ajORVboepsiwu1MirYhVn15BpNvgHckmcjqMUOyz0B9EerxJAjyAgflUZL0q_Lx2OYVwdKetdMphFy0H2z2mhBjG0sBo9yM8eO4cnzytYT-42ABoKoD3KMoTAeyDN_qmk Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59971595644041418ea11fd1d795f42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59971595644041418ea11fd1d795f42c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}] Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bc6a1d30f20048159afd27eefdc831f9 Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '985ba888-5655-480f-8d6b-f39d4a4065fa'} Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:05.233322 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:05.238823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Returning 404 to user: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:05.240541 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c2d1d20c-0831-4cfd-9070-e9165b11a8fd tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "DELETE /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 404 len: 111 microversion: 2.1 time: 0.095936 Oct 11 19:57:05.245037 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1754/3450] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:57:05 2022] DELETE /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:05.254044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f4fbf5b1-9bf2-4435-87b9-639483865712 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83d07e95e0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:05.382202 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f4fbf5b1-9bf2-4435-87b9-639483865712 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.135911 Oct 11 19:57:05.383726 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1755/3451] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:57:05 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:05.391914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:05.392565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 985ba888-5655-480f-8d6b-f39d4a4065fa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:05.417478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:05.418594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:05.419057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:05.419796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:05.420291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:05.420760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:05.475701 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] HTTP exception thrown: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Request method failure captured: Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa HTTP/1.1 Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjzw13fmGyGRNXoHvUb473ckUA7cWqxaBKtW2jows9ag-ajORVboepsiwu1MirYhVn15BpNvgHckmcjqMUOyz0B9EerxJAjyAgflUZL0q_Lx2OYVwdKetdMphFy0H2z2mhBjG0sBo9yM8eO4cnzytYT-42ABoKoD3KMoTAeyDN_qmk Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59971595644041418ea11fd1d795f42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59971595644041418ea11fd1d795f42c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}] Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bc6a1d30f20048159afd27eefdc831f9 Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '985ba888-5655-480f-8d6b-f39d4a4065fa'} Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:05.477282 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:05.481813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:05.481813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:05.481813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:05.481813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:05.481813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:05.481813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. Oct 11 19:57:05.481813 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:05.481813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Returning 404 to user: Instance 985ba888-5655-480f-8d6b-f39d4a4065fa could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:05.481813 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5b66d02f-51f0-423e-bad8-1d03ddea3166 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa" status: 404 len: 111 microversion: 2.1 time: 0.094033 Oct 11 19:57:05.487845 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1756/3452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:05 2022] GET /compute/v2.1/servers/985ba888-5655-480f-8d6b-f39d4a4065fa => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:05.501163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-15d571b0-e3f4-4b5b-a85f-ec50e0baa5cb req-3acd05d0-541c-46fe-9c35-ca898cef8d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f1dc40-ef33-40f8-b128-d5c6367e833e", "name": "network-vif-unplugged", "status": "completed", "tag": "7033f16c-8fb2-4050-810b-a6de0ea759f0"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:05.529139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-15d571b0-e3f4-4b5b-a85f-ec50e0baa5cb req-3acd05d0-541c-46fe-9c35-ca898cef8d57 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:05.529624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-15d571b0-e3f4-4b5b-a85f-ec50e0baa5cb req-3acd05d0-541c-46fe-9c35-ca898cef8d57 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:05.544380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-15d571b0-e3f4-4b5b-a85f-ec50e0baa5cb req-3acd05d0-541c-46fe-9c35-ca898cef8d57 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:05.595187 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-15d571b0-e3f4-4b5b-a85f-ec50e0baa5cb req-3acd05d0-541c-46fe-9c35-ca898cef8d57 service nova] Creating event network-vif-unplugged:7033f16c-8fb2-4050-810b-a6de0ea759f0 for instance 85f1dc40-ef33-40f8-b128-d5c6367e833e on n-h1-860864-3 Oct 11 19:57:05.604722 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-15d571b0-e3f4-4b5b-a85f-ec50e0baa5cb req-3acd05d0-541c-46fe-9c35-ca898cef8d57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115959 Oct 11 19:57:05.611979 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1757/3453] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:05.627275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2054264149", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "35295b7c-4089-4c98-81b0-9cc1d9c13721"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:05.744577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] validate_networks() for [('35295b7c-4089-4c98-81b0-9cc1d9c13721', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:57:07.053792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:57:07.054449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:57:07.055452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:57:07.055925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:57:07.056397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:57:07.073200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:07.076043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:07.078206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:07.081858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:07.082636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:07.083769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:07.136292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for project efd1bdcd18f14e87925a5b41393b9add. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:57:07.157099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for user 0647dca89de240ba9fbc1c59ed2b6392 and project efd1bdcd18f14e87925a5b41393b9add. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:57:07.193174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:57:07.200134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:57:07.307851 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-96d47e1b-d626-4c42-b433-4dfdde696340 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694276 Oct 11 19:57:07.310000 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1758/3454] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:57:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:57:07.330425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e409e1a5-6d0a-42b9-90bd-f1765dd84e28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:07.331473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e409e1a5-6d0a-42b9-90bd-f1765dd84e28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:07.350413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e409e1a5-6d0a-42b9-90bd-f1765dd84e28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:07.351219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e409e1a5-6d0a-42b9-90bd-f1765dd84e28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:07.351894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e409e1a5-6d0a-42b9-90bd-f1765dd84e28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:07.369326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e409e1a5-6d0a-42b9-90bd-f1765dd84e28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:07.379782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e409e1a5-6d0a-42b9-90bd-f1765dd84e28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:07.380667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e409e1a5-6d0a-42b9-90bd-f1765dd84e28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:08.353347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e409e1a5-6d0a-42b9-90bd-f1765dd84e28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:08.365748 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e409e1a5-6d0a-42b9-90bd-f1765dd84e28 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1453 microversion: 2.1 time: 1.043326 Oct 11 19:57:08.368417 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1759/3455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:07 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1453 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:08.380729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-987888ae-7a95-4016-8a7d-6130c3f5de1a tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83d08404c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:08.385201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Building network info cache for instance {{(pid=126955) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 19:57:08.465169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-987888ae-7a95-4016-8a7d-6130c3f5de1a tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.094136 Oct 11 19:57:08.466143 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1760/3456] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:57:08 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:08.484098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-27debfd1-d175-47c1-815b-f6b00b8a6d62 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:08.487377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-27debfd1-d175-47c1-815b-f6b00b8a6d62 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:08.501026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27debfd1-d175-47c1-815b-f6b00b8a6d62 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:08.504558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27debfd1-d175-47c1-815b-f6b00b8a6d62 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:08.513956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27debfd1-d175-47c1-815b-f6b00b8a6d62 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:08.515046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27debfd1-d175-47c1-815b-f6b00b8a6d62 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:08.515773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27debfd1-d175-47c1-815b-f6b00b8a6d62 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:08.516396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-27debfd1-d175-47c1-815b-f6b00b8a6d62 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:08.693232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-27debfd1-d175-47c1-815b-f6b00b8a6d62 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:08.706355 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-27debfd1-d175-47c1-815b-f6b00b8a6d62 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1211 microversion: 2.1 time: 0.229907 Oct 11 19:57:08.708707 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1761/3457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:08 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1211 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:08.721329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2708ec8e-0678-4fd7-9bfe-d54631722a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:08.723826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2708ec8e-0678-4fd7-9bfe-d54631722a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:08.737242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2708ec8e-0678-4fd7-9bfe-d54631722a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:08.737766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2708ec8e-0678-4fd7-9bfe-d54631722a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:08.738792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2708ec8e-0678-4fd7-9bfe-d54631722a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:08.739539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2708ec8e-0678-4fd7-9bfe-d54631722a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:08.740010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2708ec8e-0678-4fd7-9bfe-d54631722a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:08.740469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2708ec8e-0678-4fd7-9bfe-d54631722a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:09.265398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2708ec8e-0678-4fd7-9bfe-d54631722a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:09.279644 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2708ec8e-0678-4fd7-9bfe-d54631722a60 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1453 microversion: 2.1 time: 0.569336 Oct 11 19:57:09.293000 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1762/3458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:08 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1453 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:09.324412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-bcdef2a0-c8d3-443a-bad6-cc4c0f6b3c83 req-e2ff79d7-70ef-407e-8833-b4e725611939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b74878-0856-4c96-801f-9a14951d647f", "tag": "6ff9f802-da11-4f74-900d-b80cccb9041b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:09.401544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bcdef2a0-c8d3-443a-bad6-cc4c0f6b3c83 req-e2ff79d7-70ef-407e-8833-b4e725611939 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:09.408367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bcdef2a0-c8d3-443a-bad6-cc4c0f6b3c83 req-e2ff79d7-70ef-407e-8833-b4e725611939 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:09.412418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bcdef2a0-c8d3-443a-bad6-cc4c0f6b3c83 req-e2ff79d7-70ef-407e-8833-b4e725611939 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:09.474150 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bcdef2a0-c8d3-443a-bad6-cc4c0f6b3c83 req-e2ff79d7-70ef-407e-8833-b4e725611939 service nova] Creating event network-changed:6ff9f802-da11-4f74-900d-b80cccb9041b for instance 57b74878-0856-4c96-801f-9a14951d647f on n-h2-860864-3 Oct 11 19:57:09.501875 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-bcdef2a0-c8d3-443a-bad6-cc4c0f6b3c83 req-e2ff79d7-70ef-407e-8833-b4e725611939 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203090 Oct 11 19:57:09.512684 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1763/3459] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:09.528308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:09.529601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:09.559835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:09.563195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:09.565770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:09.567365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:09.572154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:09.573118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:09.655612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lazy-loading 'flavor' on Instance uuid 85f1dc40-ef33-40f8-b128-d5c6367e833e {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:57:09.701901 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Cannot 'shelve' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state shelved_offloaded Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action HTTP/1.1 Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 14 Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: {"shelve": {}} Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: exception: Cannot 'shelve' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state shelved_offloaded Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '85f1dc40-ef33-40f8-b128-d5c6367e833e', 'body': {'shelve': {}}} Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:57:09.709748 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state shelved_offloaded Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state shelved_offloaded Oct 11 19:57:09.714700 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:09.726497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 409 to user: Cannot 'shelve' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state shelved_offloaded {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:09.728033 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e20851e-2dd8-40d7-982b-b199436cb624 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 409 len: 155 microversion: 2.1 time: 0.213686 Oct 11 19:57:09.729177 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1764/3460] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:09 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 155 bytes in 215 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:57:09.735500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1a397c2-7b6c-4624-88a5-12a159daa99e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83d06d1ee0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:09.790270 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e1a397c2-7b6c-4624-88a5-12a159daa99e tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.059640 Oct 11 19:57:09.791240 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1765/3461] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:57:09 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:09.796121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-07f95d1e-634c-4020-a9b9-ad9500e276d8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:09.797234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-07f95d1e-634c-4020-a9b9-ad9500e276d8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:09.818059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f95d1e-634c-4020-a9b9-ad9500e276d8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:09.819036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f95d1e-634c-4020-a9b9-ad9500e276d8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:09.822894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f95d1e-634c-4020-a9b9-ad9500e276d8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:09.824198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f95d1e-634c-4020-a9b9-ad9500e276d8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:09.824928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f95d1e-634c-4020-a9b9-ad9500e276d8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:09.825589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07f95d1e-634c-4020-a9b9-ad9500e276d8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:10.092904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-07f95d1e-634c-4020-a9b9-ad9500e276d8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:10.104323 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-07f95d1e-634c-4020-a9b9-ad9500e276d8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1273 microversion: 2.1 time: 0.311624 Oct 11 19:57:10.108107 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1766/3462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:09 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1273 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:10.113830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-537ac086-ff54-4f93-8208-1f55073764fa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:10.114753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-537ac086-ff54-4f93-8208-1f55073764fa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:10.122779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-537ac086-ff54-4f93-8208-1f55073764fa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:10.123610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-537ac086-ff54-4f93-8208-1f55073764fa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:10.124257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-537ac086-ff54-4f93-8208-1f55073764fa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:10.125917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-537ac086-ff54-4f93-8208-1f55073764fa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:10.126575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-537ac086-ff54-4f93-8208-1f55073764fa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:10.127428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-537ac086-ff54-4f93-8208-1f55073764fa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:10.211296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-537ac086-ff54-4f93-8208-1f55073764fa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126956) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 19:57:10.358084 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-537ac086-ff54-4f93-8208-1f55073764fa tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 202 len: 0 microversion: 2.1 time: 0.248022 Oct 11 19:57:10.359352 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1767/3463] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:10 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:10.384425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c0373ec1-edd3-4390-b64d-24dd4dec74a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:10.385213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c0373ec1-edd3-4390-b64d-24dd4dec74a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:10.393355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0373ec1-edd3-4390-b64d-24dd4dec74a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:10.393853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0373ec1-edd3-4390-b64d-24dd4dec74a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:10.394569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0373ec1-edd3-4390-b64d-24dd4dec74a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:10.395220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0373ec1-edd3-4390-b64d-24dd4dec74a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:10.395729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0373ec1-edd3-4390-b64d-24dd4dec74a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:10.396069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0373ec1-edd3-4390-b64d-24dd4dec74a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:11.095737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c0373ec1-edd3-4390-b64d-24dd4dec74a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:11.109268 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c0373ec1-edd3-4390-b64d-24dd4dec74a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1461 microversion: 2.1 time: 0.743190 Oct 11 19:57:11.110089 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1768/3464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:10 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1461 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:11.134443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2339e53-c8d4-428e-b56e-a378fcfd4fd7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:11.137932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2339e53-c8d4-428e-b56e-a378fcfd4fd7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:11.149633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2339e53-c8d4-428e-b56e-a378fcfd4fd7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:11.150308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2339e53-c8d4-428e-b56e-a378fcfd4fd7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:11.150925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2339e53-c8d4-428e-b56e-a378fcfd4fd7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:11.151931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2339e53-c8d4-428e-b56e-a378fcfd4fd7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:11.152389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2339e53-c8d4-428e-b56e-a378fcfd4fd7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:11.152950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2339e53-c8d4-428e-b56e-a378fcfd4fd7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:11.210164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-a2339e53-c8d4-428e-b56e-a378fcfd4fd7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lazy-loading 'flavor' on Instance uuid e1c4b045-264a-41c3-b8e8-5a038c485877 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:57:11.547213 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2339e53-c8d4-428e-b56e-a378fcfd4fd7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/action" status: 200 len: 32 microversion: 2.1 time: 0.422881 Oct 11 19:57:11.556389 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1769/3465] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:11 2022] POST /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:57:11.565615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cb0a470f-fe1c-4506-9a54-fe5991ed90a4 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83cc3650d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:11.670710 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cb0a470f-fe1c-4506-9a54-fe5991ed90a4 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.111656 Oct 11 19:57:11.674177 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1770/3466] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:57:11 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:11.689007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-19e55f49-e886-4a0e-a09e-4d09ccbf5009 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:11.692708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-19e55f49-e886-4a0e-a09e-4d09ccbf5009 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:11.719234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e55f49-e886-4a0e-a09e-4d09ccbf5009 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:11.719848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e55f49-e886-4a0e-a09e-4d09ccbf5009 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:11.721602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e55f49-e886-4a0e-a09e-4d09ccbf5009 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:11.725405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e55f49-e886-4a0e-a09e-4d09ccbf5009 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:11.727412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e55f49-e886-4a0e-a09e-4d09ccbf5009 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:11.728119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19e55f49-e886-4a0e-a09e-4d09ccbf5009 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:12.027301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-19e55f49-e886-4a0e-a09e-4d09ccbf5009 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:12.056119 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-19e55f49-e886-4a0e-a09e-4d09ccbf5009 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1273 microversion: 2.1 time: 0.380732 Oct 11 19:57:12.082677 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1771/3467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:11 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1273 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:12.092025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:12.092025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:12.104903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:12.105836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:12.106644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:12.111836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:12.113558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:12.114186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:12.142769 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] HTTP exception thrown: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Request method failure captured: Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 HTTP/1.1 Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjzw13fmGyGRNXoHvUb473ckUA7cWqxaBKtW2jows9ag-ajORVboepsiwu1MirYhVn15BpNvgHckmcjqMUOyz0B9EerxJAjyAgflUZL0q_Lx2OYVwdKetdMphFy0H2z2mhBjG0sBo9yM8eO4cnzytYT-42ABoKoD3KMoTAeyDN_qmk Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59971595644041418ea11fd1d795f42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59971595644041418ea11fd1d795f42c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}] Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bc6a1d30f20048159afd27eefdc831f9 Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5db170ae-e6b1-4057-8d54-6bba8c210919'} Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:12.152153 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:12.157183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Returning 404 to user: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:12.159709 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b5361bed-04df-4d75-a57c-613f101df456 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 404 len: 111 microversion: 2.1 time: 0.076260 Oct 11 19:57:12.165027 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1772/3468] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:57:12 2022] DELETE /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:12.168743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Updating instance_info_cache with network_info: [{"id": "6ff9f802-da11-4f74-900d-b80cccb9041b", "address": "fa:16:3e:59:f6:8c", "network": {"id": "963eb12a-addf-44c1-a4c3-817337475ff3", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-81926066-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3c560285045d4c17b0f4d86e31c6f584", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6ff9f802-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126955) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:57:12.178423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b6943f2-049b-47e0-8972-7ef4b8ff5914 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:12.179499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b6943f2-049b-47e0-8972-7ef4b8ff5914 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:12.189973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Releasing lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:57:12.200166 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8e6799fb-bf92-4066-ab49-78f8efc83908 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action" status: 202 len: 0 microversion: 2.1 time: 7.674414 Oct 11 19:57:12.201628 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1697/3469] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:04 2022] POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action => generated 0 bytes in 7685 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 19:57:12.208049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c96ff688-1d20-4038-ae4f-8821e027ab40 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:12.210410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c96ff688-1d20-4038-ae4f-8821e027ab40 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:12.212685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b6943f2-049b-47e0-8972-7ef4b8ff5914 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:12.213220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b6943f2-049b-47e0-8972-7ef4b8ff5914 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:12.213759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b6943f2-049b-47e0-8972-7ef4b8ff5914 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:12.214845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b6943f2-049b-47e0-8972-7ef4b8ff5914 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:12.215356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b6943f2-049b-47e0-8972-7ef4b8ff5914 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:12.215787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b6943f2-049b-47e0-8972-7ef4b8ff5914 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:12.227339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c96ff688-1d20-4038-ae4f-8821e027ab40 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:12.228765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c96ff688-1d20-4038-ae4f-8821e027ab40 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:12.229423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c96ff688-1d20-4038-ae4f-8821e027ab40 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:12.230348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c96ff688-1d20-4038-ae4f-8821e027ab40 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:12.231025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c96ff688-1d20-4038-ae4f-8821e027ab40 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:12.231622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c96ff688-1d20-4038-ae4f-8821e027ab40 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:13.162697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b6943f2-049b-47e0-8972-7ef4b8ff5914 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:13.171919 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b6943f2-049b-47e0-8972-7ef4b8ff5914 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 1.007852 Oct 11 19:57:13.182605 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1773/3470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:12 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:13.182605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:13.182605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] [instance: 5db170ae-e6b1-4057-8d54-6bba8c210919] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:13.198279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:13.199143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:13.199531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:13.200363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:13.201433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:13.201433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:13.236505 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] HTTP exception thrown: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Request method failure captured: Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 HTTP/1.1 Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcjzw13fmGyGRNXoHvUb473ckUA7cWqxaBKtW2jows9ag-ajORVboepsiwu1MirYhVn15BpNvgHckmcjqMUOyz0B9EerxJAjyAgflUZL0q_Lx2OYVwdKetdMphFy0H2z2mhBjG0sBo9yM8eO4cnzytYT-42ABoKoD3KMoTAeyDN_qmk Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59971595644041418ea11fd1d795f42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59971595644041418ea11fd1d795f42c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59971595644041418ea11fd1d795f42c"}]}] Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 59971595644041418ea11fd1d795f42c Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1790011466 Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bc6a1d30f20048159afd27eefdc831f9 Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeTestJSON-1790011466-project Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5db170ae-e6b1-4057-8d54-6bba8c210919'} Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:13.238779 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:13.244989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:13.244989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:13.244989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:13.244989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:13.244989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:13.244989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. Oct 11 19:57:13.244989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:13.244989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] Returning 404 to user: Instance 5db170ae-e6b1-4057-8d54-6bba8c210919 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:13.244989 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-70f4f505-ec39-45d0-8ae2-c3413088f402 tempest-AttachVolumeTestJSON-1790011466 tempest-AttachVolumeTestJSON-1790011466-project] 10.222.0.27 "GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919" status: 404 len: 111 microversion: 2.1 time: 0.066822 Oct 11 19:57:13.244989 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1774/3471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:13 2022] GET /compute/v2.1/servers/5db170ae-e6b1-4057-8d54-6bba8c210919 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:13.249726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1636366-fa8a-475a-b06d-44696caf754e tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Action: 'create', calling method: .version_select at 0x7f83d07c1280>, body: {"pool": "e50c37a5-7b35-497b-af44-fdc0119017a2"} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:13.452967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c96ff688-1d20-4038-ae4f-8821e027ab40 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:13.472152 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c96ff688-1d20-4038-ae4f-8821e027ab40 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1463 microversion: 2.1 time: 1.268962 Oct 11 19:57:13.473512 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1698/3472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:12 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1463 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:13.479390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9586d5b1-3c53-4cfd-9f1f-08863e333901 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c7435700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:13.537075 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9586d5b1-3c53-4cfd-9f1f-08863e333901 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.062091 Oct 11 19:57:13.538007 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1699/3473] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:57:13 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:13.543473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-302fc33a-51c8-42bc-8f21-9d5410e18ff8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:13.544280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-302fc33a-51c8-42bc-8f21-9d5410e18ff8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:13.555203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302fc33a-51c8-42bc-8f21-9d5410e18ff8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:13.557285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302fc33a-51c8-42bc-8f21-9d5410e18ff8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:13.557906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302fc33a-51c8-42bc-8f21-9d5410e18ff8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:13.559091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302fc33a-51c8-42bc-8f21-9d5410e18ff8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:13.559713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302fc33a-51c8-42bc-8f21-9d5410e18ff8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:13.560483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302fc33a-51c8-42bc-8f21-9d5410e18ff8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:13.796659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-302fc33a-51c8-42bc-8f21-9d5410e18ff8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:13.808543 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-302fc33a-51c8-42bc-8f21-9d5410e18ff8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1273 microversion: 2.1 time: 0.269227 Oct 11 19:57:13.827318 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1700/3474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:13 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:14.201501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3814f2ad-5941-4850-8b60-c737749689ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:14.210431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3814f2ad-5941-4850-8b60-c737749689ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:14.222144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3814f2ad-5941-4850-8b60-c737749689ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:14.224765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3814f2ad-5941-4850-8b60-c737749689ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:14.227027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3814f2ad-5941-4850-8b60-c737749689ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:14.227986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3814f2ad-5941-4850-8b60-c737749689ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:14.229828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3814f2ad-5941-4850-8b60-c737749689ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:14.230586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3814f2ad-5941-4850-8b60-c737749689ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:15.117926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3814f2ad-5941-4850-8b60-c737749689ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:15.135131 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3814f2ad-5941-4850-8b60-c737749689ff tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.940900 Oct 11 19:57:15.152950 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1701/3475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:14 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:15.168734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a39cbca1-3f7a-4a7a-bded-9b6b7dff2dd8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:15.169770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a39cbca1-3f7a-4a7a-bded-9b6b7dff2dd8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:15.180674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39cbca1-3f7a-4a7a-bded-9b6b7dff2dd8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:15.181464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39cbca1-3f7a-4a7a-bded-9b6b7dff2dd8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:15.182078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39cbca1-3f7a-4a7a-bded-9b6b7dff2dd8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:15.186803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39cbca1-3f7a-4a7a-bded-9b6b7dff2dd8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:15.188638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39cbca1-3f7a-4a7a-bded-9b6b7dff2dd8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:15.190355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a39cbca1-3f7a-4a7a-bded-9b6b7dff2dd8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:15.873698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a39cbca1-3f7a-4a7a-bded-9b6b7dff2dd8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:15.918915 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a39cbca1-3f7a-4a7a-bded-9b6b7dff2dd8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1519 microversion: 2.1 time: 0.752614 Oct 11 19:57:15.931810 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1702/3476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:15 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1519 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:15.944981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8649463c-039d-42bb-8b07-1844159e7b92 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c73af280>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:16.093635 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8649463c-039d-42bb-8b07-1844159e7b92 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1429 microversion: 2.1 time: 0.160771 Oct 11 19:57:16.094576 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1703/3477] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:57:15 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1429 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:16.101512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7cfc9d22-c050-46bc-9fb9-398f88031f6e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:16.102256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7cfc9d22-c050-46bc-9fb9-398f88031f6e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:16.119446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cfc9d22-c050-46bc-9fb9-398f88031f6e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:16.120083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cfc9d22-c050-46bc-9fb9-398f88031f6e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:16.120365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cfc9d22-c050-46bc-9fb9-398f88031f6e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:16.126785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cfc9d22-c050-46bc-9fb9-398f88031f6e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:16.127448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cfc9d22-c050-46bc-9fb9-398f88031f6e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:16.128052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cfc9d22-c050-46bc-9fb9-398f88031f6e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:17.109388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:17.180519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:17.188351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7cfc9d22-c050-46bc-9fb9-398f88031f6e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:17.198024 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7cfc9d22-c050-46bc-9fb9-398f88031f6e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1315 microversion: 2.1 time: 1.102378 Oct 11 19:57:17.198634 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1704/3478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:16 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1315 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:17.223335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fedb82ff-9f84-40c7-95f3-80ab2346cc00 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:17.229632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fedb82ff-9f84-40c7-95f3-80ab2346cc00 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:17.260886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fedb82ff-9f84-40c7-95f3-80ab2346cc00 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:17.261414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fedb82ff-9f84-40c7-95f3-80ab2346cc00 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:17.261847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fedb82ff-9f84-40c7-95f3-80ab2346cc00 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:17.262594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fedb82ff-9f84-40c7-95f3-80ab2346cc00 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:17.268456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fedb82ff-9f84-40c7-95f3-80ab2346cc00 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:17.269126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fedb82ff-9f84-40c7-95f3-80ab2346cc00 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:17.778452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fedb82ff-9f84-40c7-95f3-80ab2346cc00 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:17.788577 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fedb82ff-9f84-40c7-95f3-80ab2346cc00 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.582771 Oct 11 19:57:17.798409 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1705/3479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:17 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:17.808095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e105bbec-b721-4ab2-b3fa-fa0fa32c449e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:17.809408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e105bbec-b721-4ab2-b3fa-fa0fa32c449e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:17.825477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e105bbec-b721-4ab2-b3fa-fa0fa32c449e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:17.829424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e105bbec-b721-4ab2-b3fa-fa0fa32c449e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:17.830047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e105bbec-b721-4ab2-b3fa-fa0fa32c449e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:17.831025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e105bbec-b721-4ab2-b3fa-fa0fa32c449e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:17.833091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e105bbec-b721-4ab2-b3fa-fa0fa32c449e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:17.833622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e105bbec-b721-4ab2-b3fa-fa0fa32c449e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:18.942046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e105bbec-b721-4ab2-b3fa-fa0fa32c449e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:18.956767 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e105bbec-b721-4ab2-b3fa-fa0fa32c449e tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1519 microversion: 2.1 time: 1.156868 Oct 11 19:57:18.957643 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1706/3480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:17 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1519 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:18.966806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e62dc5b-f190-41ae-af8a-39cbcfc881f8 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c7430670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:19.062712 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e62dc5b-f190-41ae-af8a-39cbcfc881f8 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1438 microversion: 2.1 time: 0.103645 Oct 11 19:57:19.063973 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1707/3481] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:57:18 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:19.094316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e4b803e8-cb09-45aa-8a16-a25805dac818 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:19.096206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e4b803e8-cb09-45aa-8a16-a25805dac818 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:19.108458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4b803e8-cb09-45aa-8a16-a25805dac818 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:19.111003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4b803e8-cb09-45aa-8a16-a25805dac818 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:19.113220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4b803e8-cb09-45aa-8a16-a25805dac818 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:19.114251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4b803e8-cb09-45aa-8a16-a25805dac818 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:19.116018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4b803e8-cb09-45aa-8a16-a25805dac818 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:19.116701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4b803e8-cb09-45aa-8a16-a25805dac818 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:19.624587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4b803e8-cb09-45aa-8a16-a25805dac818 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:19.637484 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e4b803e8-cb09-45aa-8a16-a25805dac818 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1315 microversion: 2.1 time: 0.550636 Oct 11 19:57:19.638383 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1708/3482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:19 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:19.658724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-09f958a8-efe7-4073-be2f-83c8c8a053a7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:19.660386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-09f958a8-efe7-4073-be2f-83c8c8a053a7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:19.671765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09f958a8-efe7-4073-be2f-83c8c8a053a7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:19.673528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09f958a8-efe7-4073-be2f-83c8c8a053a7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:19.675483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09f958a8-efe7-4073-be2f-83c8c8a053a7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:19.677143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09f958a8-efe7-4073-be2f-83c8c8a053a7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:19.680429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09f958a8-efe7-4073-be2f-83c8c8a053a7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:19.680885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09f958a8-efe7-4073-be2f-83c8c8a053a7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:20.458235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-09f958a8-efe7-4073-be2f-83c8c8a053a7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:20.473788 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-09f958a8-efe7-4073-be2f-83c8c8a053a7 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.829055 Oct 11 19:57:20.477316 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1709/3483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:19 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:20.501354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d1eadb2c-47d6-408d-9922-756ef4a69931 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c74304c0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:20.588118 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d1eadb2c-47d6-408d-9922-756ef4a69931 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 200 len: 1438 microversion: 2.1 time: 0.096225 Oct 11 19:57:20.589595 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1710/3484] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:57:20 2022] GET /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 1438 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:20.596642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1db2800f-73ec-4aef-95a4-c7b887432685 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:20.597821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1db2800f-73ec-4aef-95a4-c7b887432685 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:20.605093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db2800f-73ec-4aef-95a4-c7b887432685 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:20.605866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db2800f-73ec-4aef-95a4-c7b887432685 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:20.606477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db2800f-73ec-4aef-95a4-c7b887432685 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:20.608059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db2800f-73ec-4aef-95a4-c7b887432685 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:20.609022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db2800f-73ec-4aef-95a4-c7b887432685 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:20.609626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db2800f-73ec-4aef-95a4-c7b887432685 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:20.640722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:21.124289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1db2800f-73ec-4aef-95a4-c7b887432685 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:21.144673 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1db2800f-73ec-4aef-95a4-c7b887432685 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1519 microversion: 2.1 time: 0.552985 Oct 11 19:57:21.146365 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1711/3485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:20 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1519 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:21.151340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5e4c1c3e-3b3c-425c-a252-b7cf4a74016a req-1b3d22e6-ecb7-493e-bae8-9366c6ff3f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bbcb06-9011-4ae8-874b-b03b92aeb1df", "tag": "3757429c-6734-44c3-a22e-a3443f350784"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:21.173888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5e4c1c3e-3b3c-425c-a252-b7cf4a74016a req-1b3d22e6-ecb7-493e-bae8-9366c6ff3f1c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:21.182448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5e4c1c3e-3b3c-425c-a252-b7cf4a74016a req-1b3d22e6-ecb7-493e-bae8-9366c6ff3f1c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:21.184207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5e4c1c3e-3b3c-425c-a252-b7cf4a74016a req-1b3d22e6-ecb7-493e-bae8-9366c6ff3f1c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:21.221859 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1636366-fa8a-475a-b06d-44696caf754e tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.978675 Oct 11 19:57:21.223763 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1775/3486] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 11 19:57:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:21.224531 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5e4c1c3e-3b3c-425c-a252-b7cf4a74016a req-1b3d22e6-ecb7-493e-bae8-9366c6ff3f1c service nova] Creating event network-changed:3757429c-6734-44c3-a22e-a3443f350784 for instance f3bbcb06-9011-4ae8-874b-b03b92aeb1df on n-h1-860864-3 Oct 11 19:57:21.233456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9364239-7614-4f7a-9ccf-27249a9bd29b tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:21.234454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d9364239-7614-4f7a-9ccf-27249a9bd29b tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:21.236597 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5e4c1c3e-3b3c-425c-a252-b7cf4a74016a req-1b3d22e6-ecb7-493e-bae8-9366c6ff3f1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087243 Oct 11 19:57:21.239645 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1712/3487] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:21.247410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9364239-7614-4f7a-9ccf-27249a9bd29b tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:21.248503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9364239-7614-4f7a-9ccf-27249a9bd29b tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:21.249121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9364239-7614-4f7a-9ccf-27249a9bd29b tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:21.250234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9364239-7614-4f7a-9ccf-27249a9bd29b tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:21.251331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9364239-7614-4f7a-9ccf-27249a9bd29b tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:21.251938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9364239-7614-4f7a-9ccf-27249a9bd29b tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:21.256922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2490df82-5a17-4955-9e81-463dacb08c82 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:21.258649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2490df82-5a17-4955-9e81-463dacb08c82 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:21.275452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2490df82-5a17-4955-9e81-463dacb08c82 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:21.277439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2490df82-5a17-4955-9e81-463dacb08c82 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:21.279527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2490df82-5a17-4955-9e81-463dacb08c82 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:21.281173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2490df82-5a17-4955-9e81-463dacb08c82 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:21.283791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2490df82-5a17-4955-9e81-463dacb08c82 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:21.284345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2490df82-5a17-4955-9e81-463dacb08c82 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:21.285586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:21.708889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d9364239-7614-4f7a-9ccf-27249a9bd29b tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:21.721030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9364239-7614-4f7a-9ccf-27249a9bd29b tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1465 microversion: 2.1 time: 0.493796 Oct 11 19:57:21.723118 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1776/3488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:21 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1465 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:21.763566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.59"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:21.768761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:21.779299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:21.779805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:21.780249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:21.781254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:21.782035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:21.782678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:21.826264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:57:21.826981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquired lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:57:21.828019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2490df82-5a17-4955-9e81-463dacb08c82 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:21.843124 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2490df82-5a17-4955-9e81-463dacb08c82 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1315 microversion: 2.1 time: 0.599285 Oct 11 19:57:21.844425 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1713/3489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:21 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:21.850197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-972b597f-4d9f-4613-9c3a-802271bdd12f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:21.851793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-972b597f-4d9f-4613-9c3a-802271bdd12f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:21.862548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-972b597f-4d9f-4613-9c3a-802271bdd12f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:21.863886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-972b597f-4d9f-4613-9c3a-802271bdd12f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:21.864621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-972b597f-4d9f-4613-9c3a-802271bdd12f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:21.866103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-972b597f-4d9f-4613-9c3a-802271bdd12f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:21.866985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-972b597f-4d9f-4613-9c3a-802271bdd12f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:21.868602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-972b597f-4d9f-4613-9c3a-802271bdd12f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:22.477593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-972b597f-4d9f-4613-9c3a-802271bdd12f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:22.502838 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-972b597f-4d9f-4613-9c3a-802271bdd12f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.656535 Oct 11 19:57:22.520527 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1714/3490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:21 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:22.535539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4cfbae69-94c3-4202-a1f0-a763fd80b4a4 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83c7390160>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:23.246105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.59 (f8379b13-bac0-4230-8953-d874fde78ca3) with port 6ff9f802-da11-4f74-900d-b80cccb9041b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e50c37a5-7b35-497b-af44-fdc0119017a2.", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:57:23.247219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Releasing lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:57:23.247783 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.59 (f8379b13-bac0-4230-8953-d874fde78ca3) with port 6ff9f802-da11-4f74-900d-b80cccb9041b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e50c37a5-7b35-497b-af44-fdc0119017a2. Oct 11 19:57:23.247783 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-5ee32ad1-f647-443f-afcc-ea24c5b38d79'] Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Request method failure captured: Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action HTTP/1.1 Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 45 Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcpvwAFkJ66y49UCZJptptK8kJXNSFybsqunNUo_GJZ-yYR_uypFGk3eQMup-1PIrsdIQp8Fs0g3oGcKuyvQgJat9g3rmpClop7uKNt4bLfirTtJPvDt-9HCvU0w2dGbdvSpBxgbtVF1FMkD8qkFulWeWXn5OHheXHRYEY5luTebxSg Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3c560285045d4c17b0f4d86e31c6f584 Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c560285045d4c17b0f4d86e31c6f584"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c560285045d4c17b0f4d86e31c6f584", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c560285045d4c17b0f4d86e31c6f584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c560285045d4c17b0f4d86e31c6f584"}]}] Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3c560285045d4c17b0f4d86e31c6f584 Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 246e8a514537477fb2ca87e3f4117f3e Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: {"addFloatingIp": {"address": "172.25.2.59"}} Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: exception: Cannot associate floating IP 172.25.2.59 (f8379b13-bac0-4230-8953-d874fde78ca3) with port 6ff9f802-da11-4f74-900d-b80cccb9041b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e50c37a5-7b35-497b-af44-fdc0119017a2. Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-5ee32ad1-f647-443f-afcc-ea24c5b38d79'] Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '57b74878-0856-4c96-801f-9a14951d647f', 'body': {'addFloatingIp': {'address': '172.25.2.59'}}} Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:57:23.250656 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.59 (f8379b13-bac0-4230-8953-d874fde78ca3) with port 6ff9f802-da11-4f74-900d-b80cccb9041b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e50c37a5-7b35-497b-af44-fdc0119017a2. Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ee32ad1-f647-443f-afcc-ea24c5b38d79'] Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.59 (f8379b13-bac0-4230-8953-d874fde78ca3) with port 6ff9f802-da11-4f74-900d-b80cccb9041b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e50c37a5-7b35-497b-af44-fdc0119017a2. Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ee32ad1-f647-443f-afcc-ea24c5b38d79'] Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.59 (f8379b13-bac0-4230-8953-d874fde78ca3) with port 6ff9f802-da11-4f74-900d-b80cccb9041b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e50c37a5-7b35-497b-af44-fdc0119017a2. Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ee32ad1-f647-443f-afcc-ea24c5b38d79'] Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.59 (f8379b13-bac0-4230-8953-d874fde78ca3) with port 6ff9f802-da11-4f74-900d-b80cccb9041b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e50c37a5-7b35-497b-af44-fdc0119017a2. Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ee32ad1-f647-443f-afcc-ea24c5b38d79'] Oct 11 19:57:23.257803 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:23.267362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Returning 400 to user: Cannot associate floating IP 172.25.2.59 (f8379b13-bac0-4230-8953-d874fde78ca3) with port 6ff9f802-da11-4f74-900d-b80cccb9041b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e50c37a5-7b35-497b-af44-fdc0119017a2. Oct 11 19:57:23.267362 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-5ee32ad1-f647-443f-afcc-ea24c5b38d79'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:23.267362 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-66b680b2-7c2e-4823-83f9-8fea9bc52393 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action" status: 400 len: 380 microversion: 2.1 time: 1.514327 Oct 11 19:57:23.267362 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1777/3491] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:21 2022] POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action => generated 380 bytes in 1526 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:57:23.272315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a3485e6-b55e-4d3a-8f93-6a8f140dcfd2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:23.272958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0a3485e6-b55e-4d3a-8f93-6a8f140dcfd2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:23.291772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a3485e6-b55e-4d3a-8f93-6a8f140dcfd2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:23.292228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a3485e6-b55e-4d3a-8f93-6a8f140dcfd2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:23.292681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a3485e6-b55e-4d3a-8f93-6a8f140dcfd2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:23.298088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a3485e6-b55e-4d3a-8f93-6a8f140dcfd2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:23.298651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a3485e6-b55e-4d3a-8f93-6a8f140dcfd2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:23.299180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a3485e6-b55e-4d3a-8f93-6a8f140dcfd2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:23.738568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0a3485e6-b55e-4d3a-8f93-6a8f140dcfd2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:23.752882 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a3485e6-b55e-4d3a-8f93-6a8f140dcfd2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1519 microversion: 2.1 time: 0.490691 Oct 11 19:57:23.757068 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1778/3492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:23 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1519 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:23.775166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10cd231b-beff-4fa3-b56c-8b562f6e6768 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:23.777341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10cd231b-beff-4fa3-b56c-8b562f6e6768 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:23.799469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cd231b-beff-4fa3-b56c-8b562f6e6768 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:23.801960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cd231b-beff-4fa3-b56c-8b562f6e6768 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:23.802638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cd231b-beff-4fa3-b56c-8b562f6e6768 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:23.803496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cd231b-beff-4fa3-b56c-8b562f6e6768 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:23.803977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cd231b-beff-4fa3-b56c-8b562f6e6768 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:23.804414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10cd231b-beff-4fa3-b56c-8b562f6e6768 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:23.883025 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4cfbae69-94c3-4202-a1f0-a763fd80b4a4 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "DELETE /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12" status: 204 len: 0 microversion: 2.1 time: 1.355823 Oct 11 19:57:23.884682 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1715/3493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:22 2022] DELETE /compute/v2.1/images/7da7495e-eff2-41f9-9083-36c36c8fab12 => generated 0 bytes in 1363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:57:23.891273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb23be7a-4542-4190-bbb3-3b9a1e0a12fd tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '.version_select at 0x7f83c7341c10>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:24.676231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-10cd231b-beff-4fa3-b56c-8b562f6e6768 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:24.692309 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10cd231b-beff-4fa3-b56c-8b562f6e6768 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1315 microversion: 2.1 time: 0.933742 Oct 11 19:57:24.699255 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1779/3494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:23 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1315 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:24.720796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8828c305-4d96-4e4b-b842-47b4df4c8073 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:24.724643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8828c305-4d96-4e4b-b842-47b4df4c8073 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:24.745279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8828c305-4d96-4e4b-b842-47b4df4c8073 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:24.747338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8828c305-4d96-4e4b-b842-47b4df4c8073 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:24.750394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8828c305-4d96-4e4b-b842-47b4df4c8073 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:24.752987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8828c305-4d96-4e4b-b842-47b4df4c8073 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:24.755477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8828c305-4d96-4e4b-b842-47b4df4c8073 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:24.756127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8828c305-4d96-4e4b-b842-47b4df4c8073 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:25.235329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8828c305-4d96-4e4b-b842-47b4df4c8073 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:25.248859 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8828c305-4d96-4e4b-b842-47b4df4c8073 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.546326 Oct 11 19:57:25.251946 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1780/3495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:24 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:25.279715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d232568-6991-4f3f-a1aa-d5c62a4effae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '.version_select at 0x7f83cca18ee0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:25.358393 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0d232568-6991-4f3f-a1aa-d5c62a4effae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] HTTP exception thrown: Image not found. Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d232568-6991-4f3f-a1aa-d5c62a4effae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Request method failure captured: Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 HTTP/1.1 Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRco085IlBROCePDllh9tKAIYPsSzgX5td84mGwngN8ACIhmD38iAbmWwzM0IlF25SsKal5NvNcJpnXGfRF9yEa4gpXqvcxRFWp1SKwq191GHg7ctW_Qyd0KomUZN3SBNA5Vo0xoS7Qw-YhoGvoI2heJICj3PqjklUZz3yuEwqqBr8gc Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 6c55a426691c4e53ab0e77715dd251a2 Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesOneServerTestJSON-1145387263 Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c55a426691c4e53ab0e77715dd251a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c55a426691c4e53ab0e77715dd251a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c55a426691c4e53ab0e77715dd251a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c55a426691c4e53ab0e77715dd251a2"}]}] Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesOneServerTestJSON-1145387263 Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 6c55a426691c4e53ab0e77715dd251a2 Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1145387263 Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesOneServerTestJSON-1145387263-project Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 35e16fd8c73b4d609b7f4cad18389978 Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesOneServerTestJSON-1145387263-project Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: exception: Image not found. Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'c0b0694f-33cf-41ca-a890-cac7b0d83420'} Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c0b0694f-33cf-41ca-a890-cac7b0d83420 to delete Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c0b0694f-33cf-41ca-a890-cac7b0d83420 could not be found. Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:25.360638 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d232568-6991-4f3f-a1aa-d5c62a4effae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Returning 404 to user: Image not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:25.366380 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0d232568-6991-4f3f-a1aa-d5c62a4effae tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "DELETE /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420" status: 404 len: 62 microversion: 2.1 time: 0.109501 Oct 11 19:57:25.368252 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1781/3496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:25 2022] DELETE /compute/v2.1/images/c0b0694f-33cf-41ca-a890-cac7b0d83420 => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:57:25.385294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a39b2026-ee26-49cd-91b9-6be9d4f2ef6e req-d54fb359-7a17-4459-9ceb-6e7efcf24e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2742468-e532-49c8-8797-5f3572f6786f", "name": "network-vif-unplugged", "status": "completed", "tag": "1c5eacd7-fba5-46ee-b79b-51ac38302947"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:25.463875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a39b2026-ee26-49cd-91b9-6be9d4f2ef6e req-d54fb359-7a17-4459-9ceb-6e7efcf24e9b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:25.465912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a39b2026-ee26-49cd-91b9-6be9d4f2ef6e req-d54fb359-7a17-4459-9ceb-6e7efcf24e9b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:25.466784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a39b2026-ee26-49cd-91b9-6be9d4f2ef6e req-d54fb359-7a17-4459-9ceb-6e7efcf24e9b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:25.506426 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a39b2026-ee26-49cd-91b9-6be9d4f2ef6e req-d54fb359-7a17-4459-9ceb-6e7efcf24e9b service nova] Creating event network-vif-unplugged:1c5eacd7-fba5-46ee-b79b-51ac38302947 for instance f2742468-e532-49c8-8797-5f3572f6786f on n-h2-860864-3 Oct 11 19:57:25.578082 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a39b2026-ee26-49cd-91b9-6be9d4f2ef6e req-d54fb359-7a17-4459-9ceb-6e7efcf24e9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.208307 Oct 11 19:57:25.581914 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1782/3497] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:25.597035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:25.620061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:25.620979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Searching by: {'deleted': False, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:57:25.640890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:25.641431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:25.641868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:25.642622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:25.643131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:25.643557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:25.717136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:57:25.787295 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9160ea04-045f-471b-8390-6ae7e51bf573 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.202357 Oct 11 19:57:25.800406 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1783/3498] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 19:57:25 2022] GET /compute/v2.1/servers => generated 344 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:25.806332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-86d5d414-56d6-4c87-a1b1-8a3ec3f592fc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:25.807305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-86d5d414-56d6-4c87-a1b1-8a3ec3f592fc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:25.814350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86d5d414-56d6-4c87-a1b1-8a3ec3f592fc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:25.814924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86d5d414-56d6-4c87-a1b1-8a3ec3f592fc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:25.815408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86d5d414-56d6-4c87-a1b1-8a3ec3f592fc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:25.816666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86d5d414-56d6-4c87-a1b1-8a3ec3f592fc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:25.817120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86d5d414-56d6-4c87-a1b1-8a3ec3f592fc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:25.817549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86d5d414-56d6-4c87-a1b1-8a3ec3f592fc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:26.764150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-86d5d414-56d6-4c87-a1b1-8a3ec3f592fc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:26.780058 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-86d5d414-56d6-4c87-a1b1-8a3ec3f592fc tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1519 microversion: 2.1 time: 0.977887 Oct 11 19:57:26.781813 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1784/3499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:25 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1519 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:26.789122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-194d4ab8-f773-453e-9239-d31517ef6c98 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:26.790073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-194d4ab8-f773-453e-9239-d31517ef6c98 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:26.796892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-194d4ab8-f773-453e-9239-d31517ef6c98 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:26.798827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-194d4ab8-f773-453e-9239-d31517ef6c98 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:26.800711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-194d4ab8-f773-453e-9239-d31517ef6c98 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:26.802037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-194d4ab8-f773-453e-9239-d31517ef6c98 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:26.802772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-194d4ab8-f773-453e-9239-d31517ef6c98 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:26.803417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-194d4ab8-f773-453e-9239-d31517ef6c98 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:26.838656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-194d4ab8-f773-453e-9239-d31517ef6c98 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:57:26.957148 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-194d4ab8-f773-453e-9239-d31517ef6c98 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 204 len: 0 microversion: 2.1 time: 0.173028 Oct 11 19:57:26.958713 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1785/3500] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:57:26 2022] DELETE /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:57:26.967175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-df717180-0b91-4649-989e-ff8eb340931c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:26.968675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-df717180-0b91-4649-989e-ff8eb340931c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:26.974891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df717180-0b91-4649-989e-ff8eb340931c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:26.975568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df717180-0b91-4649-989e-ff8eb340931c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:26.976131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df717180-0b91-4649-989e-ff8eb340931c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:26.977232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df717180-0b91-4649-989e-ff8eb340931c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:26.977701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df717180-0b91-4649-989e-ff8eb340931c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:26.978494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df717180-0b91-4649-989e-ff8eb340931c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:27.304825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-df717180-0b91-4649-989e-ff8eb340931c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:27.313022 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-df717180-0b91-4649-989e-ff8eb340931c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1315 microversion: 2.1 time: 0.352719 Oct 11 19:57:27.326553 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1786/3501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:26 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:27.332822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:27.344516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:27.345419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Searching by: {'deleted': False, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 19:57:27.357581 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cb23be7a-4542-4190-bbb3-3b9a1e0a12fd tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/f8379b13-bac0-4230-8953-d874fde78ca3" status: 202 len: 0 microversion: 2.1 time: 3.471301 Oct 11 19:57:27.358518 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1716/3502] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:57:23 2022] DELETE /compute/v2.1/os-floating-ips/f8379b13-bac0-4230-8953-d874fde78ca3 => generated 0 bytes in 3473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:27.359170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:27.359805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:27.360749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:27.361493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:27.361949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:27.362392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:27.364150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5766fcd5-e6c4-4a37-bd6c-3e25dc5d564c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:27.364762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5766fcd5-e6c4-4a37-bd6c-3e25dc5d564c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:27.371013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5766fcd5-e6c4-4a37-bd6c-3e25dc5d564c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:27.371756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5766fcd5-e6c4-4a37-bd6c-3e25dc5d564c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:27.372406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5766fcd5-e6c4-4a37-bd6c-3e25dc5d564c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:27.373301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5766fcd5-e6c4-4a37-bd6c-3e25dc5d564c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:27.373949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5766fcd5-e6c4-4a37-bd6c-3e25dc5d564c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:27.374610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5766fcd5-e6c4-4a37-bd6c-3e25dc5d564c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:27.392499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 19:57:27.431451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:27.438472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:27.438682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:27.439160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:27.741947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5766fcd5-e6c4-4a37-bd6c-3e25dc5d564c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:27.757909 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5766fcd5-e6c4-4a37-bd6c-3e25dc5d564c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.397775 Oct 11 19:57:27.758965 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1717/3503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:27 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:27.763816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8909dc8-1e83-464a-a7c3-2d6d2c3360fb tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:27.764423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c8909dc8-1e83-464a-a7c3-2d6d2c3360fb tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:27.770687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8909dc8-1e83-464a-a7c3-2d6d2c3360fb tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:27.771483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8909dc8-1e83-464a-a7c3-2d6d2c3360fb tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:27.772137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8909dc8-1e83-464a-a7c3-2d6d2c3360fb tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:27.773054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8909dc8-1e83-464a-a7c3-2d6d2c3360fb tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:27.773724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8909dc8-1e83-464a-a7c3-2d6d2c3360fb tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:27.774368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8909dc8-1e83-464a-a7c3-2d6d2c3360fb tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:27.836804 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4f3a0794-53ac-44be-8e58-3959014b2fda tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.522137 Oct 11 19:57:27.837752 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1787/3504] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 19:57:27 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:27.842895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.147"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:28.262476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:28.269208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:28.269575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:28.270100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:28.270962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:28.273028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c8909dc8-1e83-464a-a7c3-2d6d2c3360fb tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:28.273622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:28.274154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:28.283428 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8909dc8-1e83-464a-a7c3-2d6d2c3360fb tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1471 microversion: 2.1 time: 0.522839 Oct 11 19:57:28.287660 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1718/3505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:27 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1471 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:28.294587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-786c3843-a603-4b36-95cf-8c70304ee3e2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:28.308958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-786c3843-a603-4b36-95cf-8c70304ee3e2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:28.324953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-786c3843-a603-4b36-95cf-8c70304ee3e2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:28.326128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-786c3843-a603-4b36-95cf-8c70304ee3e2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:28.328448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-786c3843-a603-4b36-95cf-8c70304ee3e2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:28.329438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-786c3843-a603-4b36-95cf-8c70304ee3e2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:28.333403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-786c3843-a603-4b36-95cf-8c70304ee3e2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:28.334160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-786c3843-a603-4b36-95cf-8c70304ee3e2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:28.827837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-786c3843-a603-4b36-95cf-8c70304ee3e2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:28.837608 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-786c3843-a603-4b36-95cf-8c70304ee3e2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1519 microversion: 2.1 time: 0.548269 Oct 11 19:57:28.841602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:57:28.842733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquired lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:57:28.854831 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1719/3506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:28 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1519 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:28.864146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84bf3585-1eed-4cbb-b095-a0e33bdf663c tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:28.874149 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-84bf3585-1eed-4cbb-b095-a0e33bdf663c tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017745 Oct 11 19:57:28.875626 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1720/3507] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:57:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:28.882110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ce04569a-501d-4c7f-93bf-c7b59d4d8543 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:28.883089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ce04569a-501d-4c7f-93bf-c7b59d4d8543 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:28.891567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce04569a-501d-4c7f-93bf-c7b59d4d8543 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:28.892933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce04569a-501d-4c7f-93bf-c7b59d4d8543 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:28.893738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce04569a-501d-4c7f-93bf-c7b59d4d8543 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:28.896627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce04569a-501d-4c7f-93bf-c7b59d4d8543 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:28.897591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce04569a-501d-4c7f-93bf-c7b59d4d8543 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:28.898289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce04569a-501d-4c7f-93bf-c7b59d4d8543 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:29.292820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce04569a-501d-4c7f-93bf-c7b59d4d8543 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:29.304850 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ce04569a-501d-4c7f-93bf-c7b59d4d8543 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1315 microversion: 2.1 time: 0.427921 Oct 11 19:57:29.307212 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1721/3508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:28 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:29.318868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c2bac64-7f38-41e9-960c-a0a3e6f25b97 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:29.319560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c2bac64-7f38-41e9-960c-a0a3e6f25b97 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:29.338188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c2bac64-7f38-41e9-960c-a0a3e6f25b97 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:29.338735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c2bac64-7f38-41e9-960c-a0a3e6f25b97 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:29.339197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c2bac64-7f38-41e9-960c-a0a3e6f25b97 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:29.339938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c2bac64-7f38-41e9-960c-a0a3e6f25b97 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:29.340782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c2bac64-7f38-41e9-960c-a0a3e6f25b97 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:29.340782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c2bac64-7f38-41e9-960c-a0a3e6f25b97 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:30.172022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9c2bac64-7f38-41e9-960c-a0a3e6f25b97 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:30.185973 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c2bac64-7f38-41e9-960c-a0a3e6f25b97 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.877377 Oct 11 19:57:30.188798 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1722/3509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:29 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:30.215893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2154dfe-abf6-4e84-bc44-84defef2de91 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:30.220942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a2154dfe-abf6-4e84-bc44-84defef2de91 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:30.229988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2154dfe-abf6-4e84-bc44-84defef2de91 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:30.230490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2154dfe-abf6-4e84-bc44-84defef2de91 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:30.230957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2154dfe-abf6-4e84-bc44-84defef2de91 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:30.231666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2154dfe-abf6-4e84-bc44-84defef2de91 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:30.232142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2154dfe-abf6-4e84-bc44-84defef2de91 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:30.232574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2154dfe-abf6-4e84-bc44-84defef2de91 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:30.262976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a2154dfe-abf6-4e84-bc44-84defef2de91 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:57:30.392472 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a2154dfe-abf6-4e84-bc44-84defef2de91 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 204 len: 0 microversion: 2.1 time: 0.201964 Oct 11 19:57:30.393835 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1723/3510] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:57:30 2022] DELETE /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:57:30.405392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-485cc547-31d5-4eea-b18c-2a71f98e1e49 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:30.406378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-485cc547-31d5-4eea-b18c-2a71f98e1e49 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:30.415539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-485cc547-31d5-4eea-b18c-2a71f98e1e49 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:30.416399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-485cc547-31d5-4eea-b18c-2a71f98e1e49 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:30.417864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-485cc547-31d5-4eea-b18c-2a71f98e1e49 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:30.418860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-485cc547-31d5-4eea-b18c-2a71f98e1e49 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:30.419554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-485cc547-31d5-4eea-b18c-2a71f98e1e49 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:30.420181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-485cc547-31d5-4eea-b18c-2a71f98e1e49 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:30.566118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-485cc547-31d5-4eea-b18c-2a71f98e1e49 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e16fd8c73b4d609b7f4cad18389978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c55a426691c4e53ab0e77715dd251a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:30.579872 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-485cc547-31d5-4eea-b18c-2a71f98e1e49 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 200 len: 1429 microversion: 2.1 time: 0.184125 Oct 11 19:57:30.581360 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1724/3511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:30 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 1429 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:30.592092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bf318dd5-0374-49b6-ae66-31a46a35d23c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:30.592954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bf318dd5-0374-49b6-ae66-31a46a35d23c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:30.611948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf318dd5-0374-49b6-ae66-31a46a35d23c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:30.612923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf318dd5-0374-49b6-ae66-31a46a35d23c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:30.613544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf318dd5-0374-49b6-ae66-31a46a35d23c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:30.616222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf318dd5-0374-49b6-ae66-31a46a35d23c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:30.616975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf318dd5-0374-49b6-ae66-31a46a35d23c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:30.620603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Building network info cache for instance {{(pid=126956) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 19:57:30.621878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf318dd5-0374-49b6-ae66-31a46a35d23c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:31.287376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bf318dd5-0374-49b6-ae66-31a46a35d23c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:31.299725 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bf318dd5-0374-49b6-ae66-31a46a35d23c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1519 microversion: 2.1 time: 0.716939 Oct 11 19:57:31.300511 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1725/3512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:30 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1519 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:31.314594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cd4fd78f-6290-46cf-aa7b-0146a4c2d20e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:31.316177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cd4fd78f-6290-46cf-aa7b-0146a4c2d20e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:31.329799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd4fd78f-6290-46cf-aa7b-0146a4c2d20e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:31.330664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd4fd78f-6290-46cf-aa7b-0146a4c2d20e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:31.331483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd4fd78f-6290-46cf-aa7b-0146a4c2d20e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:31.332426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd4fd78f-6290-46cf-aa7b-0146a4c2d20e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:31.333727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd4fd78f-6290-46cf-aa7b-0146a4c2d20e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:31.334756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd4fd78f-6290-46cf-aa7b-0146a4c2d20e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:31.938588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cd4fd78f-6290-46cf-aa7b-0146a4c2d20e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:31.950310 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cd4fd78f-6290-46cf-aa7b-0146a4c2d20e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1315 microversion: 2.1 time: 0.648341 Oct 11 19:57:31.950933 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1726/3513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:31 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:31.959727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6c9f08f-88d7-4b49-b808-e24d76645c50 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:31.966619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a6c9f08f-88d7-4b49-b808-e24d76645c50 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:31.975666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6c9f08f-88d7-4b49-b808-e24d76645c50 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:31.987887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6c9f08f-88d7-4b49-b808-e24d76645c50 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:31.988731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6c9f08f-88d7-4b49-b808-e24d76645c50 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:31.989770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6c9f08f-88d7-4b49-b808-e24d76645c50 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:31.990561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6c9f08f-88d7-4b49-b808-e24d76645c50 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:31.991227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6c9f08f-88d7-4b49-b808-e24d76645c50 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:32.215785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Updating instance_info_cache with network_info: [{"id": "6ff9f802-da11-4f74-900d-b80cccb9041b", "address": "fa:16:3e:59:f6:8c", "network": {"id": "963eb12a-addf-44c1-a4c3-817337475ff3", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-81926066-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3c560285045d4c17b0f4d86e31c6f584", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6ff9f802-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126956) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 19:57:32.233853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Releasing lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126956) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:57:32.234977 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cbc3d469-c9dc-4580-a04c-ae179d44cb91 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action" status: 202 len: 0 microversion: 2.1 time: 4.396088 Oct 11 19:57:32.239767 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1788/3514] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:27 2022] POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action => generated 0 bytes in 4401 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 19:57:32.247533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f1a625f7-e11e-41e8-b908-bd1bf739afe3 req-6548a89d-709d-49cd-b618-60b34ea59b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b74878-0856-4c96-801f-9a14951d647f", "tag": "6ff9f802-da11-4f74-900d-b80cccb9041b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:32.264701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f1a625f7-e11e-41e8-b908-bd1bf739afe3 req-6548a89d-709d-49cd-b618-60b34ea59b0c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:32.266200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f1a625f7-e11e-41e8-b908-bd1bf739afe3 req-6548a89d-709d-49cd-b618-60b34ea59b0c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:32.266863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f1a625f7-e11e-41e8-b908-bd1bf739afe3 req-6548a89d-709d-49cd-b618-60b34ea59b0c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:32.279827 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f1a625f7-e11e-41e8-b908-bd1bf739afe3 req-6548a89d-709d-49cd-b618-60b34ea59b0c service nova] Creating event network-changed:6ff9f802-da11-4f74-900d-b80cccb9041b for instance 57b74878-0856-4c96-801f-9a14951d647f on n-h2-860864-3 Oct 11 19:57:32.302876 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f1a625f7-e11e-41e8-b908-bd1bf739afe3 req-6548a89d-709d-49cd-b618-60b34ea59b0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060574 Oct 11 19:57:32.305034 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1789/3515] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:32.315048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40485d5b-3ab8-4de0-91c9-cca766e3cb45 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:32.316256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-40485d5b-3ab8-4de0-91c9-cca766e3cb45 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:32.326818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40485d5b-3ab8-4de0-91c9-cca766e3cb45 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:32.327611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40485d5b-3ab8-4de0-91c9-cca766e3cb45 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:32.329077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40485d5b-3ab8-4de0-91c9-cca766e3cb45 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:32.330169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40485d5b-3ab8-4de0-91c9-cca766e3cb45 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:32.333162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40485d5b-3ab8-4de0-91c9-cca766e3cb45 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:32.333919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40485d5b-3ab8-4de0-91c9-cca766e3cb45 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:32.462838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6c9f08f-88d7-4b49-b808-e24d76645c50 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:32.481683 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6c9f08f-88d7-4b49-b808-e24d76645c50 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1608 microversion: 2.1 time: 0.525893 Oct 11 19:57:32.500919 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1727/3516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:31 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1608 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:32.505496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:32.506118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] [instance: f2742468-e532-49c8-8797-5f3572f6786f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:32.512991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:32.513805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:32.514258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:32.515076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:32.515584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:32.516025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:32.532450 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] HTTP exception thrown: Instance f2742468-e532-49c8-8797-5f3572f6786f could not be found. Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Request method failure captured: Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f HTTP/1.1 Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRco085IlBROCePDllh9tKAIYPsSzgX5td84mGwngN8ACIhmD38iAbmWwzM0IlF25SsKal5NvNcJpnXGfRF9yEa4gpXqvcxRFWp1SKwq191GHg7ctW_Qyd0KomUZN3SBNA5Vo0xoS7Qw-YhoGvoI2heJICj3PqjklUZz3yuEwqqBr8gc Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 6c55a426691c4e53ab0e77715dd251a2 Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesOneServerTestJSON-1145387263 Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c55a426691c4e53ab0e77715dd251a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c55a426691c4e53ab0e77715dd251a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c55a426691c4e53ab0e77715dd251a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c55a426691c4e53ab0e77715dd251a2"}]}] Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesOneServerTestJSON-1145387263 Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 6c55a426691c4e53ab0e77715dd251a2 Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1145387263 Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesOneServerTestJSON-1145387263-project Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 35e16fd8c73b4d609b7f4cad18389978 Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesOneServerTestJSON-1145387263-project Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f2742468-e532-49c8-8797-5f3572f6786f could not be found. Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f2742468-e532-49c8-8797-5f3572f6786f'} Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2742468-e532-49c8-8797-5f3572f6786f could not be found. Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2742468-e532-49c8-8797-5f3572f6786f could not be found. Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:32.534390 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:32.540366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:32.540366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:32.540366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:32.540366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:32.540366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:32.540366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2742468-e532-49c8-8797-5f3572f6786f could not be found. Oct 11 19:57:32.540366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:32.540366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] Returning 404 to user: Instance f2742468-e532-49c8-8797-5f3572f6786f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:32.540366 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f561afc7-4606-4375-aa3f-d14d26402234 tempest-ImagesOneServerTestJSON-1145387263 tempest-ImagesOneServerTestJSON-1145387263-project] 10.222.0.27 "GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f" status: 404 len: 111 microversion: 2.1 time: 0.047008 Oct 11 19:57:32.540366 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1728/3517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:32 2022] GET /compute/v2.1/servers/f2742468-e532-49c8-8797-5f3572f6786f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:32.544468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e0fee860-fc08-4c6b-9bdb-0f404ac741d1 req-2ba9fec1-ce68-4d7c-8d2b-a424168ff6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bbcb06-9011-4ae8-874b-b03b92aeb1df", "name": "network-vif-plugged", "status": "completed", "tag": "3757429c-6734-44c3-a22e-a3443f350784"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:32.556327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e0fee860-fc08-4c6b-9bdb-0f404ac741d1 req-2ba9fec1-ce68-4d7c-8d2b-a424168ff6c4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:32.557215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e0fee860-fc08-4c6b-9bdb-0f404ac741d1 req-2ba9fec1-ce68-4d7c-8d2b-a424168ff6c4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:32.558229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e0fee860-fc08-4c6b-9bdb-0f404ac741d1 req-2ba9fec1-ce68-4d7c-8d2b-a424168ff6c4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:32.577465 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e0fee860-fc08-4c6b-9bdb-0f404ac741d1 req-2ba9fec1-ce68-4d7c-8d2b-a424168ff6c4 service nova] Creating event network-vif-plugged:3757429c-6734-44c3-a22e-a3443f350784 for instance f3bbcb06-9011-4ae8-874b-b03b92aeb1df on n-h1-860864-3 Oct 11 19:57:32.587834 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e0fee860-fc08-4c6b-9bdb-0f404ac741d1 req-2ba9fec1-ce68-4d7c-8d2b-a424168ff6c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047055 Oct 11 19:57:32.589036 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1729/3518] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:32.597248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5af84ea4-44ea-4269-800a-c6ad8730bdee tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '.version_select at 0x7f83d0700ee0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:32.975592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-40485d5b-3ab8-4de0-91c9-cca766e3cb45 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:32.996143 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40485d5b-3ab8-4de0-91c9-cca766e3cb45 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.689534 Oct 11 19:57:32.999304 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1790/3519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:32 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:33.005005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-56e6ddec-c448-471e-913f-1e5dfdeb7464 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:33.006552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-56e6ddec-c448-471e-913f-1e5dfdeb7464 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:33.015154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56e6ddec-c448-471e-913f-1e5dfdeb7464 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:33.015929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56e6ddec-c448-471e-913f-1e5dfdeb7464 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:33.016430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56e6ddec-c448-471e-913f-1e5dfdeb7464 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:33.017196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56e6ddec-c448-471e-913f-1e5dfdeb7464 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:33.017736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56e6ddec-c448-471e-913f-1e5dfdeb7464 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:33.018224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56e6ddec-c448-471e-913f-1e5dfdeb7464 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:33.575397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56e6ddec-c448-471e-913f-1e5dfdeb7464 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:33.579020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:33.602188 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-56e6ddec-c448-471e-913f-1e5dfdeb7464 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1519 microversion: 2.1 time: 0.601052 Oct 11 19:57:33.603028 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1791/3520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:32 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1519 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:33.608199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9ea3a520-90a5-4851-b929-25214d70c19b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:33.608820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9ea3a520-90a5-4851-b929-25214d70c19b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:33.630249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea3a520-90a5-4851-b929-25214d70c19b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:33.631410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea3a520-90a5-4851-b929-25214d70c19b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:33.635207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea3a520-90a5-4851-b929-25214d70c19b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:33.636337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea3a520-90a5-4851-b929-25214d70c19b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:33.637322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea3a520-90a5-4851-b929-25214d70c19b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:33.639038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea3a520-90a5-4851-b929-25214d70c19b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:34.562997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9ea3a520-90a5-4851-b929-25214d70c19b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:34.571490 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9ea3a520-90a5-4851-b929-25214d70c19b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1315 microversion: 2.1 time: 0.967260 Oct 11 19:57:34.572391 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1792/3521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:33 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1315 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:34.615331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e2b02f4-464a-47ca-8a11-95b04b681065 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:34.616280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e2b02f4-464a-47ca-8a11-95b04b681065 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:34.626344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:34.637280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e2b02f4-464a-47ca-8a11-95b04b681065 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:34.637791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e2b02f4-464a-47ca-8a11-95b04b681065 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:34.638239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e2b02f4-464a-47ca-8a11-95b04b681065 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:34.639484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e2b02f4-464a-47ca-8a11-95b04b681065 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:34.640336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e2b02f4-464a-47ca-8a11-95b04b681065 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:34.640943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e2b02f4-464a-47ca-8a11-95b04b681065 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:34.788455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e2b02f4-464a-47ca-8a11-95b04b681065 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:34.798891 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e2b02f4-464a-47ca-8a11-95b04b681065 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1540 microversion: 2.1 time: 0.225057 Oct 11 19:57:34.818517 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1793/3522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:34 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1540 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:34.824979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3d17aaf5-9084-4964-a2a0-4e1fac1fcae6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:34.825767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3d17aaf5-9084-4964-a2a0-4e1fac1fcae6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:34.833460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d17aaf5-9084-4964-a2a0-4e1fac1fcae6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:34.834136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d17aaf5-9084-4964-a2a0-4e1fac1fcae6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:34.834786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d17aaf5-9084-4964-a2a0-4e1fac1fcae6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:34.835678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d17aaf5-9084-4964-a2a0-4e1fac1fcae6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:34.836313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d17aaf5-9084-4964-a2a0-4e1fac1fcae6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:34.836891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d17aaf5-9084-4964-a2a0-4e1fac1fcae6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:35.191452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3d17aaf5-9084-4964-a2a0-4e1fac1fcae6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:35.204529 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3d17aaf5-9084-4964-a2a0-4e1fac1fcae6 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.384336 Oct 11 19:57:35.206897 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1794/3523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:34 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:35.214465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-24ab8e71-50e5-4878-b56a-01ffaefa46c5 req-f040f518-68b2-4b12-a321-3fcad6912b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2742468-e532-49c8-8797-5f3572f6786f", "name": "network-vif-deleted", "tag": "1c5eacd7-fba5-46ee-b79b-51ac38302947"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:35.242490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-24ab8e71-50e5-4878-b56a-01ffaefa46c5 req-f040f518-68b2-4b12-a321-3fcad6912b60 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:35.245225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-24ab8e71-50e5-4878-b56a-01ffaefa46c5 req-f040f518-68b2-4b12-a321-3fcad6912b60 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:35.247847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-24ab8e71-50e5-4878-b56a-01ffaefa46c5 req-f040f518-68b2-4b12-a321-3fcad6912b60 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:35.294081 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-24ab8e71-50e5-4878-b56a-01ffaefa46c5 req-f040f518-68b2-4b12-a321-3fcad6912b60 service nova] Creating event network-vif-deleted:1c5eacd7-fba5-46ee-b79b-51ac38302947 for instance f2742468-e532-49c8-8797-5f3572f6786f on n-h2-860864-3 Oct 11 19:57:35.313930 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-24ab8e71-50e5-4878-b56a-01ffaefa46c5 req-f040f518-68b2-4b12-a321-3fcad6912b60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104456 Oct 11 19:57:35.314970 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1795/3524] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:35.330333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-57fc656d-9f00-4ad2-a94e-5762b975eead req-eab494a7-5bd3-4ff0-b173-139a9c481596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f1dc40-ef33-40f8-b128-d5c6367e833e", "name": "network-vif-plugged", "status": "completed", "tag": "7033f16c-8fb2-4050-810b-a6de0ea759f0"}, {"server_uuid": "0795791f-2f7c-418b-8c82-7f1bfb623e93", "name": "network-vif-unplugged", "status": "completed", "tag": "22ee4a7b-aafc-48ad-8a2b-8316827168cb"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:35.368011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-57fc656d-9f00-4ad2-a94e-5762b975eead req-eab494a7-5bd3-4ff0-b173-139a9c481596 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:35.371595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-57fc656d-9f00-4ad2-a94e-5762b975eead req-eab494a7-5bd3-4ff0-b173-139a9c481596 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:35.374681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-57fc656d-9f00-4ad2-a94e-5762b975eead req-eab494a7-5bd3-4ff0-b173-139a9c481596 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:35.416635 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-57fc656d-9f00-4ad2-a94e-5762b975eead req-eab494a7-5bd3-4ff0-b173-139a9c481596 service nova] Creating event network-vif-plugged:7033f16c-8fb2-4050-810b-a6de0ea759f0 for instance 85f1dc40-ef33-40f8-b128-d5c6367e833e on n-h1-860864-3 Oct 11 19:57:35.431143 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-57fc656d-9f00-4ad2-a94e-5762b975eead req-eab494a7-5bd3-4ff0-b173-139a9c481596 service nova] Creating event network-vif-unplugged:22ee4a7b-aafc-48ad-8a2b-8316827168cb for instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 on n-h1-860864-3 Oct 11 19:57:35.449668 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-57fc656d-9f00-4ad2-a94e-5762b975eead req-eab494a7-5bd3-4ff0-b173-139a9c481596 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.132708 Oct 11 19:57:35.455616 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1796/3525] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:35.470554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c302f62-9ba5-4562-81d3-03a191f98f64 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:35.471266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4c302f62-9ba5-4562-81d3-03a191f98f64 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:35.506121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c302f62-9ba5-4562-81d3-03a191f98f64 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:35.506753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c302f62-9ba5-4562-81d3-03a191f98f64 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:35.507563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c302f62-9ba5-4562-81d3-03a191f98f64 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:35.508013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c302f62-9ba5-4562-81d3-03a191f98f64 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:35.508470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c302f62-9ba5-4562-81d3-03a191f98f64 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:35.508937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c302f62-9ba5-4562-81d3-03a191f98f64 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:35.513982 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5af84ea4-44ea-4269-800a-c6ad8730bdee tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/fba3f973-f224-45b7-97be-e5af600adcdb" status: 202 len: 0 microversion: 2.1 time: 2.923105 Oct 11 19:57:35.514603 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1730/3526] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 19:57:32 2022] DELETE /compute/v2.1/os-floating-ips/fba3f973-f224-45b7-97be-e5af600adcdb => generated 0 bytes in 2925 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:35.526585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc6acdf2-08cf-446b-be39-0d007378e038 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc6acdf2-08cf-446b-be39-0d007378e038 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Request method failure captured: Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action HTTP/1.1 Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 34 Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcpvwAFkJ66y49UCZJptptK8kJXNSFybsqunNUo_GJZ-yYR_uypFGk3eQMup-1PIrsdIQp8Fs0g3oGcKuyvQgJat9g3rmpClop7uKNt4bLfirTtJPvDt-9HCvU0w2dGbdvSpBxgbtVF1FMkD8qkFulWeWXn5OHheXHRYEY5luTebxSg Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3c560285045d4c17b0f4d86e31c6f584 Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c560285045d4c17b0f4d86e31c6f584"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c560285045d4c17b0f4d86e31c6f584", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c560285045d4c17b0f4d86e31c6f584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c560285045d4c17b0f4d86e31c6f584"}]}] Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3c560285045d4c17b0f4d86e31c6f584 Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 246e8a514537477fb2ca87e3f4117f3e Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: {"addFloatingIp": {"address": ""}} Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '57b74878-0856-4c96-801f-9a14951d647f', 'body': {'addFloatingIp': {'address': ''}}} Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi '' Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:57:35.532749 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 19:57:35.539547 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.546042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc6acdf2-08cf-446b-be39-0d007378e038 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:35.547541 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc6acdf2-08cf-446b-be39-0d007378e038 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action" status: 400 len: 142 microversion: 2.1 time: 0.025065 Oct 11 19:57:35.549158 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1731/3527] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:35 2022] POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action => generated 142 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:57:35.570001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:35.579931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:35.587476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:35.609258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:35.611336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:35.613507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:35.614440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:35.615945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:35.616494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:35.657989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 19:57:35.658408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquired lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 19:57:35.885651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4c302f62-9ba5-4562-81d3-03a191f98f64 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:35.899830 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4c302f62-9ba5-4562-81d3-03a191f98f64 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1519 microversion: 2.1 time: 0.438139 Oct 11 19:57:35.907809 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1797/3528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:35 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1519 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:35.918075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1de848f3-0d67-4894-aecb-43ce17914955 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:35.918782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1de848f3-0d67-4894-aecb-43ce17914955 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:35.932499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Releasing lock "refresh_cache-57b74878-0856-4c96-801f-9a14951d647f" {{(pid=126955) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 19:57:35.933075 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] HTTP exception thrown: floating IP not found Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Request method failure captured: Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action HTTP/1.1 Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 41 Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcpvwAFkJ66y49UCZJptptK8kJXNSFybsqunNUo_GJZ-yYR_uypFGk3eQMup-1PIrsdIQp8Fs0g3oGcKuyvQgJat9g3rmpClop7uKNt4bLfirTtJPvDt-9HCvU0w2dGbdvSpBxgbtVF1FMkD8qkFulWeWXn5OHheXHRYEY5luTebxSg Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3c560285045d4c17b0f4d86e31c6f584 Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c560285045d4c17b0f4d86e31c6f584"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c560285045d4c17b0f4d86e31c6f584", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c560285045d4c17b0f4d86e31c6f584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c560285045d4c17b0f4d86e31c6f584"}]}] Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3c560285045d4c17b0f4d86e31c6f584 Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 246e8a514537477fb2ca87e3f4117f3e Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: exception: floating IP not found Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '57b74878-0856-4c96-801f-9a14951d647f', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 11 19:57:35.934780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Returning 404 to user: floating IP not found {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-30689fd5-c0d1-49fd-83a4-915ea93181ea tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action" status: 404 len: 67 microversion: 2.1 time: 0.380704 Oct 11 19:57:35.940189 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1732/3529] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:35 2022] POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action => generated 67 bytes in 382 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:57:35.945459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de848f3-0d67-4894-aecb-43ce17914955 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:35.945970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de848f3-0d67-4894-aecb-43ce17914955 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:35.949044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de848f3-0d67-4894-aecb-43ce17914955 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:35.949044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de848f3-0d67-4894-aecb-43ce17914955 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:35.949044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de848f3-0d67-4894-aecb-43ce17914955 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:35.949044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de848f3-0d67-4894-aecb-43ce17914955 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:36.210112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1de848f3-0d67-4894-aecb-43ce17914955 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:36.222169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1de848f3-0d67-4894-aecb-43ce17914955 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1503 microversion: 2.1 time: 0.313142 Oct 11 19:57:36.227451 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1798/3530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:35 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:36.235963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-60e98db8-c8cb-4ec8-8fa5-3c6cb40af378 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:36.240219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-60e98db8-c8cb-4ec8-8fa5-3c6cb40af378 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:36.257439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e98db8-c8cb-4ec8-8fa5-3c6cb40af378 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:36.258190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e98db8-c8cb-4ec8-8fa5-3c6cb40af378 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:36.261212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e98db8-c8cb-4ec8-8fa5-3c6cb40af378 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:36.262213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e98db8-c8cb-4ec8-8fa5-3c6cb40af378 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:36.265196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e98db8-c8cb-4ec8-8fa5-3c6cb40af378 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:36.266230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e98db8-c8cb-4ec8-8fa5-3c6cb40af378 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:36.284045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bae083ab-be13-4d7a-89c1-2d9cabb269f5 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Action: 'create', calling method: .version_select at 0x7f83d069f700>, body: {"keypair": {"name": "tempest-keypair-964013005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKdNxJRT7gWJynL4cadgjHgqMZA9rF20unEYekGQ93a2G/tmfbQm/w1Bww5qWI6pArG0ZnwSUy/YkiGWWp+wzNqbTrePUejr++bW7I3kt3tIJXcZXsJ61yGm96VBwhPdw=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:36.319711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-bae083ab-be13-4d7a-89c1-2d9cabb269f5 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:57:36.329996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-bae083ab-be13-4d7a-89c1-2d9cabb269f5 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for user eec83482c57a49948ab8e52fe38a6530 and project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:57:36.387535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-60e98db8-c8cb-4ec8-8fa5-3c6cb40af378 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:36.392178 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bae083ab-be13-4d7a-89c1-2d9cabb269f5 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.454001 Oct 11 19:57:36.397114 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-60e98db8-c8cb-4ec8-8fa5-3c6cb40af378 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1252 microversion: 2.1 time: 0.167673 Oct 11 19:57:36.400512 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1733/3531] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:57:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:36.409015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0d73980-fdfb-4fc6-a67b-164f4133a3c4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:36.415197 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1799/3532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:36 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1252 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:36.421768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0de6a0f9-8455-44a6-8e14-43e45668d45f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:36.422582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0de6a0f9-8455-44a6-8e14-43e45668d45f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:36.429967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0de6a0f9-8455-44a6-8e14-43e45668d45f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:36.430716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0de6a0f9-8455-44a6-8e14-43e45668d45f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:36.431775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0de6a0f9-8455-44a6-8e14-43e45668d45f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:36.432685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0de6a0f9-8455-44a6-8e14-43e45668d45f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:36.433309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0de6a0f9-8455-44a6-8e14-43e45668d45f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:36.434064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0de6a0f9-8455-44a6-8e14-43e45668d45f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:36.477990 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-a0d73980-fdfb-4fc6-a67b-164f4133a3c4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0d73980-fdfb-4fc6-a67b-164f4133a3c4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Request method failure captured: Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action HTTP/1.1 Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 44 Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcpvwAFkJ66y49UCZJptptK8kJXNSFybsqunNUo_GJZ-yYR_uypFGk3eQMup-1PIrsdIQp8Fs0g3oGcKuyvQgJat9g3rmpClop7uKNt4bLfirTtJPvDt-9HCvU0w2dGbdvSpBxgbtVF1FMkD8qkFulWeWXn5OHheXHRYEY5luTebxSg Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3c560285045d4c17b0f4d86e31c6f584 Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c560285045d4c17b0f4d86e31c6f584"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c560285045d4c17b0f4d86e31c6f584", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c560285045d4c17b0f4d86e31c6f584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c560285045d4c17b0f4d86e31c6f584"}]}] Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3c560285045d4c17b0f4d86e31c6f584 Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 246e8a514537477fb2ca87e3f4117f3e Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: exception: Floating IP not found for address 0.0.0.0. Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '57b74878-0856-4c96-801f-9a14951d647f', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 11 19:57:36.479926 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0d73980-fdfb-4fc6-a67b-164f4133a3c4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:36.484920 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a0d73980-fdfb-4fc6-a67b-164f4133a3c4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action" status: 404 len: 88 microversion: 2.1 time: 0.082353 Oct 11 19:57:36.485864 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1734/3533] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:36 2022] POST /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f/action => generated 88 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:57:36.492669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8557a861-87d6-4b2f-a3bc-87fd6199e69a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:36.510094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8557a861-87d6-4b2f-a3bc-87fd6199e69a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:36.510626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8557a861-87d6-4b2f-a3bc-87fd6199e69a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:36.512998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8557a861-87d6-4b2f-a3bc-87fd6199e69a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:36.553781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:36.577371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8557a861-87d6-4b2f-a3bc-87fd6199e69a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Going to try to stop instance {{(pid=126955) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 19:57:36.676346 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8557a861-87d6-4b2f-a3bc-87fd6199e69a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df/action" status: 202 len: 0 microversion: 2.1 time: 0.189940 Oct 11 19:57:36.676968 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1735/3534] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:36 2022] POST /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:36.690599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2200f143-2640-4525-871b-6c8ccf8b03f5 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Calling method '.version_select at 0x7f83c73775e0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:36.717477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0de6a0f9-8455-44a6-8e14-43e45668d45f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:36.729667 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0de6a0f9-8455-44a6-8e14-43e45668d45f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.312238 Oct 11 19:57:36.730423 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1800/3535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:36 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:36.735470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10597536-d637-4185-8cd8-4e7f82e47ea4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:36.735989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10597536-d637-4185-8cd8-4e7f82e47ea4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:36.743756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10597536-d637-4185-8cd8-4e7f82e47ea4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:36.744643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10597536-d637-4185-8cd8-4e7f82e47ea4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:36.745264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10597536-d637-4185-8cd8-4e7f82e47ea4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:36.745785 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2200f143-2640-4525-871b-6c8ccf8b03f5 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-964013005" status: 200 len: 497 microversion: 2.1 time: 0.067493 Oct 11 19:57:36.746374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10597536-d637-4185-8cd8-4e7f82e47ea4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:36.746908 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1736/3536] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Oct 11 19:57:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-964013005 => generated 497 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:36.747206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10597536-d637-4185-8cd8-4e7f82e47ea4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:36.747831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10597536-d637-4185-8cd8-4e7f82e47ea4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:36.756955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6539ba06-3357-41c0-9597-a3cb7292bf83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:36.757704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6539ba06-3357-41c0-9597-a3cb7292bf83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:36.775612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6539ba06-3357-41c0-9597-a3cb7292bf83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:36.777215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6539ba06-3357-41c0-9597-a3cb7292bf83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:36.777921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6539ba06-3357-41c0-9597-a3cb7292bf83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:36.779872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6539ba06-3357-41c0-9597-a3cb7292bf83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:36.780361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6539ba06-3357-41c0-9597-a3cb7292bf83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:36.780942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6539ba06-3357-41c0-9597-a3cb7292bf83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:36.790709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10597536-d637-4185-8cd8-4e7f82e47ea4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:57:36.979255 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10597536-d637-4185-8cd8-4e7f82e47ea4 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "DELETE /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 204 len: 0 microversion: 2.1 time: 0.247347 Oct 11 19:57:36.979982 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1801/3537] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:57:36 2022] DELETE /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:57:36.996434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-177c9675-3f5a-4b4a-a33d-2f6dc5d76c79 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Calling method '.version_select at 0x7f83c72cfaf0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:37.057643 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-177c9675-3f5a-4b4a-a33d-2f6dc5d76c79 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964013005" status: 202 len: 0 microversion: 2.1 time: 0.075770 Oct 11 19:57:37.060294 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1802/3538] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 19:57:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964013005 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:37.070425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6539ba06-3357-41c0-9597-a3cb7292bf83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:37.078821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bae57723-e226-45eb-9fd8-04f1c9a00875 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:37.082870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bae57723-e226-45eb-9fd8-04f1c9a00875 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:37.087595 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6539ba06-3357-41c0-9597-a3cb7292bf83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 0.339572 Oct 11 19:57:37.088957 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1737/3539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:36 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:37.093758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-894a87c7-65f0-44b9-851f-d2b809d3c051 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:37.094584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-894a87c7-65f0-44b9-851f-d2b809d3c051 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:37.109253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae57723-e226-45eb-9fd8-04f1c9a00875 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:37.111584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae57723-e226-45eb-9fd8-04f1c9a00875 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:37.112339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae57723-e226-45eb-9fd8-04f1c9a00875 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:37.113837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae57723-e226-45eb-9fd8-04f1c9a00875 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:37.114256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae57723-e226-45eb-9fd8-04f1c9a00875 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:37.114793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae57723-e226-45eb-9fd8-04f1c9a00875 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:37.118624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-894a87c7-65f0-44b9-851f-d2b809d3c051 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:37.119125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-894a87c7-65f0-44b9-851f-d2b809d3c051 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:37.119561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-894a87c7-65f0-44b9-851f-d2b809d3c051 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:37.120264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-894a87c7-65f0-44b9-851f-d2b809d3c051 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:37.120718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-894a87c7-65f0-44b9-851f-d2b809d3c051 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:37.121140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-894a87c7-65f0-44b9-851f-d2b809d3c051 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:37.375875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:37.430198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:37.446984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bae57723-e226-45eb-9fd8-04f1c9a00875 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:37.460359 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bae57723-e226-45eb-9fd8-04f1c9a00875 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1519 microversion: 2.1 time: 0.394005 Oct 11 19:57:37.470556 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1803/3540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:37 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1519 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:37.477522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3fc8c3f8-60c5-4678-a1ce-aa2db00ecd4f tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Action: 'create', calling method: .version_select at 0x7f83d07d6160>, body: {"keypair": {"name": "tempest-keypair-1132728761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa7ANW0Ej3B4eNdf3K9RqNvfCOWLu48eau3ujx0e0ZKl1S6cciGTB1MW+pCWFPOl2OXZU2N3XT6Jx1+vrMGj281/B2ykKLROGnVTY1Bz12QnnaqFUkQjjRwaFq+CqcPg=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:37.477792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-894a87c7-65f0-44b9-851f-d2b809d3c051 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:37.484542 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-894a87c7-65f0-44b9-851f-d2b809d3c051 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1539 microversion: 2.1 time: 0.394314 Oct 11 19:57:37.499565 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1738/3541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:37 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1539 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:37.506490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-3fc8c3f8-60c5-4678-a1ce-aa2db00ecd4f tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:57:37.512932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-3fc8c3f8-60c5-4678-a1ce-aa2db00ecd4f tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for user eec83482c57a49948ab8e52fe38a6530 and project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:57:37.568082 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3fc8c3f8-60c5-4678-a1ce-aa2db00ecd4f tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104517 Oct 11 19:57:37.572932 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1804/3542] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:57:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:37.586548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f7ce843c-55ff-47e3-98e9-c9ea24a4d9b0 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:37.588122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f7ce843c-55ff-47e3-98e9-c9ea24a4d9b0 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:37.600330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7ce843c-55ff-47e3-98e9-c9ea24a4d9b0 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:37.602177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7ce843c-55ff-47e3-98e9-c9ea24a4d9b0 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:37.603134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7ce843c-55ff-47e3-98e9-c9ea24a4d9b0 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:37.603800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7ce843c-55ff-47e3-98e9-c9ea24a4d9b0 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:37.604327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7ce843c-55ff-47e3-98e9-c9ea24a4d9b0 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:37.604762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7ce843c-55ff-47e3-98e9-c9ea24a4d9b0 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:37.699057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7ce843c-55ff-47e3-98e9-c9ea24a4d9b0 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:37.708116 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f7ce843c-55ff-47e3-98e9-c9ea24a4d9b0 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1252 microversion: 2.1 time: 0.133905 Oct 11 19:57:37.710419 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1805/3543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:37 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1252 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:37.724666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-247308f8-a7dd-4c9b-887e-59c68d7e8483 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Calling method '.version_select at 0x7f83cc9fc040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:37.753565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1c4f6c23-92bb-4d3d-bfdb-8a0d63e7fcf0 req-796eb56c-05c7-45d9-90a4-c1255d67c9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0795791f-2f7c-418b-8c82-7f1bfb623e93", "name": "network-vif-deleted", "tag": "22ee4a7b-aafc-48ad-8a2b-8316827168cb"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:37.765774 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-247308f8-a7dd-4c9b-887e-59c68d7e8483 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132728761" status: 202 len: 0 microversion: 2.1 time: 0.045191 Oct 11 19:57:37.770465 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1806/3544] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 19:57:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132728761 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:37.778978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1c4f6c23-92bb-4d3d-bfdb-8a0d63e7fcf0 req-796eb56c-05c7-45d9-90a4-c1255d67c9af service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:37.779609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1c4f6c23-92bb-4d3d-bfdb-8a0d63e7fcf0 req-796eb56c-05c7-45d9-90a4-c1255d67c9af service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:37.782043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1c4f6c23-92bb-4d3d-bfdb-8a0d63e7fcf0 req-796eb56c-05c7-45d9-90a4-c1255d67c9af service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:37.782295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ceab1cff-9711-48b0-92cf-0b10734178fa tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:37.785179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ceab1cff-9711-48b0-92cf-0b10734178fa tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:37.802340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceab1cff-9711-48b0-92cf-0b10734178fa tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:37.803100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceab1cff-9711-48b0-92cf-0b10734178fa tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:37.803544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceab1cff-9711-48b0-92cf-0b10734178fa tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:37.806887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceab1cff-9711-48b0-92cf-0b10734178fa tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:37.808140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceab1cff-9711-48b0-92cf-0b10734178fa tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:37.808522 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1c4f6c23-92bb-4d3d-bfdb-8a0d63e7fcf0 req-796eb56c-05c7-45d9-90a4-c1255d67c9af service nova] Creating event network-vif-deleted:22ee4a7b-aafc-48ad-8a2b-8316827168cb for instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 on n-h1-860864-3 Oct 11 19:57:37.808782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceab1cff-9711-48b0-92cf-0b10734178fa tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:37.817202 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1c4f6c23-92bb-4d3d-bfdb-8a0d63e7fcf0 req-796eb56c-05c7-45d9-90a4-c1255d67c9af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315956 Oct 11 19:57:37.826916 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1739/3545] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:37.833654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ef58ece2-0c3f-4487-af7d-163301e895a3 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Action: 'create', calling method: .version_select at 0x7f83c737a4c0>, body: {"keypair": {"name": "tempest-keypair-1320767516", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:37.854432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-ef58ece2-0c3f-4487-af7d-163301e895a3 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:57:37.865132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-ef58ece2-0c3f-4487-af7d-163301e895a3 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for user eec83482c57a49948ab8e52fe38a6530 and project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:57:37.920120 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ef58ece2-0c3f-4487-af7d-163301e895a3 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.091328 Oct 11 19:57:37.921104 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1740/3546] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:57:37 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:37.936719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5b1a2da5-d2e6-460a-ada7-cbc39e99b990 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Calling method '.version_select at 0x7f83c73413a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:37.982980 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5b1a2da5-d2e6-460a-ada7-cbc39e99b990 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320767516" status: 202 len: 0 microversion: 2.1 time: 0.052854 Oct 11 19:57:37.984095 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1741/3547] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 19:57:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320767516 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:37.997114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53574f2e-dbc3-460f-8580-019165b6b1f9 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Action: 'create', calling method: .version_select at 0x7f83c7435700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-861982468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkj/uW1ZAucOVSU5IkqEBIdT4pEFVymWuLvHUiXmv3ehU9f9oHlYHHMT19M8dZ0gSejfC48bAF8RfloId0XOgybL5d3eSSUL3u2NdkcTyTyrpoYl+pl0TRCQHTraSHTGQ=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:38.033756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-53574f2e-dbc3-460f-8580-019165b6b1f9 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:57:38.063231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ceab1cff-9711-48b0-92cf-0b10734178fa tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:38.077945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-53574f2e-dbc3-460f-8580-019165b6b1f9 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for user eec83482c57a49948ab8e52fe38a6530 and project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:57:38.085395 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ceab1cff-9711-48b0-92cf-0b10734178fa tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.313692 Oct 11 19:57:38.086716 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1807/3548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:37 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:38.117260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d3ab0153-b45c-4d62-bda7-43d8c8087c2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:38.118366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d3ab0153-b45c-4d62-bda7-43d8c8087c2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:38.129801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3ab0153-b45c-4d62-bda7-43d8c8087c2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:38.130760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3ab0153-b45c-4d62-bda7-43d8c8087c2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:38.131392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3ab0153-b45c-4d62-bda7-43d8c8087c2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:38.132716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3ab0153-b45c-4d62-bda7-43d8c8087c2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:38.133439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3ab0153-b45c-4d62-bda7-43d8c8087c2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:38.134095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3ab0153-b45c-4d62-bda7-43d8c8087c2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:38.148336 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-53574f2e-dbc3-460f-8580-019165b6b1f9 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.155502 Oct 11 19:57:38.149556 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1742/3549] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:57:37 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:57:38.164653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-532d1993-1ed8-42c6-ac72-178b669fc514 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Action: 'create', calling method: .version_select at 0x7f83c73a7310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-524546137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpIlVQMm69AN8byDt7P5a6raXzjH+4ObRTRSOv/UBd9oQIad9zGJ9FhS02BrqA1K+/rIdY4m+FEpjfPF0BIIqGqII5XKJ2aJpCQ+IzThIMpmV0/qejFoz7uGH6eU3I/9A=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:38.184791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-532d1993-1ed8-42c6-ac72-178b669fc514 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:57:38.198178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-532d1993-1ed8-42c6-ac72-178b669fc514 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for user eec83482c57a49948ab8e52fe38a6530 and project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:57:38.235884 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-532d1993-1ed8-42c6-ac72-178b669fc514 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.075903 Oct 11 19:57:38.238014 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1743/3550] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:57:38 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:57:38.269850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-46177944-a191-4f14-a2a2-529de67a208e tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Action: 'create', calling method: .version_select at 0x7f83c742f820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1539670760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGWI3qJv3lk5Frgouz0yqI3Y1NKg9KArh3FY6Zinjep4HQvgDI/RxgfhGAn5KJjpxBscSXzbcChyMjMcHAITqgBpP0LltYl1cDVbblC9ppsZD3xZmivx+D/IZ0O2EAn2A=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:38.324358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-46177944-a191-4f14-a2a2-529de67a208e tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:57:38.342922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-46177944-a191-4f14-a2a2-529de67a208e tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Getting quotas for user eec83482c57a49948ab8e52fe38a6530 and project 9847ad5bf01748a8a87d8ee0b474a296. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:57:38.408572 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-46177944-a191-4f14-a2a2-529de67a208e tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.153139 Oct 11 19:57:38.410190 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1744/3551] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:57:38 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:57:38.422644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0db1d326-44cf-4cd0-8282-9e3df38fa5af tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Calling method '.version_select at 0x7f83c7341ee0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:38.427419 n-d-860864-3 devstack@n-api.service[126955]: WARNING oslo_db.sqlalchemy.utils [None req-0db1d326-44cf-4cd0-8282-9e3df38fa5af tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 19:57:38.440949 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0db1d326-44cf-4cd0-8282-9e3df38fa5af tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.023019 Oct 11 19:57:38.447924 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1745/3552] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 19:57:38 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:57:38.459426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d3ab0153-b45c-4d62-bda7-43d8c8087c2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:38.461582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-78fc387e-ea70-4306-a7f5-cd49951a6cfd tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Calling method '.version_select at 0x7f83c7317b80>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:38.470502 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d3ab0153-b45c-4d62-bda7-43d8c8087c2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 0.362516 Oct 11 19:57:38.472997 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1808/3553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:38 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:38.484331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2fe55c0e-0427-4331-b017-a5459a8ae859 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:38.487071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2fe55c0e-0427-4331-b017-a5459a8ae859 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:38.505793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe55c0e-0427-4331-b017-a5459a8ae859 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:38.506566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe55c0e-0427-4331-b017-a5459a8ae859 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:38.507323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe55c0e-0427-4331-b017-a5459a8ae859 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:38.508313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe55c0e-0427-4331-b017-a5459a8ae859 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:38.509335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe55c0e-0427-4331-b017-a5459a8ae859 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:38.510044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fe55c0e-0427-4331-b017-a5459a8ae859 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:38.522867 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-78fc387e-ea70-4306-a7f5-cd49951a6cfd tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1539670760" status: 202 len: 0 microversion: 2.1 time: 0.066568 Oct 11 19:57:38.523519 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1746/3554] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 11 19:57:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1539670760 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:57:38.530147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2bdf81f-2e9a-4c3d-9e64-43d3472caaff tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:38.530895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d2bdf81f-2e9a-4c3d-9e64-43d3472caaff tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:38.541478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2bdf81f-2e9a-4c3d-9e64-43d3472caaff tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:38.544007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2bdf81f-2e9a-4c3d-9e64-43d3472caaff tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:38.544485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2bdf81f-2e9a-4c3d-9e64-43d3472caaff tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:38.545213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2bdf81f-2e9a-4c3d-9e64-43d3472caaff tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:38.545687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2bdf81f-2e9a-4c3d-9e64-43d3472caaff tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:38.546118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d2bdf81f-2e9a-4c3d-9e64-43d3472caaff tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:38.827271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d2bdf81f-2e9a-4c3d-9e64-43d3472caaff tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:38.840649 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d2bdf81f-2e9a-4c3d-9e64-43d3472caaff tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1539 microversion: 2.1 time: 0.315709 Oct 11 19:57:38.841906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2fe55c0e-0427-4331-b017-a5459a8ae859 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:38.851143 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2fe55c0e-0427-4331-b017-a5459a8ae859 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.370555 Oct 11 19:57:38.859108 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1747/3555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:38 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1539 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:38.867706 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1809/3556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:38 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:57:38.883238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1e6aa975-5ba2-4546-9eb7-dcd10ab965d7 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Calling method '.version_select at 0x7f83c7317700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:38.888168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7eb7a278-6b21-41b9-91a1-9a29e058bd55 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:38.888794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7eb7a278-6b21-41b9-91a1-9a29e058bd55 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:38.908620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eb7a278-6b21-41b9-91a1-9a29e058bd55 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:38.908620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eb7a278-6b21-41b9-91a1-9a29e058bd55 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:38.918365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eb7a278-6b21-41b9-91a1-9a29e058bd55 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:38.919202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eb7a278-6b21-41b9-91a1-9a29e058bd55 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:38.919685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eb7a278-6b21-41b9-91a1-9a29e058bd55 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:38.920118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7eb7a278-6b21-41b9-91a1-9a29e058bd55 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:38.943930 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1e6aa975-5ba2-4546-9eb7-dcd10ab965d7 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-524546137" status: 202 len: 0 microversion: 2.1 time: 0.083282 Oct 11 19:57:38.944539 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1748/3557] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:57:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-524546137 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:38.955577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3bfacb2a-c635-416e-9a69-10641dd998c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:38.956901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3bfacb2a-c635-416e-9a69-10641dd998c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:38.979429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfacb2a-c635-416e-9a69-10641dd998c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:38.980630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfacb2a-c635-416e-9a69-10641dd998c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:38.984706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfacb2a-c635-416e-9a69-10641dd998c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:38.986497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfacb2a-c635-416e-9a69-10641dd998c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:38.990399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfacb2a-c635-416e-9a69-10641dd998c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:38.991397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfacb2a-c635-416e-9a69-10641dd998c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:39.090826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7eb7a278-6b21-41b9-91a1-9a29e058bd55 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:39.103548 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7eb7a278-6b21-41b9-91a1-9a29e058bd55 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1252 microversion: 2.1 time: 0.233392 Oct 11 19:57:39.120383 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1810/3558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:38 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1252 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:39.128463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c0bd517-cc13-4c1d-b3a6-3b0ed7f19466 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] Calling method '.version_select at 0x7f83c72cfe50>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:39.180254 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c0bd517-cc13-4c1d-b3a6-3b0ed7f19466 tempest-KeyPairsV2TestJSON-343405276 tempest-KeyPairsV2TestJSON-343405276-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-861982468" status: 202 len: 0 microversion: 2.1 time: 0.058434 Oct 11 19:57:39.180847 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1811/3559] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:57:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-861982468 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:39.193255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb3f2364-482c-43b5-824e-cc0d7502396e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:39.193879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bb3f2364-482c-43b5-824e-cc0d7502396e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:39.214312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb3f2364-482c-43b5-824e-cc0d7502396e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:39.214312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb3f2364-482c-43b5-824e-cc0d7502396e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:39.214312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb3f2364-482c-43b5-824e-cc0d7502396e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:39.214312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb3f2364-482c-43b5-824e-cc0d7502396e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:39.214312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb3f2364-482c-43b5-824e-cc0d7502396e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:39.220599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb3f2364-482c-43b5-824e-cc0d7502396e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:39.229667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:39.442425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3bfacb2a-c635-416e-9a69-10641dd998c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:39.451042 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3bfacb2a-c635-416e-9a69-10641dd998c8 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.502156 Oct 11 19:57:39.458093 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1749/3560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:38 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:39.493916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e9b8187e-86a3-489c-baad-49668287d61b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:39.495351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e9b8187e-86a3-489c-baad-49668287d61b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:39.524280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9b8187e-86a3-489c-baad-49668287d61b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:39.524881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9b8187e-86a3-489c-baad-49668287d61b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:39.525388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9b8187e-86a3-489c-baad-49668287d61b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:39.527424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9b8187e-86a3-489c-baad-49668287d61b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:39.528932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9b8187e-86a3-489c-baad-49668287d61b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:39.532224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9b8187e-86a3-489c-baad-49668287d61b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:39.757340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bb3f2364-482c-43b5-824e-cc0d7502396e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:39.765777 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bb3f2364-482c-43b5-824e-cc0d7502396e tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1735 microversion: 2.1 time: 0.583858 Oct 11 19:57:39.772143 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1812/3561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:39 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1735 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:39.787673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b2af86bb-2670-402c-a45e-eb4f5038a120 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:39.788477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b2af86bb-2670-402c-a45e-eb4f5038a120 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:39.796530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2af86bb-2670-402c-a45e-eb4f5038a120 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:39.797250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2af86bb-2670-402c-a45e-eb4f5038a120 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:39.797696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2af86bb-2670-402c-a45e-eb4f5038a120 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:39.798403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2af86bb-2670-402c-a45e-eb4f5038a120 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:39.798890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2af86bb-2670-402c-a45e-eb4f5038a120 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:39.799316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2af86bb-2670-402c-a45e-eb4f5038a120 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:39.855444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e9b8187e-86a3-489c-baad-49668287d61b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:39.863862 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e9b8187e-86a3-489c-baad-49668287d61b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.374928 Oct 11 19:57:39.870567 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1750/3562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:39 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:39.872588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6a96c3e9-77cd-403d-b112-494a66a55c4d tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:39.873194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6a96c3e9-77cd-403d-b112-494a66a55c4d tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:39.889362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a96c3e9-77cd-403d-b112-494a66a55c4d tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:39.894939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a96c3e9-77cd-403d-b112-494a66a55c4d tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:39.896317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a96c3e9-77cd-403d-b112-494a66a55c4d tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:39.897810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a96c3e9-77cd-403d-b112-494a66a55c4d tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:39.898500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a96c3e9-77cd-403d-b112-494a66a55c4d tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:39.899183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a96c3e9-77cd-403d-b112-494a66a55c4d tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:40.085810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6a96c3e9-77cd-403d-b112-494a66a55c4d tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246e8a514537477fb2ca87e3f4117f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c560285045d4c17b0f4d86e31c6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:40.106406 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6a96c3e9-77cd-403d-b112-494a66a55c4d tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 200 len: 1497 microversion: 2.1 time: 0.237192 Oct 11 19:57:40.116000 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1751/3563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:39 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 1497 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:40.121244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0463335-cc0c-4443-8202-084188946802 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:40.148471 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-f0463335-cc0c-4443-8202-084188946802 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance ea59d74c-dcbc-4876-93a5-531e0718f395 has no mapping to a cell. Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0463335-cc0c-4443-8202-084188946802 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/ea59d74c-dcbc-4876-93a5-531e0718f395/action HTTP/1.1 Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 15 Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: {"os-stop": {}} Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ea59d74c-dcbc-4876-93a5-531e0718f395 has no mapping to a cell. Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ea59d74c-dcbc-4876-93a5-531e0718f395', 'body': {'os-stop': {}}} Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance ea59d74c-dcbc-4876-93a5-531e0718f395 has no mapping to a cell. Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:40.156465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea59d74c-dcbc-4876-93a5-531e0718f395 has no mapping to a cell. Oct 11 19:57:40.163639 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:40.163639 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:40.163639 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:40.163639 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:40.163639 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:40.163639 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:40.163639 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:40.163639 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:40.163639 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea59d74c-dcbc-4876-93a5-531e0718f395 has no mapping to a cell. Oct 11 19:57:40.163639 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:40.168959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0463335-cc0c-4443-8202-084188946802 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance ea59d74c-dcbc-4876-93a5-531e0718f395 has no mapping to a cell. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:40.170236 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f0463335-cc0c-4443-8202-084188946802 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/ea59d74c-dcbc-4876-93a5-531e0718f395/action" status: 404 len: 117 microversion: 2.1 time: 0.052908 Oct 11 19:57:40.171464 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1752/3564] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:40 2022] POST /compute/v2.1/servers/ea59d74c-dcbc-4876-93a5-531e0718f395/action => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:40.181524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-91cefac1-8f14-4d06-b9cf-809078853222 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:40.182153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-91cefac1-8f14-4d06-b9cf-809078853222 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:40.205170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91cefac1-8f14-4d06-b9cf-809078853222 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:40.206043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91cefac1-8f14-4d06-b9cf-809078853222 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:40.207042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91cefac1-8f14-4d06-b9cf-809078853222 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:40.208455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91cefac1-8f14-4d06-b9cf-809078853222 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:40.210691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91cefac1-8f14-4d06-b9cf-809078853222 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:40.211743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91cefac1-8f14-4d06-b9cf-809078853222 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:40.224539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b2af86bb-2670-402c-a45e-eb4f5038a120 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:40.274901 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b2af86bb-2670-402c-a45e-eb4f5038a120 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 0.485406 Oct 11 19:57:40.281218 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1813/3565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:39 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:40.307295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6cf65b87-5e61-4d57-a6fd-65bdd017b47b req-d302123f-43a2-4abd-b0e4-679a074c7889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b74878-0856-4c96-801f-9a14951d647f", "name": "network-vif-deleted", "tag": "6ff9f802-da11-4f74-900d-b80cccb9041b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:40.326147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6cf65b87-5e61-4d57-a6fd-65bdd017b47b req-d302123f-43a2-4abd-b0e4-679a074c7889 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:40.327209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6cf65b87-5e61-4d57-a6fd-65bdd017b47b req-d302123f-43a2-4abd-b0e4-679a074c7889 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:40.328542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6cf65b87-5e61-4d57-a6fd-65bdd017b47b req-d302123f-43a2-4abd-b0e4-679a074c7889 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:40.342133 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6cf65b87-5e61-4d57-a6fd-65bdd017b47b req-d302123f-43a2-4abd-b0e4-679a074c7889 service nova] Creating event network-vif-deleted:6ff9f802-da11-4f74-900d-b80cccb9041b for instance 57b74878-0856-4c96-801f-9a14951d647f on n-h2-860864-3 Oct 11 19:57:40.350353 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6cf65b87-5e61-4d57-a6fd-65bdd017b47b req-d302123f-43a2-4abd-b0e4-679a074c7889 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055719 Oct 11 19:57:40.351800 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1814/3566] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:40.359235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-de3b1c02-afb0-45e2-bafc-f2c21282a170 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:40.360201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-de3b1c02-afb0-45e2-bafc-f2c21282a170 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:40.369035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de3b1c02-afb0-45e2-bafc-f2c21282a170 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:40.369848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de3b1c02-afb0-45e2-bafc-f2c21282a170 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:40.370466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de3b1c02-afb0-45e2-bafc-f2c21282a170 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:40.382758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de3b1c02-afb0-45e2-bafc-f2c21282a170 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:40.385887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de3b1c02-afb0-45e2-bafc-f2c21282a170 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:40.386552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de3b1c02-afb0-45e2-bafc-f2c21282a170 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:40.445577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-91cefac1-8f14-4d06-b9cf-809078853222 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:40.455478 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-91cefac1-8f14-4d06-b9cf-809078853222 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1252 microversion: 2.1 time: 0.282534 Oct 11 19:57:40.456774 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1753/3567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:40 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1252 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:40.700299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-de3b1c02-afb0-45e2-bafc-f2c21282a170 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:40.722068 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-de3b1c02-afb0-45e2-bafc-f2c21282a170 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.368342 Oct 11 19:57:40.724746 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1815/3568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:40 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:40.755200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-844df81f-c444-4f6a-843a-a6f7cf7fd7a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:40.756075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-844df81f-c444-4f6a-843a-a6f7cf7fd7a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:40.767665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-844df81f-c444-4f6a-843a-a6f7cf7fd7a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:40.769346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-844df81f-c444-4f6a-843a-a6f7cf7fd7a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:40.770552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-844df81f-c444-4f6a-843a-a6f7cf7fd7a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:40.774641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-844df81f-c444-4f6a-843a-a6f7cf7fd7a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:40.775403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-844df81f-c444-4f6a-843a-a6f7cf7fd7a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:40.776065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-844df81f-c444-4f6a-843a-a6f7cf7fd7a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:40.810674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-51675695-2dc5-43b4-8b4c-0083ba7d985b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:40.815040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-51675695-2dc5-43b4-8b4c-0083ba7d985b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:40.838415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51675695-2dc5-43b4-8b4c-0083ba7d985b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:40.839486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51675695-2dc5-43b4-8b4c-0083ba7d985b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:40.840452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51675695-2dc5-43b4-8b4c-0083ba7d985b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:40.842321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51675695-2dc5-43b4-8b4c-0083ba7d985b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:40.843058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51675695-2dc5-43b4-8b4c-0083ba7d985b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:40.843840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51675695-2dc5-43b4-8b4c-0083ba7d985b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:41.203738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-51675695-2dc5-43b4-8b4c-0083ba7d985b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:41.215014 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-51675695-2dc5-43b4-8b4c-0083ba7d985b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1715 microversion: 2.1 time: 0.420989 Oct 11 19:57:41.217097 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1816/3569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:40 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1715 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:41.250649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:41.252000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] [instance: 57b74878-0856-4c96-801f-9a14951d647f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:41.271804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-844df81f-c444-4f6a-843a-a6f7cf7fd7a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:41.285250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:41.290857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:41.291781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:41.292306 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-844df81f-c444-4f6a-843a-a6f7cf7fd7a2 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.540296 Oct 11 19:57:41.295979 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1754/3570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:40 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:41.296300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:41.296987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:41.298027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:41.317041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c450d3a9-b17f-4b38-96df-319082bd5792 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:41.319314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c450d3a9-b17f-4b38-96df-319082bd5792 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:41.330419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:41.356126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c450d3a9-b17f-4b38-96df-319082bd5792 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:41.356612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c450d3a9-b17f-4b38-96df-319082bd5792 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:41.357063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c450d3a9-b17f-4b38-96df-319082bd5792 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:41.357893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c450d3a9-b17f-4b38-96df-319082bd5792 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:41.358240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c450d3a9-b17f-4b38-96df-319082bd5792 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:41.358699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c450d3a9-b17f-4b38-96df-319082bd5792 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:41.365768 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] HTTP exception thrown: Instance 57b74878-0856-4c96-801f-9a14951d647f could not be found. Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Request method failure captured: Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f HTTP/1.1 Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcpvwAFkJ66y49UCZJptptK8kJXNSFybsqunNUo_GJZ-yYR_uypFGk3eQMup-1PIrsdIQp8Fs0g3oGcKuyvQgJat9g3rmpClop7uKNt4bLfirTtJPvDt-9HCvU0w2dGbdvSpBxgbtVF1FMkD8qkFulWeWXn5OHheXHRYEY5luTebxSg Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3c560285045d4c17b0f4d86e31c6f584 Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c560285045d4c17b0f4d86e31c6f584"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c560285045d4c17b0f4d86e31c6f584", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c560285045d4c17b0f4d86e31c6f584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c560285045d4c17b0f4d86e31c6f584"}]}] Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3c560285045d4c17b0f4d86e31c6f584 Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 246e8a514537477fb2ca87e3f4117f3e Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 57b74878-0856-4c96-801f-9a14951d647f could not be found. Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '57b74878-0856-4c96-801f-9a14951d647f'} Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b74878-0856-4c96-801f-9a14951d647f could not be found. Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b74878-0856-4c96-801f-9a14951d647f could not be found. Oct 11 19:57:41.367534 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b74878-0856-4c96-801f-9a14951d647f could not be found. Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] Returning 404 to user: Instance 57b74878-0856-4c96-801f-9a14951d647f could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:41.373751 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-986e47bd-5104-4a2f-8f89-e7dbf8f55f09 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386 tempest-FloatingIPsAssociationNegativeTestJSON-1589787386-project] 10.222.0.27 "GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f" status: 404 len: 111 microversion: 2.1 time: 0.137681 Oct 11 19:57:41.381041 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1817/3571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:41 2022] GET /compute/v2.1/servers/57b74878-0856-4c96-801f-9a14951d647f => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:41.405518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0bc8809-9fe0-454b-95d2-930fd39a9064 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:41.406686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a0bc8809-9fe0-454b-95d2-930fd39a9064 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: e53cacbf-64ca-4bed-8aef-bcfb9d68a49b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:41.423368 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a0bc8809-9fe0-454b-95d2-930fd39a9064 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance e53cacbf-64ca-4bed-8aef-bcfb9d68a49b could not be found. Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0bc8809-9fe0-454b-95d2-930fd39a9064 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/e53cacbf-64ca-4bed-8aef-bcfb9d68a49b/action HTTP/1.1 Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 15 Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: {"suspend": {}} Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance e53cacbf-64ca-4bed-8aef-bcfb9d68a49b could not be found. Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'e53cacbf-64ca-4bed-8aef-bcfb9d68a49b', 'body': {'suspend': {}}} Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e53cacbf-64ca-4bed-8aef-bcfb9d68a49b could not be found. Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e53cacbf-64ca-4bed-8aef-bcfb9d68a49b could not be found. Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:41.430151 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:41.439605 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:41.439605 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:41.439605 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e53cacbf-64ca-4bed-8aef-bcfb9d68a49b could not be found. Oct 11 19:57:41.439605 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:41.439605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0bc8809-9fe0-454b-95d2-930fd39a9064 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance e53cacbf-64ca-4bed-8aef-bcfb9d68a49b could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:41.439605 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a0bc8809-9fe0-454b-95d2-930fd39a9064 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/e53cacbf-64ca-4bed-8aef-bcfb9d68a49b/action" status: 404 len: 111 microversion: 2.1 time: 0.048188 Oct 11 19:57:41.439605 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1818/3572] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:41 2022] POST /compute/v2.1/servers/e53cacbf-64ca-4bed-8aef-bcfb9d68a49b/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:41.457946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8040aff9-6f04-46f5-9826-19b6c36b5195 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:41.461459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8040aff9-6f04-46f5-9826-19b6c36b5195 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:41.488374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8040aff9-6f04-46f5-9826-19b6c36b5195 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:41.489322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8040aff9-6f04-46f5-9826-19b6c36b5195 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:41.490777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8040aff9-6f04-46f5-9826-19b6c36b5195 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:41.495806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8040aff9-6f04-46f5-9826-19b6c36b5195 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:41.496728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8040aff9-6f04-46f5-9826-19b6c36b5195 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:41.497340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8040aff9-6f04-46f5-9826-19b6c36b5195 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:41.901626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8040aff9-6f04-46f5-9826-19b6c36b5195 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:41.917035 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8040aff9-6f04-46f5-9826-19b6c36b5195 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.475305 Oct 11 19:57:41.918114 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1819/3573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:41 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:41.942044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9603a482-cb38-4e67-b180-1f905acfc0fb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:41.942969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9603a482-cb38-4e67-b180-1f905acfc0fb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:41.944131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c450d3a9-b17f-4b38-96df-319082bd5792 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:41.950552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9603a482-cb38-4e67-b180-1f905acfc0fb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:41.953234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9603a482-cb38-4e67-b180-1f905acfc0fb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:41.953858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9603a482-cb38-4e67-b180-1f905acfc0fb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:41.954793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9603a482-cb38-4e67-b180-1f905acfc0fb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:41.955431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9603a482-cb38-4e67-b180-1f905acfc0fb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:41.956537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9603a482-cb38-4e67-b180-1f905acfc0fb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:41.966639 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c450d3a9-b17f-4b38-96df-319082bd5792 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 0.662241 Oct 11 19:57:41.976492 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1755/3574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:41 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:41.993316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:41.994103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:42.010017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:42.010857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:42.012753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:42.014942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:42.015683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:42.016981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:42.258894 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] HTTP exception thrown: Cannot 'detach_volume' instance e1c4b045-264a-41c3-b8e8-5a038c485877 while it is in vm_state rescued Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Request method failure captured: Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments/7843b57b-2a59-49ee-b87b-c8c7fa462b21 HTTP/1.1 Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnHf-gY9GoFThGWTuyLZOFCjiBlppqFx09S1rxIOZhPN4k_d-_Y9sZYcmKSj4UOYvu9oafZcIYglvMprUUmJuXwAUoSMveDAF_xAfvCOrPvWGeWuOLI47ySPf1501t-RY5r2Fgp6Sqr-jc81_0LijQqzlDf3IXjp_i8MKsYX5dySSY Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8df2eebeffd440d988aa6f580c9bb221", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}] Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d1ab8c29f18c4fc09858791a80527e5d Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: exception: Cannot 'detach_volume' instance e1c4b045-264a-41c3-b8e8-5a038c485877 while it is in vm_state rescued Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'server_id': 'e1c4b045-264a-41c3-b8e8-5a038c485877', 'id': '7843b57b-2a59-49ee-b87b-c8c7fa462b21'} Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1c4b045-264a-41c3-b8e8-5a038c485877 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e1c4b045-264a-41c3-b8e8-5a038c485877 while it is in vm_state rescued Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:42.269565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:42.277662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:42.277662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:42.277662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:42.277662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:42.277662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e1c4b045-264a-41c3-b8e8-5a038c485877 while it is in vm_state rescued Oct 11 19:57:42.277662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:42.279244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Returning 409 to user: Cannot 'detach_volume' instance e1c4b045-264a-41c3-b8e8-5a038c485877 while it is in vm_state rescued {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:42.280594 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5a0812f2-b59e-4eb5-a5cd-9f22168e95d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments/7843b57b-2a59-49ee-b87b-c8c7fa462b21" status: 409 len: 152 microversion: 2.1 time: 0.300911 Oct 11 19:57:42.281395 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1756/3575] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 19:57:41 2022] DELETE /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments/7843b57b-2a59-49ee-b87b-c8c7fa462b21 => generated 152 bytes in 304 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:57:42.290704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eef3ff5c-3fa1-4f58-b99b-388bcff09e7d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:42.291567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eef3ff5c-3fa1-4f58-b99b-388bcff09e7d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:42.300526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eef3ff5c-3fa1-4f58-b99b-388bcff09e7d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:42.301382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eef3ff5c-3fa1-4f58-b99b-388bcff09e7d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:42.302259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eef3ff5c-3fa1-4f58-b99b-388bcff09e7d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:42.303373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eef3ff5c-3fa1-4f58-b99b-388bcff09e7d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:42.304039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eef3ff5c-3fa1-4f58-b99b-388bcff09e7d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:42.304677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eef3ff5c-3fa1-4f58-b99b-388bcff09e7d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:42.853040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9603a482-cb38-4e67-b180-1f905acfc0fb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57648a513c14c3b9f81b1c1e1eafcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef09f5386314639b7a5d6a3a6bc6320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:42.865185 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9603a482-cb38-4e67-b180-1f905acfc0fb tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 200 len: 1252 microversion: 2.1 time: 0.932585 Oct 11 19:57:42.869126 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1820/3576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:41 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 1252 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:42.879458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8159c51d-565c-4f9d-924a-628aa716acd5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:42.891298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8159c51d-565c-4f9d-924a-628aa716acd5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:42.899100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8159c51d-565c-4f9d-924a-628aa716acd5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:42.899839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8159c51d-565c-4f9d-924a-628aa716acd5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:42.907251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8159c51d-565c-4f9d-924a-628aa716acd5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:42.908300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8159c51d-565c-4f9d-924a-628aa716acd5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:42.908999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8159c51d-565c-4f9d-924a-628aa716acd5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:42.910238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8159c51d-565c-4f9d-924a-628aa716acd5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:43.082290 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8159c51d-565c-4f9d-924a-628aa716acd5 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/action" status: 202 len: 0 microversion: 2.1 time: 0.207825 Oct 11 19:57:43.099281 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1821/3577] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:42 2022] POST /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:43.108717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe2d1219-2574-4dd3-ac77-7b1417146b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:43.124715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fe2d1219-2574-4dd3-ac77-7b1417146b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:43.134501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe2d1219-2574-4dd3-ac77-7b1417146b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:43.140473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe2d1219-2574-4dd3-ac77-7b1417146b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:43.140934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe2d1219-2574-4dd3-ac77-7b1417146b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:43.141681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe2d1219-2574-4dd3-ac77-7b1417146b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:43.142145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe2d1219-2574-4dd3-ac77-7b1417146b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:43.142586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe2d1219-2574-4dd3-ac77-7b1417146b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:43.392707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eef3ff5c-3fa1-4f58-b99b-388bcff09e7d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:43.405338 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eef3ff5c-3fa1-4f58-b99b-388bcff09e7d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 1.122437 Oct 11 19:57:43.418910 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1757/3578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:42 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:43.418910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0700315-a82a-42d9-9532-09409bb062ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:43.418910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a0700315-a82a-42d9-9532-09409bb062ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:43.430076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0700315-a82a-42d9-9532-09409bb062ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:43.430731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0700315-a82a-42d9-9532-09409bb062ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:43.431612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0700315-a82a-42d9-9532-09409bb062ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:43.432605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0700315-a82a-42d9-9532-09409bb062ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:43.433709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0700315-a82a-42d9-9532-09409bb062ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:43.434496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0700315-a82a-42d9-9532-09409bb062ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:44.333467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a0700315-a82a-42d9-9532-09409bb062ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:44.348181 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a0700315-a82a-42d9-9532-09409bb062ba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1723 microversion: 2.1 time: 0.936369 Oct 11 19:57:44.349195 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1758/3579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:43 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1723 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:44.360204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9131513-8895-4405-9299-0c9721c7e33f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:44.360752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f9131513-8895-4405-9299-0c9721c7e33f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:44.378474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9131513-8895-4405-9299-0c9721c7e33f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:44.379349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9131513-8895-4405-9299-0c9721c7e33f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:44.379762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9131513-8895-4405-9299-0c9721c7e33f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:44.380485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9131513-8895-4405-9299-0c9721c7e33f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:44.380948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9131513-8895-4405-9299-0c9721c7e33f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:44.387011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9131513-8895-4405-9299-0c9721c7e33f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:44.447292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-f9131513-8895-4405-9299-0c9721c7e33f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lazy-loading 'flavor' on Instance uuid 85f1dc40-ef33-40f8-b128-d5c6367e833e {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:57:44.458422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe2d1219-2574-4dd3-ac77-7b1417146b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:44.470559 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fe2d1219-2574-4dd3-ac77-7b1417146b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 1.369478 Oct 11 19:57:44.472430 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1822/3580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:43 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:44.479111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:44.480030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] [instance: 0795791f-2f7c-418b-8c82-7f1bfb623e93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:44.487901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:44.489016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:44.489686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:44.490996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:44.491681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:44.492491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:44.512009 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] HTTP exception thrown: Instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 could not be found. Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Request method failure captured: Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 HTTP/1.1 Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcoraFFvFSSD99bMiuwN_hm4B99jprPTmu7BQnNmJdFtOSk3UMFfNEolH7GMT5dcdX8blv__qSAP8wvABD_xLv_HiuP7-Pn6rj2KRouVty3OzJfGSxMpVHQJicwlQ6Ug7PlesqZjGyUFOsoM9wKI8H0rbNEevwrftWXbXSO5WTKS1JU Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1ef09f5386314639b7a5d6a3a6bc6320 Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestBootFromVolume-1628207757 Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1ef09f5386314639b7a5d6a3a6bc6320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1ef09f5386314639b7a5d6a3a6bc6320", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ef09f5386314639b7a5d6a3a6bc6320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ef09f5386314639b7a5d6a3a6bc6320"}]}] Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestBootFromVolume-1628207757 Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1ef09f5386314639b7a5d6a3a6bc6320 Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1628207757 Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestBootFromVolume-1628207757-project Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e57648a513c14c3b9f81b1c1e1eafcd8 Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestBootFromVolume-1628207757-project Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 could not be found. Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '0795791f-2f7c-418b-8c82-7f1bfb623e93'} Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 could not be found. Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 could not be found. Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:44.516912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:44.522179 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:44.522179 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:44.522179 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:44.522179 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:44.522179 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:44.522179 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 could not be found. Oct 11 19:57:44.522179 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:44.526250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Returning 404 to user: Instance 0795791f-2f7c-418b-8c82-7f1bfb623e93 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:44.528326 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10a461c3-6b55-4acd-917a-05584c6d364b tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93" status: 404 len: 111 microversion: 2.1 time: 0.053942 Oct 11 19:57:44.529175 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1823/3581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:44 2022] GET /compute/v2.1/servers/0795791f-2f7c-418b-8c82-7f1bfb623e93 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:44.543974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f9ea377-bf5b-496e-af3e-a4040c81c508 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] Calling method '.version_select at 0x7f83cc8a24c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:44.602982 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f9ea377-bf5b-496e-af3e-a4040c81c508 tempest-ServersTestBootFromVolume-1628207757 tempest-ServersTestBootFromVolume-1628207757-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-849669695" status: 202 len: 0 microversion: 2.1 time: 0.066571 Oct 11 19:57:44.609148 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1824/3582] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 19:57:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-849669695 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:44.681287 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9131513-8895-4405-9299-0c9721c7e33f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 202 len: 0 microversion: 2.1 time: 0.314083 Oct 11 19:57:44.684604 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1759/3583] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:44 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:44.693171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-619ddb87-4222-4e38-a0b3-1f52ca40090b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:44.693817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-619ddb87-4222-4e38-a0b3-1f52ca40090b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:44.712744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-619ddb87-4222-4e38-a0b3-1f52ca40090b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:44.713533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-619ddb87-4222-4e38-a0b3-1f52ca40090b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:44.714146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-619ddb87-4222-4e38-a0b3-1f52ca40090b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:44.718686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-619ddb87-4222-4e38-a0b3-1f52ca40090b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:44.719445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-619ddb87-4222-4e38-a0b3-1f52ca40090b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:44.720055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-619ddb87-4222-4e38-a0b3-1f52ca40090b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:45.380919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bac9ac74-b596-4879-a7f5-c136e0acc2d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:45.381824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bac9ac74-b596-4879-a7f5-c136e0acc2d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:45.427676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bac9ac74-b596-4879-a7f5-c136e0acc2d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:45.428318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bac9ac74-b596-4879-a7f5-c136e0acc2d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:45.431450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bac9ac74-b596-4879-a7f5-c136e0acc2d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:45.432287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bac9ac74-b596-4879-a7f5-c136e0acc2d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:45.433761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bac9ac74-b596-4879-a7f5-c136e0acc2d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:45.436104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bac9ac74-b596-4879-a7f5-c136e0acc2d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:45.497995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:45.688922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-619ddb87-4222-4e38-a0b3-1f52ca40090b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:45.702437 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-619ddb87-4222-4e38-a0b3-1f52ca40090b tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1514 microversion: 2.1 time: 1.014299 Oct 11 19:57:45.721741 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1825/3584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:44 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1514 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:45.734468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d4c8402-8b27-47d7-b563-a6227c9dddee tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:45.735481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4d4c8402-8b27-47d7-b563-a6227c9dddee tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:45.749395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d4c8402-8b27-47d7-b563-a6227c9dddee tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:45.750544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d4c8402-8b27-47d7-b563-a6227c9dddee tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:45.751532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d4c8402-8b27-47d7-b563-a6227c9dddee tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:45.754168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d4c8402-8b27-47d7-b563-a6227c9dddee tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:45.757509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d4c8402-8b27-47d7-b563-a6227c9dddee tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:45.758162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d4c8402-8b27-47d7-b563-a6227c9dddee tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:45.861399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bac9ac74-b596-4879-a7f5-c136e0acc2d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:45.909183 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bac9ac74-b596-4879-a7f5-c136e0acc2d0 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1723 microversion: 2.1 time: 0.528561 Oct 11 19:57:45.916951 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1760/3585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:45 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1723 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:46.030635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4d4c8402-8b27-47d7-b563-a6227c9dddee tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:46.040069 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4d4c8402-8b27-47d7-b563-a6227c9dddee tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 0.316594 Oct 11 19:57:46.040662 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1826/3586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:45 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:46.728166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db9763e3-5208-4cd8-aca0-0c8a8129ae33 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:46.728698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-db9763e3-5208-4cd8-aca0-0c8a8129ae33 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:46.758094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db9763e3-5208-4cd8-aca0-0c8a8129ae33 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:46.758655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db9763e3-5208-4cd8-aca0-0c8a8129ae33 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:46.759109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db9763e3-5208-4cd8-aca0-0c8a8129ae33 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:46.759829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db9763e3-5208-4cd8-aca0-0c8a8129ae33 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:46.760283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db9763e3-5208-4cd8-aca0-0c8a8129ae33 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:46.760709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db9763e3-5208-4cd8-aca0-0c8a8129ae33 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:46.933316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b010180a-971d-4348-8802-931e87d18748 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:46.933934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b010180a-971d-4348-8802-931e87d18748 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:46.945552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b010180a-971d-4348-8802-931e87d18748 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:46.949215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b010180a-971d-4348-8802-931e87d18748 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:46.949872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b010180a-971d-4348-8802-931e87d18748 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:46.951227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b010180a-971d-4348-8802-931e87d18748 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:46.951854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b010180a-971d-4348-8802-931e87d18748 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:46.955160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b010180a-971d-4348-8802-931e87d18748 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:47.410298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-db9763e3-5208-4cd8-aca0-0c8a8129ae33 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:47.425127 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-db9763e3-5208-4cd8-aca0-0c8a8129ae33 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1497 microversion: 2.1 time: 0.699829 Oct 11 19:57:47.430451 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1761/3587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:46 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1497 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:47.445730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ab0ae68a-e991-401f-9646-6340543f1b7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:47.449808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ab0ae68a-e991-401f-9646-6340543f1b7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:47.474202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab0ae68a-e991-401f-9646-6340543f1b7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:47.479222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab0ae68a-e991-401f-9646-6340543f1b7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:47.483005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab0ae68a-e991-401f-9646-6340543f1b7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:47.486198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab0ae68a-e991-401f-9646-6340543f1b7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:47.488194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab0ae68a-e991-401f-9646-6340543f1b7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:47.489844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab0ae68a-e991-401f-9646-6340543f1b7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:47.540973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:47.607328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b010180a-971d-4348-8802-931e87d18748 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:47.621503 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b010180a-971d-4348-8802-931e87d18748 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1729 microversion: 2.1 time: 0.692118 Oct 11 19:57:47.635418 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1827/3588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:46 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1729 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:47.654771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:47.655834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:47.674694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:47.675769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:47.676553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:47.677443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:47.678763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:47.679383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:47.731043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lazy-loading 'flavor' on Instance uuid 85f1dc40-ef33-40f8-b128-d5c6367e833e {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:57:47.745745 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Cannot 'suspend' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state suspended Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action HTTP/1.1 Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 15 Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: {"suspend": {}} Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: exception: Cannot 'suspend' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state suspended Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '85f1dc40-ef33-40f8-b128-d5c6367e833e', 'body': {'suspend': {}}} Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e in vm_state suspended. Cannot suspend while the instance is in this state. Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 11 19:57:47.748214 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state suspended Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state suspended Oct 11 19:57:47.754719 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:47.759092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 409 to user: Cannot 'suspend' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state suspended {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:47.760208 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cdc70fa7-8d67-4269-aa08-c966b9967467 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 409 len: 148 microversion: 2.1 time: 0.123505 Oct 11 19:57:47.765956 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1828/3589] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:47 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 148 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:57:47.772199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a4f6d331-3e0b-40ff-93d2-7d150c59271f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:47.773025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a4f6d331-3e0b-40ff-93d2-7d150c59271f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:47.784664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4f6d331-3e0b-40ff-93d2-7d150c59271f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:47.785464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4f6d331-3e0b-40ff-93d2-7d150c59271f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:47.786646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4f6d331-3e0b-40ff-93d2-7d150c59271f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:47.787722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4f6d331-3e0b-40ff-93d2-7d150c59271f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:47.789128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4f6d331-3e0b-40ff-93d2-7d150c59271f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:47.789611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4f6d331-3e0b-40ff-93d2-7d150c59271f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:48.128066 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a4f6d331-3e0b-40ff-93d2-7d150c59271f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.359931 Oct 11 19:57:48.130509 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1829/3590] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:57:47 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-interface => generated 284 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:48.138240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2e802be-b7a9-46af-a49d-967a6ed7dfad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:48.142870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2e802be-b7a9-46af-a49d-967a6ed7dfad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:48.179169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e802be-b7a9-46af-a49d-967a6ed7dfad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:48.181774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e802be-b7a9-46af-a49d-967a6ed7dfad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:48.185402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e802be-b7a9-46af-a49d-967a6ed7dfad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:48.188921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e802be-b7a9-46af-a49d-967a6ed7dfad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:48.191599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e802be-b7a9-46af-a49d-967a6ed7dfad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:48.199754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e802be-b7a9-46af-a49d-967a6ed7dfad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:48.372614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=20 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:48.379476 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2e802be-b7a9-46af-a49d-967a6ed7dfad tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 202 len: 0 microversion: 2.1 time: 0.246840 Oct 11 19:57:48.395835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1830/3591] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:48 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:57:48.412277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd54c1b5-ec22-4b0d-b732-0632e3540282 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:48.428176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fd54c1b5-ec22-4b0d-b732-0632e3540282 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:48.447138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:48.481990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd54c1b5-ec22-4b0d-b732-0632e3540282 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:48.483084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd54c1b5-ec22-4b0d-b732-0632e3540282 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:48.483766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd54c1b5-ec22-4b0d-b732-0632e3540282 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:48.484749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd54c1b5-ec22-4b0d-b732-0632e3540282 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:48.488528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd54c1b5-ec22-4b0d-b732-0632e3540282 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:48.490708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd54c1b5-ec22-4b0d-b732-0632e3540282 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:48.514218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:57:48.913651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ab0ae68a-e991-401f-9646-6340543f1b7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:48.932529 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ab0ae68a-e991-401f-9646-6340543f1b7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 1.500504 Oct 11 19:57:48.934173 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1762/3592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:47 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:49.142721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fd54c1b5-ec22-4b0d-b732-0632e3540282 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:49.151843 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fd54c1b5-ec22-4b0d-b732-0632e3540282 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1503 microversion: 2.1 time: 0.752843 Oct 11 19:57:49.155629 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1831/3593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:48 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1503 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:49.961607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9aac5c12-d43d-4a20-964f-2ee2fb649e56 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:49.962190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9aac5c12-d43d-4a20-964f-2ee2fb649e56 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:49.973906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aac5c12-d43d-4a20-964f-2ee2fb649e56 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:49.974412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aac5c12-d43d-4a20-964f-2ee2fb649e56 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:49.974878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aac5c12-d43d-4a20-964f-2ee2fb649e56 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:49.975587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aac5c12-d43d-4a20-964f-2ee2fb649e56 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:49.976052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aac5c12-d43d-4a20-964f-2ee2fb649e56 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:49.976478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9aac5c12-d43d-4a20-964f-2ee2fb649e56 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:50.180894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-39fab14b-95cc-4db6-8883-dff7c5691d2f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:50.183054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-39fab14b-95cc-4db6-8883-dff7c5691d2f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:50.195380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fab14b-95cc-4db6-8883-dff7c5691d2f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:50.196140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fab14b-95cc-4db6-8883-dff7c5691d2f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:50.196859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fab14b-95cc-4db6-8883-dff7c5691d2f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:50.197809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fab14b-95cc-4db6-8883-dff7c5691d2f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:50.198594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fab14b-95cc-4db6-8883-dff7c5691d2f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:50.200322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39fab14b-95cc-4db6-8883-dff7c5691d2f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:50.540721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9aac5c12-d43d-4a20-964f-2ee2fb649e56 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:50.553448 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9aac5c12-d43d-4a20-964f-2ee2fb649e56 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 0.595400 Oct 11 19:57:50.553891 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1763/3594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:49 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:50.736884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-39fab14b-95cc-4db6-8883-dff7c5691d2f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:50.765374 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-39fab14b-95cc-4db6-8883-dff7c5691d2f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1503 microversion: 2.1 time: 0.587432 Oct 11 19:57:50.771391 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1832/3595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:50 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1503 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:51.117531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c3147ba5-1b56-420e-9424-67bf3cc0f27f req-6c78ad30-9bb2-44ea-9e4c-74b98e6dca49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4b045-264a-41c3-b8e8-5a038c485877", "tag": "8c56ce9b-8903-45a8-b9a9-f1cca5c18f44"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:51.137921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c3147ba5-1b56-420e-9424-67bf3cc0f27f req-6c78ad30-9bb2-44ea-9e4c-74b98e6dca49 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:51.139426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c3147ba5-1b56-420e-9424-67bf3cc0f27f req-6c78ad30-9bb2-44ea-9e4c-74b98e6dca49 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:51.140103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c3147ba5-1b56-420e-9424-67bf3cc0f27f req-6c78ad30-9bb2-44ea-9e4c-74b98e6dca49 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:51.156888 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c3147ba5-1b56-420e-9424-67bf3cc0f27f req-6c78ad30-9bb2-44ea-9e4c-74b98e6dca49 service nova] Creating event network-changed:8c56ce9b-8903-45a8-b9a9-f1cca5c18f44 for instance e1c4b045-264a-41c3-b8e8-5a038c485877 on n-h2-860864-3 Oct 11 19:57:51.167386 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c3147ba5-1b56-420e-9424-67bf3cc0f27f req-6c78ad30-9bb2-44ea-9e4c-74b98e6dca49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.489316 Oct 11 19:57:51.169043 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1764/3596] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:51.579218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c1e801eb-a33c-4a0a-8a45-09a7b07deb28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:51.579833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1e801eb-a33c-4a0a-8a45-09a7b07deb28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:51.588769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1e801eb-a33c-4a0a-8a45-09a7b07deb28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:51.589589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1e801eb-a33c-4a0a-8a45-09a7b07deb28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:51.590286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1e801eb-a33c-4a0a-8a45-09a7b07deb28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:51.591447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1e801eb-a33c-4a0a-8a45-09a7b07deb28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:51.600516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1e801eb-a33c-4a0a-8a45-09a7b07deb28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:51.601768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1e801eb-a33c-4a0a-8a45-09a7b07deb28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:51.792725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f835db20-e962-44cd-a525-69416de5f9d5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:51.795076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f835db20-e962-44cd-a525-69416de5f9d5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:51.811515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f835db20-e962-44cd-a525-69416de5f9d5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:51.812270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f835db20-e962-44cd-a525-69416de5f9d5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:51.813526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f835db20-e962-44cd-a525-69416de5f9d5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:51.815365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f835db20-e962-44cd-a525-69416de5f9d5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:51.816169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f835db20-e962-44cd-a525-69416de5f9d5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:51.816946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f835db20-e962-44cd-a525-69416de5f9d5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:52.799805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f835db20-e962-44cd-a525-69416de5f9d5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:52.811372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c1e801eb-a33c-4a0a-8a45-09a7b07deb28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:52.814353 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f835db20-e962-44cd-a525-69416de5f9d5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 1.022899 Oct 11 19:57:52.816359 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1765/3597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:51 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:52.827545 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c1e801eb-a33c-4a0a-8a45-09a7b07deb28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 1.252102 Oct 11 19:57:52.828139 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1833/3598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:51 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:52.855906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-846ce915-e584-47a8-8e72-4982f59e2bae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:52.856546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-846ce915-e584-47a8-8e72-4982f59e2bae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:52.868368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-846ce915-e584-47a8-8e72-4982f59e2bae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:52.868865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-846ce915-e584-47a8-8e72-4982f59e2bae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:52.871052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-846ce915-e584-47a8-8e72-4982f59e2bae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:52.874363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-846ce915-e584-47a8-8e72-4982f59e2bae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:52.875044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-846ce915-e584-47a8-8e72-4982f59e2bae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:52.875644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-846ce915-e584-47a8-8e72-4982f59e2bae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:53.194631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-977470d2-1ccb-458d-b702-a56855c46105 req-89bf069d-dc46-4507-972f-6dd9d735a042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4b045-264a-41c3-b8e8-5a038c485877", "tag": "8c56ce9b-8903-45a8-b9a9-f1cca5c18f44"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:53.223020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-977470d2-1ccb-458d-b702-a56855c46105 req-89bf069d-dc46-4507-972f-6dd9d735a042 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:53.223956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-977470d2-1ccb-458d-b702-a56855c46105 req-89bf069d-dc46-4507-972f-6dd9d735a042 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:53.224578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-977470d2-1ccb-458d-b702-a56855c46105 req-89bf069d-dc46-4507-972f-6dd9d735a042 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:53.247402 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-977470d2-1ccb-458d-b702-a56855c46105 req-89bf069d-dc46-4507-972f-6dd9d735a042 service nova] Creating event network-changed:8c56ce9b-8903-45a8-b9a9-f1cca5c18f44 for instance e1c4b045-264a-41c3-b8e8-5a038c485877 on n-h2-860864-3 Oct 11 19:57:53.274471 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-977470d2-1ccb-458d-b702-a56855c46105 req-89bf069d-dc46-4507-972f-6dd9d735a042 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082560 Oct 11 19:57:53.277634 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1834/3599] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:57:53.858241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-db59cc59-d0e6-4dc4-918e-51e065e63b27 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:53.861624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-db59cc59-d0e6-4dc4-918e-51e065e63b27 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:53.875719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db59cc59-d0e6-4dc4-918e-51e065e63b27 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:53.876851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db59cc59-d0e6-4dc4-918e-51e065e63b27 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:53.879684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db59cc59-d0e6-4dc4-918e-51e065e63b27 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:53.880920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db59cc59-d0e6-4dc4-918e-51e065e63b27 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:53.881472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db59cc59-d0e6-4dc4-918e-51e065e63b27 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:53.883334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db59cc59-d0e6-4dc4-918e-51e065e63b27 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:54.398993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-846ce915-e584-47a8-8e72-4982f59e2bae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:54.415066 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-846ce915-e584-47a8-8e72-4982f59e2bae tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 1.565437 Oct 11 19:57:54.416829 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1766/3600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:52 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:54.442786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db25cbde-b0e8-4c7d-b12c-640ce29fcac5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:54.443426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-db25cbde-b0e8-4c7d-b12c-640ce29fcac5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 22c31fcf-a483-4d0e-bbab-8c73741846ec] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:54.455567 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-db25cbde-b0e8-4c7d-b12c-640ce29fcac5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance 22c31fcf-a483-4d0e-bbab-8c73741846ec could not be found. Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db25cbde-b0e8-4c7d-b12c-640ce29fcac5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/22c31fcf-a483-4d0e-bbab-8c73741846ec/action HTTP/1.1 Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 15 Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: {"unpause": {}} Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 22c31fcf-a483-4d0e-bbab-8c73741846ec could not be found. Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '22c31fcf-a483-4d0e-bbab-8c73741846ec', 'body': {'unpause': {}}} Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22c31fcf-a483-4d0e-bbab-8c73741846ec could not be found. Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22c31fcf-a483-4d0e-bbab-8c73741846ec could not be found. Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:54.459020 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:54.464481 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:54.464481 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:54.464481 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22c31fcf-a483-4d0e-bbab-8c73741846ec could not be found. Oct 11 19:57:54.464481 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:54.468433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db25cbde-b0e8-4c7d-b12c-640ce29fcac5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance 22c31fcf-a483-4d0e-bbab-8c73741846ec could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:54.474431 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-db25cbde-b0e8-4c7d-b12c-640ce29fcac5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/22c31fcf-a483-4d0e-bbab-8c73741846ec/action" status: 404 len: 111 microversion: 2.1 time: 0.036825 Oct 11 19:57:54.475902 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1767/3601] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:54 2022] POST /compute/v2.1/servers/22c31fcf-a483-4d0e-bbab-8c73741846ec/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:54.485671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7d2c58a9-d241-4fe0-987d-0ef062aa18f1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:54.487423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7d2c58a9-d241-4fe0-987d-0ef062aa18f1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:54.508604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d2c58a9-d241-4fe0-987d-0ef062aa18f1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:54.514585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d2c58a9-d241-4fe0-987d-0ef062aa18f1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:54.515245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d2c58a9-d241-4fe0-987d-0ef062aa18f1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:54.516378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d2c58a9-d241-4fe0-987d-0ef062aa18f1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:54.517025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d2c58a9-d241-4fe0-987d-0ef062aa18f1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:54.517840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d2c58a9-d241-4fe0-987d-0ef062aa18f1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:55.241614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-db59cc59-d0e6-4dc4-918e-51e065e63b27 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:55.252220 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-db59cc59-d0e6-4dc4-918e-51e065e63b27 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 1.399488 Oct 11 19:57:55.253898 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1835/3602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:53 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:55.972212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d2c58a9-d241-4fe0-987d-0ef062aa18f1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:55.984903 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7d2c58a9-d241-4fe0-987d-0ef062aa18f1 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 1.504618 Oct 11 19:57:55.989090 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1768/3603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:54 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:57:56.022224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a2a813a-7465-4877-a053-b26f678a9066 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:56.023719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0a2a813a-7465-4877-a053-b26f678a9066 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:56.037873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2a813a-7465-4877-a053-b26f678a9066 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:56.038328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2a813a-7465-4877-a053-b26f678a9066 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:56.042041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2a813a-7465-4877-a053-b26f678a9066 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:56.044419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2a813a-7465-4877-a053-b26f678a9066 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:56.044918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2a813a-7465-4877-a053-b26f678a9066 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:56.046101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2a813a-7465-4877-a053-b26f678a9066 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:56.280677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-59db0627-ed88-4f8c-b772-976afe9eb2ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:56.281300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-59db0627-ed88-4f8c-b772-976afe9eb2ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:56.294781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59db0627-ed88-4f8c-b772-976afe9eb2ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:56.295290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59db0627-ed88-4f8c-b772-976afe9eb2ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:56.298383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59db0627-ed88-4f8c-b772-976afe9eb2ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:56.300452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59db0627-ed88-4f8c-b772-976afe9eb2ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:56.301538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59db0627-ed88-4f8c-b772-976afe9eb2ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:56.307174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59db0627-ed88-4f8c-b772-976afe9eb2ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:56.877028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0a2a813a-7465-4877-a053-b26f678a9066 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:56.889281 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a2a813a-7465-4877-a053-b26f678a9066 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.871924 Oct 11 19:57:56.889882 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1836/3604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:56 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:56.915427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:56.915966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:56.930297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:56.931632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:56.932628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:56.933509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:56.934131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:56.934921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:56.988300 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Cannot 'unpause' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action HTTP/1.1 Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 15 Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: {"unpause": {}} Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: exception: Cannot 'unpause' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '85f1dc40-ef33-40f8-b128-d5c6367e833e', 'body': {'unpause': {}}} Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e in vm_state active. Cannot unpause while the instance is in this state. Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:56.991096 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:56.996001 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:56.996001 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:56.996001 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:56.996001 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:57:56.996001 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:56.996001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 409 to user: Cannot 'unpause' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:56.996001 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-291e5c30-0b4b-4fc2-a69e-b34c7fbc247f tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 409 len: 145 microversion: 2.1 time: 0.081202 Oct 11 19:57:56.996001 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1837/3605] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:56 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 145 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:57:57.005814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40f9f491-9970-42ed-8720-22f6fdbbe7e4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:57.006682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-40f9f491-9970-42ed-8720-22f6fdbbe7e4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:57.021011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f9f491-9970-42ed-8720-22f6fdbbe7e4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:57.021518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f9f491-9970-42ed-8720-22f6fdbbe7e4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:57.021956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f9f491-9970-42ed-8720-22f6fdbbe7e4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:57.026151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f9f491-9970-42ed-8720-22f6fdbbe7e4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:57.026738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f9f491-9970-42ed-8720-22f6fdbbe7e4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:57.027177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40f9f491-9970-42ed-8720-22f6fdbbe7e4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:57.440847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-59db0627-ed88-4f8c-b772-976afe9eb2ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:57.455229 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-59db0627-ed88-4f8c-b772-976afe9eb2ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 1.178566 Oct 11 19:57:57.456413 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1769/3606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:56 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:57.678619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-40f9f491-9970-42ed-8720-22f6fdbbe7e4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:57.704638 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40f9f491-9970-42ed-8720-22f6fdbbe7e4 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.706722 Oct 11 19:57:57.708761 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1838/3607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:56 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:57:57.738778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-764486e5-6765-4c0c-bfd5-abe723dd6eb6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:57.739464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-764486e5-6765-4c0c-bfd5-abe723dd6eb6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:57.746829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-764486e5-6765-4c0c-bfd5-abe723dd6eb6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:57.747636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-764486e5-6765-4c0c-bfd5-abe723dd6eb6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:57.748339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-764486e5-6765-4c0c-bfd5-abe723dd6eb6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:57.749304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-764486e5-6765-4c0c-bfd5-abe723dd6eb6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:57.750061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-764486e5-6765-4c0c-bfd5-abe723dd6eb6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:57.752348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-764486e5-6765-4c0c-bfd5-abe723dd6eb6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:58.095607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-764486e5-6765-4c0c-bfd5-abe723dd6eb6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:58.113026 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-764486e5-6765-4c0c-bfd5-abe723dd6eb6 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.380177 Oct 11 19:57:58.128968 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1770/3608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:57 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:58.147356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8cfaf6ae-d85a-4c05-9b85-11e1d2ae9059 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:58.148690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8cfaf6ae-d85a-4c05-9b85-11e1d2ae9059 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: ca3f7d21-c1c1-4f56-ab8e-6337e6203abd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:58.160607 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-8cfaf6ae-d85a-4c05-9b85-11e1d2ae9059 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance ca3f7d21-c1c1-4f56-ab8e-6337e6203abd could not be found. Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8cfaf6ae-d85a-4c05-9b85-11e1d2ae9059 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/ca3f7d21-c1c1-4f56-ab8e-6337e6203abd/action HTTP/1.1 Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 18 Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: {"unshelve": null} Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance ca3f7d21-c1c1-4f56-ab8e-6337e6203abd could not be found. Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ca3f7d21-c1c1-4f56-ab8e-6337e6203abd', 'body': {'unshelve': None}} Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca3f7d21-c1c1-4f56-ab8e-6337e6203abd could not be found. Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca3f7d21-c1c1-4f56-ab8e-6337e6203abd could not be found. Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:58.162800 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:58.167399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:58.167399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:58.167399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:58.167399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:58.167399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:58.167399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:58.167399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca3f7d21-c1c1-4f56-ab8e-6337e6203abd could not be found. Oct 11 19:57:58.167399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:58.171535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8cfaf6ae-d85a-4c05-9b85-11e1d2ae9059 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance ca3f7d21-c1c1-4f56-ab8e-6337e6203abd could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:58.172682 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8cfaf6ae-d85a-4c05-9b85-11e1d2ae9059 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/ca3f7d21-c1c1-4f56-ab8e-6337e6203abd/action" status: 404 len: 111 microversion: 2.1 time: 0.031529 Oct 11 19:57:58.182436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-add87e4f-19a6-4631-a0ba-b24040b6459d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:58.183767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-add87e4f-19a6-4631-a0ba-b24040b6459d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:58.187458 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1839/3609] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:58 2022] POST /compute/v2.1/servers/ca3f7d21-c1c1-4f56-ab8e-6337e6203abd/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:58.194968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-add87e4f-19a6-4631-a0ba-b24040b6459d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:58.196302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-add87e4f-19a6-4631-a0ba-b24040b6459d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:58.196759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-add87e4f-19a6-4631-a0ba-b24040b6459d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:58.197485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-add87e4f-19a6-4631-a0ba-b24040b6459d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:58.198644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-add87e4f-19a6-4631-a0ba-b24040b6459d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:58.199389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-add87e4f-19a6-4631-a0ba-b24040b6459d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:58.480987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-287a37ef-7d5c-4462-b45c-32dc220ed07e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:58.481971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-287a37ef-7d5c-4462-b45c-32dc220ed07e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:58.497223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a37ef-7d5c-4462-b45c-32dc220ed07e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:58.498562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a37ef-7d5c-4462-b45c-32dc220ed07e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:58.501674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a37ef-7d5c-4462-b45c-32dc220ed07e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:58.502641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a37ef-7d5c-4462-b45c-32dc220ed07e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:58.503318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a37ef-7d5c-4462-b45c-32dc220ed07e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:58.503751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a37ef-7d5c-4462-b45c-32dc220ed07e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:58.504963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-add87e4f-19a6-4631-a0ba-b24040b6459d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:58.531635 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-add87e4f-19a6-4631-a0ba-b24040b6459d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.353173 Oct 11 19:57:58.532677 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1771/3610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:58 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:58.562560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fac5d70-939c-4ecf-976a-5bdafc7ed8d7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:58.563346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9fac5d70-939c-4ecf-976a-5bdafc7ed8d7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:58.576646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fac5d70-939c-4ecf-976a-5bdafc7ed8d7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:58.579874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fac5d70-939c-4ecf-976a-5bdafc7ed8d7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:58.580993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fac5d70-939c-4ecf-976a-5bdafc7ed8d7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:58.581953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fac5d70-939c-4ecf-976a-5bdafc7ed8d7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:58.583694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fac5d70-939c-4ecf-976a-5bdafc7ed8d7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:58.585393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fac5d70-939c-4ecf-976a-5bdafc7ed8d7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:58.845702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9fac5d70-939c-4ecf-976a-5bdafc7ed8d7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:58.857367 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9fac5d70-939c-4ecf-976a-5bdafc7ed8d7 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.297860 Oct 11 19:57:58.859399 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1772/3611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:58 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:58.883685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:58.884306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:58.896557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:58.897292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:58.897907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:58.898849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:58.899605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:58.900192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:58.902368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-287a37ef-7d5c-4462-b45c-32dc220ed07e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:58.914738 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-287a37ef-7d5c-4462-b45c-32dc220ed07e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 0.438287 Oct 11 19:57:58.915763 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1840/3612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:58 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:59.075448 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Cannot 'unshelve' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action HTTP/1.1 Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 18 Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: {"unshelve": null} Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: exception: Cannot 'unshelve' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '85f1dc40-ef33-40f8-b128-d5c6367e833e', 'body': {'unshelve': None}} Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e in vm_state active. Cannot unshelve while the instance is in this state. Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:57:59.078292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 409 to user: Cannot 'unshelve' instance 85f1dc40-ef33-40f8-b128-d5c6367e833e while it is in vm_state active {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-62448bdf-47f0-4f9c-b48c-e7574647669c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action" status: 409 len: 146 microversion: 2.1 time: 0.202869 Oct 11 19:57:59.086667 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1773/3613] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:57:58 2022] POST /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e/action => generated 146 bytes in 206 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 11 19:57:59.091360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f07dcac4-d60e-4f07-a027-061c52e94a88 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:59.091980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f07dcac4-d60e-4f07-a027-061c52e94a88 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:59.109930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f07dcac4-d60e-4f07-a027-061c52e94a88 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:59.112363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f07dcac4-d60e-4f07-a027-061c52e94a88 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:59.112841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f07dcac4-d60e-4f07-a027-061c52e94a88 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:59.116539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f07dcac4-d60e-4f07-a027-061c52e94a88 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:59.116967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f07dcac4-d60e-4f07-a027-061c52e94a88 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:59.117401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f07dcac4-d60e-4f07-a027-061c52e94a88 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:59.326814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f07dcac4-d60e-4f07-a027-061c52e94a88 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:59.336515 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f07dcac4-d60e-4f07-a027-061c52e94a88 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.250656 Oct 11 19:57:59.337097 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1841/3614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:59 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:59.366120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5012bc32-88ce-4c81-ad5e-b56ee95fdb27 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:59.366841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5012bc32-88ce-4c81-ad5e-b56ee95fdb27 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:59.389795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5012bc32-88ce-4c81-ad5e-b56ee95fdb27 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:59.390306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5012bc32-88ce-4c81-ad5e-b56ee95fdb27 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:59.390772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5012bc32-88ce-4c81-ad5e-b56ee95fdb27 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:59.391492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5012bc32-88ce-4c81-ad5e-b56ee95fdb27 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:59.391953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5012bc32-88ce-4c81-ad5e-b56ee95fdb27 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:59.392382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5012bc32-88ce-4c81-ad5e-b56ee95fdb27 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:59.668111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5012bc32-88ce-4c81-ad5e-b56ee95fdb27 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:57:59.678925 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5012bc32-88ce-4c81-ad5e-b56ee95fdb27 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.319075 Oct 11 19:57:59.679822 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1774/3615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:59 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:57:59.706427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a38f909f-d1dd-42a5-8836-cf7a88cb8fbd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2059549526_updated"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:57:59.709603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a38f909f-d1dd-42a5-8836-cf7a88cb8fbd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f8cafb48-292a-4e40-b25c-5d104e107f69] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:59.719118 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a38f909f-d1dd-42a5-8836-cf7a88cb8fbd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance f8cafb48-292a-4e40-b25c-5d104e107f69 could not be found. Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a38f909f-d1dd-42a5-8836-cf7a88cb8fbd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/servers/f8cafb48-292a-4e40-b25c-5d104e107f69 HTTP/1.1 Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 81 Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2059549526_updated"}} Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance f8cafb48-292a-4e40-b25c-5d104e107f69 could not be found. Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'f8cafb48-292a-4e40-b25c-5d104e107f69', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2059549526_updated'}}} Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8cafb48-292a-4e40-b25c-5d104e107f69 could not be found. Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 11 19:57:59.722701 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8cafb48-292a-4e40-b25c-5d104e107f69 could not be found. Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8cafb48-292a-4e40-b25c-5d104e107f69 could not be found. Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a38f909f-d1dd-42a5-8836-cf7a88cb8fbd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance f8cafb48-292a-4e40-b25c-5d104e107f69 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:57:59.729836 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a38f909f-d1dd-42a5-8836-cf7a88cb8fbd tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "PUT /compute/v2.1/servers/f8cafb48-292a-4e40-b25c-5d104e107f69" status: 404 len: 111 microversion: 2.1 time: 0.026729 Oct 11 19:57:59.732258 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1842/3616] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 11 19:57:59 2022] PUT /compute/v2.1/servers/f8cafb48-292a-4e40-b25c-5d104e107f69 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:57:59.740762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aeffd787-abc0-4f51-87a9-fa7215aec6b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:59.741368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aeffd787-abc0-4f51-87a9-fa7215aec6b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:59.749085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aeffd787-abc0-4f51-87a9-fa7215aec6b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:59.749877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aeffd787-abc0-4f51-87a9-fa7215aec6b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:59.750539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aeffd787-abc0-4f51-87a9-fa7215aec6b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:59.751457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aeffd787-abc0-4f51-87a9-fa7215aec6b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:59.752801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aeffd787-abc0-4f51-87a9-fa7215aec6b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:59.753456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aeffd787-abc0-4f51-87a9-fa7215aec6b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:59.937157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ebc33341-2ceb-462a-983e-68aab7b010e8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:57:59.937836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ebc33341-2ceb-462a-983e-68aab7b010e8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:57:59.958795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebc33341-2ceb-462a-983e-68aab7b010e8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:59.959306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebc33341-2ceb-462a-983e-68aab7b010e8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:59.959753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebc33341-2ceb-462a-983e-68aab7b010e8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:57:59.960470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebc33341-2ceb-462a-983e-68aab7b010e8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:57:59.960933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebc33341-2ceb-462a-983e-68aab7b010e8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:57:59.961364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebc33341-2ceb-462a-983e-68aab7b010e8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:00.008217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aeffd787-abc0-4f51-87a9-fa7215aec6b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:00.019084 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aeffd787-abc0-4f51-87a9-fa7215aec6b0 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.282341 Oct 11 19:58:00.019815 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1775/3617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:59 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:00.065498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-69e07d52-c2c8-4110-9656-6bd738aee050 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:00.066568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-69e07d52-c2c8-4110-9656-6bd738aee050 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:00.079104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69e07d52-c2c8-4110-9656-6bd738aee050 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:00.079889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69e07d52-c2c8-4110-9656-6bd738aee050 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:00.081121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69e07d52-c2c8-4110-9656-6bd738aee050 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:00.082084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69e07d52-c2c8-4110-9656-6bd738aee050 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:00.082836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69e07d52-c2c8-4110-9656-6bd738aee050 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:00.083512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69e07d52-c2c8-4110-9656-6bd738aee050 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:00.638920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-69e07d52-c2c8-4110-9656-6bd738aee050 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:00.652283 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-69e07d52-c2c8-4110-9656-6bd738aee050 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.604234 Oct 11 19:58:00.652892 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1776/3618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:00 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:00.686728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ebc33341-2ceb-462a-983e-68aab7b010e8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:00.699564 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ebc33341-2ceb-462a-983e-68aab7b010e8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 0.765928 Oct 11 19:58:00.702515 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1843/3619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:57:59 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:00.708431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-48599a69-f62f-44f7-a5da-7daa70dd25ff tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-48599a69-f62f-44f7-a5da-7daa70dd25ff tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e HTTP/1.1 Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 280 Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '85f1dc40-ef33-40f8-b128-d5c6367e833e', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:00.712249 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 19:58:00.716060 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:00.721326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-48599a69-f62f-44f7-a5da-7daa70dd25ff tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:00.722616 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-48599a69-f62f-44f7-a5da-7daa70dd25ff tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "PUT /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 400 len: 619 microversion: 2.1 time: 0.018545 Oct 11 19:58:00.724321 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1844/3620] 10.222.0.27 () {60 vars in 1257 bytes} [Tue Oct 11 19:58:00 2022] PUT /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:58:00.735500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6236f8d2-4617-4ac1-bdba-3ff9f2ec0442 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:00.737828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6236f8d2-4617-4ac1-bdba-3ff9f2ec0442 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:00.751008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6236f8d2-4617-4ac1-bdba-3ff9f2ec0442 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:00.751798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6236f8d2-4617-4ac1-bdba-3ff9f2ec0442 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:00.753088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6236f8d2-4617-4ac1-bdba-3ff9f2ec0442 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:00.754300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6236f8d2-4617-4ac1-bdba-3ff9f2ec0442 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:00.755811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6236f8d2-4617-4ac1-bdba-3ff9f2ec0442 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:00.756554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6236f8d2-4617-4ac1-bdba-3ff9f2ec0442 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:00.973091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ef98a992-df82-4bbb-b12b-1de3c8df5624 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83c7317ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-816494160", "description": "tempest-description-326290970"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:01.211283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6236f8d2-4617-4ac1-bdba-3ff9f2ec0442 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:01.230465 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6236f8d2-4617-4ac1-bdba-3ff9f2ec0442 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.497506 Oct 11 19:58:01.231229 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1845/3621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:00 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:01.261042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-037e848b-f490-48ab-8147-08943a34ba2c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:01.261664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-037e848b-f490-48ab-8147-08943a34ba2c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:01.278738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-037e848b-f490-48ab-8147-08943a34ba2c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:01.284461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-037e848b-f490-48ab-8147-08943a34ba2c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:01.284620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-037e848b-f490-48ab-8147-08943a34ba2c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:01.290272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-037e848b-f490-48ab-8147-08943a34ba2c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:01.290977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-037e848b-f490-48ab-8147-08943a34ba2c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:01.291292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-037e848b-f490-48ab-8147-08943a34ba2c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:01.999205 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ef98a992-df82-4bbb-b12b-1de3c8df5624 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.343646 Oct 11 19:58:02.008294 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1777/3622] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:58:00 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:02.008294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56b760fb-6ba8-4fdf-b611-1d2d238f7acb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:02.008294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56b760fb-6ba8-4fdf-b611-1d2d238f7acb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:02.020098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b760fb-6ba8-4fdf-b611-1d2d238f7acb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:02.020610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b760fb-6ba8-4fdf-b611-1d2d238f7acb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:02.021054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b760fb-6ba8-4fdf-b611-1d2d238f7acb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:02.021757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b760fb-6ba8-4fdf-b611-1d2d238f7acb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:02.027045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b760fb-6ba8-4fdf-b611-1d2d238f7acb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:02.027508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b760fb-6ba8-4fdf-b611-1d2d238f7acb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:02.040974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-037e848b-f490-48ab-8147-08943a34ba2c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:02.049437 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-037e848b-f490-48ab-8147-08943a34ba2c tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.796117 Oct 11 19:58:02.053860 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1846/3623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:01 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:02.079226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ea24cd8-5b25-4d57-8145-fd102a41c144 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83cca504c0>, body: {"security_group_rule": {"parent_group_id": "b8fcedf5-b170-4ba6-82a2-bb672b77f88e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:02.409716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56b760fb-6ba8-4fdf-b611-1d2d238f7acb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:02.421903 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56b760fb-6ba8-4fdf-b611-1d2d238f7acb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1513 microversion: 2.1 time: 0.420531 Oct 11 19:58:02.436221 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1778/3624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:02 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1513 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:02.459793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b6f2dc32-132a-4480-9c7f-1b58c6f24cd5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b6f2dc32-132a-4480-9c7f-1b58c6f24cd5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: request: PUT /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e HTTP/1.1 Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 24 Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": ""}} Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '85f1dc40-ef33-40f8-b128-d5c6367e833e', 'body': {'server': {'name': ''}}} Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi '' Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 19:58:02.502363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:02.508503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b6f2dc32-132a-4480-9c7f-1b58c6f24cd5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:02.512532 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b6f2dc32-132a-4480-9c7f-1b58c6f24cd5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "PUT /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 400 len: 108 microversion: 2.1 time: 0.072524 Oct 11 19:58:02.514434 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1779/3625] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 11 19:58:02 2022] PUT /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 108 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:58:02.532838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1c5483c7-9c67-4ac0-8573-43662ab99a34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:02.535424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1c5483c7-9c67-4ac0-8573-43662ab99a34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:02.558655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c5483c7-9c67-4ac0-8573-43662ab99a34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:02.561333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c5483c7-9c67-4ac0-8573-43662ab99a34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:02.562773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c5483c7-9c67-4ac0-8573-43662ab99a34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:02.565469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c5483c7-9c67-4ac0-8573-43662ab99a34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:02.566319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c5483c7-9c67-4ac0-8573-43662ab99a34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:02.566791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c5483c7-9c67-4ac0-8573-43662ab99a34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:02.681140 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1ea24cd8-5b25-4d57-8145-fd102a41c144 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.625918 Oct 11 19:58:02.682168 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1847/3626] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 19:58:02 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:02.695661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-707637ac-402f-454c-b178-5b65aa08c102 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83cc8ded30>, body: {"security_group_rule": {"parent_group_id": "b8fcedf5-b170-4ba6-82a2-bb672b77f88e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:03.225608 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-707637ac-402f-454c-b178-5b65aa08c102 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] HTTP exception thrown: This rule already exists in group b8fcedf5-b170-4ba6-82a2-bb672b77f88e Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-707637ac-402f-454c-b178-5b65aa08c102 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Request method failure captured: Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 138 Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrIDqO_wICEuMyYq07BF-ldVlw-kdJwyOf0al8m7pj1V1DFuwUywt_Tq_IPt7lWyTD5U55tE_RVFolgCFS1JefWC8r0p5g2EyDEVXNsmkDIV1gxrGfZpNjrJNNT0JjOM4jGBivHD2QcaZsIEjL6yxpqewo8VqUBOrVcKj_geN8dv4A Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1af9aba15d9344a89db20178158157a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1af9aba15d9344a89db20178158157a8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}] Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 039d07088e4440e7ad806e3ebe8480f7 Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: {"security_group_rule": {"parent_group_id": "b8fcedf5-b170-4ba6-82a2-bb672b77f88e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: exception: This rule already exists in group b8fcedf5-b170-4ba6-82a2-bb672b77f88e Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b8fcedf5-b170-4ba6-82a2-bb672b77f88e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group b8fcedf5-b170-4ba6-82a2-bb672b77f88e Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group b8fcedf5-b170-4ba6-82a2-bb672b77f88e Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:03.229237 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:03.233754 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:03.233754 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:03.233754 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group b8fcedf5-b170-4ba6-82a2-bb672b77f88e Oct 11 19:58:03.233754 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:03.233754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-707637ac-402f-454c-b178-5b65aa08c102 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Returning 400 to user: This rule already exists in group b8fcedf5-b170-4ba6-82a2-bb672b77f88e {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:03.233754 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-707637ac-402f-454c-b178-5b65aa08c102 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.540137 Oct 11 19:58:03.234236 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1848/3627] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 19:58:02 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 543 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:58:03.243842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9603c24b-9a2a-4b65-b939-6ffc255d3a42 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Calling method '.version_select at 0x7f83c732c160>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:03.313378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1c5483c7-9c67-4ac0-8573-43662ab99a34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:03.316346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:03.326623 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1c5483c7-9c67-4ac0-8573-43662ab99a34 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1506 microversion: 2.1 time: 0.806920 Oct 11 19:58:03.331793 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1780/3628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:02 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1506 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:03.449882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6989dcb7-1e1c-440d-b8f3-54c0fdb8de18 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:03.450793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6989dcb7-1e1c-440d-b8f3-54c0fdb8de18 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:03.463472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6989dcb7-1e1c-440d-b8f3-54c0fdb8de18 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:03.465901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6989dcb7-1e1c-440d-b8f3-54c0fdb8de18 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:03.467138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6989dcb7-1e1c-440d-b8f3-54c0fdb8de18 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:03.469222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6989dcb7-1e1c-440d-b8f3-54c0fdb8de18 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:03.470610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6989dcb7-1e1c-440d-b8f3-54c0fdb8de18 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:03.471906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6989dcb7-1e1c-440d-b8f3-54c0fdb8de18 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:04.057402 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9603c24b-9a2a-4b65-b939-6ffc255d3a42 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/353c9b53-2d86-4f7a-a8ca-56c301e80beb" status: 202 len: 0 microversion: 2.1 time: 0.815028 Oct 11 19:58:04.060763 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1849/3629] 10.222.0.27 () {58 vars in 1287 bytes} [Tue Oct 11 19:58:03 2022] DELETE /compute/v2.1/os-security-group-rules/353c9b53-2d86-4f7a-a8ca-56c301e80beb => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:58:04.070564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ed06b7c6-b8cd-4956-92e2-8007b433f5f7 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83ccca65e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1133258418", "description": "tempest-description-525462076"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:04.325188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6989dcb7-1e1c-440d-b8f3-54c0fdb8de18 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:04.341516 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6989dcb7-1e1c-440d-b8f3-54c0fdb8de18 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1490 microversion: 2.1 time: 0.896202 Oct 11 19:58:04.344627 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1781/3630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:03 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1490 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:04.369424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b7c049c2-9c25-469b-bfff-9891c51b1ef2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:04.372356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b7c049c2-9c25-469b-bfff-9891c51b1ef2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:04.390848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7c049c2-9c25-469b-bfff-9891c51b1ef2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:04.391799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7c049c2-9c25-469b-bfff-9891c51b1ef2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:04.393042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7c049c2-9c25-469b-bfff-9891c51b1ef2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:04.397250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7c049c2-9c25-469b-bfff-9891c51b1ef2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:04.398118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7c049c2-9c25-469b-bfff-9891c51b1ef2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:04.399046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7c049c2-9c25-469b-bfff-9891c51b1ef2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:04.503867 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b7c049c2-9c25-469b-bfff-9891c51b1ef2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 200 len: 128 microversion: 2.1 time: 0.138257 Oct 11 19:58:04.504824 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1782/3631] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:04 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 128 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:58:04.516304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a9db32b9-702d-48ef-9524-03afb80d58e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:04.517521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a9db32b9-702d-48ef-9524-03afb80d58e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:04.538354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9db32b9-702d-48ef-9524-03afb80d58e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:04.540040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9db32b9-702d-48ef-9524-03afb80d58e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:04.540726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9db32b9-702d-48ef-9524-03afb80d58e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:04.541625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9db32b9-702d-48ef-9524-03afb80d58e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:04.543413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9db32b9-702d-48ef-9524-03afb80d58e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:04.545222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9db32b9-702d-48ef-9524-03afb80d58e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:05.003251 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ed06b7c6-b8cd-4956-92e2-8007b433f5f7 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.936450 Oct 11 19:58:05.007039 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1850/3632] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:58:04 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:05.023491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-585dc3a9-d290-4146-9f51-020f5b8dedcd tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83d07c1670>, body: {"security_group_rule": {"parent_group_id": "cd706590-9e2f-4ba4-8c81-240360cb81e5", "ip_protocol": "tcp", "from_port": 1918571788, "to_port": 22}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:05.413954 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-585dc3a9-d290-4146-9f51-020f5b8dedcd tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] HTTP exception thrown: Invalid port range 1918571788:22. Former value cannot be greater than the later Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-585dc3a9-d290-4146-9f51-020f5b8dedcd tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Request method failure captured: Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 146 Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrIDqO_wICEuMyYq07BF-ldVlw-kdJwyOf0al8m7pj1V1DFuwUywt_Tq_IPt7lWyTD5U55tE_RVFolgCFS1JefWC8r0p5g2EyDEVXNsmkDIV1gxrGfZpNjrJNNT0JjOM4jGBivHD2QcaZsIEjL6yxpqewo8VqUBOrVcKj_geN8dv4A Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1af9aba15d9344a89db20178158157a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1af9aba15d9344a89db20178158157a8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}] Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 039d07088e4440e7ad806e3ebe8480f7 Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: {"security_group_rule": {"parent_group_id": "cd706590-9e2f-4ba4-8c81-240360cb81e5", "ip_protocol": "tcp", "from_port": 1918571788, "to_port": 22}} Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid port range 1918571788:22. Former value cannot be greater than the later Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cd706590-9e2f-4ba4-8c81-240360cb81e5', 'ip_protocol': 'tcp', 'from_port': 1918571788, 'to_port': 22}}} Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1918571788:22. Former value cannot be greater than the later Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1918571788:22. Former value cannot be greater than the later Oct 11 19:58:05.415732 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1918571788:22. Former value cannot be greater than the later Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-585dc3a9-d290-4146-9f51-020f5b8dedcd tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Returning 400 to user: Invalid port range 1918571788:22. Former value cannot be greater than the later {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-585dc3a9-d290-4146-9f51-020f5b8dedcd tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.401382 Oct 11 19:58:05.428024 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1851/3633] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 19:58:05 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 404 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:58:05.443525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c93d6620-7842-41ad-9d2b-46e8a95eb891 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83ccb88700>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-365874209", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:05.445948 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c93d6620-7842-41ad-9d2b-46e8a95eb891 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] HTTP exception thrown: Security group id should be uuid Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c93d6620-7842-41ad-9d2b-46e8a95eb891 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Request method failure captured: Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 130 Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrIDqO_wICEuMyYq07BF-ldVlw-kdJwyOf0al8m7pj1V1DFuwUywt_Tq_IPt7lWyTD5U55tE_RVFolgCFS1JefWC8r0p5g2EyDEVXNsmkDIV1gxrGfZpNjrJNNT0JjOM4jGBivHD2QcaZsIEjL6yxpqewo8VqUBOrVcKj_geN8dv4A Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1af9aba15d9344a89db20178158157a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1af9aba15d9344a89db20178158157a8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}] Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 039d07088e4440e7ad806e3ebe8480f7 Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-365874209", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: exception: Security group id should be uuid Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-365874209', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:05.454794 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:05.466310 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 11 19:58:05.466310 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:05.466310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c93d6620-7842-41ad-9d2b-46e8a95eb891 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Returning 400 to user: Security group id should be uuid {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:05.466310 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c93d6620-7842-41ad-9d2b-46e8a95eb891 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028386 Oct 11 19:58:05.466310 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1852/3634] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 19:58:05 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:58:05.474556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8301e528-4e19-4197-b080-27b4e39eba25 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83cca50a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1909836278", "description": "tempest-description-854693244"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:05.776621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a9db32b9-702d-48ef-9524-03afb80d58e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:05.795214 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a9db32b9-702d-48ef-9524-03afb80d58e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 1.283706 Oct 11 19:58:05.798178 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1783/3635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:04 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:05.827047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c17e348f-6ecb-4159-af08-23ca2011a618 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:05.829326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c17e348f-6ecb-4159-af08-23ca2011a618 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:05.860550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c17e348f-6ecb-4159-af08-23ca2011a618 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:05.861190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c17e348f-6ecb-4159-af08-23ca2011a618 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:05.866699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c17e348f-6ecb-4159-af08-23ca2011a618 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:05.867907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c17e348f-6ecb-4159-af08-23ca2011a618 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:05.868578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c17e348f-6ecb-4159-af08-23ca2011a618 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:05.869083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c17e348f-6ecb-4159-af08-23ca2011a618 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:06.701941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c17e348f-6ecb-4159-af08-23ca2011a618 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:06.712831 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c17e348f-6ecb-4159-af08-23ca2011a618 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.889920 Oct 11 19:58:06.732742 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1784/3636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:05 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:06.740225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-39905e7e-19ca-41b5-b535-349bf2d01def tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:06.741097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-39905e7e-19ca-41b5-b535-349bf2d01def tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:06.750042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39905e7e-19ca-41b5-b535-349bf2d01def tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:06.750836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39905e7e-19ca-41b5-b535-349bf2d01def tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:06.751634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39905e7e-19ca-41b5-b535-349bf2d01def tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:06.753336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39905e7e-19ca-41b5-b535-349bf2d01def tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:06.754004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39905e7e-19ca-41b5-b535-349bf2d01def tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:06.754654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39905e7e-19ca-41b5-b535-349bf2d01def tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:07.046009 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8301e528-4e19-4197-b080-27b4e39eba25 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.580771 Oct 11 19:58:07.050616 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1853/3637] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:58:05 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:07.066106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-083fe07a-1266-4288-816f-9126055718ea tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83c732c280>, body: {"security_group_rule": {"parent_group_id": "86d430cc-bc5a-445c-b11b-b183af1e5dfb", "ip_protocol": "tempest-999-612448459", "from_port": 22, "to_port": 22}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:07.591807 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-083fe07a-1266-4288-816f-9126055718ea tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] HTTP exception thrown: Invalid IP protocol tempest-999-612448459. Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-083fe07a-1266-4288-816f-9126055718ea tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Request method failure captured: Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 156 Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrIDqO_wICEuMyYq07BF-ldVlw-kdJwyOf0al8m7pj1V1DFuwUywt_Tq_IPt7lWyTD5U55tE_RVFolgCFS1JefWC8r0p5g2EyDEVXNsmkDIV1gxrGfZpNjrJNNT0JjOM4jGBivHD2QcaZsIEjL6yxpqewo8VqUBOrVcKj_geN8dv4A Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1af9aba15d9344a89db20178158157a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1af9aba15d9344a89db20178158157a8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}] Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 039d07088e4440e7ad806e3ebe8480f7 Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: {"security_group_rule": {"parent_group_id": "86d430cc-bc5a-445c-b11b-b183af1e5dfb", "ip_protocol": "tempest-999-612448459", "from_port": 22, "to_port": 22}} Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid IP protocol tempest-999-612448459. Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'security_group_rule': {'parent_group_id': '86d430cc-bc5a-445c-b11b-b183af1e5dfb', 'ip_protocol': 'tempest-999-612448459', 'from_port': 22, 'to_port': 22}}} Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-612448459. Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-612448459. Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:07.593388 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-612448459. Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-083fe07a-1266-4288-816f-9126055718ea tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Returning 400 to user: Invalid IP protocol tempest-999-612448459. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-083fe07a-1266-4288-816f-9126055718ea tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.533867 Oct 11 19:58:07.603228 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1854/3638] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 19:58:07 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 535 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 19:58:07.605528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e8b01713-35db-4089-8487-06981871d288 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83ccca6a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-584335980", "description": "tempest-description-1521855796"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:07.694502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-39905e7e-19ca-41b5-b535-349bf2d01def tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:07.711753 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-39905e7e-19ca-41b5-b535-349bf2d01def tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.977488 Oct 11 19:58:07.715277 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1785/3639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:06 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:07.745559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f98eaaed-6d7a-4b50-ab38-bcfeb5ca087f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:07.746170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f98eaaed-6d7a-4b50-ab38-bcfeb5ca087f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:07.773137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f98eaaed-6d7a-4b50-ab38-bcfeb5ca087f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:07.773646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f98eaaed-6d7a-4b50-ab38-bcfeb5ca087f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:07.774089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f98eaaed-6d7a-4b50-ab38-bcfeb5ca087f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:07.774967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f98eaaed-6d7a-4b50-ab38-bcfeb5ca087f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:07.775263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f98eaaed-6d7a-4b50-ab38-bcfeb5ca087f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:07.775681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f98eaaed-6d7a-4b50-ab38-bcfeb5ca087f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:08.037437 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e8b01713-35db-4089-8487-06981871d288 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.436282 Oct 11 19:58:08.039253 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1855/3640] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:58:07 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:08.053212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67f0eb4a-c6e5-41bd-afa0-419eae2970fa tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83cc31dee0>, body: {"security_group_rule": {"parent_group_id": "b99bc622-c91f-4640-8343-cb49ef6c8f45", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:08.500556 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-67f0eb4a-c6e5-41bd-afa0-419eae2970fa tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67f0eb4a-c6e5-41bd-afa0-419eae2970fa tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Request method failure captured: Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 138 Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrIDqO_wICEuMyYq07BF-ldVlw-kdJwyOf0al8m7pj1V1DFuwUywt_Tq_IPt7lWyTD5U55tE_RVFolgCFS1JefWC8r0p5g2EyDEVXNsmkDIV1gxrGfZpNjrJNNT0JjOM4jGBivHD2QcaZsIEjL6yxpqewo8VqUBOrVcKj_geN8dv4A Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1af9aba15d9344a89db20178158157a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1af9aba15d9344a89db20178158157a8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}] Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 039d07088e4440e7ad806e3ebe8480f7 Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: {"security_group_rule": {"parent_group_id": "b99bc622-c91f-4640-8343-cb49ef6c8f45", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b99bc622-c91f-4640-8343-cb49ef6c8f45', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 19:58:08.502643 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67f0eb4a-c6e5-41bd-afa0-419eae2970fa tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-67f0eb4a-c6e5-41bd-afa0-419eae2970fa tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.456263 Oct 11 19:58:08.506992 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1856/3641] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 19:58:08 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 457 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 19:58:08.518343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b73469a1-eb71-4cb9-8859-32a3b2d15d59 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83c732cf70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1181784068", "description": "tempest-description-542588380"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:08.684972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f98eaaed-6d7a-4b50-ab38-bcfeb5ca087f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:08.716947 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f98eaaed-6d7a-4b50-ab38-bcfeb5ca087f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.972866 Oct 11 19:58:08.749983 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1786/3642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:07 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:08.936844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1298027746", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "35295b7c-4089-4c98-81b0-9cc1d9c13721"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:09.059615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] validate_networks() for [('35295b7c-4089-4c98-81b0-9cc1d9c13721', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:58:09.538752 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b73469a1-eb71-4cb9-8859-32a3b2d15d59 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.026314 Oct 11 19:58:09.547137 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1857/3643] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 19:58:08 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:09.563169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c11dc3cc-16b9-4259-8fd7-1a448527791f tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83cc5dee50>, body: {"security_group_rule": {"parent_group_id": "79da247b-54d8-4ac7-972c-08fc2c11abb7", "ip_protocol": "tcp", "from_port": 22, "to_port": 418485627}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:10.426921 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c11dc3cc-16b9-4259-8fd7-1a448527791f tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] HTTP exception thrown: Invalid port range 22:418485627. Valid TCP ports should be between 1-65535 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c11dc3cc-16b9-4259-8fd7-1a448527791f tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Request method failure captured: Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 145 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrIDqO_wICEuMyYq07BF-ldVlw-kdJwyOf0al8m7pj1V1DFuwUywt_Tq_IPt7lWyTD5U55tE_RVFolgCFS1JefWC8r0p5g2EyDEVXNsmkDIV1gxrGfZpNjrJNNT0JjOM4jGBivHD2QcaZsIEjL6yxpqewo8VqUBOrVcKj_geN8dv4A Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1af9aba15d9344a89db20178158157a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1af9aba15d9344a89db20178158157a8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}] Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 039d07088e4440e7ad806e3ebe8480f7 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: {"security_group_rule": {"parent_group_id": "79da247b-54d8-4ac7-972c-08fc2c11abb7", "ip_protocol": "tcp", "from_port": 22, "to_port": 418485627}} Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid port range 22:418485627. Valid TCP ports should be between 1-65535 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'security_group_rule': {'parent_group_id': '79da247b-54d8-4ac7-972c-08fc2c11abb7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 418485627}}} Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:418485627. Valid TCP ports should be between 1-65535 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:418485627. Valid TCP ports should be between 1-65535 Oct 11 19:58:10.428571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:418485627. Valid TCP ports should be between 1-65535 Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c11dc3cc-16b9-4259-8fd7-1a448527791f tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Returning 400 to user: Invalid port range 22:418485627. Valid TCP ports should be between 1-65535 {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c11dc3cc-16b9-4259-8fd7-1a448527791f tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.879435 Oct 11 19:58:10.440430 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1858/3644] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 19:58:09 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 881 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 19:58:10.442854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-26c39049-75d0-44b3-af46-bf0a126266de tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Action: 'create', calling method: .version_select at 0x7f83cc485ca0>, body: {"security_group_rule": {"parent_group_id": "46cbf726-2461-42ec-a1c8-68fb7d1c0aa6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:10.655575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:58:10.656133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:58:10.656480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:58:10.657034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:58:10.657523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:58:10.679273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:10.680773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:10.681230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:10.685958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:10.686987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:10.687754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:10.733272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for project efd1bdcd18f14e87925a5b41393b9add. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:58:10.746080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for user 0647dca89de240ba9fbc1c59ed2b6392 and project efd1bdcd18f14e87925a5b41393b9add. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:58:10.770353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:58:10.778479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:58:10.859779 n-d-860864-3 devstack@n-api.service[126955]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [8ea8e8c1-269f-4eea-b215-db217e8d12eb] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 19:58:10.979752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-26c39049-75d0-44b3-af46-bf0a126266de tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 46cbf726-2461-42ec-a1c8-68fb7d1c0aa6 does not exist", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:58:10.986707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.security_group_api [None req-26c39049-75d0-44b3-af46-bf0a126266de tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Neutron security group 46cbf726-2461-42ec-a1c8-68fb7d1c0aa6 not found {{(pid=126956) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 19:58:10.988140 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-26c39049-75d0-44b3-af46-bf0a126266de tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] HTTP exception thrown: Security group 46cbf726-2461-42ec-a1c8-68fb7d1c0aa6 does not exist Oct 11 19:58:10.988140 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-444e5559-5ced-4773-9ebc-5d68ca65c2d4'] Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-26c39049-75d0-44b3-af46-bf0a126266de tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Request method failure captured: Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 138 Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrIDqO_wICEuMyYq07BF-ldVlw-kdJwyOf0al8m7pj1V1DFuwUywt_Tq_IPt7lWyTD5U55tE_RVFolgCFS1JefWC8r0p5g2EyDEVXNsmkDIV1gxrGfZpNjrJNNT0JjOM4jGBivHD2QcaZsIEjL6yxpqewo8VqUBOrVcKj_geN8dv4A Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1af9aba15d9344a89db20178158157a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1af9aba15d9344a89db20178158157a8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}] Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 039d07088e4440e7ad806e3ebe8480f7 Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: {"security_group_rule": {"parent_group_id": "46cbf726-2461-42ec-a1c8-68fb7d1c0aa6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: exception: Security group 46cbf726-2461-42ec-a1c8-68fb7d1c0aa6 does not exist Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-444e5559-5ced-4773-9ebc-5d68ca65c2d4'] Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'security_group_rule': {'parent_group_id': '46cbf726-2461-42ec-a1c8-68fb7d1c0aa6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:58:10.992002 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 46cbf726-2461-42ec-a1c8-68fb7d1c0aa6 does not exist Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444e5559-5ced-4773-9ebc-5d68ca65c2d4'] Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 46cbf726-2461-42ec-a1c8-68fb7d1c0aa6 does not exist Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444e5559-5ced-4773-9ebc-5d68ca65c2d4'] Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 46cbf726-2461-42ec-a1c8-68fb7d1c0aa6 does not exist Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444e5559-5ced-4773-9ebc-5d68ca65c2d4'] Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 46cbf726-2461-42ec-a1c8-68fb7d1c0aa6 does not exist Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-444e5559-5ced-4773-9ebc-5d68ca65c2d4'] Oct 11 19:58:10.996393 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:11.005316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-26c39049-75d0-44b3-af46-bf0a126266de tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Returning 404 to user: Security group 46cbf726-2461-42ec-a1c8-68fb7d1c0aa6 does not exist Oct 11 19:58:11.005316 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-444e5559-5ced-4773-9ebc-5d68ca65c2d4'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:11.008225 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-26c39049-75d0-44b3-af46-bf0a126266de tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.569900 Oct 11 19:58:11.009631 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1859/3645] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 19:58:10 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 572 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:58:11.020544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2dc4bbf3-b8ab-47da-ab79-ff286e1aba89 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Calling method '.version_select at 0x7f83cc5dee50>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:11.270025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=29 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:11.379879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-2dc4bbf3-b8ab-47da-ab79-ff286e1aba89 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule cf6e9f22-876b-44a3-8a55-20f50d46aef0 does not exist", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 19:58:11.381787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.security_group_api [None req-2dc4bbf3-b8ab-47da-ab79-ff286e1aba89 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Neutron security group rule cf6e9f22-876b-44a3-8a55-20f50d46aef0 not found {{(pid=126956) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 11 19:58:11.382480 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-2dc4bbf3-b8ab-47da-ab79-ff286e1aba89 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] HTTP exception thrown: Security group rule cf6e9f22-876b-44a3-8a55-20f50d46aef0 does not exist Oct 11 19:58:11.382480 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-b823ab8e-5360-4943-a8f5-efebe02be99b'] Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2dc4bbf3-b8ab-47da-ab79-ff286e1aba89 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Request method failure captured: Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-security-group-rules/cf6e9f22-876b-44a3-8a55-20f50d46aef0 HTTP/1.1 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrIDqO_wICEuMyYq07BF-ldVlw-kdJwyOf0al8m7pj1V1DFuwUywt_Tq_IPt7lWyTD5U55tE_RVFolgCFS1JefWC8r0p5g2EyDEVXNsmkDIV1gxrGfZpNjrJNNT0JjOM4jGBivHD2QcaZsIEjL6yxpqewo8VqUBOrVcKj_geN8dv4A Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1af9aba15d9344a89db20178158157a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1af9aba15d9344a89db20178158157a8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1af9aba15d9344a89db20178158157a8"}]}] Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1af9aba15d9344a89db20178158157a8 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 039d07088e4440e7ad806e3ebe8480f7 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-888684925-project Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: exception: Security group rule cf6e9f22-876b-44a3-8a55-20f50d46aef0 does not exist Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-b823ab8e-5360-4943-a8f5-efebe02be99b'] Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'cf6e9f22-876b-44a3-8a55-20f50d46aef0'} Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 19:58:11.385714 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule cf6e9f22-876b-44a3-8a55-20f50d46aef0 does not exist Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b823ab8e-5360-4943-a8f5-efebe02be99b'] Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule cf6e9f22-876b-44a3-8a55-20f50d46aef0 does not exist Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b823ab8e-5360-4943-a8f5-efebe02be99b'] Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule cf6e9f22-876b-44a3-8a55-20f50d46aef0 does not exist Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b823ab8e-5360-4943-a8f5-efebe02be99b'] Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule cf6e9f22-876b-44a3-8a55-20f50d46aef0 does not exist Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b823ab8e-5360-4943-a8f5-efebe02be99b'] Oct 11 19:58:11.390546 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:11.397528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2dc4bbf3-b8ab-47da-ab79-ff286e1aba89 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Returning 404 to user: Security group rule cf6e9f22-876b-44a3-8a55-20f50d46aef0 does not exist Oct 11 19:58:11.397528 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-b823ab8e-5360-4943-a8f5-efebe02be99b'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:11.399456 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2dc4bbf3-b8ab-47da-ab79-ff286e1aba89 tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/cf6e9f22-876b-44a3-8a55-20f50d46aef0" status: 404 len: 199 microversion: 2.1 time: 0.382474 Oct 11 19:58:11.400541 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1860/3646] 10.222.0.27 () {58 vars in 1287 bytes} [Tue Oct 11 19:58:11 2022] DELETE /compute/v2.1/os-security-group-rules/cf6e9f22-876b-44a3-8a55-20f50d46aef0 => generated 199 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:58:11.413958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3554d9f9-1dd3-40f6-a67c-dc893f48c4fd tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Calling method '.version_select at 0x7f83cc5de3a0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:11.869670 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [8ea8e8c1-269f-4eea-b215-db217e8d12eb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55310. Oct 11 19:58:11.876653 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f145fe7d-c827-4d64-bc1b-b3e370f8c75a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.943564 Oct 11 19:58:11.878803 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1787/3647] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:58:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:58:12.046154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=70 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:12.194814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9485db9-38a6-40f8-a1d2-8ebec423674c tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Action: 'create', calling method: .version_select at 0x7f83c72860d0>, body: {"keypair": {"name": "tempest-keypair-1631076610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvs7pTJXr1MJUuFXE/aY0V70PL4+5BPRa0h1k4g1pSlQGMLurw+aX96jyAPF4MD77S4PdgH5/Wy/VBscVOj0Vhq7zC8L3XWieGlIId9dUjd+u2047B7A4oYQA2LhJU9fQ=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:12.224061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:12.224223 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3554d9f9-1dd3-40f6-a67c-dc893f48c4fd tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/79da247b-54d8-4ac7-972c-08fc2c11abb7" status: 202 len: 0 microversion: 2.1 time: 0.817240 Oct 11 19:58:12.225102 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1861/3648] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:58:11 2022] DELETE /compute/v2.1/os-security-groups/79da247b-54d8-4ac7-972c-08fc2c11abb7 => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:58:12.233777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-85956a41-7d02-4929-b897-61f0ec9ffd0f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:12.234406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-85956a41-7d02-4929-b897-61f0ec9ffd0f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:12.261727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f9485db9-38a6-40f8-a1d2-8ebec423674c tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Getting quotas for project f63b32c07e704b3a895d2427ef38a5c3. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:58:12.274176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f9485db9-38a6-40f8-a1d2-8ebec423674c tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Getting quotas for user 0c2160cb11ec4591b301d4b518f06169 and project f63b32c07e704b3a895d2427ef38a5c3. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:58:12.331472 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9485db9-38a6-40f8-a1d2-8ebec423674c tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.450842 Oct 11 19:58:12.332143 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1788/3649] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:58:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:12.361866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c751840b-0e0f-4412-a6ac-ca84acba306e tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Calling method '.version_select at 0x7f83c7ada820>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:12.563841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-85956a41-7d02-4929-b897-61f0ec9ffd0f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:12.572212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-85956a41-7d02-4929-b897-61f0ec9ffd0f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1215 microversion: 2.1 time: 0.345382 Oct 11 19:58:12.572808 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1862/3650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:12 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1215 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:13.021915 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c751840b-0e0f-4412-a6ac-ca84acba306e tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b99bc622-c91f-4640-8343-cb49ef6c8f45" status: 202 len: 0 microversion: 2.1 time: 0.682564 Oct 11 19:58:13.022855 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1789/3651] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:58:12 2022] DELETE /compute/v2.1/os-security-groups/b99bc622-c91f-4640-8343-cb49ef6c8f45 => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:58:13.032612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99c6dbf3-5fea-4382-8407-425163980a8e tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Calling method '.version_select at 0x7f83cc5b2670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:13.600311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ef35a225-311e-493b-a15c-23d942270cc1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:13.600924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ef35a225-311e-493b-a15c-23d942270cc1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:13.618254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef35a225-311e-493b-a15c-23d942270cc1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:13.618778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef35a225-311e-493b-a15c-23d942270cc1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:13.627820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef35a225-311e-493b-a15c-23d942270cc1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:13.629518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef35a225-311e-493b-a15c-23d942270cc1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:13.630167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef35a225-311e-493b-a15c-23d942270cc1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:13.630908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef35a225-311e-493b-a15c-23d942270cc1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:13.940162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ef35a225-311e-493b-a15c-23d942270cc1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:13.954076 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ef35a225-311e-493b-a15c-23d942270cc1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1219 microversion: 2.1 time: 0.358307 Oct 11 19:58:13.955693 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1790/3652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:13 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1219 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:13.960406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:13.964948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:13.983478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:13.984259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:13.984864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:13.985794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:13.987474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:13.988093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:14.021382 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e HTTP/1.1 Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f2251c32-cb71-4195-a9df-cf9ea9f3c20e'} Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:58:14.023662 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:58:14.028559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:14.035734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:14.037544 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7b464b27-a38c-4429-8f1d-95be9f2e8f1d tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 404 len: 111 microversion: 2.1 time: 0.080878 Oct 11 19:58:14.040765 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1791/3653] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:58:13 2022] DELETE /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:58:14.049285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:14.055400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: f2251c32-cb71-4195-a9df-cf9ea9f3c20e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:14.076303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:14.083305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:14.084076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:14.085020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:14.085680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:14.086324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:14.119840 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e HTTP/1.1 Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f2251c32-cb71-4195-a9df-cf9ea9f3c20e'} Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:14.128803 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:14.136636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:14.136636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:14.136636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:14.136636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:14.136636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:14.136636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. Oct 11 19:58:14.136636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:14.147151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance f2251c32-cb71-4195-a9df-cf9ea9f3c20e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:14.151329 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ae306038-abbb-4895-8436-25c9d1f78158 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e" status: 404 len: 111 microversion: 2.1 time: 0.106365 Oct 11 19:58:14.158627 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1792/3654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:14 2022] GET /compute/v2.1/servers/f2251c32-cb71-4195-a9df-cf9ea9f3c20e => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:58:14.164106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-302760b5-7e15-4186-ad1a-049d881eb7c5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:14.173513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-302760b5-7e15-4186-ad1a-049d881eb7c5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:14.187563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302760b5-7e15-4186-ad1a-049d881eb7c5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:14.188597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302760b5-7e15-4186-ad1a-049d881eb7c5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:14.190772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302760b5-7e15-4186-ad1a-049d881eb7c5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:14.191849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302760b5-7e15-4186-ad1a-049d881eb7c5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:14.193683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302760b5-7e15-4186-ad1a-049d881eb7c5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:14.198563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-302760b5-7e15-4186-ad1a-049d881eb7c5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:14.202394 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99c6dbf3-5fea-4382-8407-425163980a8e tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/86d430cc-bc5a-445c-b11b-b183af1e5dfb" status: 202 len: 0 microversion: 2.1 time: 1.175485 Oct 11 19:58:14.203589 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1863/3655] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:58:13 2022] DELETE /compute/v2.1/os-security-groups/86d430cc-bc5a-445c-b11b-b183af1e5dfb => generated 0 bytes in 1177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:58:14.211728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d052d89-c5ed-4449-abf9-ec80223799bc tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Calling method '.version_select at 0x7f83cc4aed30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:14.284075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-302760b5-7e15-4186-ad1a-049d881eb7c5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:58:14.484994 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-302760b5-7e15-4186-ad1a-049d881eb7c5 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "DELETE /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 204 len: 0 microversion: 2.1 time: 0.324465 Oct 11 19:58:14.487512 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1793/3656] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:58:14 2022] DELETE /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:58:14.497585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-92a4336f-5542-46ac-9a04-d5eb0e049588 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:14.498579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-92a4336f-5542-46ac-9a04-d5eb0e049588 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:14.510073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92a4336f-5542-46ac-9a04-d5eb0e049588 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:14.510901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92a4336f-5542-46ac-9a04-d5eb0e049588 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:14.521384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92a4336f-5542-46ac-9a04-d5eb0e049588 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:14.522137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92a4336f-5542-46ac-9a04-d5eb0e049588 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:14.522630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92a4336f-5542-46ac-9a04-d5eb0e049588 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:14.523245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92a4336f-5542-46ac-9a04-d5eb0e049588 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:14.836365 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0d052d89-c5ed-4449-abf9-ec80223799bc tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/cd706590-9e2f-4ba4-8c81-240360cb81e5" status: 202 len: 0 microversion: 2.1 time: 0.628393 Oct 11 19:58:14.837500 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1864/3657] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:58:14 2022] DELETE /compute/v2.1/os-security-groups/cd706590-9e2f-4ba4-8c81-240360cb81e5 => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 19:58:14.846045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb3b4fce-6453-47ed-9827-4cd59f90558b tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] Calling method '.version_select at 0x7f83cc5b2040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:15.089324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-92a4336f-5542-46ac-9a04-d5eb0e049588 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:15.105779 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-92a4336f-5542-46ac-9a04-d5eb0e049588 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 0.612935 Oct 11 19:58:15.109541 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1794/3658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:14 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:15.125491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-52eed09c-6e8d-42e1-85bf-d83ee3221368 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:15.127016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-52eed09c-6e8d-42e1-85bf-d83ee3221368 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:15.144305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52eed09c-6e8d-42e1-85bf-d83ee3221368 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:15.148020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52eed09c-6e8d-42e1-85bf-d83ee3221368 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:15.149067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52eed09c-6e8d-42e1-85bf-d83ee3221368 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:15.151132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52eed09c-6e8d-42e1-85bf-d83ee3221368 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:15.152193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52eed09c-6e8d-42e1-85bf-d83ee3221368 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:15.153488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52eed09c-6e8d-42e1-85bf-d83ee3221368 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:15.350113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-52eed09c-6e8d-42e1-85bf-d83ee3221368 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:15.361527 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-52eed09c-6e8d-42e1-85bf-d83ee3221368 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1275 microversion: 2.1 time: 0.246857 Oct 11 19:58:15.371502 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1795/3659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:15 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:15.642218 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb3b4fce-6453-47ed-9827-4cd59f90558b tempest-SecurityGroupRulesNegativeTestJSON-888684925 tempest-SecurityGroupRulesNegativeTestJSON-888684925-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b8fcedf5-b170-4ba6-82a2-bb672b77f88e" status: 202 len: 0 microversion: 2.1 time: 0.800488 Oct 11 19:58:15.643281 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1865/3660] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 19:58:14 2022] DELETE /compute/v2.1/os-security-groups/b8fcedf5-b170-4ba6-82a2-bb672b77f88e => generated 0 bytes in 802 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:58:16.136554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b45cd3e-2d89-4f01-8fbe-692521b49110 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:16.137702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b45cd3e-2d89-4f01-8fbe-692521b49110 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:16.155455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b45cd3e-2d89-4f01-8fbe-692521b49110 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:16.156301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b45cd3e-2d89-4f01-8fbe-692521b49110 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:16.160963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b45cd3e-2d89-4f01-8fbe-692521b49110 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:16.161903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b45cd3e-2d89-4f01-8fbe-692521b49110 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:16.163067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b45cd3e-2d89-4f01-8fbe-692521b49110 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:16.175348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b45cd3e-2d89-4f01-8fbe-692521b49110 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:16.399819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dda88140-fd76-4573-b925-e419fbc2c84e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:16.401494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dda88140-fd76-4573-b925-e419fbc2c84e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:16.414398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dda88140-fd76-4573-b925-e419fbc2c84e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:16.423395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dda88140-fd76-4573-b925-e419fbc2c84e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:16.424357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dda88140-fd76-4573-b925-e419fbc2c84e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:16.425284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dda88140-fd76-4573-b925-e419fbc2c84e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:16.425916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dda88140-fd76-4573-b925-e419fbc2c84e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:16.426558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dda88140-fd76-4573-b925-e419fbc2c84e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:16.893225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dda88140-fd76-4573-b925-e419fbc2c84e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:16.901330 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dda88140-fd76-4573-b925-e419fbc2c84e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1273 microversion: 2.1 time: 0.505329 Oct 11 19:58:16.903887 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1866/3661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:16 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1273 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:17.371579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b45cd3e-2d89-4f01-8fbe-692521b49110 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:17.385131 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b45cd3e-2d89-4f01-8fbe-692521b49110 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 1.253011 Oct 11 19:58:17.386276 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1796/3662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:16 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:17.931610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c93c87f-588f-4d1f-a3a5-b97d34d944ce tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:17.932954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c93c87f-588f-4d1f-a3a5-b97d34d944ce tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:17.945058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c93c87f-588f-4d1f-a3a5-b97d34d944ce tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:17.952346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c93c87f-588f-4d1f-a3a5-b97d34d944ce tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:17.952744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c93c87f-588f-4d1f-a3a5-b97d34d944ce tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:17.955410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c93c87f-588f-4d1f-a3a5-b97d34d944ce tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:17.956029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c93c87f-588f-4d1f-a3a5-b97d34d944ce tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:17.956973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c93c87f-588f-4d1f-a3a5-b97d34d944ce tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:18.412991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9e6872e-2b6c-4d0f-9bd2-7d89a19ac7ce tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:18.413699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f9e6872e-2b6c-4d0f-9bd2-7d89a19ac7ce tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:18.414799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c93c87f-588f-4d1f-a3a5-b97d34d944ce tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:18.426045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9e6872e-2b6c-4d0f-9bd2-7d89a19ac7ce tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:18.426693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9e6872e-2b6c-4d0f-9bd2-7d89a19ac7ce tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:18.427413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9e6872e-2b6c-4d0f-9bd2-7d89a19ac7ce tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:18.428374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9e6872e-2b6c-4d0f-9bd2-7d89a19ac7ce tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:18.429851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9e6872e-2b6c-4d0f-9bd2-7d89a19ac7ce tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:18.430487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9e6872e-2b6c-4d0f-9bd2-7d89a19ac7ce tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:18.442993 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c93c87f-588f-4d1f-a3a5-b97d34d944ce tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1273 microversion: 2.1 time: 0.515145 Oct 11 19:58:18.445327 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1867/3663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:17 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1273 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:19.312096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "cf88ac10-d693-45a2-915b-afda775efeb1"}], "security_groups": [{"name": "tempest-securitygroup--288072364"}], "key_name": "tempest-keypair-1631076610", "user_data": "}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:19.747804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f9e6872e-2b6c-4d0f-9bd2-7d89a19ac7ce tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f978f677e3e463c9599ed524cc33e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5612f57424051949f9a1d3e085611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:19.762212 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9e6872e-2b6c-4d0f-9bd2-7d89a19ac7ce tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 200 len: 1512 microversion: 2.1 time: 1.355621 Oct 11 19:58:19.766661 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1797/3664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:18 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 1512 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:19.776388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-60923dbd-ce75-45e2-ba33-93f2ea8908db tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:19.777329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-60923dbd-ce75-45e2-ba33-93f2ea8908db tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:19.791513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60923dbd-ce75-45e2-ba33-93f2ea8908db tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:19.792114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60923dbd-ce75-45e2-ba33-93f2ea8908db tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:19.793155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60923dbd-ce75-45e2-ba33-93f2ea8908db tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:19.794115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60923dbd-ce75-45e2-ba33-93f2ea8908db tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:19.795591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60923dbd-ce75-45e2-ba33-93f2ea8908db tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:19.796155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60923dbd-ce75-45e2-ba33-93f2ea8908db tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:20.059572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-60923dbd-ce75-45e2-ba33-93f2ea8908db tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:20.076631 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-60923dbd-ce75-45e2-ba33-93f2ea8908db tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1273 microversion: 2.1 time: 0.308459 Oct 11 19:58:20.081131 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1798/3665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:19 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:20.140294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] validate_networks() for [('cf88ac10-d693-45a2-915b-afda775efeb1', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:58:20.375837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2033660943", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "95e3b674-0b5e-40c7-945c-485aa05d6c41"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:20.466582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] validate_networks() for [('95e3b674-0b5e-40c7-945c-485aa05d6c41', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:58:20.703897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:22.189936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:58:22.190577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:58:22.192682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:58:22.194071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:58:22.194487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:58:22.210485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.211530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.212401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.213647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.214394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.215201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.255581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Getting quotas for project f63b32c07e704b3a895d2427ef38a5c3. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:58:22.263724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Getting quotas for user 0c2160cb11ec4591b301d4b518f06169 and project f63b32c07e704b3a895d2427ef38a5c3. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:58:22.287331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:58:22.287891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:58:22.288215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:58:22.288622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:58:22.289032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:58:22.291162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:58:22.293481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:22.299337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:58:22.308307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.311309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.312139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.316102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.316796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.317946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.374002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Getting quotas for project 9d1efaec3c7640d684256bc6460e7559. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:58:22.386646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Getting quotas for user bfddbe97757446b58c605f5f6f64500c and project 9d1efaec3c7640d684256bc6460e7559. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:58:22.393096 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a5669c76-f722-405c-84a6-dfa830363da6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.085561 Oct 11 19:58:22.399893 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1868/3666] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:58:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 3087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:58:22.402111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-94eebf2d-308b-45d4-bec9-48872c430075 req-1f0f03c8-4012-42ed-9531-d24c82e642bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f1dc40-ef33-40f8-b128-d5c6367e833e", "name": "network-vif-deleted", "tag": "7033f16c-8fb2-4050-810b-a6de0ea759f0"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:22.419314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-94eebf2d-308b-45d4-bec9-48872c430075 req-1f0f03c8-4012-42ed-9531-d24c82e642bf service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.419804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-94eebf2d-308b-45d4-bec9-48872c430075 req-1f0f03c8-4012-42ed-9531-d24c82e642bf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.420238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-94eebf2d-308b-45d4-bec9-48872c430075 req-1f0f03c8-4012-42ed-9531-d24c82e642bf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.439906 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-94eebf2d-308b-45d4-bec9-48872c430075 req-1f0f03c8-4012-42ed-9531-d24c82e642bf service nova] Creating event network-vif-deleted:7033f16c-8fb2-4050-810b-a6de0ea759f0 for instance 85f1dc40-ef33-40f8-b128-d5c6367e833e on n-h1-860864-3 Oct 11 19:58:22.448350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:58:22.451329 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-94eebf2d-308b-45d4-bec9-48872c430075 req-1f0f03c8-4012-42ed-9531-d24c82e642bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055823 Oct 11 19:58:22.451468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:58:22.453093 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1869/3667] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:22.459568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aaf22641-1123-4491-bc81-aef8098ae420 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:22.460800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aaf22641-1123-4491-bc81-aef8098ae420 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:22.468906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaf22641-1123-4491-bc81-aef8098ae420 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.469705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaf22641-1123-4491-bc81-aef8098ae420 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.470459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaf22641-1123-4491-bc81-aef8098ae420 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.472361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaf22641-1123-4491-bc81-aef8098ae420 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.473322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaf22641-1123-4491-bc81-aef8098ae420 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.478738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaf22641-1123-4491-bc81-aef8098ae420 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.601699 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b47bc977-5361-44d3-8f32-c95c5e9a6229 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.516637 Oct 11 19:58:22.603916 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1799/3668] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:58:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:58:22.616670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:22.619945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] [instance: 85f1dc40-ef33-40f8-b128-d5c6367e833e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:22.635299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-aaf22641-1123-4491-bc81-aef8098ae420 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lazy-loading 'services' on Instance uuid e1c4b045-264a-41c3-b8e8-5a038c485877 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:58:22.653078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.657161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.657787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.666344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.667244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.667800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.708452 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] HTTP exception thrown: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e could not be found. Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Request method failure captured: Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e HTTP/1.1 Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnYTTGnKqqaynxPlipVscf2Tk2E4VmuaIJkZHu85lJ5We72vxjEkhThviXol1UU8Jd0SPf3do5qwgNwR8I2qwGIErnocsYVSm12DbldQRMK7U3UvNHqeIY4Kox8qEbYh06GMuVav22mzuf0dAxFN2cArhpmKqJBsUqxCAyB-8rE2rQ Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef5612f57424051949f9a1d3e085611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef5612f57424051949f9a1d3e085611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef5612f57424051949f9a1d3e085611"}]}] Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bef5612f57424051949f9a1d3e085611 Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2114150269 Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 3f978f677e3e463c9599ed524cc33e34 Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-2114150269-project Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e could not be found. Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '85f1dc40-ef33-40f8-b128-d5c6367e833e'} Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e could not be found. Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e could not be found. Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:22.716834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:22.722614 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:22.722614 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:22.722614 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:22.722614 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:22.722614 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:22.722614 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e could not be found. Oct 11 19:58:22.722614 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:22.723686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] Returning 404 to user: Instance 85f1dc40-ef33-40f8-b128-d5c6367e833e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:22.725980 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51ed0ca1-4789-4778-99aa-190cbbd7ca41 tempest-ServersNegativeTestJSON-2114150269 tempest-ServersNegativeTestJSON-2114150269-project] 10.222.0.27 "GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e" status: 404 len: 111 microversion: 2.1 time: 0.120287 Oct 11 19:58:22.728277 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1800/3669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:22 2022] GET /compute/v2.1/servers/85f1dc40-ef33-40f8-b128-d5c6367e833e => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:58:22.743466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d35bd0f9-dbbb-4aa1-afde-574146328722 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:22.744131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d35bd0f9-dbbb-4aa1-afde-574146328722 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:22.752219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35bd0f9-dbbb-4aa1-afde-574146328722 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.753598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35bd0f9-dbbb-4aa1-afde-574146328722 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.754059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35bd0f9-dbbb-4aa1-afde-574146328722 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.755683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35bd0f9-dbbb-4aa1-afde-574146328722 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:22.756860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35bd0f9-dbbb-4aa1-afde-574146328722 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:22.757306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d35bd0f9-dbbb-4aa1-afde-574146328722 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:22.779388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:22.808075 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aaf22641-1123-4491-bc81-aef8098ae420 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments/7843b57b-2a59-49ee-b87b-c8c7fa462b21" status: 202 len: 0 microversion: 2.1 time: 0.353004 Oct 11 19:58:22.812764 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1870/3670] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 19:58:22 2022] DELETE /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments/7843b57b-2a59-49ee-b87b-c8c7fa462b21 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:58:22.827434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d09aba29-488a-448c-9c62-3ae4465e484e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:22.829336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d09aba29-488a-448c-9c62-3ae4465e484e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:23.239449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d09aba29-488a-448c-9c62-3ae4465e484e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:23.248202 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d09aba29-488a-448c-9c62-3ae4465e484e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1226 microversion: 2.1 time: 0.433918 Oct 11 19:58:23.248658 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1871/3671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:22 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1226 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:23.270020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6506059-f1c3-47e7-a396-318db5857ed9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:23.270664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6506059-f1c3-47e7-a396-318db5857ed9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:23.528003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f6506059-f1c3-47e7-a396-318db5857ed9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:23.539440 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6506059-f1c3-47e7-a396-318db5857ed9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1208 microversion: 2.1 time: 0.284086 Oct 11 19:58:23.540053 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1872/3672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:23 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1208 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:23.548037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77110cf3-4dc5-4068-8544-ee99a6a21a9a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:23.558443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-77110cf3-4dc5-4068-8544-ee99a6a21a9a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:23.574776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77110cf3-4dc5-4068-8544-ee99a6a21a9a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:23.575588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77110cf3-4dc5-4068-8544-ee99a6a21a9a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:23.576207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77110cf3-4dc5-4068-8544-ee99a6a21a9a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:23.577092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77110cf3-4dc5-4068-8544-ee99a6a21a9a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:23.577719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77110cf3-4dc5-4068-8544-ee99a6a21a9a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:23.581351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77110cf3-4dc5-4068-8544-ee99a6a21a9a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:23.621941 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-77110cf3-4dc5-4068-8544-ee99a6a21a9a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077997 Oct 11 19:58:23.633437 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1873/3673] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:58:23 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:23.778763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d35bd0f9-dbbb-4aa1-afde-574146328722 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:23.787992 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d35bd0f9-dbbb-4aa1-afde-574146328722 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1315 microversion: 2.1 time: 1.058431 Oct 11 19:58:23.791179 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1801/3674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:22 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1315 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:24.273861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ec7d7a12-f08a-4245-b346-c136bacf0f80 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:24.275199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ec7d7a12-f08a-4245-b346-c136bacf0f80 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:24.297891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec7d7a12-f08a-4245-b346-c136bacf0f80 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:24.300566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec7d7a12-f08a-4245-b346-c136bacf0f80 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:24.304517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec7d7a12-f08a-4245-b346-c136bacf0f80 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:24.307279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec7d7a12-f08a-4245-b346-c136bacf0f80 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:24.308566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec7d7a12-f08a-4245-b346-c136bacf0f80 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:24.322930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec7d7a12-f08a-4245-b346-c136bacf0f80 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:24.569361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ec7d7a12-f08a-4245-b346-c136bacf0f80 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:24.576441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84201007-b797-42e9-b745-81ee77880b50 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:24.579622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-84201007-b797-42e9-b745-81ee77880b50 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:24.594147 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ec7d7a12-f08a-4245-b346-c136bacf0f80 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1278 microversion: 2.1 time: 0.324871 Oct 11 19:58:24.599569 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1874/3675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:24 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1278 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:24.605325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84201007-b797-42e9-b745-81ee77880b50 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:24.606091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84201007-b797-42e9-b745-81ee77880b50 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:24.609679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84201007-b797-42e9-b745-81ee77880b50 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:24.610807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84201007-b797-42e9-b745-81ee77880b50 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:24.611579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84201007-b797-42e9-b745-81ee77880b50 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:24.615007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84201007-b797-42e9-b745-81ee77880b50 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:24.645174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-df734080-65f3-4a8a-a226-e3dfb2bc5f09 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:24.648678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-df734080-65f3-4a8a-a226-e3dfb2bc5f09 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:24.662474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df734080-65f3-4a8a-a226-e3dfb2bc5f09 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:24.664699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df734080-65f3-4a8a-a226-e3dfb2bc5f09 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:24.667220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df734080-65f3-4a8a-a226-e3dfb2bc5f09 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:24.668215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df734080-65f3-4a8a-a226-e3dfb2bc5f09 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:24.670788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df734080-65f3-4a8a-a226-e3dfb2bc5f09 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:24.671762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df734080-65f3-4a8a-a226-e3dfb2bc5f09 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:24.785898 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-df734080-65f3-4a8a-a226-e3dfb2bc5f09 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145087 Oct 11 19:58:24.790146 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1875/3676] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:58:24 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:24.816225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1f5c41dd-242e-40d5-a98d-8384dfa9b6e2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:24.817553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1f5c41dd-242e-40d5-a98d-8384dfa9b6e2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:24.828332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5c41dd-242e-40d5-a98d-8384dfa9b6e2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:24.830984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5c41dd-242e-40d5-a98d-8384dfa9b6e2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:24.833557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5c41dd-242e-40d5-a98d-8384dfa9b6e2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:24.834875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5c41dd-242e-40d5-a98d-8384dfa9b6e2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:24.836948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5c41dd-242e-40d5-a98d-8384dfa9b6e2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:24.838224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f5c41dd-242e-40d5-a98d-8384dfa9b6e2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:25.118599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-84201007-b797-42e9-b745-81ee77880b50 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:25.127358 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-84201007-b797-42e9-b745-81ee77880b50 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1260 microversion: 2.1 time: 0.563478 Oct 11 19:58:25.142442 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1802/3677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:24 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1260 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:25.628571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f164df5c-e7e2-4077-abab-df9ffa9f4839 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:25.629444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f164df5c-e7e2-4077-abab-df9ffa9f4839 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:25.642849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f164df5c-e7e2-4077-abab-df9ffa9f4839 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:25.643490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f164df5c-e7e2-4077-abab-df9ffa9f4839 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:25.643978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f164df5c-e7e2-4077-abab-df9ffa9f4839 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:25.644695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f164df5c-e7e2-4077-abab-df9ffa9f4839 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:25.645150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f164df5c-e7e2-4077-abab-df9ffa9f4839 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:25.645574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f164df5c-e7e2-4077-abab-df9ffa9f4839 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:25.786671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1f5c41dd-242e-40d5-a98d-8384dfa9b6e2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:25.801010 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1f5c41dd-242e-40d5-a98d-8384dfa9b6e2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1315 microversion: 2.1 time: 0.991323 Oct 11 19:58:25.801586 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1876/3678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:24 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1315 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:25.808961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c1130cc0-00bc-4c6c-90dd-19877c20c53d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:25.815053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1130cc0-00bc-4c6c-90dd-19877c20c53d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:25.838117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1130cc0-00bc-4c6c-90dd-19877c20c53d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:25.838645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1130cc0-00bc-4c6c-90dd-19877c20c53d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:25.839084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1130cc0-00bc-4c6c-90dd-19877c20c53d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:25.839788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1130cc0-00bc-4c6c-90dd-19877c20c53d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:25.840243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1130cc0-00bc-4c6c-90dd-19877c20c53d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:25.840665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1130cc0-00bc-4c6c-90dd-19877c20c53d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:25.952779 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c1130cc0-00bc-4c6c-90dd-19877c20c53d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149818 Oct 11 19:58:25.963763 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1877/3679] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:58:25 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:25.968244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f164df5c-e7e2-4077-abab-df9ffa9f4839 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:25.989361 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f164df5c-e7e2-4077-abab-df9ffa9f4839 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1284 microversion: 2.1 time: 0.365222 Oct 11 19:58:25.990612 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1803/3680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:25 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1284 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:26.149619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d5a995a4-8f48-4b08-bc06-bccf00a4027e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:26.150861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d5a995a4-8f48-4b08-bc06-bccf00a4027e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:26.165411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a995a4-8f48-4b08-bc06-bccf00a4027e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:26.166255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a995a4-8f48-4b08-bc06-bccf00a4027e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:26.166974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a995a4-8f48-4b08-bc06-bccf00a4027e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:26.167954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a995a4-8f48-4b08-bc06-bccf00a4027e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:26.171132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a995a4-8f48-4b08-bc06-bccf00a4027e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:26.171877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a995a4-8f48-4b08-bc06-bccf00a4027e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:26.352322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d5a995a4-8f48-4b08-bc06-bccf00a4027e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:26.367125 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d5a995a4-8f48-4b08-bc06-bccf00a4027e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1266 microversion: 2.1 time: 0.221233 Oct 11 19:58:26.379465 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1878/3681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:26 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:26.512197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-18d2a2d8-e6a1-48ba-b785-4dd3653fb0a1 req-046ab8ea-8c53-4c87-a765-743743c2fa59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c86a44e-bc4e-4fe8-b3cb-fce035d48458", "tag": "3453a8cd-4bc4-49f3-80f0-9d3ba710c8e8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:26.522921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-18d2a2d8-e6a1-48ba-b785-4dd3653fb0a1 req-046ab8ea-8c53-4c87-a765-743743c2fa59 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:26.523804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-18d2a2d8-e6a1-48ba-b785-4dd3653fb0a1 req-046ab8ea-8c53-4c87-a765-743743c2fa59 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:26.524480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-18d2a2d8-e6a1-48ba-b785-4dd3653fb0a1 req-046ab8ea-8c53-4c87-a765-743743c2fa59 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:26.538863 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-18d2a2d8-e6a1-48ba-b785-4dd3653fb0a1 req-046ab8ea-8c53-4c87-a765-743743c2fa59 service nova] Creating event network-changed:3453a8cd-4bc4-49f3-80f0-9d3ba710c8e8 for instance 2c86a44e-bc4e-4fe8-b3cb-fce035d48458 on n-h1-860864-3 Oct 11 19:58:26.544274 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-18d2a2d8-e6a1-48ba-b785-4dd3653fb0a1 req-046ab8ea-8c53-4c87-a765-743743c2fa59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037018 Oct 11 19:58:26.545297 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1804/3682] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:58:26.825294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c2c2610f-fab4-4f3d-a19c-32a73deecf5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:26.825905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c2c2610f-fab4-4f3d-a19c-32a73deecf5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:26.837750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2c2610f-fab4-4f3d-a19c-32a73deecf5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:26.838579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2c2610f-fab4-4f3d-a19c-32a73deecf5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:26.839202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2c2610f-fab4-4f3d-a19c-32a73deecf5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:26.851672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2c2610f-fab4-4f3d-a19c-32a73deecf5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:26.852823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2c2610f-fab4-4f3d-a19c-32a73deecf5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:26.853435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2c2610f-fab4-4f3d-a19c-32a73deecf5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:26.967292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6589c7f6-41d3-43aa-9f96-3f56915f39cd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:26.970079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6589c7f6-41d3-43aa-9f96-3f56915f39cd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:26.986211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6589c7f6-41d3-43aa-9f96-3f56915f39cd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:26.987098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6589c7f6-41d3-43aa-9f96-3f56915f39cd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:26.987752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6589c7f6-41d3-43aa-9f96-3f56915f39cd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:26.988708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6589c7f6-41d3-43aa-9f96-3f56915f39cd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:26.992392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6589c7f6-41d3-43aa-9f96-3f56915f39cd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:26.993119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6589c7f6-41d3-43aa-9f96-3f56915f39cd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:27.109446 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6589c7f6-41d3-43aa-9f96-3f56915f39cd tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147729 Oct 11 19:58:27.118084 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1805/3683] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:58:26 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:27.139649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ba808b11-0e35-4be2-b260-93bae322c8d1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:27.143453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ba808b11-0e35-4be2-b260-93bae322c8d1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:27.161922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba808b11-0e35-4be2-b260-93bae322c8d1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:27.162843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba808b11-0e35-4be2-b260-93bae322c8d1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:27.165244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba808b11-0e35-4be2-b260-93bae322c8d1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:27.166261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba808b11-0e35-4be2-b260-93bae322c8d1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:27.171618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba808b11-0e35-4be2-b260-93bae322c8d1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:27.172412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba808b11-0e35-4be2-b260-93bae322c8d1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:27.382896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c2c2610f-fab4-4f3d-a19c-32a73deecf5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:27.393933 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c2c2610f-fab4-4f3d-a19c-32a73deecf5a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1315 microversion: 2.1 time: 0.572820 Oct 11 19:58:27.410113 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1879/3684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:26 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:27.420733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-05a2c0c9-ba6a-4789-9f2c-7376d3535823 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:27.426408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-05a2c0c9-ba6a-4789-9f2c-7376d3535823 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:27.434039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05a2c0c9-ba6a-4789-9f2c-7376d3535823 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:27.434865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05a2c0c9-ba6a-4789-9f2c-7376d3535823 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:27.435482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05a2c0c9-ba6a-4789-9f2c-7376d3535823 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:27.436510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05a2c0c9-ba6a-4789-9f2c-7376d3535823 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:27.437136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05a2c0c9-ba6a-4789-9f2c-7376d3535823 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:27.437726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05a2c0c9-ba6a-4789-9f2c-7376d3535823 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:27.870845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ba808b11-0e35-4be2-b260-93bae322c8d1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:27.880529 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ba808b11-0e35-4be2-b260-93bae322c8d1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1284 microversion: 2.1 time: 0.760787 Oct 11 19:58:27.898964 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1806/3685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:27 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1284 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:27.956675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-05a2c0c9-ba6a-4789-9f2c-7376d3535823 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:28.011330 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-05a2c0c9-ba6a-4789-9f2c-7376d3535823 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1266 microversion: 2.1 time: 0.558499 Oct 11 19:58:28.014248 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1880/3686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:27 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1266 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:28.128027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d085efc-2542-414a-a003-2d2eedcf9745 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:28.130487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6d085efc-2542-414a-a003-2d2eedcf9745 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:28.154139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d085efc-2542-414a-a003-2d2eedcf9745 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:28.154780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d085efc-2542-414a-a003-2d2eedcf9745 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:28.155302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d085efc-2542-414a-a003-2d2eedcf9745 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:28.156098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d085efc-2542-414a-a003-2d2eedcf9745 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:28.156619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d085efc-2542-414a-a003-2d2eedcf9745 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:28.157345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d085efc-2542-414a-a003-2d2eedcf9745 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:28.252031 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6d085efc-2542-414a-a003-2d2eedcf9745 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129254 Oct 11 19:58:28.252908 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1807/3687] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:58:28 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:28.428000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8fc66b05-ec78-493a-a519-41a0d8e4f803 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:28.428981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8fc66b05-ec78-493a-a519-41a0d8e4f803 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:28.439022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fc66b05-ec78-493a-a519-41a0d8e4f803 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:28.439874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fc66b05-ec78-493a-a519-41a0d8e4f803 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:28.441788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fc66b05-ec78-493a-a519-41a0d8e4f803 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:28.442745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fc66b05-ec78-493a-a519-41a0d8e4f803 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:28.443370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fc66b05-ec78-493a-a519-41a0d8e4f803 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:28.443982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fc66b05-ec78-493a-a519-41a0d8e4f803 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:28.905623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-59ba57c4-4817-425a-b7b2-d9ef494356af tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:28.906233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-59ba57c4-4817-425a-b7b2-d9ef494356af tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:28.928946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ba57c4-4817-425a-b7b2-d9ef494356af tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:28.929540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ba57c4-4817-425a-b7b2-d9ef494356af tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:28.930195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ba57c4-4817-425a-b7b2-d9ef494356af tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:28.931124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ba57c4-4817-425a-b7b2-d9ef494356af tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:28.931772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ba57c4-4817-425a-b7b2-d9ef494356af tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:28.932417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ba57c4-4817-425a-b7b2-d9ef494356af tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:29.112599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8fc66b05-ec78-493a-a519-41a0d8e4f803 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:29.124834 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8fc66b05-ec78-493a-a519-41a0d8e4f803 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1315 microversion: 2.1 time: 0.705538 Oct 11 19:58:29.125777 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1881/3688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:28 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:29.137463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c8152ccb-102b-4956-a772-0e1c3a1d560d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:29.138080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c8152ccb-102b-4956-a772-0e1c3a1d560d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:29.155859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8152ccb-102b-4956-a772-0e1c3a1d560d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:29.156360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8152ccb-102b-4956-a772-0e1c3a1d560d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:29.160418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8152ccb-102b-4956-a772-0e1c3a1d560d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:29.163150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8152ccb-102b-4956-a772-0e1c3a1d560d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:29.175640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8152ccb-102b-4956-a772-0e1c3a1d560d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:29.178063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8152ccb-102b-4956-a772-0e1c3a1d560d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:29.252009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-59ba57c4-4817-425a-b7b2-d9ef494356af tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:29.263222 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-59ba57c4-4817-425a-b7b2-d9ef494356af tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1284 microversion: 2.1 time: 0.361476 Oct 11 19:58:29.263810 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1808/3689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:28 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1284 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:29.275023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-683510db-1787-41cc-ab9c-7ae50ee1b122 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:29.291452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-683510db-1787-41cc-ab9c-7ae50ee1b122 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:29.299898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-683510db-1787-41cc-ab9c-7ae50ee1b122 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:29.301470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-683510db-1787-41cc-ab9c-7ae50ee1b122 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:29.303529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-683510db-1787-41cc-ab9c-7ae50ee1b122 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:29.304669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-683510db-1787-41cc-ab9c-7ae50ee1b122 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:29.306582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-683510db-1787-41cc-ab9c-7ae50ee1b122 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:29.307248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-683510db-1787-41cc-ab9c-7ae50ee1b122 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:29.366421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c8152ccb-102b-4956-a772-0e1c3a1d560d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:29.374358 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c8152ccb-102b-4956-a772-0e1c3a1d560d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1266 microversion: 2.1 time: 0.246924 Oct 11 19:58:29.387488 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1882/3690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:29 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:29.391072 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-683510db-1787-41cc-ab9c-7ae50ee1b122 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119770 Oct 11 19:58:29.396889 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1809/3691] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:58:29 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:30.151869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3948dd74-fb4c-421d-8bf7-f0e7495b020c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:30.152634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3948dd74-fb4c-421d-8bf7-f0e7495b020c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:30.161159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3948dd74-fb4c-421d-8bf7-f0e7495b020c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:30.168979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3948dd74-fb4c-421d-8bf7-f0e7495b020c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:30.170366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3948dd74-fb4c-421d-8bf7-f0e7495b020c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:30.171693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3948dd74-fb4c-421d-8bf7-f0e7495b020c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:30.179240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3948dd74-fb4c-421d-8bf7-f0e7495b020c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:30.180463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3948dd74-fb4c-421d-8bf7-f0e7495b020c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:30.289740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3555c9f0-e62c-49b0-8c6e-390cdd9a6a75 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:30.290356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3555c9f0-e62c-49b0-8c6e-390cdd9a6a75 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:30.299349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3555c9f0-e62c-49b0-8c6e-390cdd9a6a75 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:30.299844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3555c9f0-e62c-49b0-8c6e-390cdd9a6a75 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:30.300282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3555c9f0-e62c-49b0-8c6e-390cdd9a6a75 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:30.301941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3555c9f0-e62c-49b0-8c6e-390cdd9a6a75 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:30.302408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3555c9f0-e62c-49b0-8c6e-390cdd9a6a75 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:30.302949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3555c9f0-e62c-49b0-8c6e-390cdd9a6a75 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.162821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3555c9f0-e62c-49b0-8c6e-390cdd9a6a75 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:31.171935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3948dd74-fb4c-421d-8bf7-f0e7495b020c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:31.179848 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3555c9f0-e62c-49b0-8c6e-390cdd9a6a75 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 0.893864 Oct 11 19:58:31.190187 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3948dd74-fb4c-421d-8bf7-f0e7495b020c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1315 microversion: 2.1 time: 1.038401 Oct 11 19:58:31.192219 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1883/3692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:30 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1315 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:31.200017 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1810/3693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:30 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:31.209129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-51cc281a-e4db-4580-a5ba-5c0a25b9b963 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:31.212042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fb4dedf0-6234-473d-8a94-11d42cd2d981 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:31.213991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fb4dedf0-6234-473d-8a94-11d42cd2d981 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:31.214792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-51cc281a-e4db-4580-a5ba-5c0a25b9b963 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:31.227565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51cc281a-e4db-4580-a5ba-5c0a25b9b963 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.228401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51cc281a-e4db-4580-a5ba-5c0a25b9b963 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.230171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51cc281a-e4db-4580-a5ba-5c0a25b9b963 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.231837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51cc281a-e4db-4580-a5ba-5c0a25b9b963 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.233071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51cc281a-e4db-4580-a5ba-5c0a25b9b963 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.234781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51cc281a-e4db-4580-a5ba-5c0a25b9b963 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.240555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4dedf0-6234-473d-8a94-11d42cd2d981 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.241053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4dedf0-6234-473d-8a94-11d42cd2d981 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.241493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4dedf0-6234-473d-8a94-11d42cd2d981 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.242200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4dedf0-6234-473d-8a94-11d42cd2d981 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.242680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4dedf0-6234-473d-8a94-11d42cd2d981 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.243309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4dedf0-6234-473d-8a94-11d42cd2d981 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.278848 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-51cc281a-e4db-4580-a5ba-5c0a25b9b963 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085114 Oct 11 19:58:31.279866 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1884/3694] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 19:58:31 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:58:31.377711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:31.380373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:31.390234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.390935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.391516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.394072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.397795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.398377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.411315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:31.476044 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] HTTP exception thrown: Cannot 'reboot' instance a346658c-09a4-43ec-a0ab-e2541e23e423 while it is in vm_state rescued Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Request method failure captured: Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423/action HTTP/1.1 Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 28 Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnHf-gY9GoFThGWTuyLZOFCjiBlppqFx09S1rxIOZhPN4k_d-_Y9sZYcmKSj4UOYvu9oafZcIYglvMprUUmJuXwAUoSMveDAF_xAfvCOrPvWGeWuOLI47ySPf1501t-RY5r2Fgp6Sqr-jc81_0LijQqzlDf3IXjp_i8MKsYX5dySSY Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8df2eebeffd440d988aa6f580c9bb221", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}] Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d1ab8c29f18c4fc09858791a80527e5d Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: {"reboot": {"type": "HARD"}} Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: exception: Cannot 'reboot' instance a346658c-09a4-43ec-a0ab-e2541e23e423 while it is in vm_state rescued Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a346658c-09a4-43ec-a0ab-e2541e23e423', 'body': {'reboot': {'type': 'HARD'}}} Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a346658c-09a4-43ec-a0ab-e2541e23e423 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:58:31.479601 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance a346658c-09a4-43ec-a0ab-e2541e23e423 while it is in vm_state rescued Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance a346658c-09a4-43ec-a0ab-e2541e23e423 while it is in vm_state rescued Oct 11 19:58:31.484509 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:31.490189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Returning 409 to user: Cannot 'reboot' instance a346658c-09a4-43ec-a0ab-e2541e23e423 while it is in vm_state rescued {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:31.491136 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eda7ba14-93c3-4873-965c-e3c89d423bf2 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423/action" status: 409 len: 145 microversion: 2.1 time: 0.121191 Oct 11 19:58:31.501692 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1885/3695] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:31 2022] POST /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423/action => generated 145 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:58:31.510678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:31.514741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:31.525341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.526198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.526894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.528107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.528767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.530135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.569000 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] HTTP exception thrown: Cannot 'rebuild' instance a346658c-09a4-43ec-a0ab-e2541e23e423 while it is in vm_state rescued Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Request method failure captured: Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423/action HTTP/1.1 Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 65 Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnHf-gY9GoFThGWTuyLZOFCjiBlppqFx09S1rxIOZhPN4k_d-_Y9sZYcmKSj4UOYvu9oafZcIYglvMprUUmJuXwAUoSMveDAF_xAfvCOrPvWGeWuOLI47ySPf1501t-RY5r2Fgp6Sqr-jc81_0LijQqzlDf3IXjp_i8MKsYX5dySSY Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8df2eebeffd440d988aa6f580c9bb221", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}] Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d1ab8c29f18c4fc09858791a80527e5d Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: exception: Cannot 'rebuild' instance a346658c-09a4-43ec-a0ab-e2541e23e423 while it is in vm_state rescued Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a346658c-09a4-43ec-a0ab-e2541e23e423', 'body': {'rebuild': {'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3'}}} Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a346658c-09a4-43ec-a0ab-e2541e23e423 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:58:31.571371 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance a346658c-09a4-43ec-a0ab-e2541e23e423 while it is in vm_state rescued Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance a346658c-09a4-43ec-a0ab-e2541e23e423 while it is in vm_state rescued Oct 11 19:58:31.577590 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:58:31.581478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Returning 409 to user: Cannot 'rebuild' instance a346658c-09a4-43ec-a0ab-e2541e23e423 while it is in vm_state rescued {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:31.582933 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c82a33cc-bc06-4343-a44d-1b89709df361 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "POST /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423/action" status: 409 len: 146 microversion: 2.1 time: 0.079084 Oct 11 19:58:31.588923 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1886/3696] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:31 2022] POST /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423/action => generated 146 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:58:31.596121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cee5fcbf-c34d-4e64-a72e-792c89b27f12 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:31.596862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cee5fcbf-c34d-4e64-a72e-792c89b27f12 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:31.605123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee5fcbf-c34d-4e64-a72e-792c89b27f12 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.605750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee5fcbf-c34d-4e64-a72e-792c89b27f12 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.606455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee5fcbf-c34d-4e64-a72e-792c89b27f12 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.607968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee5fcbf-c34d-4e64-a72e-792c89b27f12 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.608693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee5fcbf-c34d-4e64-a72e-792c89b27f12 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.609361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cee5fcbf-c34d-4e64-a72e-792c89b27f12 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.652468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cee5fcbf-c34d-4e64-a72e-792c89b27f12 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:58:31.780881 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cee5fcbf-c34d-4e64-a72e-792c89b27f12 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 204 len: 0 microversion: 2.1 time: 0.190169 Oct 11 19:58:31.782167 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1887/3697] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:58:31 2022] DELETE /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:58:31.793565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-83981675-998c-4713-b8ac-67beb6917dba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:31.794420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-83981675-998c-4713-b8ac-67beb6917dba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:31.801301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83981675-998c-4713-b8ac-67beb6917dba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.802053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83981675-998c-4713-b8ac-67beb6917dba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.802726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83981675-998c-4713-b8ac-67beb6917dba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:31.803708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83981675-998c-4713-b8ac-67beb6917dba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:31.804344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83981675-998c-4713-b8ac-67beb6917dba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:31.804959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83981675-998c-4713-b8ac-67beb6917dba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:32.227271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:32.319231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fb4dedf0-6234-473d-8a94-11d42cd2d981 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:32.327707 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fb4dedf0-6234-473d-8a94-11d42cd2d981 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1308 microversion: 2.1 time: 1.126307 Oct 11 19:58:32.328629 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1811/3698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:31 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1308 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:32.335020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ee9b943c-d5ca-440e-b292-5cc6c186ee11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:32.335841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ee9b943c-d5ca-440e-b292-5cc6c186ee11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:32.342797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9b943c-d5ca-440e-b292-5cc6c186ee11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:32.343635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9b943c-d5ca-440e-b292-5cc6c186ee11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:32.344349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9b943c-d5ca-440e-b292-5cc6c186ee11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:32.345751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9b943c-d5ca-440e-b292-5cc6c186ee11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:32.346800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9b943c-d5ca-440e-b292-5cc6c186ee11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:32.347445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9b943c-d5ca-440e-b292-5cc6c186ee11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:32.348688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:32.417281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:32.806840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-83981675-998c-4713-b8ac-67beb6917dba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:32.822022 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-83981675-998c-4713-b8ac-67beb6917dba tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1689 microversion: 2.1 time: 1.034517 Oct 11 19:58:32.822759 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1888/3699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:31 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1689 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:32.843706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e4926f9-8d96-4938-aca4-0c3176235697 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:32.844660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e4926f9-8d96-4938-aca4-0c3176235697 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:32.852446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4926f9-8d96-4938-aca4-0c3176235697 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:32.853269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4926f9-8d96-4938-aca4-0c3176235697 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:32.853931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4926f9-8d96-4938-aca4-0c3176235697 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:32.854895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4926f9-8d96-4938-aca4-0c3176235697 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:32.855566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4926f9-8d96-4938-aca4-0c3176235697 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:32.856237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4926f9-8d96-4938-aca4-0c3176235697 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:33.022451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ee9b943c-d5ca-440e-b292-5cc6c186ee11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:33.035721 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ee9b943c-d5ca-440e-b292-5cc6c186ee11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 0.705013 Oct 11 19:58:33.037007 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1812/3700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:32 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:33.332536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e4926f9-8d96-4938-aca4-0c3176235697 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:33.343113 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e4926f9-8d96-4938-aca4-0c3176235697 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1315 microversion: 2.1 time: 0.507025 Oct 11 19:58:33.344123 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1889/3701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:32 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:33.366077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-930c7373-f6ba-4c9d-ad10-0bcf206dff49 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:33.366733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-930c7373-f6ba-4c9d-ad10-0bcf206dff49 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:33.382943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-930c7373-f6ba-4c9d-ad10-0bcf206dff49 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:33.383445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-930c7373-f6ba-4c9d-ad10-0bcf206dff49 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:33.383889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-930c7373-f6ba-4c9d-ad10-0bcf206dff49 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:33.384631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-930c7373-f6ba-4c9d-ad10-0bcf206dff49 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:33.385092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-930c7373-f6ba-4c9d-ad10-0bcf206dff49 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:33.385521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-930c7373-f6ba-4c9d-ad10-0bcf206dff49 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:33.613833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-5f75e58e-9b5f-4ff3-a419-f3c35a0ffdfe req-16823c98-d344-4321-83fe-558f43a70449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3244b84-dd0d-485c-97c1-36a525a95e19", "tag": "7491365b-e5b5-4dd6-988e-21683fa0a559"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:33.663016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=12 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:33.670936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5f75e58e-9b5f-4ff3-a419-f3c35a0ffdfe req-16823c98-d344-4321-83fe-558f43a70449 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:33.674756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5f75e58e-9b5f-4ff3-a419-f3c35a0ffdfe req-16823c98-d344-4321-83fe-558f43a70449 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:33.675688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5f75e58e-9b5f-4ff3-a419-f3c35a0ffdfe req-16823c98-d344-4321-83fe-558f43a70449 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:33.695811 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-5f75e58e-9b5f-4ff3-a419-f3c35a0ffdfe req-16823c98-d344-4321-83fe-558f43a70449 service nova] Creating event network-changed:7491365b-e5b5-4dd6-988e-21683fa0a559 for instance c3244b84-dd0d-485c-97c1-36a525a95e19 on n-h2-860864-3 Oct 11 19:58:33.703139 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-5f75e58e-9b5f-4ff3-a419-f3c35a0ffdfe req-16823c98-d344-4321-83fe-558f43a70449 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099322 Oct 11 19:58:33.704069 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1890/3702] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:58:33.742957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-930c7373-f6ba-4c9d-ad10-0bcf206dff49 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:33.752982 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-930c7373-f6ba-4c9d-ad10-0bcf206dff49 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1308 microversion: 2.1 time: 0.395353 Oct 11 19:58:33.753703 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1813/3703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:33 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:33.849869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-377343d4-f1e2-4f7e-9f4a-65742db89401 req-3d38c4da-0071-4785-bed8-ad9b78c6cff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c86a44e-bc4e-4fe8-b3cb-fce035d48458", "name": "network-vif-plugged", "status": "completed", "tag": "3453a8cd-4bc4-49f3-80f0-9d3ba710c8e8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:33.851002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc2acc2d-ce43-420b-a048-b979f9f9e036 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:33.852038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc2acc2d-ce43-420b-a048-b979f9f9e036 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:33.874597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc2acc2d-ce43-420b-a048-b979f9f9e036 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:33.876211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc2acc2d-ce43-420b-a048-b979f9f9e036 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:33.879505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc2acc2d-ce43-420b-a048-b979f9f9e036 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:33.880386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc2acc2d-ce43-420b-a048-b979f9f9e036 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:33.885255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-377343d4-f1e2-4f7e-9f4a-65742db89401 req-3d38c4da-0071-4785-bed8-ad9b78c6cff6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:33.885670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc2acc2d-ce43-420b-a048-b979f9f9e036 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:33.886152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc2acc2d-ce43-420b-a048-b979f9f9e036 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:33.886499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-377343d4-f1e2-4f7e-9f4a-65742db89401 req-3d38c4da-0071-4785-bed8-ad9b78c6cff6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:33.887166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-377343d4-f1e2-4f7e-9f4a-65742db89401 req-3d38c4da-0071-4785-bed8-ad9b78c6cff6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:33.906427 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-377343d4-f1e2-4f7e-9f4a-65742db89401 req-3d38c4da-0071-4785-bed8-ad9b78c6cff6 service nova] Creating event network-vif-plugged:3453a8cd-4bc4-49f3-80f0-9d3ba710c8e8 for instance 2c86a44e-bc4e-4fe8-b3cb-fce035d48458 on n-h1-860864-3 Oct 11 19:58:33.913195 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-377343d4-f1e2-4f7e-9f4a-65742db89401 req-3d38c4da-0071-4785-bed8-ad9b78c6cff6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185569 Oct 11 19:58:33.914300 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1891/3704] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:58:34.062246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e24bec1-6a7c-49c8-8e2e-191ed9047bed tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:34.063212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e24bec1-6a7c-49c8-8e2e-191ed9047bed tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:34.081762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e24bec1-6a7c-49c8-8e2e-191ed9047bed tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:34.082261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e24bec1-6a7c-49c8-8e2e-191ed9047bed tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:34.082734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e24bec1-6a7c-49c8-8e2e-191ed9047bed tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:34.083442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e24bec1-6a7c-49c8-8e2e-191ed9047bed tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:34.083899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e24bec1-6a7c-49c8-8e2e-191ed9047bed tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:34.084324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e24bec1-6a7c-49c8-8e2e-191ed9047bed tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:34.368983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e24bec1-6a7c-49c8-8e2e-191ed9047bed tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:34.381925 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e24bec1-6a7c-49c8-8e2e-191ed9047bed tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 0.324891 Oct 11 19:58:34.385147 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1892/3705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:34 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:34.391626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5207cc43-93ef-4c51-8ccd-61101b19443f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:34.393234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5207cc43-93ef-4c51-8ccd-61101b19443f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:34.401571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5207cc43-93ef-4c51-8ccd-61101b19443f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:34.402334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5207cc43-93ef-4c51-8ccd-61101b19443f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:34.402985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5207cc43-93ef-4c51-8ccd-61101b19443f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:34.403933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5207cc43-93ef-4c51-8ccd-61101b19443f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:34.404691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5207cc43-93ef-4c51-8ccd-61101b19443f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:34.405856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5207cc43-93ef-4c51-8ccd-61101b19443f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:34.708997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc2acc2d-ce43-420b-a048-b979f9f9e036 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:34.717426 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc2acc2d-ce43-420b-a048-b979f9f9e036 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1689 microversion: 2.1 time: 0.871637 Oct 11 19:58:34.718271 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1814/3706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:33 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1689 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:34.782700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fbde0ab6-aee4-43bd-bf5e-5707418dc523 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:34.783735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fbde0ab6-aee4-43bd-bf5e-5707418dc523 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:34.796350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbde0ab6-aee4-43bd-bf5e-5707418dc523 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:34.797297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbde0ab6-aee4-43bd-bf5e-5707418dc523 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:34.798002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbde0ab6-aee4-43bd-bf5e-5707418dc523 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:34.799609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbde0ab6-aee4-43bd-bf5e-5707418dc523 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:34.800333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbde0ab6-aee4-43bd-bf5e-5707418dc523 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:34.801128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbde0ab6-aee4-43bd-bf5e-5707418dc523 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:34.809298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5207cc43-93ef-4c51-8ccd-61101b19443f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:34.823265 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5207cc43-93ef-4c51-8ccd-61101b19443f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1315 microversion: 2.1 time: 0.436691 Oct 11 19:58:34.824157 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1893/3707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:34 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:35.369102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fbde0ab6-aee4-43bd-bf5e-5707418dc523 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:35.380671 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fbde0ab6-aee4-43bd-bf5e-5707418dc523 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1308 microversion: 2.1 time: 0.604594 Oct 11 19:58:35.382412 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1815/3708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:34 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:35.412871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bdb7e967-22a3-429c-ad39-c737374b6ef2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:35.413488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bdb7e967-22a3-429c-ad39-c737374b6ef2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:35.421745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdb7e967-22a3-429c-ad39-c737374b6ef2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:35.422831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdb7e967-22a3-429c-ad39-c737374b6ef2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:35.424009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdb7e967-22a3-429c-ad39-c737374b6ef2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:35.434998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdb7e967-22a3-429c-ad39-c737374b6ef2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:35.435542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdb7e967-22a3-429c-ad39-c737374b6ef2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:35.438844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bdb7e967-22a3-429c-ad39-c737374b6ef2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:35.732477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-473113ae-4987-4c63-a8cd-857ae382801a req-b93966d4-6880-4b4a-ae1f-769874b1f3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392dfdc2-0385-4e3b-8afb-b26d4d9d7192", "tag": "64639c79-3542-45ee-b629-e0e30cd6fb75"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:35.752498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-473113ae-4987-4c63-a8cd-857ae382801a req-b93966d4-6880-4b4a-ae1f-769874b1f3b5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:35.753007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-473113ae-4987-4c63-a8cd-857ae382801a req-b93966d4-6880-4b4a-ae1f-769874b1f3b5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:35.753446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-473113ae-4987-4c63-a8cd-857ae382801a req-b93966d4-6880-4b4a-ae1f-769874b1f3b5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:35.775563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-473113ae-4987-4c63-a8cd-857ae382801a req-b93966d4-6880-4b4a-ae1f-769874b1f3b5 service nova] Creating event network-changed:64639c79-3542-45ee-b629-e0e30cd6fb75 for instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 on n-h2-860864-3 Oct 11 19:58:35.785760 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-473113ae-4987-4c63-a8cd-857ae382801a req-b93966d4-6880-4b4a-ae1f-769874b1f3b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057193 Oct 11 19:58:35.786379 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1816/3709] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:58:35.791834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-869634e4-bd93-45b8-a544-d17f25cc6460 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:35.792739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-869634e4-bd93-45b8-a544-d17f25cc6460 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:35.799679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-869634e4-bd93-45b8-a544-d17f25cc6460 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:35.800458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-869634e4-bd93-45b8-a544-d17f25cc6460 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:35.801083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-869634e4-bd93-45b8-a544-d17f25cc6460 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:35.802133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-869634e4-bd93-45b8-a544-d17f25cc6460 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:35.802787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-869634e4-bd93-45b8-a544-d17f25cc6460 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:35.803567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-869634e4-bd93-45b8-a544-d17f25cc6460 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:36.532976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bdb7e967-22a3-429c-ad39-c737374b6ef2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:36.577219 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bdb7e967-22a3-429c-ad39-c737374b6ef2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 1.168978 Oct 11 19:58:36.579808 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1894/3710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:35 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:36.605109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-15d53f9c-6ef2-474c-95d0-03ed38ad208f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:36.608326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-15d53f9c-6ef2-474c-95d0-03ed38ad208f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:36.627325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15d53f9c-6ef2-474c-95d0-03ed38ad208f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:36.630116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15d53f9c-6ef2-474c-95d0-03ed38ad208f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:36.630764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15d53f9c-6ef2-474c-95d0-03ed38ad208f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:36.631510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15d53f9c-6ef2-474c-95d0-03ed38ad208f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:36.633934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15d53f9c-6ef2-474c-95d0-03ed38ad208f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:36.635733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15d53f9c-6ef2-474c-95d0-03ed38ad208f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:36.858861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-869634e4-bd93-45b8-a544-d17f25cc6460 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:36.871392 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-869634e4-bd93-45b8-a544-d17f25cc6460 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1689 microversion: 2.1 time: 1.083559 Oct 11 19:58:36.886651 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1817/3711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:35 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1689 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:36.886651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d294df2-7f34-4552-972f-a942a0d6ea98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:36.886651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6d294df2-7f34-4552-972f-a942a0d6ea98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:36.894346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d294df2-7f34-4552-972f-a942a0d6ea98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:36.894924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d294df2-7f34-4552-972f-a942a0d6ea98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:36.895356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d294df2-7f34-4552-972f-a942a0d6ea98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:36.896065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d294df2-7f34-4552-972f-a942a0d6ea98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:36.896522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d294df2-7f34-4552-972f-a942a0d6ea98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:36.896944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d294df2-7f34-4552-972f-a942a0d6ea98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:37.538365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-15d53f9c-6ef2-474c-95d0-03ed38ad208f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:37.552229 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-15d53f9c-6ef2-474c-95d0-03ed38ad208f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1502 microversion: 2.1 time: 0.971240 Oct 11 19:58:37.553455 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1895/3712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:36 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1502 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:37.579199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7869073a-09a8-46f7-9295-81ea969f33e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:37.582147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7869073a-09a8-46f7-9295-81ea969f33e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:37.597440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7869073a-09a8-46f7-9295-81ea969f33e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:37.598006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7869073a-09a8-46f7-9295-81ea969f33e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:37.600100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7869073a-09a8-46f7-9295-81ea969f33e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:37.600712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7869073a-09a8-46f7-9295-81ea969f33e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:37.602198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7869073a-09a8-46f7-9295-81ea969f33e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:37.603857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7869073a-09a8-46f7-9295-81ea969f33e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:37.645765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6d294df2-7f34-4552-972f-a942a0d6ea98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:37.653906 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6d294df2-7f34-4552-972f-a942a0d6ea98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1308 microversion: 2.1 time: 0.780500 Oct 11 19:58:37.655678 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1818/3713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:36 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1308 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:37.664913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5126bc34-91c9-49bf-a8f1-5ce923b67df4 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:37.665603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5126bc34-91c9-49bf-a8f1-5ce923b67df4 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:37.686669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5126bc34-91c9-49bf-a8f1-5ce923b67df4 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:37.687644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5126bc34-91c9-49bf-a8f1-5ce923b67df4 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:37.688567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5126bc34-91c9-49bf-a8f1-5ce923b67df4 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:37.689836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5126bc34-91c9-49bf-a8f1-5ce923b67df4 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:37.690668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5126bc34-91c9-49bf-a8f1-5ce923b67df4 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:37.691163 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7869073a-09a8-46f7-9295-81ea969f33e9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action" status: 200 len: 14 microversion: 2.1 time: 0.117264 Oct 11 19:58:37.691464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5126bc34-91c9-49bf-a8f1-5ce923b67df4 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:37.692717 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1896/3714] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:37 2022] POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:58:37.722809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:37.903232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ea9b130a-dbe6-424d-82c8-d0f3c4e4117b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:37.904175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ea9b130a-dbe6-424d-82c8-d0f3c4e4117b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:37.935624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea9b130a-dbe6-424d-82c8-d0f3c4e4117b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:37.935838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea9b130a-dbe6-424d-82c8-d0f3c4e4117b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:37.936404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea9b130a-dbe6-424d-82c8-d0f3c4e4117b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:37.937365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea9b130a-dbe6-424d-82c8-d0f3c4e4117b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:37.937989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea9b130a-dbe6-424d-82c8-d0f3c4e4117b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:37.939133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea9b130a-dbe6-424d-82c8-d0f3c4e4117b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:38.024810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5126bc34-91c9-49bf-a8f1-5ce923b67df4 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:38.040259 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5126bc34-91c9-49bf-a8f1-5ce923b67df4 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 0.383292 Oct 11 19:58:38.040862 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1819/3715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:37 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:38.118046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ea9b130a-dbe6-424d-82c8-d0f3c4e4117b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:38.130596 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ea9b130a-dbe6-424d-82c8-d0f3c4e4117b tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1621 microversion: 2.1 time: 0.238306 Oct 11 19:58:38.131988 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1897/3716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:37 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1621 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:38.682180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-369ee3ef-03cb-4c7b-ace3-739e83f07dce tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:38.682826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-369ee3ef-03cb-4c7b-ace3-739e83f07dce tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:38.703643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1f64356-2e52-4567-95a0-362b1b5c1e79 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:38.706854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e1f64356-2e52-4567-95a0-362b1b5c1e79 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:38.712688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-369ee3ef-03cb-4c7b-ace3-739e83f07dce tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:38.713222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-369ee3ef-03cb-4c7b-ace3-739e83f07dce tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:38.713660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-369ee3ef-03cb-4c7b-ace3-739e83f07dce tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:38.714352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-369ee3ef-03cb-4c7b-ace3-739e83f07dce tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:38.717858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-369ee3ef-03cb-4c7b-ace3-739e83f07dce tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:38.718631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-369ee3ef-03cb-4c7b-ace3-739e83f07dce tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:38.724783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f64356-2e52-4567-95a0-362b1b5c1e79 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:38.725285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f64356-2e52-4567-95a0-362b1b5c1e79 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:38.725716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f64356-2e52-4567-95a0-362b1b5c1e79 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:38.726824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f64356-2e52-4567-95a0-362b1b5c1e79 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:38.728810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f64356-2e52-4567-95a0-362b1b5c1e79 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:38.729500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1f64356-2e52-4567-95a0-362b1b5c1e79 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:38.803600 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e1f64356-2e52-4567-95a0-362b1b5c1e79 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action" status: 200 len: 14 microversion: 2.1 time: 0.103647 Oct 11 19:58:38.808841 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1898/3717] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:38 2022] POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:58:38.889068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4b045-264a-41c3-b8e8-5a038c485877", "name": "network-vif-deleted", "tag": "8c56ce9b-8903-45a8-b9a9-f1cca5c18f44"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:38.910776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:38.911269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:38.911701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:38.938034 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] Creating event network-vif-deleted:8c56ce9b-8903-45a8-b9a9-f1cca5c18f44 for instance e1c4b045-264a-41c3-b8e8-5a038c485877 on n-h2-860864-3 Oct 11 19:58:38.955007 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069453 Oct 11 19:58:38.957126 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1899/3718] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:58:39.011897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:39.013056 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001763 Oct 11 19:58:39.013405 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1900/3719] 10.222.0.27 () {56 vars in 886 bytes} [Tue Oct 11 19:58:39 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 11 19:58:39.024875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:39.026347 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002330 Oct 11 19:58:39.026970 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1901/3720] 10.222.0.27 () {54 vars in 1035 bytes} [Tue Oct 11 19:58:39 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Oct 11 19:58:39.034644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:39.036115 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001944 Oct 11 19:58:39.037016 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1902/3721] 10.222.0.27 () {54 vars in 1041 bytes} [Tue Oct 11 19:58:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:39.046307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:39.047601 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a131cf66-a899-4786-9d08-1b466933a1a6 req-01ef0aff-6699-4856-8262-f21cef21153c service nova] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001822 Oct 11 19:58:39.050495 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1903/3722] 10.222.0.27 () {56 vars in 886 bytes} [Tue Oct 11 19:58:39 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 19:58:39.073168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2468e4be-ebeb-48ee-8b95-bb292038ced6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:39.074326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2468e4be-ebeb-48ee-8b95-bb292038ced6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:39.086544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:39.090816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2468e4be-ebeb-48ee-8b95-bb292038ced6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:39.091374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2468e4be-ebeb-48ee-8b95-bb292038ced6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:39.092763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2468e4be-ebeb-48ee-8b95-bb292038ced6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:39.094279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2468e4be-ebeb-48ee-8b95-bb292038ced6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:39.096232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2468e4be-ebeb-48ee-8b95-bb292038ced6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:39.098029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2468e4be-ebeb-48ee-8b95-bb292038ced6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:39.426602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-369ee3ef-03cb-4c7b-ace3-739e83f07dce tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:39.440332 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-369ee3ef-03cb-4c7b-ace3-739e83f07dce tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1308 microversion: 2.1 time: 0.761681 Oct 11 19:58:39.456090 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1820/3723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:38 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1308 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:39.461066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:39.461678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:39.474098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:39.474632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:39.475207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:39.476109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:39.477584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:39.478481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:39.522797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:39.523465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:39.524261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:39.524909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lazy-loading 'fault' on Instance uuid e1c4b045-264a-41c3-b8e8-5a038c485877 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:58:39.600895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:39.634813 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-052ae4b5-3e42-4e98-b7a0-e6f187721e6a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 200 len: 1335 microversion: 2.1 time: 0.173284 Oct 11 19:58:39.635531 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1821/3724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:39 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 1335 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:39.684613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2468e4be-ebeb-48ee-8b95-bb292038ced6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:39.694388 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2468e4be-ebeb-48ee-8b95-bb292038ced6 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 0.630681 Oct 11 19:58:39.717261 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1904/3725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:39 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:39.816701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ccac2a48-5f54-4278-b1fa-160895b35191 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:39.819550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ccac2a48-5f54-4278-b1fa-160895b35191 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:39.827243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccac2a48-5f54-4278-b1fa-160895b35191 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:39.827976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccac2a48-5f54-4278-b1fa-160895b35191 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:39.828609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccac2a48-5f54-4278-b1fa-160895b35191 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:39.830037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccac2a48-5f54-4278-b1fa-160895b35191 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:39.830746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccac2a48-5f54-4278-b1fa-160895b35191 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:39.831343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ccac2a48-5f54-4278-b1fa-160895b35191 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:39.886515 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ccac2a48-5f54-4278-b1fa-160895b35191 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action" status: 200 len: 14 microversion: 2.1 time: 0.073336 Oct 11 19:58:39.888015 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1822/3726] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:39 2022] POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:58:40.471911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2d2d9418-23ee-4547-985b-0a26bf4d96c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:40.472652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2d2d9418-23ee-4547-985b-0a26bf4d96c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:40.490231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d2d9418-23ee-4547-985b-0a26bf4d96c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:40.490929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d2d9418-23ee-4547-985b-0a26bf4d96c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:40.491478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d2d9418-23ee-4547-985b-0a26bf4d96c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:40.492311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d2d9418-23ee-4547-985b-0a26bf4d96c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:40.492883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d2d9418-23ee-4547-985b-0a26bf4d96c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:40.493562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d2d9418-23ee-4547-985b-0a26bf4d96c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:40.663255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:40.664674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: e1c4b045-264a-41c3-b8e8-5a038c485877] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:40.678900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:40.681263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:40.682292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:40.684766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:40.685785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:40.687069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:40.693277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:40.744911 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] HTTP exception thrown: Instance e1c4b045-264a-41c3-b8e8-5a038c485877 could not be found. Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Request method failure captured: Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 HTTP/1.1 Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnHf-gY9GoFThGWTuyLZOFCjiBlppqFx09S1rxIOZhPN4k_d-_Y9sZYcmKSj4UOYvu9oafZcIYglvMprUUmJuXwAUoSMveDAF_xAfvCOrPvWGeWuOLI47ySPf1501t-RY5r2Fgp6Sqr-jc81_0LijQqzlDf3IXjp_i8MKsYX5dySSY Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8df2eebeffd440d988aa6f580c9bb221", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}] Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d1ab8c29f18c4fc09858791a80527e5d Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance e1c4b045-264a-41c3-b8e8-5a038c485877 could not be found. Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'e1c4b045-264a-41c3-b8e8-5a038c485877'} Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c4b045-264a-41c3-b8e8-5a038c485877 could not be found. Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c4b045-264a-41c3-b8e8-5a038c485877 could not be found. Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:40.747095 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:40.751955 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:40.751955 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:40.751955 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:40.751955 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:40.751955 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:40.751955 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:40.751955 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c4b045-264a-41c3-b8e8-5a038c485877 could not be found. Oct 11 19:58:40.751955 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:40.756166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Returning 404 to user: Instance e1c4b045-264a-41c3-b8e8-5a038c485877 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:40.757347 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b444c69-e9aa-4d4c-9841-0c3dffabdab9 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877" status: 404 len: 111 microversion: 2.1 time: 0.099697 Oct 11 19:58:40.758176 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1823/3727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:40 2022] GET /compute/v2.1/servers/e1c4b045-264a-41c3-b8e8-5a038c485877 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:58:40.763173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-36746432-941a-4816-97ad-aaeb04f11fb3 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:40.764125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-36746432-941a-4816-97ad-aaeb04f11fb3 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:40.787804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36746432-941a-4816-97ad-aaeb04f11fb3 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:40.788760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36746432-941a-4816-97ad-aaeb04f11fb3 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:40.789687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36746432-941a-4816-97ad-aaeb04f11fb3 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:40.791546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36746432-941a-4816-97ad-aaeb04f11fb3 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:40.792236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36746432-941a-4816-97ad-aaeb04f11fb3 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:40.793260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36746432-941a-4816-97ad-aaeb04f11fb3 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:41.138033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2d2d9418-23ee-4547-985b-0a26bf4d96c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:41.151344 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2d2d9418-23ee-4547-985b-0a26bf4d96c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1308 microversion: 2.1 time: 0.683971 Oct 11 19:58:41.158273 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1905/3728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:40 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1308 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:41.172841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cd4db505-818b-4755-887f-79822053bc42 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '.version_select at 0x7f83ccb88f70>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:41.211911 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cd4db505-818b-4755-887f-79822053bc42 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407913434" status: 202 len: 0 microversion: 2.1 time: 0.052087 Oct 11 19:58:41.214842 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1906/3729] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 19:58:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407913434 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:58:41.226187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87812a98-a064-4968-9c5e-4abc9d4567bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:41.228753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-87812a98-a064-4968-9c5e-4abc9d4567bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:41.246028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87812a98-a064-4968-9c5e-4abc9d4567bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:41.247702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87812a98-a064-4968-9c5e-4abc9d4567bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:41.248345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87812a98-a064-4968-9c5e-4abc9d4567bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:41.250277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87812a98-a064-4968-9c5e-4abc9d4567bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:41.251390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87812a98-a064-4968-9c5e-4abc9d4567bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:41.252211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87812a98-a064-4968-9c5e-4abc9d4567bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:41.325791 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87812a98-a064-4968-9c5e-4abc9d4567bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action" status: 200 len: 14 microversion: 2.1 time: 0.109474 Oct 11 19:58:41.326745 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1907/3730] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:41 2022] POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:58:41.418308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-36746432-941a-4816-97ad-aaeb04f11fb3 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:41.456355 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-36746432-941a-4816-97ad-aaeb04f11fb3 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 0.696500 Oct 11 19:58:41.458516 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1824/3731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:40 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:42.176884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-279dac34-5dfe-4133-9a94-eaba687847b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:42.178207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-279dac34-5dfe-4133-9a94-eaba687847b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:42.203201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-279dac34-5dfe-4133-9a94-eaba687847b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:42.203699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-279dac34-5dfe-4133-9a94-eaba687847b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:42.204225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-279dac34-5dfe-4133-9a94-eaba687847b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:42.204917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-279dac34-5dfe-4133-9a94-eaba687847b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:42.211744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-279dac34-5dfe-4133-9a94-eaba687847b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:42.214237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-279dac34-5dfe-4133-9a94-eaba687847b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:42.339463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-73a64514-07f7-4bad-910b-aab4df47fdda tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:42.342516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-73a64514-07f7-4bad-910b-aab4df47fdda tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:42.355355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73a64514-07f7-4bad-910b-aab4df47fdda tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:42.355779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73a64514-07f7-4bad-910b-aab4df47fdda tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:42.356229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73a64514-07f7-4bad-910b-aab4df47fdda tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:42.356943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73a64514-07f7-4bad-910b-aab4df47fdda tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:42.357406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73a64514-07f7-4bad-910b-aab4df47fdda tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:42.357833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73a64514-07f7-4bad-910b-aab4df47fdda tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:42.461240 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-73a64514-07f7-4bad-910b-aab4df47fdda tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action" status: 200 len: 14 microversion: 2.1 time: 0.125864 Oct 11 19:58:42.462228 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1825/3732] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:42 2022] POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:58:42.482496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6ed56b7e-9a82-41dd-8781-dd9fc892597d tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:42.483265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6ed56b7e-9a82-41dd-8781-dd9fc892597d tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:42.505265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ed56b7e-9a82-41dd-8781-dd9fc892597d tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:42.505832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ed56b7e-9a82-41dd-8781-dd9fc892597d tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:42.506293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ed56b7e-9a82-41dd-8781-dd9fc892597d tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:42.507068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ed56b7e-9a82-41dd-8781-dd9fc892597d tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:42.512353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ed56b7e-9a82-41dd-8781-dd9fc892597d tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:42.512813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ed56b7e-9a82-41dd-8781-dd9fc892597d tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:42.885934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-279dac34-5dfe-4133-9a94-eaba687847b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:42.889820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:42.895735 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-279dac34-5dfe-4133-9a94-eaba687847b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1308 microversion: 2.1 time: 0.723835 Oct 11 19:58:42.907795 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1908/3733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:42 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1308 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:42.984055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6ed56b7e-9a82-41dd-8781-dd9fc892597d tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:43.009439 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6ed56b7e-9a82-41dd-8781-dd9fc892597d tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 0.532487 Oct 11 19:58:43.010573 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1826/3734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:42 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:43.473009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66a71f54-a3bd-4a1e-bea2-61c354a43e97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:43.476037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-66a71f54-a3bd-4a1e-bea2-61c354a43e97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:43.507194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a71f54-a3bd-4a1e-bea2-61c354a43e97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:43.509299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a71f54-a3bd-4a1e-bea2-61c354a43e97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:43.511218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a71f54-a3bd-4a1e-bea2-61c354a43e97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:43.514126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a71f54-a3bd-4a1e-bea2-61c354a43e97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:43.517426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a71f54-a3bd-4a1e-bea2-61c354a43e97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:43.519114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66a71f54-a3bd-4a1e-bea2-61c354a43e97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:43.571771 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-66a71f54-a3bd-4a1e-bea2-61c354a43e97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action" status: 200 len: 14 microversion: 2.1 time: 0.103214 Oct 11 19:58:43.573628 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1909/3735] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:43 2022] POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:58:43.929836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0276bdc8-1e10-4e53-bf69-348d6543c852 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:43.931217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0276bdc8-1e10-4e53-bf69-348d6543c852 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:43.941335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0276bdc8-1e10-4e53-bf69-348d6543c852 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:43.942255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0276bdc8-1e10-4e53-bf69-348d6543c852 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:43.942990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0276bdc8-1e10-4e53-bf69-348d6543c852 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:43.943970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0276bdc8-1e10-4e53-bf69-348d6543c852 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:43.944823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0276bdc8-1e10-4e53-bf69-348d6543c852 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:43.946092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0276bdc8-1e10-4e53-bf69-348d6543c852 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:44.034617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d41cb829-3b74-42e2-8035-15c96ce107c1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:44.035610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d41cb829-3b74-42e2-8035-15c96ce107c1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:44.042851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d41cb829-3b74-42e2-8035-15c96ce107c1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:44.043644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d41cb829-3b74-42e2-8035-15c96ce107c1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:44.044259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d41cb829-3b74-42e2-8035-15c96ce107c1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:44.045239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d41cb829-3b74-42e2-8035-15c96ce107c1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:44.045874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d41cb829-3b74-42e2-8035-15c96ce107c1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:44.046472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d41cb829-3b74-42e2-8035-15c96ce107c1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:44.498473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0276bdc8-1e10-4e53-bf69-348d6543c852 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:44.508718 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0276bdc8-1e10-4e53-bf69-348d6543c852 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1308 microversion: 2.1 time: 0.582020 Oct 11 19:58:44.511484 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1827/3736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:43 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1308 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:44.553592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d41cb829-3b74-42e2-8035-15c96ce107c1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:44.569986 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d41cb829-3b74-42e2-8035-15c96ce107c1 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 0.539631 Oct 11 19:58:44.572597 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1910/3737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:44 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:44.586511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db0d19cd-79bf-465f-bce0-e35cb50349bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:44.588648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-db0d19cd-79bf-465f-bce0-e35cb50349bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:44.614908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db0d19cd-79bf-465f-bce0-e35cb50349bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:44.615436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db0d19cd-79bf-465f-bce0-e35cb50349bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:44.618447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db0d19cd-79bf-465f-bce0-e35cb50349bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:44.620631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db0d19cd-79bf-465f-bce0-e35cb50349bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:44.621573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db0d19cd-79bf-465f-bce0-e35cb50349bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:44.622273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db0d19cd-79bf-465f-bce0-e35cb50349bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:44.697113 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-db0d19cd-79bf-465f-bce0-e35cb50349bd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action" status: 200 len: 14 microversion: 2.1 time: 0.115844 Oct 11 19:58:44.702384 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1828/3738] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:44 2022] POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:58:44.764193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-0e1e68d3-9d6c-49a3-bcc6-ff90f0c6a680 req-7458450a-b3dd-4f5f-9e48-1bfad17bd19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392dfdc2-0385-4e3b-8afb-b26d4d9d7192", "name": "network-vif-plugged", "status": "completed", "tag": "64639c79-3542-45ee-b629-e0e30cd6fb75"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:44.791079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0e1e68d3-9d6c-49a3-bcc6-ff90f0c6a680 req-7458450a-b3dd-4f5f-9e48-1bfad17bd19d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:44.791782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0e1e68d3-9d6c-49a3-bcc6-ff90f0c6a680 req-7458450a-b3dd-4f5f-9e48-1bfad17bd19d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:44.792463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0e1e68d3-9d6c-49a3-bcc6-ff90f0c6a680 req-7458450a-b3dd-4f5f-9e48-1bfad17bd19d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:44.821583 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-0e1e68d3-9d6c-49a3-bcc6-ff90f0c6a680 req-7458450a-b3dd-4f5f-9e48-1bfad17bd19d service nova] Creating event network-vif-plugged:64639c79-3542-45ee-b629-e0e30cd6fb75 for instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 on n-h2-860864-3 Oct 11 19:58:44.833485 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-0e1e68d3-9d6c-49a3-bcc6-ff90f0c6a680 req-7458450a-b3dd-4f5f-9e48-1bfad17bd19d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076761 Oct 11 19:58:44.834118 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1911/3739] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:45.535772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-73c2d47e-4768-42c9-95fe-ecca5ccfe944 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:45.536483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-73c2d47e-4768-42c9-95fe-ecca5ccfe944 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:45.545885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c2d47e-4768-42c9-95fe-ecca5ccfe944 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:45.546358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c2d47e-4768-42c9-95fe-ecca5ccfe944 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:45.555981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c2d47e-4768-42c9-95fe-ecca5ccfe944 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:45.557054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c2d47e-4768-42c9-95fe-ecca5ccfe944 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:45.559672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c2d47e-4768-42c9-95fe-ecca5ccfe944 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:45.560827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c2d47e-4768-42c9-95fe-ecca5ccfe944 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:45.600469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5b1597cb-77af-43b0-9800-fdc590aefa0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:45.601192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5b1597cb-77af-43b0-9800-fdc590aefa0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:45.613930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b1597cb-77af-43b0-9800-fdc590aefa0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:45.614441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b1597cb-77af-43b0-9800-fdc590aefa0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:45.624438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b1597cb-77af-43b0-9800-fdc590aefa0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:45.625660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b1597cb-77af-43b0-9800-fdc590aefa0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:45.625660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b1597cb-77af-43b0-9800-fdc590aefa0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:45.626652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b1597cb-77af-43b0-9800-fdc590aefa0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:46.296014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5b1597cb-77af-43b0-9800-fdc590aefa0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:46.307862 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5b1597cb-77af-43b0-9800-fdc590aefa0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 0.714250 Oct 11 19:58:46.309267 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1912/3740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:45 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:46.354620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73c2d47e-4768-42c9-95fe-ecca5ccfe944 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:46.368560 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-73c2d47e-4768-42c9-95fe-ecca5ccfe944 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1308 microversion: 2.1 time: 0.837574 Oct 11 19:58:46.368996 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1829/3741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:45 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1308 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:46.843669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-828e235a-99a9-4658-8903-c61035e81458 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:46.846862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-828e235a-99a9-4658-8903-c61035e81458 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:46.858877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828e235a-99a9-4658-8903-c61035e81458 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:46.859387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828e235a-99a9-4658-8903-c61035e81458 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:46.859832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828e235a-99a9-4658-8903-c61035e81458 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:46.860645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828e235a-99a9-4658-8903-c61035e81458 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:46.861086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828e235a-99a9-4658-8903-c61035e81458 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:46.861518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828e235a-99a9-4658-8903-c61035e81458 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:46.934796 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-828e235a-99a9-4658-8903-c61035e81458 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action" status: 200 len: 14 microversion: 2.1 time: 0.620816 Oct 11 19:58:46.935422 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1913/3742] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:46 2022] POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action => generated 14 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:58:47.033100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-6b9fadb4-2e8f-40f5-ac93-a2207a64cd14 req-2b0d035b-cc41-4e5b-a4ef-4245209a574b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3244b84-dd0d-485c-97c1-36a525a95e19", "name": "network-vif-plugged", "status": "completed", "tag": "7491365b-e5b5-4dd6-988e-21683fa0a559"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:47.064381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6b9fadb4-2e8f-40f5-ac93-a2207a64cd14 req-2b0d035b-cc41-4e5b-a4ef-4245209a574b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:47.070850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6b9fadb4-2e8f-40f5-ac93-a2207a64cd14 req-2b0d035b-cc41-4e5b-a4ef-4245209a574b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:47.071129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6b9fadb4-2e8f-40f5-ac93-a2207a64cd14 req-2b0d035b-cc41-4e5b-a4ef-4245209a574b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:47.103680 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6b9fadb4-2e8f-40f5-ac93-a2207a64cd14 req-2b0d035b-cc41-4e5b-a4ef-4245209a574b service nova] Creating event network-vif-plugged:7491365b-e5b5-4dd6-988e-21683fa0a559 for instance c3244b84-dd0d-485c-97c1-36a525a95e19 on n-h2-860864-3 Oct 11 19:58:47.118767 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-6b9fadb4-2e8f-40f5-ac93-a2207a64cd14 req-2b0d035b-cc41-4e5b-a4ef-4245209a574b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090402 Oct 11 19:58:47.122885 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1830/3743] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:58:47.334325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6db612d8-e8d6-4cc7-a2de-733ab125fa59 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:47.334997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6db612d8-e8d6-4cc7-a2de-733ab125fa59 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:47.347835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db612d8-e8d6-4cc7-a2de-733ab125fa59 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:47.348333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db612d8-e8d6-4cc7-a2de-733ab125fa59 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:47.348775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db612d8-e8d6-4cc7-a2de-733ab125fa59 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:47.349485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db612d8-e8d6-4cc7-a2de-733ab125fa59 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:47.349947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db612d8-e8d6-4cc7-a2de-733ab125fa59 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:47.350378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6db612d8-e8d6-4cc7-a2de-733ab125fa59 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:47.397248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1a30e613-6116-4db0-bd94-46356cd9d1b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:47.397961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1a30e613-6116-4db0-bd94-46356cd9d1b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:47.407381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a30e613-6116-4db0-bd94-46356cd9d1b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:47.407998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a30e613-6116-4db0-bd94-46356cd9d1b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:47.408445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a30e613-6116-4db0-bd94-46356cd9d1b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:47.418223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a30e613-6116-4db0-bd94-46356cd9d1b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:47.418768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a30e613-6116-4db0-bd94-46356cd9d1b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:47.427184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a30e613-6116-4db0-bd94-46356cd9d1b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:48.286980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a30e613-6116-4db0-bd94-46356cd9d1b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:48.307545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6db612d8-e8d6-4cc7-a2de-733ab125fa59 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:48.318797 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1a30e613-6116-4db0-bd94-46356cd9d1b6 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1489 microversion: 2.1 time: 0.925528 Oct 11 19:58:48.338747 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6db612d8-e8d6-4cc7-a2de-733ab125fa59 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 0.995052 Oct 11 19:58:48.339738 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1914/3744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:47 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:48.340187 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1831/3745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:47 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1489 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:48.353327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e15e0da2-eb3a-4657-a1a8-ac35625057ae tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:48.365352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-abf915b4-cf83-4d3c-82b5-194b1466136d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:48.373142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-abf915b4-cf83-4d3c-82b5-194b1466136d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:48.379767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e15e0da2-eb3a-4657-a1a8-ac35625057ae tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:48.400263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abf915b4-cf83-4d3c-82b5-194b1466136d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:48.403815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e15e0da2-eb3a-4657-a1a8-ac35625057ae tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:48.404797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e15e0da2-eb3a-4657-a1a8-ac35625057ae tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:48.407764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abf915b4-cf83-4d3c-82b5-194b1466136d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:48.409475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e15e0da2-eb3a-4657-a1a8-ac35625057ae tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:48.413552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e15e0da2-eb3a-4657-a1a8-ac35625057ae tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:48.414373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abf915b4-cf83-4d3c-82b5-194b1466136d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:48.416084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abf915b4-cf83-4d3c-82b5-194b1466136d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:48.416588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e15e0da2-eb3a-4657-a1a8-ac35625057ae tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:48.417224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e15e0da2-eb3a-4657-a1a8-ac35625057ae tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:48.417877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abf915b4-cf83-4d3c-82b5-194b1466136d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:48.422895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-abf915b4-cf83-4d3c-82b5-194b1466136d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:48.526845 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e15e0da2-eb3a-4657-a1a8-ac35625057ae tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action" status: 200 len: 14 microversion: 2.1 time: 0.185091 Oct 11 19:58:48.527507 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1832/3746] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:48 2022] POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 19:58:48.609994 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-abf915b4-cf83-4d3c-82b5-194b1466136d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192/action" status: 202 len: 0 microversion: 2.1 time: 0.252193 Oct 11 19:58:48.612576 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1915/3747] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:48 2022] POST /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:58:48.624618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-34921f48-5f25-40e0-8b7e-567968bd20b9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:48.630074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-34921f48-5f25-40e0-8b7e-567968bd20b9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:48.659464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34921f48-5f25-40e0-8b7e-567968bd20b9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:48.660059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34921f48-5f25-40e0-8b7e-567968bd20b9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:48.660536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34921f48-5f25-40e0-8b7e-567968bd20b9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:48.661424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34921f48-5f25-40e0-8b7e-567968bd20b9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:48.661895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34921f48-5f25-40e0-8b7e-567968bd20b9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:48.662329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34921f48-5f25-40e0-8b7e-567968bd20b9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:49.371620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-43fd210f-f65e-4f69-a32a-bb5283582c11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:49.372702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-43fd210f-f65e-4f69-a32a-bb5283582c11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:49.392864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43fd210f-f65e-4f69-a32a-bb5283582c11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:49.393369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43fd210f-f65e-4f69-a32a-bb5283582c11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:49.405862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43fd210f-f65e-4f69-a32a-bb5283582c11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:49.408522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43fd210f-f65e-4f69-a32a-bb5283582c11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:49.411152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43fd210f-f65e-4f69-a32a-bb5283582c11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:49.412395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43fd210f-f65e-4f69-a32a-bb5283582c11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:50.120258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-34921f48-5f25-40e0-8b7e-567968bd20b9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:50.131916 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-34921f48-5f25-40e0-8b7e-567968bd20b9 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1494 microversion: 2.1 time: 1.515738 Oct 11 19:58:50.151156 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1833/3748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:48 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1494 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:50.158375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9345e898-3de1-4296-a7f4-0c5f9fee4855 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:50.173176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9345e898-3de1-4296-a7f4-0c5f9fee4855 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:50.181349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9345e898-3de1-4296-a7f4-0c5f9fee4855 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:50.181983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9345e898-3de1-4296-a7f4-0c5f9fee4855 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:50.182310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9345e898-3de1-4296-a7f4-0c5f9fee4855 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:50.188937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9345e898-3de1-4296-a7f4-0c5f9fee4855 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:50.193519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9345e898-3de1-4296-a7f4-0c5f9fee4855 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:50.205819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9345e898-3de1-4296-a7f4-0c5f9fee4855 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:50.327993 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9345e898-3de1-4296-a7f4-0c5f9fee4855 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action" status: 200 len: 16393 microversion: 2.1 time: 0.173880 Oct 11 19:58:50.330994 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1834/3749] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:50 2022] POST /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458/action => generated 16393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:58:50.342550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d542f2d9-dc56-451a-a72a-ad67dd1a1e70 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:50.343762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d542f2d9-dc56-451a-a72a-ad67dd1a1e70 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:50.366046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d542f2d9-dc56-451a-a72a-ad67dd1a1e70 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:50.370112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d542f2d9-dc56-451a-a72a-ad67dd1a1e70 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:50.371950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d542f2d9-dc56-451a-a72a-ad67dd1a1e70 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:50.373619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d542f2d9-dc56-451a-a72a-ad67dd1a1e70 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:50.376583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d542f2d9-dc56-451a-a72a-ad67dd1a1e70 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:50.379415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d542f2d9-dc56-451a-a72a-ad67dd1a1e70 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:50.447619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-43fd210f-f65e-4f69-a32a-bb5283582c11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:50.461408 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-43fd210f-f65e-4f69-a32a-bb5283582c11 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1351 microversion: 2.1 time: 1.094325 Oct 11 19:58:50.479140 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1916/3750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:49 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1351 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:51.168370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-debaed8d-a415-4212-bf8d-798657873c33 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:51.169926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-debaed8d-a415-4212-bf8d-798657873c33 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:51.183335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-debaed8d-a415-4212-bf8d-798657873c33 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:51.190789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-debaed8d-a415-4212-bf8d-798657873c33 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:51.191469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-debaed8d-a415-4212-bf8d-798657873c33 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:51.192403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-debaed8d-a415-4212-bf8d-798657873c33 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:51.193035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-debaed8d-a415-4212-bf8d-798657873c33 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:51.193641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-debaed8d-a415-4212-bf8d-798657873c33 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:51.640198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d542f2d9-dc56-451a-a72a-ad67dd1a1e70 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:51.656684 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d542f2d9-dc56-451a-a72a-ad67dd1a1e70 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 1.318933 Oct 11 19:58:51.663568 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1835/3751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:50 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:51.672910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-409adeaf-3cd8-4401-9c37-a297751b1c9f tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:51.679696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-409adeaf-3cd8-4401-9c37-a297751b1c9f tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:51.691683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-409adeaf-3cd8-4401-9c37-a297751b1c9f tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:51.692495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-409adeaf-3cd8-4401-9c37-a297751b1c9f tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:51.700602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-409adeaf-3cd8-4401-9c37-a297751b1c9f tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:51.701874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-409adeaf-3cd8-4401-9c37-a297751b1c9f tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:51.702553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-409adeaf-3cd8-4401-9c37-a297751b1c9f tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:51.703163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-409adeaf-3cd8-4401-9c37-a297751b1c9f tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:52.163230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-debaed8d-a415-4212-bf8d-798657873c33 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:52.185719 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-debaed8d-a415-4212-bf8d-798657873c33 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 200 len: 1474 microversion: 2.1 time: 1.021643 Oct 11 19:58:52.211376 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1917/3752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:51 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 1474 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:52.223941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-096fd4b8-15a2-446a-ab4c-f1c9a39ce987 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:52.227494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-096fd4b8-15a2-446a-ab4c-f1c9a39ce987 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:52.248170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-096fd4b8-15a2-446a-ab4c-f1c9a39ce987 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:52.248967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-096fd4b8-15a2-446a-ab4c-f1c9a39ce987 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:52.249608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-096fd4b8-15a2-446a-ab4c-f1c9a39ce987 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:52.250601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-096fd4b8-15a2-446a-ab4c-f1c9a39ce987 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:52.251369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-096fd4b8-15a2-446a-ab4c-f1c9a39ce987 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:52.251975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-096fd4b8-15a2-446a-ab4c-f1c9a39ce987 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:52.645754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-409adeaf-3cd8-4401-9c37-a297751b1c9f tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:52.659013 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-409adeaf-3cd8-4401-9c37-a297751b1c9f tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1542 microversion: 2.1 time: 0.991954 Oct 11 19:58:52.680032 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1836/3753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:51 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1542 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:52.695253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-448520bc-6bbd-4419-9f1f-cdd765c07b15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-870686814"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:52.698374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-448520bc-6bbd-4419-9f1f-cdd765c07b15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:52.727899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-448520bc-6bbd-4419-9f1f-cdd765c07b15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:52.727899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-448520bc-6bbd-4419-9f1f-cdd765c07b15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:52.727899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-448520bc-6bbd-4419-9f1f-cdd765c07b15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:52.727899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-448520bc-6bbd-4419-9f1f-cdd765c07b15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:52.727899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-448520bc-6bbd-4419-9f1f-cdd765c07b15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:52.727899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-448520bc-6bbd-4419-9f1f-cdd765c07b15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:52.798893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-096fd4b8-15a2-446a-ab4c-f1c9a39ce987 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:52.810882 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-096fd4b8-15a2-446a-ab4c-f1c9a39ce987 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.598150 Oct 11 19:58:52.834425 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1918/3754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:52 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:52.862032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-35b446af-2145-4c81-8fe9-76ccb83f7d0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:52.865648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-35b446af-2145-4c81-8fe9-76ccb83f7d0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:52.880740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b446af-2145-4c81-8fe9-76ccb83f7d0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:52.883217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b446af-2145-4c81-8fe9-76ccb83f7d0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:52.885162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b446af-2145-4c81-8fe9-76ccb83f7d0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:52.888713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b446af-2145-4c81-8fe9-76ccb83f7d0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:52.889554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b446af-2145-4c81-8fe9-76ccb83f7d0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:52.890109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b446af-2145-4c81-8fe9-76ccb83f7d0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:53.181057 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-35b446af-2145-4c81-8fe9-76ccb83f7d0e tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.341729 Oct 11 19:58:53.193805 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1919/3755] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:58:52 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19/os-interface => generated 285 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:53.206275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8dac4ed0-3400-40af-8f13-4e1d1f4688e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:53.211942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8dac4ed0-3400-40af-8f13-4e1d1f4688e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:53.226442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dac4ed0-3400-40af-8f13-4e1d1f4688e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:53.228998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dac4ed0-3400-40af-8f13-4e1d1f4688e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:53.229705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dac4ed0-3400-40af-8f13-4e1d1f4688e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:53.232145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dac4ed0-3400-40af-8f13-4e1d1f4688e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:53.232842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dac4ed0-3400-40af-8f13-4e1d1f4688e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:53.236363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dac4ed0-3400-40af-8f13-4e1d1f4688e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:53.348623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:58:53.452559 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-448520bc-6bbd-4419-9f1f-cdd765c07b15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192/action" status: 202 len: 0 microversion: 2.1 time: 0.762164 Oct 11 19:58:53.457511 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1837/3756] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:52 2022] POST /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192/action => generated 0 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 19:58:53.588378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d74adfbc-6612-42a1-9885-f3108b57cc93 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Action: 'create', calling method: .version_select at 0x7f83c72c2160>, body: {"keypair": {"name": "tempest-keypair-1494943510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUXWn9/r3BqkvXzBkm0VS9i36W+K51iBoh0y2jED5jNSrHeyjRZQevDBpcwPSau8xtCyIlyT8lO7F82yb0Om3jadm9FHvxwBVYu5UpqE4/TFL8I4jdmnI7XHJF/oc5V9Q=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:53.644914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d74adfbc-6612-42a1-9885-f3108b57cc93 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Getting quotas for project be4c654256334c259ebee814be235a69. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:58:53.666804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d74adfbc-6612-42a1-9885-f3108b57cc93 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Getting quotas for user 1255c68ae02e4992ac0ea1f8a22dd80d and project be4c654256334c259ebee814be235a69. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:58:53.728552 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d74adfbc-6612-42a1-9885-f3108b57cc93 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.266051 Oct 11 19:58:53.729679 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1838/3757] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:58:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:58:53.741190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-946e5e03-372d-4c00-825e-689d03fae797 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72e3820>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:53.827890 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-946e5e03-372d-4c00-825e-689d03fae797 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.096117 Oct 11 19:58:53.829957 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1839/3758] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:58:53 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:53.994514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8dac4ed0-3400-40af-8f13-4e1d1f4688e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:54.008377 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8dac4ed0-3400-40af-8f13-4e1d1f4688e5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.811737 Oct 11 19:58:54.012511 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1920/3759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:53 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:54.042641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4f08ba08-41e6-4e93-af6c-3be6a756a8a5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:54.043570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4f08ba08-41e6-4e93-af6c-3be6a756a8a5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:54.088786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f08ba08-41e6-4e93-af6c-3be6a756a8a5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:54.095415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f08ba08-41e6-4e93-af6c-3be6a756a8a5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:54.100789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f08ba08-41e6-4e93-af6c-3be6a756a8a5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:54.101571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f08ba08-41e6-4e93-af6c-3be6a756a8a5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:54.102160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f08ba08-41e6-4e93-af6c-3be6a756a8a5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:54.102753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f08ba08-41e6-4e93-af6c-3be6a756a8a5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:54.816839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4f08ba08-41e6-4e93-af6c-3be6a756a8a5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:54.833349 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4f08ba08-41e6-4e93-af6c-3be6a756a8a5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.799248 Oct 11 19:58:54.847696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-33063468-7c7e-4564-a6d4-6edabbcf864a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc4934c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:54.852117 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1840/3760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:54 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:54.883479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65ad2efb-b2ba-4931-b3bc-7adcf7b35d39 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:54.884334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-65ad2efb-b2ba-4931-b3bc-7adcf7b35d39 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:54.946994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65ad2efb-b2ba-4931-b3bc-7adcf7b35d39 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:54.949667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65ad2efb-b2ba-4931-b3bc-7adcf7b35d39 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:54.951054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65ad2efb-b2ba-4931-b3bc-7adcf7b35d39 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:54.955281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65ad2efb-b2ba-4931-b3bc-7adcf7b35d39 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:54.960228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65ad2efb-b2ba-4931-b3bc-7adcf7b35d39 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:54.961062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65ad2efb-b2ba-4931-b3bc-7adcf7b35d39 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:54.986250 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-33063468-7c7e-4564-a6d4-6edabbcf864a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.134946 Oct 11 19:58:54.987576 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1921/3761] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:58:54 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:55.129489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-65ad2efb-b2ba-4931-b3bc-7adcf7b35d39 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Locking {{(pid=126955) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 11 19:58:55.254350 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-65ad2efb-b2ba-4931-b3bc-7adcf7b35d39 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.375901 Oct 11 19:58:55.255463 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1841/3762] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:54 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:58:55.263778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f10d72b3-db0b-4ce1-870a-f3f4bee8ed63 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:55.264700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f10d72b3-db0b-4ce1-870a-f3f4bee8ed63 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:55.281511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f10d72b3-db0b-4ce1-870a-f3f4bee8ed63 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:55.283647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f10d72b3-db0b-4ce1-870a-f3f4bee8ed63 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:55.285454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f10d72b3-db0b-4ce1-870a-f3f4bee8ed63 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:55.287954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f10d72b3-db0b-4ce1-870a-f3f4bee8ed63 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:55.289139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f10d72b3-db0b-4ce1-870a-f3f4bee8ed63 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:55.291157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f10d72b3-db0b-4ce1-870a-f3f4bee8ed63 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:55.366045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-697a51f0-90e3-48ca-9696-cd77542e5b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:55.366818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-697a51f0-90e3-48ca-9696-cd77542e5b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:55.374286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697a51f0-90e3-48ca-9696-cd77542e5b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:55.375033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697a51f0-90e3-48ca-9696-cd77542e5b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:55.381068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697a51f0-90e3-48ca-9696-cd77542e5b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:55.382075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697a51f0-90e3-48ca-9696-cd77542e5b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:55.384323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697a51f0-90e3-48ca-9696-cd77542e5b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:55.387162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-697a51f0-90e3-48ca-9696-cd77542e5b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:55.465875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-697a51f0-90e3-48ca-9696-cd77542e5b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:58:55.620287 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-697a51f0-90e3-48ca-9696-cd77542e5b02 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 204 len: 0 microversion: 2.1 time: 0.257009 Oct 11 19:58:55.624432 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1842/3763] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:58:55 2022] DELETE /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:58:55.632353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-81fc5183-205b-44b8-9594-9064bc1b3e8c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:55.633177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-81fc5183-205b-44b8-9594-9064bc1b3e8c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:55.641999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81fc5183-205b-44b8-9594-9064bc1b3e8c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:55.642757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81fc5183-205b-44b8-9594-9064bc1b3e8c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:55.644617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81fc5183-205b-44b8-9594-9064bc1b3e8c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:55.645839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81fc5183-205b-44b8-9594-9064bc1b3e8c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:55.646771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81fc5183-205b-44b8-9594-9064bc1b3e8c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:55.647445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81fc5183-205b-44b8-9594-9064bc1b3e8c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:55.864814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-81fc5183-205b-44b8-9594-9064bc1b3e8c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:55.875844 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-81fc5183-205b-44b8-9594-9064bc1b3e8c tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1508 microversion: 2.1 time: 0.248880 Oct 11 19:58:55.893007 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1843/3764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:55 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:55.904461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f10d72b3-db0b-4ce1-870a-f3f4bee8ed63 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:55.918363 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f10d72b3-db0b-4ce1-870a-f3f4bee8ed63 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.657357 Oct 11 19:58:55.920350 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1922/3765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:55 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:55.947053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06cbf9e1-2f05-4ab6-a960-c1cff2f44b71 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:55.960114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06cbf9e1-2f05-4ab6-a960-c1cff2f44b71 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:55.960942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06cbf9e1-2f05-4ab6-a960-c1cff2f44b71 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:55.961690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06cbf9e1-2f05-4ab6-a960-c1cff2f44b71 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:56.006765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a864ff1b-16b0-4756-bf2f-b41d10c25e41 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc5dec10>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:56.026496 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-06cbf9e1-2f05-4ab6-a960-c1cff2f44b71 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] HTTP exception thrown: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 is locked Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06cbf9e1-2f05-4ab6-a960-c1cff2f44b71 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Request method failure captured: Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action HTTP/1.1 Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 15 Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnI5OPNqEKALykkTrMulwNA85YH_Zdqz_g5mxxtFhZWzC1mgynXOwy-7XOBwQTjUtt_HFqth8q6PFQS1r46sN3cIfMotnurV3uQo5c99ZQnVSr2pWZn-5m3uVl2cj_7fGN0q1zKhyJks1DRVXwQGH05jJBBzz6HnW7DgJ8v9-VauHo Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efd1bdcd18f14e87925a5b41393b9add", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}] Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1914419120 Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1914419120-project Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 0647dca89de240ba9fbc1c59ed2b6392 Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1914419120-project Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: {"os-stop": {}} Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 is locked Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'b7ee4391-e163-4a76-9151-04adeb0111a8', 'body': {'os-stop': {}}} Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 is locked Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 is locked Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 is locked Oct 11 19:58:56.032837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:58:56.040105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06cbf9e1-2f05-4ab6-a960-c1cff2f44b71 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Returning 409 to user: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 is locked {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:58:56.042778 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-06cbf9e1-2f05-4ab6-a960-c1cff2f44b71 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 409 len: 107 microversion: 2.1 time: 0.102390 Oct 11 19:58:56.047818 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1844/3766] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:55 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 107 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 19:58:56.066397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-80f13b5f-9165-4829-88b1-077f191bc2b0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:56.068724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-80f13b5f-9165-4829-88b1-077f191bc2b0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:56.097053 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a864ff1b-16b0-4756-bf2f-b41d10c25e41 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.097287 Oct 11 19:58:56.097644 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1923/3767] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:58:55 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:56.100834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f13b5f-9165-4829-88b1-077f191bc2b0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:56.103126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f13b5f-9165-4829-88b1-077f191bc2b0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:56.103653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f13b5f-9165-4829-88b1-077f191bc2b0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:56.108363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f13b5f-9165-4829-88b1-077f191bc2b0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:56.113381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f13b5f-9165-4829-88b1-077f191bc2b0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:56.114324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80f13b5f-9165-4829-88b1-077f191bc2b0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:56.220227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-80f13b5f-9165-4829-88b1-077f191bc2b0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Unlocking {{(pid=126955) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 11 19:58:56.319207 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-80f13b5f-9165-4829-88b1-077f191bc2b0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.262824 Oct 11 19:58:56.323121 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1845/3768] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:56 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:58:56.330727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87097ac8-66e9-4a09-889f-76215625cf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:56.338212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87097ac8-66e9-4a09-889f-76215625cf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:56.339264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87097ac8-66e9-4a09-889f-76215625cf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:56.340093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87097ac8-66e9-4a09-889f-76215625cf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:56.378873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-87097ac8-66e9-4a09-889f-76215625cf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Going to try to stop instance {{(pid=126956) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 19:58:56.495403 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87097ac8-66e9-4a09-889f-76215625cf48 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.169671 Oct 11 19:58:56.496425 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1924/3769] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:58:56 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:58:56.511530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-98707f4f-f375-45c6-a03c-af8e29c6c6ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:56.513463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-98707f4f-f375-45c6-a03c-af8e29c6c6ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:56.533526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98707f4f-f375-45c6-a03c-af8e29c6c6ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:56.534848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98707f4f-f375-45c6-a03c-af8e29c6c6ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:56.535381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98707f4f-f375-45c6-a03c-af8e29c6c6ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:56.536198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98707f4f-f375-45c6-a03c-af8e29c6c6ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:56.537226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98707f4f-f375-45c6-a03c-af8e29c6c6ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:56.537972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98707f4f-f375-45c6-a03c-af8e29c6c6ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:56.883637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-756d445d-8848-44c4-aab0-ac1c762de8cf req-030307be-a2cd-46a9-85f7-a66bc10e2f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3244b84-dd0d-485c-97c1-36a525a95e19", "tag": "7491365b-e5b5-4dd6-988e-21683fa0a559"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:56.910865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-756d445d-8848-44c4-aab0-ac1c762de8cf req-030307be-a2cd-46a9-85f7-a66bc10e2f75 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:56.912317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-756d445d-8848-44c4-aab0-ac1c762de8cf req-030307be-a2cd-46a9-85f7-a66bc10e2f75 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:56.913012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-756d445d-8848-44c4-aab0-ac1c762de8cf req-030307be-a2cd-46a9-85f7-a66bc10e2f75 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:56.926998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-98707f4f-f375-45c6-a03c-af8e29c6c6ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:56.942131 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-98707f4f-f375-45c6-a03c-af8e29c6c6ca tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 0.441479 Oct 11 19:58:56.944788 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-756d445d-8848-44c4-aab0-ac1c762de8cf req-030307be-a2cd-46a9-85f7-a66bc10e2f75 service nova] Creating event network-changed:7491365b-e5b5-4dd6-988e-21683fa0a559 for instance c3244b84-dd0d-485c-97c1-36a525a95e19 on n-h2-860864-3 Oct 11 19:58:56.968392 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-756d445d-8848-44c4-aab0-ac1c762de8cf req-030307be-a2cd-46a9-85f7-a66bc10e2f75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091637 Oct 11 19:58:56.969371 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1925/3770] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:58:56.973282 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1846/3771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:56 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:56.977762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d3f7c35a-a797-4bf7-9b29-c4b0faded270 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:56.978803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d3f7c35a-a797-4bf7-9b29-c4b0faded270 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:56.989435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f7c35a-a797-4bf7-9b29-c4b0faded270 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:56.993217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f7c35a-a797-4bf7-9b29-c4b0faded270 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:56.995695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f7c35a-a797-4bf7-9b29-c4b0faded270 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:57.007624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f7c35a-a797-4bf7-9b29-c4b0faded270 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:57.008500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f7c35a-a797-4bf7-9b29-c4b0faded270 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:57.009128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3f7c35a-a797-4bf7-9b29-c4b0faded270 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:57.119992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a7ccfd49-a0b6-4130-b95b-b56cf4669ea4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72bb700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:57.233436 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a7ccfd49-a0b6-4130-b95b-b56cf4669ea4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.123171 Oct 11 19:58:57.261972 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1847/3772] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:58:57 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:57.568065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53047840-dc6e-47dc-8907-01a68d451261 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Action: 'create', calling method: .version_select at 0x7f83c72c58b0>, body: {"keypair": {"name": "tempest-keypair-1419696406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUV1OY/lAM/CRouxldd8xs1cKwU5/h9X14Z5+d+5L8uM23thyARG3tbVOE71ehZ8OxeINA7Mx4SJ2x5LsQvA9GVZcxUe5ZYQP2hVa/0ws1+zxA+zB/oGXHNpGwIh8pH6A=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:58:57.615335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-53047840-dc6e-47dc-8907-01a68d451261 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Getting quotas for project 3e49d03e014e4749b522b6a87372994b. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:58:57.629924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-53047840-dc6e-47dc-8907-01a68d451261 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Getting quotas for user 27affa75f6a849ba802c1397406b201c and project 3e49d03e014e4749b522b6a87372994b. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:58:57.705185 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-53047840-dc6e-47dc-8907-01a68d451261 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.242721 Oct 11 19:58:57.706617 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1848/3773] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 11 19:58:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 245 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 11 19:58:57.982472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-226926b5-4347-4f82-90e7-d480263a5ffe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:57.984360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-226926b5-4347-4f82-90e7-d480263a5ffe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:57.995138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-226926b5-4347-4f82-90e7-d480263a5ffe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:57.996088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-226926b5-4347-4f82-90e7-d480263a5ffe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:57.997156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-226926b5-4347-4f82-90e7-d480263a5ffe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:57.999896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-226926b5-4347-4f82-90e7-d480263a5ffe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:58.001736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-226926b5-4347-4f82-90e7-d480263a5ffe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:58.002889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-226926b5-4347-4f82-90e7-d480263a5ffe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:58.768988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d3f7c35a-a797-4bf7-9b29-c4b0faded270 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:58.783655 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d3f7c35a-a797-4bf7-9b29-c4b0faded270 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1508 microversion: 2.1 time: 1.812774 Oct 11 19:58:58.801107 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1926/3774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:56 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1508 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:58.814809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-de1f5124-b138-4e03-84d1-37a6f41bc320 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83ccb88f70>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:58.893758 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-de1f5124-b138-4e03-84d1-37a6f41bc320 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.084986 Oct 11 19:58:58.894507 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1927/3775] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:58:58 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:58:59.049009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-226926b5-4347-4f82-90e7-d480263a5ffe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:58:59.065377 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-226926b5-4347-4f82-90e7-d480263a5ffe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 1.088100 Oct 11 19:58:59.094840 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1849/3776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:57 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:58:59.813492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b277a4c5-b8e5-477c-b6cd-42045109e42d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:58:59.814816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b277a4c5-b8e5-477c-b6cd-42045109e42d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:58:59.824995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b277a4c5-b8e5-477c-b6cd-42045109e42d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:59.829572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b277a4c5-b8e5-477c-b6cd-42045109e42d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:59.831222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b277a4c5-b8e5-477c-b6cd-42045109e42d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:59.833837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b277a4c5-b8e5-477c-b6cd-42045109e42d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:58:59.834577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b277a4c5-b8e5-477c-b6cd-42045109e42d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:58:59.836020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b277a4c5-b8e5-477c-b6cd-42045109e42d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:58:59.909798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-277bf0c6-e139-4f1f-905d-0983a27b6722 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c7258ee0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:00.008433 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-277bf0c6-e139-4f1f-905d-0983a27b6722 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.102890 Oct 11 19:59:00.012942 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1850/3777] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:58:59 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:00.093119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a8d97bfb-946b-46f3-8c94-063765c5070d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:00.094660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a8d97bfb-946b-46f3-8c94-063765c5070d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:00.104602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8d97bfb-946b-46f3-8c94-063765c5070d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:00.105475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8d97bfb-946b-46f3-8c94-063765c5070d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:00.106169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8d97bfb-946b-46f3-8c94-063765c5070d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:00.107177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8d97bfb-946b-46f3-8c94-063765c5070d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:00.107881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8d97bfb-946b-46f3-8c94-063765c5070d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:00.108561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8d97bfb-946b-46f3-8c94-063765c5070d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:00.440124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b277a4c5-b8e5-477c-b6cd-42045109e42d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:00.447834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:00.450448 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b277a4c5-b8e5-477c-b6cd-42045109e42d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 200 len: 1466 microversion: 2.1 time: 0.641280 Oct 11 19:59:00.467590 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1928/3778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:58:59 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 1466 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:00.478632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4be783f1-d112-4b42-82ea-368de5d7b710 req-5e72bae1-4b63-4d6e-840d-65c8eeb589e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a346658c-09a4-43ec-a0ab-e2541e23e423", "name": "network-vif-deleted", "tag": "958b0dc6-87d6-463a-b043-1a976667640b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:00.508857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4be783f1-d112-4b42-82ea-368de5d7b710 req-5e72bae1-4b63-4d6e-840d-65c8eeb589e2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:00.509491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4be783f1-d112-4b42-82ea-368de5d7b710 req-5e72bae1-4b63-4d6e-840d-65c8eeb589e2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:00.510049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4be783f1-d112-4b42-82ea-368de5d7b710 req-5e72bae1-4b63-4d6e-840d-65c8eeb589e2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:00.528215 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4be783f1-d112-4b42-82ea-368de5d7b710 req-5e72bae1-4b63-4d6e-840d-65c8eeb589e2 service nova] Creating event network-vif-deleted:958b0dc6-87d6-463a-b043-1a976667640b for instance a346658c-09a4-43ec-a0ab-e2541e23e423 on n-h2-860864-3 Oct 11 19:59:00.535234 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4be783f1-d112-4b42-82ea-368de5d7b710 req-5e72bae1-4b63-4d6e-840d-65c8eeb589e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065984 Oct 11 19:59:00.539021 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1929/3779] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:01.029646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8823d6d7-ecc3-472d-8fc5-00821ffa3a52 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc4af9d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:01.144290 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8823d6d7-ecc3-472d-8fc5-00821ffa3a52 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.122103 Oct 11 19:59:01.144901 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1930/3780] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:01 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:01.495562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:01.496325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: a346658c-09a4-43ec-a0ab-e2541e23e423] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:01.521148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:01.521653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:01.522100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:01.522844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:01.523305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:01.523725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:01.557991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a8d97bfb-946b-46f3-8c94-063765c5070d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:01.568644 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a8d97bfb-946b-46f3-8c94-063765c5070d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 1.479251 Oct 11 19:59:01.571760 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] HTTP exception thrown: Instance a346658c-09a4-43ec-a0ab-e2541e23e423 could not be found. Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Request method failure captured: Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 HTTP/1.1 Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnHf-gY9GoFThGWTuyLZOFCjiBlppqFx09S1rxIOZhPN4k_d-_Y9sZYcmKSj4UOYvu9oafZcIYglvMprUUmJuXwAUoSMveDAF_xAfvCOrPvWGeWuOLI47ySPf1501t-RY5r2Fgp6Sqr-jc81_0LijQqzlDf3IXjp_i8MKsYX5dySSY Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8df2eebeffd440d988aa6f580c9bb221", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}] Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d1ab8c29f18c4fc09858791a80527e5d Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance a346658c-09a4-43ec-a0ab-e2541e23e423 could not be found. Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a346658c-09a4-43ec-a0ab-e2541e23e423'} Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a346658c-09a4-43ec-a0ab-e2541e23e423 could not be found. Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a346658c-09a4-43ec-a0ab-e2541e23e423 could not be found. Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:59:01.576810 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:59:01.582916 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:59:01.582916 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:59:01.582916 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:59:01.582916 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:59:01.582916 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:59:01.582916 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:59:01.582916 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a346658c-09a4-43ec-a0ab-e2541e23e423 could not be found. Oct 11 19:59:01.582916 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 19:59:01.584533 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1851/3781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:00 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:01.586433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Returning 404 to user: Instance a346658c-09a4-43ec-a0ab-e2541e23e423 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:59:01.588892 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-21691aa5-df68-4d0b-88d6-236ac95205e4 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423" status: 404 len: 111 microversion: 2.1 time: 0.099514 Oct 11 19:59:01.600140 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1931/3782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:01 2022] GET /compute/v2.1/servers/a346658c-09a4-43ec-a0ab-e2541e23e423 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 19:59:01.601185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f3845b03-0724-483c-8344-0e88184d986a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:01.601969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f3845b03-0724-483c-8344-0e88184d986a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:01.617872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3845b03-0724-483c-8344-0e88184d986a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:01.619015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3845b03-0724-483c-8344-0e88184d986a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:01.622857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3845b03-0724-483c-8344-0e88184d986a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:01.623760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3845b03-0724-483c-8344-0e88184d986a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:01.624361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3845b03-0724-483c-8344-0e88184d986a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:01.625939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3845b03-0724-483c-8344-0e88184d986a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:01.691710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f3845b03-0724-483c-8344-0e88184d986a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:59:01.704360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:01.772243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-240318447", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9b026dfe-2f09-4cb3-b739-cb1be26cf628"}], "security_groups": [{"name": "tempest-securitygroup--1576189224"}], "key_name": "tempest-keypair-1494943510", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:01.914163 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f3845b03-0724-483c-8344-0e88184d986a tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 204 len: 0 microversion: 2.1 time: 0.318257 Oct 11 19:59:01.920369 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1852/3783] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:59:01 2022] DELETE /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:59:01.935975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-20523ae5-71ed-44cb-b33c-dd97e3375e5f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:01.936701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-20523ae5-71ed-44cb-b33c-dd97e3375e5f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:01.956254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20523ae5-71ed-44cb-b33c-dd97e3375e5f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:01.956771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20523ae5-71ed-44cb-b33c-dd97e3375e5f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:01.957224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20523ae5-71ed-44cb-b33c-dd97e3375e5f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:01.958335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20523ae5-71ed-44cb-b33c-dd97e3375e5f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:01.959333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20523ae5-71ed-44cb-b33c-dd97e3375e5f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:01.959785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20523ae5-71ed-44cb-b33c-dd97e3375e5f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:02.163550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] validate_networks() for [('9b026dfe-2f09-4cb3-b739-cb1be26cf628', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:59:02.610197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-20523ae5-71ed-44cb-b33c-dd97e3375e5f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:02.634857 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-20523ae5-71ed-44cb-b33c-dd97e3375e5f tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.698009 Oct 11 19:59:02.636145 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1853/3784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:01 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:02.651265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7740d767-c71f-45e7-a51b-358e8b5973a4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72465e0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:02.748384 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7740d767-c71f-45e7-a51b-358e8b5973a4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.110708 Oct 11 19:59:02.749169 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1854/3785] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:02 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:02.763855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e3114c5d-16ba-4787-bc48-dbfeff1374b5 req-0163de4c-171c-4bbd-b140-4b4f5bf2dc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392dfdc2-0385-4e3b-8afb-b26d4d9d7192", "name": "network-vif-plugged", "status": "completed", "tag": "64639c79-3542-45ee-b629-e0e30cd6fb75"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:02.787453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e3114c5d-16ba-4787-bc48-dbfeff1374b5 req-0163de4c-171c-4bbd-b140-4b4f5bf2dc10 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:02.791303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e3114c5d-16ba-4787-bc48-dbfeff1374b5 req-0163de4c-171c-4bbd-b140-4b4f5bf2dc10 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:02.792403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e3114c5d-16ba-4787-bc48-dbfeff1374b5 req-0163de4c-171c-4bbd-b140-4b4f5bf2dc10 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:02.814987 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e3114c5d-16ba-4787-bc48-dbfeff1374b5 req-0163de4c-171c-4bbd-b140-4b4f5bf2dc10 service nova] Creating event network-vif-plugged:64639c79-3542-45ee-b629-e0e30cd6fb75 for instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 on n-h2-860864-3 Oct 11 19:59:02.824806 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e3114c5d-16ba-4787-bc48-dbfeff1374b5 req-0163de4c-171c-4bbd-b140-4b4f5bf2dc10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069397 Oct 11 19:59:02.826144 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1855/3786] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:02.834337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca9ad485-4ea7-41f1-8c00-0506e060546c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:02.835865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca9ad485-4ea7-41f1-8c00-0506e060546c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:02.848000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9ad485-4ea7-41f1-8c00-0506e060546c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:02.848929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9ad485-4ea7-41f1-8c00-0506e060546c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:02.851263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9ad485-4ea7-41f1-8c00-0506e060546c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:02.852268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9ad485-4ea7-41f1-8c00-0506e060546c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:02.853253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9ad485-4ea7-41f1-8c00-0506e060546c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:02.853958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9ad485-4ea7-41f1-8c00-0506e060546c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:03.898433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca9ad485-4ea7-41f1-8c00-0506e060546c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:03.938925 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca9ad485-4ea7-41f1-8c00-0506e060546c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 1.111121 Oct 11 19:59:03.940716 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1856/3787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:02 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:03.949076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2075590952", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aedac80a-377a-485e-8549-987822ec3514"}], "security_groups": [{"name": "tempest-securitygroup--1547482493"}], "key_name": "tempest-keypair-1419696406", "user_data": "}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:04.379521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] validate_networks() for [('aedac80a-377a-485e-8549-987822ec3514', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:59:04.397349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Getting quotas for project be4c654256334c259ebee814be235a69. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:59:04.409075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Getting quotas for user 1255c68ae02e4992ac0ea1f8a22dd80d and project be4c654256334c259ebee814be235a69. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:59:04.436110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:59:04.437512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:59:04.438964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:59:04.440120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:59:04.440822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:59:04.456189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:04.457085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:04.458277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:04.461559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:04.462346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:04.463052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:04.497880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Getting quotas for project be4c654256334c259ebee814be235a69. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:59:04.506269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Getting quotas for user 1255c68ae02e4992ac0ea1f8a22dd80d and project be4c654256334c259ebee814be235a69. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:59:04.529644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:59:04.532440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:59:04.636518 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-55d94b6a-dcc0-4a68-97e3-51a6850df352 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.870175 Oct 11 19:59:04.637685 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1932/3788] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:59:01 2022] POST /compute/v2.1/servers => generated 407 bytes in 2872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 19:59:04.648507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e0037cd-93d6-4b97-8de2-2b101f398308 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:04.649310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e0037cd-93d6-4b97-8de2-2b101f398308 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:04.687210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e0037cd-93d6-4b97-8de2-2b101f398308 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:04.689237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e0037cd-93d6-4b97-8de2-2b101f398308 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:04.689586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e0037cd-93d6-4b97-8de2-2b101f398308 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:04.692706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e0037cd-93d6-4b97-8de2-2b101f398308 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:04.694136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e0037cd-93d6-4b97-8de2-2b101f398308 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:04.696470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e0037cd-93d6-4b97-8de2-2b101f398308 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:05.463607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e0037cd-93d6-4b97-8de2-2b101f398308 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:05.487446 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e0037cd-93d6-4b97-8de2-2b101f398308 tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.846531 Oct 11 19:59:05.488226 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1933/3789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:04 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:05.514214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-17341556-d66c-4c03-8b93-209f09d7f4b1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc8cc790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:05.632785 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-17341556-d66c-4c03-8b93-209f09d7f4b1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.142679 Oct 11 19:59:05.636305 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1934/3790] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:05 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:05.647505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-73f7d747-6c4a-4b5f-98b2-9462b27ef69e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:05.650355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-73f7d747-6c4a-4b5f-98b2-9462b27ef69e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:05.999702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-73f7d747-6c4a-4b5f-98b2-9462b27ef69e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:06.024064 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-73f7d747-6c4a-4b5f-98b2-9462b27ef69e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1269 microversion: 2.1 time: 0.385129 Oct 11 19:59:06.036108 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1935/3791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:05 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1269 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:06.048241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d25e82d-b765-4c94-962d-2dbce6a63242 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:06.050269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4d25e82d-b765-4c94-962d-2dbce6a63242 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:06.078327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d25e82d-b765-4c94-962d-2dbce6a63242 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:06.080004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d25e82d-b765-4c94-962d-2dbce6a63242 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:06.080684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d25e82d-b765-4c94-962d-2dbce6a63242 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:06.082275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d25e82d-b765-4c94-962d-2dbce6a63242 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:06.082984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d25e82d-b765-4c94-962d-2dbce6a63242 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:06.083626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d25e82d-b765-4c94-962d-2dbce6a63242 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:07.541479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:59:07.542482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:59:07.543001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:59:07.543422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:59:07.543844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:59:07.565992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:07.566419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:07.567023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:07.567949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:07.569779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:07.570228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:07.643145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Getting quotas for project 3e49d03e014e4749b522b6a87372994b. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:59:07.648933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:07.650550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Getting quotas for user 27affa75f6a849ba802c1397406b201c and project 3e49d03e014e4749b522b6a87372994b. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:59:07.692229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:59:07.700917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:59:07.813467 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b014c9e-f658-4fec-8bc6-eb3c06a212b6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.870665 Oct 11 19:59:07.816654 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1857/3792] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 19:59:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 3875 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 19:59:07.821015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4d25e82d-b765-4c94-962d-2dbce6a63242 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:07.824601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-114b90a6-348c-4ec2-aa82-5fa7d7030e3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:07.834907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-114b90a6-348c-4ec2-aa82-5fa7d7030e3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:07.845871 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4d25e82d-b765-4c94-962d-2dbce6a63242 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 1.808112 Oct 11 19:59:07.847373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114b90a6-348c-4ec2-aa82-5fa7d7030e3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:07.848730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114b90a6-348c-4ec2-aa82-5fa7d7030e3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:07.857535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114b90a6-348c-4ec2-aa82-5fa7d7030e3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:07.858764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114b90a6-348c-4ec2-aa82-5fa7d7030e3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:07.860088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114b90a6-348c-4ec2-aa82-5fa7d7030e3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:07.860948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114b90a6-348c-4ec2-aa82-5fa7d7030e3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:07.874286 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1936/3793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:06 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:07.894430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-077ff22f-3cdd-4a29-9d71-7e935bba8917 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83d06c1b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:08.008366 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-077ff22f-3cdd-4a29-9d71-7e935bba8917 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.130791 Oct 11 19:59:08.009299 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1937/3794] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:07 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:08.024700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c4d6c6b-042f-423b-9854-a2b9288e6628 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:08.028678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c4d6c6b-042f-423b-9854-a2b9288e6628 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:08.051807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c4d6c6b-042f-423b-9854-a2b9288e6628 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:08.052360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c4d6c6b-042f-423b-9854-a2b9288e6628 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:08.052799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c4d6c6b-042f-423b-9854-a2b9288e6628 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:08.053529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c4d6c6b-042f-423b-9854-a2b9288e6628 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:08.066146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c4d6c6b-042f-423b-9854-a2b9288e6628 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:08.066994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c4d6c6b-042f-423b-9854-a2b9288e6628 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:08.174546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c4d6c6b-042f-423b-9854-a2b9288e6628 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:08.195767 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c4d6c6b-042f-423b-9854-a2b9288e6628 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1327 microversion: 2.1 time: 0.183303 Oct 11 19:59:08.196685 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1938/3795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:08 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1327 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:08.201610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-217f27d2-da07-44bb-8c30-a51b8c4861c8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:08.202227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-217f27d2-da07-44bb-8c30-a51b8c4861c8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:08.526337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-217f27d2-da07-44bb-8c30-a51b8c4861c8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:08.534987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-217f27d2-da07-44bb-8c30-a51b8c4861c8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:08.537117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-217f27d2-da07-44bb-8c30-a51b8c4861c8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:08.555166 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-217f27d2-da07-44bb-8c30-a51b8c4861c8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1282 microversion: 2.20 time: 0.357240 Oct 11 19:59:08.555845 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1939/3796] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:08 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1282 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:08.760893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-114b90a6-348c-4ec2-aa82-5fa7d7030e3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ab8c29f18c4fc09858791a80527e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df2eebeffd440d988aa6f580c9bb221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:08.779745 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-114b90a6-348c-4ec2-aa82-5fa7d7030e3d tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 200 len: 1522 microversion: 2.1 time: 0.958742 Oct 11 19:59:08.782945 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1858/3797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:07 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 1522 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:08.795748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-39b46770-0be8-4330-aaa5-93ab600ebced req-f3f2cf3f-1936-4f85-8b50-4ef1201cf086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac52ec7-a881-454c-89ea-25e9d288b87d", "name": "network-vif-deleted", "tag": "9b2cc42b-faeb-475b-a070-fb2ed8d8904e"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:08.817340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-39b46770-0be8-4330-aaa5-93ab600ebced req-f3f2cf3f-1936-4f85-8b50-4ef1201cf086 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:08.818168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-39b46770-0be8-4330-aaa5-93ab600ebced req-f3f2cf3f-1936-4f85-8b50-4ef1201cf086 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:08.818927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-39b46770-0be8-4330-aaa5-93ab600ebced req-f3f2cf3f-1936-4f85-8b50-4ef1201cf086 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:08.847829 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-39b46770-0be8-4330-aaa5-93ab600ebced req-f3f2cf3f-1936-4f85-8b50-4ef1201cf086 service nova] Creating event network-vif-deleted:9b2cc42b-faeb-475b-a070-fb2ed8d8904e for instance 0ac52ec7-a881-454c-89ea-25e9d288b87d on n-h2-860864-3 Oct 11 19:59:08.862513 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-39b46770-0be8-4330-aaa5-93ab600ebced req-f3f2cf3f-1936-4f85-8b50-4ef1201cf086 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070519 Oct 11 19:59:08.863574 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1940/3798] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:08.874026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eff9f8e4-e2be-4172-beed-25a06bd8645c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:08.874828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eff9f8e4-e2be-4172-beed-25a06bd8645c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:08.887259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9f8e4-e2be-4172-beed-25a06bd8645c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:08.892642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9f8e4-e2be-4172-beed-25a06bd8645c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:08.896495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9f8e4-e2be-4172-beed-25a06bd8645c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:08.899163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9f8e4-e2be-4172-beed-25a06bd8645c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:08.901467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9f8e4-e2be-4172-beed-25a06bd8645c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:08.901906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eff9f8e4-e2be-4172-beed-25a06bd8645c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:09.025532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-af08568c-a36f-4882-8141-938bbff37b3e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc4ae1f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:09.134613 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-af08568c-a36f-4882-8141-938bbff37b3e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.114067 Oct 11 19:59:09.136775 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1941/3799] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:09 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:09.226613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-50b55f93-d1fd-4e9e-a603-4259fe4c7fe0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:09.227481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-50b55f93-d1fd-4e9e-a603-4259fe4c7fe0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:09.243753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:09.246604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b55f93-d1fd-4e9e-a603-4259fe4c7fe0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:09.247231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b55f93-d1fd-4e9e-a603-4259fe4c7fe0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:09.247952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b55f93-d1fd-4e9e-a603-4259fe4c7fe0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:09.251900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b55f93-d1fd-4e9e-a603-4259fe4c7fe0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:09.253573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b55f93-d1fd-4e9e-a603-4259fe4c7fe0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:09.254716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50b55f93-d1fd-4e9e-a603-4259fe4c7fe0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:09.508974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-50b55f93-d1fd-4e9e-a603-4259fe4c7fe0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:09.525052 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-50b55f93-d1fd-4e9e-a603-4259fe4c7fe0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1327 microversion: 2.1 time: 0.304585 Oct 11 19:59:09.532032 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1942/3800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:09 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1327 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:09.581242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:09.581872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:09.595053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:09.595572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:09.596020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:09.596742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:09.597208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:09.597640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:09.679369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eff9f8e4-e2be-4172-beed-25a06bd8645c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:09.693367 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eff9f8e4-e2be-4172-beed-25a06bd8645c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1656 microversion: 2.1 time: 0.822966 Oct 11 19:59:09.696659 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1859/3801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:08 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1656 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:09.721485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f52f7593-8ca7-4b42-85c7-b7af128f6467 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:09.736344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f52f7593-8ca7-4b42-85c7-b7af128f6467 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:09.738257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f52f7593-8ca7-4b42-85c7-b7af128f6467 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:09.739968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f52f7593-8ca7-4b42-85c7-b7af128f6467 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:09.806270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f52f7593-8ca7-4b42-85c7-b7af128f6467 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Going to try to start instance {{(pid=126955) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 19:59:09.917868 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f52f7593-8ca7-4b42-85c7-b7af128f6467 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.201622 Oct 11 19:59:09.922669 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1860/3802] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:59:09 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:59:09.952237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:09.957193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] [instance: 0ac52ec7-a881-454c-89ea-25e9d288b87d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:09.977603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:09.979511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:09.980325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:09.981936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:09.983928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:09.985442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:10.028844 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] HTTP exception thrown: Instance 0ac52ec7-a881-454c-89ea-25e9d288b87d could not be found. Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Request method failure captured: Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d HTTP/1.1 Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnHf-gY9GoFThGWTuyLZOFCjiBlppqFx09S1rxIOZhPN4k_d-_Y9sZYcmKSj4UOYvu9oafZcIYglvMprUUmJuXwAUoSMveDAF_xAfvCOrPvWGeWuOLI47ySPf1501t-RY5r2Fgp6Sqr-jc81_0LijQqzlDf3IXjp_i8MKsYX5dySSY Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8df2eebeffd440d988aa6f580c9bb221", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8df2eebeffd440d988aa6f580c9bb221"}]}] Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 8df2eebeffd440d988aa6f580c9bb221 Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-550439393 Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d1ab8c29f18c4fc09858791a80527e5d Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerRescueNegativeTestJSON-550439393-project Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 0ac52ec7-a881-454c-89ea-25e9d288b87d could not be found. Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '0ac52ec7-a881-454c-89ea-25e9d288b87d'} Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac52ec7-a881-454c-89ea-25e9d288b87d could not be found. Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac52ec7-a881-454c-89ea-25e9d288b87d could not be found. Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:59:10.036232 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:59:10.042373 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:59:10.042373 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:59:10.042373 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:59:10.042373 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:59:10.042373 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:59:10.042373 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:59:10.042373 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac52ec7-a881-454c-89ea-25e9d288b87d could not be found. Oct 11 19:59:10.042373 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:59:10.044996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] Returning 404 to user: Instance 0ac52ec7-a881-454c-89ea-25e9d288b87d could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:59:10.046104 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6f310cd9-0795-486c-8215-03e9db3b02ab tempest-ServerRescueNegativeTestJSON-550439393 tempest-ServerRescueNegativeTestJSON-550439393-project] 10.222.0.27 "GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d" status: 404 len: 111 microversion: 2.1 time: 0.112297 Oct 11 19:59:10.049744 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1861/3803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:09 2022] GET /compute/v2.1/servers/0ac52ec7-a881-454c-89ea-25e9d288b87d => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:59:10.069700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0a21930-1287-42ae-81dd-267c42bc048d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:10.083524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e0a21930-1287-42ae-81dd-267c42bc048d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:10.092481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0a21930-1287-42ae-81dd-267c42bc048d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:10.093300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0a21930-1287-42ae-81dd-267c42bc048d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:10.094116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0a21930-1287-42ae-81dd-267c42bc048d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:10.095192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0a21930-1287-42ae-81dd-267c42bc048d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:10.095910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0a21930-1287-42ae-81dd-267c42bc048d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:10.096651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0a21930-1287-42ae-81dd-267c42bc048d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:10.185573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:10.206493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:10.210438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:10.211702 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb50e809-6815-47d6-8bfa-a31fd6393ba7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1278 microversion: 2.20 time: 0.635226 Oct 11 19:59:10.214389 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1943/3804] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:09 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1278 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 19:59:10.221284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9884d4dd-f7f1-4f98-bb13-20996289f6b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cca504c0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:10.361593 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9884d4dd-f7f1-4f98-bb13-20996289f6b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.145005 Oct 11 19:59:10.372254 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1944/3805] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:10 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:10.557749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3e7433bf-55d3-45af-a403-2e5a2f404f5f tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:10.558377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3e7433bf-55d3-45af-a403-2e5a2f404f5f tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:10.570614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7433bf-55d3-45af-a403-2e5a2f404f5f tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:10.571489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7433bf-55d3-45af-a403-2e5a2f404f5f tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:10.572178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7433bf-55d3-45af-a403-2e5a2f404f5f tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:10.573137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7433bf-55d3-45af-a403-2e5a2f404f5f tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:10.574150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7433bf-55d3-45af-a403-2e5a2f404f5f tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:10.574915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7433bf-55d3-45af-a403-2e5a2f404f5f tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:11.786785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e0a21930-1287-42ae-81dd-267c42bc048d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:11.796050 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e0a21930-1287-42ae-81dd-267c42bc048d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1665 microversion: 2.1 time: 1.745172 Oct 11 19:59:11.803035 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1862/3806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:10 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1665 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:11.825566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:11.826290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:11.845577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:11.846003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:11.846437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:11.847180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:11.863434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:11.864304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:11.917558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3e7433bf-55d3-45af-a403-2e5a2f404f5f tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:11.933147 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3e7433bf-55d3-45af-a403-2e5a2f404f5f tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1395 microversion: 2.1 time: 1.377640 Oct 11 19:59:11.934312 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1945/3807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:10 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1395 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:11.948680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b8869371-b164-4fa2-963d-64434c15c640 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83ccca6790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:12.018970 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b8869371-b164-4fa2-963d-64434c15c640 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.079394 Oct 11 19:59:12.019561 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1946/3808] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:11 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:12.058363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:12.071504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:12.079034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:12.079034 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b5cc4fa-5e5b-479b-97d6-4c2ebbc5c91e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1340 microversion: 2.20 time: 0.273246 Oct 11 19:59:12.079034 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1863/3809] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:11 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1340 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:12.827091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f8613270-548f-4dd4-bf0a-0c8905b177b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:12.827725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f8613270-548f-4dd4-bf0a-0c8905b177b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:12.842164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8613270-548f-4dd4-bf0a-0c8905b177b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:12.843031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8613270-548f-4dd4-bf0a-0c8905b177b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:12.844874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8613270-548f-4dd4-bf0a-0c8905b177b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:12.846068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8613270-548f-4dd4-bf0a-0c8905b177b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:12.847575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8613270-548f-4dd4-bf0a-0c8905b177b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:12.848839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8613270-548f-4dd4-bf0a-0c8905b177b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:12.962877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-618801ab-6d7b-4917-9823-8ce8c96318f2 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:12.964578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-618801ab-6d7b-4917-9823-8ce8c96318f2 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:12.987460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618801ab-6d7b-4917-9823-8ce8c96318f2 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:12.988247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618801ab-6d7b-4917-9823-8ce8c96318f2 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:12.988898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618801ab-6d7b-4917-9823-8ce8c96318f2 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:12.989804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618801ab-6d7b-4917-9823-8ce8c96318f2 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:12.990453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618801ab-6d7b-4917-9823-8ce8c96318f2 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:12.991074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-618801ab-6d7b-4917-9823-8ce8c96318f2 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:13.619216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-618801ab-6d7b-4917-9823-8ce8c96318f2 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:13.632311 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-618801ab-6d7b-4917-9823-8ce8c96318f2 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1395 microversion: 2.1 time: 0.673792 Oct 11 19:59:13.633602 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1864/3810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:12 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1395 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:13.646157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c6a1ffbb-d9f0-4c2c-8400-5c5de76a5056 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c7248f70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:13.709948 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c6a1ffbb-d9f0-4c2c-8400-5c5de76a5056 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.075000 Oct 11 19:59:13.731903 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1865/3811] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:13 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:13.737663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:13.738291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:13.764637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:13.765145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:13.765717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:13.766618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:13.767175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:13.767892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:13.834928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f8613270-548f-4dd4-bf0a-0c8905b177b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:13.846557 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f8613270-548f-4dd4-bf0a-0c8905b177b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1665 microversion: 2.1 time: 1.025127 Oct 11 19:59:13.847171 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1947/3812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:12 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1665 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:14.059826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:14.103389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:14.126436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:14.131226 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5c77e7ed-e6e6-449b-a96f-85f032599889 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1340 microversion: 2.20 time: 0.396942 Oct 11 19:59:14.133807 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1866/3813] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:13 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1340 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:14.669283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ade742e-a080-483e-8010-0a2b130dfc0b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:14.669911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ade742e-a080-483e-8010-0a2b130dfc0b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:14.672555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:14.696594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade742e-a080-483e-8010-0a2b130dfc0b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:14.697601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade742e-a080-483e-8010-0a2b130dfc0b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:14.699312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade742e-a080-483e-8010-0a2b130dfc0b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:14.700337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade742e-a080-483e-8010-0a2b130dfc0b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:14.702174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade742e-a080-483e-8010-0a2b130dfc0b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:14.711689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ade742e-a080-483e-8010-0a2b130dfc0b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:14.728205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-27aa0368-8037-484b-bdd0-0d4c27407bd7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c721d310>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:14.809850 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-27aa0368-8037-484b-bdd0-0d4c27407bd7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.087720 Oct 11 19:59:14.810981 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1867/3814] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:14 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:14.879215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff18f963-f356-4a70-87d7-1ebfe014c22e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:14.885566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ff18f963-f356-4a70-87d7-1ebfe014c22e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:14.897561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff18f963-f356-4a70-87d7-1ebfe014c22e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:14.898559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff18f963-f356-4a70-87d7-1ebfe014c22e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:14.899245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff18f963-f356-4a70-87d7-1ebfe014c22e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:14.900456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff18f963-f356-4a70-87d7-1ebfe014c22e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:14.901259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff18f963-f356-4a70-87d7-1ebfe014c22e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:14.902668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff18f963-f356-4a70-87d7-1ebfe014c22e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:15.269847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8ade742e-a080-483e-8010-0a2b130dfc0b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:15.293432 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ade742e-a080-483e-8010-0a2b130dfc0b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1395 microversion: 2.1 time: 0.634362 Oct 11 19:59:15.295643 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1948/3815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:14 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1395 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:15.302772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:15.303756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:15.312329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:15.313528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:15.315855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:15.316848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:15.317569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:15.318659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:15.376346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ff18f963-f356-4a70-87d7-1ebfe014c22e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:15.415286 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ff18f963-f356-4a70-87d7-1ebfe014c22e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.545630 Oct 11 19:59:15.417485 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1868/3816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:14 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:15.447198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3fac190c-cb38-4b28-8aaa-81233bdbb1cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:15.448692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3fac190c-cb38-4b28-8aaa-81233bdbb1cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:15.456675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fac190c-cb38-4b28-8aaa-81233bdbb1cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:15.460129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fac190c-cb38-4b28-8aaa-81233bdbb1cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:15.461023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fac190c-cb38-4b28-8aaa-81233bdbb1cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:15.462015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fac190c-cb38-4b28-8aaa-81233bdbb1cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:15.462794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fac190c-cb38-4b28-8aaa-81233bdbb1cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:15.463435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fac190c-cb38-4b28-8aaa-81233bdbb1cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:16.780097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:16.789967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:16.794961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:16.799082 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5f6a824f-1798-4136-a3e6-2de6859041a3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1408 microversion: 2.20 time: 1.501998 Oct 11 19:59:16.802925 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1949/3817] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:15 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1408 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:16.812723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-546c551b-50af-46fe-8479-4defbcdc99b5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83ccca6c10>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:16.882922 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-546c551b-50af-46fe-8479-4defbcdc99b5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.078499 Oct 11 19:59:16.892363 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1950/3818] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:16 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:16.898616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3d1b4738-834e-4757-bdd3-f8d6cd1510e9 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:16.899591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3d1b4738-834e-4757-bdd3-f8d6cd1510e9 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:16.906884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d1b4738-834e-4757-bdd3-f8d6cd1510e9 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:16.907818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d1b4738-834e-4757-bdd3-f8d6cd1510e9 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:16.908521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d1b4738-834e-4757-bdd3-f8d6cd1510e9 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:16.909502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d1b4738-834e-4757-bdd3-f8d6cd1510e9 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:16.910250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d1b4738-834e-4757-bdd3-f8d6cd1510e9 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:16.911003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d1b4738-834e-4757-bdd3-f8d6cd1510e9 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:17.318773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3fac190c-cb38-4b28-8aaa-81233bdbb1cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:17.349593 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3fac190c-cb38-4b28-8aaa-81233bdbb1cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 1.905355 Oct 11 19:59:17.368063 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1869/3819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:15 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:17.397664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-29cce1e7-e208-4b4f-8640-a94f483f4c2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:17.405337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-29cce1e7-e208-4b4f-8640-a94f483f4c2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:17.434770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29cce1e7-e208-4b4f-8640-a94f483f4c2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:17.439419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29cce1e7-e208-4b4f-8640-a94f483f4c2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:17.440193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29cce1e7-e208-4b4f-8640-a94f483f4c2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:17.447314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29cce1e7-e208-4b4f-8640-a94f483f4c2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:17.448243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29cce1e7-e208-4b4f-8640-a94f483f4c2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:17.449586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29cce1e7-e208-4b4f-8640-a94f483f4c2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:17.501768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3d1b4738-834e-4757-bdd3-f8d6cd1510e9 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:17.519446 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3d1b4738-834e-4757-bdd3-f8d6cd1510e9 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1395 microversion: 2.1 time: 0.625439 Oct 11 19:59:17.524603 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1951/3820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:16 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1395 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:17.608578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:17.657380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-29cce1e7-e208-4b4f-8640-a94f483f4c2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Unlocking {{(pid=126955) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 11 19:59:17.724349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:17.731600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=14 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:17.789444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-7f5906f8-165f-455c-8bb3-8b11138944f5 req-efaafaba-2cd8-4492-967a-9d9bec821640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1db038-aabe-417a-bb33-f7a83173e7ba", "tag": "303457d8-51f7-4eb4-97b1-f3880c440ba0"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:17.809246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7f5906f8-165f-455c-8bb3-8b11138944f5 req-efaafaba-2cd8-4492-967a-9d9bec821640 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:17.810133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7f5906f8-165f-455c-8bb3-8b11138944f5 req-efaafaba-2cd8-4492-967a-9d9bec821640 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:17.811237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7f5906f8-165f-455c-8bb3-8b11138944f5 req-efaafaba-2cd8-4492-967a-9d9bec821640 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:17.844644 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-7f5906f8-165f-455c-8bb3-8b11138944f5 req-efaafaba-2cd8-4492-967a-9d9bec821640 service nova] Creating event network-changed:303457d8-51f7-4eb4-97b1-f3880c440ba0 for instance 1e1db038-aabe-417a-bb33-f7a83173e7ba on n-h1-860864-3 Oct 11 19:59:17.853084 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-29cce1e7-e208-4b4f-8640-a94f483f4c2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.481566 Oct 11 19:59:17.856204 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-7f5906f8-165f-455c-8bb3-8b11138944f5 req-efaafaba-2cd8-4492-967a-9d9bec821640 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071426 Oct 11 19:59:17.860019 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1870/3821] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:59:17 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:59:17.865079 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1952/3822] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:17.869542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:17.871558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:17.878824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-02f604f5-4496-42e1-b914-969639e7260a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:17.884735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-02f604f5-4496-42e1-b914-969639e7260a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:17.895096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:17.897095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:17.898225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:17.899510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:17.901373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:17.902222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:17.911646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02f604f5-4496-42e1-b914-969639e7260a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:17.912178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02f604f5-4496-42e1-b914-969639e7260a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:17.917359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02f604f5-4496-42e1-b914-969639e7260a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:17.919828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02f604f5-4496-42e1-b914-969639e7260a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:17.926866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02f604f5-4496-42e1-b914-969639e7260a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:17.927359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02f604f5-4496-42e1-b914-969639e7260a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:18.535431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=14 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:18.629852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:18.637789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:18.640004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:18.640760 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-79e13510-e82a-43ba-9de4-e3b6d8341f59 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1408 microversion: 2.20 time: 0.779415 Oct 11 19:59:18.641369 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1871/3823] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:17 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1408 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:18.660230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-743b1ed0-a981-4294-a226-daccce851a66 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72eeb80>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:18.744081 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-743b1ed0-a981-4294-a226-daccce851a66 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.088193 Oct 11 19:59:18.748669 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1872/3824] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:18 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:18.756604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3891e48a-190a-4612-8992-9113d0fe4336 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:18.757479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3891e48a-190a-4612-8992-9113d0fe4336 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:18.767324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3891e48a-190a-4612-8992-9113d0fe4336 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:18.767324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3891e48a-190a-4612-8992-9113d0fe4336 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:18.767324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3891e48a-190a-4612-8992-9113d0fe4336 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:18.767324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3891e48a-190a-4612-8992-9113d0fe4336 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:18.767324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3891e48a-190a-4612-8992-9113d0fe4336 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:18.767324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3891e48a-190a-4612-8992-9113d0fe4336 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:18.957341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-02f604f5-4496-42e1-b914-969639e7260a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:18.981278 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-02f604f5-4496-42e1-b914-969639e7260a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 1.111373 Oct 11 19:59:18.989579 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1953/3825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:17 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:19.021081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-094a55df-35fa-41f7-92c7-8b653158b480 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:19.023562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-094a55df-35fa-41f7-92c7-8b653158b480 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:19.052124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a55df-35fa-41f7-92c7-8b653158b480 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:19.070834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a55df-35fa-41f7-92c7-8b653158b480 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:19.071441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a55df-35fa-41f7-92c7-8b653158b480 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:19.072225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a55df-35fa-41f7-92c7-8b653158b480 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:19.072712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a55df-35fa-41f7-92c7-8b653158b480 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:19.073152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a55df-35fa-41f7-92c7-8b653158b480 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:20.019312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3891e48a-190a-4612-8992-9113d0fe4336 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:20.029046 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3891e48a-190a-4612-8992-9113d0fe4336 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1395 microversion: 2.1 time: 1.279025 Oct 11 19:59:20.036572 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1873/3826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:18 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1395 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:20.072756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:20.075072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:20.101955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:20.105322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:20.106100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:20.111307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:20.113437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:20.115533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:20.420337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-094a55df-35fa-41f7-92c7-8b653158b480 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:20.447041 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-094a55df-35fa-41f7-92c7-8b653158b480 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 1.435388 Oct 11 19:59:20.465543 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1954/3827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:19 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:20.477075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c87e109-2205-4f5f-9a24-845e00db2ceb tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83d07f7f70>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:20.582844 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c87e109-2205-4f5f-9a24-845e00db2ceb tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.114135 Oct 11 19:59:20.586810 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1955/3828] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:20 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:20.601988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9531a5e7-22d8-4b6f-a39b-f0ba13d8ae4e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:20.606717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9531a5e7-22d8-4b6f-a39b-f0ba13d8ae4e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:20.631492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9531a5e7-22d8-4b6f-a39b-f0ba13d8ae4e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:20.633543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9531a5e7-22d8-4b6f-a39b-f0ba13d8ae4e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:20.634347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9531a5e7-22d8-4b6f-a39b-f0ba13d8ae4e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:20.648598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9531a5e7-22d8-4b6f-a39b-f0ba13d8ae4e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:20.649136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9531a5e7-22d8-4b6f-a39b-f0ba13d8ae4e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:20.653846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9531a5e7-22d8-4b6f-a39b-f0ba13d8ae4e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:21.066373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:21.108162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:21.117893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:21.119149 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7703584d-737a-445d-a1b1-530fb87901d5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1408 microversion: 2.20 time: 1.072755 Oct 11 19:59:21.150804 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1874/3829] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:20 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1408 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:21.169769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9f12b7dc-de2f-430f-b723-01496a439d42 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:21.170513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9f12b7dc-de2f-430f-b723-01496a439d42 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:21.203050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f12b7dc-de2f-430f-b723-01496a439d42 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:21.203050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f12b7dc-de2f-430f-b723-01496a439d42 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:21.203050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f12b7dc-de2f-430f-b723-01496a439d42 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:21.203050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f12b7dc-de2f-430f-b723-01496a439d42 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:21.203050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f12b7dc-de2f-430f-b723-01496a439d42 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:21.203050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f12b7dc-de2f-430f-b723-01496a439d42 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:21.526126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9531a5e7-22d8-4b6f-a39b-f0ba13d8ae4e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:21.556051 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9531a5e7-22d8-4b6f-a39b-f0ba13d8ae4e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.963016 Oct 11 19:59:21.556912 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1956/3830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:20 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:21.575876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4b3012c6-fe88-41c1-a485-264fffbfb64c req-872b4dc8-f823-41ff-8e26-53fa39436e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e65c53-e164-4255-a2b8-4338069b7e47", "tag": "f7bf35aa-741b-418c-92ae-e8af14cd5a52"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:21.608560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4b3012c6-fe88-41c1-a485-264fffbfb64c req-872b4dc8-f823-41ff-8e26-53fa39436e44 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:21.609765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4b3012c6-fe88-41c1-a485-264fffbfb64c req-872b4dc8-f823-41ff-8e26-53fa39436e44 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:21.611282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4b3012c6-fe88-41c1-a485-264fffbfb64c req-872b4dc8-f823-41ff-8e26-53fa39436e44 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:21.660274 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4b3012c6-fe88-41c1-a485-264fffbfb64c req-872b4dc8-f823-41ff-8e26-53fa39436e44 service nova] Creating event network-changed:f7bf35aa-741b-418c-92ae-e8af14cd5a52 for instance 34e65c53-e164-4255-a2b8-4338069b7e47 on n-h2-860864-3 Oct 11 19:59:21.681877 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4b3012c6-fe88-41c1-a485-264fffbfb64c req-872b4dc8-f823-41ff-8e26-53fa39436e44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123427 Oct 11 19:59:21.683081 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1957/3831] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:21.689030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eaa2085a-4c77-4c6a-b664-7adba01d8542 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:21.699912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eaa2085a-4c77-4c6a-b664-7adba01d8542 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:21.708955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaa2085a-4c77-4c6a-b664-7adba01d8542 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:21.709655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaa2085a-4c77-4c6a-b664-7adba01d8542 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:21.711068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaa2085a-4c77-4c6a-b664-7adba01d8542 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:21.724009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaa2085a-4c77-4c6a-b664-7adba01d8542 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:21.725054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaa2085a-4c77-4c6a-b664-7adba01d8542 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:21.726041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eaa2085a-4c77-4c6a-b664-7adba01d8542 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:21.841350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:21.880763 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eaa2085a-4c77-4c6a-b664-7adba01d8542 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.196115 Oct 11 19:59:21.881730 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1958/3832] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:59:21 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:59:21.889700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e699045-d6f9-40d2-b15a-ab1b1dddadc4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc4af430>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:22.006904 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e699045-d6f9-40d2-b15a-ab1b1dddadc4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1413 microversion: 2.1 time: 0.123636 Oct 11 19:59:22.007785 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1959/3833] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:21 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:22.020621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b15f696-5fe5-41dd-bfa5-eeaff204e379 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:22.021812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b15f696-5fe5-41dd-bfa5-eeaff204e379 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:22.036642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b15f696-5fe5-41dd-bfa5-eeaff204e379 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:22.042560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b15f696-5fe5-41dd-bfa5-eeaff204e379 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:22.043155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b15f696-5fe5-41dd-bfa5-eeaff204e379 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:22.044006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b15f696-5fe5-41dd-bfa5-eeaff204e379 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:22.044722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b15f696-5fe5-41dd-bfa5-eeaff204e379 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:22.045409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b15f696-5fe5-41dd-bfa5-eeaff204e379 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:22.574953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9f12b7dc-de2f-430f-b723-01496a439d42 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:22.599164 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9f12b7dc-de2f-430f-b723-01496a439d42 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1395 microversion: 2.1 time: 1.439755 Oct 11 19:59:22.600116 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1875/3834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:21 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1395 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:22.615544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:22.616432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:22.630716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:22.631178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:22.631629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:22.632343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:22.632803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:22.633231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:22.816399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b15f696-5fe5-41dd-bfa5-eeaff204e379 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:22.829587 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b15f696-5fe5-41dd-bfa5-eeaff204e379 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1674 microversion: 2.1 time: 0.813814 Oct 11 19:59:22.834782 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1960/3835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:22 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1674 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:23.024517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc0a59aa-5d9a-4322-a77f-ea3f4d6cca25 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c7444790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:23.111220 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc0a59aa-5d9a-4322-a77f-ea3f4d6cca25 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1422 microversion: 2.1 time: 0.091324 Oct 11 19:59:23.112089 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1961/3836] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:23 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:23.127395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4692d6cd-a99f-433a-9dea-8788df5ff046 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc4d6b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:23.201553 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4692d6cd-a99f-433a-9dea-8788df5ff046 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 200 len: 1422 microversion: 2.1 time: 0.079359 Oct 11 19:59:23.211891 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1962/3837] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 19:59:23 2022] GET /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:23.216820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-caa1619a-a62c-4134-af3c-1f647285d960 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83d07a3940>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:23.650376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:23.665053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:23.680287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:23.684676 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-68e84b6d-9cdb-4c5e-a14b-53590f100e8f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1408 microversion: 2.20 time: 1.080796 Oct 11 19:59:23.685689 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1876/3838] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:22 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1408 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:23.709870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6ffff684-3cb4-4297-bb2f-f667bea74fb0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:23.710373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6ffff684-3cb4-4297-bb2f-f667bea74fb0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:23.724233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ffff684-3cb4-4297-bb2f-f667bea74fb0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:23.729712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ffff684-3cb4-4297-bb2f-f667bea74fb0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:23.731104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ffff684-3cb4-4297-bb2f-f667bea74fb0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:23.732031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ffff684-3cb4-4297-bb2f-f667bea74fb0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:23.732661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ffff684-3cb4-4297-bb2f-f667bea74fb0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:23.733284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ffff684-3cb4-4297-bb2f-f667bea74fb0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:24.416947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6ffff684-3cb4-4297-bb2f-f667bea74fb0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:24.444683 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6ffff684-3cb4-4297-bb2f-f667bea74fb0 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1395 microversion: 2.1 time: 0.754733 Oct 11 19:59:24.453301 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1877/3839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:23 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1395 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:24.487413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bca7cb64-07f5-4ba4-938f-15b02ce5119b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:24.488612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bca7cb64-07f5-4ba4-938f-15b02ce5119b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:24.507282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bca7cb64-07f5-4ba4-938f-15b02ce5119b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:24.508185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bca7cb64-07f5-4ba4-938f-15b02ce5119b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:24.512527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bca7cb64-07f5-4ba4-938f-15b02ce5119b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:24.516772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bca7cb64-07f5-4ba4-938f-15b02ce5119b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:24.517904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bca7cb64-07f5-4ba4-938f-15b02ce5119b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:24.518918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bca7cb64-07f5-4ba4-938f-15b02ce5119b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:24.542243 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-caa1619a-a62c-4134-af3c-1f647285d960 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 204 len: 0 microversion: 2.1 time: 1.328999 Oct 11 19:59:24.543748 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1963/3840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:23 2022] DELETE /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 0 bytes in 1331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:59:24.554461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d95a012d-6cd0-4f11-804f-21d7f23f3a00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:24.555923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d95a012d-6cd0-4f11-804f-21d7f23f3a00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:24.566843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d95a012d-6cd0-4f11-804f-21d7f23f3a00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:24.567825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d95a012d-6cd0-4f11-804f-21d7f23f3a00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:24.568532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d95a012d-6cd0-4f11-804f-21d7f23f3a00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:24.569542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d95a012d-6cd0-4f11-804f-21d7f23f3a00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:24.570268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d95a012d-6cd0-4f11-804f-21d7f23f3a00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:24.570976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d95a012d-6cd0-4f11-804f-21d7f23f3a00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:24.605498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d95a012d-6cd0-4f11-804f-21d7f23f3a00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:59:24.759188 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d95a012d-6cd0-4f11-804f-21d7f23f3a00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 204 len: 0 microversion: 2.1 time: 0.209554 Oct 11 19:59:24.760898 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1964/3841] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:59:24 2022] DELETE /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 19:59:24.769222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:24.770598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:24.777987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:24.778885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:24.779580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:24.783082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:24.784220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:24.784897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:25.470260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bca7cb64-07f5-4ba4-938f-15b02ce5119b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:25.480961 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bca7cb64-07f5-4ba4-938f-15b02ce5119b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1654 microversion: 2.1 time: 1.025942 Oct 11 19:59:25.481785 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1878/3842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:24 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1654 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:25.491376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-05fe24c9-aca2-46b5-ba83-5ec50ab5641f req-45b23cdd-24a2-472f-afb3-d1eeab2cec7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1db038-aabe-417a-bb33-f7a83173e7ba", "name": "network-vif-plugged", "status": "completed", "tag": "303457d8-51f7-4eb4-97b1-f3880c440ba0"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:25.495320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:25.505068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:25.506013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-05fe24c9-aca2-46b5-ba83-5ec50ab5641f req-45b23cdd-24a2-472f-afb3-d1eeab2cec7e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:25.506546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:25.506747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-05fe24c9-aca2-46b5-ba83-5ec50ab5641f req-45b23cdd-24a2-472f-afb3-d1eeab2cec7e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:25.507377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-05fe24c9-aca2-46b5-ba83-5ec50ab5641f req-45b23cdd-24a2-472f-afb3-d1eeab2cec7e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:25.507668 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5e616f4-1f49-4fa9-912e-fc9d2811ac29 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1408 microversion: 2.20 time: 0.745332 Oct 11 19:59:25.511523 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1965/3843] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:24 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1408 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:25.521745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-774554567", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "95e3b674-0b5e-40c7-945c-485aa05d6c41"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:25.539149 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-05fe24c9-aca2-46b5-ba83-5ec50ab5641f req-45b23cdd-24a2-472f-afb3-d1eeab2cec7e service nova] Creating event network-vif-plugged:303457d8-51f7-4eb4-97b1-f3880c440ba0 for instance 1e1db038-aabe-417a-bb33-f7a83173e7ba on n-h1-860864-3 Oct 11 19:59:25.544610 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-05fe24c9-aca2-46b5-ba83-5ec50ab5641f req-45b23cdd-24a2-472f-afb3-d1eeab2cec7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061346 Oct 11 19:59:25.545394 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1879/3844] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:25.553782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3141afd5-1080-4140-833f-d05bc9fa829d tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:25.554837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3141afd5-1080-4140-833f-d05bc9fa829d tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:25.562560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3141afd5-1080-4140-833f-d05bc9fa829d tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:25.563614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3141afd5-1080-4140-833f-d05bc9fa829d tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:25.564278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3141afd5-1080-4140-833f-d05bc9fa829d tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:25.567111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3141afd5-1080-4140-833f-d05bc9fa829d tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:25.567810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3141afd5-1080-4140-833f-d05bc9fa829d tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:25.568441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3141afd5-1080-4140-833f-d05bc9fa829d tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:25.635239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] validate_networks() for [('95e3b674-0b5e-40c7-945c-485aa05d6c41', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:59:26.032418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3141afd5-1080-4140-833f-d05bc9fa829d tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:26.043539 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3141afd5-1080-4140-833f-d05bc9fa829d tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1395 microversion: 2.1 time: 0.496237 Oct 11 19:59:26.045412 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1880/3845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:25 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1395 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:26.050495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65f6f5f9-1d0e-47da-92ea-f4fd79aa684b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:26.051136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-65f6f5f9-1d0e-47da-92ea-f4fd79aa684b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:26.058080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f6f5f9-1d0e-47da-92ea-f4fd79aa684b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:26.059943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f6f5f9-1d0e-47da-92ea-f4fd79aa684b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:26.060728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f6f5f9-1d0e-47da-92ea-f4fd79aa684b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:26.062844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f6f5f9-1d0e-47da-92ea-f4fd79aa684b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:26.064190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f6f5f9-1d0e-47da-92ea-f4fd79aa684b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:26.065347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65f6f5f9-1d0e-47da-92ea-f4fd79aa684b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:26.194351 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-65f6f5f9-1d0e-47da-92ea-f4fd79aa684b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.147494 Oct 11 19:59:26.199132 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1881/3846] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:59:26 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:59:26.208370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f44e9db5-b0a0-440a-91b6-a3ae3f67e3cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:26.209457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f44e9db5-b0a0-440a-91b6-a3ae3f67e3cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:26.216681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44e9db5-b0a0-440a-91b6-a3ae3f67e3cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:26.217176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44e9db5-b0a0-440a-91b6-a3ae3f67e3cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:26.217620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44e9db5-b0a0-440a-91b6-a3ae3f67e3cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:26.218586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44e9db5-b0a0-440a-91b6-a3ae3f67e3cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:26.219491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44e9db5-b0a0-440a-91b6-a3ae3f67e3cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:26.219932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44e9db5-b0a0-440a-91b6-a3ae3f67e3cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:26.595661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f44e9db5-b0a0-440a-91b6-a3ae3f67e3cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:26.604776 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f44e9db5-b0a0-440a-91b6-a3ae3f67e3cd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1661 microversion: 2.1 time: 0.403230 Oct 11 19:59:26.619046 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1882/3847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:26 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1661 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:26.627688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:26.628269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:26.634641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:26.635451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:26.636125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:26.637370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:26.638040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:26.638919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:26.705916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:59:26.706562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:59:26.706903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:59:26.707241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:59:26.707653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:59:26.721938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:26.722880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:26.726671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:26.727688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:26.728164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:26.728599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:26.750466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Getting quotas for project 9d1efaec3c7640d684256bc6460e7559. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:59:26.762344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Getting quotas for user bfddbe97757446b58c605f5f6f64500c and project 9d1efaec3c7640d684256bc6460e7559. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:59:26.784183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:59:26.787705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:59:26.879966 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2173ff0c-b0eb-4e9c-997f-d1abfc1a5c8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.366881 Oct 11 19:59:26.881246 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1966/3848] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:59:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:59:26.893816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-896a1c56-ba5d-42c8-a3f3-118fedc50f4e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:26.895295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-896a1c56-ba5d-42c8-a3f3-118fedc50f4e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:26.997831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:27.003774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-896a1c56-ba5d-42c8-a3f3-118fedc50f4e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:27.009139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:27.014377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:27.020496 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-79cc0e21-ae2c-4ac3-ac62-8630e5cee95e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1408 microversion: 2.20 time: 0.399867 Oct 11 19:59:27.021157 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-896a1c56-ba5d-42c8-a3f3-118fedc50f4e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1207 microversion: 2.1 time: 0.129528 Oct 11 19:59:27.023373 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1883/3849] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:26 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1408 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:27.023857 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1967/3850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:26 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1207 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:27.072607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c9567335-3730-402b-babd-956eafc70ef8 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:27.073385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c9567335-3730-402b-babd-956eafc70ef8 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:27.086783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9567335-3730-402b-babd-956eafc70ef8 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:27.087394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9567335-3730-402b-babd-956eafc70ef8 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:27.088619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9567335-3730-402b-babd-956eafc70ef8 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:27.089984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9567335-3730-402b-babd-956eafc70ef8 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:27.091579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9567335-3730-402b-babd-956eafc70ef8 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:27.092128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c9567335-3730-402b-babd-956eafc70ef8 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:27.540608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c9567335-3730-402b-babd-956eafc70ef8 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:27.553691 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c9567335-3730-402b-babd-956eafc70ef8 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1395 microversion: 2.1 time: 0.485127 Oct 11 19:59:27.569810 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1884/3851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:27 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1395 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:27.644914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-931343ef-bafe-4b5e-ad21-6c9731269238 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:27.645506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-931343ef-bafe-4b5e-ad21-6c9731269238 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:27.667415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-931343ef-bafe-4b5e-ad21-6c9731269238 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:27.669501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-931343ef-bafe-4b5e-ad21-6c9731269238 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:27.670222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-931343ef-bafe-4b5e-ad21-6c9731269238 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:27.686058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-931343ef-bafe-4b5e-ad21-6c9731269238 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:27.688410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-931343ef-bafe-4b5e-ad21-6c9731269238 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:27.691870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-931343ef-bafe-4b5e-ad21-6c9731269238 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:27.911600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1072f9ba-5d93-4ed0-9076-fd2cdbb9582e req-ec813989-5225-47d0-801f-b324b649c63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392dfdc2-0385-4e3b-8afb-b26d4d9d7192", "name": "network-vif-deleted", "tag": "64639c79-3542-45ee-b629-e0e30cd6fb75"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:27.939330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1072f9ba-5d93-4ed0-9076-fd2cdbb9582e req-ec813989-5225-47d0-801f-b324b649c63c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:27.939910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1072f9ba-5d93-4ed0-9076-fd2cdbb9582e req-ec813989-5225-47d0-801f-b324b649c63c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:27.940347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1072f9ba-5d93-4ed0-9076-fd2cdbb9582e req-ec813989-5225-47d0-801f-b324b649c63c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:27.954869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-931343ef-bafe-4b5e-ad21-6c9731269238 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:27.966286 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-931343ef-bafe-4b5e-ad21-6c9731269238 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.336845 Oct 11 19:59:27.967609 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1968/3852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:27 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:27.996086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e1f99d5-de68-4df3-9647-969d5aaa997b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:27.996709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e1f99d5-de68-4df3-9647-969d5aaa997b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:28.000240 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1072f9ba-5d93-4ed0-9076-fd2cdbb9582e req-ec813989-5225-47d0-801f-b324b649c63c service nova] Creating event network-vif-deleted:64639c79-3542-45ee-b629-e0e30cd6fb75 for instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 on n-h2-860864-3 Oct 11 19:59:28.008505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e1f99d5-de68-4df3-9647-969d5aaa997b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:28.009075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e1f99d5-de68-4df3-9647-969d5aaa997b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:28.009568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e1f99d5-de68-4df3-9647-969d5aaa997b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:28.010793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e1f99d5-de68-4df3-9647-969d5aaa997b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:28.011478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e1f99d5-de68-4df3-9647-969d5aaa997b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:28.012563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e1f99d5-de68-4df3-9647-969d5aaa997b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:28.017391 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1072f9ba-5d93-4ed0-9076-fd2cdbb9582e req-ec813989-5225-47d0-801f-b324b649c63c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101203 Oct 11 19:59:28.023626 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1885/3853] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:28.056437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e324b06-dddb-4b8d-a26e-181e977c39f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:28.057748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e324b06-dddb-4b8d-a26e-181e977c39f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:28.092871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e324b06-dddb-4b8d-a26e-181e977c39f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:28.095758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e324b06-dddb-4b8d-a26e-181e977c39f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:28.096429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e324b06-dddb-4b8d-a26e-181e977c39f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:28.099288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e324b06-dddb-4b8d-a26e-181e977c39f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:28.101499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e324b06-dddb-4b8d-a26e-181e977c39f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:28.102147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e324b06-dddb-4b8d-a26e-181e977c39f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:28.716366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2e324b06-dddb-4b8d-a26e-181e977c39f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:28.740706 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2e324b06-dddb-4b8d-a26e-181e977c39f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1259 microversion: 2.1 time: 0.695404 Oct 11 19:59:28.741312 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1886/3854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:28 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1259 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:28.762213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:28.763081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:28.770909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:28.771711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:28.772348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:28.773236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:28.773860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:28.774458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:28.779873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:28.998461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e1f99d5-de68-4df3-9647-969d5aaa997b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:29.010755 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e1f99d5-de68-4df3-9647-969d5aaa997b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 1.022456 Oct 11 19:59:29.011874 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1969/3855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:27 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:29.019845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ff5680b-e899-4dfa-95ad-2f02673f7ed6 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:29.021452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0ff5680b-e899-4dfa-95ad-2f02673f7ed6 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:29.037773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ff5680b-e899-4dfa-95ad-2f02673f7ed6 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.038893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ff5680b-e899-4dfa-95ad-2f02673f7ed6 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.039392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ff5680b-e899-4dfa-95ad-2f02673f7ed6 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.040257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ff5680b-e899-4dfa-95ad-2f02673f7ed6 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.040728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ff5680b-e899-4dfa-95ad-2f02673f7ed6 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.041351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ff5680b-e899-4dfa-95ad-2f02673f7ed6 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.179683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:29.197993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:29.200258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:29.201733 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f14ab9ba-6f7a-4418-a718-3ddc198afd36 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1408 microversion: 2.20 time: 0.446018 Oct 11 19:59:29.205238 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1887/3856] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:28 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:29.212940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a549697b-7bf9-4f88-8eb5-243cfaac877c req-f61d4937-281b-4ed6-a6e3-aa676155f5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e65c53-e164-4255-a2b8-4338069b7e47", "name": "network-vif-plugged", "status": "completed", "tag": "f7bf35aa-741b-418c-92ae-e8af14cd5a52"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:29.226025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a549697b-7bf9-4f88-8eb5-243cfaac877c req-f61d4937-281b-4ed6-a6e3-aa676155f5aa service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.226925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a549697b-7bf9-4f88-8eb5-243cfaac877c req-f61d4937-281b-4ed6-a6e3-aa676155f5aa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.227607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a549697b-7bf9-4f88-8eb5-243cfaac877c req-f61d4937-281b-4ed6-a6e3-aa676155f5aa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.274433 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a549697b-7bf9-4f88-8eb5-243cfaac877c req-f61d4937-281b-4ed6-a6e3-aa676155f5aa service nova] Creating event network-vif-plugged:f7bf35aa-741b-418c-92ae-e8af14cd5a52 for instance 34e65c53-e164-4255-a2b8-4338069b7e47 on n-h2-860864-3 Oct 11 19:59:29.288670 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a549697b-7bf9-4f88-8eb5-243cfaac877c req-f61d4937-281b-4ed6-a6e3-aa676155f5aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078510 Oct 11 19:59:29.291733 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1888/3857] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:29.305303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-12a52a20-6075-4e48-b55c-46b655677b97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:29.306996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-12a52a20-6075-4e48-b55c-46b655677b97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:29.322961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a52a20-6075-4e48-b55c-46b655677b97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.324693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a52a20-6075-4e48-b55c-46b655677b97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.325408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a52a20-6075-4e48-b55c-46b655677b97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.326311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a52a20-6075-4e48-b55c-46b655677b97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.327048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a52a20-6075-4e48-b55c-46b655677b97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.328557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a52a20-6075-4e48-b55c-46b655677b97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.331606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0ff5680b-e899-4dfa-95ad-2f02673f7ed6 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:29.359901 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0ff5680b-e899-4dfa-95ad-2f02673f7ed6 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1576 microversion: 2.1 time: 0.346407 Oct 11 19:59:29.364538 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1970/3858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:29 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1576 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:29.393879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6eadfce8-7737-4d26-b3d1-5d49c210ba27 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:29.395549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6eadfce8-7737-4d26-b3d1-5d49c210ba27 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:29.402904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6eadfce8-7737-4d26-b3d1-5d49c210ba27 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.404046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6eadfce8-7737-4d26-b3d1-5d49c210ba27 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.404810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6eadfce8-7737-4d26-b3d1-5d49c210ba27 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.406029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6eadfce8-7737-4d26-b3d1-5d49c210ba27 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.406891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6eadfce8-7737-4d26-b3d1-5d49c210ba27 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.407585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6eadfce8-7737-4d26-b3d1-5d49c210ba27 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.442371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6eadfce8-7737-4d26-b3d1-5d49c210ba27 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 19:59:29.570951 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6eadfce8-7737-4d26-b3d1-5d49c210ba27 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 204 len: 0 microversion: 2.1 time: 0.204483 Oct 11 19:59:29.571251 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1971/3859] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 19:59:29 2022] DELETE /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 19:59:29.591288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a06258d1-001c-4f90-b941-6f7180864767 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:29.592237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a06258d1-001c-4f90-b941-6f7180864767 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:29.598755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a06258d1-001c-4f90-b941-6f7180864767 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.599051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a06258d1-001c-4f90-b941-6f7180864767 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.599488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a06258d1-001c-4f90-b941-6f7180864767 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.600184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a06258d1-001c-4f90-b941-6f7180864767 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.600635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a06258d1-001c-4f90-b941-6f7180864767 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.601179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a06258d1-001c-4f90-b941-6f7180864767 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.714969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-12a52a20-6075-4e48-b55c-46b655677b97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:29.728734 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-12a52a20-6075-4e48-b55c-46b655677b97 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.431997 Oct 11 19:59:29.729841 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1889/3860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:29 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:29.735009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-57d324b5-cbb8-44f0-ac51-cc0a87857e90 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:29.736081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-57d324b5-cbb8-44f0-ac51-cc0a87857e90 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:29.742874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57d324b5-cbb8-44f0-ac51-cc0a87857e90 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.744330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57d324b5-cbb8-44f0-ac51-cc0a87857e90 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.744330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57d324b5-cbb8-44f0-ac51-cc0a87857e90 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.745279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57d324b5-cbb8-44f0-ac51-cc0a87857e90 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.746116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57d324b5-cbb8-44f0-ac51-cc0a87857e90 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.746957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57d324b5-cbb8-44f0-ac51-cc0a87857e90 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.824731 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a06258d1-001c-4f90-b941-6f7180864767 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.247689 Oct 11 19:59:29.826318 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1972/3861] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 19:59:29 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba/os-interface => generated 285 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:29.832554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7e1d6a4-3e14-4c4a-8a3b-fa8f6fca3cdd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:29.833205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7e1d6a4-3e14-4c4a-8a3b-fa8f6fca3cdd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:29.868619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e1d6a4-3e14-4c4a-8a3b-fa8f6fca3cdd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.869129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e1d6a4-3e14-4c4a-8a3b-fa8f6fca3cdd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.872428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e1d6a4-3e14-4c4a-8a3b-fa8f6fca3cdd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:29.873190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e1d6a4-3e14-4c4a-8a3b-fa8f6fca3cdd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:29.873709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e1d6a4-3e14-4c4a-8a3b-fa8f6fca3cdd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:29.874776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7e1d6a4-3e14-4c4a-8a3b-fa8f6fca3cdd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:30.311274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-57d324b5-cbb8-44f0-ac51-cc0a87857e90 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:30.341284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b7e1d6a4-3e14-4c4a-8a3b-fa8f6fca3cdd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:30.352406 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-57d324b5-cbb8-44f0-ac51-cc0a87857e90 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1667 microversion: 2.1 time: 0.617700 Oct 11 19:59:30.363052 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7e1d6a4-3e14-4c4a-8a3b-fa8f6fca3cdd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.535338 Oct 11 19:59:30.364289 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1890/3862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:29 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1667 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:30.376925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fa9accb9-4a83-4b71-a6a1-db1bacbb9946 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:30.379146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fa9accb9-4a83-4b71-a6a1-db1bacbb9946 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:30.382606 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1973/3863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:29 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:30.391622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:30.392246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:30.392502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa9accb9-4a83-4b71-a6a1-db1bacbb9946 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:30.393212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa9accb9-4a83-4b71-a6a1-db1bacbb9946 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:30.393821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa9accb9-4a83-4b71-a6a1-db1bacbb9946 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:30.394488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa9accb9-4a83-4b71-a6a1-db1bacbb9946 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:30.396117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa9accb9-4a83-4b71-a6a1-db1bacbb9946 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:30.396270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fa9accb9-4a83-4b71-a6a1-db1bacbb9946 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:30.413314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:30.413817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:30.414258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:30.414994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:30.415452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:30.415881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:30.566959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fa9accb9-4a83-4b71-a6a1-db1bacbb9946 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:30.586144 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fa9accb9-4a83-4b71-a6a1-db1bacbb9946 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1265 microversion: 2.1 time: 0.218354 Oct 11 19:59:30.587068 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1891/3864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:30 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:30.601412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-690c6b1e-7794-443a-9edb-4f46619e066e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:30.602392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-690c6b1e-7794-443a-9edb-4f46619e066e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:30.608887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-690c6b1e-7794-443a-9edb-4f46619e066e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:30.609380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-690c6b1e-7794-443a-9edb-4f46619e066e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:30.609811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-690c6b1e-7794-443a-9edb-4f46619e066e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:30.610500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-690c6b1e-7794-443a-9edb-4f46619e066e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:30.610975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-690c6b1e-7794-443a-9edb-4f46619e066e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:30.611392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-690c6b1e-7794-443a-9edb-4f46619e066e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:30.834214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:30.850178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:30.853884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:30.856446 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-29dcf463-3ee1-4724-b77a-1acb94b1bb31 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1408 microversion: 2.20 time: 0.472737 Oct 11 19:59:30.875773 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1974/3865] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:30 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1408 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:31.039926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-690c6b1e-7794-443a-9edb-4f46619e066e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:31.059676 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-690c6b1e-7794-443a-9edb-4f46619e066e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.470486 Oct 11 19:59:31.060558 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1892/3866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:30 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:31.088130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d49df9cc-151f-4266-adc9-c5a70b4e2430 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:31.089077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d49df9cc-151f-4266-adc9-c5a70b4e2430 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:31.100727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d49df9cc-151f-4266-adc9-c5a70b4e2430 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:31.102502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d49df9cc-151f-4266-adc9-c5a70b4e2430 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:31.102996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d49df9cc-151f-4266-adc9-c5a70b4e2430 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:31.103761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d49df9cc-151f-4266-adc9-c5a70b4e2430 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:31.105006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d49df9cc-151f-4266-adc9-c5a70b4e2430 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:31.106556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d49df9cc-151f-4266-adc9-c5a70b4e2430 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:31.392766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5ee9e533-210e-4559-88d0-a7ac631dc474 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:31.393911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5ee9e533-210e-4559-88d0-a7ac631dc474 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:31.404070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ee9e533-210e-4559-88d0-a7ac631dc474 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:31.408923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ee9e533-210e-4559-88d0-a7ac631dc474 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:31.409604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ee9e533-210e-4559-88d0-a7ac631dc474 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:31.412729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ee9e533-210e-4559-88d0-a7ac631dc474 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:31.413513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ee9e533-210e-4559-88d0-a7ac631dc474 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:31.416050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ee9e533-210e-4559-88d0-a7ac631dc474 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:32.155949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d49df9cc-151f-4266-adc9-c5a70b4e2430 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:32.168209 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d49df9cc-151f-4266-adc9-c5a70b4e2430 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 1.084658 Oct 11 19:59:32.169772 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1975/3867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:31 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:32.186540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-554895bb-684d-4fc6-a22a-d919b3aa8700 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:32.189528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-554895bb-684d-4fc6-a22a-d919b3aa8700 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:32.213486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-554895bb-684d-4fc6-a22a-d919b3aa8700 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:32.214188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-554895bb-684d-4fc6-a22a-d919b3aa8700 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:32.215216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-554895bb-684d-4fc6-a22a-d919b3aa8700 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:32.216517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-554895bb-684d-4fc6-a22a-d919b3aa8700 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:32.217160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-554895bb-684d-4fc6-a22a-d919b3aa8700 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:32.218178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-554895bb-684d-4fc6-a22a-d919b3aa8700 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:32.373860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5ee9e533-210e-4559-88d0-a7ac631dc474 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:32.393676 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5ee9e533-210e-4559-88d0-a7ac631dc474 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1667 microversion: 2.1 time: 1.006975 Oct 11 19:59:32.425203 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1893/3868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:31 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1667 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:32.438090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:32.439462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:32.474137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:32.474821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:32.475296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:32.475978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:32.476417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:32.477051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:32.879025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-554895bb-684d-4fc6-a22a-d919b3aa8700 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:32.892552 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-554895bb-684d-4fc6-a22a-d919b3aa8700 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1307 microversion: 2.1 time: 0.720422 Oct 11 19:59:32.907331 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1976/3869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:32 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1307 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:33.029011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-50ba0e71-7ce4-4845-8f90-75e1a34e6737 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:33.029693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-50ba0e71-7ce4-4845-8f90-75e1a34e6737 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:33.040670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ba0e71-7ce4-4845-8f90-75e1a34e6737 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:33.041262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ba0e71-7ce4-4845-8f90-75e1a34e6737 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:33.041778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ba0e71-7ce4-4845-8f90-75e1a34e6737 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:33.045394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ba0e71-7ce4-4845-8f90-75e1a34e6737 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:33.046775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ba0e71-7ce4-4845-8f90-75e1a34e6737 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:33.047439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ba0e71-7ce4-4845-8f90-75e1a34e6737 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:33.063738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:33.093075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:33.110424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:33.120970 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1abef861-a77e-413f-a156-871807b0170f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1599 microversion: 2.20 time: 0.687065 Oct 11 19:59:33.121907 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1894/3870] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 19:59:32 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1599 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 19:59:33.128205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a98d4132-897e-4346-8929-6882c3e2a508 req-e2238f9c-d94e-44dc-baa8-69ca9b665592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1db038-aabe-417a-bb33-f7a83173e7ba", "tag": "303457d8-51f7-4eb4-97b1-f3880c440ba0"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:33.140946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a98d4132-897e-4346-8929-6882c3e2a508 req-e2238f9c-d94e-44dc-baa8-69ca9b665592 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:33.141843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a98d4132-897e-4346-8929-6882c3e2a508 req-e2238f9c-d94e-44dc-baa8-69ca9b665592 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:33.149735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a98d4132-897e-4346-8929-6882c3e2a508 req-e2238f9c-d94e-44dc-baa8-69ca9b665592 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:33.173502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a98d4132-897e-4346-8929-6882c3e2a508 req-e2238f9c-d94e-44dc-baa8-69ca9b665592 service nova] Creating event network-changed:303457d8-51f7-4eb4-97b1-f3880c440ba0 for instance 1e1db038-aabe-417a-bb33-f7a83173e7ba on n-h1-860864-3 Oct 11 19:59:33.210745 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a98d4132-897e-4346-8929-6882c3e2a508 req-e2238f9c-d94e-44dc-baa8-69ca9b665592 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084090 Oct 11 19:59:33.214566 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1895/3871] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:33.232245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5373a35-814f-49d0-98ca-2ec87d0ce221 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:33.235194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c5373a35-814f-49d0-98ca-2ec87d0ce221 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:33.262105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5373a35-814f-49d0-98ca-2ec87d0ce221 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:33.266221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5373a35-814f-49d0-98ca-2ec87d0ce221 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:33.266852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5373a35-814f-49d0-98ca-2ec87d0ce221 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:33.268029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5373a35-814f-49d0-98ca-2ec87d0ce221 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:33.269190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5373a35-814f-49d0-98ca-2ec87d0ce221 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:33.269763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5373a35-814f-49d0-98ca-2ec87d0ce221 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:33.706135 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c5373a35-814f-49d0-98ca-2ec87d0ce221 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.488024 Oct 11 19:59:33.714147 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1896/3872] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 11 19:59:33 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-interface => generated 284 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 19:59:33.719047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-bddb5fe9-3a68-43bc-9b1c-a79faf937775 req-4d093444-a1ee-4028-adf3-3c1c46f7eb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9003fd-01af-4756-9492-3a213041cdfd", "tag": "9588333b-d35f-44e4-99b7-e36269b187ad"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:33.745363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bddb5fe9-3a68-43bc-9b1c-a79faf937775 req-4d093444-a1ee-4028-adf3-3c1c46f7eb4c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:33.745856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bddb5fe9-3a68-43bc-9b1c-a79faf937775 req-4d093444-a1ee-4028-adf3-3c1c46f7eb4c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:33.746384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bddb5fe9-3a68-43bc-9b1c-a79faf937775 req-4d093444-a1ee-4028-adf3-3c1c46f7eb4c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:33.772494 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-bddb5fe9-3a68-43bc-9b1c-a79faf937775 req-4d093444-a1ee-4028-adf3-3c1c46f7eb4c service nova] Creating event network-changed:9588333b-d35f-44e4-99b7-e36269b187ad for instance bf9003fd-01af-4756-9492-3a213041cdfd on n-h2-860864-3 Oct 11 19:59:33.788417 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-bddb5fe9-3a68-43bc-9b1c-a79faf937775 req-4d093444-a1ee-4028-adf3-3c1c46f7eb4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072814 Oct 11 19:59:33.789048 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1897/3873] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:33.794308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f747563-80bf-4c4e-964b-ff5b43e28ec2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:33.799489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f747563-80bf-4c4e-964b-ff5b43e28ec2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:33.810195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f747563-80bf-4c4e-964b-ff5b43e28ec2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:33.820621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f747563-80bf-4c4e-964b-ff5b43e28ec2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:33.821367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f747563-80bf-4c4e-964b-ff5b43e28ec2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:33.822381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f747563-80bf-4c4e-964b-ff5b43e28ec2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:33.823047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f747563-80bf-4c4e-964b-ff5b43e28ec2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:33.823888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f747563-80bf-4c4e-964b-ff5b43e28ec2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:34.212160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2f747563-80bf-4c4e-964b-ff5b43e28ec2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:34.235095 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f747563-80bf-4c4e-964b-ff5b43e28ec2 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1600 microversion: 2.1 time: 0.440046 Oct 11 19:59:34.236812 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1898/3874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:33 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1600 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:34.246969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-16f3deba-df0e-4016-8c83-f7b0e2a7dae7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:34.247902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-16f3deba-df0e-4016-8c83-f7b0e2a7dae7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:34.270693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16f3deba-df0e-4016-8c83-f7b0e2a7dae7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:34.274189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16f3deba-df0e-4016-8c83-f7b0e2a7dae7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:34.279429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16f3deba-df0e-4016-8c83-f7b0e2a7dae7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:34.284063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16f3deba-df0e-4016-8c83-f7b0e2a7dae7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:34.285276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16f3deba-df0e-4016-8c83-f7b0e2a7dae7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:34.289423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16f3deba-df0e-4016-8c83-f7b0e2a7dae7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:34.599220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-50ba0e71-7ce4-4845-8f90-75e1a34e6737 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:34.603798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:34.617947 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-50ba0e71-7ce4-4845-8f90-75e1a34e6737 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1576 microversion: 2.1 time: 1.593068 Oct 11 19:59:34.619082 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1977/3875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:33 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1576 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:35.237564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-16f3deba-df0e-4016-8c83-f7b0e2a7dae7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:35.250479 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-16f3deba-df0e-4016-8c83-f7b0e2a7dae7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1307 microversion: 2.1 time: 1.012468 Oct 11 19:59:35.261337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e163d3c-0aa7-43fb-8426-447540949527 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:35.262140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e163d3c-0aa7-43fb-8426-447540949527 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:35.271089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e163d3c-0aa7-43fb-8426-447540949527 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:35.271590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e163d3c-0aa7-43fb-8426-447540949527 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:35.272034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e163d3c-0aa7-43fb-8426-447540949527 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:35.272864 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1899/3876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:34 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1307 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:35.281692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e163d3c-0aa7-43fb-8426-447540949527 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:35.282184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e163d3c-0aa7-43fb-8426-447540949527 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:35.282713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e163d3c-0aa7-43fb-8426-447540949527 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:35.556427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e163d3c-0aa7-43fb-8426-447540949527 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:35.566662 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e163d3c-0aa7-43fb-8426-447540949527 tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1600 microversion: 2.1 time: 0.309091 Oct 11 19:59:35.573053 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1978/3877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:35 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1600 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:35.765339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5584c25f-996f-4fba-a7a2-49ac62ccd857 req-1201ce21-17ff-45ef-8e4d-e80b7e496e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3244b84-dd0d-485c-97c1-36a525a95e19", "name": "network-vif-deleted", "tag": "7491365b-e5b5-4dd6-988e-21683fa0a559"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:35.781847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5584c25f-996f-4fba-a7a2-49ac62ccd857 req-1201ce21-17ff-45ef-8e4d-e80b7e496e58 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:35.783427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5584c25f-996f-4fba-a7a2-49ac62ccd857 req-1201ce21-17ff-45ef-8e4d-e80b7e496e58 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:35.784075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5584c25f-996f-4fba-a7a2-49ac62ccd857 req-1201ce21-17ff-45ef-8e4d-e80b7e496e58 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:35.831767 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5584c25f-996f-4fba-a7a2-49ac62ccd857 req-1201ce21-17ff-45ef-8e4d-e80b7e496e58 service nova] Creating event network-vif-deleted:7491365b-e5b5-4dd6-988e-21683fa0a559 for instance c3244b84-dd0d-485c-97c1-36a525a95e19 on n-h2-860864-3 Oct 11 19:59:35.837975 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5584c25f-996f-4fba-a7a2-49ac62ccd857 req-1201ce21-17ff-45ef-8e4d-e80b7e496e58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076237 Oct 11 19:59:35.839223 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1900/3878] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:36.301261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0342b28b-153c-4a0e-882d-cb8034ff754e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:36.301886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0342b28b-153c-4a0e-882d-cb8034ff754e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:36.316671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0342b28b-153c-4a0e-882d-cb8034ff754e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:36.321629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0342b28b-153c-4a0e-882d-cb8034ff754e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:36.325844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0342b28b-153c-4a0e-882d-cb8034ff754e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:36.326860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0342b28b-153c-4a0e-882d-cb8034ff754e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:36.327759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0342b28b-153c-4a0e-882d-cb8034ff754e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:36.328341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0342b28b-153c-4a0e-882d-cb8034ff754e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:36.599108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:36.599827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:36.614372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:36.614902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:36.615354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:36.616084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:36.616549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:36.616980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:36.712412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:36.721405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:36.721892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:36.722373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lazy-loading 'fault' on Instance uuid c3244b84-dd0d-485c-97c1-36a525a95e19 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 19:59:36.736519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:37.015976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:37.106263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2160cb11ec4591b301d4b518f06169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63b32c07e704b3a895d2427ef38a5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:37.119462 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a512cc5c-32fd-4bd7-919d-1a39aed32cac tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 200 len: 1316 microversion: 2.1 time: 0.524721 Oct 11 19:59:37.120858 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1901/3879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:36 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:37.243192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0342b28b-153c-4a0e-882d-cb8034ff754e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:37.283446 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0342b28b-153c-4a0e-882d-cb8034ff754e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1307 microversion: 2.1 time: 0.983812 Oct 11 19:59:37.300738 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1979/3880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:36 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1307 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:38.145301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:38.146410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] [instance: c3244b84-dd0d-485c-97c1-36a525a95e19] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:38.168122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:38.179009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:38.182864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:38.184708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:38.185684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:38.191323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:38.195775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:38.225132 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] HTTP exception thrown: Instance c3244b84-dd0d-485c-97c1-36a525a95e19 could not be found. Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Request method failure captured: Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 HTTP/1.1 Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcrTWXe2gRUZzjotVnWLDbyJfhKzUON2oDmySk0bfZjFXPWU0REcjkmRXS52IdJx2lOM-0Z2Wq2WShxXOvDsLpaQQ3S6rLQTzlaX04fecbOVF5MdbZWbGTZT73ejXK9ryE0KBveU1UtNLYy4B3EqBDLkeP7i1d8Hb7sIYGh5smeMxTI Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f63b32c07e704b3a895d2427ef38a5c3 Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestFqdnHostnames-1407959363 Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f63b32c07e704b3a895d2427ef38a5c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f63b32c07e704b3a895d2427ef38a5c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f63b32c07e704b3a895d2427ef38a5c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f63b32c07e704b3a895d2427ef38a5c3"}]}] Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestFqdnHostnames-1407959363 Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f63b32c07e704b3a895d2427ef38a5c3 Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1407959363 Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestFqdnHostnames-1407959363-project Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 0c2160cb11ec4591b301d4b518f06169 Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestFqdnHostnames-1407959363-project Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance c3244b84-dd0d-485c-97c1-36a525a95e19 could not be found. Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'c3244b84-dd0d-485c-97c1-36a525a95e19'} Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3244b84-dd0d-485c-97c1-36a525a95e19 could not be found. Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3244b84-dd0d-485c-97c1-36a525a95e19 could not be found. Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 19:59:38.229259 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:59:38.232313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 19:59:38.232313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 19:59:38.232313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 19:59:38.232313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 19:59:38.232313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 19:59:38.232313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3244b84-dd0d-485c-97c1-36a525a95e19 could not be found. Oct 11 19:59:38.232313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 19:59:38.236979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Returning 404 to user: Instance c3244b84-dd0d-485c-97c1-36a525a95e19 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 19:59:38.238772 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b3b117e-09cf-46e9-9e87-267e2abb61cc tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19" status: 404 len: 111 microversion: 2.1 time: 0.097662 Oct 11 19:59:38.240185 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1902/3881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:38 2022] GET /compute/v2.1/servers/c3244b84-dd0d-485c-97c1-36a525a95e19 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 19:59:38.251315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e8ce2941-7367-41bc-857a-0e2c235962fe tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] Calling method '.version_select at 0x7f83cc668b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:38.282947 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e8ce2941-7367-41bc-857a-0e2c235962fe tempest-ServersTestFqdnHostnames-1407959363 tempest-ServersTestFqdnHostnames-1407959363-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631076610" status: 202 len: 0 microversion: 2.1 time: 0.037766 Oct 11 19:59:38.284019 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1980/3882] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 19:59:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631076610 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:59:38.328652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-24fc15d8-8227-4292-816f-a91849351162 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:38.331880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-24fc15d8-8227-4292-816f-a91849351162 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:38.347476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fc15d8-8227-4292-816f-a91849351162 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:38.348538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fc15d8-8227-4292-816f-a91849351162 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:38.349164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fc15d8-8227-4292-816f-a91849351162 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:38.350839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fc15d8-8227-4292-816f-a91849351162 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:38.351489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fc15d8-8227-4292-816f-a91849351162 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:38.352384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fc15d8-8227-4292-816f-a91849351162 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:38.575846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-89164d43-15a6-4da1-88d1-0a9ce695f8ca req-ec99309e-2b1c-43bb-82dd-7dff12dfe1eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e65c53-e164-4255-a2b8-4338069b7e47", "tag": "f7bf35aa-741b-418c-92ae-e8af14cd5a52"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:38.603140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-89164d43-15a6-4da1-88d1-0a9ce695f8ca req-ec99309e-2b1c-43bb-82dd-7dff12dfe1eb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:38.605305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-89164d43-15a6-4da1-88d1-0a9ce695f8ca req-ec99309e-2b1c-43bb-82dd-7dff12dfe1eb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:38.605965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-89164d43-15a6-4da1-88d1-0a9ce695f8ca req-ec99309e-2b1c-43bb-82dd-7dff12dfe1eb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:38.633784 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-89164d43-15a6-4da1-88d1-0a9ce695f8ca req-ec99309e-2b1c-43bb-82dd-7dff12dfe1eb service nova] Creating event network-changed:f7bf35aa-741b-418c-92ae-e8af14cd5a52 for instance 34e65c53-e164-4255-a2b8-4338069b7e47 on n-h2-860864-3 Oct 11 19:59:38.656603 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-89164d43-15a6-4da1-88d1-0a9ce695f8ca req-ec99309e-2b1c-43bb-82dd-7dff12dfe1eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085343 Oct 11 19:59:38.659743 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1981/3883] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 19:59:39.103335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-24fc15d8-8227-4292-816f-a91849351162 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:39.115869 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-24fc15d8-8227-4292-816f-a91849351162 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1307 microversion: 2.1 time: 0.795611 Oct 11 19:59:39.117533 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1903/3884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:38 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1307 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:40.143201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1975795b-a6c8-45de-86aa-9cf6642f0cbc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:40.144879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1975795b-a6c8-45de-86aa-9cf6642f0cbc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:40.150680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:40.164007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1975795b-a6c8-45de-86aa-9cf6642f0cbc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:40.171522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1975795b-a6c8-45de-86aa-9cf6642f0cbc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:40.172243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1975795b-a6c8-45de-86aa-9cf6642f0cbc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:40.173134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1975795b-a6c8-45de-86aa-9cf6642f0cbc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:40.173750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1975795b-a6c8-45de-86aa-9cf6642f0cbc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:40.174330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1975795b-a6c8-45de-86aa-9cf6642f0cbc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:40.516738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1975795b-a6c8-45de-86aa-9cf6642f0cbc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:40.527562 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1975795b-a6c8-45de-86aa-9cf6642f0cbc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1307 microversion: 2.1 time: 0.389713 Oct 11 19:59:40.550629 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1982/3885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:40 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:41.227540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1809283689", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "4bda9a14-e746-4951-9d43-234855a05a4d"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:41.349308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] validate_networks() for [('4bda9a14-e746-4951-9d43-234855a05a4d', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 19:59:41.503252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-08f0f086-5220-49f4-b1fc-78982265070d req-7432eb7e-9435-411e-8113-ae6efe068136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9003fd-01af-4756-9492-3a213041cdfd", "name": "network-vif-plugged", "status": "completed", "tag": "9588333b-d35f-44e4-99b7-e36269b187ad"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:41.535660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-08f0f086-5220-49f4-b1fc-78982265070d req-7432eb7e-9435-411e-8113-ae6efe068136 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:41.536166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-08f0f086-5220-49f4-b1fc-78982265070d req-7432eb7e-9435-411e-8113-ae6efe068136 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:41.536631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-08f0f086-5220-49f4-b1fc-78982265070d req-7432eb7e-9435-411e-8113-ae6efe068136 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:41.556772 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-08f0f086-5220-49f4-b1fc-78982265070d req-7432eb7e-9435-411e-8113-ae6efe068136 service nova] Creating event network-vif-plugged:9588333b-d35f-44e4-99b7-e36269b187ad for instance bf9003fd-01af-4756-9492-3a213041cdfd on n-h2-860864-3 Oct 11 19:59:41.564251 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-08f0f086-5220-49f4-b1fc-78982265070d req-7432eb7e-9435-411e-8113-ae6efe068136 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065935 Oct 11 19:59:41.565404 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1983/3886] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:41.579263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87c43d18-1db7-40a0-8bb9-3e921884a759 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:41.580559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-87c43d18-1db7-40a0-8bb9-3e921884a759 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:41.602956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87c43d18-1db7-40a0-8bb9-3e921884a759 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:41.612568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87c43d18-1db7-40a0-8bb9-3e921884a759 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:41.613027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87c43d18-1db7-40a0-8bb9-3e921884a759 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:41.613932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87c43d18-1db7-40a0-8bb9-3e921884a759 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:41.614482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87c43d18-1db7-40a0-8bb9-3e921884a759 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:41.614939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87c43d18-1db7-40a0-8bb9-3e921884a759 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:42.333246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-87c43d18-1db7-40a0-8bb9-3e921884a759 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:42.344035 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87c43d18-1db7-40a0-8bb9-3e921884a759 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1307 microversion: 2.1 time: 0.777265 Oct 11 19:59:42.348541 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1984/3887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:41 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1307 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:42.506136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 19:59:42.507464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 19:59:42.508566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 19:59:42.509026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 19:59:42.510078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 19:59:42.547838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:42.548453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:42.549076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:42.549909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:42.550370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:42.553276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:42.638275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:59:42.644912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for user a84c2531dcb24cce9872808db6c1fa6d and project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:59:42.659412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 19:59:42.662139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 19:59:42.733698 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b9167b7-3f9b-491b-bccc-3824545281f9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.894508 Oct 11 19:59:42.747853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d227c191-a2c4-4bf9-9507-65dae8eee935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:42.749179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d227c191-a2c4-4bf9-9507-65dae8eee935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:42.753973 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1904/3888] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 19:59:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 19:59:42.889023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d227c191-a2c4-4bf9-9507-65dae8eee935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:42.897884 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d227c191-a2c4-4bf9-9507-65dae8eee935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1193 microversion: 2.1 time: 0.154920 Oct 11 19:59:42.918737 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1985/3889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:42 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1193 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:43.376169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-42dc8ed8-671e-4713-8903-3a719c0c3501 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:43.380212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-42dc8ed8-671e-4713-8903-3a719c0c3501 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:43.404742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42dc8ed8-671e-4713-8903-3a719c0c3501 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:43.405887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42dc8ed8-671e-4713-8903-3a719c0c3501 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:43.407393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42dc8ed8-671e-4713-8903-3a719c0c3501 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:43.409087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42dc8ed8-671e-4713-8903-3a719c0c3501 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:43.410515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42dc8ed8-671e-4713-8903-3a719c0c3501 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:43.411268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42dc8ed8-671e-4713-8903-3a719c0c3501 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:43.859243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-42dc8ed8-671e-4713-8903-3a719c0c3501 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:43.874860 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-42dc8ed8-671e-4713-8903-3a719c0c3501 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1307 microversion: 2.1 time: 0.505664 Oct 11 19:59:43.876285 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1905/3890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:43 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1307 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:43.925466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f97225e8-1df9-4231-b5c9-8000a1623ac1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:43.926136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f97225e8-1df9-4231-b5c9-8000a1623ac1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:43.941617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f97225e8-1df9-4231-b5c9-8000a1623ac1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:43.942124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f97225e8-1df9-4231-b5c9-8000a1623ac1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:43.942636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f97225e8-1df9-4231-b5c9-8000a1623ac1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:43.943305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f97225e8-1df9-4231-b5c9-8000a1623ac1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:43.943761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f97225e8-1df9-4231-b5c9-8000a1623ac1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:43.944185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f97225e8-1df9-4231-b5c9-8000a1623ac1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:44.131304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f97225e8-1df9-4231-b5c9-8000a1623ac1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:44.140108 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f97225e8-1df9-4231-b5c9-8000a1623ac1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1197 microversion: 2.1 time: 0.218408 Oct 11 19:59:44.150315 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1986/3891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:43 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:44.903511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a1f44371-7de3-4293-a900-6afcdb03a033 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:44.904125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a1f44371-7de3-4293-a900-6afcdb03a033 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:44.919161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1f44371-7de3-4293-a900-6afcdb03a033 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:44.920066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1f44371-7de3-4293-a900-6afcdb03a033 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:44.923424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1f44371-7de3-4293-a900-6afcdb03a033 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:44.924377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1f44371-7de3-4293-a900-6afcdb03a033 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:44.925626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1f44371-7de3-4293-a900-6afcdb03a033 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:44.926984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1f44371-7de3-4293-a900-6afcdb03a033 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:45.169925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c0c6796-eb3a-4740-8206-d95c427f9016 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:45.171453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c0c6796-eb3a-4740-8206-d95c427f9016 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:45.187704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c0c6796-eb3a-4740-8206-d95c427f9016 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:45.190287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c0c6796-eb3a-4740-8206-d95c427f9016 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:45.190846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c0c6796-eb3a-4740-8206-d95c427f9016 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:45.209025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c0c6796-eb3a-4740-8206-d95c427f9016 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:45.209643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c0c6796-eb3a-4740-8206-d95c427f9016 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:45.210094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c0c6796-eb3a-4740-8206-d95c427f9016 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:45.368280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c0c6796-eb3a-4740-8206-d95c427f9016 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:45.389828 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c0c6796-eb3a-4740-8206-d95c427f9016 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1251 microversion: 2.1 time: 0.225253 Oct 11 19:59:45.390447 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1987/3892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:45 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1251 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:45.551722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a1f44371-7de3-4293-a900-6afcdb03a033 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:45.570689 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a1f44371-7de3-4293-a900-6afcdb03a033 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1488 microversion: 2.1 time: 0.669233 Oct 11 19:59:45.571316 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1906/3893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:44 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1488 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:45.596163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ea57b9cf-fd61-47ea-aef6-0b9110311d69 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:45.603410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea57b9cf-fd61-47ea-aef6-0b9110311d69 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:45.604097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea57b9cf-fd61-47ea-aef6-0b9110311d69 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:45.604690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea57b9cf-fd61-47ea-aef6-0b9110311d69 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:45.634073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ea57b9cf-fd61-47ea-aef6-0b9110311d69 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Going to try to stop instance {{(pid=126956) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 19:59:45.707557 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ea57b9cf-fd61-47ea-aef6-0b9110311d69 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd/action" status: 202 len: 0 microversion: 2.1 time: 0.115799 Oct 11 19:59:45.708193 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1988/3894] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:59:45 2022] POST /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:59:45.725678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f8693601-1d4b-4bed-ac80-972715cfac54 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:45.726985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f8693601-1d4b-4bed-ac80-972715cfac54 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:45.744798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8693601-1d4b-4bed-ac80-972715cfac54 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:45.746546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8693601-1d4b-4bed-ac80-972715cfac54 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:45.747467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8693601-1d4b-4bed-ac80-972715cfac54 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:45.748692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8693601-1d4b-4bed-ac80-972715cfac54 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:45.752008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8693601-1d4b-4bed-ac80-972715cfac54 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:45.754208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8693601-1d4b-4bed-ac80-972715cfac54 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:46.425629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3c8eb58-79b5-4359-bbf8-8e0101039b10 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:46.427595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3c8eb58-79b5-4359-bbf8-8e0101039b10 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:46.455802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3c8eb58-79b5-4359-bbf8-8e0101039b10 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:46.456362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3c8eb58-79b5-4359-bbf8-8e0101039b10 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:46.456818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3c8eb58-79b5-4359-bbf8-8e0101039b10 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:46.462254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3c8eb58-79b5-4359-bbf8-8e0101039b10 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:46.462800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3c8eb58-79b5-4359-bbf8-8e0101039b10 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:46.463244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3c8eb58-79b5-4359-bbf8-8e0101039b10 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:46.592335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f8693601-1d4b-4bed-ac80-972715cfac54 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:46.603341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:46.606470 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f8693601-1d4b-4bed-ac80-972715cfac54 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.893184 Oct 11 19:59:46.607803 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1907/3895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:45 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:46.659245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c3c8eb58-79b5-4359-bbf8-8e0101039b10 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:46.692244 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3c8eb58-79b5-4359-bbf8-8e0101039b10 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1251 microversion: 2.1 time: 0.282546 Oct 11 19:59:46.693500 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1989/3896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:46 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1251 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:47.635958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b7eaa08f-8a51-4ea0-a056-9ef6f4b3db8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:47.637216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b7eaa08f-8a51-4ea0-a056-9ef6f4b3db8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:47.646718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7eaa08f-8a51-4ea0-a056-9ef6f4b3db8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:47.647458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7eaa08f-8a51-4ea0-a056-9ef6f4b3db8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:47.648046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7eaa08f-8a51-4ea0-a056-9ef6f4b3db8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:47.648911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7eaa08f-8a51-4ea0-a056-9ef6f4b3db8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:47.649549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7eaa08f-8a51-4ea0-a056-9ef6f4b3db8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:47.650132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7eaa08f-8a51-4ea0-a056-9ef6f4b3db8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:47.725483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-819c9331-7786-4417-a25e-a34ed9fb3ea1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:47.726626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-819c9331-7786-4417-a25e-a34ed9fb3ea1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:47.742096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-819c9331-7786-4417-a25e-a34ed9fb3ea1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:47.742631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-819c9331-7786-4417-a25e-a34ed9fb3ea1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:47.743080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-819c9331-7786-4417-a25e-a34ed9fb3ea1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:47.743806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-819c9331-7786-4417-a25e-a34ed9fb3ea1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:47.744268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-819c9331-7786-4417-a25e-a34ed9fb3ea1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:47.744693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-819c9331-7786-4417-a25e-a34ed9fb3ea1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:48.105049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7eaa08f-8a51-4ea0-a056-9ef6f4b3db8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:48.113849 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b7eaa08f-8a51-4ea0-a056-9ef6f4b3db8a tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.484412 Oct 11 19:59:48.115617 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1908/3897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:47 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:48.151603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-819c9331-7786-4417-a25e-a34ed9fb3ea1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:48.160044 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-819c9331-7786-4417-a25e-a34ed9fb3ea1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1293 microversion: 2.1 time: 0.439771 Oct 11 19:59:48.161292 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1990/3898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:47 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1293 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:49.143376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4204ad20-743f-4321-b7ed-981eca10d339 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:49.144026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4204ad20-743f-4321-b7ed-981eca10d339 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:49.154015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4204ad20-743f-4321-b7ed-981eca10d339 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:49.154537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4204ad20-743f-4321-b7ed-981eca10d339 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:49.163240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4204ad20-743f-4321-b7ed-981eca10d339 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:49.164178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4204ad20-743f-4321-b7ed-981eca10d339 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:49.164835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4204ad20-743f-4321-b7ed-981eca10d339 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:49.165403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4204ad20-743f-4321-b7ed-981eca10d339 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:49.198031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-913627a4-0d04-4814-b541-fdcb13267e7c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:49.209255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-913627a4-0d04-4814-b541-fdcb13267e7c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:49.220745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-913627a4-0d04-4814-b541-fdcb13267e7c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:49.221608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-913627a4-0d04-4814-b541-fdcb13267e7c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:49.222344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-913627a4-0d04-4814-b541-fdcb13267e7c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:49.243904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-913627a4-0d04-4814-b541-fdcb13267e7c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:49.244710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-913627a4-0d04-4814-b541-fdcb13267e7c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:49.245468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-913627a4-0d04-4814-b541-fdcb13267e7c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:49.803809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-913627a4-0d04-4814-b541-fdcb13267e7c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:49.816209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4204ad20-743f-4321-b7ed-981eca10d339 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:49.823261 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-913627a4-0d04-4814-b541-fdcb13267e7c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1293 microversion: 2.1 time: 0.635874 Oct 11 19:59:49.825841 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4204ad20-743f-4321-b7ed-981eca10d339 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.686683 Oct 11 19:59:49.826709 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1991/3899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:49 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1293 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:49.829386 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1909/3900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:49 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:50.075489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6ba3ab2c-79a5-4447-a3a9-014102797390 req-262a8a90-a2ac-4fa0-9d55-e788f9d2153b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f54ce835-5aaa-41d9-a3d8-7c3debc17c6f", "tag": "eef2e5f6-d641-4728-8057-83da0ade845a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:50.103225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ba3ab2c-79a5-4447-a3a9-014102797390 req-262a8a90-a2ac-4fa0-9d55-e788f9d2153b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:50.105185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ba3ab2c-79a5-4447-a3a9-014102797390 req-262a8a90-a2ac-4fa0-9d55-e788f9d2153b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:50.105843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6ba3ab2c-79a5-4447-a3a9-014102797390 req-262a8a90-a2ac-4fa0-9d55-e788f9d2153b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:50.128475 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6ba3ab2c-79a5-4447-a3a9-014102797390 req-262a8a90-a2ac-4fa0-9d55-e788f9d2153b service nova] Creating event network-changed:eef2e5f6-d641-4728-8057-83da0ade845a for instance f54ce835-5aaa-41d9-a3d8-7c3debc17c6f on n-h1-860864-3 Oct 11 19:59:50.135655 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6ba3ab2c-79a5-4447-a3a9-014102797390 req-262a8a90-a2ac-4fa0-9d55-e788f9d2153b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065254 Oct 11 19:59:50.137388 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1992/3901] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:50.852544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d70b934f-4864-47d4-a965-2799b4f1fbb9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:50.853188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d70b934f-4864-47d4-a965-2799b4f1fbb9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:50.854856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8676a593-04a8-4fc3-92d0-e7b8d6e7030d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:50.855563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8676a593-04a8-4fc3-92d0-e7b8d6e7030d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:50.869150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d70b934f-4864-47d4-a965-2799b4f1fbb9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:50.869698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d70b934f-4864-47d4-a965-2799b4f1fbb9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:50.870153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d70b934f-4864-47d4-a965-2799b4f1fbb9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:50.874217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d70b934f-4864-47d4-a965-2799b4f1fbb9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:50.875287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d70b934f-4864-47d4-a965-2799b4f1fbb9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:50.875670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d70b934f-4864-47d4-a965-2799b4f1fbb9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:50.882281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8676a593-04a8-4fc3-92d0-e7b8d6e7030d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:50.882597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8676a593-04a8-4fc3-92d0-e7b8d6e7030d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:50.888494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8676a593-04a8-4fc3-92d0-e7b8d6e7030d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:50.891556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8676a593-04a8-4fc3-92d0-e7b8d6e7030d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:50.893402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8676a593-04a8-4fc3-92d0-e7b8d6e7030d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:50.895384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8676a593-04a8-4fc3-92d0-e7b8d6e7030d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:51.855882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d70b934f-4864-47d4-a965-2799b4f1fbb9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:51.864465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8676a593-04a8-4fc3-92d0-e7b8d6e7030d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:51.875543 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8676a593-04a8-4fc3-92d0-e7b8d6e7030d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 1.027556 Oct 11 19:59:51.876347 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1993/3902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:50 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:51.877717 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d70b934f-4864-47d4-a965-2799b4f1fbb9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1293 microversion: 2.1 time: 1.029938 Oct 11 19:59:51.883491 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1910/3903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:50 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1293 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:52.901764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa101ddb-82a9-4fd1-a266-944edf7313de tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:52.902575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa101ddb-82a9-4fd1-a266-944edf7313de tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:52.905731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bf75bb40-fdc0-4092-87b7-efaf5e2cf496 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:52.906357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bf75bb40-fdc0-4092-87b7-efaf5e2cf496 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:52.906864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:52.912858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa101ddb-82a9-4fd1-a266-944edf7313de tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:52.913464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa101ddb-82a9-4fd1-a266-944edf7313de tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:52.914114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa101ddb-82a9-4fd1-a266-944edf7313de tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:52.914926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa101ddb-82a9-4fd1-a266-944edf7313de tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:52.915576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa101ddb-82a9-4fd1-a266-944edf7313de tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:52.916273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa101ddb-82a9-4fd1-a266-944edf7313de tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:52.917453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:52.918412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:52.921742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf75bb40-fdc0-4092-87b7-efaf5e2cf496 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:52.923536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf75bb40-fdc0-4092-87b7-efaf5e2cf496 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:52.923536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf75bb40-fdc0-4092-87b7-efaf5e2cf496 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:52.923775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf75bb40-fdc0-4092-87b7-efaf5e2cf496 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:52.924191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf75bb40-fdc0-4092-87b7-efaf5e2cf496 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:52.924690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf75bb40-fdc0-4092-87b7-efaf5e2cf496 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:53.315938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa101ddb-82a9-4fd1-a266-944edf7313de tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:53.337197 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa101ddb-82a9-4fd1-a266-944edf7313de tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1293 microversion: 2.1 time: 0.438896 Oct 11 19:59:53.338517 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1994/3904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:52 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1293 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:53.353255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bf75bb40-fdc0-4092-87b7-efaf5e2cf496 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:53.361413 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bf75bb40-fdc0-4092-87b7-efaf5e2cf496 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.460848 Oct 11 19:59:53.362336 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1911/3905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:52 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:54.364166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-828dade5-71c1-4433-a6e7-27acc7f79f73 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:54.364803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-828dade5-71c1-4433-a6e7-27acc7f79f73 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:54.371790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828dade5-71c1-4433-a6e7-27acc7f79f73 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:54.372299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828dade5-71c1-4433-a6e7-27acc7f79f73 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:54.372743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828dade5-71c1-4433-a6e7-27acc7f79f73 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:54.373496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828dade5-71c1-4433-a6e7-27acc7f79f73 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:54.373956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828dade5-71c1-4433-a6e7-27acc7f79f73 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:54.374398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-828dade5-71c1-4433-a6e7-27acc7f79f73 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:54.385644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c51700d1-55ff-4e4d-b7dd-053490ce7b34 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:54.386277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c51700d1-55ff-4e4d-b7dd-053490ce7b34 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:54.408677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c51700d1-55ff-4e4d-b7dd-053490ce7b34 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:54.409128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c51700d1-55ff-4e4d-b7dd-053490ce7b34 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:54.409583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c51700d1-55ff-4e4d-b7dd-053490ce7b34 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:54.410308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c51700d1-55ff-4e4d-b7dd-053490ce7b34 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:54.422044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c51700d1-55ff-4e4d-b7dd-053490ce7b34 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:54.422740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c51700d1-55ff-4e4d-b7dd-053490ce7b34 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:55.148226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c51700d1-55ff-4e4d-b7dd-053490ce7b34 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:55.164447 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c51700d1-55ff-4e4d-b7dd-053490ce7b34 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.778735 Oct 11 19:59:55.166060 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1912/3906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:54 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:55.174067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-828dade5-71c1-4433-a6e7-27acc7f79f73 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:55.176177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f4b9a5eb-5b2b-44f9-8c34-4aea0bd7d6b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:55.179405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f4b9a5eb-5b2b-44f9-8c34-4aea0bd7d6b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:55.189254 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-828dade5-71c1-4433-a6e7-27acc7f79f73 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1293 microversion: 2.1 time: 0.825672 Oct 11 19:59:55.190128 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1995/3907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:54 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1293 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:55.202095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4b9a5eb-5b2b-44f9-8c34-4aea0bd7d6b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:55.202742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4b9a5eb-5b2b-44f9-8c34-4aea0bd7d6b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:55.204976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4b9a5eb-5b2b-44f9-8c34-4aea0bd7d6b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:55.205738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4b9a5eb-5b2b-44f9-8c34-4aea0bd7d6b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:55.206997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4b9a5eb-5b2b-44f9-8c34-4aea0bd7d6b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:55.210108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4b9a5eb-5b2b-44f9-8c34-4aea0bd7d6b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:55.315106 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f4b9a5eb-5b2b-44f9-8c34-4aea0bd7d6b5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.145579 Oct 11 19:59:55.317097 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1913/3908] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 19:59:55 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 19:59:55.327387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-03be6637-1f36-47f4-8940-3782960a7d51 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:55.328494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-03be6637-1f36-47f4-8940-3782960a7d51 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:55.338042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03be6637-1f36-47f4-8940-3782960a7d51 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:55.338827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03be6637-1f36-47f4-8940-3782960a7d51 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:55.340419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03be6637-1f36-47f4-8940-3782960a7d51 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:55.340989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03be6637-1f36-47f4-8940-3782960a7d51 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:55.341604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03be6637-1f36-47f4-8940-3782960a7d51 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:55.342983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03be6637-1f36-47f4-8940-3782960a7d51 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:55.900334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-03be6637-1f36-47f4-8940-3782960a7d51 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:55.911425 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-03be6637-1f36-47f4-8940-3782960a7d51 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1671 microversion: 2.1 time: 0.590148 Oct 11 19:59:55.912790 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1996/3909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:55 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1671 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:56.193611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9df106ae-0e81-44be-b2b7-ae2ffa576a71 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:56.194275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9df106ae-0e81-44be-b2b7-ae2ffa576a71 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:56.208032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df106ae-0e81-44be-b2b7-ae2ffa576a71 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:56.208032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df106ae-0e81-44be-b2b7-ae2ffa576a71 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:56.208032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df106ae-0e81-44be-b2b7-ae2ffa576a71 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:56.213553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ce06d20-4752-4983-b3ee-6ec16def771a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:56.214180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ce06d20-4752-4983-b3ee-6ec16def771a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:56.223367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df106ae-0e81-44be-b2b7-ae2ffa576a71 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:56.223937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df106ae-0e81-44be-b2b7-ae2ffa576a71 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:56.224385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9df106ae-0e81-44be-b2b7-ae2ffa576a71 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:56.225131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ce06d20-4752-4983-b3ee-6ec16def771a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:56.225838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ce06d20-4752-4983-b3ee-6ec16def771a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:56.229502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ce06d20-4752-4983-b3ee-6ec16def771a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:56.231770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ce06d20-4752-4983-b3ee-6ec16def771a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:56.232402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ce06d20-4752-4983-b3ee-6ec16def771a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:56.233757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ce06d20-4752-4983-b3ee-6ec16def771a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:56.293811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 19:59:56.876937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9df106ae-0e81-44be-b2b7-ae2ffa576a71 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:56.888870 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9df106ae-0e81-44be-b2b7-ae2ffa576a71 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.700691 Oct 11 19:59:56.898752 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1914/3910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:56 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:56.936593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-91370180-f1d6-43a1-8700-12752999895f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:56.937217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-91370180-f1d6-43a1-8700-12752999895f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:56.947489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91370180-f1d6-43a1-8700-12752999895f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:56.947999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91370180-f1d6-43a1-8700-12752999895f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:56.948448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91370180-f1d6-43a1-8700-12752999895f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:56.952692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91370180-f1d6-43a1-8700-12752999895f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:56.953190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91370180-f1d6-43a1-8700-12752999895f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:56.953633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91370180-f1d6-43a1-8700-12752999895f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:56.987439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8ce06d20-4752-4983-b3ee-6ec16def771a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:56.995513 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ce06d20-4752-4983-b3ee-6ec16def771a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1293 microversion: 2.1 time: 0.786170 Oct 11 19:59:57.010959 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1997/3911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:56 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1293 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:57.200553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-91370180-f1d6-43a1-8700-12752999895f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:57.212199 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-91370180-f1d6-43a1-8700-12752999895f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1671 microversion: 2.1 time: 0.279256 Oct 11 19:59:57.228216 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1915/3912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:56 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1671 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:57.352123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-5c21c9e3-6376-4404-a08e-cbb2b53b7686 req-5a386cef-323e-4d68-a599-3fd84b0db1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54ce835-5aaa-41d9-a3d8-7c3debc17c6f", "name": "network-vif-plugged", "status": "completed", "tag": "eef2e5f6-d641-4728-8057-83da0ade845a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:57.378074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5c21c9e3-6376-4404-a08e-cbb2b53b7686 req-5a386cef-323e-4d68-a599-3fd84b0db1a8 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:57.378757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5c21c9e3-6376-4404-a08e-cbb2b53b7686 req-5a386cef-323e-4d68-a599-3fd84b0db1a8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:57.379292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5c21c9e3-6376-4404-a08e-cbb2b53b7686 req-5a386cef-323e-4d68-a599-3fd84b0db1a8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:57.394393 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-5c21c9e3-6376-4404-a08e-cbb2b53b7686 req-5a386cef-323e-4d68-a599-3fd84b0db1a8 service nova] Creating event network-vif-plugged:eef2e5f6-d641-4728-8057-83da0ade845a for instance f54ce835-5aaa-41d9-a3d8-7c3debc17c6f on n-h1-860864-3 Oct 11 19:59:57.399735 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-5c21c9e3-6376-4404-a08e-cbb2b53b7686 req-5a386cef-323e-4d68-a599-3fd84b0db1a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058086 Oct 11 19:59:57.400902 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1998/3913] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 19:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 19:59:57.912438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9398db6-1e73-4e9c-b442-9d27d9db0bba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:57.913047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b9398db6-1e73-4e9c-b442-9d27d9db0bba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:57.919793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9398db6-1e73-4e9c-b442-9d27d9db0bba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:57.920803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9398db6-1e73-4e9c-b442-9d27d9db0bba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:57.921430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9398db6-1e73-4e9c-b442-9d27d9db0bba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:57.922283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9398db6-1e73-4e9c-b442-9d27d9db0bba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:57.922902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9398db6-1e73-4e9c-b442-9d27d9db0bba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:57.923467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9398db6-1e73-4e9c-b442-9d27d9db0bba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:58.028228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c888af0-70fe-4097-80e5-45fbd0683257 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:58.030048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c888af0-70fe-4097-80e5-45fbd0683257 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:58.036608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c888af0-70fe-4097-80e5-45fbd0683257 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:58.037329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c888af0-70fe-4097-80e5-45fbd0683257 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:58.038056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c888af0-70fe-4097-80e5-45fbd0683257 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:58.038950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c888af0-70fe-4097-80e5-45fbd0683257 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:58.039551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c888af0-70fe-4097-80e5-45fbd0683257 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:58.040131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c888af0-70fe-4097-80e5-45fbd0683257 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:58.437182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b9398db6-1e73-4e9c-b442-9d27d9db0bba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:58.447452 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b9398db6-1e73-4e9c-b442-9d27d9db0bba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.538960 Oct 11 19:59:58.449711 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1916/3914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:57 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:58.462393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9cbd6534-cede-45c9-b8c6-39e181f71115 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:58.466562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9cbd6534-cede-45c9-b8c6-39e181f71115 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:58.475918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbd6534-cede-45c9-b8c6-39e181f71115 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:58.476672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbd6534-cede-45c9-b8c6-39e181f71115 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:58.477396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbd6534-cede-45c9-b8c6-39e181f71115 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:58.479337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbd6534-cede-45c9-b8c6-39e181f71115 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:58.480170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbd6534-cede-45c9-b8c6-39e181f71115 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:58.480951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbd6534-cede-45c9-b8c6-39e181f71115 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:58.491889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c888af0-70fe-4097-80e5-45fbd0683257 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:58.503631 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c888af0-70fe-4097-80e5-45fbd0683257 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1293 microversion: 2.1 time: 0.481192 Oct 11 19:59:58.507935 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 1999/3915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:58 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1293 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:58.887580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9cbd6534-cede-45c9-b8c6-39e181f71115 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:58.900522 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9cbd6534-cede-45c9-b8c6-39e181f71115 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.449350 Oct 11 19:59:58.921658 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1917/3916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:58 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 19:59:59.478253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3f91e033-b19a-4c71-af88-fdb666d5399e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:59.478953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3f91e033-b19a-4c71-af88-fdb666d5399e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:59.492306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f91e033-b19a-4c71-af88-fdb666d5399e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:59.492706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f91e033-b19a-4c71-af88-fdb666d5399e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:59.493144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f91e033-b19a-4c71-af88-fdb666d5399e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:59.500496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f91e033-b19a-4c71-af88-fdb666d5399e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:59.501226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f91e033-b19a-4c71-af88-fdb666d5399e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:59.502093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f91e033-b19a-4c71-af88-fdb666d5399e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:59.759520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3f91e033-b19a-4c71-af88-fdb666d5399e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 19:59:59.772267 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3f91e033-b19a-4c71-af88-fdb666d5399e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.298087 Oct 11 19:59:59.777642 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1918/3917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:59 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 19:59:59.789756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-013440b8-cfeb-4709-8c10-679353763933 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 19:59:59.793610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-013440b8-cfeb-4709-8c10-679353763933 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 19:59:59.806690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-27a79fd0-b89e-4820-9188-9bdc58f2364e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Action: 'create', calling method: .version_select at 0x7f83c7451dc0>, body: {"keypair": {"name": "tempest-keypair-1506801164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+upONeerPUzM5oWCx7byef/OynsJVO9XGqHeltc3xYFlUdILWZXyT/osjBR47OIgJto7TCFuDfpkZZrqvBsLUs7l2YIgxdGxa/T0oqEXW5pmBgUQ81lXCtj6aloJ7AhQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 19:59:59.810452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013440b8-cfeb-4709-8c10-679353763933 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:59.814805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013440b8-cfeb-4709-8c10-679353763933 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:59.816210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013440b8-cfeb-4709-8c10-679353763933 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:59.819130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013440b8-cfeb-4709-8c10-679353763933 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 19:59:59.822083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013440b8-cfeb-4709-8c10-679353763933 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 19:59:59.824432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013440b8-cfeb-4709-8c10-679353763933 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 19:59:59.844421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-27a79fd0-b89e-4820-9188-9bdc58f2364e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Getting quotas for project d967db3cdcf24f8191bcaad486b9d16e. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 19:59:59.859099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-27a79fd0-b89e-4820-9188-9bdc58f2364e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Getting quotas for user aca071e3ee284a0dbd2762856cf2a2c2 and project d967db3cdcf24f8191bcaad486b9d16e. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 19:59:59.906238 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-27a79fd0-b89e-4820-9188-9bdc58f2364e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.645288 Oct 11 19:59:59.907505 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2000/3918] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 19:59:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:00.052509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-013440b8-cfeb-4709-8c10-679353763933 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:00.070242 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-013440b8-cfeb-4709-8c10-679353763933 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1474 microversion: 2.1 time: 0.291220 Oct 11 20:00:00.075184 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1919/3919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 19:59:59 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1474 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:00.217138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1895033285", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:00.316109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] validate_networks() for [('4bda9a14-e746-4951-9d43-234855a05a4d', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:00:00.801662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e522c708-7449-403c-afcc-3c49c1fe09da tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:00.802797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e522c708-7449-403c-afcc-3c49c1fe09da tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:00.814196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e522c708-7449-403c-afcc-3c49c1fe09da tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:00.815101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e522c708-7449-403c-afcc-3c49c1fe09da tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:00.815547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e522c708-7449-403c-afcc-3c49c1fe09da tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:00.816261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e522c708-7449-403c-afcc-3c49c1fe09da tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:00.817133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e522c708-7449-403c-afcc-3c49c1fe09da tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:00.818959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e522c708-7449-403c-afcc-3c49c1fe09da tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:01.366499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e522c708-7449-403c-afcc-3c49c1fe09da tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:01.381019 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e522c708-7449-403c-afcc-3c49c1fe09da tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.582675 Oct 11 20:00:01.387198 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1920/3920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:00 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:01.934280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:00:01.935772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:00:01.936493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:00:01.937140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:00:01.937631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:00:01.948863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:01.949521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:01.950156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:01.950859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:01.951525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:01.951882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:01.997105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:00:02.003036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for user a84c2531dcb24cce9872808db6c1fa6d and project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:00:02.018919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:00:02.021366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 728db27d-d985-495b-a9b9-aa26fd765990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:00:02.102019 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d7cd986b-2cc1-43b7-aea0-0c3103fa52c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.891010 Oct 11 20:00:02.110702 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2001/3921] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:00:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:00:02.115077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dd78a12a-8394-410f-9af5-a68be6fea0c5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:02.116280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dd78a12a-8394-410f-9af5-a68be6fea0c5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 728db27d-d985-495b-a9b9-aa26fd765990] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:02.152909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dd78a12a-8394-410f-9af5-a68be6fea0c5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 728db27d-d985-495b-a9b9-aa26fd765990] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:00:02.415498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5d40f02c-4ab7-4102-8211-75ee75fed014 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:02.416150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5d40f02c-4ab7-4102-8211-75ee75fed014 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:02.437802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d40f02c-4ab7-4102-8211-75ee75fed014 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:02.438316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d40f02c-4ab7-4102-8211-75ee75fed014 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:02.443093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d40f02c-4ab7-4102-8211-75ee75fed014 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:02.443906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d40f02c-4ab7-4102-8211-75ee75fed014 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:02.444383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d40f02c-4ab7-4102-8211-75ee75fed014 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:02.445021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d40f02c-4ab7-4102-8211-75ee75fed014 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:02.495220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dd78a12a-8394-410f-9af5-a68be6fea0c5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990" status: 204 len: 0 microversion: 2.1 time: 0.384279 Oct 11 20:00:02.499435 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1921/3922] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:00:02 2022] DELETE /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:00:02.504628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5d0d176f-aaea-43e2-84a5-e5a463ee6c4b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:02.511899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5d0d176f-aaea-43e2-84a5-e5a463ee6c4b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 728db27d-d985-495b-a9b9-aa26fd765990] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:02.568705 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5d0d176f-aaea-43e2-84a5-e5a463ee6c4b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5d0d176f-aaea-43e2-84a5-e5a463ee6c4b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990 HTTP/1.1 Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '728db27d-d985-495b-a9b9-aa26fd765990'} Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 728db27d-d985-495b-a9b9-aa26fd765990 Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:00:02.570716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:02.575267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5d0d176f-aaea-43e2-84a5-e5a463ee6c4b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:00:02.581093 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5d0d176f-aaea-43e2-84a5-e5a463ee6c4b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990" status: 404 len: 111 microversion: 2.1 time: 0.076274 Oct 11 20:00:02.583468 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1922/3923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:02 2022] GET /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:00:02.628583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5d40f02c-4ab7-4102-8211-75ee75fed014 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:02.638257 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5d40f02c-4ab7-4102-8211-75ee75fed014 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.232882 Oct 11 20:00:02.644489 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2002/3924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:02 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:02.650063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1921271029", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "4bda9a14-e746-4951-9d43-234855a05a4d"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:02.788420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] validate_networks() for [('4bda9a14-e746-4951-9d43-234855a05a4d', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:00:03.173969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1001040673", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "12661b7a-8875-4ab5-ac56-c3fa6908ad7f"}], "security_groups": [{"name": "tempest-securitygroup--301201534"}], "key_name": "tempest-keypair-1506801164", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:03.366237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] validate_networks() for [('12661b7a-8875-4ab5-ac56-c3fa6908ad7f', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:00:03.939072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:00:03.940043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:00:03.941219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:00:03.942071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:00:03.942510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:00:03.952975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:03.953813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:03.954957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:03.955937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:03.956617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:03.957143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:03.975936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:00:03.981865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for user a84c2531dcb24cce9872808db6c1fa6d and project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:00:03.996163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:00:03.999364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:00:04.073443 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-07fd277c-5943-4c50-b708-af1061b01035 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.428921 Oct 11 20:00:04.083819 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1923/3925] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:00:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:00:04.088804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bf52fee2-f83c-4886-955a-befe092093dc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:04.089675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bf52fee2-f83c-4886-955a-befe092093dc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:04.106279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf52fee2-f83c-4886-955a-befe092093dc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:04.107183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf52fee2-f83c-4886-955a-befe092093dc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:04.107868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf52fee2-f83c-4886-955a-befe092093dc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:04.108788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf52fee2-f83c-4886-955a-befe092093dc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:04.109447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf52fee2-f83c-4886-955a-befe092093dc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:04.110105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf52fee2-f83c-4886-955a-befe092093dc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:04.545912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bf52fee2-f83c-4886-955a-befe092093dc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:04.559739 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bf52fee2-f83c-4886-955a-befe092093dc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.474591 Oct 11 20:00:04.575955 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1924/3926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:04 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:04.582824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30a2754d-694e-47eb-90a2-03bc846f0184 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:04.584245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30a2754d-694e-47eb-90a2-03bc846f0184 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:04.665728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Getting quotas for project d967db3cdcf24f8191bcaad486b9d16e. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:00:04.683000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Getting quotas for user aca071e3ee284a0dbd2762856cf2a2c2 and project d967db3cdcf24f8191bcaad486b9d16e. Resources: dict_keys(['metadata_items']) {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:00:04.688408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-30a2754d-694e-47eb-90a2-03bc846f0184 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:04.703464 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-30a2754d-694e-47eb-90a2-03bc846f0184 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1221 microversion: 2.1 time: 0.126018 Oct 11 20:00:04.706364 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1925/3927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:04 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1221 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:04.734753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:00:04.739531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:00:04.740227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:00:04.740807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:00:04.746846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:00:04.765676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:04.766581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:04.767249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:04.768205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:04.768992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:04.769620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:04.795245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Getting quotas for project d967db3cdcf24f8191bcaad486b9d16e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:00:04.803311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Getting quotas for user aca071e3ee284a0dbd2762856cf2a2c2 and project d967db3cdcf24f8191bcaad486b9d16e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:00:04.823342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:00:04.826970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:00:04.886886 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e53ba97-e2f5-47cc-9f03-ef2e9924d8ff tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.718734 Oct 11 20:00:04.888268 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2003/3928] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:00:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:00:04.901377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-75ac6d58-f063-4fb8-b929-7606015ce6d7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:04.902416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-75ac6d58-f063-4fb8-b929-7606015ce6d7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:05.051351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-75ac6d58-f063-4fb8-b929-7606015ce6d7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:05.066911 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-75ac6d58-f063-4fb8-b929-7606015ce6d7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1278 microversion: 2.1 time: 0.170386 Oct 11 20:00:05.069650 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1926/3929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:04 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:05.587255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-20fe65ba-eb7c-4eb5-ae2c-1d5e75b9cfc2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:05.587903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-20fe65ba-eb7c-4eb5-ae2c-1d5e75b9cfc2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:05.599601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20fe65ba-eb7c-4eb5-ae2c-1d5e75b9cfc2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:05.600094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20fe65ba-eb7c-4eb5-ae2c-1d5e75b9cfc2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:05.600536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20fe65ba-eb7c-4eb5-ae2c-1d5e75b9cfc2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:05.601397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20fe65ba-eb7c-4eb5-ae2c-1d5e75b9cfc2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:05.601856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20fe65ba-eb7c-4eb5-ae2c-1d5e75b9cfc2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:05.602274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20fe65ba-eb7c-4eb5-ae2c-1d5e75b9cfc2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:05.733704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-adc21dd0-a70a-418f-9fac-f4b84b3fa5c1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:05.734758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-adc21dd0-a70a-418f-9fac-f4b84b3fa5c1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:05.755335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:05.760530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc21dd0-a70a-418f-9fac-f4b84b3fa5c1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:05.763197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc21dd0-a70a-418f-9fac-f4b84b3fa5c1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:05.763898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc21dd0-a70a-418f-9fac-f4b84b3fa5c1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:05.765130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc21dd0-a70a-418f-9fac-f4b84b3fa5c1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:05.767738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc21dd0-a70a-418f-9fac-f4b84b3fa5c1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:05.768398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adc21dd0-a70a-418f-9fac-f4b84b3fa5c1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:05.941324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-adc21dd0-a70a-418f-9fac-f4b84b3fa5c1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:05.942750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-20fe65ba-eb7c-4eb5-ae2c-1d5e75b9cfc2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:05.954000 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-20fe65ba-eb7c-4eb5-ae2c-1d5e75b9cfc2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.370580 Oct 11 20:00:05.971770 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2004/3930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:05 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:05.977127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ebca3f1e-0156-4ccc-80cc-2f2501ce15b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:05.977894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ebca3f1e-0156-4ccc-80cc-2f2501ce15b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:05.985413 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-adc21dd0-a70a-418f-9fac-f4b84b3fa5c1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1273 microversion: 2.1 time: 0.257281 Oct 11 20:00:05.992198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebca3f1e-0156-4ccc-80cc-2f2501ce15b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:05.993027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebca3f1e-0156-4ccc-80cc-2f2501ce15b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:05.993720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebca3f1e-0156-4ccc-80cc-2f2501ce15b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:05.995791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebca3f1e-0156-4ccc-80cc-2f2501ce15b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:05.996010 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1927/3931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:05 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1273 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:05.996708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebca3f1e-0156-4ccc-80cc-2f2501ce15b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:05.997423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ebca3f1e-0156-4ccc-80cc-2f2501ce15b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:06.047342 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ebca3f1e-0156-4ccc-80cc-2f2501ce15b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/ips" status: 200 len: 150 microversion: 2.20 time: 0.073925 Oct 11 20:00:06.049212 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2005/3932] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Oct 11 20:00:05 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/ips => generated 150 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:00:06.093790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-87d95247-6b8c-4cb1-9ab2-68f159632ec9 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:06.094509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-87d95247-6b8c-4cb1-9ab2-68f159632ec9 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:06.104647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87d95247-6b8c-4cb1-9ab2-68f159632ec9 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:06.105150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87d95247-6b8c-4cb1-9ab2-68f159632ec9 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:06.105591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87d95247-6b8c-4cb1-9ab2-68f159632ec9 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:06.109556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87d95247-6b8c-4cb1-9ab2-68f159632ec9 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:06.111155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87d95247-6b8c-4cb1-9ab2-68f159632ec9 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:06.112697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87d95247-6b8c-4cb1-9ab2-68f159632ec9 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:06.126179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:06.368180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-87d95247-6b8c-4cb1-9ab2-68f159632ec9 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:06.396173 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-87d95247-6b8c-4cb1-9ab2-68f159632ec9 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1282 microversion: 2.1 time: 0.291193 Oct 11 20:00:06.397160 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1928/3933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:06 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1282 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:06.978606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-203486a0-0634-4499-8653-f739245ee458 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:06.980114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-203486a0-0634-4499-8653-f739245ee458 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:06.995533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-203486a0-0634-4499-8653-f739245ee458 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:06.998796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-203486a0-0634-4499-8653-f739245ee458 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:06.999472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-203486a0-0634-4499-8653-f739245ee458 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:07.000857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-203486a0-0634-4499-8653-f739245ee458 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:07.003926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-203486a0-0634-4499-8653-f739245ee458 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:07.009756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a32b2f1a-728f-4200-9448-8efb465bf955 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:07.011243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a32b2f1a-728f-4200-9448-8efb465bf955 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:07.027853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-203486a0-0634-4499-8653-f739245ee458 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:07.036845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a32b2f1a-728f-4200-9448-8efb465bf955 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:07.051338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a32b2f1a-728f-4200-9448-8efb465bf955 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:07.055134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a32b2f1a-728f-4200-9448-8efb465bf955 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:07.056612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a32b2f1a-728f-4200-9448-8efb465bf955 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:07.062382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a32b2f1a-728f-4200-9448-8efb465bf955 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:07.066426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a32b2f1a-728f-4200-9448-8efb465bf955 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:07.741969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a32b2f1a-728f-4200-9448-8efb465bf955 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:07.757820 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a32b2f1a-728f-4200-9448-8efb465bf955 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1279 microversion: 2.1 time: 0.750719 Oct 11 20:00:07.760604 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1929/3934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:07 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1279 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:07.775837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fd03cbb4-5ddb-4dc2-a5bf-0827518505aa tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:07.779958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fd03cbb4-5ddb-4dc2-a5bf-0827518505aa tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:07.796887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd03cbb4-5ddb-4dc2-a5bf-0827518505aa tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:07.797665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd03cbb4-5ddb-4dc2-a5bf-0827518505aa tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:07.798451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd03cbb4-5ddb-4dc2-a5bf-0827518505aa tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:07.799422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd03cbb4-5ddb-4dc2-a5bf-0827518505aa tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:07.800666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd03cbb4-5ddb-4dc2-a5bf-0827518505aa tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:07.801256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd03cbb4-5ddb-4dc2-a5bf-0827518505aa tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:07.901968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fd03cbb4-5ddb-4dc2-a5bf-0827518505aa tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:07.913520 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fd03cbb4-5ddb-4dc2-a5bf-0827518505aa tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1336 microversion: 2.1 time: 0.151302 Oct 11 20:00:07.914491 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1930/3935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:07 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1336 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:07.920678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:07.926234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:07.927352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Searching by: {'deleted': False, 'project_id': 'be4c654256334c259ebee814be235a69'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 20:00:07.933622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:07.934108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:07.934616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:07.936033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:07.936549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:07.937602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:07.974194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 20:00:08.012892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-203486a0-0634-4499-8653-f739245ee458 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:08.019309 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-489ca197-f8b7-43d5-be07-1d04d4d03394 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.103028 Oct 11 20:00:08.020384 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1931/3936] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 20:00:07 2022] GET /compute/v2.1/servers => generated 333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:08.037189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:08.043759 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-203486a0-0634-4499-8653-f739245ee458 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 1.069653 Oct 11 20:00:08.044949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:08.046131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Searching by: {'deleted': False, 'project_id': 'be4c654256334c259ebee814be235a69'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 20:00:08.057008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:08.057782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:08.058412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:08.058790 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2006/3937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:06 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:08.060888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:08.064671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:08.065283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:08.146163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 20:00:08.245967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:08.258138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:08.258699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:08.259158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:08.518395 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e2ad6937-c114-4be3-9a47-ca3bf3c8c4b4 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.487343 Oct 11 20:00:08.519279 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1932/3938] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 20:00:08 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:08.546764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa90215b-2322-48d4-beba-911ae1f408b3 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:08.549730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:08.557405 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa90215b-2322-48d4-beba-911ae1f408b3 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014381 Oct 11 20:00:08.558474 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2007/3939] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 20:00:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:08.785233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0170344e-520f-47c2-8c0b-69c3d1f6cb58 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:08.785728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0170344e-520f-47c2-8c0b-69c3d1f6cb58 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:08.796498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0170344e-520f-47c2-8c0b-69c3d1f6cb58 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:08.797000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0170344e-520f-47c2-8c0b-69c3d1f6cb58 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:08.802242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0170344e-520f-47c2-8c0b-69c3d1f6cb58 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:08.803087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0170344e-520f-47c2-8c0b-69c3d1f6cb58 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:08.803568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0170344e-520f-47c2-8c0b-69c3d1f6cb58 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:08.804009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0170344e-520f-47c2-8c0b-69c3d1f6cb58 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:08.886437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d5f79cb2-1ec2-4c44-a529-a277bc884b4e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:08.887020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d5f79cb2-1ec2-4c44-a529-a277bc884b4e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:08.901168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5f79cb2-1ec2-4c44-a529-a277bc884b4e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:08.901670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5f79cb2-1ec2-4c44-a529-a277bc884b4e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:08.902106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5f79cb2-1ec2-4c44-a529-a277bc884b4e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:08.902842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5f79cb2-1ec2-4c44-a529-a277bc884b4e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:08.903300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5f79cb2-1ec2-4c44-a529-a277bc884b4e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:08.903722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5f79cb2-1ec2-4c44-a529-a277bc884b4e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:08.973144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d5f79cb2-1ec2-4c44-a529-a277bc884b4e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:00:09.195154 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d5f79cb2-1ec2-4c44-a529-a277bc884b4e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 204 len: 0 microversion: 2.1 time: 0.312752 Oct 11 20:00:09.197001 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2008/3940] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:00:08 2022] DELETE /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:00:09.206918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b4245e18-f4d0-40ad-983c-343e5cac36a0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:09.208009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b4245e18-f4d0-40ad-983c-343e5cac36a0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:09.216179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4245e18-f4d0-40ad-983c-343e5cac36a0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:09.217909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4245e18-f4d0-40ad-983c-343e5cac36a0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:09.218610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4245e18-f4d0-40ad-983c-343e5cac36a0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:09.219556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4245e18-f4d0-40ad-983c-343e5cac36a0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:09.220282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4245e18-f4d0-40ad-983c-343e5cac36a0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:09.220888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4245e18-f4d0-40ad-983c-343e5cac36a0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:09.306189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0170344e-520f-47c2-8c0b-69c3d1f6cb58 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:09.315588 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0170344e-520f-47c2-8c0b-69c3d1f6cb58 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1321 microversion: 2.1 time: 0.534230 Oct 11 20:00:09.319464 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1933/3941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:08 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:09.327729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6b7f268e-f2dd-46b0-8481-09fbdc1b2bac tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:09.328653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6b7f268e-f2dd-46b0-8481-09fbdc1b2bac tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:09.345400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b7f268e-f2dd-46b0-8481-09fbdc1b2bac tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:09.348300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b7f268e-f2dd-46b0-8481-09fbdc1b2bac tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:09.353295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b7f268e-f2dd-46b0-8481-09fbdc1b2bac tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:09.360510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b7f268e-f2dd-46b0-8481-09fbdc1b2bac tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:09.361385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b7f268e-f2dd-46b0-8481-09fbdc1b2bac tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:09.361988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b7f268e-f2dd-46b0-8481-09fbdc1b2bac tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:09.405630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b4245e18-f4d0-40ad-983c-343e5cac36a0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:09.428744 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b4245e18-f4d0-40ad-983c-343e5cac36a0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1336 microversion: 2.1 time: 0.228953 Oct 11 20:00:09.437185 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2009/3942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:09 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1336 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:09.458819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13732371-6b22-4bab-b752-531a44a5a839 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:09.460589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-13732371-6b22-4bab-b752-531a44a5a839 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:09.492467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13732371-6b22-4bab-b752-531a44a5a839 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:09.493259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13732371-6b22-4bab-b752-531a44a5a839 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:09.494992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13732371-6b22-4bab-b752-531a44a5a839 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:09.501342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13732371-6b22-4bab-b752-531a44a5a839 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:09.504559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13732371-6b22-4bab-b752-531a44a5a839 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:09.505389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13732371-6b22-4bab-b752-531a44a5a839 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:10.014670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6b7f268e-f2dd-46b0-8481-09fbdc1b2bac tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:10.027052 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6b7f268e-f2dd-46b0-8481-09fbdc1b2bac tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1498 microversion: 2.1 time: 0.705523 Oct 11 20:00:10.031895 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1934/3943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:09 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1498 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:10.047248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c3ff2e25-646f-4d04-9367-8f95b41406e4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:10.048122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c3ff2e25-646f-4d04-9367-8f95b41406e4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:10.067085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3ff2e25-646f-4d04-9367-8f95b41406e4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:10.067860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3ff2e25-646f-4d04-9367-8f95b41406e4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:10.068518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3ff2e25-646f-4d04-9367-8f95b41406e4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:10.069459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3ff2e25-646f-4d04-9367-8f95b41406e4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:10.070158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3ff2e25-646f-4d04-9367-8f95b41406e4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:10.070847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3ff2e25-646f-4d04-9367-8f95b41406e4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:10.102020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13732371-6b22-4bab-b752-531a44a5a839 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:10.110969 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13732371-6b22-4bab-b752-531a44a5a839 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1701 microversion: 2.1 time: 0.672293 Oct 11 20:00:10.111556 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2010/3944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:09 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1701 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:10.123513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-c3ff2e25-646f-4d04-9367-8f95b41406e4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lazy-loading 'flavor' on Instance uuid 34e65c53-e164-4255-a2b8-4338069b7e47 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:00:10.346062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba558d3a-cfb0-49b2-9058-b1fd0b4ae2bb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:10.347642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba558d3a-cfb0-49b2-9058-b1fd0b4ae2bb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:10.362069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba558d3a-cfb0-49b2-9058-b1fd0b4ae2bb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:10.362602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba558d3a-cfb0-49b2-9058-b1fd0b4ae2bb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:10.363886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba558d3a-cfb0-49b2-9058-b1fd0b4ae2bb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:10.364612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba558d3a-cfb0-49b2-9058-b1fd0b4ae2bb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:10.365071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba558d3a-cfb0-49b2-9058-b1fd0b4ae2bb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:10.365501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba558d3a-cfb0-49b2-9058-b1fd0b4ae2bb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:10.547300 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c3ff2e25-646f-4d04-9367-8f95b41406e4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "POST /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/action" status: 202 len: 0 microversion: 2.20 time: 0.510929 Oct 11 20:00:10.550914 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1935/3945] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 20:00:10 2022] POST /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:00:10.566620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aa429889-4caf-403c-b0f8-93a6f8dab509 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:10.568692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aa429889-4caf-403c-b0f8-93a6f8dab509 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:10.587576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa429889-4caf-403c-b0f8-93a6f8dab509 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:10.588150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa429889-4caf-403c-b0f8-93a6f8dab509 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:10.590177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa429889-4caf-403c-b0f8-93a6f8dab509 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:10.592432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa429889-4caf-403c-b0f8-93a6f8dab509 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:10.594857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa429889-4caf-403c-b0f8-93a6f8dab509 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:10.595739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa429889-4caf-403c-b0f8-93a6f8dab509 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:10.813805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba558d3a-cfb0-49b2-9058-b1fd0b4ae2bb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:10.835140 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba558d3a-cfb0-49b2-9058-b1fd0b4ae2bb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1321 microversion: 2.1 time: 0.494728 Oct 11 20:00:10.835737 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2011/3946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:10 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1321 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:10.853862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:10.854482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:10.884933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:10.885431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:10.885865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:10.899791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:10.901303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:10.901890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:11.412046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aa429889-4caf-403c-b0f8-93a6f8dab509 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:11.446377 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aa429889-4caf-403c-b0f8-93a6f8dab509 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1403 microversion: 2.1 time: 0.894760 Oct 11 20:00:11.458708 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1936/3947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:10 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1403 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:11.481226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3dfbee51-9f29-46f8-9bc6-a4dd1d70f197 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:11.484819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3dfbee51-9f29-46f8-9bc6-a4dd1d70f197 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:11.492605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:11.500493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dfbee51-9f29-46f8-9bc6-a4dd1d70f197 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:11.502249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dfbee51-9f29-46f8-9bc6-a4dd1d70f197 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:11.504115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dfbee51-9f29-46f8-9bc6-a4dd1d70f197 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:11.505598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dfbee51-9f29-46f8-9bc6-a4dd1d70f197 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:11.507327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dfbee51-9f29-46f8-9bc6-a4dd1d70f197 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:11.509422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dfbee51-9f29-46f8-9bc6-a4dd1d70f197 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:11.509539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:11.510966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:11.519705 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-de8b9a87-cffd-4546-b5b6-48c40ddfbd1b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.668226 Oct 11 20:00:11.521965 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2012/3948] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:10 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:11.539031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-455acc82-d2b4-434d-98d2-126df198f7ac tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:11.539974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-455acc82-d2b4-434d-98d2-126df198f7ac tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:11.549492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455acc82-d2b4-434d-98d2-126df198f7ac tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:11.551177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455acc82-d2b4-434d-98d2-126df198f7ac tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:11.558234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455acc82-d2b4-434d-98d2-126df198f7ac tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:11.559532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455acc82-d2b4-434d-98d2-126df198f7ac tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:11.561182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455acc82-d2b4-434d-98d2-126df198f7ac tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:11.562341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455acc82-d2b4-434d-98d2-126df198f7ac tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:12.182380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3dfbee51-9f29-46f8-9bc6-a4dd1d70f197 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:12.191560 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3dfbee51-9f29-46f8-9bc6-a4dd1d70f197 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 200 len: 1475 microversion: 2.1 time: 0.740869 Oct 11 20:00:12.192188 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1937/3949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:11 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 1475 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:12.203838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-906b7270-9bfb-4bc7-aa86-9ac6e71ac4df req-a6810830-f2f9-45e6-939d-ba38a9d9f3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f536ba50-8666-4272-91ea-a92f7a6e8e87", "tag": "e694b9a3-5f3f-446f-af04-99d01ebe47dd"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:12.227229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-906b7270-9bfb-4bc7-aa86-9ac6e71ac4df req-a6810830-f2f9-45e6-939d-ba38a9d9f3b6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:12.227897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-906b7270-9bfb-4bc7-aa86-9ac6e71ac4df req-a6810830-f2f9-45e6-939d-ba38a9d9f3b6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:12.228520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-906b7270-9bfb-4bc7-aa86-9ac6e71ac4df req-a6810830-f2f9-45e6-939d-ba38a9d9f3b6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:12.239707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-455acc82-d2b4-434d-98d2-126df198f7ac tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:12.242062 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-906b7270-9bfb-4bc7-aa86-9ac6e71ac4df req-a6810830-f2f9-45e6-939d-ba38a9d9f3b6 service nova] Creating event network-changed:e694b9a3-5f3f-446f-af04-99d01ebe47dd for instance f536ba50-8666-4272-91ea-a92f7a6e8e87 on n-h2-860864-3 Oct 11 20:00:12.247184 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-906b7270-9bfb-4bc7-aa86-9ac6e71ac4df req-a6810830-f2f9-45e6-939d-ba38a9d9f3b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053766 Oct 11 20:00:12.248401 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1938/3950] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:12.253688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-49cd3234-7068-41d6-bcf3-c37880f155b0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:12.253822 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-455acc82-d2b4-434d-98d2-126df198f7ac tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1701 microversion: 2.1 time: 0.729867 Oct 11 20:00:12.254473 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2013/3951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:11 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1701 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:12.255003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-49cd3234-7068-41d6-bcf3-c37880f155b0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:12.261159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fee7b551-6b55-4566-8a90-64d39ada3463 req-ce3860ab-18ca-40b0-b436-f96974417dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f563b39-da5e-4d96-a6d4-ee6642d668a3", "tag": "f6d0e7a7-dee9-44a5-9015-7bb817c9e400"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:12.262427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49cd3234-7068-41d6-bcf3-c37880f155b0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:12.263159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49cd3234-7068-41d6-bcf3-c37880f155b0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:12.264365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49cd3234-7068-41d6-bcf3-c37880f155b0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:12.265260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49cd3234-7068-41d6-bcf3-c37880f155b0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:12.265905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49cd3234-7068-41d6-bcf3-c37880f155b0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:12.266518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49cd3234-7068-41d6-bcf3-c37880f155b0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:12.283756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fee7b551-6b55-4566-8a90-64d39ada3463 req-ce3860ab-18ca-40b0-b436-f96974417dac service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:12.284339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fee7b551-6b55-4566-8a90-64d39ada3463 req-ce3860ab-18ca-40b0-b436-f96974417dac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:12.284812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fee7b551-6b55-4566-8a90-64d39ada3463 req-ce3860ab-18ca-40b0-b436-f96974417dac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:12.315506 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fee7b551-6b55-4566-8a90-64d39ada3463 req-ce3860ab-18ca-40b0-b436-f96974417dac service nova] Creating event network-changed:f6d0e7a7-dee9-44a5-9015-7bb817c9e400 for instance 5f563b39-da5e-4d96-a6d4-ee6642d668a3 on n-h2-860864-3 Oct 11 20:00:12.321824 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fee7b551-6b55-4566-8a90-64d39ada3463 req-ce3860ab-18ca-40b0-b436-f96974417dac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065554 Oct 11 20:00:12.322872 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2014/3952] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:12.332192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-86f8e653-d72f-4e26-a374-079dea18013f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-8033266"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:12.336725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-86f8e653-d72f-4e26-a374-079dea18013f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:12.347877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86f8e653-d72f-4e26-a374-079dea18013f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:12.348378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86f8e653-d72f-4e26-a374-079dea18013f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:12.348971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86f8e653-d72f-4e26-a374-079dea18013f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:12.349997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86f8e653-d72f-4e26-a374-079dea18013f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:12.350466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86f8e653-d72f-4e26-a374-079dea18013f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:12.351382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86f8e653-d72f-4e26-a374-079dea18013f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:12.702961 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-86f8e653-d72f-4e26-a374-079dea18013f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd/action" status: 202 len: 0 microversion: 2.1 time: 0.377196 Oct 11 20:00:12.709046 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2015/3953] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:00:12 2022] POST /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 20:00:12.728361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-332243c2-5742-4978-9b10-9d10350ca62b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:12.730619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-332243c2-5742-4978-9b10-9d10350ca62b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:12.740503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332243c2-5742-4978-9b10-9d10350ca62b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:12.741015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332243c2-5742-4978-9b10-9d10350ca62b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:12.741458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332243c2-5742-4978-9b10-9d10350ca62b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:12.742179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332243c2-5742-4978-9b10-9d10350ca62b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:12.742682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332243c2-5742-4978-9b10-9d10350ca62b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:12.743118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-332243c2-5742-4978-9b10-9d10350ca62b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:12.764807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:13.307514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-49cd3234-7068-41d6-bcf3-c37880f155b0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:13.322313 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-49cd3234-7068-41d6-bcf3-c37880f155b0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1321 microversion: 2.1 time: 1.072516 Oct 11 20:00:13.323357 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1939/3954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:12 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1321 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:13.328801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:13.329599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:13.341133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:13.343121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:13.343672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:13.345230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:13.345885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:13.346892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:13.438028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-332243c2-5742-4978-9b10-9d10350ca62b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:13.447267 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-332243c2-5742-4978-9b10-9d10350ca62b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1403 microversion: 2.1 time: 0.728326 Oct 11 20:00:13.450143 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2016/3955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:12 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1403 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:13.462155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89a9702d-b55e-41a9-9775-4be355616595 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83d07c1e50>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:13.537743 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-89a9702d-b55e-41a9-9775-4be355616595 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.081461 Oct 11 20:00:13.539964 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2017/3956] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:13 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:13.555160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ccab4b79-d123-4154-bc48-011252749f1b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:13.555683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ccab4b79-d123-4154-bc48-011252749f1b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:13.570883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccab4b79-d123-4154-bc48-011252749f1b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:13.571698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccab4b79-d123-4154-bc48-011252749f1b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:13.573050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccab4b79-d123-4154-bc48-011252749f1b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:13.574796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccab4b79-d123-4154-bc48-011252749f1b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:13.578251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccab4b79-d123-4154-bc48-011252749f1b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:13.580562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccab4b79-d123-4154-bc48-011252749f1b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:13.663509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:13.679171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:13.681579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:13.683314 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-013d839e-4ed1-48e1-b832-c5ffd32c3738 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.358478 Oct 11 20:00:13.684104 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1940/3957] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:13 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:13.712103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ccab4b79-d123-4154-bc48-011252749f1b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:13.720417 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ccab4b79-d123-4154-bc48-011252749f1b tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1633 microversion: 2.1 time: 0.179416 Oct 11 20:00:13.721018 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2018/3958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:13 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1633 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:14.346569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ebbc5ea5-332a-4b58-8a9e-8121e3d7a037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:14.347177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ebbc5ea5-332a-4b58-8a9e-8121e3d7a037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:14.359049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebbc5ea5-332a-4b58-8a9e-8121e3d7a037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:14.359549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebbc5ea5-332a-4b58-8a9e-8121e3d7a037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:14.359996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebbc5ea5-332a-4b58-8a9e-8121e3d7a037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:14.362629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebbc5ea5-332a-4b58-8a9e-8121e3d7a037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:14.363227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebbc5ea5-332a-4b58-8a9e-8121e3d7a037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:14.363675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebbc5ea5-332a-4b58-8a9e-8121e3d7a037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:14.372226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-45f47809-05fd-43cc-b4b2-d522afd5893c req-b9d5b0ff-4769-4c19-a3a7-50ab5c7f101f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1db038-aabe-417a-bb33-f7a83173e7ba", "name": "network-vif-deleted", "tag": "303457d8-51f7-4eb4-97b1-f3880c440ba0"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:14.401810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-45f47809-05fd-43cc-b4b2-d522afd5893c req-b9d5b0ff-4769-4c19-a3a7-50ab5c7f101f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:14.402485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-45f47809-05fd-43cc-b4b2-d522afd5893c req-b9d5b0ff-4769-4c19-a3a7-50ab5c7f101f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:14.402948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-45f47809-05fd-43cc-b4b2-d522afd5893c req-b9d5b0ff-4769-4c19-a3a7-50ab5c7f101f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:14.436606 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-45f47809-05fd-43cc-b4b2-d522afd5893c req-b9d5b0ff-4769-4c19-a3a7-50ab5c7f101f service nova] Creating event network-vif-deleted:303457d8-51f7-4eb4-97b1-f3880c440ba0 for instance 1e1db038-aabe-417a-bb33-f7a83173e7ba on n-h1-860864-3 Oct 11 20:00:14.447411 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-45f47809-05fd-43cc-b4b2-d522afd5893c req-b9d5b0ff-4769-4c19-a3a7-50ab5c7f101f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079770 Oct 11 20:00:14.451205 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2019/3959] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:00:14.474225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5f28d9cb-f74b-482e-8ee8-730537b992cf tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:14.475209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5f28d9cb-f74b-482e-8ee8-730537b992cf tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:14.485221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f28d9cb-f74b-482e-8ee8-730537b992cf tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:14.485892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f28d9cb-f74b-482e-8ee8-730537b992cf tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:14.486508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f28d9cb-f74b-482e-8ee8-730537b992cf tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:14.487386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f28d9cb-f74b-482e-8ee8-730537b992cf tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:14.488120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f28d9cb-f74b-482e-8ee8-730537b992cf tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:14.488709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f28d9cb-f74b-482e-8ee8-730537b992cf tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:14.752665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ebbc5ea5-332a-4b58-8a9e-8121e3d7a037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:14.769032 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ebbc5ea5-332a-4b58-8a9e-8121e3d7a037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1321 microversion: 2.1 time: 0.426411 Oct 11 20:00:14.774711 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1941/3960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:14 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:14.782488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a07ac1e7-4c01-4353-8697-2fbe189e5300 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c73af940>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:14.786098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:14.815532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=20 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:14.847280 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a07ac1e7-4c01-4353-8697-2fbe189e5300 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.070759 Oct 11 20:00:14.848214 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1942/3961] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:14 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:14.853411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:14.854019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:14.861263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:14.861851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:14.862378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:14.863364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:14.863891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:14.864390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:14.888117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:15.044215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5f28d9cb-f74b-482e-8ee8-730537b992cf tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:15.117559 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5f28d9cb-f74b-482e-8ee8-730537b992cf tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1403 microversion: 2.1 time: 0.648702 Oct 11 20:00:15.118161 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2020/3962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:14 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1403 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:15.128174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:15.129472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:15.162863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:15.163388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:15.164085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:15.168419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:15.169259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:15.170434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:15.249930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:15.250719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:15.251340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:15.254218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lazy-loading 'fault' on Instance uuid 1e1db038-aabe-417a-bb33-f7a83173e7ba {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:00:15.402947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1255c68ae02e4992ac0ea1f8a22dd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c654256334c259ebee814be235a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:15.416566 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-803083e7-d48b-4a54-b9c7-f4dc4e1a55c5 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 200 len: 1359 microversion: 2.1 time: 0.292604 Oct 11 20:00:15.436914 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2021/3963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:15 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 1359 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:15.501988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:15.518472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:15.521981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:15.549875 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ae79bfa9-501f-4ac6-9fe7-7fca911e3fbc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.697090 Oct 11 20:00:15.552064 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1943/3964] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:14 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:15.800529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd9fc2dd-30ff-4ba0-98d1-bebf18e5344f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:15.802041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fd9fc2dd-30ff-4ba0-98d1-bebf18e5344f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:15.809404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd9fc2dd-30ff-4ba0-98d1-bebf18e5344f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:15.811098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd9fc2dd-30ff-4ba0-98d1-bebf18e5344f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:15.811747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd9fc2dd-30ff-4ba0-98d1-bebf18e5344f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:15.812777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd9fc2dd-30ff-4ba0-98d1-bebf18e5344f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:15.813584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd9fc2dd-30ff-4ba0-98d1-bebf18e5344f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:15.814214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd9fc2dd-30ff-4ba0-98d1-bebf18e5344f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:15.871264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0f295dd-6768-420c-83a0-7e28d5562285 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72bcaf0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:15.963088 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a0f295dd-6768-420c-83a0-7e28d5562285 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.098252 Oct 11 20:00:15.963767 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1944/3965] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:15 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:16.147840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-73876cee-fceb-451d-abd1-e7cc97ca023b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:16.149148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-73876cee-fceb-451d-abd1-e7cc97ca023b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:16.170285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73876cee-fceb-451d-abd1-e7cc97ca023b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:16.170285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73876cee-fceb-451d-abd1-e7cc97ca023b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:16.171625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73876cee-fceb-451d-abd1-e7cc97ca023b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:16.171625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73876cee-fceb-451d-abd1-e7cc97ca023b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:16.172036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73876cee-fceb-451d-abd1-e7cc97ca023b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:16.172510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73876cee-fceb-451d-abd1-e7cc97ca023b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:16.214850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fd9fc2dd-30ff-4ba0-98d1-bebf18e5344f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:16.224972 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fd9fc2dd-30ff-4ba0-98d1-bebf18e5344f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1321 microversion: 2.1 time: 0.428820 Oct 11 20:00:16.226647 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2022/3966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:15 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:16.450327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73876cee-fceb-451d-abd1-e7cc97ca023b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:16.456922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:16.457845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] [instance: 1e1db038-aabe-417a-bb33-f7a83173e7ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:16.472374 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-73876cee-fceb-451d-abd1-e7cc97ca023b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1403 microversion: 2.1 time: 0.330258 Oct 11 20:00:16.474354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:16.491076 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1945/3967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:16 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1403 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:16.491833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:16.492290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:16.493170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:16.494866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:16.496823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:16.515032 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] HTTP exception thrown: Instance 1e1db038-aabe-417a-bb33-f7a83173e7ba could not be found. Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Request method failure captured: Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba HTTP/1.1 Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcr8hHLH7BihaxOle_Mw7pCLSZ99iv-62xpFnTDPfqnpNUXkmutzwFN4rTUuZD0Db4jzMANpzF5bnxxQEuyNmx_zF_kQtp4j3ZAG-kVDpgnCCFujEU8e3zgHEqG94-WwOFkGsQ42tn0TZO8Ya-fFq6EL2XHNFEsMry4jdJMcdKS8kas Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: be4c654256334c259ebee814be235a69 Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestJSON-1711452953 Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be4c654256334c259ebee814be235a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be4c654256334c259ebee814be235a69", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be4c654256334c259ebee814be235a69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be4c654256334c259ebee814be235a69"}]}] Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestJSON-1711452953 Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: be4c654256334c259ebee814be235a69 Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestJSON-1711452953 Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestJSON-1711452953-project Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 1255c68ae02e4992ac0ea1f8a22dd80d Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestJSON-1711452953-project Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 1e1db038-aabe-417a-bb33-f7a83173e7ba could not be found. Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '1e1db038-aabe-417a-bb33-f7a83173e7ba'} Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1db038-aabe-417a-bb33-f7a83173e7ba could not be found. Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1db038-aabe-417a-bb33-f7a83173e7ba could not be found. Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:00:16.517127 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:00:16.521148 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:00:16.521148 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:00:16.521148 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:00:16.521148 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:00:16.521148 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:00:16.521148 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1db038-aabe-417a-bb33-f7a83173e7ba could not be found. Oct 11 20:00:16.521148 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:00:16.521148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Returning 404 to user: Instance 1e1db038-aabe-417a-bb33-f7a83173e7ba could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:00:16.521148 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6ce10401-9557-4e50-8c31-fe8316c1f31e tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba" status: 404 len: 111 microversion: 2.1 time: 0.078072 Oct 11 20:00:16.521148 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2023/3968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:16 2022] GET /compute/v2.1/servers/1e1db038-aabe-417a-bb33-f7a83173e7ba => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:00:16.533008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9370611-41bc-4bf5-82bd-88906eee6023 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] Calling method '.version_select at 0x7f83c72bcca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:16.555087 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b9370611-41bc-4bf5-82bd-88906eee6023 tempest-ServersTestJSON-1711452953 tempest-ServersTestJSON-1711452953-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494943510" status: 202 len: 0 microversion: 2.1 time: 0.029444 Oct 11 20:00:16.556072 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1946/3969] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 20:00:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494943510 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:00:16.587222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:16.588069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:16.598063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:16.598767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:16.599352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:16.600376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:16.600835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:16.601262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:16.832899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:16.855653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:16.863334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:16.869334 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fee30d9d-e35e-444e-bf28-ef05e0fb9680 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.289127 Oct 11 20:00:16.872046 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2024/3970] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:16 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:16.979980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-42df8d53-b742-437e-bd22-debb37261fdc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c742f160>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:17.053877 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-42df8d53-b742-437e-bd22-debb37261fdc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.076450 Oct 11 20:00:17.054697 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1947/3971] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:16 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:17.253000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6fa6a5b2-98e5-49ff-a14d-6d4f067d9699 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:17.253620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6fa6a5b2-98e5-49ff-a14d-6d4f067d9699 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:17.265206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fa6a5b2-98e5-49ff-a14d-6d4f067d9699 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:17.265706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fa6a5b2-98e5-49ff-a14d-6d4f067d9699 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:17.266141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fa6a5b2-98e5-49ff-a14d-6d4f067d9699 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:17.268041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fa6a5b2-98e5-49ff-a14d-6d4f067d9699 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:17.272587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fa6a5b2-98e5-49ff-a14d-6d4f067d9699 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:17.273350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fa6a5b2-98e5-49ff-a14d-6d4f067d9699 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:17.504486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f2e60a6b-3815-4635-9152-e35df1ce9980 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:17.506082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f2e60a6b-3815-4635-9152-e35df1ce9980 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:17.514826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6fa6a5b2-98e5-49ff-a14d-6d4f067d9699 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:17.525864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2e60a6b-3815-4635-9152-e35df1ce9980 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:17.526364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2e60a6b-3815-4635-9152-e35df1ce9980 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:17.526828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2e60a6b-3815-4635-9152-e35df1ce9980 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:17.528286 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6fa6a5b2-98e5-49ff-a14d-6d4f067d9699 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1321 microversion: 2.1 time: 0.278988 Oct 11 20:00:17.530244 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2025/3972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:17 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:17.530934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2e60a6b-3815-4635-9152-e35df1ce9980 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:17.531709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2e60a6b-3815-4635-9152-e35df1ce9980 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:17.532386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2e60a6b-3815-4635-9152-e35df1ce9980 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:17.802210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f2e60a6b-3815-4635-9152-e35df1ce9980 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:17.812228 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f2e60a6b-3815-4635-9152-e35df1ce9980 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1403 microversion: 2.1 time: 0.311550 Oct 11 20:00:17.813206 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1948/3973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:17 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1403 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:17.901302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:17.901302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:17.917397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:17.917911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:17.920149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:17.922175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:17.926575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:17.927259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:18.070699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-723ff24b-dcf3-415c-a93a-4455180570ba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c73b33a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:18.112065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:18.148584 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-723ff24b-dcf3-415c-a93a-4455180570ba tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.081624 Oct 11 20:00:18.149182 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1949/3974] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:18 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:18.314473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:18.324689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:18.326354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:18.328042 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f7435d41-0628-474f-8363-0a36e8af585c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.434593 Oct 11 20:00:18.339127 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2026/3975] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:17 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:18.551058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=14 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:18.558709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-152b52e6-bafa-44d4-a9de-3cd02c40b33e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:18.560435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-152b52e6-bafa-44d4-a9de-3cd02c40b33e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:18.589541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152b52e6-bafa-44d4-a9de-3cd02c40b33e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:18.590269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152b52e6-bafa-44d4-a9de-3cd02c40b33e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:18.592853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152b52e6-bafa-44d4-a9de-3cd02c40b33e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:18.594131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152b52e6-bafa-44d4-a9de-3cd02c40b33e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:18.595396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152b52e6-bafa-44d4-a9de-3cd02c40b33e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:18.597187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-152b52e6-bafa-44d4-a9de-3cd02c40b33e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:18.839666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7b0a05eb-6e41-408c-abee-3aae9cc038b2 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:18.840822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7b0a05eb-6e41-408c-abee-3aae9cc038b2 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:18.849322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0a05eb-6e41-408c-abee-3aae9cc038b2 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:18.850083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0a05eb-6e41-408c-abee-3aae9cc038b2 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:18.850939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0a05eb-6e41-408c-abee-3aae9cc038b2 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:18.851919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0a05eb-6e41-408c-abee-3aae9cc038b2 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:18.852875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0a05eb-6e41-408c-abee-3aae9cc038b2 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:18.853512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0a05eb-6e41-408c-abee-3aae9cc038b2 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:19.506161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7b0a05eb-6e41-408c-abee-3aae9cc038b2 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:19.520019 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7b0a05eb-6e41-408c-abee-3aae9cc038b2 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1403 microversion: 2.1 time: 0.684464 Oct 11 20:00:19.524889 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2027/3976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:18 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1403 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:19.546175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1aff91cf-7311-4ab1-8469-1c2d381237fe tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83d07a31f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:19.661063 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1aff91cf-7311-4ab1-8469-1c2d381237fe tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.134543 Oct 11 20:00:19.661983 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2028/3977] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:19 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:19.676383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:19.678296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:19.687430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:19.689085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:19.689985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:19.690872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:19.691502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:19.692073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:19.772970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-152b52e6-bafa-44d4-a9de-3cd02c40b33e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:19.794423 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-152b52e6-bafa-44d4-a9de-3cd02c40b33e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1321 microversion: 2.1 time: 1.239688 Oct 11 20:00:19.796547 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1950/3978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:18 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1321 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:20.551681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-38868504-079e-411b-b956-bee161563229 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:20.554911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-38868504-079e-411b-b956-bee161563229 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:20.591050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38868504-079e-411b-b956-bee161563229 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:20.598261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38868504-079e-411b-b956-bee161563229 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:20.602253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:20.603683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38868504-079e-411b-b956-bee161563229 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:20.612643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38868504-079e-411b-b956-bee161563229 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:20.614235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38868504-079e-411b-b956-bee161563229 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:20.614908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38868504-079e-411b-b956-bee161563229 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:20.619045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:20.630072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:20.631758 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a9ae387f-2ce8-4050-8145-3af5f3a6c6fd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.968382 Oct 11 20:00:20.637540 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2029/3979] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:19 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:20.676747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-52675d6b-6a86-416f-a66f-650107722625 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72c3af0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:20.809982 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-52675d6b-6a86-416f-a66f-650107722625 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.137085 Oct 11 20:00:20.817862 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2030/3980] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:20 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:20.828631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1691588e-da6d-4f3f-ad2e-0a6398d5936f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:20.828979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1691588e-da6d-4f3f-ad2e-0a6398d5936f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:20.857910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1691588e-da6d-4f3f-ad2e-0a6398d5936f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:20.859289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1691588e-da6d-4f3f-ad2e-0a6398d5936f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:20.859737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1691588e-da6d-4f3f-ad2e-0a6398d5936f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:20.860489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1691588e-da6d-4f3f-ad2e-0a6398d5936f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:20.860956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1691588e-da6d-4f3f-ad2e-0a6398d5936f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:20.861386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1691588e-da6d-4f3f-ad2e-0a6398d5936f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:21.699000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-38868504-079e-411b-b956-bee161563229 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:21.709116 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-38868504-079e-411b-b956-bee161563229 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1403 microversion: 2.1 time: 1.161428 Oct 11 20:00:21.717646 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1951/3981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:20 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1403 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:21.748551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1691588e-da6d-4f3f-ad2e-0a6398d5936f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:21.756836 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1691588e-da6d-4f3f-ad2e-0a6398d5936f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1321 microversion: 2.1 time: 0.939414 Oct 11 20:00:21.757440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b4dfcfac-475e-42dc-b57c-542ccd4da069 req-6a202d3f-cfbe-4f9f-b917-854a5efe83ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f536ba50-8666-4272-91ea-a92f7a6e8e87", "name": "network-vif-plugged", "status": "completed", "tag": "e694b9a3-5f3f-446f-af04-99d01ebe47dd"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:21.775213 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2031/3982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:20 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1321 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:21.784035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b4dfcfac-475e-42dc-b57c-542ccd4da069 req-6a202d3f-cfbe-4f9f-b917-854a5efe83ec service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:21.785201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b4dfcfac-475e-42dc-b57c-542ccd4da069 req-6a202d3f-cfbe-4f9f-b917-854a5efe83ec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:21.787141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b4dfcfac-475e-42dc-b57c-542ccd4da069 req-6a202d3f-cfbe-4f9f-b917-854a5efe83ec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:21.796866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:21.797738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:21.808175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:21.812537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:21.813192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:21.816913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:21.817622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:21.819145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:21.822135 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b4dfcfac-475e-42dc-b57c-542ccd4da069 req-6a202d3f-cfbe-4f9f-b917-854a5efe83ec service nova] Creating event network-vif-plugged:e694b9a3-5f3f-446f-af04-99d01ebe47dd for instance f536ba50-8666-4272-91ea-a92f7a6e8e87 on n-h2-860864-3 Oct 11 20:00:21.833060 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b4dfcfac-475e-42dc-b57c-542ccd4da069 req-6a202d3f-cfbe-4f9f-b917-854a5efe83ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097408 Oct 11 20:00:21.834548 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1952/3983] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:21.850244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bf9ca913-bb4e-4f7a-9a23-a707601e9404 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc0f10d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:21.945911 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bf9ca913-bb4e-4f7a-9a23-a707601e9404 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.108296 Oct 11 20:00:21.946982 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1953/3984] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:21 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:22.355185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:22.366085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:22.368650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:22.370771 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f42c79e3-decd-43fd-a218-6d9fe63e766c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.593643 Oct 11 20:00:22.387916 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2032/3985] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:21 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:22.742476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-070637e5-04c0-4905-aed9-0f4c4284fb29 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:22.743929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-070637e5-04c0-4905-aed9-0f4c4284fb29 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:22.763366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-070637e5-04c0-4905-aed9-0f4c4284fb29 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:22.767774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-070637e5-04c0-4905-aed9-0f4c4284fb29 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:22.773477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-070637e5-04c0-4905-aed9-0f4c4284fb29 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:22.774938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-070637e5-04c0-4905-aed9-0f4c4284fb29 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:22.775419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-070637e5-04c0-4905-aed9-0f4c4284fb29 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:22.775852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-070637e5-04c0-4905-aed9-0f4c4284fb29 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:22.791644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-32ec6d9e-11c0-413b-a68d-62e0b138ea5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:22.792390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-32ec6d9e-11c0-413b-a68d-62e0b138ea5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:22.804808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ec6d9e-11c0-413b-a68d-62e0b138ea5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:22.805884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ec6d9e-11c0-413b-a68d-62e0b138ea5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:22.808425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ec6d9e-11c0-413b-a68d-62e0b138ea5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:22.809459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ec6d9e-11c0-413b-a68d-62e0b138ea5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:22.811605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ec6d9e-11c0-413b-a68d-62e0b138ea5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:22.812300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32ec6d9e-11c0-413b-a68d-62e0b138ea5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:23.467015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-32ec6d9e-11c0-413b-a68d-62e0b138ea5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:23.477567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-070637e5-04c0-4905-aed9-0f4c4284fb29 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:23.482517 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-32ec6d9e-11c0-413b-a68d-62e0b138ea5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1321 microversion: 2.1 time: 0.694592 Oct 11 20:00:23.505063 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-070637e5-04c0-4905-aed9-0f4c4284fb29 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1403 microversion: 2.1 time: 0.767211 Oct 11 20:00:23.505549 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2033/3986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:22 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1321 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:23.506584 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1954/3987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:22 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1403 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:23.521423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:23.522818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6fa78439-e376-4f59-9a92-debc118dfab2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c7382790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:23.525810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:23.540842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:23.542777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:23.543408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:23.545014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:23.545827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:23.546438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:23.655526 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6fa78439-e376-4f59-9a92-debc118dfab2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.146454 Oct 11 20:00:23.672281 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2034/3988] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:23 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:23.989035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-e0f20ca5-d49f-48b9-a2d4-a9728008f351 req-e8bd96de-2661-4a40-b32c-23d48e2bc3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f563b39-da5e-4d96-a6d4-ee6642d668a3", "name": "network-vif-plugged", "status": "completed", "tag": "f6d0e7a7-dee9-44a5-9015-7bb817c9e400"}, {"server_uuid": "bf9003fd-01af-4756-9492-3a213041cdfd", "name": "network-vif-plugged", "status": "completed", "tag": "9588333b-d35f-44e4-99b7-e36269b187ad"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:24.043958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e0f20ca5-d49f-48b9-a2d4-a9728008f351 req-e8bd96de-2661-4a40-b32c-23d48e2bc3c9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:24.052859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e0f20ca5-d49f-48b9-a2d4-a9728008f351 req-e8bd96de-2661-4a40-b32c-23d48e2bc3c9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:24.053514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e0f20ca5-d49f-48b9-a2d4-a9728008f351 req-e8bd96de-2661-4a40-b32c-23d48e2bc3c9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:24.098759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:24.108712 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-e0f20ca5-d49f-48b9-a2d4-a9728008f351 req-e8bd96de-2661-4a40-b32c-23d48e2bc3c9 service nova] Creating event network-vif-plugged:f6d0e7a7-dee9-44a5-9015-7bb817c9e400 for instance 5f563b39-da5e-4d96-a6d4-ee6642d668a3 on n-h2-860864-3 Oct 11 20:00:24.109337 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-e0f20ca5-d49f-48b9-a2d4-a9728008f351 req-e8bd96de-2661-4a40-b32c-23d48e2bc3c9 service nova] Creating event network-vif-plugged:9588333b-d35f-44e4-99b7-e36269b187ad for instance bf9003fd-01af-4756-9492-3a213041cdfd on n-h2-860864-3 Oct 11 20:00:24.119502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:24.124074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:24.126074 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-27c2c9dd-5092-4db0-8fc8-c20ae1b0ee80 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.617869 Oct 11 20:00:24.128191 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-e0f20ca5-d49f-48b9-a2d4-a9728008f351 req-e8bd96de-2661-4a40-b32c-23d48e2bc3c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.143661 Oct 11 20:00:24.130946 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1955/3989] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:23 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:24.151722 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2035/3990] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:24.521236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58b7cb0b-5921-499b-9e3d-895d373a4e05 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:24.521948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58b7cb0b-5921-499b-9e3d-895d373a4e05 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:24.559194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b7cb0b-5921-499b-9e3d-895d373a4e05 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:24.562304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b7cb0b-5921-499b-9e3d-895d373a4e05 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:24.563681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b7cb0b-5921-499b-9e3d-895d373a4e05 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:24.569103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b7cb0b-5921-499b-9e3d-895d373a4e05 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:24.571444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b7cb0b-5921-499b-9e3d-895d373a4e05 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:24.574498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58b7cb0b-5921-499b-9e3d-895d373a4e05 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:24.596361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8156612f-c374-4354-be30-b3fcbf61ae1b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:24.597211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8156612f-c374-4354-be30-b3fcbf61ae1b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:24.625390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8156612f-c374-4354-be30-b3fcbf61ae1b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:24.626244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8156612f-c374-4354-be30-b3fcbf61ae1b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:24.626918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8156612f-c374-4354-be30-b3fcbf61ae1b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:24.628127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8156612f-c374-4354-be30-b3fcbf61ae1b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:24.628797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8156612f-c374-4354-be30-b3fcbf61ae1b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:24.629761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8156612f-c374-4354-be30-b3fcbf61ae1b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:25.005957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8156612f-c374-4354-be30-b3fcbf61ae1b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:25.021542 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8156612f-c374-4354-be30-b3fcbf61ae1b tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1403 microversion: 2.1 time: 0.430380 Oct 11 20:00:25.025260 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2036/3991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:24 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1403 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:25.041733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e69f5e7-cfb0-4b3d-aa2b-15b04bfa8963 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c7382040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:25.154452 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e69f5e7-cfb0-4b3d-aa2b-15b04bfa8963 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.127799 Oct 11 20:00:25.162367 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2037/3992] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:25 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:25.162834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58b7cb0b-5921-499b-9e3d-895d373a4e05 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:25.172706 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58b7cb0b-5921-499b-9e3d-895d373a4e05 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1503 microversion: 2.1 time: 0.658066 Oct 11 20:00:25.181638 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1956/3993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:24 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1503 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:25.185608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:25.186449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:25.211269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-82e9b1a1-747d-4cbe-a558-d0664c1ff4cb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:25.211910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-82e9b1a1-747d-4cbe-a558-d0664c1ff4cb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:25.218200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:25.222190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:25.222777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:25.223549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:25.224030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:25.232118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:25.235623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82e9b1a1-747d-4cbe-a558-d0664c1ff4cb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:25.242375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82e9b1a1-747d-4cbe-a558-d0664c1ff4cb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:25.243064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82e9b1a1-747d-4cbe-a558-d0664c1ff4cb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:25.244938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82e9b1a1-747d-4cbe-a558-d0664c1ff4cb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:25.252379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82e9b1a1-747d-4cbe-a558-d0664c1ff4cb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:25.253095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82e9b1a1-747d-4cbe-a558-d0664c1ff4cb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:25.843857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-82e9b1a1-747d-4cbe-a558-d0664c1ff4cb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:25.854370 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-82e9b1a1-747d-4cbe-a558-d0664c1ff4cb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1503 microversion: 2.1 time: 0.649911 Oct 11 20:00:25.858728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:25.867950 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1957/3994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:25 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1503 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:25.870612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:25.873741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:25.875756 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc5bd8ef-b2f6-4b0c-9ff6-fdc31af44d21 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.719167 Oct 11 20:00:25.876987 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2038/3995] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:25 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:25.879831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b38897a8-9370-4fb4-85f9-9d216d43e72a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:25.880335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b38897a8-9370-4fb4-85f9-9d216d43e72a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:25.887029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b38897a8-9370-4fb4-85f9-9d216d43e72a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:25.888506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b38897a8-9370-4fb4-85f9-9d216d43e72a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:25.889100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b38897a8-9370-4fb4-85f9-9d216d43e72a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:25.890035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b38897a8-9370-4fb4-85f9-9d216d43e72a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:25.890818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b38897a8-9370-4fb4-85f9-9d216d43e72a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:25.891384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b38897a8-9370-4fb4-85f9-9d216d43e72a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:25.936085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b38897a8-9370-4fb4-85f9-9d216d43e72a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:00:26.062356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cdd6d694-609d-4473-b079-af2a1b2942e0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:26.064211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cdd6d694-609d-4473-b079-af2a1b2942e0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:26.074184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdd6d694-609d-4473-b079-af2a1b2942e0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:26.075001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdd6d694-609d-4473-b079-af2a1b2942e0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:26.075746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdd6d694-609d-4473-b079-af2a1b2942e0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:26.076682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdd6d694-609d-4473-b079-af2a1b2942e0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:26.077296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdd6d694-609d-4473-b079-af2a1b2942e0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:26.077864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdd6d694-609d-4473-b079-af2a1b2942e0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:26.113178 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b38897a8-9370-4fb4-85f9-9d216d43e72a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 204 len: 0 microversion: 2.1 time: 0.236992 Oct 11 20:00:26.114074 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1958/3996] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:00:25 2022] DELETE /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:00:26.119788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:26.124567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5f62976-a8d7-4f18-aed6-0cd875a44935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:26.133552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f5f62976-a8d7-4f18-aed6-0cd875a44935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:26.162416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5f62976-a8d7-4f18-aed6-0cd875a44935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:26.164081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5f62976-a8d7-4f18-aed6-0cd875a44935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:26.167750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5f62976-a8d7-4f18-aed6-0cd875a44935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:26.168714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5f62976-a8d7-4f18-aed6-0cd875a44935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:26.171581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5f62976-a8d7-4f18-aed6-0cd875a44935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:26.172870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5f62976-a8d7-4f18-aed6-0cd875a44935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:26.395139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cdd6d694-609d-4473-b079-af2a1b2942e0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:26.406386 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cdd6d694-609d-4473-b079-af2a1b2942e0 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1589 microversion: 2.1 time: 0.355350 Oct 11 20:00:26.407674 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2039/3997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:26 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1589 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:26.412459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e24158a3-e8e1-441b-8128-0454dbcfa85e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c735f1f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:26.433161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f5f62976-a8d7-4f18-aed6-0cd875a44935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:26.443139 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f5f62976-a8d7-4f18-aed6-0cd875a44935 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1509 microversion: 2.1 time: 0.323955 Oct 11 20:00:26.444313 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1959/3998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:26 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:26.452343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7987cd61-a5d9-4f5f-8870-a66ffdcc9d0d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:26.453003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7987cd61-a5d9-4f5f-8870-a66ffdcc9d0d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:26.460647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7987cd61-a5d9-4f5f-8870-a66ffdcc9d0d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:26.461432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7987cd61-a5d9-4f5f-8870-a66ffdcc9d0d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:26.462022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7987cd61-a5d9-4f5f-8870-a66ffdcc9d0d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:26.463062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7987cd61-a5d9-4f5f-8870-a66ffdcc9d0d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:26.463775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7987cd61-a5d9-4f5f-8870-a66ffdcc9d0d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:26.464501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7987cd61-a5d9-4f5f-8870-a66ffdcc9d0d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:26.484762 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e24158a3-e8e1-441b-8128-0454dbcfa85e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.075688 Oct 11 20:00:26.485887 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2040/3999] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:26 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:26.597649 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7987cd61-a5d9-4f5f-8870-a66ffdcc9d0d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151720 Oct 11 20:00:26.598576 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1960/4000] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:00:26 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:26.911446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:26.913744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:26.923395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:26.925895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:26.927207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:26.927982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:26.928588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:26.929415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:27.490749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1f33d121-df3f-4d22-bed0-60f9318a9833 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:27.492545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f33d121-df3f-4d22-bed0-60f9318a9833 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:27.527350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:27.538350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:27.544607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f33d121-df3f-4d22-bed0-60f9318a9833 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:27.545127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f33d121-df3f-4d22-bed0-60f9318a9833 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:27.546166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:27.556632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f33d121-df3f-4d22-bed0-60f9318a9833 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:27.558320 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cfe8b7a5-2439-49b6-98fa-365a76703650 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1744 microversion: 2.20 time: 0.654552 Oct 11 20:00:27.558459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f33d121-df3f-4d22-bed0-60f9318a9833 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:27.559277 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2041/4001] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:26 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1744 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:27.562839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f33d121-df3f-4d22-bed0-60f9318a9833 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:27.564216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f33d121-df3f-4d22-bed0-60f9318a9833 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:27.567590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5d80fb4b-8f55-4cd2-9437-2253b872ca45 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc66d820>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:27.670655 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5d80fb4b-8f55-4cd2-9437-2253b872ca45 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.109863 Oct 11 20:00:27.671254 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2042/4002] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:27 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:28.199835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1f33d121-df3f-4d22-bed0-60f9318a9833 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:28.213052 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1f33d121-df3f-4d22-bed0-60f9318a9833 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1509 microversion: 2.1 time: 0.744399 Oct 11 20:00:28.214886 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1961/4003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:27 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1509 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:28.592443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:28.594863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:28.605659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:28.607219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:28.607968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:28.617494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:28.618213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:28.618871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:28.689293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cef82d08-0f75-4507-b4f9-13f3d0279ebc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c730ec10>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:28.792428 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cef82d08-0f75-4507-b4f9-13f3d0279ebc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1411 microversion: 2.1 time: 0.109637 Oct 11 20:00:28.793052 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1962/4004] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:28 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:29.241577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4648ae8-d312-4b07-a725-53bec66a7e77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:29.242420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a4648ae8-d312-4b07-a725-53bec66a7e77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:29.258701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4648ae8-d312-4b07-a725-53bec66a7e77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:29.261669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4648ae8-d312-4b07-a725-53bec66a7e77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:29.262600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4648ae8-d312-4b07-a725-53bec66a7e77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:29.267016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4648ae8-d312-4b07-a725-53bec66a7e77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:29.269041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4648ae8-d312-4b07-a725-53bec66a7e77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:29.269760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4648ae8-d312-4b07-a725-53bec66a7e77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:29.978905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:30.000557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:30.002290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:30.003630 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3cd216f9-7b95-40b4-a2f8-6766a148d7d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1744 microversion: 2.20 time: 1.415550 Oct 11 20:00:30.019393 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2043/4005] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:28 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1744 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:30.039917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9ef59715-55d9-4c69-bdc0-2a7caa58fedd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c735fca0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:30.507640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a4648ae8-d312-4b07-a725-53bec66a7e77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:30.528126 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a4648ae8-d312-4b07-a725-53bec66a7e77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 200 len: 1509 microversion: 2.1 time: 1.292936 Oct 11 20:00:30.547159 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1963/4006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:29 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 1509 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:30.564151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ab5bd3c3-fc6c-420d-b032-dd298b64aa03 req-9c0b6bbb-d39c-48dd-9d1f-5813394c8a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f536ba50-8666-4272-91ea-a92f7a6e8e87", "name": "network-vif-deleted", "tag": "e694b9a3-5f3f-446f-af04-99d01ebe47dd"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:30.586210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab5bd3c3-fc6c-420d-b032-dd298b64aa03 req-9c0b6bbb-d39c-48dd-9d1f-5813394c8a45 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:30.588181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab5bd3c3-fc6c-420d-b032-dd298b64aa03 req-9c0b6bbb-d39c-48dd-9d1f-5813394c8a45 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:30.591526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab5bd3c3-fc6c-420d-b032-dd298b64aa03 req-9c0b6bbb-d39c-48dd-9d1f-5813394c8a45 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:30.608739 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ab5bd3c3-fc6c-420d-b032-dd298b64aa03 req-9c0b6bbb-d39c-48dd-9d1f-5813394c8a45 service nova] Creating event network-vif-deleted:e694b9a3-5f3f-446f-af04-99d01ebe47dd for instance f536ba50-8666-4272-91ea-a92f7a6e8e87 on n-h2-860864-3 Oct 11 20:00:30.627903 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ab5bd3c3-fc6c-420d-b032-dd298b64aa03 req-9c0b6bbb-d39c-48dd-9d1f-5813394c8a45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079101 Oct 11 20:00:30.632337 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1964/4007] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:31.036548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:31.038119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:31.091876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:31.102957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:31.104787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:31.108775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:31.120326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:31.120788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:31.539737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:31.553865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:31.565684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:31.567583 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-59912659-7bbb-49e8-9824-4bc491be1ad4 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1739 microversion: 2.20 time: 0.539428 Oct 11 20:00:31.596721 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1965/4008] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:31 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1739 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:00:31.604126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a8fd7bfc-d5c4-4603-ae79-dc0247954c79 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:31.622696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a8fd7bfc-d5c4-4603-ae79-dc0247954c79 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:31.651755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8fd7bfc-d5c4-4603-ae79-dc0247954c79 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:31.655902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8fd7bfc-d5c4-4603-ae79-dc0247954c79 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:31.656544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8fd7bfc-d5c4-4603-ae79-dc0247954c79 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:31.657469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8fd7bfc-d5c4-4603-ae79-dc0247954c79 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:31.658624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8fd7bfc-d5c4-4603-ae79-dc0247954c79 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:31.659573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8fd7bfc-d5c4-4603-ae79-dc0247954c79 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:31.672961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:32.475134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a8fd7bfc-d5c4-4603-ae79-dc0247954c79 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:32.484324 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a8fd7bfc-d5c4-4603-ae79-dc0247954c79 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1589 microversion: 2.1 time: 0.886246 Oct 11 20:00:32.491159 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1966/4009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:31 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1589 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:32.503768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:32.507343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:32.520565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:32.521453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:32.525039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:32.526195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:32.526944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:32.529054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:32.576377 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 HTTP/1.1 Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f536ba50-8666-4272-91ea-a92f7a6e8e87'} Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:00:32.580711 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:32.585004 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:00:32.585004 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:00:32.585004 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:00:32.585004 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:00:32.585004 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:00:32.585004 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:00:32.585004 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:00:32.591148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:00:32.594183 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7ba90c22-a387-4872-bfd6-5f87fce78261 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 404 len: 111 microversion: 2.1 time: 0.100154 Oct 11 20:00:32.597328 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1967/4010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:32 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:00:32.616967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:32.619206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:32.640092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:32.644005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:32.644507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:32.645275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:32.645932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:32.652197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:33.156087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:33.170153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:33.185112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:33.189015 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f682e091-db38-4416-b7d4-84b37790876f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1739 microversion: 2.20 time: 0.579859 Oct 11 20:00:33.197964 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1968/4011] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:32 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1739 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:33.250735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-19845fb7-9ecd-4d67-844d-0623c3803c65 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'create', calling method: .version_select at 0x7f83c73b3ca0>, body: {"keypair": {"name": "tempest-key-443303125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbc+S3XM1hqF5RAFs0ZsxC9/SFwawv00MbAS0HxuhmtvnQUeI8NSYavpWQANCBdMs2z1/beUa2bpIGkOfew5p7WCSw3Z8LtBeGGaGxqYu+tTHmcIbR+ib5UKCEkk9wJSQ=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:33.302321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-19845fb7-9ecd-4d67-844d-0623c3803c65 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:00:33.321104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-19845fb7-9ecd-4d67-844d-0623c3803c65 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for user a84c2531dcb24cce9872808db6c1fa6d and project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:00:33.399013 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-19845fb7-9ecd-4d67-844d-0623c3803c65 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.189240 Oct 11 20:00:33.399636 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1969/4012] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:00:33 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:33.418097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b910a8ab-667e-46d9-bcb0-c5ae6dd05d72 req-5c958d5d-e24d-4b6d-96fb-410ca49d97d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f563b39-da5e-4d96-a6d4-ee6642d668a3", "tag": "f6d0e7a7-dee9-44a5-9015-7bb817c9e400"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:33.463541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b910a8ab-667e-46d9-bcb0-c5ae6dd05d72 req-5c958d5d-e24d-4b6d-96fb-410ca49d97d7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:33.464556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b910a8ab-667e-46d9-bcb0-c5ae6dd05d72 req-5c958d5d-e24d-4b6d-96fb-410ca49d97d7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:33.466481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b910a8ab-667e-46d9-bcb0-c5ae6dd05d72 req-5c958d5d-e24d-4b6d-96fb-410ca49d97d7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:33.494343 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b910a8ab-667e-46d9-bcb0-c5ae6dd05d72 req-5c958d5d-e24d-4b6d-96fb-410ca49d97d7 service nova] Creating event network-changed:f6d0e7a7-dee9-44a5-9015-7bb817c9e400 for instance 5f563b39-da5e-4d96-a6d4-ee6642d668a3 on n-h2-860864-3 Oct 11 20:00:33.553394 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b910a8ab-667e-46d9-bcb0-c5ae6dd05d72 req-5c958d5d-e24d-4b6d-96fb-410ca49d97d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132069 Oct 11 20:00:33.558637 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1970/4013] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:33.574283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-75354b01-38fd-4598-a77c-9ed4ef618ea0 req-88d7137f-6997-429e-8354-f2e41a46c5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e65c53-e164-4255-a2b8-4338069b7e47", "name": "network-vif-plugged", "status": "completed", "tag": "f7bf35aa-741b-418c-92ae-e8af14cd5a52"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:33.606135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-75354b01-38fd-4598-a77c-9ed4ef618ea0 req-88d7137f-6997-429e-8354-f2e41a46c5bc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:33.607950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-75354b01-38fd-4598-a77c-9ed4ef618ea0 req-88d7137f-6997-429e-8354-f2e41a46c5bc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:33.608419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-75354b01-38fd-4598-a77c-9ed4ef618ea0 req-88d7137f-6997-429e-8354-f2e41a46c5bc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:33.644231 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-75354b01-38fd-4598-a77c-9ed4ef618ea0 req-88d7137f-6997-429e-8354-f2e41a46c5bc service nova] Creating event network-vif-plugged:f7bf35aa-741b-418c-92ae-e8af14cd5a52 for instance 34e65c53-e164-4255-a2b8-4338069b7e47 on n-h2-860864-3 Oct 11 20:00:33.662874 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-75354b01-38fd-4598-a77c-9ed4ef618ea0 req-88d7137f-6997-429e-8354-f2e41a46c5bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101257 Oct 11 20:00:33.663508 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1971/4014] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:33.689277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6a87c608-0a77-443b-b69c-5aa75e6cb771 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '.version_select at 0x7f83c7246d30>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:33.723887 n-d-860864-3 devstack@n-api.service[126955]: WARNING oslo_db.sqlalchemy.utils [None req-6a87c608-0a77-443b-b69c-5aa75e6cb771 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 20:00:33.746658 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6a87c608-0a77-443b-b69c-5aa75e6cb771 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.071356 Oct 11 20:00:33.761440 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1972/4015] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 20:00:33 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:33.785782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a57dd0b7-6dc6-40a4-80f7-b33c350e49e6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:33.788249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a57dd0b7-6dc6-40a4-80f7-b33c350e49e6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:33.808323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:33.817092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a57dd0b7-6dc6-40a4-80f7-b33c350e49e6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:33.820288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a57dd0b7-6dc6-40a4-80f7-b33c350e49e6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:33.821777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a57dd0b7-6dc6-40a4-80f7-b33c350e49e6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:33.829544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a57dd0b7-6dc6-40a4-80f7-b33c350e49e6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:33.830336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a57dd0b7-6dc6-40a4-80f7-b33c350e49e6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:33.831020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a57dd0b7-6dc6-40a4-80f7-b33c350e49e6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:34.670235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a57dd0b7-6dc6-40a4-80f7-b33c350e49e6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:34.689409 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a57dd0b7-6dc6-40a4-80f7-b33c350e49e6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.924899 Oct 11 20:00:34.690400 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1973/4016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:33 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:34.700706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-940010347", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "key_name": "tempest-key-443303125", "networks": [{"uuid": "4bda9a14-e746-4951-9d43-234855a05a4d"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:38.607214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:39.987507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=14 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:41.438134 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9ef59715-55d9-4c69-bdc0-2a7caa58fedd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1420 microversion: 2.1 time: 11.416173 Oct 11 20:00:41.445651 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2044/4017] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:30 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1420 bytes in 11421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:41.450473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] validate_networks() for [('4bda9a14-e746-4951-9d43-234855a05a4d', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:00:41.462000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:41.462658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:41.495955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:41.497529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:41.498132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:41.499200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:41.499893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:41.500558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:41.999171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:42.008465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:42.009917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:42.022695 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-54adc170-2100-43fc-87b7-b29fbb7913e3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1739 microversion: 2.20 time: 0.575077 Oct 11 20:00:42.023326 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2045/4018] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:41 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1739 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:42.038814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cefaf277-b8f1-4dbd-9473-edc1e4dff01d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:42.039816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cefaf277-b8f1-4dbd-9473-edc1e4dff01d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:42.056698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cefaf277-b8f1-4dbd-9473-edc1e4dff01d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:42.061383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cefaf277-b8f1-4dbd-9473-edc1e4dff01d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:42.062016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cefaf277-b8f1-4dbd-9473-edc1e4dff01d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:42.062792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cefaf277-b8f1-4dbd-9473-edc1e4dff01d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:42.063335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cefaf277-b8f1-4dbd-9473-edc1e4dff01d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:42.063835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cefaf277-b8f1-4dbd-9473-edc1e4dff01d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:42.405288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cefaf277-b8f1-4dbd-9473-edc1e4dff01d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:42.419366 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cefaf277-b8f1-4dbd-9473-edc1e4dff01d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.390645 Oct 11 20:00:42.420308 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2046/4019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:42 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:42.439752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b415c46f-fa8b-4435-8fa9-5fb5f6f5b2e5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72e1280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:42.526230 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b415c46f-fa8b-4435-8fa9-5fb5f6f5b2e5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 200 len: 1420 microversion: 2.1 time: 0.104072 Oct 11 20:00:42.530992 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2047/4020] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:00:42 2022] GET /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:42.545306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bcf9b4eb-271e-4d97-8a7a-4dc3758ca585 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:42.546051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bcf9b4eb-271e-4d97-8a7a-4dc3758ca585 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:42.563051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcf9b4eb-271e-4d97-8a7a-4dc3758ca585 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:42.563628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcf9b4eb-271e-4d97-8a7a-4dc3758ca585 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:42.564685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcf9b4eb-271e-4d97-8a7a-4dc3758ca585 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:42.565588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcf9b4eb-271e-4d97-8a7a-4dc3758ca585 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:42.567241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcf9b4eb-271e-4d97-8a7a-4dc3758ca585 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:42.567690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcf9b4eb-271e-4d97-8a7a-4dc3758ca585 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:42.627776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:00:42.628197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:00:42.628675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:00:42.629095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:00:42.629514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:00:42.648721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:42.650320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:42.657664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:42.658698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:42.659862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:42.660596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:42.720019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:00:42.731297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for user a84c2531dcb24cce9872808db6c1fa6d and project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:00:42.765933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:00:42.781995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:00:42.899131 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97f27459-e8d5-46b8-aa5b-8301f5c3734d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.205940 Oct 11 20:00:42.900251 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1974/4021] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 8208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:00:42.900387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bcf9b4eb-271e-4d97-8a7a-4dc3758ca585 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:42.909954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-72e07a86-5426-4dfe-a1b1-51ec7442190d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c73b3040>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:42.913953 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bcf9b4eb-271e-4d97-8a7a-4dc3758ca585 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.379877 Oct 11 20:00:42.915062 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2048/4022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:42 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:42.920837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-df4a5b02-edc7-406f-aae9-c4bc93cc78bd tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:42.921446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-df4a5b02-edc7-406f-aae9-c4bc93cc78bd tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:43.085822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-df4a5b02-edc7-406f-aae9-c4bc93cc78bd tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:43.099375 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-df4a5b02-edc7-406f-aae9-c4bc93cc78bd tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1227 microversion: 2.1 time: 0.183012 Oct 11 20:00:43.115403 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2049/4023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:42 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1227 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:43.121280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee5f4830-871a-42c7-80a9-f0643f610459 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:43.126410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ee5f4830-871a-42c7-80a9-f0643f610459 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:43.141561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee5f4830-871a-42c7-80a9-f0643f610459 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:43.142071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee5f4830-871a-42c7-80a9-f0643f610459 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:43.142513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee5f4830-871a-42c7-80a9-f0643f610459 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:43.143251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee5f4830-871a-42c7-80a9-f0643f610459 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:43.144324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee5f4830-871a-42c7-80a9-f0643f610459 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:43.147313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee5f4830-871a-42c7-80a9-f0643f610459 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:43.510269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ee5f4830-871a-42c7-80a9-f0643f610459 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:43.531221 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ee5f4830-871a-42c7-80a9-f0643f610459 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.414528 Oct 11 20:00:43.547729 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2050/4024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:43 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:43.923201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-963824055", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:44.329445 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-72e07a86-5426-4dfe-a1b1-51ec7442190d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 204 len: 0 microversion: 2.1 time: 1.428118 Oct 11 20:00:44.333183 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1975/4025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:42 2022] DELETE /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 0 bytes in 1429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:00:44.339271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:44.342155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:44.368199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:44.369768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:44.375275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:44.377730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:44.380525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:44.381171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:44.403469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] validate_networks() for [('a9efb5bf-6432-41d5-b4f1-9dacc91bbe55', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:00:44.914630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:44.928883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:44.935612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:44.937344 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-388145a0-6791-4b8b-a547-5a6e8152ec78 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1739 microversion: 2.20 time: 0.602714 Oct 11 20:00:44.942093 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1976/4026] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:44 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1739 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:44.968734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1771566677", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "35295b7c-4089-4c98-81b0-9cc1d9c13721"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:45.092902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] validate_networks() for [('35295b7c-4089-4c98-81b0-9cc1d9c13721', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:00:45.860867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:00:45.866632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:00:45.869072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:00:45.869763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:00:45.870744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:00:45.889311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:45.889825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:45.891917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:45.892699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:45.896723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:45.897465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:45.950993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Getting quotas for project f8f60b56d4134dc386dc502b26f193ae. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:00:45.959564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Getting quotas for user 639fa589545d478da41b8632e5eb2faa and project f8f60b56d4134dc386dc502b26f193ae. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:00:45.981486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:00:45.984207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:00:46.113193 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3fbe7690-acaf-4e42-98f5-a7b6a286853c tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.564150 Oct 11 20:00:46.114259 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2051/4027] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:00:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:00:46.124949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8505ec4e-7f21-4ae8-8808-9343f1280868 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:46.125950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8505ec4e-7f21-4ae8-8808-9343f1280868 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:46.140051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8505ec4e-7f21-4ae8-8808-9343f1280868 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:46.141193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8505ec4e-7f21-4ae8-8808-9343f1280868 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:46.141889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8505ec4e-7f21-4ae8-8808-9343f1280868 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:46.148316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8505ec4e-7f21-4ae8-8808-9343f1280868 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:46.149076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8505ec4e-7f21-4ae8-8808-9343f1280868 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:46.151319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8505ec4e-7f21-4ae8-8808-9343f1280868 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:46.304583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:00:46.305663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:00:46.306402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:00:46.306943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:00:46.307582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:00:46.343266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:46.344993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:46.348274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:46.349499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:46.350218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:46.352564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:46.353817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8505ec4e-7f21-4ae8-8808-9343f1280868 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:46.370973 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8505ec4e-7f21-4ae8-8808-9343f1280868 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1285 microversion: 2.1 time: 0.255229 Oct 11 20:00:46.376594 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2052/4028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:46 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1285 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:46.388020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f6d1124-c5e8-4367-8043-55bdc2f23748 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:46.390565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f6d1124-c5e8-4367-8043-55bdc2f23748 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:46.406859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f6d1124-c5e8-4367-8043-55bdc2f23748 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:46.408257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f6d1124-c5e8-4367-8043-55bdc2f23748 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:46.411036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f6d1124-c5e8-4367-8043-55bdc2f23748 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:46.413116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f6d1124-c5e8-4367-8043-55bdc2f23748 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:46.413779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f6d1124-c5e8-4367-8043-55bdc2f23748 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:46.416545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f6d1124-c5e8-4367-8043-55bdc2f23748 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:46.455833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for project efd1bdcd18f14e87925a5b41393b9add. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:00:46.471754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for user 0647dca89de240ba9fbc1c59ed2b6392 and project efd1bdcd18f14e87925a5b41393b9add. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:00:46.488756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f6d1124-c5e8-4367-8043-55bdc2f23748 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:00:46.507288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:00:46.513171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:00:46.650126 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f3d8d190-28e0-4c95-a86d-4ea1f3a202dd tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.704175 Oct 11 20:00:46.655337 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1977/4029] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:00:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:00:46.685338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:46.690640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:46.717263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:46.718024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:46.718802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:46.719859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:46.721599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:46.722220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:46.738444 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f6d1124-c5e8-4367-8043-55bdc2f23748 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 204 len: 0 microversion: 2.1 time: 0.360065 Oct 11 20:00:46.739133 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2053/4030] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:00:46 2022] DELETE /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:00:46.784493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c8c1bd7-0747-4f73-88c6-f4635acd08a4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:46.787751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c8c1bd7-0747-4f73-88c6-f4635acd08a4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:47.160981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c8c1bd7-0747-4f73-88c6-f4635acd08a4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:47.172744 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c8c1bd7-0747-4f73-88c6-f4635acd08a4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1213 microversion: 2.1 time: 0.432349 Oct 11 20:00:47.186788 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2054/4031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:46 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1213 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:47.195614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9fe8a76b-9447-4568-a968-51144ce9f17b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:47.217310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9fe8a76b-9447-4568-a968-51144ce9f17b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:48.488254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9fe8a76b-9447-4568-a968-51144ce9f17b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:48.515733 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9fe8a76b-9447-4568-a968-51144ce9f17b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1215 microversion: 2.1 time: 1.335333 Oct 11 20:00:48.516729 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2055/4032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:47 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1215 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:48.531653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-585539428", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "95e3b674-0b5e-40c7-945c-485aa05d6c41"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:48.624760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:48.663804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] validate_networks() for [('95e3b674-0b5e-40c7-945c-485aa05d6c41', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:00:48.669648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:48.677620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:48.684940 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc9b0a2c-57af-4782-a0ee-c1d1254b7396 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1739 microversion: 2.20 time: 2.023600 Oct 11 20:00:48.687723 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1978/4033] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:46 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1739 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:48.700592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62a003aa-1d33-48f1-ba82-cc243202fbf1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:48.702113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-62a003aa-1d33-48f1-ba82-cc243202fbf1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:48.731078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62a003aa-1d33-48f1-ba82-cc243202fbf1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:48.731754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62a003aa-1d33-48f1-ba82-cc243202fbf1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:48.732500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62a003aa-1d33-48f1-ba82-cc243202fbf1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:48.754238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62a003aa-1d33-48f1-ba82-cc243202fbf1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:48.757982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62a003aa-1d33-48f1-ba82-cc243202fbf1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:48.758452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62a003aa-1d33-48f1-ba82-cc243202fbf1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:50.019536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-62a003aa-1d33-48f1-ba82-cc243202fbf1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:50.035010 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-62a003aa-1d33-48f1-ba82-cc243202fbf1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1327 microversion: 2.1 time: 1.345987 Oct 11 20:00:50.043384 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1979/4034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:48 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1327 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:50.055752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4795aded-6c8b-4d05-ab75-e6e5211e9eba req-83535e2f-b4c4-46d2-b72d-5c578c3fe1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9003fd-01af-4756-9492-3a213041cdfd", "name": "network-vif-unplugged", "status": "completed", "tag": "9588333b-d35f-44e4-99b7-e36269b187ad"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:50.088614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4795aded-6c8b-4d05-ab75-e6e5211e9eba req-83535e2f-b4c4-46d2-b72d-5c578c3fe1f4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:50.090483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4795aded-6c8b-4d05-ab75-e6e5211e9eba req-83535e2f-b4c4-46d2-b72d-5c578c3fe1f4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:50.091146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4795aded-6c8b-4d05-ab75-e6e5211e9eba req-83535e2f-b4c4-46d2-b72d-5c578c3fe1f4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:50.120734 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4795aded-6c8b-4d05-ab75-e6e5211e9eba req-83535e2f-b4c4-46d2-b72d-5c578c3fe1f4 service nova] Creating event network-vif-unplugged:9588333b-d35f-44e4-99b7-e36269b187ad for instance bf9003fd-01af-4756-9492-3a213041cdfd on n-h2-860864-3 Oct 11 20:00:50.143502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4795aded-6c8b-4d05-ab75-e6e5211e9eba req-83535e2f-b4c4-46d2-b72d-5c578c3fe1f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097752 Oct 11 20:00:50.147924 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1980/4035] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:50.157616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b3f504dd-be4d-41cd-9edb-c68a8a4d3795 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:50.160281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b3f504dd-be4d-41cd-9edb-c68a8a4d3795 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:50.185018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3f504dd-be4d-41cd-9edb-c68a8a4d3795 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:50.185852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3f504dd-be4d-41cd-9edb-c68a8a4d3795 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:50.186499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3f504dd-be4d-41cd-9edb-c68a8a4d3795 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:50.187461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3f504dd-be4d-41cd-9edb-c68a8a4d3795 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:50.189404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3f504dd-be4d-41cd-9edb-c68a8a4d3795 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:50.190041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3f504dd-be4d-41cd-9edb-c68a8a4d3795 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:50.344474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b3f504dd-be4d-41cd-9edb-c68a8a4d3795 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:50.366802 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b3f504dd-be4d-41cd-9edb-c68a8a4d3795 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1271 microversion: 2.1 time: 0.216547 Oct 11 20:00:50.372543 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1981/4036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:50 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:50.379107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5633cd9c-541d-4cf6-b1ad-be4f9ec19129 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:50.389402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5633cd9c-541d-4cf6-b1ad-be4f9ec19129 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:50.426345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5633cd9c-541d-4cf6-b1ad-be4f9ec19129 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:50.427235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5633cd9c-541d-4cf6-b1ad-be4f9ec19129 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:50.429493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5633cd9c-541d-4cf6-b1ad-be4f9ec19129 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:50.432438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5633cd9c-541d-4cf6-b1ad-be4f9ec19129 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:50.432919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5633cd9c-541d-4cf6-b1ad-be4f9ec19129 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:50.433949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5633cd9c-541d-4cf6-b1ad-be4f9ec19129 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:50.959403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5633cd9c-541d-4cf6-b1ad-be4f9ec19129 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:50.983974 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5633cd9c-541d-4cf6-b1ad-be4f9ec19129 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1275 microversion: 2.1 time: 0.607912 Oct 11 20:00:50.986575 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1982/4037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:50 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1275 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:51.014519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:51.016232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:51.066165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:51.079778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:51.084832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:51.087724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:51.088365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:51.088941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:51.684433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:51.704406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:51.708773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:51.712312 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-84aedcc3-a074-4fb6-84d6-d390ca78c42f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1739 microversion: 2.20 time: 0.720956 Oct 11 20:00:51.727079 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1983/4038] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:50 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1739 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:51.743567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d4049d06-0fbb-4818-baac-e1a68872aa9f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:51.745879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d4049d06-0fbb-4818-baac-e1a68872aa9f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:51.769714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4049d06-0fbb-4818-baac-e1a68872aa9f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:51.773052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4049d06-0fbb-4818-baac-e1a68872aa9f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:51.775041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4049d06-0fbb-4818-baac-e1a68872aa9f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:51.775956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4049d06-0fbb-4818-baac-e1a68872aa9f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:51.779276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4049d06-0fbb-4818-baac-e1a68872aa9f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:51.792024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4049d06-0fbb-4818-baac-e1a68872aa9f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:52.716540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:00:52.717034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:00:52.717930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:00:52.722881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:00:52.723514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:00:52.749922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:52.750538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:52.757294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:52.758111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:52.763699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:52.764185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:52.819036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Getting quotas for project 9d1efaec3c7640d684256bc6460e7559. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:00:52.831610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Getting quotas for user bfddbe97757446b58c605f5f6f64500c and project 9d1efaec3c7640d684256bc6460e7559. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:00:52.874368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:00:52.877028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:00:52.887669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d4049d06-0fbb-4818-baac-e1a68872aa9f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:52.911862 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d4049d06-0fbb-4818-baac-e1a68872aa9f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1327 microversion: 2.1 time: 1.178634 Oct 11 20:00:52.913890 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1984/4039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:51 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1327 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:52.928545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-25704050-5da2-45a0-8501-4b70c7c51304 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:52.929371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-25704050-5da2-45a0-8501-4b70c7c51304 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:52.945551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25704050-5da2-45a0-8501-4b70c7c51304 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:52.946937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25704050-5da2-45a0-8501-4b70c7c51304 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:52.951227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25704050-5da2-45a0-8501-4b70c7c51304 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:52.952413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25704050-5da2-45a0-8501-4b70c7c51304 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:52.953237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25704050-5da2-45a0-8501-4b70c7c51304 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:52.954447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25704050-5da2-45a0-8501-4b70c7c51304 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:53.009663 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9a10ac2b-0eaf-448d-a6df-af78a42ebf79 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.490991 Oct 11 20:00:53.012963 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2056/4040] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:00:53.026086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-615d545c-b8cd-4c3d-92dd-b177af0870a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:53.026996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-615d545c-b8cd-4c3d-92dd-b177af0870a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:53.052134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-615d545c-b8cd-4c3d-92dd-b177af0870a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:53.052846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-615d545c-b8cd-4c3d-92dd-b177af0870a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:53.053466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-615d545c-b8cd-4c3d-92dd-b177af0870a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:53.054416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-615d545c-b8cd-4c3d-92dd-b177af0870a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:53.056843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-615d545c-b8cd-4c3d-92dd-b177af0870a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:53.057488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-615d545c-b8cd-4c3d-92dd-b177af0870a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:53.325757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-615d545c-b8cd-4c3d-92dd-b177af0870a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:53.342048 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-615d545c-b8cd-4c3d-92dd-b177af0870a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1273 microversion: 2.1 time: 0.327765 Oct 11 20:00:53.357815 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2057/4041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:53 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1273 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:53.369067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-399ffba2-05e0-436c-a629-9a2fdbec141c req-5ed67a94-1987-41b8-aeee-0fbefd33d0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9003fd-01af-4756-9492-3a213041cdfd", "name": "network-vif-deleted", "tag": "9588333b-d35f-44e4-99b7-e36269b187ad"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:53.424522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-399ffba2-05e0-436c-a629-9a2fdbec141c req-5ed67a94-1987-41b8-aeee-0fbefd33d0a8 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:53.425117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-399ffba2-05e0-436c-a629-9a2fdbec141c req-5ed67a94-1987-41b8-aeee-0fbefd33d0a8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:53.425694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-399ffba2-05e0-436c-a629-9a2fdbec141c req-5ed67a94-1987-41b8-aeee-0fbefd33d0a8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:53.456297 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-399ffba2-05e0-436c-a629-9a2fdbec141c req-5ed67a94-1987-41b8-aeee-0fbefd33d0a8 service nova] Creating event network-vif-deleted:9588333b-d35f-44e4-99b7-e36269b187ad for instance bf9003fd-01af-4756-9492-3a213041cdfd on n-h2-860864-3 Oct 11 20:00:53.464114 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-399ffba2-05e0-436c-a629-9a2fdbec141c req-5ed67a94-1987-41b8-aeee-0fbefd33d0a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113310 Oct 11 20:00:53.466209 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2058/4042] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:53.473765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-359c3284-0571-487d-b1b2-6a09ca17a67b req-34dd61b0-531c-48ba-b3ef-d0b4e8a95dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a385f615-a24c-47d5-b833-b2786ceb0410", "tag": "c2369f0c-de84-41bb-97bc-2795c77267ea"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:53.499545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-359c3284-0571-487d-b1b2-6a09ca17a67b req-34dd61b0-531c-48ba-b3ef-d0b4e8a95dad service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:53.503182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-359c3284-0571-487d-b1b2-6a09ca17a67b req-34dd61b0-531c-48ba-b3ef-d0b4e8a95dad service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:53.503778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-359c3284-0571-487d-b1b2-6a09ca17a67b req-34dd61b0-531c-48ba-b3ef-d0b4e8a95dad service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:53.536374 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-359c3284-0571-487d-b1b2-6a09ca17a67b req-34dd61b0-531c-48ba-b3ef-d0b4e8a95dad service nova] Creating event network-changed:c2369f0c-de84-41bb-97bc-2795c77267ea for instance a385f615-a24c-47d5-b833-b2786ceb0410 on n-h2-860864-3 Oct 11 20:00:53.550783 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-359c3284-0571-487d-b1b2-6a09ca17a67b req-34dd61b0-531c-48ba-b3ef-d0b4e8a95dad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082188 Oct 11 20:00:53.551787 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2059/4043] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:53.565011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:53.565379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:53.573921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:53.574069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:53.575189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:53.576122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:53.576590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:53.577073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:53.831731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-25704050-5da2-45a0-8501-4b70c7c51304 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:53.847315 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-25704050-5da2-45a0-8501-4b70c7c51304 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1313 microversion: 2.1 time: 0.928208 Oct 11 20:00:53.848665 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1985/4044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:52 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1313 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:53.857408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-677f18d2-07b2-4a59-97ec-5b84a44a4323 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:53.858244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-677f18d2-07b2-4a59-97ec-5b84a44a4323 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:54.015757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:54.030413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:54.032708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:54.034341 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f3b71c44-7c29-472b-a8ac-5d7bf50c4517 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1739 microversion: 2.20 time: 0.480703 Oct 11 20:00:54.035708 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2060/4045] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:53 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1739 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:54.047266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d5bd17bb-8b5b-44b7-8b0a-193614c4b87f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:54.048299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d5bd17bb-8b5b-44b7-8b0a-193614c4b87f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:54.064377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5bd17bb-8b5b-44b7-8b0a-193614c4b87f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:54.065465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5bd17bb-8b5b-44b7-8b0a-193614c4b87f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:54.066262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5bd17bb-8b5b-44b7-8b0a-193614c4b87f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:54.067439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5bd17bb-8b5b-44b7-8b0a-193614c4b87f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:54.068292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5bd17bb-8b5b-44b7-8b0a-193614c4b87f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:54.069075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5bd17bb-8b5b-44b7-8b0a-193614c4b87f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:54.155832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-677f18d2-07b2-4a59-97ec-5b84a44a4323 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:54.191025 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-677f18d2-07b2-4a59-97ec-5b84a44a4323 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1207 microversion: 2.1 time: 0.336690 Oct 11 20:00:54.198804 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1986/4046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:53 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1207 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:54.369110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7a23de76-8638-4115-97de-5411f5ba3861 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:54.371957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7a23de76-8638-4115-97de-5411f5ba3861 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:54.395022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a23de76-8638-4115-97de-5411f5ba3861 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:54.396713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a23de76-8638-4115-97de-5411f5ba3861 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:54.398762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a23de76-8638-4115-97de-5411f5ba3861 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:54.403013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a23de76-8638-4115-97de-5411f5ba3861 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:54.406345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a23de76-8638-4115-97de-5411f5ba3861 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:54.407034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a23de76-8638-4115-97de-5411f5ba3861 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:55.306036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d5bd17bb-8b5b-44b7-8b0a-193614c4b87f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:55.325377 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d5bd17bb-8b5b-44b7-8b0a-193614c4b87f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1327 microversion: 2.1 time: 1.287771 Oct 11 20:00:55.329392 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2061/4047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:54 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1327 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:55.345468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-783cf611-573b-4a6d-80c1-46c877bd1a84 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:55.347703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7a23de76-8638-4115-97de-5411f5ba3861 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:55.349239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-783cf611-573b-4a6d-80c1-46c877bd1a84 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:55.363739 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7a23de76-8638-4115-97de-5411f5ba3861 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1315 microversion: 2.1 time: 1.002274 Oct 11 20:00:55.365457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783cf611-573b-4a6d-80c1-46c877bd1a84 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:55.366360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783cf611-573b-4a6d-80c1-46c877bd1a84 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:55.366745 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1987/4048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:54 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1315 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:00:55.367388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783cf611-573b-4a6d-80c1-46c877bd1a84 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:55.369743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783cf611-573b-4a6d-80c1-46c877bd1a84 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:55.373200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783cf611-573b-4a6d-80c1-46c877bd1a84 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:55.373817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783cf611-573b-4a6d-80c1-46c877bd1a84 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:55.377402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:55.378076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:55.395816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:55.396324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:55.397213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:55.403792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:55.404492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:55.405168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:56.082419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-783cf611-573b-4a6d-80c1-46c877bd1a84 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:56.093415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-783cf611-573b-4a6d-80c1-46c877bd1a84 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1313 microversion: 2.1 time: 0.762711 Oct 11 20:00:56.099302 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2062/4049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:55 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1313 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:56.114415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b368d6f-d925-45e3-8f0a-c346d5aabce1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:56.115395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0b368d6f-d925-45e3-8f0a-c346d5aabce1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:56.123259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b368d6f-d925-45e3-8f0a-c346d5aabce1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:56.125967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b368d6f-d925-45e3-8f0a-c346d5aabce1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:56.126941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b368d6f-d925-45e3-8f0a-c346d5aabce1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:56.132924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b368d6f-d925-45e3-8f0a-c346d5aabce1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:56.133628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b368d6f-d925-45e3-8f0a-c346d5aabce1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:56.134241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b368d6f-d925-45e3-8f0a-c346d5aabce1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:56.293647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:56.303752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:56.306062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:56.307800 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4e31a4d6-1598-4f0c-802e-6eb6a81f295c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1739 microversion: 2.20 time: 0.939937 Oct 11 20:00:56.309848 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1988/4050] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:55 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1739 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:56.318390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5f269c8c-7d22-42ee-993d-81406504178c req-c02b0295-7423-48c1-98cc-19744ef8ff0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a538e9-f310-4739-bf23-3db32cca228a", "tag": "73e8073d-2357-4294-b78a-3ba0a1c71ec9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:00:56.335115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0b368d6f-d925-45e3-8f0a-c346d5aabce1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:56.353403 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b368d6f-d925-45e3-8f0a-c346d5aabce1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1265 microversion: 2.1 time: 0.251838 Oct 11 20:00:56.360688 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2063/4051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:56 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:56.363266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5f269c8c-7d22-42ee-993d-81406504178c req-c02b0295-7423-48c1-98cc-19744ef8ff0d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:56.365834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5f269c8c-7d22-42ee-993d-81406504178c req-c02b0295-7423-48c1-98cc-19744ef8ff0d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:56.368545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5f269c8c-7d22-42ee-993d-81406504178c req-c02b0295-7423-48c1-98cc-19744ef8ff0d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:56.375188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-43447f84-9dc1-46c7-bb1b-3e1b6372f326 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:56.378582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-43447f84-9dc1-46c7-bb1b-3e1b6372f326 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:56.421376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:56.423740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43447f84-9dc1-46c7-bb1b-3e1b6372f326 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:56.424264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43447f84-9dc1-46c7-bb1b-3e1b6372f326 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:56.424896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43447f84-9dc1-46c7-bb1b-3e1b6372f326 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:56.425809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43447f84-9dc1-46c7-bb1b-3e1b6372f326 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:56.426431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43447f84-9dc1-46c7-bb1b-3e1b6372f326 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:56.427056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-43447f84-9dc1-46c7-bb1b-3e1b6372f326 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:56.432622 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5f269c8c-7d22-42ee-993d-81406504178c req-c02b0295-7423-48c1-98cc-19744ef8ff0d service nova] Creating event network-changed:73e8073d-2357-4294-b78a-3ba0a1c71ec9 for instance c6a538e9-f310-4739-bf23-3db32cca228a on n-h1-860864-3 Oct 11 20:00:56.443672 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5f269c8c-7d22-42ee-993d-81406504178c req-c02b0295-7423-48c1-98cc-19744ef8ff0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131589 Oct 11 20:00:56.444854 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1989/4052] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:00:56.451861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c75a2ffc-0a2b-41be-8fad-c1297956984f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:56.452762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c75a2ffc-0a2b-41be-8fad-c1297956984f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:56.460408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c75a2ffc-0a2b-41be-8fad-c1297956984f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:56.461208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c75a2ffc-0a2b-41be-8fad-c1297956984f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:56.461842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c75a2ffc-0a2b-41be-8fad-c1297956984f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:56.462793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c75a2ffc-0a2b-41be-8fad-c1297956984f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:56.463532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c75a2ffc-0a2b-41be-8fad-c1297956984f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:56.464501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c75a2ffc-0a2b-41be-8fad-c1297956984f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:56.964629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c75a2ffc-0a2b-41be-8fad-c1297956984f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:56.983743 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c75a2ffc-0a2b-41be-8fad-c1297956984f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1315 microversion: 2.1 time: 0.537447 Oct 11 20:00:56.986593 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1990/4053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:56 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:57.124962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4d07d9e9-1a28-4524-a7e9-2b2bcfd8c4d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:57.125543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4d07d9e9-1a28-4524-a7e9-2b2bcfd8c4d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:57.143338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d07d9e9-1a28-4524-a7e9-2b2bcfd8c4d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:57.146780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d07d9e9-1a28-4524-a7e9-2b2bcfd8c4d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:57.147806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d07d9e9-1a28-4524-a7e9-2b2bcfd8c4d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:57.154823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d07d9e9-1a28-4524-a7e9-2b2bcfd8c4d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:57.155597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d07d9e9-1a28-4524-a7e9-2b2bcfd8c4d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:57.156053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d07d9e9-1a28-4524-a7e9-2b2bcfd8c4d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:57.268756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:57.672458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-43447f84-9dc1-46c7-bb1b-3e1b6372f326 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:57.684753 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-43447f84-9dc1-46c7-bb1b-3e1b6372f326 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1327 microversion: 2.1 time: 1.320294 Oct 11 20:00:57.687150 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2064/4054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:56 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1327 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:57.701522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:57.702506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:57.722127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:57.724817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:57.725489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:57.730804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:57.732521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:57.736366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:57.839324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4d07d9e9-1a28-4524-a7e9-2b2bcfd8c4d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:57.857412 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4d07d9e9-1a28-4524-a7e9-2b2bcfd8c4d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1313 microversion: 2.1 time: 0.736605 Oct 11 20:00:57.859129 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1991/4055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:57 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:57.868129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-961cb3bb-6473-4639-8816-3da2fa3b7f00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:57.869356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-961cb3bb-6473-4639-8816-3da2fa3b7f00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:57.889057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961cb3bb-6473-4639-8816-3da2fa3b7f00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:57.890763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961cb3bb-6473-4639-8816-3da2fa3b7f00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:57.893063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961cb3bb-6473-4639-8816-3da2fa3b7f00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:57.894034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961cb3bb-6473-4639-8816-3da2fa3b7f00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:57.894556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961cb3bb-6473-4639-8816-3da2fa3b7f00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:57.895007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-961cb3bb-6473-4639-8816-3da2fa3b7f00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:58.082831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-961cb3bb-6473-4639-8816-3da2fa3b7f00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:58.098334 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-961cb3bb-6473-4639-8816-3da2fa3b7f00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1265 microversion: 2.1 time: 0.237601 Oct 11 20:00:58.099422 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1992/4056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:57 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:58.120595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9785c579-62ff-40d6-a281-f13bc3127e38 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:58.125071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9785c579-62ff-40d6-a281-f13bc3127e38 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:58.134681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9785c579-62ff-40d6-a281-f13bc3127e38 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:58.135396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9785c579-62ff-40d6-a281-f13bc3127e38 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:58.136117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9785c579-62ff-40d6-a281-f13bc3127e38 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:58.137894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9785c579-62ff-40d6-a281-f13bc3127e38 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:58.138612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9785c579-62ff-40d6-a281-f13bc3127e38 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:58.139318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9785c579-62ff-40d6-a281-f13bc3127e38 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:58.405710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:58.415624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:58.417531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:58.420540 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-094a1c2f-58d5-441c-94bb-9576c729cdeb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1721 microversion: 2.20 time: 0.730728 Oct 11 20:00:58.424398 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2065/4057] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:00:57 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1721 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:00:58.663520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9785c579-62ff-40d6-a281-f13bc3127e38 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:00:58.689081 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9785c579-62ff-40d6-a281-f13bc3127e38 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1315 microversion: 2.1 time: 0.588259 Oct 11 20:00:58.691077 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1993/4058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:58 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:00:58.715420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2e9d657e-acb8-4836-bd82-9a237988aa06 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:58.716668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2e9d657e-acb8-4836-bd82-9a237988aa06 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:58.724756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e9d657e-acb8-4836-bd82-9a237988aa06 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:58.725619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e9d657e-acb8-4836-bd82-9a237988aa06 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:58.726293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e9d657e-acb8-4836-bd82-9a237988aa06 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:58.727229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e9d657e-acb8-4836-bd82-9a237988aa06 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:58.727937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e9d657e-acb8-4836-bd82-9a237988aa06 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:58.728578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e9d657e-acb8-4836-bd82-9a237988aa06 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:58.761025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:00:58.881135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a33fcebc-e457-4559-b024-52b09b861ca0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:00:58.881911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a33fcebc-e457-4559-b024-52b09b861ca0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:00:58.891082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a33fcebc-e457-4559-b024-52b09b861ca0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:58.893528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a33fcebc-e457-4559-b024-52b09b861ca0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:58.894942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a33fcebc-e457-4559-b024-52b09b861ca0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:00:58.897264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a33fcebc-e457-4559-b024-52b09b861ca0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:00:58.897782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a33fcebc-e457-4559-b024-52b09b861ca0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:00:58.899521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a33fcebc-e457-4559-b024-52b09b861ca0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:00.114708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2e9d657e-acb8-4836-bd82-9a237988aa06 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:00.117225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a33fcebc-e457-4559-b024-52b09b861ca0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:00.131320 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a33fcebc-e457-4559-b024-52b09b861ca0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1313 microversion: 2.1 time: 1.252224 Oct 11 20:01:00.133585 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1994/4059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:58 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1313 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:00.142220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-16af74b1-47e2-4cde-bc58-5558924604ee tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:00.143089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-16af74b1-47e2-4cde-bc58-5558924604ee tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:00.151050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16af74b1-47e2-4cde-bc58-5558924604ee tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:00.151952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16af74b1-47e2-4cde-bc58-5558924604ee tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:00.152873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16af74b1-47e2-4cde-bc58-5558924604ee tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:00.153950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16af74b1-47e2-4cde-bc58-5558924604ee tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:00.155524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16af74b1-47e2-4cde-bc58-5558924604ee tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:00.156197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-16af74b1-47e2-4cde-bc58-5558924604ee tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:00.156872 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2e9d657e-acb8-4836-bd82-9a237988aa06 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1327 microversion: 2.1 time: 1.438922 Oct 11 20:01:00.173760 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2066/4060] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:00:58 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1327 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:00.187157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-5c070789-2fa2-4c77-bf8e-ea8c1a83d262 req-90fdcfac-2cd3-4f50-a2ae-ae8a5c9e806d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4014c74c-a02a-44d4-a85e-9288ae8758b8", "tag": "fe9b7f5a-45d6-47f0-91a9-3c3937912457"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:00.214417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5c070789-2fa2-4c77-bf8e-ea8c1a83d262 req-90fdcfac-2cd3-4f50-a2ae-ae8a5c9e806d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:00.215301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5c070789-2fa2-4c77-bf8e-ea8c1a83d262 req-90fdcfac-2cd3-4f50-a2ae-ae8a5c9e806d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:00.215914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5c070789-2fa2-4c77-bf8e-ea8c1a83d262 req-90fdcfac-2cd3-4f50-a2ae-ae8a5c9e806d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:00.231594 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-5c070789-2fa2-4c77-bf8e-ea8c1a83d262 req-90fdcfac-2cd3-4f50-a2ae-ae8a5c9e806d service nova] Creating event network-changed:fe9b7f5a-45d6-47f0-91a9-3c3937912457 for instance 4014c74c-a02a-44d4-a85e-9288ae8758b8 on n-h2-860864-3 Oct 11 20:01:00.241907 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-5c070789-2fa2-4c77-bf8e-ea8c1a83d262 req-90fdcfac-2cd3-4f50-a2ae-ae8a5c9e806d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066935 Oct 11 20:01:00.242554 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2067/4061] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:00.249633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-972c151f-9eb1-4a0f-8605-bc416d3ba97a req-c2a1b61a-9f70-4a5f-976b-d2678bea067e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a385f615-a24c-47d5-b833-b2786ceb0410", "name": "network-vif-plugged", "status": "completed", "tag": "c2369f0c-de84-41bb-97bc-2795c77267ea"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:00.260474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-972c151f-9eb1-4a0f-8605-bc416d3ba97a req-c2a1b61a-9f70-4a5f-976b-d2678bea067e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:00.260950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-972c151f-9eb1-4a0f-8605-bc416d3ba97a req-c2a1b61a-9f70-4a5f-976b-d2678bea067e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:00.261976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-972c151f-9eb1-4a0f-8605-bc416d3ba97a req-c2a1b61a-9f70-4a5f-976b-d2678bea067e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:00.276009 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-972c151f-9eb1-4a0f-8605-bc416d3ba97a req-c2a1b61a-9f70-4a5f-976b-d2678bea067e service nova] Creating event network-vif-plugged:c2369f0c-de84-41bb-97bc-2795c77267ea for instance a385f615-a24c-47d5-b833-b2786ceb0410 on n-h2-860864-3 Oct 11 20:01:00.281279 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-972c151f-9eb1-4a0f-8605-bc416d3ba97a req-c2a1b61a-9f70-4a5f-976b-d2678bea067e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036884 Oct 11 20:01:00.281877 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2068/4062] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:00.287335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:00.289310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:00.298907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:00.299563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:00.300342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:00.301707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:00.302433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:00.303073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:00.671184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-16af74b1-47e2-4cde-bc58-5558924604ee tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:00.688715 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-16af74b1-47e2-4cde-bc58-5558924604ee tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1307 microversion: 2.1 time: 0.553577 Oct 11 20:01:00.689766 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1995/4063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:00 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1307 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:00.695203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e72c9a82-3107-4040-a73e-f455d5ae4219 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:00.696322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e72c9a82-3107-4040-a73e-f455d5ae4219 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:00.706738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e72c9a82-3107-4040-a73e-f455d5ae4219 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:00.707536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e72c9a82-3107-4040-a73e-f455d5ae4219 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:00.708708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e72c9a82-3107-4040-a73e-f455d5ae4219 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:00.709779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e72c9a82-3107-4040-a73e-f455d5ae4219 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:00.710754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e72c9a82-3107-4040-a73e-f455d5ae4219 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:00.711771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e72c9a82-3107-4040-a73e-f455d5ae4219 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:00.781166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:00.792440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:00.796020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:00.799322 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-42847176-88ff-4b81-ac7b-485bf675482e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1664 microversion: 2.20 time: 0.516347 Oct 11 20:01:00.800002 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2069/4064] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:00 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1664 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:00.833062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c771259-db78-424a-a1b4-9ce9a6f7c092 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d5cc19d-0bd9-4a0d-ac5e-27d296c098f4"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:00.837551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4c771259-db78-424a-a1b4-9ce9a6f7c092 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:00.849044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c771259-db78-424a-a1b4-9ce9a6f7c092 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:00.851211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c771259-db78-424a-a1b4-9ce9a6f7c092 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:00.852302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c771259-db78-424a-a1b4-9ce9a6f7c092 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:00.853770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c771259-db78-424a-a1b4-9ce9a6f7c092 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:00.854452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c771259-db78-424a-a1b4-9ce9a6f7c092 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:00.855657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c771259-db78-424a-a1b4-9ce9a6f7c092 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:01.165150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e72c9a82-3107-4040-a73e-f455d5ae4219 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:01.186292 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e72c9a82-3107-4040-a73e-f455d5ae4219 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1315 microversion: 2.1 time: 0.495020 Oct 11 20:01:01.193223 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1996/4065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:00 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:01.200288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-94bd09ea-8e53-4517-86e0-f1d31cb8741b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:01.203395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-94bd09ea-8e53-4517-86e0-f1d31cb8741b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:01.210925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94bd09ea-8e53-4517-86e0-f1d31cb8741b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:01.211788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94bd09ea-8e53-4517-86e0-f1d31cb8741b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:01.224133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94bd09ea-8e53-4517-86e0-f1d31cb8741b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:01.226052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94bd09ea-8e53-4517-86e0-f1d31cb8741b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:01.227769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94bd09ea-8e53-4517-86e0-f1d31cb8741b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:01.229431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94bd09ea-8e53-4517-86e0-f1d31cb8741b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:01.398896 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4c771259-db78-424a-a1b4-9ce9a6f7c092 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "POST /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.574554 Oct 11 20:01:01.400769 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2070/4066] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Oct 11 20:01:00 2022] POST /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments => generated 188 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:01:01.413112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7745bc67-fa8f-4b71-8b5c-e233fd84e5f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:01.413864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7745bc67-fa8f-4b71-8b5c-e233fd84e5f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:01.426375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7745bc67-fa8f-4b71-8b5c-e233fd84e5f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:01.426904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7745bc67-fa8f-4b71-8b5c-e233fd84e5f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:01.432568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7745bc67-fa8f-4b71-8b5c-e233fd84e5f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:01.432568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7745bc67-fa8f-4b71-8b5c-e233fd84e5f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:01.432568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7745bc67-fa8f-4b71-8b5c-e233fd84e5f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:01.432568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7745bc67-fa8f-4b71-8b5c-e233fd84e5f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:01.500777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-94bd09ea-8e53-4517-86e0-f1d31cb8741b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:01.511053 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-94bd09ea-8e53-4517-86e0-f1d31cb8741b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1313 microversion: 2.1 time: 0.316447 Oct 11 20:01:01.517479 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1997/4067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:01 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:01.576813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-237c07c2-5779-42d7-8e44-8bd95850422d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:01.577587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-237c07c2-5779-42d7-8e44-8bd95850422d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:01.584234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-237c07c2-5779-42d7-8e44-8bd95850422d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:01.584732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-237c07c2-5779-42d7-8e44-8bd95850422d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:01.585281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-237c07c2-5779-42d7-8e44-8bd95850422d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:01.586379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-237c07c2-5779-42d7-8e44-8bd95850422d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:01.587157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-237c07c2-5779-42d7-8e44-8bd95850422d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:01.588090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-237c07c2-5779-42d7-8e44-8bd95850422d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:01.626961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-237c07c2-5779-42d7-8e44-8bd95850422d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126955) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 20:01:01.689650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7745bc67-fa8f-4b71-8b5c-e233fd84e5f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:01.701115 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7745bc67-fa8f-4b71-8b5c-e233fd84e5f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1327 microversion: 2.1 time: 0.298907 Oct 11 20:01:01.702298 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2071/4068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:01 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1327 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:01.713315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b9f0eeb-96e3-45cf-9dd2-7ac7c0913066 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:01.714834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b9f0eeb-96e3-45cf-9dd2-7ac7c0913066 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:01.719255 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-237c07c2-5779-42d7-8e44-8bd95850422d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "POST /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/action" status: 202 len: 0 microversion: 2.20 time: 0.148186 Oct 11 20:01:01.720039 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1998/4069] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 20:01:01 2022] POST /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:01:01.722678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b9f0eeb-96e3-45cf-9dd2-7ac7c0913066 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:01.723631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b9f0eeb-96e3-45cf-9dd2-7ac7c0913066 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:01.725079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b9f0eeb-96e3-45cf-9dd2-7ac7c0913066 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:01.725982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b9f0eeb-96e3-45cf-9dd2-7ac7c0913066 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:01.726803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b9f0eeb-96e3-45cf-9dd2-7ac7c0913066 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:01.727457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b9f0eeb-96e3-45cf-9dd2-7ac7c0913066 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:01.728776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:01.729381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:01.736347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:01.737012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:01.737601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:01.738446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:01.739107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:01.739678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:02.177949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:02.193151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:02.218686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:02.223652 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a764aeb8-1c61-40a4-ba49-5f407169b7a8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1750 microversion: 2.20 time: 0.498589 Oct 11 20:01:02.224095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b9f0eeb-96e3-45cf-9dd2-7ac7c0913066 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:02.224843 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 1999/4070] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:01 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1750 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:02.234419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9d300cf9-cd33-4612-992a-fce43f261260 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:02.237842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9d300cf9-cd33-4612-992a-fce43f261260 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:02.239611 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b9f0eeb-96e3-45cf-9dd2-7ac7c0913066 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1307 microversion: 2.1 time: 0.530299 Oct 11 20:01:02.244232 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2072/4071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:01 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1307 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:02.254720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d300cf9-cd33-4612-992a-fce43f261260 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:02.255317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d300cf9-cd33-4612-992a-fce43f261260 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:02.256878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d300cf9-cd33-4612-992a-fce43f261260 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:02.258645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d300cf9-cd33-4612-992a-fce43f261260 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:02.259719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d300cf9-cd33-4612-992a-fce43f261260 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:02.261855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d300cf9-cd33-4612-992a-fce43f261260 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:02.305953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4c576621-1e3d-4c60-9bf2-077a6529bbbb req-8ebc76f4-ab95-4227-ab8c-65b0835d3776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a538e9-f310-4739-bf23-3db32cca228a", "name": "network-vif-plugged", "status": "completed", "tag": "73e8073d-2357-4294-b78a-3ba0a1c71ec9"}, {"server_uuid": "34e65c53-e164-4255-a2b8-4338069b7e47", "name": "network-vif-unplugged", "status": "completed", "tag": "f7bf35aa-741b-418c-92ae-e8af14cd5a52"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:02.354477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4c576621-1e3d-4c60-9bf2-077a6529bbbb req-8ebc76f4-ab95-4227-ab8c-65b0835d3776 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:02.357135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4c576621-1e3d-4c60-9bf2-077a6529bbbb req-8ebc76f4-ab95-4227-ab8c-65b0835d3776 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:02.358911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4c576621-1e3d-4c60-9bf2-077a6529bbbb req-8ebc76f4-ab95-4227-ab8c-65b0835d3776 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:02.382206 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4c576621-1e3d-4c60-9bf2-077a6529bbbb req-8ebc76f4-ab95-4227-ab8c-65b0835d3776 service nova] Creating event network-vif-plugged:73e8073d-2357-4294-b78a-3ba0a1c71ec9 for instance c6a538e9-f310-4739-bf23-3db32cca228a on n-h1-860864-3 Oct 11 20:01:02.382981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.compute.server_external_events [req-4c576621-1e3d-4c60-9bf2-077a6529bbbb req-8ebc76f4-ab95-4227-ab8c-65b0835d3776 service nova] Unable to find a host for instance 34e65c53-e164-4255-a2b8-4338069b7e47. Dropping event network-vif-unplugged {{(pid=126956) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 20:01:02.389655 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4c576621-1e3d-4c60-9bf2-077a6529bbbb req-8ebc76f4-ab95-4227-ab8c-65b0835d3776 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.088689 Oct 11 20:01:02.390921 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2073/4072] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 20:01:02.399585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-7efb5303-55d6-4148-a1d6-fbcffecb6d73 req-ec2d9a7c-162c-43f3-b2e8-1caf3b17e763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b9b0470-13c5-4393-a735-d4b067e5f980", "tag": "c99ee24d-ef2c-408e-b3a8-5cbb58c948d8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:02.415175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7efb5303-55d6-4148-a1d6-fbcffecb6d73 req-ec2d9a7c-162c-43f3-b2e8-1caf3b17e763 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:02.415860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7efb5303-55d6-4148-a1d6-fbcffecb6d73 req-ec2d9a7c-162c-43f3-b2e8-1caf3b17e763 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:02.416623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7efb5303-55d6-4148-a1d6-fbcffecb6d73 req-ec2d9a7c-162c-43f3-b2e8-1caf3b17e763 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:02.431137 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-7efb5303-55d6-4148-a1d6-fbcffecb6d73 req-ec2d9a7c-162c-43f3-b2e8-1caf3b17e763 service nova] Creating event network-changed:c99ee24d-ef2c-408e-b3a8-5cbb58c948d8 for instance 2b9b0470-13c5-4393-a735-d4b067e5f980 on n-h1-860864-3 Oct 11 20:01:02.438914 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-7efb5303-55d6-4148-a1d6-fbcffecb6d73 req-ec2d9a7c-162c-43f3-b2e8-1caf3b17e763 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044865 Oct 11 20:01:02.440131 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2074/4073] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:02.542599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c568d414-0873-424f-8d12-a76e313805c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:02.543741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c568d414-0873-424f-8d12-a76e313805c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:02.548835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:02.551696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c568d414-0873-424f-8d12-a76e313805c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:02.552432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c568d414-0873-424f-8d12-a76e313805c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:02.553074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c568d414-0873-424f-8d12-a76e313805c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:02.554005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c568d414-0873-424f-8d12-a76e313805c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:02.554740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c568d414-0873-424f-8d12-a76e313805c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:02.555368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c568d414-0873-424f-8d12-a76e313805c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:02.799390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:02.859653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9d300cf9-cd33-4612-992a-fce43f261260 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:02.867373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=18 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:02.869834 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9d300cf9-cd33-4612-992a-fce43f261260 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1315 microversion: 2.1 time: 0.642865 Oct 11 20:01:02.871581 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2000/4074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:02 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:02.882911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1a3d03f9-152e-43f7-9ec5-05fd09a0653e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:02.883923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1a3d03f9-152e-43f7-9ec5-05fd09a0653e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:02.903418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a3d03f9-152e-43f7-9ec5-05fd09a0653e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:02.903910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a3d03f9-152e-43f7-9ec5-05fd09a0653e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:02.905468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a3d03f9-152e-43f7-9ec5-05fd09a0653e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:02.906498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a3d03f9-152e-43f7-9ec5-05fd09a0653e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:02.907258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a3d03f9-152e-43f7-9ec5-05fd09a0653e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:02.908504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a3d03f9-152e-43f7-9ec5-05fd09a0653e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:03.103447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c568d414-0873-424f-8d12-a76e313805c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:03.117949 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c568d414-0873-424f-8d12-a76e313805c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1499 microversion: 2.1 time: 0.580393 Oct 11 20:01:03.134551 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2075/4075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:02 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1499 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:03.145690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5206d9d0-35ce-4f2a-81f9-115e9f425466 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:03.148542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5206d9d0-35ce-4f2a-81f9-115e9f425466 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:03.159623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5206d9d0-35ce-4f2a-81f9-115e9f425466 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:03.160326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5206d9d0-35ce-4f2a-81f9-115e9f425466 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:03.161651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5206d9d0-35ce-4f2a-81f9-115e9f425466 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:03.162787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5206d9d0-35ce-4f2a-81f9-115e9f425466 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:03.163665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5206d9d0-35ce-4f2a-81f9-115e9f425466 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:03.164568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5206d9d0-35ce-4f2a-81f9-115e9f425466 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:03.214767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-5206d9d0-35ce-4f2a-81f9-115e9f425466 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lazy-loading 'flavor' on Instance uuid a385f615-a24c-47d5-b833-b2786ceb0410 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:01:03.301452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a3d03f9-152e-43f7-9ec5-05fd09a0653e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:03.322345 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5206d9d0-35ce-4f2a-81f9-115e9f425466 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "POST /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410/action" status: 200 len: 32 microversion: 2.1 time: 0.181663 Oct 11 20:01:03.324126 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2076/4076] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:01:03 2022] POST /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 20:01:03.328443 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1a3d03f9-152e-43f7-9ec5-05fd09a0653e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1327 microversion: 2.1 time: 0.455120 Oct 11 20:01:03.331329 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2001/4077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:02 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1327 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:03.332449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:03.333295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:03.355298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e349d307-c59d-405b-9f7e-b16a5953408e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:03.358017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:03.358859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:03.359388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:03.360331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e349d307-c59d-405b-9f7e-b16a5953408e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:03.360673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:03.361269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:03.361924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:03.382043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e349d307-c59d-405b-9f7e-b16a5953408e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:03.382594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e349d307-c59d-405b-9f7e-b16a5953408e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:03.383044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e349d307-c59d-405b-9f7e-b16a5953408e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:03.383953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e349d307-c59d-405b-9f7e-b16a5953408e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:03.384559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e349d307-c59d-405b-9f7e-b16a5953408e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:03.384995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e349d307-c59d-405b-9f7e-b16a5953408e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:03.668778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:03.671119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e349d307-c59d-405b-9f7e-b16a5953408e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:03.680134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:03.680268 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e349d307-c59d-405b-9f7e-b16a5953408e tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1307 microversion: 2.1 time: 0.346526 Oct 11 20:01:03.681092 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2002/4078] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:03 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1307 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:03.682864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:03.685112 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d17998bf-1e5d-452e-9b1a-bec42c177c93 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1750 microversion: 2.20 time: 0.359401 Oct 11 20:01:03.699947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2085eb7-f06e-4a17-9505-15e74f3a8eca tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:03.700398 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2077/4079] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:03 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1750 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:03.704865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a2085eb7-f06e-4a17-9505-15e74f3a8eca tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:03.707728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2085eb7-f06e-4a17-9505-15e74f3a8eca tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:03.708391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2085eb7-f06e-4a17-9505-15e74f3a8eca tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:03.708989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2085eb7-f06e-4a17-9505-15e74f3a8eca tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:03.709814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2085eb7-f06e-4a17-9505-15e74f3a8eca tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:03.710292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2085eb7-f06e-4a17-9505-15e74f3a8eca tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:03.710832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2085eb7-f06e-4a17-9505-15e74f3a8eca tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:03.868155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a2085eb7-f06e-4a17-9505-15e74f3a8eca tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:03.877482 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a2085eb7-f06e-4a17-9505-15e74f3a8eca tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.195163 Oct 11 20:01:03.879002 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2003/4080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:03 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:03.902992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-56c18c48-ff91-4665-b12f-5af96c402d60 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:03.903853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-56c18c48-ff91-4665-b12f-5af96c402d60 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:03.911051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c18c48-ff91-4665-b12f-5af96c402d60 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:03.912956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c18c48-ff91-4665-b12f-5af96c402d60 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:03.913567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c18c48-ff91-4665-b12f-5af96c402d60 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:03.914442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c18c48-ff91-4665-b12f-5af96c402d60 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:03.915066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c18c48-ff91-4665-b12f-5af96c402d60 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:03.915707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56c18c48-ff91-4665-b12f-5af96c402d60 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:04.076326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56c18c48-ff91-4665-b12f-5af96c402d60 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:04.091042 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-56c18c48-ff91-4665-b12f-5af96c402d60 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1315 microversion: 2.1 time: 0.194016 Oct 11 20:01:04.093240 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2078/4081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:03 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:04.357358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7c639869-a7d6-4522-9bcd-3e5e337f89f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:04.358975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7c639869-a7d6-4522-9bcd-3e5e337f89f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:04.362295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=18 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:04.364884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:04.373991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c639869-a7d6-4522-9bcd-3e5e337f89f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:04.374768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c639869-a7d6-4522-9bcd-3e5e337f89f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:04.375695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c639869-a7d6-4522-9bcd-3e5e337f89f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:04.376660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c639869-a7d6-4522-9bcd-3e5e337f89f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:04.377561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c639869-a7d6-4522-9bcd-3e5e337f89f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:04.378220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c639869-a7d6-4522-9bcd-3e5e337f89f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:04.639185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7c639869-a7d6-4522-9bcd-3e5e337f89f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:04.649537 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7c639869-a7d6-4522-9bcd-3e5e337f89f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1327 microversion: 2.1 time: 0.296593 Oct 11 20:01:04.653713 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2004/4082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:04 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1327 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:04.703657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a4ef4a48-e840-4181-8631-79eb464bb8c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:04.704356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a4ef4a48-e840-4181-8631-79eb464bb8c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:04.713506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:04.714226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:04.726320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:04.727880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4ef4a48-e840-4181-8631-79eb464bb8c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:04.728479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:04.729684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:04.731654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4ef4a48-e840-4181-8631-79eb464bb8c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:04.732375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:04.732907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4ef4a48-e840-4181-8631-79eb464bb8c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:04.733538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:04.734332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4ef4a48-e840-4181-8631-79eb464bb8c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:04.734891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4ef4a48-e840-4181-8631-79eb464bb8c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:04.735186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:04.736470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4ef4a48-e840-4181-8631-79eb464bb8c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:05.437199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4ef4a48-e840-4181-8631-79eb464bb8c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:05.447815 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a4ef4a48-e840-4181-8631-79eb464bb8c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1307 microversion: 2.1 time: 0.748459 Oct 11 20:01:05.467160 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2079/4083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:04 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1307 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:05.475343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a69c28d2-177a-438f-903f-c6886fc024f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:05.476048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a69c28d2-177a-438f-903f-c6886fc024f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:05.484367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a69c28d2-177a-438f-903f-c6886fc024f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:05.485176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a69c28d2-177a-438f-903f-c6886fc024f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:05.486084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a69c28d2-177a-438f-903f-c6886fc024f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:05.487294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a69c28d2-177a-438f-903f-c6886fc024f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:05.487966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a69c28d2-177a-438f-903f-c6886fc024f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:05.489528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a69c28d2-177a-438f-903f-c6886fc024f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:05.545317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:05.557974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:05.565294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:05.568599 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5a1c803f-6ef0-41ca-ab2b-bc46a41a785a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1752 microversion: 2.20 time: 0.859967 Oct 11 20:01:05.569185 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2005/4084] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:04 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1752 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:01:05.586510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:05.593501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:05.601253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Searching by: {'deleted': False, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 20:01:05.615724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:05.616348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:05.616794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:05.617599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:05.622407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:05.624064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:05.696794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 20:01:05.749386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:05.768632 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2a795259-6378-444b-bb69-df7f37b8d0c6 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.195644 Oct 11 20:01:05.771742 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2006/4085] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 20:01:05 2022] GET /compute/v2.1/servers => generated 340 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:05.779917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-533d40db-81d9-418a-949e-6c7eca7fd8e3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:05.780743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-533d40db-81d9-418a-949e-6c7eca7fd8e3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:05.805964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-533d40db-81d9-418a-949e-6c7eca7fd8e3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:05.811957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-533d40db-81d9-418a-949e-6c7eca7fd8e3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:05.812641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-533d40db-81d9-418a-949e-6c7eca7fd8e3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:05.813625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-533d40db-81d9-418a-949e-6c7eca7fd8e3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:05.815828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-533d40db-81d9-418a-949e-6c7eca7fd8e3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:05.817434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-533d40db-81d9-418a-949e-6c7eca7fd8e3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.090335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a69c28d2-177a-438f-903f-c6886fc024f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:06.094303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-533d40db-81d9-418a-949e-6c7eca7fd8e3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:06.099360 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a69c28d2-177a-438f-903f-c6886fc024f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.630983 Oct 11 20:01:06.101125 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2080/4086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:05 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:06.104521 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-533d40db-81d9-418a-949e-6c7eca7fd8e3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1315 microversion: 2.1 time: 0.331484 Oct 11 20:01:06.105395 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2007/4087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:05 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:06.123583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:06.125389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c81c5b3-adfd-4ddc-a3a0-7a12d706e516 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:06.126200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c81c5b3-adfd-4ddc-a3a0-7a12d706e516 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:06.129067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:06.131799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Searching by: {'deleted': False, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 20:01:06.132659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c81c5b3-adfd-4ddc-a3a0-7a12d706e516 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.133308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c81c5b3-adfd-4ddc-a3a0-7a12d706e516 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.133897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c81c5b3-adfd-4ddc-a3a0-7a12d706e516 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.135350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c81c5b3-adfd-4ddc-a3a0-7a12d706e516 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.137211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c81c5b3-adfd-4ddc-a3a0-7a12d706e516 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.137817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c81c5b3-adfd-4ddc-a3a0-7a12d706e516 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.138275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.138830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.139327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.140776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.141438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.141928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.143574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:06.176314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 20:01:06.222107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:06.228798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.229291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.229738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.335419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1c81c5b3-adfd-4ddc-a3a0-7a12d706e516 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:06.346405 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c81c5b3-adfd-4ddc-a3a0-7a12d706e516 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1508 microversion: 2.1 time: 0.243850 Oct 11 20:01:06.347793 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2081/4088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:06 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:06.368945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4eff5ecc-58e3-456b-9c22-5e82f7a9df5c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:06.369842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4eff5ecc-58e3-456b-9c22-5e82f7a9df5c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:06.376182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4eff5ecc-58e3-456b-9c22-5e82f7a9df5c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.376919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4eff5ecc-58e3-456b-9c22-5e82f7a9df5c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.377554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4eff5ecc-58e3-456b-9c22-5e82f7a9df5c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.378432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4eff5ecc-58e3-456b-9c22-5e82f7a9df5c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.379090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4eff5ecc-58e3-456b-9c22-5e82f7a9df5c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.379687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4eff5ecc-58e3-456b-9c22-5e82f7a9df5c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.389214 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7d885209-7072-4190-9241-4048bf23f511 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.282501 Oct 11 20:01:06.389824 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2008/4089] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 20:01:06 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:06.413313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-91589b9d-754c-44fa-bb36-3edc2ca5d30d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:06.424850 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-91589b9d-754c-44fa-bb36-3edc2ca5d30d tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015314 Oct 11 20:01:06.426090 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2009/4090] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 20:01:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:06.477220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-026ffaab-00de-4e0f-9f29-f9906bdcb792 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:06.477903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-026ffaab-00de-4e0f-9f29-f9906bdcb792 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:06.487043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-026ffaab-00de-4e0f-9f29-f9906bdcb792 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.487660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-026ffaab-00de-4e0f-9f29-f9906bdcb792 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.488177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-026ffaab-00de-4e0f-9f29-f9906bdcb792 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.488971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-026ffaab-00de-4e0f-9f29-f9906bdcb792 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.489508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-026ffaab-00de-4e0f-9f29-f9906bdcb792 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.490005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-026ffaab-00de-4e0f-9f29-f9906bdcb792 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.553756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4eff5ecc-58e3-456b-9c22-5e82f7a9df5c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:06.562123 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4eff5ecc-58e3-456b-9c22-5e82f7a9df5c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1508 microversion: 2.1 time: 0.196895 Oct 11 20:01:06.572458 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2082/4091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:06 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:06.589270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-463686c7-ab65-47f5-885a-225fb6881986 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:06.589961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-463686c7-ab65-47f5-885a-225fb6881986 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:06.598036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-463686c7-ab65-47f5-885a-225fb6881986 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.598576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-463686c7-ab65-47f5-885a-225fb6881986 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.598993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-463686c7-ab65-47f5-885a-225fb6881986 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.599689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-463686c7-ab65-47f5-885a-225fb6881986 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.600142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-463686c7-ab65-47f5-885a-225fb6881986 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.600562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-463686c7-ab65-47f5-885a-225fb6881986 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.635378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-463686c7-ab65-47f5-885a-225fb6881986 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:01:06.663780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-026ffaab-00de-4e0f-9f29-f9906bdcb792 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:06.672272 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-026ffaab-00de-4e0f-9f29-f9906bdcb792 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1307 microversion: 2.1 time: 0.198916 Oct 11 20:01:06.673400 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2010/4092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:06 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:06.678815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:06.679857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:06.690724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.691241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.692052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.692435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.692887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.693363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.727625 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-463686c7-ab65-47f5-885a-225fb6881986 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 204 len: 0 microversion: 2.1 time: 0.143620 Oct 11 20:01:06.738915 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2083/4093] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:01:06 2022] DELETE /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:01:06.756177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a43a9a3-d952-41b6-85ac-3be98259a60d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:06.756896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a43a9a3-d952-41b6-85ac-3be98259a60d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:06.775528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a43a9a3-d952-41b6-85ac-3be98259a60d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.776068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a43a9a3-d952-41b6-85ac-3be98259a60d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.776550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a43a9a3-d952-41b6-85ac-3be98259a60d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:06.777838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a43a9a3-d952-41b6-85ac-3be98259a60d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:06.778302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a43a9a3-d952-41b6-85ac-3be98259a60d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:06.778757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a43a9a3-d952-41b6-85ac-3be98259a60d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.009413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:07.020398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:07.021877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:07.037197 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-89a33359-cbc1-4b42-8421-3bea1cc35b07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1752 microversion: 2.20 time: 0.355521 Oct 11 20:01:07.050675 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2011/4094] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:06 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1752 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:07.066628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8008c528-3dfa-4a83-9504-f56b8212d13e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:07.067422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8008c528-3dfa-4a83-9504-f56b8212d13e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:07.084200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8008c528-3dfa-4a83-9504-f56b8212d13e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.084976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8008c528-3dfa-4a83-9504-f56b8212d13e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.085612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8008c528-3dfa-4a83-9504-f56b8212d13e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.086579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8008c528-3dfa-4a83-9504-f56b8212d13e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.087231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8008c528-3dfa-4a83-9504-f56b8212d13e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.087848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8008c528-3dfa-4a83-9504-f56b8212d13e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.120016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a43a9a3-d952-41b6-85ac-3be98259a60d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:07.133851 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a43a9a3-d952-41b6-85ac-3be98259a60d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1514 microversion: 2.1 time: 0.387554 Oct 11 20:01:07.148611 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2084/4095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:06 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1514 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:07.164465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8008c528-3dfa-4a83-9504-f56b8212d13e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:01:07.165500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b2a83a51-89d6-47b8-966b-d4b93a09521a req-0f527035-e68e-4bbc-86ab-bdb28788bf51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9b0470-13c5-4393-a735-d4b067e5f980", "name": "network-vif-plugged", "status": "completed", "tag": "c99ee24d-ef2c-408e-b3a8-5cbb58c948d8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:07.193573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b2a83a51-89d6-47b8-966b-d4b93a09521a req-0f527035-e68e-4bbc-86ab-bdb28788bf51 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.194301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b2a83a51-89d6-47b8-966b-d4b93a09521a req-0f527035-e68e-4bbc-86ab-bdb28788bf51 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.195055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b2a83a51-89d6-47b8-966b-d4b93a09521a req-0f527035-e68e-4bbc-86ab-bdb28788bf51 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.231456 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b2a83a51-89d6-47b8-966b-d4b93a09521a req-0f527035-e68e-4bbc-86ab-bdb28788bf51 service nova] Creating event network-vif-plugged:c99ee24d-ef2c-408e-b3a8-5cbb58c948d8 for instance 2b9b0470-13c5-4393-a735-d4b067e5f980 on n-h1-860864-3 Oct 11 20:01:07.240409 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b2a83a51-89d6-47b8-966b-d4b93a09521a req-0f527035-e68e-4bbc-86ab-bdb28788bf51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089783 Oct 11 20:01:07.246894 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2085/4096] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:07.259957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ccbf1d1-f241-4350-8851-3aed4a84b7ab tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:07.261742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ccbf1d1-f241-4350-8851-3aed4a84b7ab tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:07.272886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccbf1d1-f241-4350-8851-3aed4a84b7ab tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.275647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccbf1d1-f241-4350-8851-3aed4a84b7ab tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.276416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccbf1d1-f241-4350-8851-3aed4a84b7ab tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.279568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccbf1d1-f241-4350-8851-3aed4a84b7ab tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.280489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccbf1d1-f241-4350-8851-3aed4a84b7ab tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.283074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ccbf1d1-f241-4350-8851-3aed4a84b7ab tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.296752 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8008c528-3dfa-4a83-9504-f56b8212d13e tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 204 len: 0 microversion: 2.1 time: 0.242154 Oct 11 20:01:07.298793 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2012/4097] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:01:07 2022] DELETE /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:01:07.312036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b3a95d3f-0688-46a5-ab9a-17e00b1d063f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:07.312760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b3a95d3f-0688-46a5-ab9a-17e00b1d063f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:07.330109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a95d3f-0688-46a5-ab9a-17e00b1d063f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.330662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a95d3f-0688-46a5-ab9a-17e00b1d063f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.331267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a95d3f-0688-46a5-ab9a-17e00b1d063f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.331993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a95d3f-0688-46a5-ab9a-17e00b1d063f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.332462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a95d3f-0688-46a5-ab9a-17e00b1d063f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.332897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a95d3f-0688-46a5-ab9a-17e00b1d063f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.594650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7ccbf1d1-f241-4350-8851-3aed4a84b7ab tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:07.613365 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ccbf1d1-f241-4350-8851-3aed4a84b7ab tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.364943 Oct 11 20:01:07.615388 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2086/4098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:07 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:07.647007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8e68ddd9-cb32-4575-a7d3-297be995d526 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:07.647987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8e68ddd9-cb32-4575-a7d3-297be995d526 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:07.649531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b3a95d3f-0688-46a5-ab9a-17e00b1d063f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:07.656568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e68ddd9-cb32-4575-a7d3-297be995d526 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.657354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e68ddd9-cb32-4575-a7d3-297be995d526 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.658001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e68ddd9-cb32-4575-a7d3-297be995d526 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.658961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e68ddd9-cb32-4575-a7d3-297be995d526 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.659639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e68ddd9-cb32-4575-a7d3-297be995d526 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.660297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e68ddd9-cb32-4575-a7d3-297be995d526 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.664692 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b3a95d3f-0688-46a5-ab9a-17e00b1d063f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1315 microversion: 2.1 time: 0.363855 Oct 11 20:01:07.665328 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2013/4099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:07 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:07.696330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-52e9cb37-64e8-4d8b-8419-351a83a9e2cd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:07.697684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-52e9cb37-64e8-4d8b-8419-351a83a9e2cd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:07.721120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e9cb37-64e8-4d8b-8419-351a83a9e2cd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.722404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e9cb37-64e8-4d8b-8419-351a83a9e2cd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.723095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e9cb37-64e8-4d8b-8419-351a83a9e2cd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.724055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e9cb37-64e8-4d8b-8419-351a83a9e2cd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:07.724733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e9cb37-64e8-4d8b-8419-351a83a9e2cd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:07.725398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52e9cb37-64e8-4d8b-8419-351a83a9e2cd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:07.950087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e68ddd9-cb32-4575-a7d3-297be995d526 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:07.958341 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8e68ddd9-cb32-4575-a7d3-297be995d526 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1713 microversion: 2.1 time: 0.322530 Oct 11 20:01:07.970856 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2087/4100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:07 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1713 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:08.085787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:08.086393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:08.098638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:08.099521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:08.100117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:08.100969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:08.103621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:08.104215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:08.161187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-52e9cb37-64e8-4d8b-8419-351a83a9e2cd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:08.169761 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-52e9cb37-64e8-4d8b-8419-351a83a9e2cd tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1307 microversion: 2.1 time: 0.477473 Oct 11 20:01:08.173729 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2014/4101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:07 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1307 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:08.179575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5f49938b-3e3e-4aa1-8165-ad2db64482c7 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:08.180192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f49938b-3e3e-4aa1-8165-ad2db64482c7 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:08.196232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f49938b-3e3e-4aa1-8165-ad2db64482c7 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:08.196741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f49938b-3e3e-4aa1-8165-ad2db64482c7 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:08.197188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f49938b-3e3e-4aa1-8165-ad2db64482c7 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:08.197902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f49938b-3e3e-4aa1-8165-ad2db64482c7 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:08.199272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f49938b-3e3e-4aa1-8165-ad2db64482c7 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:08.199789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f49938b-3e3e-4aa1-8165-ad2db64482c7 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:08.510040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:08.520738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:08.523398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:08.525446 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-678b27d2-2969-488d-8801-43fc963656e7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1752 microversion: 2.20 time: 0.443255 Oct 11 20:01:08.544295 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2088/4102] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:08 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1752 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:08.639345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6fbe810e-8b88-424c-8b74-0d69d892e2dd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:08.639967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6fbe810e-8b88-424c-8b74-0d69d892e2dd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:08.654327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fbe810e-8b88-424c-8b74-0d69d892e2dd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:08.654825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fbe810e-8b88-424c-8b74-0d69d892e2dd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:08.655269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fbe810e-8b88-424c-8b74-0d69d892e2dd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:08.655954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fbe810e-8b88-424c-8b74-0d69d892e2dd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:08.656421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fbe810e-8b88-424c-8b74-0d69d892e2dd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:08.656849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fbe810e-8b88-424c-8b74-0d69d892e2dd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:08.798703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5f49938b-3e3e-4aa1-8165-ad2db64482c7 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:08.807297 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5f49938b-3e3e-4aa1-8165-ad2db64482c7 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1514 microversion: 2.1 time: 0.631273 Oct 11 20:01:08.811873 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2015/4103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:08 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1514 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:08.821550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aee24c20-7d19-4bc1-bd53-d68fe05c5847 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:08.824454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aee24c20-7d19-4bc1-bd53-d68fe05c5847 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:08.845407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aee24c20-7d19-4bc1-bd53-d68fe05c5847 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:08.846287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aee24c20-7d19-4bc1-bd53-d68fe05c5847 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:08.846974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aee24c20-7d19-4bc1-bd53-d68fe05c5847 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:08.847944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aee24c20-7d19-4bc1-bd53-d68fe05c5847 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:08.853389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aee24c20-7d19-4bc1-bd53-d68fe05c5847 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:08.853935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aee24c20-7d19-4bc1-bd53-d68fe05c5847 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:09.447713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6fbe810e-8b88-424c-8b74-0d69d892e2dd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:09.459270 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6fbe810e-8b88-424c-8b74-0d69d892e2dd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.824482 Oct 11 20:01:09.469398 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2089/4104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:08 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:09.483113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee6a8e85-c295-4682-a236-04c5dbd053a7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:09.483657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ee6a8e85-c295-4682-a236-04c5dbd053a7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:09.504952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee6a8e85-c295-4682-a236-04c5dbd053a7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:09.505455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee6a8e85-c295-4682-a236-04c5dbd053a7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:09.505888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee6a8e85-c295-4682-a236-04c5dbd053a7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:09.506612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee6a8e85-c295-4682-a236-04c5dbd053a7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:09.507068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee6a8e85-c295-4682-a236-04c5dbd053a7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:09.507489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee6a8e85-c295-4682-a236-04c5dbd053a7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:09.568390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aee24c20-7d19-4bc1-bd53-d68fe05c5847 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:09.586297 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aee24c20-7d19-4bc1-bd53-d68fe05c5847 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1315 microversion: 2.1 time: 0.768361 Oct 11 20:01:09.587169 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2016/4105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:08 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:09.594812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c4178fe8-82fc-4d48-b281-786df1540535 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:09.595422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4178fe8-82fc-4d48-b281-786df1540535 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:09.652979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4178fe8-82fc-4d48-b281-786df1540535 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:09.655085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4178fe8-82fc-4d48-b281-786df1540535 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:09.655775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4178fe8-82fc-4d48-b281-786df1540535 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:09.656308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4178fe8-82fc-4d48-b281-786df1540535 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:09.656764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4178fe8-82fc-4d48-b281-786df1540535 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:09.659325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4178fe8-82fc-4d48-b281-786df1540535 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:10.250228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ee6a8e85-c295-4682-a236-04c5dbd053a7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:10.258314 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ee6a8e85-c295-4682-a236-04c5dbd053a7 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1713 microversion: 2.1 time: 0.785406 Oct 11 20:01:10.263326 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2090/4106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:09 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1713 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:10.287807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-5738bcd9-f8b7-44ba-aa79-6f2d2f79e075 req-31b49632-b628-465d-95c8-74b9018efa59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4014c74c-a02a-44d4-a85e-9288ae8758b8", "name": "network-vif-plugged", "status": "completed", "tag": "fe9b7f5a-45d6-47f0-91a9-3c3937912457"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:10.316706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5738bcd9-f8b7-44ba-aa79-6f2d2f79e075 req-31b49632-b628-465d-95c8-74b9018efa59 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:10.317472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5738bcd9-f8b7-44ba-aa79-6f2d2f79e075 req-31b49632-b628-465d-95c8-74b9018efa59 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:10.318252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5738bcd9-f8b7-44ba-aa79-6f2d2f79e075 req-31b49632-b628-465d-95c8-74b9018efa59 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:10.344455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c4178fe8-82fc-4d48-b281-786df1540535 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:10.349632 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-5738bcd9-f8b7-44ba-aa79-6f2d2f79e075 req-31b49632-b628-465d-95c8-74b9018efa59 service nova] Creating event network-vif-plugged:fe9b7f5a-45d6-47f0-91a9-3c3937912457 for instance 4014c74c-a02a-44d4-a85e-9288ae8758b8 on n-h2-860864-3 Oct 11 20:01:10.356158 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c4178fe8-82fc-4d48-b281-786df1540535 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1488 microversion: 2.1 time: 0.765181 Oct 11 20:01:10.357890 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-5738bcd9-f8b7-44ba-aa79-6f2d2f79e075 req-31b49632-b628-465d-95c8-74b9018efa59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081096 Oct 11 20:01:10.363418 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2091/4108] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:10.371482 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2017/4108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:09 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1488 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:10.382501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:10.383270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:10.404705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-896a1c64-4439-4279-9339-b6ff6e4b484e req-e7f77a7a-187a-4ae4-aa7b-10f38dbebdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a538e9-f310-4739-bf23-3db32cca228a", "name": "network-vif-deleted", "tag": "73e8073d-2357-4294-b78a-3ba0a1c71ec9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:10.405997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:10.406504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:10.406971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:10.415550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:10.416090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:10.416584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:10.456322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-896a1c64-4439-4279-9339-b6ff6e4b484e req-e7f77a7a-187a-4ae4-aa7b-10f38dbebdf6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:10.460306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-896a1c64-4439-4279-9339-b6ff6e4b484e req-e7f77a7a-187a-4ae4-aa7b-10f38dbebdf6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:10.462569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-896a1c64-4439-4279-9339-b6ff6e4b484e req-e7f77a7a-187a-4ae4-aa7b-10f38dbebdf6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:10.504248 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-896a1c64-4439-4279-9339-b6ff6e4b484e req-e7f77a7a-187a-4ae4-aa7b-10f38dbebdf6 service nova] Creating event network-vif-deleted:73e8073d-2357-4294-b78a-3ba0a1c71ec9 for instance c6a538e9-f310-4739-bf23-3db32cca228a on n-h1-860864-3 Oct 11 20:01:10.524171 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-896a1c64-4439-4279-9339-b6ff6e4b484e req-e7f77a7a-187a-4ae4-aa7b-10f38dbebdf6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146225 Oct 11 20:01:10.524805 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2018/4109] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:10.537310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:10.547802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:10.576081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:10.576759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:10.580946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:10.586365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:10.587044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:10.600266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:10.677039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:10.680316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:10.681932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:10.682444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lazy-loading 'fault' on Instance uuid c6a538e9-f310-4739-bf23-3db32cca228a {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:01:10.778420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:10.790330 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-431deed9-0667-4b62-bf8b-3327c8c0158c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 200 len: 1317 microversion: 2.1 time: 0.256114 Oct 11 20:01:10.791736 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2019/4110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:10 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:10.801624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8969a071-190f-4ca1-976a-095d9572c961 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:10.804372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8969a071-190f-4ca1-976a-095d9572c961 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:10.820778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8969a071-190f-4ca1-976a-095d9572c961 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:10.822864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8969a071-190f-4ca1-976a-095d9572c961 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:10.824525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8969a071-190f-4ca1-976a-095d9572c961 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:10.825640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8969a071-190f-4ca1-976a-095d9572c961 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:10.828064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8969a071-190f-4ca1-976a-095d9572c961 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:10.829354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8969a071-190f-4ca1-976a-095d9572c961 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:10.884575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-8969a071-190f-4ca1-976a-095d9572c961 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lazy-loading 'flavor' on Instance uuid 2b9b0470-13c5-4393-a735-d4b067e5f980 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:01:10.939489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:10.952301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:10.956134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:10.958293 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-17e68bb6-b06b-4b1d-9099-46a2a45e3825 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1752 microversion: 2.20 time: 0.591799 Oct 11 20:01:10.963436 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2092/4111] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:10 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1752 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:10.983328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c8bc05ab-7b77-4f5d-a5aa-6d503118136b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:10.984197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c8bc05ab-7b77-4f5d-a5aa-6d503118136b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:11.004437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8bc05ab-7b77-4f5d-a5aa-6d503118136b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.005159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8bc05ab-7b77-4f5d-a5aa-6d503118136b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.005775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8bc05ab-7b77-4f5d-a5aa-6d503118136b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.006704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8bc05ab-7b77-4f5d-a5aa-6d503118136b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.007310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8bc05ab-7b77-4f5d-a5aa-6d503118136b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.007881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8bc05ab-7b77-4f5d-a5aa-6d503118136b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.034154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:11.067368 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8969a071-190f-4ca1-976a-095d9572c961 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980/action" status: 202 len: 0 microversion: 2.1 time: 0.269868 Oct 11 20:01:11.071715 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2020/4112] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:01:10 2022] POST /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:01:11.091737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb881c8a-d355-4c4b-9b4e-025b2baa56a3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:11.096719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bb881c8a-d355-4c4b-9b4e-025b2baa56a3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:11.126512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb881c8a-d355-4c4b-9b4e-025b2baa56a3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.129475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb881c8a-d355-4c4b-9b4e-025b2baa56a3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.131138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb881c8a-d355-4c4b-9b4e-025b2baa56a3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.132863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb881c8a-d355-4c4b-9b4e-025b2baa56a3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.135056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb881c8a-d355-4c4b-9b4e-025b2baa56a3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.137846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb881c8a-d355-4c4b-9b4e-025b2baa56a3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.511065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c8bc05ab-7b77-4f5d-a5aa-6d503118136b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:11.523161 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c8bc05ab-7b77-4f5d-a5aa-6d503118136b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.558154 Oct 11 20:01:11.546372 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2093/4113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:10 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:11.550465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bb881c8a-d355-4c4b-9b4e-025b2baa56a3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:11.561009 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bb881c8a-d355-4c4b-9b4e-025b2baa56a3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1315 microversion: 2.1 time: 0.487772 Oct 11 20:01:11.567300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4857b137-94e2-40ed-814c-c4979b5dd841 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:11.570634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4857b137-94e2-40ed-814c-c4979b5dd841 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:11.584845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4857b137-94e2-40ed-814c-c4979b5dd841 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.586017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4857b137-94e2-40ed-814c-c4979b5dd841 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.587349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4857b137-94e2-40ed-814c-c4979b5dd841 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.591663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4857b137-94e2-40ed-814c-c4979b5dd841 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.592352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4857b137-94e2-40ed-814c-c4979b5dd841 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.592953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4857b137-94e2-40ed-814c-c4979b5dd841 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.598889 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2021/4114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:11 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:11.607479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-fcf1c307-89d2-40ad-80d1-30fb407c59de req-3ded5e16-5949-400a-b2c7-8d4f94d8810e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f563b39-da5e-4d96-a6d4-ee6642d668a3", "name": "network-vif-deleted", "tag": "f6d0e7a7-dee9-44a5-9015-7bb817c9e400"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:11.711226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fcf1c307-89d2-40ad-80d1-30fb407c59de req-3ded5e16-5949-400a-b2c7-8d4f94d8810e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.711879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fcf1c307-89d2-40ad-80d1-30fb407c59de req-3ded5e16-5949-400a-b2c7-8d4f94d8810e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.712333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-fcf1c307-89d2-40ad-80d1-30fb407c59de req-3ded5e16-5949-400a-b2c7-8d4f94d8810e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.747644 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-fcf1c307-89d2-40ad-80d1-30fb407c59de req-3ded5e16-5949-400a-b2c7-8d4f94d8810e service nova] Creating event network-vif-deleted:f6d0e7a7-dee9-44a5-9015-7bb817c9e400 for instance 5f563b39-da5e-4d96-a6d4-ee6642d668a3 on n-h2-860864-3 Oct 11 20:01:11.755059 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-fcf1c307-89d2-40ad-80d1-30fb407c59de req-3ded5e16-5949-400a-b2c7-8d4f94d8810e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154244 Oct 11 20:01:11.756115 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2022/4115] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:11.762922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:11.765787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:11.784139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.784643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.785089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.785782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.796470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.796852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.875023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4857b137-94e2-40ed-814c-c4979b5dd841 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:11.888180 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4857b137-94e2-40ed-814c-c4979b5dd841 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1496 microversion: 2.1 time: 0.340379 Oct 11 20:01:11.903030 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2094/4116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:11 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1496 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:11.919324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:11.921319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:11.924359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.925984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.927094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.929970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lazy-loading 'fault' on Instance uuid 5f563b39-da5e-4d96-a6d4-ee6642d668a3 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:01:11.937301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.951328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.953744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:11.965887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:11.966730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:11.967345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:12.012940 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a HTTP/1.1 Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'c6a538e9-f310-4739-bf23-3db32cca228a'} Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:01:12.015046 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:01:12.019180 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:01:12.019180 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:01:12.019180 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:01:12.019180 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:01:12.019180 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:01:12.019180 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:01:12.019180 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:01:12.019180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:01:12.019180 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0d7564b7-4ed9-4afc-b720-acae8c933940 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 404 len: 111 microversion: 2.1 time: 0.112348 Oct 11 20:01:12.021365 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2095/4117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:11 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:01:12.029050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:12.030283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:12.032196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca071e3ee284a0dbd2762856cf2a2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd967db3cdcf24f8191bcaad486b9d16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:12.039950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:12.040604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:12.041053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:12.041832 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cfce3230-9b19-43d9-a1eb-8af7a10d8e27 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 200 len: 1368 microversion: 2.1 time: 0.283568 Oct 11 20:01:12.043672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:12.044751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:12.045446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:12.046974 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2023/4118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:11 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:12.057748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d989aa11-886f-41f6-8187-b83e918de874 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '.version_select at 0x7f83cc1020d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:12.105684 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d989aa11-886f-41f6-8187-b83e918de874 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-443303125" status: 202 len: 0 microversion: 2.1 time: 0.054147 Oct 11 20:01:12.107558 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2024/4119] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 11 20:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-443303125 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:01:12.250258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-527531185", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "4bda9a14-e746-4951-9d43-234855a05a4d"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:12.307487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:12.318000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:12.335902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:12.337530 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-780225ca-6762-4559-a4f8-e15a011c0f6b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 0.314658 Oct 11 20:01:12.350555 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2096/4120] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:12 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:12.357858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] validate_networks() for [('4bda9a14-e746-4951-9d43-234855a05a4d', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:01:12.552269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-219cf8fc-71f5-4f8b-aa23-1fb6247f7db7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:12.553692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-219cf8fc-71f5-4f8b-aa23-1fb6247f7db7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:12.562160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219cf8fc-71f5-4f8b-aa23-1fb6247f7db7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:12.562923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219cf8fc-71f5-4f8b-aa23-1fb6247f7db7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:12.563860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219cf8fc-71f5-4f8b-aa23-1fb6247f7db7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:12.564788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219cf8fc-71f5-4f8b-aa23-1fb6247f7db7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:12.565403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219cf8fc-71f5-4f8b-aa23-1fb6247f7db7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:12.565971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-219cf8fc-71f5-4f8b-aa23-1fb6247f7db7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:12.899156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-219cf8fc-71f5-4f8b-aa23-1fb6247f7db7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:12.915688 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-219cf8fc-71f5-4f8b-aa23-1fb6247f7db7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.367176 Oct 11 20:01:12.922756 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2097/4121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:12 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:12.927880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b068d522-100e-497f-b597-bf6a51a74438 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:12.929899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b068d522-100e-497f-b597-bf6a51a74438 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:12.939238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b068d522-100e-497f-b597-bf6a51a74438 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:12.939741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b068d522-100e-497f-b597-bf6a51a74438 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:12.940183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b068d522-100e-497f-b597-bf6a51a74438 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:12.941027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b068d522-100e-497f-b597-bf6a51a74438 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:12.941605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b068d522-100e-497f-b597-bf6a51a74438 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:12.942047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b068d522-100e-497f-b597-bf6a51a74438 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:12.975372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:13.071209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:01:13.071795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:01:13.072273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:01:13.072684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:01:13.073463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:01:13.093594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:13.095581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:13.096215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:13.107913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:13.112154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:13.112938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:13.165679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:01:13.181154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for user a84c2531dcb24cce9872808db6c1fa6d and project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:01:13.206452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:01:13.222495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:01:13.276909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b068d522-100e-497f-b597-bf6a51a74438 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:13.285961 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-329b9eb9-09cd-485e-abf1-facc5f85672c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.039608 Oct 11 20:01:13.287564 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2025/4122] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 20:01:13.293964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff28d78e-2adc-4698-8997-5188827bc474 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:13.295153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ff28d78e-2adc-4698-8997-5188827bc474 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:13.303277 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b068d522-100e-497f-b597-bf6a51a74438 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1502 microversion: 2.1 time: 0.382852 Oct 11 20:01:13.304382 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2098/4123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:12 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1502 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:13.304655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff28d78e-2adc-4698-8997-5188827bc474 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:13.305071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff28d78e-2adc-4698-8997-5188827bc474 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:13.305825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff28d78e-2adc-4698-8997-5188827bc474 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:13.307117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff28d78e-2adc-4698-8997-5188827bc474 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:13.308085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff28d78e-2adc-4698-8997-5188827bc474 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:13.309269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff28d78e-2adc-4698-8997-5188827bc474 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:13.326573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:13.328496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] [instance: 5f563b39-da5e-4d96-a6d4-ee6642d668a3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:13.343573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:13.344309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:13.344951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:13.345795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:13.346448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:13.352582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:13.372807 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] HTTP exception thrown: Instance 5f563b39-da5e-4d96-a6d4-ee6642d668a3 could not be found. Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Request method failure captured: Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 HTTP/1.1 Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcs_gmHHRPih6K4j_T9ZGLjOAFiPh6hkeJxXfMGG8CRjBKHQF27ie9KiY4Uw1xdaoh5EnkoCFUp890QutCZ2zWD6NUhueQf5Sxy1ducPD6RyiQ9HFYZK3cDGrEBH8C5Iesnj0cyDQaMysGaePphQ6nwYadAZguA7h93JSeWtdCcfS4I Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: d967db3cdcf24f8191bcaad486b9d16e Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestManualDisk-1337847023 Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d967db3cdcf24f8191bcaad486b9d16e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d967db3cdcf24f8191bcaad486b9d16e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d967db3cdcf24f8191bcaad486b9d16e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d967db3cdcf24f8191bcaad486b9d16e"}]}] Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestManualDisk-1337847023 Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: d967db3cdcf24f8191bcaad486b9d16e Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestManualDisk-1337847023 Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestManualDisk-1337847023-project Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: aca071e3ee284a0dbd2762856cf2a2c2 Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestManualDisk-1337847023-project Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5f563b39-da5e-4d96-a6d4-ee6642d668a3 could not be found. Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5f563b39-da5e-4d96-a6d4-ee6642d668a3'} Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f563b39-da5e-4d96-a6d4-ee6642d668a3 could not be found. Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f563b39-da5e-4d96-a6d4-ee6642d668a3 could not be found. Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:01:13.374691 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:01:13.378951 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:01:13.378951 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:01:13.378951 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:01:13.378951 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:01:13.378951 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:01:13.378951 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f563b39-da5e-4d96-a6d4-ee6642d668a3 could not be found. Oct 11 20:01:13.378951 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:01:13.381393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Returning 404 to user: Instance 5f563b39-da5e-4d96-a6d4-ee6642d668a3 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:01:13.382471 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-23bee6be-f47a-485d-8aed-d6371574d714 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3" status: 404 len: 111 microversion: 2.1 time: 0.074916 Oct 11 20:01:13.384410 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2099/4124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:13 2022] GET /compute/v2.1/servers/5f563b39-da5e-4d96-a6d4-ee6642d668a3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:01:13.390023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8c74877c-8a3c-48ca-81e6-4ed2ae2fa827 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:13.391195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8c74877c-8a3c-48ca-81e6-4ed2ae2fa827 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:13.468183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c74877c-8a3c-48ca-81e6-4ed2ae2fa827 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:13.475988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8c74877c-8a3c-48ca-81e6-4ed2ae2fa827 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1208 microversion: 2.1 time: 0.090375 Oct 11 20:01:13.478861 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2100/4125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:13 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1208 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:13.494125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3756ad11-9457-4040-9e40-267226b54a15 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:13.499020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3756ad11-9457-4040-9e40-267226b54a15 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:13.507858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3756ad11-9457-4040-9e40-267226b54a15 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:13.508744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3756ad11-9457-4040-9e40-267226b54a15 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:13.509449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3756ad11-9457-4040-9e40-267226b54a15 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:13.510432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3756ad11-9457-4040-9e40-267226b54a15 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:13.511553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3756ad11-9457-4040-9e40-267226b54a15 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:13.512541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3756ad11-9457-4040-9e40-267226b54a15 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:13.684525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ff28d78e-2adc-4698-8997-5188827bc474 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:13.703386 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ff28d78e-2adc-4698-8997-5188827bc474 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 200 len: 1479 microversion: 2.1 time: 0.414072 Oct 11 20:01:13.704236 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2026/4126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:13 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 1479 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:13.735630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:13.736258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:13.750426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:13.752702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:13.753150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:13.753866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:13.754322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:13.754776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:13.903238 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.network.security_group_api [None req-3756ad11-9457-4040-9e40-267226b54a15 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Removing security group abe94337-6d7d-4317-958d-2ec89d1423d7 from port fe9b7f5a-45d6-47f0-91a9-3c3937912457 Oct 11 20:01:14.129743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:14.146455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:14.153608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:14.155007 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1c1d724d-88e9-4cd9-bef9-9834068586ee tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 0.433841 Oct 11 20:01:14.155598 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2027/4127] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:13 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:14.178100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f4c35f8a-4720-4074-912f-736b595347c5 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] Calling method '.version_select at 0x7f83cc063ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:14.260340 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f4c35f8a-4720-4074-912f-736b595347c5 tempest-ServersTestManualDisk-1337847023 tempest-ServersTestManualDisk-1337847023-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506801164" status: 202 len: 0 microversion: 2.1 time: 0.086071 Oct 11 20:01:14.283778 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2028/4128] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 20:01:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506801164 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:01:14.299560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0f36f019-81f8-47ae-9d2d-dd290475a0c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-927114565"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:14.310124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0f36f019-81f8-47ae-9d2d-dd290475a0c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:14.338458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f36f019-81f8-47ae-9d2d-dd290475a0c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:14.339418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f36f019-81f8-47ae-9d2d-dd290475a0c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:14.342734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f36f019-81f8-47ae-9d2d-dd290475a0c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:14.343553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f36f019-81f8-47ae-9d2d-dd290475a0c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:14.344030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f36f019-81f8-47ae-9d2d-dd290475a0c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:14.344459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f36f019-81f8-47ae-9d2d-dd290475a0c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:14.669951 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0f36f019-81f8-47ae-9d2d-dd290475a0c1 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980/action" status: 202 len: 0 microversion: 2.1 time: 0.384870 Oct 11 20:01:14.674301 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2029/4129] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:01:14 2022] POST /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 20:01:14.686683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b6be3193-79a1-43ff-968b-a99dab74b4d3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:14.688191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b6be3193-79a1-43ff-968b-a99dab74b4d3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:14.696675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6be3193-79a1-43ff-968b-a99dab74b4d3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:14.697870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6be3193-79a1-43ff-968b-a99dab74b4d3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:14.699377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6be3193-79a1-43ff-968b-a99dab74b4d3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:14.700914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6be3193-79a1-43ff-968b-a99dab74b4d3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:14.701553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6be3193-79a1-43ff-968b-a99dab74b4d3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:14.702157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6be3193-79a1-43ff-968b-a99dab74b4d3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:14.710808 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3756ad11-9457-4040-9e40-267226b54a15 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8/action" status: 202 len: 0 microversion: 2.1 time: 1.229909 Oct 11 20:01:14.711489 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2101/4130] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:01:13 2022] POST /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8/action => generated 0 bytes in 1232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:01:14.720871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-851c7a3e-10f4-4729-8440-4f17a6591b40 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:14.721767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-851c7a3e-10f4-4729-8440-4f17a6591b40 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:14.737674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-851c7a3e-10f4-4729-8440-4f17a6591b40 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:14.739977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-851c7a3e-10f4-4729-8440-4f17a6591b40 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:14.753659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-851c7a3e-10f4-4729-8440-4f17a6591b40 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:14.756005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-851c7a3e-10f4-4729-8440-4f17a6591b40 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:14.757104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-851c7a3e-10f4-4729-8440-4f17a6591b40 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:14.759210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-851c7a3e-10f4-4729-8440-4f17a6591b40 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:15.045355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-851c7a3e-10f4-4729-8440-4f17a6591b40 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:15.060120 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-851c7a3e-10f4-4729-8440-4f17a6591b40 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1260 microversion: 2.1 time: 0.343962 Oct 11 20:01:15.075815 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2102/4131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:14 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1260 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:15.098645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c64687f1-c62d-471c-a042-f9e85d9fb69c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c7295550>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:15.241426 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c64687f1-c62d-471c-a042-f9e85d9fb69c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442" status: 200 len: 1439 microversion: 2.1 time: 0.164101 Oct 11 20:01:15.242328 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2103/4132] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:01:15 2022] GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 => generated 1439 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:15.272951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6901531d-49aa-4848-9263-8c01a55e44d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:15.275618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6901531d-49aa-4848-9263-8c01a55e44d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:15.302684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6901531d-49aa-4848-9263-8c01a55e44d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:15.303255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6901531d-49aa-4848-9263-8c01a55e44d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:15.303780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6901531d-49aa-4848-9263-8c01a55e44d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:15.304497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6901531d-49aa-4848-9263-8c01a55e44d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:15.304958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6901531d-49aa-4848-9263-8c01a55e44d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:15.305379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6901531d-49aa-4848-9263-8c01a55e44d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:15.354515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6be3193-79a1-43ff-968b-a99dab74b4d3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:15.368022 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b6be3193-79a1-43ff-968b-a99dab74b4d3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.690504 Oct 11 20:01:15.370702 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2030/4133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:14 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:15.391598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ba38c549-b9f8-4ba5-9d9a-27ad7cbe351e req-8861234b-e300-4a75-813e-d8273706938c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4014c74c-a02a-44d4-a85e-9288ae8758b8", "tag": "fe9b7f5a-45d6-47f0-91a9-3c3937912457"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:15.418174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ba38c549-b9f8-4ba5-9d9a-27ad7cbe351e req-8861234b-e300-4a75-813e-d8273706938c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:15.420609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ba38c549-b9f8-4ba5-9d9a-27ad7cbe351e req-8861234b-e300-4a75-813e-d8273706938c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:15.423618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ba38c549-b9f8-4ba5-9d9a-27ad7cbe351e req-8861234b-e300-4a75-813e-d8273706938c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:15.460770 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ba38c549-b9f8-4ba5-9d9a-27ad7cbe351e req-8861234b-e300-4a75-813e-d8273706938c service nova] Creating event network-changed:fe9b7f5a-45d6-47f0-91a9-3c3937912457 for instance 4014c74c-a02a-44d4-a85e-9288ae8758b8 on n-h2-860864-3 Oct 11 20:01:15.481983 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ba38c549-b9f8-4ba5-9d9a-27ad7cbe351e req-8861234b-e300-4a75-813e-d8273706938c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105509 Oct 11 20:01:15.484719 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2031/4134] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:15.499954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:15.501791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:15.524892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:15.527173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:15.528409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:15.531549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:15.532257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:15.535098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:15.972279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6901531d-49aa-4848-9263-8c01a55e44d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:15.999733 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6901531d-49aa-4848-9263-8c01a55e44d4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1460 microversion: 2.1 time: 0.738782 Oct 11 20:01:16.002655 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2104/4135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:15 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1460 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:16.032812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f7941493-3611-41f8-b93e-02416bb81393 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:16.040674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f7941493-3611-41f8-b93e-02416bb81393 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:16.098867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7941493-3611-41f8-b93e-02416bb81393 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:16.106312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7941493-3611-41f8-b93e-02416bb81393 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:16.108304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7941493-3611-41f8-b93e-02416bb81393 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:16.110925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7941493-3611-41f8-b93e-02416bb81393 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:16.118720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7941493-3611-41f8-b93e-02416bb81393 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:16.121801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7941493-3611-41f8-b93e-02416bb81393 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:17.668144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:17.691095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:17.701727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:17.703462 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-598b7849-e802-4a57-8300-31dab85c0861 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 2.215071 Oct 11 20:01:17.719127 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2032/4136] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:15 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:17.751804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1df855b0-8dc3-4b63-a73c-2b718e6c10c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:17.752433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1df855b0-8dc3-4b63-a73c-2b718e6c10c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:17.782298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1df855b0-8dc3-4b63-a73c-2b718e6c10c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:17.786990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1df855b0-8dc3-4b63-a73c-2b718e6c10c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:17.790313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1df855b0-8dc3-4b63-a73c-2b718e6c10c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:17.793984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1df855b0-8dc3-4b63-a73c-2b718e6c10c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:17.796040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1df855b0-8dc3-4b63-a73c-2b718e6c10c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:17.804195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1df855b0-8dc3-4b63-a73c-2b718e6c10c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:17.931603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7941493-3611-41f8-b93e-02416bb81393 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:17.944264 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f7941493-3611-41f8-b93e-02416bb81393 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 1.919969 Oct 11 20:01:17.962385 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2105/4137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:16 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:17.975263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ec616cb4-330d-4579-a876-dd1df778c56d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72f4160>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:18.062887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1df855b0-8dc3-4b63-a73c-2b718e6c10c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:18.084237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1df855b0-8dc3-4b63-a73c-2b718e6c10c9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1266 microversion: 2.1 time: 0.363220 Oct 11 20:01:18.085630 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2033/4138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:17 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:18.114789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-88fe05e8-e9dd-4af3-a874-174c792b0ce4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:18.115837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-88fe05e8-e9dd-4af3-a874-174c792b0ce4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:18.125196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88fe05e8-e9dd-4af3-a874-174c792b0ce4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:18.126111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88fe05e8-e9dd-4af3-a874-174c792b0ce4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:18.126799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88fe05e8-e9dd-4af3-a874-174c792b0ce4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:18.127844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88fe05e8-e9dd-4af3-a874-174c792b0ce4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:18.128521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88fe05e8-e9dd-4af3-a874-174c792b0ce4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:18.129198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88fe05e8-e9dd-4af3-a874-174c792b0ce4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:18.982223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-88fe05e8-e9dd-4af3-a874-174c792b0ce4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:18.994226 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-88fe05e8-e9dd-4af3-a874-174c792b0ce4 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.893576 Oct 11 20:01:19.003268 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2034/4139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:18 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:19.012235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b3a71fc4-0973-4799-81ec-b507bc629c5e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:19.040101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b3a71fc4-0973-4799-81ec-b507bc629c5e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:19.099240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a71fc4-0973-4799-81ec-b507bc629c5e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:19.099767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a71fc4-0973-4799-81ec-b507bc629c5e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:19.109081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a71fc4-0973-4799-81ec-b507bc629c5e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:19.118264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a71fc4-0973-4799-81ec-b507bc629c5e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:19.118817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a71fc4-0973-4799-81ec-b507bc629c5e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:19.119271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a71fc4-0973-4799-81ec-b507bc629c5e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:20.452403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b3a71fc4-0973-4799-81ec-b507bc629c5e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:20.462912 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b3a71fc4-0973-4799-81ec-b507bc629c5e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 1.455177 Oct 11 20:01:20.469800 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2035/4140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:19 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:20.477983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:20.490484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:20.515494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:20.516388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:20.517068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:20.518046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:20.519374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:20.519374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:21.248081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:21.266511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:21.268514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:21.271876 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-34159c72-46a7-4cde-b04e-2066eed3ea8d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 0.800809 Oct 11 20:01:21.295814 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2036/4141] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:20 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:21.313451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-63e1758b-f00c-45bd-b740-ba0d1a4711ed tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:21.314609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-63e1758b-f00c-45bd-b740-ba0d1a4711ed tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:21.328815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63e1758b-f00c-45bd-b740-ba0d1a4711ed tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:21.332476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63e1758b-f00c-45bd-b740-ba0d1a4711ed tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:21.335940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63e1758b-f00c-45bd-b740-ba0d1a4711ed tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:21.336783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63e1758b-f00c-45bd-b740-ba0d1a4711ed tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:21.339952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63e1758b-f00c-45bd-b740-ba0d1a4711ed tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:21.340409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63e1758b-f00c-45bd-b740-ba0d1a4711ed tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:22.395252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63e1758b-f00c-45bd-b740-ba0d1a4711ed tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:22.407622 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-63e1758b-f00c-45bd-b740-ba0d1a4711ed tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1308 microversion: 2.1 time: 1.109977 Oct 11 20:01:22.424108 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2037/4142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:21 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1308 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:22.435969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b19ee6db-4819-4907-810a-c3e4417a18a3 req-de418950-12ce-4581-a133-69dc4a2430c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9b0470-13c5-4393-a735-d4b067e5f980", "name": "network-vif-plugged", "status": "completed", "tag": "c99ee24d-ef2c-408e-b3a8-5cbb58c948d8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:22.447054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b19ee6db-4819-4907-810a-c3e4417a18a3 req-de418950-12ce-4581-a133-69dc4a2430c5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:22.448339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b19ee6db-4819-4907-810a-c3e4417a18a3 req-de418950-12ce-4581-a133-69dc4a2430c5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:22.449194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b19ee6db-4819-4907-810a-c3e4417a18a3 req-de418950-12ce-4581-a133-69dc4a2430c5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:22.467237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b19ee6db-4819-4907-810a-c3e4417a18a3 req-de418950-12ce-4581-a133-69dc4a2430c5 service nova] Creating event network-vif-plugged:c99ee24d-ef2c-408e-b3a8-5cbb58c948d8 for instance 2b9b0470-13c5-4393-a735-d4b067e5f980 on n-h1-860864-3 Oct 11 20:01:22.472684 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b19ee6db-4819-4907-810a-c3e4417a18a3 req-de418950-12ce-4581-a133-69dc4a2430c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047004 Oct 11 20:01:22.474353 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2038/4143] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:22.481877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3eb25435-33d1-48f9-bfad-e3b3189f3a00 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:22.482816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3eb25435-33d1-48f9-bfad-e3b3189f3a00 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:22.489521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:22.492205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3eb25435-33d1-48f9-bfad-e3b3189f3a00 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:22.492885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3eb25435-33d1-48f9-bfad-e3b3189f3a00 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:22.493498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3eb25435-33d1-48f9-bfad-e3b3189f3a00 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:22.494937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3eb25435-33d1-48f9-bfad-e3b3189f3a00 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:22.496538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3eb25435-33d1-48f9-bfad-e3b3189f3a00 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:22.497209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3eb25435-33d1-48f9-bfad-e3b3189f3a00 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:22.995438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3eb25435-33d1-48f9-bfad-e3b3189f3a00 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:23.016227 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3eb25435-33d1-48f9-bfad-e3b3189f3a00 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.535768 Oct 11 20:01:23.031019 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2039/4144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:22 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:23.044454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae31cb87-c292-45ea-a06c-82ade813beb9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:23.045014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae31cb87-c292-45ea-a06c-82ade813beb9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:23.057991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae31cb87-c292-45ea-a06c-82ade813beb9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:23.060674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae31cb87-c292-45ea-a06c-82ade813beb9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:23.061139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae31cb87-c292-45ea-a06c-82ade813beb9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:23.061869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae31cb87-c292-45ea-a06c-82ade813beb9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:23.062332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae31cb87-c292-45ea-a06c-82ade813beb9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:23.065114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae31cb87-c292-45ea-a06c-82ade813beb9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:23.122828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:23.145520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:23.200074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:23.476048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:23.596001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ae31cb87-c292-45ea-a06c-82ade813beb9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:23.626043 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ae31cb87-c292-45ea-a06c-82ade813beb9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.593157 Oct 11 20:01:23.632462 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2040/4145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:23 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:23.643877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:23.645111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:23.664541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:23.668462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:23.669649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:23.675394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:23.677199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:23.678819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:24.934045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:24.967375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:24.977624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:24.982238 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c29e62d7-15be-443f-a215-4725a6232b68 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 1.348371 Oct 11 20:01:24.990919 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2041/4146] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:23 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:25.012909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d975a995-cf90-49f0-896d-aa91ab3b9730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:25.022408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d975a995-cf90-49f0-896d-aa91ab3b9730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:25.065771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d975a995-cf90-49f0-896d-aa91ab3b9730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:25.079108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d975a995-cf90-49f0-896d-aa91ab3b9730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:25.079712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d975a995-cf90-49f0-896d-aa91ab3b9730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:25.084369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d975a995-cf90-49f0-896d-aa91ab3b9730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:25.091226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d975a995-cf90-49f0-896d-aa91ab3b9730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:25.092124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d975a995-cf90-49f0-896d-aa91ab3b9730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:25.762505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d975a995-cf90-49f0-896d-aa91ab3b9730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:25.780164 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d975a995-cf90-49f0-896d-aa91ab3b9730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1308 microversion: 2.1 time: 0.787929 Oct 11 20:01:25.801289 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2042/4147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:24 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1308 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:25.826708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a9243081-50e3-484b-b79c-4fbdf07ad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:25.829471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a9243081-50e3-484b-b79c-4fbdf07ad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:25.858294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9243081-50e3-484b-b79c-4fbdf07ad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:25.858817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9243081-50e3-484b-b79c-4fbdf07ad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:25.859255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9243081-50e3-484b-b79c-4fbdf07ad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:25.859976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9243081-50e3-484b-b79c-4fbdf07ad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:25.876024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9243081-50e3-484b-b79c-4fbdf07ad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:25.877691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9243081-50e3-484b-b79c-4fbdf07ad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:26.079340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:26.257736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a9243081-50e3-484b-b79c-4fbdf07ad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:26.282513 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a9243081-50e3-484b-b79c-4fbdf07ad70c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.479965 Oct 11 20:01:26.306879 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2043/4148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:25 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:26.333566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-789778ec-3b6a-4ae4-9a7b-36329e43109e req-7067f2a0-d68b-426d-a700-4132b9d32af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7fe3a5-dbd2-435f-a3ff-165d30307447", "tag": "9fac69ed-1c45-4078-b138-1757aa38e766"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:26.356824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-789778ec-3b6a-4ae4-9a7b-36329e43109e req-7067f2a0-d68b-426d-a700-4132b9d32af6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:26.360126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-789778ec-3b6a-4ae4-9a7b-36329e43109e req-7067f2a0-d68b-426d-a700-4132b9d32af6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:26.361585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-789778ec-3b6a-4ae4-9a7b-36329e43109e req-7067f2a0-d68b-426d-a700-4132b9d32af6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:26.421467 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-789778ec-3b6a-4ae4-9a7b-36329e43109e req-7067f2a0-d68b-426d-a700-4132b9d32af6 service nova] Creating event network-changed:9fac69ed-1c45-4078-b138-1757aa38e766 for instance af7fe3a5-dbd2-435f-a3ff-165d30307447 on n-h1-860864-3 Oct 11 20:01:26.434349 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-789778ec-3b6a-4ae4-9a7b-36329e43109e req-7067f2a0-d68b-426d-a700-4132b9d32af6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125565 Oct 11 20:01:26.442686 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2044/4149] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:26.448955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c4067f71-8c71-4d20-967c-92f8ffd84266 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:26.449893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4067f71-8c71-4d20-967c-92f8ffd84266 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:26.466589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4067f71-8c71-4d20-967c-92f8ffd84266 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:26.467344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4067f71-8c71-4d20-967c-92f8ffd84266 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:26.470516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4067f71-8c71-4d20-967c-92f8ffd84266 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:26.471514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4067f71-8c71-4d20-967c-92f8ffd84266 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:26.472152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4067f71-8c71-4d20-967c-92f8ffd84266 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:26.472738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4067f71-8c71-4d20-967c-92f8ffd84266 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:26.857082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c4067f71-8c71-4d20-967c-92f8ffd84266 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:26.869633 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c4067f71-8c71-4d20-967c-92f8ffd84266 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.424892 Oct 11 20:01:26.871039 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2045/4150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:26 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:26.876618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:26.877629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:26.886146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:26.886981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:26.887594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:26.888640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:26.889364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:26.890100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:27.433149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:27.447471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:27.452553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:27.461219 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a4f2a756-0cff-4fa8-acc4-00fbde9ce719 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 0.588528 Oct 11 20:01:27.464239 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2046/4151] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:26 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:27.480284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-755485411", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "35295b7c-4089-4c98-81b0-9cc1d9c13721"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:27.937035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=28 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:33.681751 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ec616cb4-330d-4579-a876-dd1df778c56d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442" status: 200 len: 1439 microversion: 2.1 time: 15.717640 Oct 11 20:01:33.684405 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2106/4152] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:01:17 2022] GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 => generated 1439 bytes in 15721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:33.691409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] validate_networks() for [('35295b7c-4089-4c98-81b0-9cc1d9c13721', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:01:33.716880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-25f506ba-3724-495e-a61e-3a6331d49d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:33.717526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-25f506ba-3724-495e-a61e-3a6331d49d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:33.725398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25f506ba-3724-495e-a61e-3a6331d49d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:33.725941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25f506ba-3724-495e-a61e-3a6331d49d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:33.726384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25f506ba-3724-495e-a61e-3a6331d49d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:33.727108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25f506ba-3724-495e-a61e-3a6331d49d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:33.727608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25f506ba-3724-495e-a61e-3a6331d49d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:33.728035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25f506ba-3724-495e-a61e-3a6331d49d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:34.060284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-25f506ba-3724-495e-a61e-3a6331d49d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:34.085663 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-25f506ba-3724-495e-a61e-3a6331d49d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1308 microversion: 2.1 time: 0.399820 Oct 11 20:01:34.091942 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2107/4153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:33 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:34.102011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-737cb114-aee4-46c4-b241-7a74ec24b149 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:34.106294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-737cb114-aee4-46c4-b241-7a74ec24b149 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:34.130104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-737cb114-aee4-46c4-b241-7a74ec24b149 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:34.130835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-737cb114-aee4-46c4-b241-7a74ec24b149 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:34.141746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-737cb114-aee4-46c4-b241-7a74ec24b149 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:34.142657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-737cb114-aee4-46c4-b241-7a74ec24b149 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:34.143049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-737cb114-aee4-46c4-b241-7a74ec24b149 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:34.143495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-737cb114-aee4-46c4-b241-7a74ec24b149 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:35.318746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-737cb114-aee4-46c4-b241-7a74ec24b149 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:35.332674 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-737cb114-aee4-46c4-b241-7a74ec24b149 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 1.239324 Oct 11 20:01:35.333277 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2108/4154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:34 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:35.351235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:35.355914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:35.372843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:35.373579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:35.377778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:35.381097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:35.381796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:35.382613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:35.642288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:01:35.642825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:01:35.643225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:01:35.643699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:01:35.644119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:01:35.686934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:35.687705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:35.688312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:35.689978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:35.690644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:35.691224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:35.723861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for project efd1bdcd18f14e87925a5b41393b9add. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:01:35.733737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Getting quotas for user 0647dca89de240ba9fbc1c59ed2b6392 and project efd1bdcd18f14e87925a5b41393b9add. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:01:35.754383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:01:35.757728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:01:35.861745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:35.867153 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-89684b63-da1c-46af-97e8-6b4c84e7d51e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.391100 Oct 11 20:01:35.867744 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2047/4155] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 8393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:01:35.878002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:35.880028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:35.882809 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-691821c8-cb8c-4d7a-a55b-227ec66a5ca3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 0.542803 Oct 11 20:01:35.888101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-578a4d57-7ff0-4f7d-90b6-cf3e577a8546 req-9b633339-c1a9-4a5b-8021-ccf1ae15ad13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7fe3a5-dbd2-435f-a3ff-165d30307447", "name": "network-vif-plugged", "status": "completed", "tag": "9fac69ed-1c45-4078-b138-1757aa38e766"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:35.919376 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2109/4156] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:35 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:35.925405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-578a4d57-7ff0-4f7d-90b6-cf3e577a8546 req-9b633339-c1a9-4a5b-8021-ccf1ae15ad13 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:35.925889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-578a4d57-7ff0-4f7d-90b6-cf3e577a8546 req-9b633339-c1a9-4a5b-8021-ccf1ae15ad13 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:35.926327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-578a4d57-7ff0-4f7d-90b6-cf3e577a8546 req-9b633339-c1a9-4a5b-8021-ccf1ae15ad13 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:35.932302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-55acf200-9249-49c2-b396-2de002582d98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72bae50>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:35.973011 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-578a4d57-7ff0-4f7d-90b6-cf3e577a8546 req-9b633339-c1a9-4a5b-8021-ccf1ae15ad13 service nova] Creating event network-vif-plugged:9fac69ed-1c45-4078-b138-1757aa38e766 for instance af7fe3a5-dbd2-435f-a3ff-165d30307447 on n-h1-860864-3 Oct 11 20:01:35.988975 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-578a4d57-7ff0-4f7d-90b6-cf3e577a8546 req-9b633339-c1a9-4a5b-8021-ccf1ae15ad13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119968 Oct 11 20:01:36.010090 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2048/4157] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:36.012300 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-55acf200-9249-49c2-b396-2de002582d98 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442" status: 200 len: 1439 microversion: 2.1 time: 0.089414 Oct 11 20:01:36.015373 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2110/4158] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:01:35 2022] GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:36.023252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8146f7e0-37a1-4668-a028-6baeee1b6be8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:36.025189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8146f7e0-37a1-4668-a028-6baeee1b6be8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:36.031574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-544a31b2-66c0-4973-9031-796303448d77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:36.032288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-544a31b2-66c0-4973-9031-796303448d77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:36.068026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-544a31b2-66c0-4973-9031-796303448d77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:36.068858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-544a31b2-66c0-4973-9031-796303448d77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:36.069473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-544a31b2-66c0-4973-9031-796303448d77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:36.070397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-544a31b2-66c0-4973-9031-796303448d77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:36.074684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-544a31b2-66c0-4973-9031-796303448d77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:36.082506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-544a31b2-66c0-4973-9031-796303448d77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:36.372530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8146f7e0-37a1-4668-a028-6baeee1b6be8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:36.387979 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8146f7e0-37a1-4668-a028-6baeee1b6be8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1214 microversion: 2.1 time: 0.370883 Oct 11 20:01:36.396341 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2111/4159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:36 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1214 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:36.415087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13aa384c-493b-49cf-bad0-da114dcc8486 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:36.423504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-13aa384c-493b-49cf-bad0-da114dcc8486 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:36.449023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13aa384c-493b-49cf-bad0-da114dcc8486 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:36.449772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13aa384c-493b-49cf-bad0-da114dcc8486 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:36.454611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13aa384c-493b-49cf-bad0-da114dcc8486 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:36.455541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13aa384c-493b-49cf-bad0-da114dcc8486 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:36.460919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13aa384c-493b-49cf-bad0-da114dcc8486 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:36.461963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13aa384c-493b-49cf-bad0-da114dcc8486 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:36.908073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-544a31b2-66c0-4973-9031-796303448d77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:36.917102 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-544a31b2-66c0-4973-9031-796303448d77 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1308 microversion: 2.1 time: 0.905406 Oct 11 20:01:36.926141 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2049/4160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:36 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1308 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:36.942767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:36.943386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:36.958277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:36.959010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:36.959602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:36.960460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:36.961071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:36.963101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:36.969552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13aa384c-493b-49cf-bad0-da114dcc8486 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:36.983427 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13aa384c-493b-49cf-bad0-da114dcc8486 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1505 microversion: 2.1 time: 0.585720 Oct 11 20:01:37.000161 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2112/4161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:36 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:37.029825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a58cecc-e252-4471-b812-6380ee0779be tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72ba790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:37.110115 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a58cecc-e252-4471-b812-6380ee0779be tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442" status: 200 len: 1439 microversion: 2.1 time: 0.084481 Oct 11 20:01:37.111092 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2113/4162] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:01:37 2022] GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 => generated 1439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:37.422561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e9708118-5333-4ad6-a65e-6d14f9827c1a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:37.435541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e9708118-5333-4ad6-a65e-6d14f9827c1a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:37.452307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9708118-5333-4ad6-a65e-6d14f9827c1a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:37.452818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9708118-5333-4ad6-a65e-6d14f9827c1a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:37.453257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9708118-5333-4ad6-a65e-6d14f9827c1a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:37.453967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9708118-5333-4ad6-a65e-6d14f9827c1a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:37.454422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9708118-5333-4ad6-a65e-6d14f9827c1a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:37.454871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e9708118-5333-4ad6-a65e-6d14f9827c1a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:37.602902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e9708118-5333-4ad6-a65e-6d14f9827c1a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:37.618942 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e9708118-5333-4ad6-a65e-6d14f9827c1a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1266 microversion: 2.1 time: 0.198861 Oct 11 20:01:37.621910 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2114/4163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:37 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:37.871864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:37.908495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:37.921406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:37.924895 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aa070e2d-2ea5-4f7d-92af-6ba045b38667 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 0.997600 Oct 11 20:01:37.945310 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2050/4164] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:36 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:37.952130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d660773a-2567-48b3-b0eb-b8b57f417014 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:37.952515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d660773a-2567-48b3-b0eb-b8b57f417014 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:37.966836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d660773a-2567-48b3-b0eb-b8b57f417014 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:37.968911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d660773a-2567-48b3-b0eb-b8b57f417014 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:37.969634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d660773a-2567-48b3-b0eb-b8b57f417014 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:37.971811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d660773a-2567-48b3-b0eb-b8b57f417014 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:37.975627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d660773a-2567-48b3-b0eb-b8b57f417014 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:37.977020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d660773a-2567-48b3-b0eb-b8b57f417014 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:38.012354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b2916c7d-fc68-4caa-aa3b-c276a1b0ee93 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:38.013844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b2916c7d-fc68-4caa-aa3b-c276a1b0ee93 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:38.035286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2916c7d-fc68-4caa-aa3b-c276a1b0ee93 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:38.035790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2916c7d-fc68-4caa-aa3b-c276a1b0ee93 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:38.036238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2916c7d-fc68-4caa-aa3b-c276a1b0ee93 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:38.041724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2916c7d-fc68-4caa-aa3b-c276a1b0ee93 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:38.044739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2916c7d-fc68-4caa-aa3b-c276a1b0ee93 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:38.084187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2916c7d-fc68-4caa-aa3b-c276a1b0ee93 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:39.414399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b2916c7d-fc68-4caa-aa3b-c276a1b0ee93 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:39.428127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d660773a-2567-48b3-b0eb-b8b57f417014 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:39.430464 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b2916c7d-fc68-4caa-aa3b-c276a1b0ee93 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1485 microversion: 2.1 time: 1.419920 Oct 11 20:01:39.433829 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2051/4165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:38 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1485 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:39.442454 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d660773a-2567-48b3-b0eb-b8b57f417014 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1308 microversion: 2.1 time: 1.491901 Oct 11 20:01:39.443122 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2115/4166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:37 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1308 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:39.465111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5fcf6cb1-ebe4-4f0c-8fd9-6454adf3420c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:39.469652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5fcf6cb1-ebe4-4f0c-8fd9-6454adf3420c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:39.487770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fcf6cb1-ebe4-4f0c-8fd9-6454adf3420c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:39.489033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f82faf7-3d24-414d-872a-b1913d4360db tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc19b9d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:39.491241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fcf6cb1-ebe4-4f0c-8fd9-6454adf3420c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:39.491695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fcf6cb1-ebe4-4f0c-8fd9-6454adf3420c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:39.496890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fcf6cb1-ebe4-4f0c-8fd9-6454adf3420c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:39.502087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fcf6cb1-ebe4-4f0c-8fd9-6454adf3420c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:39.505322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fcf6cb1-ebe4-4f0c-8fd9-6454adf3420c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:39.607761 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6f82faf7-3d24-414d-872a-b1913d4360db tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442" status: 200 len: 1439 microversion: 2.1 time: 0.172420 Oct 11 20:01:39.610073 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2052/4167] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:01:39 2022] GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 => generated 1439 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:39.638637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:39.642310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:39.671039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:39.677458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:39.679503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:39.688318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:39.690041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:39.692014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:39.783498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5fcf6cb1-ebe4-4f0c-8fd9-6454adf3420c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:39.804923 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5fcf6cb1-ebe4-4f0c-8fd9-6454adf3420c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1272 microversion: 2.1 time: 0.360337 Oct 11 20:01:39.808445 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2116/4168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:39 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1272 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:39.847147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1772138362", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:40.001822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] validate_networks() for [('a9efb5bf-6432-41d5-b4f1-9dacc91bbe55', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:01:40.903269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:40.930428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:40.936887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:40.938154 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-513b6e3f-1f18-41c6-9439-7344e699adb1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 1.326910 Oct 11 20:01:40.946136 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2053/4169] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:39 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:40.957982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c246bc76-595c-4237-8acf-7ab0c552ed2c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:40.958633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c246bc76-595c-4237-8acf-7ab0c552ed2c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:40.969360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c246bc76-595c-4237-8acf-7ab0c552ed2c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:40.969864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c246bc76-595c-4237-8acf-7ab0c552ed2c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:40.970309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c246bc76-595c-4237-8acf-7ab0c552ed2c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:40.976703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c246bc76-595c-4237-8acf-7ab0c552ed2c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:40.977204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c246bc76-595c-4237-8acf-7ab0c552ed2c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:40.977654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c246bc76-595c-4237-8acf-7ab0c552ed2c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:41.953235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c246bc76-595c-4237-8acf-7ab0c552ed2c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:41.963215 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c246bc76-595c-4237-8acf-7ab0c552ed2c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1489 microversion: 2.1 time: 1.015892 Oct 11 20:01:41.963978 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2054/4170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:40 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1489 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:41.982295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d1d86e9-232e-4398-af73-a725c872d7b8 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c74351f0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:42.074246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:01:42.075241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:01:42.075875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:01:42.076434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:01:42.077086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:01:42.127732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:42.131942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:42.134308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:42.136415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:42.140321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:42.142884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:42.147347 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6d1d86e9-232e-4398-af73-a725c872d7b8 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442" status: 200 len: 1439 microversion: 2.1 time: 0.177860 Oct 11 20:01:42.148926 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2055/4171] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:01:41 2022] GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 => generated 1439 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:42.154247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51cc3e10-b9ad-4493-b841-a4b6b37ffb23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:42.154836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51cc3e10-b9ad-4493-b841-a4b6b37ffb23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:42.191416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51cc3e10-b9ad-4493-b841-a4b6b37ffb23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:42.192213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51cc3e10-b9ad-4493-b841-a4b6b37ffb23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:42.195557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51cc3e10-b9ad-4493-b841-a4b6b37ffb23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:42.198607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51cc3e10-b9ad-4493-b841-a4b6b37ffb23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:42.205220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51cc3e10-b9ad-4493-b841-a4b6b37ffb23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:42.205948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51cc3e10-b9ad-4493-b841-a4b6b37ffb23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:42.227983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Getting quotas for project f8f60b56d4134dc386dc502b26f193ae. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:01:42.245202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Getting quotas for user 639fa589545d478da41b8632e5eb2faa and project f8f60b56d4134dc386dc502b26f193ae. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:01:42.277316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:01:42.280249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:01:42.404491 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9719edb-3cb1-47fc-88df-1f9b45ffa607 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.594734 Oct 11 20:01:42.407386 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2117/4172] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:01:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 2598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:01:42.420153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1ae1ea20-710b-4761-9bbb-6f0f26556914 req-311c1b90-38d8-4e37-8946-5d67a123226d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063e1df4-1fb8-4bbc-b6f4-59053268bb29", "tag": "971318c7-cccd-4204-b777-6b0137441143"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:42.457762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1ae1ea20-710b-4761-9bbb-6f0f26556914 req-311c1b90-38d8-4e37-8946-5d67a123226d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:42.458317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1ae1ea20-710b-4761-9bbb-6f0f26556914 req-311c1b90-38d8-4e37-8946-5d67a123226d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:42.460561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1ae1ea20-710b-4761-9bbb-6f0f26556914 req-311c1b90-38d8-4e37-8946-5d67a123226d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:42.482043 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1ae1ea20-710b-4761-9bbb-6f0f26556914 req-311c1b90-38d8-4e37-8946-5d67a123226d service nova] Creating event network-changed:971318c7-cccd-4204-b777-6b0137441143 for instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29 on n-h2-860864-3 Oct 11 20:01:42.488045 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1ae1ea20-710b-4761-9bbb-6f0f26556914 req-311c1b90-38d8-4e37-8946-5d67a123226d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079073 Oct 11 20:01:42.491951 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2118/4173] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:42.516934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:42.517700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:42.539580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:42.544246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:42.545777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:42.549771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:42.550429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:42.552919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:42.656761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51cc3e10-b9ad-4493-b841-a4b6b37ffb23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:42.666998 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51cc3e10-b9ad-4493-b841-a4b6b37ffb23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1314 microversion: 2.1 time: 0.516952 Oct 11 20:01:42.672366 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2056/4174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:42 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:42.687461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-527531185", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "4bda9a14-e746-4951-9d43-234855a05a4d"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:42.793839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] validate_networks() for [('4bda9a14-e746-4951-9d43-234855a05a4d', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:01:43.348917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:43.375640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:43.377328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:43.381057 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3767e204-f8e0-4019-9ca6-e4fe33503691 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 0.885416 Oct 11 20:01:43.383295 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2119/4175] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:42 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:43.389838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6260c97a-0b35-49ab-8bcb-853d126a762b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:43.390824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6260c97a-0b35-49ab-8bcb-853d126a762b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:43.397446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6260c97a-0b35-49ab-8bcb-853d126a762b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:43.398209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6260c97a-0b35-49ab-8bcb-853d126a762b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:43.398932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6260c97a-0b35-49ab-8bcb-853d126a762b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:43.401674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6260c97a-0b35-49ab-8bcb-853d126a762b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:43.402382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6260c97a-0b35-49ab-8bcb-853d126a762b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:43.403177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6260c97a-0b35-49ab-8bcb-853d126a762b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:43.868209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6260c97a-0b35-49ab-8bcb-853d126a762b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:43.887520 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6260c97a-0b35-49ab-8bcb-853d126a762b tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1218 microversion: 2.1 time: 0.496311 Oct 11 20:01:43.891029 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2120/4176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:43 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1218 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:43.906130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ddb15b83-0964-4f49-aed6-e1ac8f625d7c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c73338b0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:44.033923 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ddb15b83-0964-4f49-aed6-e1ac8f625d7c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442" status: 200 len: 1448 microversion: 2.1 time: 0.141056 Oct 11 20:01:44.036966 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2121/4177] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:01:43 2022] GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 => generated 1448 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:44.065522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-359c3102-ca70-42a6-b09d-23e3b91a7ab9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:44.066519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-359c3102-ca70-42a6-b09d-23e3b91a7ab9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:44.091183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-359c3102-ca70-42a6-b09d-23e3b91a7ab9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:44.092312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-359c3102-ca70-42a6-b09d-23e3b91a7ab9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:44.093086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-359c3102-ca70-42a6-b09d-23e3b91a7ab9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:44.094078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-359c3102-ca70-42a6-b09d-23e3b91a7ab9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:44.095155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-359c3102-ca70-42a6-b09d-23e3b91a7ab9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:44.096431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-359c3102-ca70-42a6-b09d-23e3b91a7ab9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:44.158663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:01:44.159863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:01:44.161965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:01:44.163580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:01:44.165524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:01:44.199513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:44.202105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:44.203447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:44.206844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:44.210428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:44.211796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:44.271338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:01:44.280698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for user a84c2531dcb24cce9872808db6c1fa6d and project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:01:44.301806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:01:44.304824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:01:44.387829 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3d100fbc-a882-46ef-ace5-25495ce0da55 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714069 Oct 11 20:01:44.388808 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2057/4178] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:01:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:01:44.394733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b60cffc-ae25-46e9-b69e-bdc50acb8470 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc1e03a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:44.430229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-359c3102-ca70-42a6-b09d-23e3b91a7ab9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:44.439536 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-359c3102-ca70-42a6-b09d-23e3b91a7ab9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1314 microversion: 2.1 time: 0.400486 Oct 11 20:01:44.460083 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2122/4179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:44 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:44.472056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cc35d8a2-9a2f-411f-9a46-e64262beb622 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:44.472694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cc35d8a2-9a2f-411f-9a46-e64262beb622 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:44.480722 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b60cffc-ae25-46e9-b69e-bdc50acb8470 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442" status: 200 len: 1448 microversion: 2.1 time: 0.084467 Oct 11 20:01:44.485357 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2058/4180] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:01:44 2022] GET /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 => generated 1448 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:44.506299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:44.509668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:44.537868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:44.538650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:44.547814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:44.559616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:44.560250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:44.568094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:44.617182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cc35d8a2-9a2f-411f-9a46-e64262beb622 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:44.658222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cc35d8a2-9a2f-411f-9a46-e64262beb622 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1208 microversion: 2.1 time: 0.196902 Oct 11 20:01:44.662999 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2123/4181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:44 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1208 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:44.678497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4428ef3a-061d-4488-92ae-b5c777320796 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c74443a0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:44.904232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:44.924444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:44.925907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:44.927135 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2d8f6a19-7cad-4372-81b9-7764fffa387c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 0.438663 Oct 11 20:01:44.927691 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2059/4182] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:44 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:44.943109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2166f012-0a7f-484c-b527-7056f16d6978 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:44.945827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2166f012-0a7f-484c-b527-7056f16d6978 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:44.958917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2166f012-0a7f-484c-b527-7056f16d6978 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:44.961889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2166f012-0a7f-484c-b527-7056f16d6978 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:44.974169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2166f012-0a7f-484c-b527-7056f16d6978 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:44.975370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2166f012-0a7f-484c-b527-7056f16d6978 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:44.976298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2166f012-0a7f-484c-b527-7056f16d6978 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:44.977302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2166f012-0a7f-484c-b527-7056f16d6978 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:45.122407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2166f012-0a7f-484c-b527-7056f16d6978 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:45.140217 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2166f012-0a7f-484c-b527-7056f16d6978 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1266 microversion: 2.1 time: 0.202652 Oct 11 20:01:45.156733 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2060/4183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:44 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:45.474024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0fa4652e-529b-4cae-a164-05126e97ed2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:45.474802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0fa4652e-529b-4cae-a164-05126e97ed2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:45.486989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0fa4652e-529b-4cae-a164-05126e97ed2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:45.495424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0fa4652e-529b-4cae-a164-05126e97ed2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:45.501868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0fa4652e-529b-4cae-a164-05126e97ed2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:45.502897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0fa4652e-529b-4cae-a164-05126e97ed2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:45.503685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0fa4652e-529b-4cae-a164-05126e97ed2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:45.504385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0fa4652e-529b-4cae-a164-05126e97ed2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:45.829761 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4428ef3a-061d-4488-92ae-b5c777320796 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442" status: 204 len: 0 microversion: 2.1 time: 1.165439 Oct 11 20:01:45.830338 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2124/4184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:44 2022] DELETE /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 => generated 0 bytes in 1167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:01:45.835534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fc668ad2-f627-4f59-b28e-fa0bec778b7b req-f0e7f25d-2c56-4ede-aca0-bf51b7b66936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e65c53-e164-4255-a2b8-4338069b7e47", "name": "network-vif-plugged", "status": "completed", "tag": "f7bf35aa-741b-418c-92ae-e8af14cd5a52"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:45.867038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fc668ad2-f627-4f59-b28e-fa0bec778b7b req-f0e7f25d-2c56-4ede-aca0-bf51b7b66936 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:45.867618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fc668ad2-f627-4f59-b28e-fa0bec778b7b req-f0e7f25d-2c56-4ede-aca0-bf51b7b66936 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:45.868066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fc668ad2-f627-4f59-b28e-fa0bec778b7b req-f0e7f25d-2c56-4ede-aca0-bf51b7b66936 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:45.898025 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fc668ad2-f627-4f59-b28e-fa0bec778b7b req-f0e7f25d-2c56-4ede-aca0-bf51b7b66936 service nova] Creating event network-vif-plugged:f7bf35aa-741b-418c-92ae-e8af14cd5a52 for instance 34e65c53-e164-4255-a2b8-4338069b7e47 on n-h2-860864-3 Oct 11 20:01:45.911035 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fc668ad2-f627-4f59-b28e-fa0bec778b7b req-f0e7f25d-2c56-4ede-aca0-bf51b7b66936 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075961 Oct 11 20:01:45.914928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0fa4652e-529b-4cae-a164-05126e97ed2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:45.915393 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2125/4185] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:45.927752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-74c061dd-8718-4a1b-9906-d01cfcdd247c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:45.931002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-74c061dd-8718-4a1b-9906-d01cfcdd247c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:45.934933 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0fa4652e-529b-4cae-a164-05126e97ed2d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1314 microversion: 2.1 time: 0.464414 Oct 11 20:01:45.937466 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2061/4186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:45 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:45.949461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74c061dd-8718-4a1b-9906-d01cfcdd247c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:45.950660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74c061dd-8718-4a1b-9906-d01cfcdd247c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:45.951261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74c061dd-8718-4a1b-9906-d01cfcdd247c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:45.952201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74c061dd-8718-4a1b-9906-d01cfcdd247c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:45.954038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74c061dd-8718-4a1b-9906-d01cfcdd247c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:45.954716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-74c061dd-8718-4a1b-9906-d01cfcdd247c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:45.956112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e57386bf-ad67-4caf-a3a9-1c20630886c3 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:45.956862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e57386bf-ad67-4caf-a3a9-1c20630886c3 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:45.968334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e57386bf-ad67-4caf-a3a9-1c20630886c3 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:45.970475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e57386bf-ad67-4caf-a3a9-1c20630886c3 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:45.971240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e57386bf-ad67-4caf-a3a9-1c20630886c3 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:45.972291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e57386bf-ad67-4caf-a3a9-1c20630886c3 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:45.973551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e57386bf-ad67-4caf-a3a9-1c20630886c3 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:45.974494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e57386bf-ad67-4caf-a3a9-1c20630886c3 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:46.028887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e57386bf-ad67-4caf-a3a9-1c20630886c3 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:01:46.034637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:46.146299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-74c061dd-8718-4a1b-9906-d01cfcdd247c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:46.167275 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-74c061dd-8718-4a1b-9906-d01cfcdd247c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1260 microversion: 2.1 time: 0.245153 Oct 11 20:01:46.167975 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2126/4187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:45 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:46.176196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:46.176800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:46.213260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:46.213888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:46.214443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:46.223265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:46.225893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:46.226430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:46.247090 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e57386bf-ad67-4caf-a3a9-1c20630886c3 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 204 len: 0 microversion: 2.1 time: 0.305200 Oct 11 20:01:46.247745 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2062/4188] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:01:45 2022] DELETE /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:01:46.257987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e4ddb4cd-6e6f-4449-b782-1be1f9d7af66 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:46.258791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e4ddb4cd-6e6f-4449-b782-1be1f9d7af66 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:46.281573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4ddb4cd-6e6f-4449-b782-1be1f9d7af66 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:46.282499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4ddb4cd-6e6f-4449-b782-1be1f9d7af66 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:46.283138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4ddb4cd-6e6f-4449-b782-1be1f9d7af66 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:46.284003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4ddb4cd-6e6f-4449-b782-1be1f9d7af66 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:46.287154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4ddb4cd-6e6f-4449-b782-1be1f9d7af66 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:46.287764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4ddb4cd-6e6f-4449-b782-1be1f9d7af66 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:46.461468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4ddb4cd-6e6f-4449-b782-1be1f9d7af66 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:46.474368 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e4ddb4cd-6e6f-4449-b782-1be1f9d7af66 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1272 microversion: 2.1 time: 0.224664 Oct 11 20:01:46.479173 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2063/4189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:46 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:46.488483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-554940777", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "95e3b674-0b5e-40c7-945c-485aa05d6c41"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:46.603109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] validate_networks() for [('95e3b674-0b5e-40c7-945c-485aa05d6c41', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:01:46.836192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:46.852220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:46.854689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:46.856146 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4092a75c-b069-4f16-82d4-5ed6e5791e24 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 0.685559 Oct 11 20:01:46.856717 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2127/4190] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:46 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:46.961235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd6b0532-7d7c-4fd1-a1ce-23918bd1a9b1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:46.961862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bd6b0532-7d7c-4fd1-a1ce-23918bd1a9b1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:46.982289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd6b0532-7d7c-4fd1-a1ce-23918bd1a9b1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:46.983335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd6b0532-7d7c-4fd1-a1ce-23918bd1a9b1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:46.983335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd6b0532-7d7c-4fd1-a1ce-23918bd1a9b1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:46.983971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd6b0532-7d7c-4fd1-a1ce-23918bd1a9b1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:46.984457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd6b0532-7d7c-4fd1-a1ce-23918bd1a9b1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:46.984873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd6b0532-7d7c-4fd1-a1ce-23918bd1a9b1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:47.644684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd6b0532-7d7c-4fd1-a1ce-23918bd1a9b1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:47.654546 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bd6b0532-7d7c-4fd1-a1ce-23918bd1a9b1 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1314 microversion: 2.1 time: 0.697067 Oct 11 20:01:47.678929 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2128/4191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:46 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:47.693715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fb12fb43-2505-4b59-a07b-b01f8bd4fc27 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:47.694539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fb12fb43-2505-4b59-a07b-b01f8bd4fc27 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:47.708182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb12fb43-2505-4b59-a07b-b01f8bd4fc27 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:47.721272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb12fb43-2505-4b59-a07b-b01f8bd4fc27 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:47.721736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb12fb43-2505-4b59-a07b-b01f8bd4fc27 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:47.722482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb12fb43-2505-4b59-a07b-b01f8bd4fc27 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:47.722975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb12fb43-2505-4b59-a07b-b01f8bd4fc27 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:47.723405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb12fb43-2505-4b59-a07b-b01f8bd4fc27 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:48.013161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fb12fb43-2505-4b59-a07b-b01f8bd4fc27 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:48.027663 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fb12fb43-2505-4b59-a07b-b01f8bd4fc27 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1260 microversion: 2.1 time: 0.347268 Oct 11 20:01:48.031431 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2129/4192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:47 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1260 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:48.041250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-65c4c317-4d3e-434e-b48a-7580ecb16473 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:48.043965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-65c4c317-4d3e-434e-b48a-7580ecb16473 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:48.067288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c4c317-4d3e-434e-b48a-7580ecb16473 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:48.073816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c4c317-4d3e-434e-b48a-7580ecb16473 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:48.076784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c4c317-4d3e-434e-b48a-7580ecb16473 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:48.082628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c4c317-4d3e-434e-b48a-7580ecb16473 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:48.083994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c4c317-4d3e-434e-b48a-7580ecb16473 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:48.084354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65c4c317-4d3e-434e-b48a-7580ecb16473 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:48.489434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:01:48.489958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:01:48.490256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:01:48.490743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:01:48.491168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:01:48.512545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:48.513835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:48.515300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:48.517203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:48.517862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:48.518460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:48.566057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Getting quotas for project 9d1efaec3c7640d684256bc6460e7559. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:01:48.576657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Getting quotas for user bfddbe97757446b58c605f5f6f64500c and project 9d1efaec3c7640d684256bc6460e7559. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:01:48.599931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:01:48.609149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:01:48.787416 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eb353a79-d08a-45cb-9d8e-c4455be8cd3c tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.303049 Oct 11 20:01:48.803225 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2064/4193] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:01:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:01:48.821994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:48.823899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:48.836660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:48.837979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:48.838852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:48.849346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:48.850136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:48.851246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:49.302310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-65c4c317-4d3e-434e-b48a-7580ecb16473 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:49.312168 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-65c4c317-4d3e-434e-b48a-7580ecb16473 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1314 microversion: 2.1 time: 1.279237 Oct 11 20:01:49.324961 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2130/4194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:48 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1314 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:49.347760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-68c05a30-7389-46df-986f-59eddf204c80 req-9b365b89-c15c-4108-b0d0-9b76105a9cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9b0470-13c5-4393-a735-d4b067e5f980", "name": "network-vif-unplugged", "status": "completed", "tag": "c99ee24d-ef2c-408e-b3a8-5cbb58c948d8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:49.389097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-68c05a30-7389-46df-986f-59eddf204c80 req-9b365b89-c15c-4108-b0d0-9b76105a9cef service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:49.392082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-68c05a30-7389-46df-986f-59eddf204c80 req-9b365b89-c15c-4108-b0d0-9b76105a9cef service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:49.394022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-68c05a30-7389-46df-986f-59eddf204c80 req-9b365b89-c15c-4108-b0d0-9b76105a9cef service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:49.428593 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-68c05a30-7389-46df-986f-59eddf204c80 req-9b365b89-c15c-4108-b0d0-9b76105a9cef service nova] Creating event network-vif-unplugged:c99ee24d-ef2c-408e-b3a8-5cbb58c948d8 for instance 2b9b0470-13c5-4393-a735-d4b067e5f980 on n-h1-860864-3 Oct 11 20:01:49.441766 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-68c05a30-7389-46df-986f-59eddf204c80 req-9b365b89-c15c-4108-b0d0-9b76105a9cef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114817 Oct 11 20:01:49.442814 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2131/4195] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:49.457214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bfd80288-1a2d-4753-8bb1-d2e794575b53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:49.459892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bfd80288-1a2d-4753-8bb1-d2e794575b53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:49.476274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfd80288-1a2d-4753-8bb1-d2e794575b53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:49.477026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfd80288-1a2d-4753-8bb1-d2e794575b53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:49.477848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfd80288-1a2d-4753-8bb1-d2e794575b53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:49.479393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfd80288-1a2d-4753-8bb1-d2e794575b53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:49.480207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfd80288-1a2d-4753-8bb1-d2e794575b53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:49.480849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfd80288-1a2d-4753-8bb1-d2e794575b53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:49.491488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:50.476020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:50.493079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:50.494888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:50.496138 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f52633b5-3181-43df-916a-a618c5f53188 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1808 microversion: 2.20 time: 1.691450 Oct 11 20:01:50.496711 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2065/4196] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:48 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1808 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:50.509890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f08889a-e0cb-496c-a473-627f34807102 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:50.510710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6f08889a-e0cb-496c-a473-627f34807102 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:50.535020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f08889a-e0cb-496c-a473-627f34807102 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:50.535518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f08889a-e0cb-496c-a473-627f34807102 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:50.536003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f08889a-e0cb-496c-a473-627f34807102 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:50.536737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f08889a-e0cb-496c-a473-627f34807102 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:50.537235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f08889a-e0cb-496c-a473-627f34807102 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:50.537693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f08889a-e0cb-496c-a473-627f34807102 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:50.635797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bfd80288-1a2d-4753-8bb1-d2e794575b53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:50.652310 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bfd80288-1a2d-4753-8bb1-d2e794575b53 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1314 microversion: 2.1 time: 1.205643 Oct 11 20:01:50.658458 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2132/4197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:49 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1314 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:50.673179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4407565c-ca66-4f07-869a-b0be74e5c734 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:50.674941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4407565c-ca66-4f07-869a-b0be74e5c734 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:50.697123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4407565c-ca66-4f07-869a-b0be74e5c734 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:50.699360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4407565c-ca66-4f07-869a-b0be74e5c734 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:50.704829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4407565c-ca66-4f07-869a-b0be74e5c734 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:50.706297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4407565c-ca66-4f07-869a-b0be74e5c734 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:50.708990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4407565c-ca66-4f07-869a-b0be74e5c734 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:50.710771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4407565c-ca66-4f07-869a-b0be74e5c734 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:51.000501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4407565c-ca66-4f07-869a-b0be74e5c734 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:51.020237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6f08889a-e0cb-496c-a473-627f34807102 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:51.035585 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6f08889a-e0cb-496c-a473-627f34807102 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1259 microversion: 2.1 time: 0.529630 Oct 11 20:01:51.042364 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4407565c-ca66-4f07-869a-b0be74e5c734 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1266 microversion: 2.1 time: 0.372607 Oct 11 20:01:51.043221 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2133/4198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:50 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1266 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:51.044903 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2066/4199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:50 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1259 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:51.050749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8a26b68e-0c44-4341-87ed-1c14b6a66ccf tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:51.052578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8a26b68e-0c44-4341-87ed-1c14b6a66ccf tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:51.067553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a26b68e-0c44-4341-87ed-1c14b6a66ccf tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:51.068254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a26b68e-0c44-4341-87ed-1c14b6a66ccf tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:51.069705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a26b68e-0c44-4341-87ed-1c14b6a66ccf tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:51.071432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a26b68e-0c44-4341-87ed-1c14b6a66ccf tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:51.073827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a26b68e-0c44-4341-87ed-1c14b6a66ccf tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:51.074788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a26b68e-0c44-4341-87ed-1c14b6a66ccf tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:51.621353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3cfb9b9a-1244-42dd-8cf1-cf47685a70e5 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'create', calling method: .version_select at 0x7f83cc19bb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-541413794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoM/OlPoQixSfQPtyQFLE2t6JD7Cxd/zBt1rch3QAKQRZTS/YPGS2h2JT9mRgzCKsBAJzZ4DXrL1d9lL3LH6qmFOM/xYiLvMCnte0QRATKN+nts42PZXnsRLRVVJJ+pWQ=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:51.634162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:51.677770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-3cfb9b9a-1244-42dd-8cf1-cf47685a70e5 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for project abba65df7ef6403db3d5b466eb12fb94. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:01:51.695403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-3cfb9b9a-1244-42dd-8cf1-cf47685a70e5 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for user c3eaa8c79a0645fd93e6e3398426237f and project abba65df7ef6403db3d5b466eb12fb94. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:01:51.767805 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3cfb9b9a-1244-42dd-8cf1-cf47685a70e5 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.504795 Oct 11 20:01:51.768560 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2067/4200] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:01:51 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:51.784398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5b8e3db9-1fd3-4caf-a5ce-bdac824bd4d3 req-f5397846-ab2d-432f-9862-fbbceb2c7b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e1df4-1fb8-4bbc-b6f4-59053268bb29", "name": "network-vif-plugged", "status": "completed", "tag": "971318c7-cccd-4204-b777-6b0137441143"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:51.810015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5b8e3db9-1fd3-4caf-a5ce-bdac824bd4d3 req-f5397846-ab2d-432f-9862-fbbceb2c7b54 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:51.810441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5b8e3db9-1fd3-4caf-a5ce-bdac824bd4d3 req-f5397846-ab2d-432f-9862-fbbceb2c7b54 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:51.813548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5b8e3db9-1fd3-4caf-a5ce-bdac824bd4d3 req-f5397846-ab2d-432f-9862-fbbceb2c7b54 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:51.829691 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5b8e3db9-1fd3-4caf-a5ce-bdac824bd4d3 req-f5397846-ab2d-432f-9862-fbbceb2c7b54 service nova] Creating event network-vif-plugged:971318c7-cccd-4204-b777-6b0137441143 for instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29 on n-h2-860864-3 Oct 11 20:01:51.836267 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5b8e3db9-1fd3-4caf-a5ce-bdac824bd4d3 req-f5397846-ab2d-432f-9862-fbbceb2c7b54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066166 Oct 11 20:01:51.837243 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2068/4201] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:51.871059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:51.876244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:51.908483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:51.908997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:51.909772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:51.910900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:51.911363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:51.911935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:52.186967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:52.340092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8a26b68e-0c44-4341-87ed-1c14b6a66ccf tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:52.349128 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8a26b68e-0c44-4341-87ed-1c14b6a66ccf tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1314 microversion: 2.1 time: 1.304681 Oct 11 20:01:52.349733 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2134/4202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:51 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1314 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:52.367333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e64681c5-5250-4d8f-95af-1106a374be9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:52.368268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e64681c5-5250-4d8f-95af-1106a374be9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:52.384145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e64681c5-5250-4d8f-95af-1106a374be9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:52.387163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e64681c5-5250-4d8f-95af-1106a374be9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:52.388071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e64681c5-5250-4d8f-95af-1106a374be9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:52.390842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e64681c5-5250-4d8f-95af-1106a374be9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:52.392482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e64681c5-5250-4d8f-95af-1106a374be9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:52.394041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e64681c5-5250-4d8f-95af-1106a374be9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:52.827302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:52.855843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:52.858646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:52.860148 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-65185e4e-8c0e-4ebe-a75b-f82c362df3f2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1795 microversion: 2.20 time: 1.021281 Oct 11 20:01:52.883712 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2069/4203] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:01:51 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1795 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:01:52.890579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d889b67e-63b6-4aef-9c74-7de5e810688b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:52.892427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d889b67e-63b6-4aef-9c74-7de5e810688b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:52.900852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d889b67e-63b6-4aef-9c74-7de5e810688b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:52.901676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d889b67e-63b6-4aef-9c74-7de5e810688b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:52.902284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d889b67e-63b6-4aef-9c74-7de5e810688b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:52.903265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d889b67e-63b6-4aef-9c74-7de5e810688b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:52.904040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d889b67e-63b6-4aef-9c74-7de5e810688b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:52.904835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d889b67e-63b6-4aef-9c74-7de5e810688b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:53.479594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e64681c5-5250-4d8f-95af-1106a374be9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:53.492791 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e64681c5-5250-4d8f-95af-1106a374be9f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1314 microversion: 2.1 time: 1.140087 Oct 11 20:01:53.495053 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2135/4204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:52 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1314 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:53.504987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cdb43661-612c-4c2e-bdc3-0cd8cc2cb5d3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:53.505939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d889b67e-63b6-4aef-9c74-7de5e810688b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:53.506698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cdb43661-612c-4c2e-bdc3-0cd8cc2cb5d3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:53.520376 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d889b67e-63b6-4aef-9c74-7de5e810688b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1307 microversion: 2.1 time: 0.634308 Oct 11 20:01:53.521296 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2070/4205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:52 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1307 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:53.527623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-756b70c4-6cc7-4d71-9ecd-0e42713d0619 req-56ce48db-aa07-41b8-aac7-2f20cdcd7309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9b0470-13c5-4393-a735-d4b067e5f980", "name": "network-vif-deleted", "tag": "c99ee24d-ef2c-408e-b3a8-5cbb58c948d8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:53.537735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdb43661-612c-4c2e-bdc3-0cd8cc2cb5d3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:53.538791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdb43661-612c-4c2e-bdc3-0cd8cc2cb5d3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:53.544006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdb43661-612c-4c2e-bdc3-0cd8cc2cb5d3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:53.548068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdb43661-612c-4c2e-bdc3-0cd8cc2cb5d3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:53.549027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdb43661-612c-4c2e-bdc3-0cd8cc2cb5d3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:53.551255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdb43661-612c-4c2e-bdc3-0cd8cc2cb5d3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:53.553252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-756b70c4-6cc7-4d71-9ecd-0e42713d0619 req-56ce48db-aa07-41b8-aac7-2f20cdcd7309 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:53.562101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-756b70c4-6cc7-4d71-9ecd-0e42713d0619 req-56ce48db-aa07-41b8-aac7-2f20cdcd7309 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:53.562907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-756b70c4-6cc7-4d71-9ecd-0e42713d0619 req-56ce48db-aa07-41b8-aac7-2f20cdcd7309 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:53.583529 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-756b70c4-6cc7-4d71-9ecd-0e42713d0619 req-56ce48db-aa07-41b8-aac7-2f20cdcd7309 service nova] Creating event network-vif-deleted:c99ee24d-ef2c-408e-b3a8-5cbb58c948d8 for instance 2b9b0470-13c5-4393-a735-d4b067e5f980 on n-h1-860864-3 Oct 11 20:01:53.594896 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-756b70c4-6cc7-4d71-9ecd-0e42713d0619 req-56ce48db-aa07-41b8-aac7-2f20cdcd7309 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072312 Oct 11 20:01:53.595521 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2071/4206] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:53.613427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3e128193-43af-4191-8e22-5775b51c26dc tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:53.614199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3e128193-43af-4191-8e22-5775b51c26dc tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:53.633410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e128193-43af-4191-8e22-5775b51c26dc tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:53.634745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e128193-43af-4191-8e22-5775b51c26dc tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:53.635659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e128193-43af-4191-8e22-5775b51c26dc tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:53.636552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e128193-43af-4191-8e22-5775b51c26dc tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:53.637212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e128193-43af-4191-8e22-5775b51c26dc tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:53.637825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e128193-43af-4191-8e22-5775b51c26dc tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:54.182375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3e128193-43af-4191-8e22-5775b51c26dc tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:54.190740 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3e128193-43af-4191-8e22-5775b51c26dc tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1314 microversion: 2.1 time: 0.588614 Oct 11 20:01:54.191187 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2072/4207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:53 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:54.208800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-cdfbce6d-96c3-4c41-84d3-5381caec5e7b req-88780bf2-8db2-4b78-9372-e5e50bb70a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a01b4b85-eeef-43da-9233-45407e1fe4fb", "tag": "4c1bed96-8e72-421a-a5fd-2b8eddbb9018"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:54.233213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cdfbce6d-96c3-4c41-84d3-5381caec5e7b req-88780bf2-8db2-4b78-9372-e5e50bb70a85 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:54.239084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cdfbce6d-96c3-4c41-84d3-5381caec5e7b req-88780bf2-8db2-4b78-9372-e5e50bb70a85 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:54.240422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cdfbce6d-96c3-4c41-84d3-5381caec5e7b req-88780bf2-8db2-4b78-9372-e5e50bb70a85 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:54.252494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cdb43661-612c-4c2e-bdc3-0cd8cc2cb5d3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:54.268856 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cdb43661-612c-4c2e-bdc3-0cd8cc2cb5d3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1308 microversion: 2.1 time: 0.771536 Oct 11 20:01:54.271164 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-cdfbce6d-96c3-4c41-84d3-5381caec5e7b req-88780bf2-8db2-4b78-9372-e5e50bb70a85 service nova] Creating event network-changed:4c1bed96-8e72-421a-a5fd-2b8eddbb9018 for instance a01b4b85-eeef-43da-9233-45407e1fe4fb on n-h2-860864-3 Oct 11 20:01:54.271747 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2136/4208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:53 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1308 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:54.288423 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-cdfbce6d-96c3-4c41-84d3-5381caec5e7b req-88780bf2-8db2-4b78-9372-e5e50bb70a85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091197 Oct 11 20:01:54.289496 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2073/4209] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:54.520074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d28bebf3-5953-4af3-931f-0eada8bc84d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:54.521251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d28bebf3-5953-4af3-931f-0eada8bc84d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:54.530195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d28bebf3-5953-4af3-931f-0eada8bc84d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:54.530954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d28bebf3-5953-4af3-931f-0eada8bc84d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:54.531546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d28bebf3-5953-4af3-931f-0eada8bc84d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:54.532428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d28bebf3-5953-4af3-931f-0eada8bc84d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:54.533041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d28bebf3-5953-4af3-931f-0eada8bc84d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:54.533869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d28bebf3-5953-4af3-931f-0eada8bc84d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:54.551624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e70672a6-2a5c-475f-aa91-b91fd0723a2f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:54.553752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e70672a6-2a5c-475f-aa91-b91fd0723a2f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:54.571399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e70672a6-2a5c-475f-aa91-b91fd0723a2f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:54.572923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e70672a6-2a5c-475f-aa91-b91fd0723a2f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:54.573496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e70672a6-2a5c-475f-aa91-b91fd0723a2f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:54.574340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e70672a6-2a5c-475f-aa91-b91fd0723a2f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:54.574969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e70672a6-2a5c-475f-aa91-b91fd0723a2f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:54.575615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e70672a6-2a5c-475f-aa91-b91fd0723a2f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:54.646213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=10 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:55.154700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e70672a6-2a5c-475f-aa91-b91fd0723a2f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:55.163096 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e70672a6-2a5c-475f-aa91-b91fd0723a2f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1307 microversion: 2.1 time: 0.615695 Oct 11 20:01:55.182902 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2074/4210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:54 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1307 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:55.183784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d28bebf3-5953-4af3-931f-0eada8bc84d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:55.183784 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d28bebf3-5953-4af3-931f-0eada8bc84d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1502 microversion: 2.1 time: 0.664679 Oct 11 20:01:55.188271 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2137/4211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:54 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1502 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:55.207214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b461e76f-7506-4e28-b2dd-19d5164c4f1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:55.207864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b461e76f-7506-4e28-b2dd-19d5164c4f1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:55.214167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c2a4932-f67f-445f-9aa2-684dd60ee9d2 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:55.214850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c2a4932-f67f-445f-9aa2-684dd60ee9d2 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:55.216680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b461e76f-7506-4e28-b2dd-19d5164c4f1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:55.219455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b461e76f-7506-4e28-b2dd-19d5164c4f1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:55.220097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b461e76f-7506-4e28-b2dd-19d5164c4f1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:55.220927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b461e76f-7506-4e28-b2dd-19d5164c4f1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:55.224577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c2a4932-f67f-445f-9aa2-684dd60ee9d2 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:55.225089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c2a4932-f67f-445f-9aa2-684dd60ee9d2 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:55.225367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b461e76f-7506-4e28-b2dd-19d5164c4f1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:55.225534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c2a4932-f67f-445f-9aa2-684dd60ee9d2 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:55.226006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b461e76f-7506-4e28-b2dd-19d5164c4f1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:55.226248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c2a4932-f67f-445f-9aa2-684dd60ee9d2 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:55.226747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c2a4932-f67f-445f-9aa2-684dd60ee9d2 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:55.233405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c2a4932-f67f-445f-9aa2-684dd60ee9d2 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:55.358654 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b461e76f-7506-4e28-b2dd-19d5164c4f1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29/action" status: 202 len: 0 microversion: 2.1 time: 0.155026 Oct 11 20:01:55.361374 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2075/4212] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:01:55 2022] POST /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:01:55.375923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8e592ba7-d20f-4592-9c4b-150671f7d288 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:55.377287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8e592ba7-d20f-4592-9c4b-150671f7d288 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:55.392411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e592ba7-d20f-4592-9c4b-150671f7d288 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:55.394386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e592ba7-d20f-4592-9c4b-150671f7d288 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:55.394944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e592ba7-d20f-4592-9c4b-150671f7d288 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:55.397227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e592ba7-d20f-4592-9c4b-150671f7d288 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:55.397483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e592ba7-d20f-4592-9c4b-150671f7d288 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:55.397920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e592ba7-d20f-4592-9c4b-150671f7d288 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:55.753358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1c2a4932-f67f-445f-9aa2-684dd60ee9d2 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:55.761874 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c2a4932-f67f-445f-9aa2-684dd60ee9d2 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1314 microversion: 2.1 time: 0.552345 Oct 11 20:01:55.762480 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2138/4213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:55 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:01:55.777291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-063b48bc-1b50-42ce-9949-784f69c0e08e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:55.777915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-063b48bc-1b50-42ce-9949-784f69c0e08e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:55.795102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063b48bc-1b50-42ce-9949-784f69c0e08e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:55.795935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063b48bc-1b50-42ce-9949-784f69c0e08e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:55.796637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063b48bc-1b50-42ce-9949-784f69c0e08e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:55.797593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063b48bc-1b50-42ce-9949-784f69c0e08e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:55.799440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063b48bc-1b50-42ce-9949-784f69c0e08e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:55.801907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-063b48bc-1b50-42ce-9949-784f69c0e08e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:56.134021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8e592ba7-d20f-4592-9c4b-150671f7d288 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:56.148708 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8e592ba7-d20f-4592-9c4b-150671f7d288 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1308 microversion: 2.1 time: 0.784773 Oct 11 20:01:56.149305 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2076/4214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:55 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1308 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:56.173925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4996a6b7-3eea-4502-8b7b-9dfcaee380f7 req-3507434c-e669-409b-841b-1e3a6c68271b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b64a493-6d84-4526-a52c-6330d7cfec84", "tag": "950b887d-3e4a-430b-b86d-71d61dee081b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:56.201788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4996a6b7-3eea-4502-8b7b-9dfcaee380f7 req-3507434c-e669-409b-841b-1e3a6c68271b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:56.207293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4996a6b7-3eea-4502-8b7b-9dfcaee380f7 req-3507434c-e669-409b-841b-1e3a6c68271b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:56.207754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4996a6b7-3eea-4502-8b7b-9dfcaee380f7 req-3507434c-e669-409b-841b-1e3a6c68271b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:56.238519 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4996a6b7-3eea-4502-8b7b-9dfcaee380f7 req-3507434c-e669-409b-841b-1e3a6c68271b service nova] Creating event network-changed:950b887d-3e4a-430b-b86d-71d61dee081b for instance 8b64a493-6d84-4526-a52c-6330d7cfec84 on n-h2-860864-3 Oct 11 20:01:56.245223 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4996a6b7-3eea-4502-8b7b-9dfcaee380f7 req-3507434c-e669-409b-841b-1e3a6c68271b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081330 Oct 11 20:01:56.251054 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2077/4215] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:01:56.256735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2116882087", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "edac9cfa-9fb8-43b5-9dea-834b9329d961"}, {"uuid": "e9eb300f-9aed-4d8d-8016-c4d90561e1f1"}, {"uuid": "edac9cfa-9fb8-43b5-9dea-834b9329d961"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:01:56.426804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] validate_networks() for [('edac9cfa-9fb8-43b5-9dea-834b9329d961', None, None, None, None, None), ('e9eb300f-9aed-4d8d-8016-c4d90561e1f1', None, None, None, None, None), ('edac9cfa-9fb8-43b5-9dea-834b9329d961', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:01:56.634886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-063b48bc-1b50-42ce-9949-784f69c0e08e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:56.643412 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-063b48bc-1b50-42ce-9949-784f69c0e08e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1507 microversion: 2.1 time: 0.870359 Oct 11 20:01:56.643966 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2139/4216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:55 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1507 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:56.659447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cc80bea0-92f1-45ea-b7cf-ab51095a0de5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:56.662443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cc80bea0-92f1-45ea-b7cf-ab51095a0de5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:56.694751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:56.698046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc80bea0-92f1-45ea-b7cf-ab51095a0de5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:56.703973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc80bea0-92f1-45ea-b7cf-ab51095a0de5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:56.706105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc80bea0-92f1-45ea-b7cf-ab51095a0de5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:56.707340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc80bea0-92f1-45ea-b7cf-ab51095a0de5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:56.708039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc80bea0-92f1-45ea-b7cf-ab51095a0de5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:56.708862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cc80bea0-92f1-45ea-b7cf-ab51095a0de5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:57.469305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cc80bea0-92f1-45ea-b7cf-ab51095a0de5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:57.484996 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cc80bea0-92f1-45ea-b7cf-ab51095a0de5 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1307 microversion: 2.1 time: 0.833358 Oct 11 20:01:57.486452 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2140/4217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:56 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1307 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:57.500996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c84128a-2d81-4b9b-8ccd-918a49ead2d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:57.502404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c84128a-2d81-4b9b-8ccd-918a49ead2d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:57.521567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c84128a-2d81-4b9b-8ccd-918a49ead2d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:57.522014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c84128a-2d81-4b9b-8ccd-918a49ead2d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:57.522803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c84128a-2d81-4b9b-8ccd-918a49ead2d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:57.523854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c84128a-2d81-4b9b-8ccd-918a49ead2d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:57.526151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c84128a-2d81-4b9b-8ccd-918a49ead2d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:57.527876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c84128a-2d81-4b9b-8ccd-918a49ead2d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:58.543424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:01:58.575300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c84128a-2d81-4b9b-8ccd-918a49ead2d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:58.583681 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c84128a-2d81-4b9b-8ccd-918a49ead2d9 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1314 microversion: 2.1 time: 1.095539 Oct 11 20:01:58.588094 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2141/4218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:57 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:58.595927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9f6f6c99-cfe1-40b2-9a5e-77176d4a2fd9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:58.603553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9f6f6c99-cfe1-40b2-9a5e-77176d4a2fd9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:58.612634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f6f6c99-cfe1-40b2-9a5e-77176d4a2fd9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:58.618279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f6f6c99-cfe1-40b2-9a5e-77176d4a2fd9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:58.619396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f6f6c99-cfe1-40b2-9a5e-77176d4a2fd9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:58.620324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f6f6c99-cfe1-40b2-9a5e-77176d4a2fd9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:58.623095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f6f6c99-cfe1-40b2-9a5e-77176d4a2fd9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:58.623691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f6f6c99-cfe1-40b2-9a5e-77176d4a2fd9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:59.851825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9f6f6c99-cfe1-40b2-9a5e-77176d4a2fd9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:01:59.874120 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9f6f6c99-cfe1-40b2-9a5e-77176d4a2fd9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1308 microversion: 2.1 time: 1.284577 Oct 11 20:01:59.877562 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2142/4219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:58 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1308 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:01:59.887903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a870c131-307d-4898-b858-ba4229cde12a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:01:59.888891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a870c131-307d-4898-b858-ba4229cde12a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:01:59.910418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a870c131-307d-4898-b858-ba4229cde12a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:59.911167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a870c131-307d-4898-b858-ba4229cde12a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:59.911917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a870c131-307d-4898-b858-ba4229cde12a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:01:59.913754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a870c131-307d-4898-b858-ba4229cde12a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:01:59.914402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a870c131-307d-4898-b858-ba4229cde12a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:01:59.915096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a870c131-307d-4898-b858-ba4229cde12a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.487007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a870c131-307d-4898-b858-ba4229cde12a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:00.495047 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a870c131-307d-4898-b858-ba4229cde12a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1487 microversion: 2.1 time: 0.616165 Oct 11 20:02:00.495892 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2143/4220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:01:59 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1487 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:00.500503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-277f58e2-5b29-4276-9ac3-9e43d4ab215d req-aa899728-138c-4162-8fd3-768312dd94d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f29c5a-1f92-4faf-90c8-24627b3f31be", "tag": "bfa7e907-b070-493a-a6c0-ec2c6f7fd7d3"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:00.510250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-277f58e2-5b29-4276-9ac3-9e43d4ab215d req-aa899728-138c-4162-8fd3-768312dd94d6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:00.510747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-277f58e2-5b29-4276-9ac3-9e43d4ab215d req-aa899728-138c-4162-8fd3-768312dd94d6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:00.511361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-277f58e2-5b29-4276-9ac3-9e43d4ab215d req-aa899728-138c-4162-8fd3-768312dd94d6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.524261 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-277f58e2-5b29-4276-9ac3-9e43d4ab215d req-aa899728-138c-4162-8fd3-768312dd94d6 service nova] Creating event network-changed:bfa7e907-b070-493a-a6c0-ec2c6f7fd7d3 for instance c6f29c5a-1f92-4faf-90c8-24627b3f31be on n-h1-860864-3 Oct 11 20:02:00.530631 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-277f58e2-5b29-4276-9ac3-9e43d4ab215d req-aa899728-138c-4162-8fd3-768312dd94d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033769 Oct 11 20:02:00.531531 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2144/4221] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:00.536741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-28b56f34-7964-4117-8cf4-841ba3e05b4b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:00.537443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-28b56f34-7964-4117-8cf4-841ba3e05b4b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:00.543795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b56f34-7964-4117-8cf4-841ba3e05b4b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:00.544288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b56f34-7964-4117-8cf4-841ba3e05b4b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:00.544756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b56f34-7964-4117-8cf4-841ba3e05b4b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.545460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b56f34-7964-4117-8cf4-841ba3e05b4b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:00.545921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b56f34-7964-4117-8cf4-841ba3e05b4b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:00.546348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b56f34-7964-4117-8cf4-841ba3e05b4b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.611160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:02:00.611670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:02:00.612048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:02:00.612458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:02:00.612970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:02:00.623944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:00.624851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:00.625428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.626159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:00.626648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:00.627069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.644759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Getting quotas for project 1df583d3545145c1ae055328f823edbc. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:02:00.650288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Getting quotas for user 28a8f90c691c43e6a131517ff9b3a0cd and project 1df583d3545145c1ae055328f823edbc. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:02:00.662883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:02:00.665814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:02:00.720885 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-281a0a62-96d5-4f20-a7ea-6ab3876bd04a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.468236 Oct 11 20:02:00.721953 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2078/4222] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:01:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:02:00.727350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-38af8788-20c4-43a5-b531-dfcbe94896c3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:00.728852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-38af8788-20c4-43a5-b531-dfcbe94896c3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:00.739025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38af8788-20c4-43a5-b531-dfcbe94896c3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:00.739702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38af8788-20c4-43a5-b531-dfcbe94896c3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:00.740141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38af8788-20c4-43a5-b531-dfcbe94896c3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.741016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38af8788-20c4-43a5-b531-dfcbe94896c3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:00.741470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38af8788-20c4-43a5-b531-dfcbe94896c3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:00.741921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38af8788-20c4-43a5-b531-dfcbe94896c3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.825318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-28b56f34-7964-4117-8cf4-841ba3e05b4b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:00.834177 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-28b56f34-7964-4117-8cf4-841ba3e05b4b tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1307 microversion: 2.1 time: 0.301355 Oct 11 20:02:00.834917 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2145/4223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:00 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:00.842391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-908efdf6-e9a2-49df-bc10-a132e0f1b449 req-d699f406-b5b2-47e2-8b54-c01a0d1d3b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01b4b85-eeef-43da-9233-45407e1fe4fb", "name": "network-vif-plugged", "status": "completed", "tag": "4c1bed96-8e72-421a-a5fd-2b8eddbb9018"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:00.872405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-908efdf6-e9a2-49df-bc10-a132e0f1b449 req-d699f406-b5b2-47e2-8b54-c01a0d1d3b31 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:00.873041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-908efdf6-e9a2-49df-bc10-a132e0f1b449 req-d699f406-b5b2-47e2-8b54-c01a0d1d3b31 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:00.876448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-908efdf6-e9a2-49df-bc10-a132e0f1b449 req-d699f406-b5b2-47e2-8b54-c01a0d1d3b31 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.898468 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-908efdf6-e9a2-49df-bc10-a132e0f1b449 req-d699f406-b5b2-47e2-8b54-c01a0d1d3b31 service nova] Creating event network-vif-plugged:4c1bed96-8e72-421a-a5fd-2b8eddbb9018 for instance a01b4b85-eeef-43da-9233-45407e1fe4fb on n-h2-860864-3 Oct 11 20:02:00.910427 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-908efdf6-e9a2-49df-bc10-a132e0f1b449 req-d699f406-b5b2-47e2-8b54-c01a0d1d3b31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073050 Oct 11 20:02:00.911089 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2146/4224] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:00.923267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-72044ed7-fae4-4f2a-9590-b60adfc8d010 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:00.924089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-72044ed7-fae4-4f2a-9590-b60adfc8d010 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:00.932236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72044ed7-fae4-4f2a-9590-b60adfc8d010 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:00.932977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72044ed7-fae4-4f2a-9590-b60adfc8d010 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:00.933410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72044ed7-fae4-4f2a-9590-b60adfc8d010 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.934355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72044ed7-fae4-4f2a-9590-b60adfc8d010 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:00.935703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72044ed7-fae4-4f2a-9590-b60adfc8d010 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:00.936298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-72044ed7-fae4-4f2a-9590-b60adfc8d010 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:00.982168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-72044ed7-fae4-4f2a-9590-b60adfc8d010 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lazy-loading 'flavor' on Instance uuid 063e1df4-1fb8-4bbc-b6f4-59053268bb29 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:02:01.091451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-38af8788-20c4-43a5-b531-dfcbe94896c3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:01.100220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-38af8788-20c4-43a5-b531-dfcbe94896c3 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1314 microversion: 2.1 time: 0.376934 Oct 11 20:02:01.103300 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2079/4225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:00 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:01.113323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f2dc912a-90ce-41ed-8fc5-5e757dd898eb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:01.119851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f2dc912a-90ce-41ed-8fc5-5e757dd898eb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:01.314026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f2dc912a-90ce-41ed-8fc5-5e757dd898eb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:01.314776 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-72044ed7-fae4-4f2a-9590-b60adfc8d010 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29/action" status: 202 len: 0 microversion: 2.1 time: 0.397451 Oct 11 20:02:01.315877 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2147/4226] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:02:00 2022] POST /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:02:01.332347 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f2dc912a-90ce-41ed-8fc5-5e757dd898eb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1213 microversion: 2.1 time: 0.224417 Oct 11 20:02:01.342184 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2080/4227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:01 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1213 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:01.357069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-899c454a-bc51-4922-b562-d3fb3253c96a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:01.359784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-899c454a-bc51-4922-b562-d3fb3253c96a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:01.362076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ec351892-120f-49dc-9754-b7d7b33c4fcc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:01.363757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ec351892-120f-49dc-9754-b7d7b33c4fcc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:01.378140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-899c454a-bc51-4922-b562-d3fb3253c96a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:01.378957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-899c454a-bc51-4922-b562-d3fb3253c96a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:01.379575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-899c454a-bc51-4922-b562-d3fb3253c96a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:01.380517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-899c454a-bc51-4922-b562-d3fb3253c96a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:01.385312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-899c454a-bc51-4922-b562-d3fb3253c96a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:01.386220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-899c454a-bc51-4922-b562-d3fb3253c96a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:01.390045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec351892-120f-49dc-9754-b7d7b33c4fcc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:01.390799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec351892-120f-49dc-9754-b7d7b33c4fcc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:01.393762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec351892-120f-49dc-9754-b7d7b33c4fcc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:01.395468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec351892-120f-49dc-9754-b7d7b33c4fcc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:01.398867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec351892-120f-49dc-9754-b7d7b33c4fcc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:01.399658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec351892-120f-49dc-9754-b7d7b33c4fcc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:01.461012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:01.858242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-899c454a-bc51-4922-b562-d3fb3253c96a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:01.867616 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-899c454a-bc51-4922-b562-d3fb3253c96a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1493 microversion: 2.1 time: 0.523551 Oct 11 20:02:01.869243 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2081/4228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:01 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1493 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:01.879165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db3d31b4-57ea-47de-9f3f-be7c4b7a7a08 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:01.880917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-db3d31b4-57ea-47de-9f3f-be7c4b7a7a08 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:01.892866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3d31b4-57ea-47de-9f3f-be7c4b7a7a08 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:01.893733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3d31b4-57ea-47de-9f3f-be7c4b7a7a08 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:01.894398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3d31b4-57ea-47de-9f3f-be7c4b7a7a08 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:01.895381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3d31b4-57ea-47de-9f3f-be7c4b7a7a08 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:01.896057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3d31b4-57ea-47de-9f3f-be7c4b7a7a08 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:01.897062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3d31b4-57ea-47de-9f3f-be7c4b7a7a08 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:01.960709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ec351892-120f-49dc-9754-b7d7b33c4fcc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:01.979348 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ec351892-120f-49dc-9754-b7d7b33c4fcc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1308 microversion: 2.1 time: 0.653264 Oct 11 20:02:01.980131 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2148/4229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:01 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1308 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:02.129157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c117ebe1-b07c-4203-b066-08f76e5b9ae1 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:02.130171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c117ebe1-b07c-4203-b066-08f76e5b9ae1 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:02.146294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c117ebe1-b07c-4203-b066-08f76e5b9ae1 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:02.153991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c117ebe1-b07c-4203-b066-08f76e5b9ae1 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:02.154570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c117ebe1-b07c-4203-b066-08f76e5b9ae1 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:02.155318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c117ebe1-b07c-4203-b066-08f76e5b9ae1 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:02.155797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c117ebe1-b07c-4203-b066-08f76e5b9ae1 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:02.156232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c117ebe1-b07c-4203-b066-08f76e5b9ae1 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:02.953709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-db3d31b4-57ea-47de-9f3f-be7c4b7a7a08 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:02.958008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:02.970345 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-db3d31b4-57ea-47de-9f3f-be7c4b7a7a08 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1307 microversion: 2.1 time: 1.099735 Oct 11 20:02:02.971782 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2082/4230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:01 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1307 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:02.977468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aed99193-4c80-4dbc-a365-cc6b45378d54 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:02.979733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aed99193-4c80-4dbc-a365-cc6b45378d54 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:02.987991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed99193-4c80-4dbc-a365-cc6b45378d54 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:02.989604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed99193-4c80-4dbc-a365-cc6b45378d54 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:02.990257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed99193-4c80-4dbc-a365-cc6b45378d54 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:02.991769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed99193-4c80-4dbc-a365-cc6b45378d54 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:02.992570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed99193-4c80-4dbc-a365-cc6b45378d54 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:02.994186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aed99193-4c80-4dbc-a365-cc6b45378d54 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:03.001791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c117ebe1-b07c-4203-b066-08f76e5b9ae1 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:03.012552 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c117ebe1-b07c-4203-b066-08f76e5b9ae1 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1314 microversion: 2.1 time: 0.887133 Oct 11 20:02:03.027569 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2149/4231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:02 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:03.035009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d76a9f0-42e2-4cad-be07-84f15d9c005a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:03.035893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0d76a9f0-42e2-4cad-be07-84f15d9c005a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:03.043599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d76a9f0-42e2-4cad-be07-84f15d9c005a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:03.044337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d76a9f0-42e2-4cad-be07-84f15d9c005a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:03.044964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d76a9f0-42e2-4cad-be07-84f15d9c005a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:03.045954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d76a9f0-42e2-4cad-be07-84f15d9c005a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:03.046584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d76a9f0-42e2-4cad-be07-84f15d9c005a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:03.047163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d76a9f0-42e2-4cad-be07-84f15d9c005a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:03.209673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aed99193-4c80-4dbc-a365-cc6b45378d54 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:03.224808 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aed99193-4c80-4dbc-a365-cc6b45378d54 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1271 microversion: 2.1 time: 0.248741 Oct 11 20:02:03.225499 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2083/4232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:02 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:03.232333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-600e07f2-aad4-4395-a167-b2ae20dbefba tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:03.233330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-600e07f2-aad4-4395-a167-b2ae20dbefba tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:03.242371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-600e07f2-aad4-4395-a167-b2ae20dbefba tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:03.243699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-600e07f2-aad4-4395-a167-b2ae20dbefba tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:03.244645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-600e07f2-aad4-4395-a167-b2ae20dbefba tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:03.245358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-600e07f2-aad4-4395-a167-b2ae20dbefba tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:03.245844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-600e07f2-aad4-4395-a167-b2ae20dbefba tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:03.246278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-600e07f2-aad4-4395-a167-b2ae20dbefba tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:03.552579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0d76a9f0-42e2-4cad-be07-84f15d9c005a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:03.582372 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0d76a9f0-42e2-4cad-be07-84f15d9c005a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1514 microversion: 2.1 time: 0.551630 Oct 11 20:02:03.584642 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2150/4233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:03 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1514 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:03.724908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-600e07f2-aad4-4395-a167-b2ae20dbefba tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:03.737879 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-600e07f2-aad4-4395-a167-b2ae20dbefba tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1308 microversion: 2.1 time: 0.510792 Oct 11 20:02:03.739454 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2084/4234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:03 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1308 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:03.974397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fd4cf6a9-21ae-4d3a-b09b-ba3b38c99538 req-a2ce8396-e15c-463c-9085-2102511d4a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b64a493-6d84-4526-a52c-6330d7cfec84", "name": "network-vif-plugged", "status": "completed", "tag": "950b887d-3e4a-430b-b86d-71d61dee081b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:03.994258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b3a76fb1-f3b4-48ed-a316-ea27529f69b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:03.994900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b3a76fb1-f3b4-48ed-a316-ea27529f69b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:04.009036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a76fb1-f3b4-48ed-a316-ea27529f69b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.009438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fd4cf6a9-21ae-4d3a-b09b-ba3b38c99538 req-a2ce8396-e15c-463c-9085-2102511d4a44 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.011376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fd4cf6a9-21ae-4d3a-b09b-ba3b38c99538 req-a2ce8396-e15c-463c-9085-2102511d4a44 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.012463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a76fb1-f3b4-48ed-a316-ea27529f69b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.013108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a76fb1-f3b4-48ed-a316-ea27529f69b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:04.015678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fd4cf6a9-21ae-4d3a-b09b-ba3b38c99538 req-a2ce8396-e15c-463c-9085-2102511d4a44 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:04.017477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a76fb1-f3b4-48ed-a316-ea27529f69b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.018155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a76fb1-f3b4-48ed-a316-ea27529f69b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.023029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3a76fb1-f3b4-48ed-a316-ea27529f69b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:04.089256 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fd4cf6a9-21ae-4d3a-b09b-ba3b38c99538 req-a2ce8396-e15c-463c-9085-2102511d4a44 service nova] Creating event network-vif-plugged:950b887d-3e4a-430b-b86d-71d61dee081b for instance 8b64a493-6d84-4526-a52c-6330d7cfec84 on n-h2-860864-3 Oct 11 20:02:04.096779 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fd4cf6a9-21ae-4d3a-b09b-ba3b38c99538 req-a2ce8396-e15c-463c-9085-2102511d4a44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129077 Oct 11 20:02:04.099182 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2151/4235] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:04.105612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3c64857e-d4a1-4dae-84ad-e4ff3e602378 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:04.107202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3c64857e-d4a1-4dae-84ad-e4ff3e602378 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:04.115789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c64857e-d4a1-4dae-84ad-e4ff3e602378 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.116794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c64857e-d4a1-4dae-84ad-e4ff3e602378 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.119296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c64857e-d4a1-4dae-84ad-e4ff3e602378 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:04.120488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c64857e-d4a1-4dae-84ad-e4ff3e602378 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.121199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c64857e-d4a1-4dae-84ad-e4ff3e602378 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.123228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c64857e-d4a1-4dae-84ad-e4ff3e602378 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:04.514712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b3a76fb1-f3b4-48ed-a316-ea27529f69b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:04.527388 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b3a76fb1-f3b4-48ed-a316-ea27529f69b7 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1488 microversion: 2.1 time: 0.537976 Oct 11 20:02:04.528674 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2085/4236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:03 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1488 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:04.539530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-33f800b6-2541-4fa1-87fc-eae5c4fb2c71 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:04.544692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-33f800b6-2541-4fa1-87fc-eae5c4fb2c71 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:04.553742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33f800b6-2541-4fa1-87fc-eae5c4fb2c71 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.559174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33f800b6-2541-4fa1-87fc-eae5c4fb2c71 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.559947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33f800b6-2541-4fa1-87fc-eae5c4fb2c71 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:04.560962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33f800b6-2541-4fa1-87fc-eae5c4fb2c71 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.561791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33f800b6-2541-4fa1-87fc-eae5c4fb2c71 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.563040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33f800b6-2541-4fa1-87fc-eae5c4fb2c71 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:04.711150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3c64857e-d4a1-4dae-84ad-e4ff3e602378 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:04.720488 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3c64857e-d4a1-4dae-84ad-e4ff3e602378 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1314 microversion: 2.1 time: 0.619610 Oct 11 20:02:04.734565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-33f800b6-2541-4fa1-87fc-eae5c4fb2c71 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:04.734805 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2152/4237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:04 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:04.734896 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-33f800b6-2541-4fa1-87fc-eae5c4fb2c71 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1271 microversion: 2.1 time: 0.198216 Oct 11 20:02:04.734975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d369856e-bbdb-4853-86a7-0843a49bfa20 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-419615910"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:04.742458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d369856e-bbdb-4853-86a7-0843a49bfa20 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:04.746790 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2086/4238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:04 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:04.749748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d369856e-bbdb-4853-86a7-0843a49bfa20 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.750254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d369856e-bbdb-4853-86a7-0843a49bfa20 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.750730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d369856e-bbdb-4853-86a7-0843a49bfa20 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:04.751442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d369856e-bbdb-4853-86a7-0843a49bfa20 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.751900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d369856e-bbdb-4853-86a7-0843a49bfa20 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.752328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d369856e-bbdb-4853-86a7-0843a49bfa20 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:04.756674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ade4a0f4-221d-40d8-bfe9-3c3ef0889c9a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:04.757543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ade4a0f4-221d-40d8-bfe9-3c3ef0889c9a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:04.771978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ade4a0f4-221d-40d8-bfe9-3c3ef0889c9a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.772929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ade4a0f4-221d-40d8-bfe9-3c3ef0889c9a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.773637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ade4a0f4-221d-40d8-bfe9-3c3ef0889c9a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:04.776833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ade4a0f4-221d-40d8-bfe9-3c3ef0889c9a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:04.778579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ade4a0f4-221d-40d8-bfe9-3c3ef0889c9a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:04.780225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ade4a0f4-221d-40d8-bfe9-3c3ef0889c9a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:05.004109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ade4a0f4-221d-40d8-bfe9-3c3ef0889c9a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:05.020396 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ade4a0f4-221d-40d8-bfe9-3c3ef0889c9a tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.271849 Oct 11 20:02:05.025933 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2087/4239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:04 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:05.043336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2253e79f-5717-4491-b768-7530cef3f008 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:05.047494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2253e79f-5717-4491-b768-7530cef3f008 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:05.069235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2253e79f-5717-4491-b768-7530cef3f008 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:05.071614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2253e79f-5717-4491-b768-7530cef3f008 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:05.075464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2253e79f-5717-4491-b768-7530cef3f008 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:05.078368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2253e79f-5717-4491-b768-7530cef3f008 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:05.079343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2253e79f-5717-4491-b768-7530cef3f008 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:05.080050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2253e79f-5717-4491-b768-7530cef3f008 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:05.230130 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d369856e-bbdb-4853-86a7-0843a49bfa20 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "POST /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb/action" status: 202 len: 0 microversion: 2.1 time: 0.501197 Oct 11 20:02:05.234150 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2153/4240] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:02:04 2022] POST /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 20:02:05.273119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0160aa9-a7a4-4f0d-b490-9872eddc09fc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c7287280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:05.385263 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0160aa9-a7a4-4f0d-b490-9872eddc09fc tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2" status: 200 len: 1413 microversion: 2.1 time: 0.136141 Oct 11 20:02:05.390541 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2154/4241] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:02:05 2022] GET /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2 => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:05.403858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-27783165-81a5-4af1-ba17-9b5535c8da5f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c735f310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:05.517573 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-27783165-81a5-4af1-ba17-9b5535c8da5f tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2" status: 200 len: 1413 microversion: 2.1 time: 0.118234 Oct 11 20:02:05.518416 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2155/4242] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:02:05 2022] GET /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:05.539809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a821373a-87bb-4c19-9b18-388c3445a2ed tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c7287f70>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:05.625708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2253e79f-5717-4491-b768-7530cef3f008 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:05.640601 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2253e79f-5717-4491-b768-7530cef3f008 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1308 microversion: 2.1 time: 0.611354 Oct 11 20:02:05.644692 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2088/4243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:05 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1308 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:05.749975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-444c42bc-a11d-43ac-bfdf-be6a0f8f61f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:05.750850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-444c42bc-a11d-43ac-bfdf-be6a0f8f61f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:05.769890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-444c42bc-a11d-43ac-bfdf-be6a0f8f61f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:05.787653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-444c42bc-a11d-43ac-bfdf-be6a0f8f61f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:05.791082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-444c42bc-a11d-43ac-bfdf-be6a0f8f61f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:05.804363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-444c42bc-a11d-43ac-bfdf-be6a0f8f61f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:05.810307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-444c42bc-a11d-43ac-bfdf-be6a0f8f61f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:05.815569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-444c42bc-a11d-43ac-bfdf-be6a0f8f61f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:06.041628 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a821373a-87bb-4c19-9b18-388c3445a2ed tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2" status: 204 len: 0 microversion: 2.1 time: 0.510771 Oct 11 20:02:06.042786 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2156/4244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:05 2022] DELETE /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:02:06.049700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8435eb4f-c879-47a1-a385-ebbff1690673 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:06.050761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8435eb4f-c879-47a1-a385-ebbff1690673 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:06.112447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8435eb4f-c879-47a1-a385-ebbff1690673 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:06.115604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8435eb4f-c879-47a1-a385-ebbff1690673 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:06.116075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8435eb4f-c879-47a1-a385-ebbff1690673 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:06.116830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8435eb4f-c879-47a1-a385-ebbff1690673 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:06.125769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8435eb4f-c879-47a1-a385-ebbff1690673 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:06.127472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8435eb4f-c879-47a1-a385-ebbff1690673 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:06.275321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-444c42bc-a11d-43ac-bfdf-be6a0f8f61f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:06.289828 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-444c42bc-a11d-43ac-bfdf-be6a0f8f61f0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1314 microversion: 2.1 time: 0.547834 Oct 11 20:02:06.309449 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2089/4245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:05 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:06.324506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dcb2acf9-2a9d-4246-a1f2-7f65f7383f44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:06.329202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dcb2acf9-2a9d-4246-a1f2-7f65f7383f44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:06.354097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb2acf9-2a9d-4246-a1f2-7f65f7383f44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:06.357837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb2acf9-2a9d-4246-a1f2-7f65f7383f44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:06.359324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb2acf9-2a9d-4246-a1f2-7f65f7383f44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:06.362882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb2acf9-2a9d-4246-a1f2-7f65f7383f44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:06.366694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb2acf9-2a9d-4246-a1f2-7f65f7383f44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:06.369055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb2acf9-2a9d-4246-a1f2-7f65f7383f44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:06.905716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dcb2acf9-2a9d-4246-a1f2-7f65f7383f44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:06.931263 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dcb2acf9-2a9d-4246-a1f2-7f65f7383f44 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.616943 Oct 11 20:02:06.948019 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2090/4246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:06 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:06.960097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8435eb4f-c879-47a1-a385-ebbff1690673 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:06.966299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b2f6aa4-c410-4215-8c84-bf5fedc1d452 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83cc19b700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:06.975403 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8435eb4f-c879-47a1-a385-ebbff1690673 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1313 microversion: 2.1 time: 0.930574 Oct 11 20:02:06.976031 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2157/4247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:06 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1313 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:06.993165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f0c8e616-3fdd-4ee3-a69a-6fd68958d94a req-eb591108-7115-4677-9845-1eebafb01ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f29c5a-1f92-4faf-90c8-24627b3f31be", "name": "network-vif-plugged", "status": "completed", "tag": "bfa7e907-b070-493a-a6c0-ec2c6f7fd7d3"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:07.021744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f0c8e616-3fdd-4ee3-a69a-6fd68958d94a req-eb591108-7115-4677-9845-1eebafb01ee1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:07.022616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f0c8e616-3fdd-4ee3-a69a-6fd68958d94a req-eb591108-7115-4677-9845-1eebafb01ee1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:07.023237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f0c8e616-3fdd-4ee3-a69a-6fd68958d94a req-eb591108-7115-4677-9845-1eebafb01ee1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:07.036533 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-8b2f6aa4-c410-4215-8c84-bf5fedc1d452 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Image not found. Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b2f6aa4-c410-4215-8c84-bf5fedc1d452 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2 HTTP/1.1 Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'e1eec085-8d25-4790-8eb3-4007e391d7b2'} Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e1eec085-8d25-4790-8eb3-4007e391d7b2 Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 20:02:07.044865 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1eec085-8d25-4790-8eb3-4007e391d7b2 could not be found. Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:07.048888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b2f6aa4-c410-4215-8c84-bf5fedc1d452 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:07.052361 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b2f6aa4-c410-4215-8c84-bf5fedc1d452 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2" status: 404 len: 62 microversion: 2.1 time: 0.103133 Oct 11 20:02:07.055275 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f0c8e616-3fdd-4ee3-a69a-6fd68958d94a req-eb591108-7115-4677-9845-1eebafb01ee1 service nova] Creating event network-vif-plugged:bfa7e907-b070-493a-a6c0-ec2c6f7fd7d3 for instance c6f29c5a-1f92-4faf-90c8-24627b3f31be on n-h1-860864-3 Oct 11 20:02:07.059740 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2091/4248] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 11 20:02:06 2022] GET /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2 => generated 62 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 20:02:07.064607 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f0c8e616-3fdd-4ee3-a69a-6fd68958d94a req-eb591108-7115-4677-9845-1eebafb01ee1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076289 Oct 11 20:02:07.071437 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2158/4249] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:07.082598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06f4a0dd-f3b9-4a19-aebe-68e31dc8c7c3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:07.083574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-06f4a0dd-f3b9-4a19-aebe-68e31dc8c7c3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:07.088103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b4f3219a-a45c-4559-a7e3-4cc2de952b23 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:07.116350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b4f3219a-a45c-4559-a7e3-4cc2de952b23 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:07.116540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f4a0dd-f3b9-4a19-aebe-68e31dc8c7c3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:07.127024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4f3219a-a45c-4559-a7e3-4cc2de952b23 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:07.127739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4f3219a-a45c-4559-a7e3-4cc2de952b23 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:07.129212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4f3219a-a45c-4559-a7e3-4cc2de952b23 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:07.130195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4f3219a-a45c-4559-a7e3-4cc2de952b23 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:07.131016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4f3219a-a45c-4559-a7e3-4cc2de952b23 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:07.131651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4f3219a-a45c-4559-a7e3-4cc2de952b23 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:07.145685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f4a0dd-f3b9-4a19-aebe-68e31dc8c7c3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:07.150239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f4a0dd-f3b9-4a19-aebe-68e31dc8c7c3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:07.151137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f4a0dd-f3b9-4a19-aebe-68e31dc8c7c3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:07.166211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f4a0dd-f3b9-4a19-aebe-68e31dc8c7c3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:07.167523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f4a0dd-f3b9-4a19-aebe-68e31dc8c7c3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:07.885594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b4f3219a-a45c-4559-a7e3-4cc2de952b23 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:07.902147 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b4f3219a-a45c-4559-a7e3-4cc2de952b23 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1506 microversion: 2.1 time: 0.828169 Oct 11 20:02:07.903446 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2159/4250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:07 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1506 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:07.913521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-56a146d1-145a-4e4b-b3d4-04b6b4024890 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:07.914354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-56a146d1-145a-4e4b-b3d4-04b6b4024890 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:07.919978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-06f4a0dd-f3b9-4a19-aebe-68e31dc8c7c3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:07.938104 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-06f4a0dd-f3b9-4a19-aebe-68e31dc8c7c3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1308 microversion: 2.1 time: 0.876836 Oct 11 20:02:07.945371 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2092/4251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:07 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1308 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:07.950855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56a146d1-145a-4e4b-b3d4-04b6b4024890 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:07.957427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56a146d1-145a-4e4b-b3d4-04b6b4024890 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:07.960437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ffc125d0-2043-4898-abf2-90b3cccdf921 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:07.961269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ffc125d0-2043-4898-abf2-90b3cccdf921 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:07.961631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56a146d1-145a-4e4b-b3d4-04b6b4024890 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:07.962689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56a146d1-145a-4e4b-b3d4-04b6b4024890 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:07.968504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56a146d1-145a-4e4b-b3d4-04b6b4024890 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:07.971336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56a146d1-145a-4e4b-b3d4-04b6b4024890 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:07.979297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc125d0-2043-4898-abf2-90b3cccdf921 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:07.980219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc125d0-2043-4898-abf2-90b3cccdf921 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:07.981478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc125d0-2043-4898-abf2-90b3cccdf921 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:07.984041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc125d0-2043-4898-abf2-90b3cccdf921 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:07.984810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc125d0-2043-4898-abf2-90b3cccdf921 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:07.986226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ffc125d0-2043-4898-abf2-90b3cccdf921 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:08.574059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ffc125d0-2043-4898-abf2-90b3cccdf921 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:08.589544 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ffc125d0-2043-4898-abf2-90b3cccdf921 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.633420 Oct 11 20:02:08.603306 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2093/4252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:07 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:08.615609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5e135381-9e81-4820-87db-5160ceac50cf tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:08.616237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5e135381-9e81-4820-87db-5160ceac50cf tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:08.639185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e135381-9e81-4820-87db-5160ceac50cf tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:08.640118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e135381-9e81-4820-87db-5160ceac50cf tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:08.640977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e135381-9e81-4820-87db-5160ceac50cf tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:08.641895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e135381-9e81-4820-87db-5160ceac50cf tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:08.645223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e135381-9e81-4820-87db-5160ceac50cf tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:08.645896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e135381-9e81-4820-87db-5160ceac50cf tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:08.675326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56a146d1-145a-4e4b-b3d4-04b6b4024890 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:08.689453 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-56a146d1-145a-4e4b-b3d4-04b6b4024890 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1501 microversion: 2.1 time: 0.783668 Oct 11 20:02:08.693008 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2160/4253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:07 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1501 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:08.730019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3b1967cd-8359-42cc-95bf-e3a6507e56b5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:08.733514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3b1967cd-8359-42cc-95bf-e3a6507e56b5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:08.742626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1967cd-8359-42cc-95bf-e3a6507e56b5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:08.744284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1967cd-8359-42cc-95bf-e3a6507e56b5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:08.744911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1967cd-8359-42cc-95bf-e3a6507e56b5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:08.745792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1967cd-8359-42cc-95bf-e3a6507e56b5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:08.746415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1967cd-8359-42cc-95bf-e3a6507e56b5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:08.747038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b1967cd-8359-42cc-95bf-e3a6507e56b5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:08.787447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-3b1967cd-8359-42cc-95bf-e3a6507e56b5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lazy-loading 'flavor' on Instance uuid 8b64a493-6d84-4526-a52c-6330d7cfec84 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:02:09.019223 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3b1967cd-8359-42cc-95bf-e3a6507e56b5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "POST /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84/action" status: 200 len: 32 microversion: 2.1 time: 0.298055 Oct 11 20:02:09.029626 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2161/4254] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:02:08 2022] POST /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84/action => generated 32 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:02:09.051288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5f5e0296-7f3f-4ae3-8c1f-38784bb95e18 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:09.052124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5f5e0296-7f3f-4ae3-8c1f-38784bb95e18 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:09.096375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f5e0296-7f3f-4ae3-8c1f-38784bb95e18 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:09.096956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f5e0296-7f3f-4ae3-8c1f-38784bb95e18 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:09.111663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f5e0296-7f3f-4ae3-8c1f-38784bb95e18 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:09.112441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f5e0296-7f3f-4ae3-8c1f-38784bb95e18 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:09.112933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f5e0296-7f3f-4ae3-8c1f-38784bb95e18 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:09.113373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f5e0296-7f3f-4ae3-8c1f-38784bb95e18 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:10.082505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5e135381-9e81-4820-87db-5160ceac50cf tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:10.096164 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5e135381-9e81-4820-87db-5160ceac50cf tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1334 microversion: 2.1 time: 1.481147 Oct 11 20:02:10.098677 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2094/4255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:08 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1334 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:10.120984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2faab3f3-73ed-4d47-a3b2-b44122356baa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:10.125592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2faab3f3-73ed-4d47-a3b2-b44122356baa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:10.143888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2faab3f3-73ed-4d47-a3b2-b44122356baa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:10.144889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2faab3f3-73ed-4d47-a3b2-b44122356baa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:10.147114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2faab3f3-73ed-4d47-a3b2-b44122356baa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:10.160033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2faab3f3-73ed-4d47-a3b2-b44122356baa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:10.162327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2faab3f3-73ed-4d47-a3b2-b44122356baa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:10.208402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2faab3f3-73ed-4d47-a3b2-b44122356baa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:10.300242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5f5e0296-7f3f-4ae3-8c1f-38784bb95e18 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:10.375440 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5f5e0296-7f3f-4ae3-8c1f-38784bb95e18 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1506 microversion: 2.1 time: 1.330672 Oct 11 20:02:10.378963 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2162/4256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:09 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1506 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:10.405816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d51d3167-f7c8-4377-b243-05cec25e9494 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:10.407594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d51d3167-f7c8-4377-b243-05cec25e9494 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:10.418614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d51d3167-f7c8-4377-b243-05cec25e9494 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:10.419435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d51d3167-f7c8-4377-b243-05cec25e9494 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:10.420046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d51d3167-f7c8-4377-b243-05cec25e9494 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:10.420937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d51d3167-f7c8-4377-b243-05cec25e9494 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:10.421586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d51d3167-f7c8-4377-b243-05cec25e9494 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:10.422364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d51d3167-f7c8-4377-b243-05cec25e9494 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:10.634856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:11.025280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2faab3f3-73ed-4d47-a3b2-b44122356baa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:11.037318 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2faab3f3-73ed-4d47-a3b2-b44122356baa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1489 microversion: 2.1 time: 0.929551 Oct 11 20:02:11.038989 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2095/4257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:10 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1489 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:11.054626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b35759bb-df4f-4e40-956c-96bbf0d756ed req-fa96750e-3f34-4766-83e8-cd2361d0bf8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e1df4-1fb8-4bbc-b6f4-59053268bb29", "name": "network-vif-plugged", "status": "completed", "tag": "971318c7-cccd-4204-b777-6b0137441143"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:11.083786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b35759bb-df4f-4e40-956c-96bbf0d756ed req-fa96750e-3f34-4766-83e8-cd2361d0bf8d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:11.085082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b35759bb-df4f-4e40-956c-96bbf0d756ed req-fa96750e-3f34-4766-83e8-cd2361d0bf8d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:11.085529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b35759bb-df4f-4e40-956c-96bbf0d756ed req-fa96750e-3f34-4766-83e8-cd2361d0bf8d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:11.101539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d51d3167-f7c8-4377-b243-05cec25e9494 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:11.117237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b35759bb-df4f-4e40-956c-96bbf0d756ed req-fa96750e-3f34-4766-83e8-cd2361d0bf8d service nova] Creating event network-vif-plugged:971318c7-cccd-4204-b777-6b0137441143 for instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29 on n-h2-860864-3 Oct 11 20:02:11.126903 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d51d3167-f7c8-4377-b243-05cec25e9494 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.728658 Oct 11 20:02:11.151936 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2163/4258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:10 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:11.158356 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b35759bb-df4f-4e40-956c-96bbf0d756ed req-fa96750e-3f34-4766-83e8-cd2361d0bf8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115092 Oct 11 20:02:11.159804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e089793-af28-48f3-92ea-9755c5dd95a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:11.161899 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2096/4259] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:11.162143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e089793-af28-48f3-92ea-9755c5dd95a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:11.178024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e089793-af28-48f3-92ea-9755c5dd95a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:11.178722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e089793-af28-48f3-92ea-9755c5dd95a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:11.179283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e089793-af28-48f3-92ea-9755c5dd95a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:11.182997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e089793-af28-48f3-92ea-9755c5dd95a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:11.187229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1172487829", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "654cf3d2-0a32-4edb-9224-6f713bbe84e9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-541413794", "security_groups": [{"name": "tempest-secgroup-smoke-1070143672"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:11.192844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e089793-af28-48f3-92ea-9755c5dd95a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:11.193713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e089793-af28-48f3-92ea-9755c5dd95a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:11.252842 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:02:11.253027 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:02:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 (ip 10.222.0.27) !!! Oct 11 20:02:11.328117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=30 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:11.530010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] validate_networks() for [('654cf3d2-0a32-4edb-9224-6f713bbe84e9', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:02:11.733086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e089793-af28-48f3-92ea-9755c5dd95a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:11.746258 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e089793-af28-48f3-92ea-9755c5dd95a4 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.593031 Oct 11 20:02:11.746882 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2164/4260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:11 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:11.763779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e38a6814-1319-4df6-aff0-01ae97736476 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:11.764426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e38a6814-1319-4df6-aff0-01ae97736476 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:11.770770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e38a6814-1319-4df6-aff0-01ae97736476 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:11.771325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e38a6814-1319-4df6-aff0-01ae97736476 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:11.771717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e38a6814-1319-4df6-aff0-01ae97736476 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:11.772448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e38a6814-1319-4df6-aff0-01ae97736476 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:11.772938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e38a6814-1319-4df6-aff0-01ae97736476 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:11.773317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e38a6814-1319-4df6-aff0-01ae97736476 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:12.321837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e38a6814-1319-4df6-aff0-01ae97736476 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:12.325699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:12.330706 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e38a6814-1319-4df6-aff0-01ae97736476 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1489 microversion: 2.1 time: 0.582760 Oct 11 20:02:12.344257 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2165/4261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:11 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1489 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:12.349322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-00035eed-6e66-4e14-84d2-b87b2e00c904 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:12.355305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-00035eed-6e66-4e14-84d2-b87b2e00c904 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:12.377177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00035eed-6e66-4e14-84d2-b87b2e00c904 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:12.378022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00035eed-6e66-4e14-84d2-b87b2e00c904 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:12.378690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00035eed-6e66-4e14-84d2-b87b2e00c904 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:12.379603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00035eed-6e66-4e14-84d2-b87b2e00c904 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:12.380288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00035eed-6e66-4e14-84d2-b87b2e00c904 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:12.381812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00035eed-6e66-4e14-84d2-b87b2e00c904 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:12.916321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:02:12.916869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:02:12.917463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:02:12.918170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:02:12.918732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:02:12.944394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:12.948599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:12.951626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:12.954138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:12.956120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:12.958722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:13.027453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-00035eed-6e66-4e14-84d2-b87b2e00c904 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:13.035591 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-00035eed-6e66-4e14-84d2-b87b2e00c904 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 0.689983 Oct 11 20:02:13.040717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for project abba65df7ef6403db3d5b466eb12fb94. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:02:13.041693 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2166/4262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:12 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:13.053543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for user c3eaa8c79a0645fd93e6e3398426237f and project abba65df7ef6403db3d5b466eb12fb94. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:02:13.062767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b91d8ceb-a3d8-4b4e-8e30-26a83e55e402 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:13.064565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b91d8ceb-a3d8-4b4e-8e30-26a83e55e402 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:13.090206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b91d8ceb-a3d8-4b4e-8e30-26a83e55e402 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:13.095298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b91d8ceb-a3d8-4b4e-8e30-26a83e55e402 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:13.096619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b91d8ceb-a3d8-4b4e-8e30-26a83e55e402 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:13.099930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b91d8ceb-a3d8-4b4e-8e30-26a83e55e402 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:13.103798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:02:13.104389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b91d8ceb-a3d8-4b4e-8e30-26a83e55e402 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:13.106368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:02:13.107696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b91d8ceb-a3d8-4b4e-8e30-26a83e55e402 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:13.212926 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f2ef0123-e914-4490-a65f-148703cdee97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.046011 Oct 11 20:02:13.226897 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2097/4263] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:02:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:02:13.233788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4c0fbcd9-4c5c-4bb8-9487-95c1ae119a25 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:13.234656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4c0fbcd9-4c5c-4bb8-9487-95c1ae119a25 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:13.242248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:13.245348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c0fbcd9-4c5c-4bb8-9487-95c1ae119a25 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:13.255402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c0fbcd9-4c5c-4bb8-9487-95c1ae119a25 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:13.256166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c0fbcd9-4c5c-4bb8-9487-95c1ae119a25 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:13.271657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c0fbcd9-4c5c-4bb8-9487-95c1ae119a25 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:13.272724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c0fbcd9-4c5c-4bb8-9487-95c1ae119a25 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:13.275049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c0fbcd9-4c5c-4bb8-9487-95c1ae119a25 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:13.681281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4c0fbcd9-4c5c-4bb8-9487-95c1ae119a25 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:13.699766 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4c0fbcd9-4c5c-4bb8-9487-95c1ae119a25 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.469649 Oct 11 20:02:13.705614 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2098/4264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:13 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:13.734188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0260c9c1-336d-4c00-a978-8a77e34dcee6 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:13.735063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0260c9c1-336d-4c00-a978-8a77e34dcee6 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:13.776093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0260c9c1-336d-4c00-a978-8a77e34dcee6 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:13.777544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0260c9c1-336d-4c00-a978-8a77e34dcee6 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:13.784304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0260c9c1-336d-4c00-a978-8a77e34dcee6 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:13.786917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0260c9c1-336d-4c00-a978-8a77e34dcee6 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:13.789367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0260c9c1-336d-4c00-a978-8a77e34dcee6 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:13.792264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0260c9c1-336d-4c00-a978-8a77e34dcee6 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:14.390509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b91d8ceb-a3d8-4b4e-8e30-26a83e55e402 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:14.453725 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b91d8ceb-a3d8-4b4e-8e30-26a83e55e402 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1488 microversion: 2.1 time: 1.407470 Oct 11 20:02:14.479876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2167/4265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:13 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1488 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:14.508419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8836c064-1d81-4359-bfc3-1bd8bd6febfe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:14.512846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8836c064-1d81-4359-bfc3-1bd8bd6febfe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:14.528926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8836c064-1d81-4359-bfc3-1bd8bd6febfe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:14.529815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8836c064-1d81-4359-bfc3-1bd8bd6febfe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:14.530725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8836c064-1d81-4359-bfc3-1bd8bd6febfe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:14.531907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8836c064-1d81-4359-bfc3-1bd8bd6febfe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:14.533400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8836c064-1d81-4359-bfc3-1bd8bd6febfe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:14.535013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8836c064-1d81-4359-bfc3-1bd8bd6febfe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:14.834262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0260c9c1-336d-4c00-a978-8a77e34dcee6 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:14.859424 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0260c9c1-336d-4c00-a978-8a77e34dcee6 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1489 microversion: 2.1 time: 1.149874 Oct 11 20:02:14.859724 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2099/4266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:13 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1489 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:14.870180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-31b7fc45-e19b-4aa1-af1f-613544788221 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:14.870830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-31b7fc45-e19b-4aa1-af1f-613544788221 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:14.900357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31b7fc45-e19b-4aa1-af1f-613544788221 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:14.900869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31b7fc45-e19b-4aa1-af1f-613544788221 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:14.901320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31b7fc45-e19b-4aa1-af1f-613544788221 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:14.902038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31b7fc45-e19b-4aa1-af1f-613544788221 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:14.902503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31b7fc45-e19b-4aa1-af1f-613544788221 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:14.913771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31b7fc45-e19b-4aa1-af1f-613544788221 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:14.935150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8836c064-1d81-4359-bfc3-1bd8bd6febfe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:14.954896 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8836c064-1d81-4359-bfc3-1bd8bd6febfe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.465886 Oct 11 20:02:14.958847 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2168/4267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:14 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:14.972635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8e95c950-5359-4963-bafd-3b691f6c25a4 req-b61c10bd-6210-4c05-8a30-37c67c84bfee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01b4b85-eeef-43da-9233-45407e1fe4fb", "name": "network-vif-plugged", "status": "completed", "tag": "4c1bed96-8e72-421a-a5fd-2b8eddbb9018"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:15.003635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8e95c950-5359-4963-bafd-3b691f6c25a4 req-b61c10bd-6210-4c05-8a30-37c67c84bfee service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.007496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8e95c950-5359-4963-bafd-3b691f6c25a4 req-b61c10bd-6210-4c05-8a30-37c67c84bfee service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.008196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8e95c950-5359-4963-bafd-3b691f6c25a4 req-b61c10bd-6210-4c05-8a30-37c67c84bfee service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.021499 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8e95c950-5359-4963-bafd-3b691f6c25a4 req-b61c10bd-6210-4c05-8a30-37c67c84bfee service nova] Creating event network-vif-plugged:4c1bed96-8e72-421a-a5fd-2b8eddbb9018 for instance a01b4b85-eeef-43da-9233-45407e1fe4fb on n-h2-860864-3 Oct 11 20:02:15.028366 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8e95c950-5359-4963-bafd-3b691f6c25a4 req-b61c10bd-6210-4c05-8a30-37c67c84bfee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067724 Oct 11 20:02:15.029322 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2169/4268] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:15.037537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c5366256-c5f7-49d0-ad7f-be550335b99f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:15.038514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c5366256-c5f7-49d0-ad7f-be550335b99f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:15.045993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5366256-c5f7-49d0-ad7f-be550335b99f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.046756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5366256-c5f7-49d0-ad7f-be550335b99f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.047377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5366256-c5f7-49d0-ad7f-be550335b99f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.048447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5366256-c5f7-49d0-ad7f-be550335b99f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.049076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5366256-c5f7-49d0-ad7f-be550335b99f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.051935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5366256-c5f7-49d0-ad7f-be550335b99f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.088703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-31b7fc45-e19b-4aa1-af1f-613544788221 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:15.104426 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-31b7fc45-e19b-4aa1-af1f-613544788221 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1318 microversion: 2.1 time: 0.238086 Oct 11 20:02:15.124243 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2100/4269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:14 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:15.135971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6048eaf5-677f-4425-aeca-c8434d5bfb39 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:15.139145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6048eaf5-677f-4425-aeca-c8434d5bfb39 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:15.152822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6048eaf5-677f-4425-aeca-c8434d5bfb39 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.163011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6048eaf5-677f-4425-aeca-c8434d5bfb39 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.163852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6048eaf5-677f-4425-aeca-c8434d5bfb39 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.165665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6048eaf5-677f-4425-aeca-c8434d5bfb39 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.166383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6048eaf5-677f-4425-aeca-c8434d5bfb39 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.167027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6048eaf5-677f-4425-aeca-c8434d5bfb39 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.200395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6048eaf5-677f-4425-aeca-c8434d5bfb39 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:02:15.204488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:15.344917 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6048eaf5-677f-4425-aeca-c8434d5bfb39 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 204 len: 0 microversion: 2.1 time: 0.210402 Oct 11 20:02:15.346978 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2101/4270] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:15 2022] DELETE /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:02:15.359168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d90d80a6-ac05-483d-9647-ae2f40529490 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:15.360278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d90d80a6-ac05-483d-9647-ae2f40529490 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:15.365573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c5366256-c5f7-49d0-ad7f-be550335b99f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:15.367608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d90d80a6-ac05-483d-9647-ae2f40529490 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.368617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d90d80a6-ac05-483d-9647-ae2f40529490 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.369400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d90d80a6-ac05-483d-9647-ae2f40529490 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.371124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d90d80a6-ac05-483d-9647-ae2f40529490 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.371742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d90d80a6-ac05-483d-9647-ae2f40529490 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.372367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d90d80a6-ac05-483d-9647-ae2f40529490 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.382212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c5366256-c5f7-49d0-ad7f-be550335b99f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 0.351437 Oct 11 20:02:15.385202 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2170/4271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:15 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:15.392426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e58ea54-3d61-4049-ba73-422f113b3a99 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:15.396617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e58ea54-3d61-4049-ba73-422f113b3a99 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:15.408233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e58ea54-3d61-4049-ba73-422f113b3a99 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.411870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e58ea54-3d61-4049-ba73-422f113b3a99 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.413764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e58ea54-3d61-4049-ba73-422f113b3a99 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.424553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e58ea54-3d61-4049-ba73-422f113b3a99 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.425379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e58ea54-3d61-4049-ba73-422f113b3a99 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.426057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e58ea54-3d61-4049-ba73-422f113b3a99 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.532589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e58ea54-3d61-4049-ba73-422f113b3a99 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:02:15.739996 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e58ea54-3d61-4049-ba73-422f113b3a99 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 204 len: 0 microversion: 2.1 time: 0.353010 Oct 11 20:02:15.741287 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2171/4272] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:15 2022] DELETE /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:02:15.762982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61c4a247-7df8-4f1b-97fa-adfd46381244 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c7295a60>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:15.822061 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-61c4a247-7df8-4f1b-97fa-adfd46381244 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Image not found. Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61c4a247-7df8-4f1b-97fa-adfd46381244 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2 HTTP/1.1 Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: exception: Image not found. Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'e1eec085-8d25-4790-8eb3-4007e391d7b2'} Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e1eec085-8d25-4790-8eb3-4007e391d7b2 to delete Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1eec085-8d25-4790-8eb3-4007e391d7b2 could not be found. Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:15.826140 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 20:02:15.830104 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:15.842816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61c4a247-7df8-4f1b-97fa-adfd46381244 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Image not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:15.843940 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-61c4a247-7df8-4f1b-97fa-adfd46381244 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2" status: 404 len: 62 microversion: 2.1 time: 0.101310 Oct 11 20:02:15.845092 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2172/4273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:15 2022] DELETE /compute/v2.1/images/e1eec085-8d25-4790-8eb3-4007e391d7b2 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 20:02:15.852129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8b296702-4686-47da-9bf8-c64447bfb94a req-60abcf8f-45de-46b4-a9ac-cd6cf8b4d141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ff88c4-2697-4489-a684-d48f009037c5", "tag": "92f83f08-a2ce-41d2-8984-80d9e9043973"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:15.865662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8b296702-4686-47da-9bf8-c64447bfb94a req-60abcf8f-45de-46b4-a9ac-cd6cf8b4d141 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.867330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8b296702-4686-47da-9bf8-c64447bfb94a req-60abcf8f-45de-46b4-a9ac-cd6cf8b4d141 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.868277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8b296702-4686-47da-9bf8-c64447bfb94a req-60abcf8f-45de-46b4-a9ac-cd6cf8b4d141 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.884867 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8b296702-4686-47da-9bf8-c64447bfb94a req-60abcf8f-45de-46b4-a9ac-cd6cf8b4d141 service nova] Creating event network-changed:92f83f08-a2ce-41d2-8984-80d9e9043973 for instance a1ff88c4-2697-4489-a684-d48f009037c5 on n-h1-860864-3 Oct 11 20:02:15.893882 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8b296702-4686-47da-9bf8-c64447bfb94a req-60abcf8f-45de-46b4-a9ac-cd6cf8b4d141 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047360 Oct 11 20:02:15.894996 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2173/4274] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:15.901380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-300c737f-f5e4-41d5-9a7c-9ae04e9fa548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:15.902084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-300c737f-f5e4-41d5-9a7c-9ae04e9fa548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:15.916559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-300c737f-f5e4-41d5-9a7c-9ae04e9fa548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.917899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-300c737f-f5e4-41d5-9a7c-9ae04e9fa548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.918514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-300c737f-f5e4-41d5-9a7c-9ae04e9fa548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.919396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-300c737f-f5e4-41d5-9a7c-9ae04e9fa548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:15.920197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-300c737f-f5e4-41d5-9a7c-9ae04e9fa548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:15.921378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-300c737f-f5e4-41d5-9a7c-9ae04e9fa548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:15.965643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d90d80a6-ac05-483d-9647-ae2f40529490 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:15.977831 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d90d80a6-ac05-483d-9647-ae2f40529490 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.627736 Oct 11 20:02:15.979631 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2102/4275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:15 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:15.995371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:16.000645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:16.013037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:16.013919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:16.014701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:16.015806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:16.016451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:16.019901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:16.088525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:02:16.177106 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.compute.api [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Instance is already in deleting state, ignoring this request Oct 11 20:02:16.178255 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-312dd2a1-75c2-4b85-ba2f-7fd68b924c15 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 204 len: 0 microversion: 2.1 time: 0.194447 Oct 11 20:02:16.179397 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2103/4276] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:15 2022] DELETE /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:02:16.185115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-adceb772-558b-4319-a20d-1f499c9a0e2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:16.186234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-adceb772-558b-4319-a20d-1f499c9a0e2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:16.195056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adceb772-558b-4319-a20d-1f499c9a0e2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:16.196683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adceb772-558b-4319-a20d-1f499c9a0e2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:16.197654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adceb772-558b-4319-a20d-1f499c9a0e2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:16.198979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adceb772-558b-4319-a20d-1f499c9a0e2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:16.199703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adceb772-558b-4319-a20d-1f499c9a0e2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:16.200368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adceb772-558b-4319-a20d-1f499c9a0e2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:16.935524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-300c737f-f5e4-41d5-9a7c-9ae04e9fa548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:16.949487 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-300c737f-f5e4-41d5-9a7c-9ae04e9fa548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1495 microversion: 2.1 time: 1.053247 Oct 11 20:02:16.951960 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2174/4277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:15 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1495 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:16.960688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cf07527d-673e-488e-842f-79a3ff0b3f7f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:16.967396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cf07527d-673e-488e-842f-79a3ff0b3f7f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:16.984753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf07527d-673e-488e-842f-79a3ff0b3f7f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:16.986204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf07527d-673e-488e-842f-79a3ff0b3f7f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:16.986991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf07527d-673e-488e-842f-79a3ff0b3f7f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:16.988024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf07527d-673e-488e-842f-79a3ff0b3f7f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:16.988709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf07527d-673e-488e-842f-79a3ff0b3f7f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:16.989349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf07527d-673e-488e-842f-79a3ff0b3f7f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:17.101213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-adceb772-558b-4319-a20d-1f499c9a0e2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:17.112852 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-adceb772-558b-4319-a20d-1f499c9a0e2c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.931674 Oct 11 20:02:17.123968 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2104/4278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:16 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:17.129126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0ef50544-bbef-4953-b021-e94d7c6fb267 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:17.129966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0ef50544-bbef-4953-b021-e94d7c6fb267 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:17.146083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ef50544-bbef-4953-b021-e94d7c6fb267 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:17.146962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ef50544-bbef-4953-b021-e94d7c6fb267 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:17.147669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ef50544-bbef-4953-b021-e94d7c6fb267 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:17.148711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ef50544-bbef-4953-b021-e94d7c6fb267 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:17.149464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ef50544-bbef-4953-b021-e94d7c6fb267 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:17.150227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ef50544-bbef-4953-b021-e94d7c6fb267 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:17.616416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cf07527d-673e-488e-842f-79a3ff0b3f7f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:17.648607 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cf07527d-673e-488e-842f-79a3ff0b3f7f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1326 microversion: 2.1 time: 0.671850 Oct 11 20:02:17.648607 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2175/4279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:16 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1326 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:17.662412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93537c96-d130-4c5a-a56b-eb586c76a465 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:17.667842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-93537c96-d130-4c5a-a56b-eb586c76a465 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:17.700180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93537c96-d130-4c5a-a56b-eb586c76a465 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:17.702579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93537c96-d130-4c5a-a56b-eb586c76a465 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:17.706726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93537c96-d130-4c5a-a56b-eb586c76a465 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:17.714971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93537c96-d130-4c5a-a56b-eb586c76a465 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:17.715640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93537c96-d130-4c5a-a56b-eb586c76a465 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:17.716244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93537c96-d130-4c5a-a56b-eb586c76a465 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:18.801091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-93537c96-d130-4c5a-a56b-eb586c76a465 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:18.810419 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-93537c96-d130-4c5a-a56b-eb586c76a465 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 1.162194 Oct 11 20:02:18.811511 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2176/4280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:17 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:18.834827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-838bd504-6256-4cac-8638-69444a65b194 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:18.835809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-838bd504-6256-4cac-8638-69444a65b194 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:18.842847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838bd504-6256-4cac-8638-69444a65b194 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:18.843607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838bd504-6256-4cac-8638-69444a65b194 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:18.844382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838bd504-6256-4cac-8638-69444a65b194 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:18.845300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838bd504-6256-4cac-8638-69444a65b194 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:18.846149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838bd504-6256-4cac-8638-69444a65b194 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:18.847318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-838bd504-6256-4cac-8638-69444a65b194 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:19.138607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0ef50544-bbef-4953-b021-e94d7c6fb267 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfddbe97757446b58c605f5f6f64500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d1efaec3c7640d684256bc6460e7559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:19.149437 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0ef50544-bbef-4953-b021-e94d7c6fb267 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 200 len: 1494 microversion: 2.1 time: 2.023417 Oct 11 20:02:19.150692 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2105/4281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:17 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 1494 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:19.156868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:19.157651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:19.176123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:19.177603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:19.179044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:19.185786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:19.186395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:19.187032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:19.286974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:19.291084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:19.291653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:19.292361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lazy-loading 'fault' on Instance uuid c6f29c5a-1f92-4faf-90c8-24627b3f31be {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:02:19.565951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:19.584086 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-728aeb9f-39fb-4e2e-b780-75ccaf885ba8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 200 len: 1298 microversion: 2.1 time: 0.426449 Oct 11 20:02:19.587035 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2106/4282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:19 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 1298 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:19.589462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-838bd504-6256-4cac-8638-69444a65b194 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:19.614550 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-838bd504-6256-4cac-8638-69444a65b194 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.786847 Oct 11 20:02:19.617382 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2177/4283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:18 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:19.635082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9fd5b74c-4dfd-4901-b479-2ade51cbf0cd req-fa1a9659-702d-4cc9-96ab-15bf4ed1082f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f29c5a-1f92-4faf-90c8-24627b3f31be", "name": "network-vif-deleted", "tag": "bfa7e907-b070-493a-a6c0-ec2c6f7fd7d3"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:19.644320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-090d0d9a-ceff-47e5-b305-1224f1694d16 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:19.655112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9fd5b74c-4dfd-4901-b479-2ade51cbf0cd req-fa1a9659-702d-4cc9-96ab-15bf4ed1082f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:19.655838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9fd5b74c-4dfd-4901-b479-2ade51cbf0cd req-fa1a9659-702d-4cc9-96ab-15bf4ed1082f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:19.656373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-090d0d9a-ceff-47e5-b305-1224f1694d16 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:19.660137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9fd5b74c-4dfd-4901-b479-2ade51cbf0cd req-fa1a9659-702d-4cc9-96ab-15bf4ed1082f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:19.685204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-090d0d9a-ceff-47e5-b305-1224f1694d16 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:19.685738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-090d0d9a-ceff-47e5-b305-1224f1694d16 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:19.686211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-090d0d9a-ceff-47e5-b305-1224f1694d16 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:19.686982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-090d0d9a-ceff-47e5-b305-1224f1694d16 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:19.687683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-090d0d9a-ceff-47e5-b305-1224f1694d16 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:19.687881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-090d0d9a-ceff-47e5-b305-1224f1694d16 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:19.692840 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9fd5b74c-4dfd-4901-b479-2ade51cbf0cd req-fa1a9659-702d-4cc9-96ab-15bf4ed1082f service nova] Creating event network-vif-deleted:bfa7e907-b070-493a-a6c0-ec2c6f7fd7d3 for instance c6f29c5a-1f92-4faf-90c8-24627b3f31be on n-h1-860864-3 Oct 11 20:02:19.709808 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9fd5b74c-4dfd-4901-b479-2ade51cbf0cd req-fa1a9659-702d-4cc9-96ab-15bf4ed1082f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090596 Oct 11 20:02:19.712784 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2178/4284] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:19.729920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-28f72cc6-f6cc-44e3-9d1f-e0b3d5b0e110 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:19.735272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-28f72cc6-f6cc-44e3-9d1f-e0b3d5b0e110 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:19.762053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28f72cc6-f6cc-44e3-9d1f-e0b3d5b0e110 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:19.764015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28f72cc6-f6cc-44e3-9d1f-e0b3d5b0e110 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:19.765552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28f72cc6-f6cc-44e3-9d1f-e0b3d5b0e110 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:19.767266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28f72cc6-f6cc-44e3-9d1f-e0b3d5b0e110 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:19.769976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28f72cc6-f6cc-44e3-9d1f-e0b3d5b0e110 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:19.770738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28f72cc6-f6cc-44e3-9d1f-e0b3d5b0e110 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:19.999429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-28f72cc6-f6cc-44e3-9d1f-e0b3d5b0e110 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:20.020417 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-28f72cc6-f6cc-44e3-9d1f-e0b3d5b0e110 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1324 microversion: 2.1 time: 0.306110 Oct 11 20:02:20.021671 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2179/4285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:19 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1324 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:20.028706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e23edee-01d8-4790-b6d4-d475b074c92d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:20.029627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e23edee-01d8-4790-b6d4-d475b074c92d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:20.040886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e23edee-01d8-4790-b6d4-d475b074c92d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.042007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e23edee-01d8-4790-b6d4-d475b074c92d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.042763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e23edee-01d8-4790-b6d4-d475b074c92d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.043952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e23edee-01d8-4790-b6d4-d475b074c92d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.046220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e23edee-01d8-4790-b6d4-d475b074c92d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.048303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e23edee-01d8-4790-b6d4-d475b074c92d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.394642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-090d0d9a-ceff-47e5-b305-1224f1694d16 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:20.418557 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-090d0d9a-ceff-47e5-b305-1224f1694d16 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.824533 Oct 11 20:02:20.420175 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2107/4286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:19 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:20.426053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:20.427256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: a01b4b85-eeef-43da-9233-45407e1fe4fb] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:20.440119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.440874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.441471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.442368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.443212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.443875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.464687 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Instance a01b4b85-eeef-43da-9233-45407e1fe4fb could not be found. Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb HTTP/1.1 Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance a01b4b85-eeef-43da-9233-45407e1fe4fb could not be found. Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a01b4b85-eeef-43da-9233-45407e1fe4fb'} Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a01b4b85-eeef-43da-9233-45407e1fe4fb could not be found. Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a01b4b85-eeef-43da-9233-45407e1fe4fb could not be found. Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.467465 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.472116 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:20.472116 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:20.472116 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:20.472116 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:20.472116 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a01b4b85-eeef-43da-9233-45407e1fe4fb could not be found. Oct 11 20:02:20.472116 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.473468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Instance a01b4b85-eeef-43da-9233-45407e1fe4fb could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:20.474851 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c327e3d9-0471-4b21-9f26-9651e79ffe00 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb" status: 404 len: 111 microversion: 2.1 time: 0.053379 Oct 11 20:02:20.476048 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2108/4287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:20 2022] GET /compute/v2.1/servers/a01b4b85-eeef-43da-9233-45407e1fe4fb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:20.482074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-88cada28-8c14-427e-abaa-d4abe8a253df req-7ac569df-100c-4c99-bffe-fec678e59800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ff88c4-2697-4489-a684-d48f009037c5", "tag": "012e4f8a-e911-49fd-a922-fb486d482f7d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:20.496673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-88cada28-8c14-427e-abaa-d4abe8a253df req-7ac569df-100c-4c99-bffe-fec678e59800 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.497564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-88cada28-8c14-427e-abaa-d4abe8a253df req-7ac569df-100c-4c99-bffe-fec678e59800 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.498273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-88cada28-8c14-427e-abaa-d4abe8a253df req-7ac569df-100c-4c99-bffe-fec678e59800 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.512233 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-88cada28-8c14-427e-abaa-d4abe8a253df req-7ac569df-100c-4c99-bffe-fec678e59800 service nova] Creating event network-changed:012e4f8a-e911-49fd-a922-fb486d482f7d for instance a1ff88c4-2697-4489-a684-d48f009037c5 on n-h1-860864-3 Oct 11 20:02:20.518421 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-88cada28-8c14-427e-abaa-d4abe8a253df req-7ac569df-100c-4c99-bffe-fec678e59800 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040597 Oct 11 20:02:20.519301 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2109/4288] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:20.525689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9adcd7c9-e434-442c-903c-5777f8d2a7ff tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83d0728820>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:20.577375 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9adcd7c9-e434-442c-903c-5777f8d2a7ff tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Image not found. Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9adcd7c9-e434-442c-903c-5777f8d2a7ff tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 HTTP/1.1 Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: exception: Image not found. Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'e5bba25f-4b70-455d-9c63-3ff36d0ab442'} Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e5bba25f-4b70-455d-9c63-3ff36d0ab442 to delete Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5bba25f-4b70-455d-9c63-3ff36d0ab442 could not be found. Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.580109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9adcd7c9-e434-442c-903c-5777f8d2a7ff tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Image not found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9adcd7c9-e434-442c-903c-5777f8d2a7ff tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442" status: 404 len: 62 microversion: 2.1 time: 0.060905 Oct 11 20:02:20.584262 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2110/4289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:20 2022] DELETE /compute/v2.1/images/e5bba25f-4b70-455d-9c63-3ff36d0ab442 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 20:02:20.590784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:20.591405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:20.599218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.599984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.600436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.601145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.601617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.602753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.625381 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 HTTP/1.1 Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '2b9b0470-13c5-4393-a735-d4b067e5f980'} Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:20.627239 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. Oct 11 20:02:20.631577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.631577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.631577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.631577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.631577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:20.631577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:20.631577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:20.631577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:20.631577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. Oct 11 20:02:20.631577 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.632904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:20.634631 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-23a14943-ea42-4a36-a421-35954a85eeea tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 404 len: 111 microversion: 2.1 time: 0.048053 Oct 11 20:02:20.638846 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2111/4290] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:20 2022] DELETE /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:20.644232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:20.645619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:20.653622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.654347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.655510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.656983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.657616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.658198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.674777 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be HTTP/1.1 Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'c6f29c5a-1f92-4faf-90c8-24627b3f31be'} Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.677178 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.681541 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.681541 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:20.681541 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:20.681541 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:20.681541 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:20.681541 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:02:20.681541 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.682947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:20.684546 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a00e188-c1d8-4ffd-8683-f8a73d945ae4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 404 len: 111 microversion: 2.1 time: 0.043917 Oct 11 20:02:20.689617 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2112/4291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:20 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:20.695386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:20.696774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 2b9b0470-13c5-4393-a735-d4b067e5f980] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:20.703752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.704439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.705072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.705959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.706823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.707522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.725058 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 HTTP/1.1 Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '2b9b0470-13c5-4393-a735-d4b067e5f980'} Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.727163 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:20.730911 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:20.730911 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:20.730911 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:20.730911 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:20.730911 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. Oct 11 20:02:20.730911 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:20.732633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Instance 2b9b0470-13c5-4393-a735-d4b067e5f980 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:20.733682 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6dd6fe8c-7a1c-468d-a5e7-6207385039df tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980" status: 404 len: 111 microversion: 2.1 time: 0.042893 Oct 11 20:02:20.737861 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2113/4292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:20 2022] GET /compute/v2.1/servers/2b9b0470-13c5-4393-a735-d4b067e5f980 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:20.742972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-20c2f489-3f20-4017-8098-647efc530f30 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:20.743844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-20c2f489-3f20-4017-8098-647efc530f30 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:20.750282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20c2f489-3f20-4017-8098-647efc530f30 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.751059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20c2f489-3f20-4017-8098-647efc530f30 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.751722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20c2f489-3f20-4017-8098-647efc530f30 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:20.753265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20c2f489-3f20-4017-8098-647efc530f30 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:20.753940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20c2f489-3f20-4017-8098-647efc530f30 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:20.754647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20c2f489-3f20-4017-8098-647efc530f30 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:21.761046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e23edee-01d8-4790-b6d4-d475b074c92d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:21.777660 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e23edee-01d8-4790-b6d4-d475b074c92d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 1.754177 Oct 11 20:02:21.778298 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2180/4293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:20 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:21.783129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b4547525-1530-451a-a516-e25526096854 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:21.794907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b4547525-1530-451a-a516-e25526096854 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:21.802550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4547525-1530-451a-a516-e25526096854 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:21.803075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4547525-1530-451a-a516-e25526096854 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:21.803536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4547525-1530-451a-a516-e25526096854 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:21.804231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4547525-1530-451a-a516-e25526096854 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:21.805424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4547525-1530-451a-a516-e25526096854 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:21.806023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4547525-1530-451a-a516-e25526096854 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:21.874809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b4547525-1530-451a-a516-e25526096854 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:02:22.104904 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b4547525-1530-451a-a516-e25526096854 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 204 len: 0 microversion: 2.1 time: 0.325125 Oct 11 20:02:22.106571 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2181/4294] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:21 2022] DELETE /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:02:22.124727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e14e6faa-7a4d-40fd-bd42-23e3081170e0 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c720a700>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:22.172483 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-e14e6faa-7a4d-40fd-bd42-23e3081170e0 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Image not found. Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e14e6faa-7a4d-40fd-bd42-23e3081170e0 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 HTTP/1.1 Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: exception: Image not found. Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '458fa028-cda2-42c2-bdb8-983fddf94cd8'} Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 458fa028-cda2-42c2-bdb8-983fddf94cd8 to delete Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 458fa028-cda2-42c2-bdb8-983fddf94cd8 could not be found. Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:22.176417 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 20:02:22.181356 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:22.183631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e14e6faa-7a4d-40fd-bd42-23e3081170e0 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Image not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:22.184725 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e14e6faa-7a4d-40fd-bd42-23e3081170e0 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8" status: 404 len: 62 microversion: 2.1 time: 0.076847 Oct 11 20:02:22.188676 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2182/4295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:22 2022] DELETE /compute/v2.1/images/458fa028-cda2-42c2-bdb8-983fddf94cd8 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 20:02:22.194974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3d3c7fe3-8c29-4b49-a78c-2d8a609b1ad7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:22.196975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3d3c7fe3-8c29-4b49-a78c-2d8a609b1ad7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:22.218932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d3c7fe3-8c29-4b49-a78c-2d8a609b1ad7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:22.219557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d3c7fe3-8c29-4b49-a78c-2d8a609b1ad7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:22.220080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d3c7fe3-8c29-4b49-a78c-2d8a609b1ad7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:22.221094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d3c7fe3-8c29-4b49-a78c-2d8a609b1ad7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:22.221387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d3c7fe3-8c29-4b49-a78c-2d8a609b1ad7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:22.221899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d3c7fe3-8c29-4b49-a78c-2d8a609b1ad7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:22.226963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:22.345454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-20c2f489-3f20-4017-8098-647efc530f30 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:22.360351 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-20c2f489-3f20-4017-8098-647efc530f30 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 1.621053 Oct 11 20:02:22.361193 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2114/4296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:20 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:22.371604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e760c0b8-f274-408c-b533-31c1f8e059bf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:22.372813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e760c0b8-f274-408c-b533-31c1f8e059bf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:22.389567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e760c0b8-f274-408c-b533-31c1f8e059bf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:22.390336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e760c0b8-f274-408c-b533-31c1f8e059bf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:22.390962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e760c0b8-f274-408c-b533-31c1f8e059bf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:22.391854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e760c0b8-f274-408c-b533-31c1f8e059bf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:22.392459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e760c0b8-f274-408c-b533-31c1f8e059bf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:22.393065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e760c0b8-f274-408c-b533-31c1f8e059bf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:22.901309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3d3c7fe3-8c29-4b49-a78c-2d8a609b1ad7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:22.914849 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3d3c7fe3-8c29-4b49-a78c-2d8a609b1ad7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1392 microversion: 2.1 time: 0.724693 Oct 11 20:02:22.915527 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2183/4297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:22 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1392 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:22.928583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e760c0b8-f274-408c-b533-31c1f8e059bf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:22.936325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-e4e06b29-0c4b-4a3e-9ce7-054171668288 req-d065d60a-8982-4bce-8be4-50d30b802e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01b4b85-eeef-43da-9233-45407e1fe4fb", "name": "network-vif-deleted", "tag": "4c1bed96-8e72-421a-a5fd-2b8eddbb9018"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:22.948180 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e760c0b8-f274-408c-b533-31c1f8e059bf tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.585745 Oct 11 20:02:22.956479 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2115/4298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:22 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:22.968081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e4e06b29-0c4b-4a3e-9ce7-054171668288 req-d065d60a-8982-4bce-8be4-50d30b802e02 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:22.972079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65085da0-a268-4bee-8533-6752d904d42f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:22.972861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e4e06b29-0c4b-4a3e-9ce7-054171668288 req-d065d60a-8982-4bce-8be4-50d30b802e02 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:22.973470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e4e06b29-0c4b-4a3e-9ce7-054171668288 req-d065d60a-8982-4bce-8be4-50d30b802e02 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:22.977521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-65085da0-a268-4bee-8533-6752d904d42f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:22.999802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65085da0-a268-4bee-8533-6752d904d42f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:23.000228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65085da0-a268-4bee-8533-6752d904d42f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:23.000674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65085da0-a268-4bee-8533-6752d904d42f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:23.001398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65085da0-a268-4bee-8533-6752d904d42f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:23.001857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65085da0-a268-4bee-8533-6752d904d42f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:23.002289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65085da0-a268-4bee-8533-6752d904d42f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:23.004919 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-e4e06b29-0c4b-4a3e-9ce7-054171668288 req-d065d60a-8982-4bce-8be4-50d30b802e02 service nova] Creating event network-vif-deleted:4c1bed96-8e72-421a-a5fd-2b8eddbb9018 for instance a01b4b85-eeef-43da-9233-45407e1fe4fb on n-h2-860864-3 Oct 11 20:02:23.023549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:23.027046 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-e4e06b29-0c4b-4a3e-9ce7-054171668288 req-d065d60a-8982-4bce-8be4-50d30b802e02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109360 Oct 11 20:02:23.028194 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2184/4299] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:23.034657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:23.035419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:23.046857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:23.047695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:23.048311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:23.049225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:23.050834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:23.051656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:23.092964 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd HTTP/1.1 Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'bf9003fd-01af-4756-9492-3a213041cdfd'} Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:23.094940 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:23.099410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:23.100167 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a59560a5-e86f-4bb9-8592-fd00eecf7879 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 404 len: 111 microversion: 2.1 time: 0.070621 Oct 11 20:02:23.100726 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2185/4300] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:23 2022] DELETE /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:23.105655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:23.106036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1f9d2e9b-a40b-40ff-8182-2abcbbc17e72 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:23.115180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1f9d2e9b-a40b-40ff-8182-2abcbbc17e72 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:23.132467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f9d2e9b-a40b-40ff-8182-2abcbbc17e72 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:23.133512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f9d2e9b-a40b-40ff-8182-2abcbbc17e72 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:23.135376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f9d2e9b-a40b-40ff-8182-2abcbbc17e72 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:23.137148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f9d2e9b-a40b-40ff-8182-2abcbbc17e72 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:23.139564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f9d2e9b-a40b-40ff-8182-2abcbbc17e72 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:23.140169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f9d2e9b-a40b-40ff-8182-2abcbbc17e72 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:23.715335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-65085da0-a268-4bee-8533-6752d904d42f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:23.728058 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-65085da0-a268-4bee-8533-6752d904d42f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1495 microversion: 2.1 time: 0.770183 Oct 11 20:02:23.729383 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2116/4301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:22 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1495 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:23.737561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:23.740483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: bf9003fd-01af-4756-9492-3a213041cdfd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:23.758456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:23.759946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:23.760617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:23.761622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:23.763417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:23.764036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:23.794824 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd HTTP/1.1 Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'bf9003fd-01af-4756-9492-3a213041cdfd'} Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:23.797515 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:23.802255 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:23.802255 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:23.802255 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:23.802255 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:23.802255 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. Oct 11 20:02:23.802255 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:23.803972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Instance bf9003fd-01af-4756-9492-3a213041cdfd could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:23.805224 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3cc772f2-0957-40fb-9764-18f471a266f2 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd" status: 404 len: 111 microversion: 2.1 time: 0.074554 Oct 11 20:02:23.806112 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2117/4302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:23 2022] GET /compute/v2.1/servers/bf9003fd-01af-4756-9492-3a213041cdfd => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:23.814761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-560566bb-a485-4063-a3af-45fbf4d42fcd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:23.815727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-560566bb-a485-4063-a3af-45fbf4d42fcd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:23.825670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-560566bb-a485-4063-a3af-45fbf4d42fcd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:23.826418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-560566bb-a485-4063-a3af-45fbf4d42fcd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:23.827112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-560566bb-a485-4063-a3af-45fbf4d42fcd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:23.828026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-560566bb-a485-4063-a3af-45fbf4d42fcd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:23.828651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-560566bb-a485-4063-a3af-45fbf4d42fcd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:23.829263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-560566bb-a485-4063-a3af-45fbf4d42fcd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:23.923515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1f9d2e9b-a40b-40ff-8182-2abcbbc17e72 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:23.944970 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1f9d2e9b-a40b-40ff-8182-2abcbbc17e72 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 0.843104 Oct 11 20:02:23.946813 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2186/4303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:23 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:23.963097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f06b54c-1664-4a2a-accb-d3ddb3ec5f1d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '.version_select at 0x7f83c72e20d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:23.999720 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0f06b54c-1664-4a2a-accb-d3ddb3ec5f1d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Image not found. Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f06b54c-1664-4a2a-accb-d3ddb3ec5f1d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 HTTP/1.1 Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: exception: Image not found. Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a019c7e8-776c-425a-97a5-bb97670a1358'} Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a019c7e8-776c-425a-97a5-bb97670a1358 to delete Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a019c7e8-776c-425a-97a5-bb97670a1358 could not be found. Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:24.001582 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 20:02:24.005868 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:24.008674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f06b54c-1664-4a2a-accb-d3ddb3ec5f1d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Image not found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:24.009678 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f06b54c-1664-4a2a-accb-d3ddb3ec5f1d tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358" status: 404 len: 62 microversion: 2.1 time: 0.061567 Oct 11 20:02:24.010718 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2187/4304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:23 2022] DELETE /compute/v2.1/images/a019c7e8-776c-425a-97a5-bb97670a1358 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 20:02:24.015876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6eaf907-98c0-4d82-b9cd-dbd013fb51cd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:24.020367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6eaf907-98c0-4d82-b9cd-dbd013fb51cd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:24.033954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6eaf907-98c0-4d82-b9cd-dbd013fb51cd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:24.036078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6eaf907-98c0-4d82-b9cd-dbd013fb51cd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:24.036703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6eaf907-98c0-4d82-b9cd-dbd013fb51cd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:24.037561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6eaf907-98c0-4d82-b9cd-dbd013fb51cd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:24.065535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6eaf907-98c0-4d82-b9cd-dbd013fb51cd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:24.066352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6eaf907-98c0-4d82-b9cd-dbd013fb51cd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:24.663043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-560566bb-a485-4063-a3af-45fbf4d42fcd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:24.688954 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-560566bb-a485-4063-a3af-45fbf4d42fcd tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.878496 Oct 11 20:02:24.697616 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2118/4305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:23 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:24.713923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-159b2fde-023c-493a-a616-175e131a9e0e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:24.715584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-159b2fde-023c-493a-a616-175e131a9e0e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:24.731930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-159b2fde-023c-493a-a616-175e131a9e0e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:24.733031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-159b2fde-023c-493a-a616-175e131a9e0e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:24.734191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-159b2fde-023c-493a-a616-175e131a9e0e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:24.739646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-159b2fde-023c-493a-a616-175e131a9e0e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:24.740248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-159b2fde-023c-493a-a616-175e131a9e0e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:24.741786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-159b2fde-023c-493a-a616-175e131a9e0e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:24.959939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6eaf907-98c0-4d82-b9cd-dbd013fb51cd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:24.983594 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6eaf907-98c0-4d82-b9cd-dbd013fb51cd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1392 microversion: 2.1 time: 0.971618 Oct 11 20:02:24.995522 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2188/4306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:24 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1392 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:25.007965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:25.009121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:25.017109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.017845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.018492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.019791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.020491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.021141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.047606 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 HTTP/1.1 Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '392dfdc2-0385-4e3b-8afb-b26d4d9d7192'} Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:25.049433 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. Oct 11 20:02:25.052966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:25.052966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:25.052966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:25.052966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:25.052966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:25.052966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:25.052966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:25.052966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:25.052966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. Oct 11 20:02:25.052966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:25.057989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:25.059140 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3e78e4e3-84a1-4b2c-9eb0-de1e9862c1c4 tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 404 len: 111 microversion: 2.1 time: 0.062390 Oct 11 20:02:25.063061 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2189/4307] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:24 2022] DELETE /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:25.073155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:25.074921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:25.085344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:25.087547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.088442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.089141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.090313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.091007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.091666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.130642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.131692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.132345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.133062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lazy-loading 'fault' on Instance uuid af7fe3a5-dbd2-435f-a3ff-165d30307447 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:02:25.313258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:25.327918 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-840a9d63-79db-448e-90a0-20ebe174771b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 200 len: 1298 microversion: 2.1 time: 0.261022 Oct 11 20:02:25.333331 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2190/4308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:25 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 1298 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:25.356169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77b70f18-5fa8-4347-9357-1772aeedf6c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:25.356985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-77b70f18-5fa8-4347-9357-1772aeedf6c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:25.370872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77b70f18-5fa8-4347-9357-1772aeedf6c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.378267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77b70f18-5fa8-4347-9357-1772aeedf6c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.379055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77b70f18-5fa8-4347-9357-1772aeedf6c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.380233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77b70f18-5fa8-4347-9357-1772aeedf6c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.381101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77b70f18-5fa8-4347-9357-1772aeedf6c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.381972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77b70f18-5fa8-4347-9357-1772aeedf6c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.436847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-159b2fde-023c-493a-a616-175e131a9e0e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:25.444948 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-159b2fde-023c-493a-a616-175e131a9e0e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.745785 Oct 11 20:02:25.454880 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2119/4309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:24 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:25.460012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-0397904e-9e83-4d31-bbb7-ab610f6e8c09 req-75df1194-10be-4937-a42a-02f7e5f09300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7fe3a5-dbd2-435f-a3ff-165d30307447", "name": "network-vif-deleted", "tag": "9fac69ed-1c45-4078-b138-1757aa38e766"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:25.480949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0397904e-9e83-4d31-bbb7-ab610f6e8c09 req-75df1194-10be-4937-a42a-02f7e5f09300 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.485085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0397904e-9e83-4d31-bbb7-ab610f6e8c09 req-75df1194-10be-4937-a42a-02f7e5f09300 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.485807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0397904e-9e83-4d31-bbb7-ab610f6e8c09 req-75df1194-10be-4937-a42a-02f7e5f09300 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.490705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:25.514310 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-0397904e-9e83-4d31-bbb7-ab610f6e8c09 req-75df1194-10be-4937-a42a-02f7e5f09300 service nova] Creating event network-vif-deleted:9fac69ed-1c45-4078-b138-1757aa38e766 for instance af7fe3a5-dbd2-435f-a3ff-165d30307447 on n-h1-860864-3 Oct 11 20:02:25.520621 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-0397904e-9e83-4d31-bbb7-ab610f6e8c09 req-75df1194-10be-4937-a42a-02f7e5f09300 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064394 Oct 11 20:02:25.521682 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2120/4310] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:25.527865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:25.528690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] [instance: 392dfdc2-0385-4e3b-8afb-b26d4d9d7192] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:25.535261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.535897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.536450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.537264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.537838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.538393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.556143 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] HTTP exception thrown: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Request method failure captured: Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 HTTP/1.1 Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcrbkMxCeG1i37rU9uxmRS-yCLVdn5ldp0F1ZFIL-trwz_PGLA3MPKsI8m59MTRky2BTj1V2akj9vySb2QxGyfoWN-JJvBMA29tFt8bLvOW4yuV_EtgLCfFvKdcMpiRtntIXPcl4CnDUZYmDSjfBR7dpMcZPJTp2cEZSwggd9DfwNRA Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d1efaec3c7640d684256bc6460e7559", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d1efaec3c7640d684256bc6460e7559"}]}] Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9d1efaec3c7640d684256bc6460e7559 Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ImagesTestJSON-1635226791 Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bfddbe97757446b58c605f5f6f64500c Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ImagesTestJSON-1635226791-project Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '392dfdc2-0385-4e3b-8afb-b26d4d9d7192'} Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:25.582734 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:25.587716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:25.587716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:25.587716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:25.587716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:25.587716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. Oct 11 20:02:25.587716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:25.589458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] Returning 404 to user: Instance 392dfdc2-0385-4e3b-8afb-b26d4d9d7192 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:25.590231 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c661402d-62cb-41fa-a352-767d558d8ada tempest-ImagesTestJSON-1635226791 tempest-ImagesTestJSON-1635226791-project] 10.222.0.27 "GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192" status: 404 len: 111 microversion: 2.1 time: 0.067123 Oct 11 20:02:25.594204 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2121/4311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:25 2022] GET /compute/v2.1/servers/392dfdc2-0385-4e3b-8afb-b26d4d9d7192 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:25.598156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-78173222-f652-481c-8ddc-fa06d2b266d3 req-112cd6d2-c630-4f56-b9de-2106c94175b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ff88c4-2697-4489-a684-d48f009037c5", "tag": "2051ef06-bdbf-4184-a72f-084b247eb5cf"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:25.617994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-78173222-f652-481c-8ddc-fa06d2b266d3 req-112cd6d2-c630-4f56-b9de-2106c94175b2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.618666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-78173222-f652-481c-8ddc-fa06d2b266d3 req-112cd6d2-c630-4f56-b9de-2106c94175b2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.619245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-78173222-f652-481c-8ddc-fa06d2b266d3 req-112cd6d2-c630-4f56-b9de-2106c94175b2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.644895 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-78173222-f652-481c-8ddc-fa06d2b266d3 req-112cd6d2-c630-4f56-b9de-2106c94175b2 service nova] Creating event network-changed:2051ef06-bdbf-4184-a72f-084b247eb5cf for instance a1ff88c4-2697-4489-a684-d48f009037c5 on n-h1-860864-3 Oct 11 20:02:25.654013 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-78173222-f652-481c-8ddc-fa06d2b266d3 req-112cd6d2-c630-4f56-b9de-2106c94175b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061416 Oct 11 20:02:25.654759 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2122/4312] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:25.726291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2a75e7a1-84ad-46e9-89d0-5de24f176ca7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:25.743426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2a75e7a1-84ad-46e9-89d0-5de24f176ca7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:25.754692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a75e7a1-84ad-46e9-89d0-5de24f176ca7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.756634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a75e7a1-84ad-46e9-89d0-5de24f176ca7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.760063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a75e7a1-84ad-46e9-89d0-5de24f176ca7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.761603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a75e7a1-84ad-46e9-89d0-5de24f176ca7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:25.764022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a75e7a1-84ad-46e9-89d0-5de24f176ca7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:25.765071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a75e7a1-84ad-46e9-89d0-5de24f176ca7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:25.970435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-77b70f18-5fa8-4347-9357-1772aeedf6c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:25.980058 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-77b70f18-5fa8-4347-9357-1772aeedf6c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 0.642736 Oct 11 20:02:25.982634 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2191/4313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:25 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:26.009998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2c50dac-1dd5-4a66-a3e2-6bfc19161155 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:26.010759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2c50dac-1dd5-4a66-a3e2-6bfc19161155 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:26.035102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2c50dac-1dd5-4a66-a3e2-6bfc19161155 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:26.036312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2c50dac-1dd5-4a66-a3e2-6bfc19161155 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:26.048046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2c50dac-1dd5-4a66-a3e2-6bfc19161155 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:26.049094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2c50dac-1dd5-4a66-a3e2-6bfc19161155 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:26.049779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2c50dac-1dd5-4a66-a3e2-6bfc19161155 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:26.050437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2c50dac-1dd5-4a66-a3e2-6bfc19161155 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:26.447572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2a75e7a1-84ad-46e9-89d0-5de24f176ca7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:26.460336 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2a75e7a1-84ad-46e9-89d0-5de24f176ca7 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.739826 Oct 11 20:02:26.483639 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2123/4314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:25 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:26.494587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:26.495588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:26.513032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:26.518038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:26.518746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:26.522317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:26.523131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:26.526155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:26.549785 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 HTTP/1.1 Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'af7fe3a5-dbd2-435f-a3ff-165d30307447'} Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:26.566892 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:26.572666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:26.572666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:26.572666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:26.572666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:26.572666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:26.572666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:02:26.572666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:26.574743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:26.576509 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-67ed8d60-7567-4451-8dc2-2f3f464cebd1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 404 len: 111 microversion: 2.1 time: 0.091506 Oct 11 20:02:26.581510 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2124/4315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:26 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:26.588075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ba02cc40-9c1d-40f9-8091-595fb1a042df tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:26.588940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ba02cc40-9c1d-40f9-8091-595fb1a042df tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:26.614992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba02cc40-9c1d-40f9-8091-595fb1a042df tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:26.621795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba02cc40-9c1d-40f9-8091-595fb1a042df tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:26.622508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba02cc40-9c1d-40f9-8091-595fb1a042df tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:26.623595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba02cc40-9c1d-40f9-8091-595fb1a042df tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:26.625780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba02cc40-9c1d-40f9-8091-595fb1a042df tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:26.627754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba02cc40-9c1d-40f9-8091-595fb1a042df tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:26.672978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a2c50dac-1dd5-4a66-a3e2-6bfc19161155 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:26.685187 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2c50dac-1dd5-4a66-a3e2-6bfc19161155 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1392 microversion: 2.1 time: 0.675569 Oct 11 20:02:26.698552 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2192/4316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:26 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1392 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:26.785371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-167919959", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "4bda9a14-e746-4951-9d43-234855a05a4d"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:26.853214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] validate_networks() for [('4bda9a14-e746-4951-9d43-234855a05a4d', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:02:27.907201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ba02cc40-9c1d-40f9-8091-595fb1a042df tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:27.916143 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ba02cc40-9c1d-40f9-8091-595fb1a042df tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 1.333273 Oct 11 20:02:27.916733 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2125/4317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:26 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:27.954333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-80dd78a7-c6e7-48db-9abe-f6694b2ea0e9 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:27.955237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-80dd78a7-c6e7-48db-9abe-f6694b2ea0e9 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:27.962564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80dd78a7-c6e7-48db-9abe-f6694b2ea0e9 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:27.963292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80dd78a7-c6e7-48db-9abe-f6694b2ea0e9 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:27.963912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80dd78a7-c6e7-48db-9abe-f6694b2ea0e9 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:27.964774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80dd78a7-c6e7-48db-9abe-f6694b2ea0e9 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:27.965383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80dd78a7-c6e7-48db-9abe-f6694b2ea0e9 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:27.965962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80dd78a7-c6e7-48db-9abe-f6694b2ea0e9 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:29.047827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-80dd78a7-c6e7-48db-9abe-f6694b2ea0e9 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:29.057865 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-80dd78a7-c6e7-48db-9abe-f6694b2ea0e9 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 1.116696 Oct 11 20:02:29.080433 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2126/4318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:27 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:29.088212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-66dfd8e4-edbc-475a-8f73-2e5dd45564fb tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:29.089567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-66dfd8e4-edbc-475a-8f73-2e5dd45564fb tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:29.099905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66dfd8e4-edbc-475a-8f73-2e5dd45564fb tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:29.100960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66dfd8e4-edbc-475a-8f73-2e5dd45564fb tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:29.101618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66dfd8e4-edbc-475a-8f73-2e5dd45564fb tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:29.103512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66dfd8e4-edbc-475a-8f73-2e5dd45564fb tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:29.104882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66dfd8e4-edbc-475a-8f73-2e5dd45564fb tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:29.105471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66dfd8e4-edbc-475a-8f73-2e5dd45564fb tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:29.349141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:02:29.349615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:02:29.350078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:02:29.350602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:02:29.351028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:02:29.367073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:29.367860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:29.368575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:29.369468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:29.370073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:29.370683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:29.390857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:02:29.396805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for user a84c2531dcb24cce9872808db6c1fa6d and project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:02:29.411432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:02:29.414718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:02:29.488681 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-26097a5d-3417-4415-8aa7-9a3d36125c1e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.707150 Oct 11 20:02:29.490034 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2193/4319] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 20:02:29.496525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-18a21728-7e0e-4ddf-a53d-736de4c013a4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:29.497333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-18a21728-7e0e-4ddf-a53d-736de4c013a4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:29.504668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18a21728-7e0e-4ddf-a53d-736de4c013a4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:29.505369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18a21728-7e0e-4ddf-a53d-736de4c013a4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:29.505974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18a21728-7e0e-4ddf-a53d-736de4c013a4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:29.506941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18a21728-7e0e-4ddf-a53d-736de4c013a4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:29.507554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18a21728-7e0e-4ddf-a53d-736de4c013a4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:29.508496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-18a21728-7e0e-4ddf-a53d-736de4c013a4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:29.558163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-66dfd8e4-edbc-475a-8f73-2e5dd45564fb tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:29.588260 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-66dfd8e4-edbc-475a-8f73-2e5dd45564fb tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.504984 Oct 11 20:02:29.589712 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2127/4320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:29 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:29.598812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a985794e-f99c-4cf3-b948-40dad0d223ed req-80efc69b-3a50-40b1-b97f-2097a2c63971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d6cd57-1120-449b-ba44-2066fb17c6e8", "tag": "a2241e88-c9e7-4296-bc6f-97e0146faa66"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:29.631503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a985794e-f99c-4cf3-b948-40dad0d223ed req-80efc69b-3a50-40b1-b97f-2097a2c63971 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:29.633794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a985794e-f99c-4cf3-b948-40dad0d223ed req-80efc69b-3a50-40b1-b97f-2097a2c63971 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:29.637984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a985794e-f99c-4cf3-b948-40dad0d223ed req-80efc69b-3a50-40b1-b97f-2097a2c63971 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:29.674272 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a985794e-f99c-4cf3-b948-40dad0d223ed req-80efc69b-3a50-40b1-b97f-2097a2c63971 service nova] Creating event network-changed:a2241e88-c9e7-4296-bc6f-97e0146faa66 for instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 on n-h2-860864-3 Oct 11 20:02:29.692281 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a985794e-f99c-4cf3-b948-40dad0d223ed req-80efc69b-3a50-40b1-b97f-2097a2c63971 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101067 Oct 11 20:02:29.692888 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2128/4321] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:29.716188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b6a27dc-dedc-45d7-aa0c-b435b7252aff tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:29.716889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7b6a27dc-dedc-45d7-aa0c-b435b7252aff tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:29.740983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b6a27dc-dedc-45d7-aa0c-b435b7252aff tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:29.741490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b6a27dc-dedc-45d7-aa0c-b435b7252aff tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:29.741931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b6a27dc-dedc-45d7-aa0c-b435b7252aff tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:29.742783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b6a27dc-dedc-45d7-aa0c-b435b7252aff tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:29.743246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b6a27dc-dedc-45d7-aa0c-b435b7252aff tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:29.743670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b6a27dc-dedc-45d7-aa0c-b435b7252aff tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:30.255411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-18a21728-7e0e-4ddf-a53d-736de4c013a4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:30.266031 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-18a21728-7e0e-4ddf-a53d-736de4c013a4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1392 microversion: 2.1 time: 0.774532 Oct 11 20:02:30.271598 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2194/4322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:29 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1392 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:30.284927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a89562ff-8f94-4880-83b5-5c4f81b3f2f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:30.285784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a89562ff-8f94-4880-83b5-5c4f81b3f2f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:30.330431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7b6a27dc-dedc-45d7-aa0c-b435b7252aff tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:30.349814 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7b6a27dc-dedc-45d7-aa0c-b435b7252aff tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.644696 Oct 11 20:02:30.351980 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2129/4323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:29 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:30.364804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4e3ac796-5342-4af8-9503-739dfd0b5f70 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:30.365363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4e3ac796-5342-4af8-9503-739dfd0b5f70 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:30.390699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e3ac796-5342-4af8-9503-739dfd0b5f70 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:30.391207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e3ac796-5342-4af8-9503-739dfd0b5f70 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:30.391739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e3ac796-5342-4af8-9503-739dfd0b5f70 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:30.398899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e3ac796-5342-4af8-9503-739dfd0b5f70 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:30.399518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e3ac796-5342-4af8-9503-739dfd0b5f70 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:30.400135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e3ac796-5342-4af8-9503-739dfd0b5f70 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:30.417022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a89562ff-8f94-4880-83b5-5c4f81b3f2f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:30.424279 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a89562ff-8f94-4880-83b5-5c4f81b3f2f5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1208 microversion: 2.1 time: 0.151301 Oct 11 20:02:30.429048 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2195/4324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:30 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1208 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:30.613428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8c1cdce7-1faa-4876-a954-c40ca777a6c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:30.614780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8c1cdce7-1faa-4876-a954-c40ca777a6c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:30.626449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c1cdce7-1faa-4876-a954-c40ca777a6c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:30.627205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c1cdce7-1faa-4876-a954-c40ca777a6c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:30.627824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c1cdce7-1faa-4876-a954-c40ca777a6c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:30.628693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c1cdce7-1faa-4876-a954-c40ca777a6c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:30.630734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c1cdce7-1faa-4876-a954-c40ca777a6c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:30.631540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c1cdce7-1faa-4876-a954-c40ca777a6c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:30.860507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4e3ac796-5342-4af8-9503-739dfd0b5f70 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:30.870674 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4e3ac796-5342-4af8-9503-739dfd0b5f70 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 0.516746 Oct 11 20:02:30.884213 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2130/4325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:30 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:31.076222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c1cdce7-1faa-4876-a954-c40ca777a6c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:31.088355 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8c1cdce7-1faa-4876-a954-c40ca777a6c6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.478404 Oct 11 20:02:31.089343 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2196/4326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:30 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:31.281545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-40a5e62e-5067-48cf-b7fa-fb831f657832 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:31.282028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-40a5e62e-5067-48cf-b7fa-fb831f657832 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:31.291666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40a5e62e-5067-48cf-b7fa-fb831f657832 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:31.292659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40a5e62e-5067-48cf-b7fa-fb831f657832 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:31.293253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40a5e62e-5067-48cf-b7fa-fb831f657832 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:31.295712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c20bf05-fca4-4eaa-b25e-30647dccdae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:31.295849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c20bf05-fca4-4eaa-b25e-30647dccdae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:31.296919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40a5e62e-5067-48cf-b7fa-fb831f657832 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:31.297571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40a5e62e-5067-48cf-b7fa-fb831f657832 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:31.298333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40a5e62e-5067-48cf-b7fa-fb831f657832 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:31.308808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c20bf05-fca4-4eaa-b25e-30647dccdae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:31.310601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c20bf05-fca4-4eaa-b25e-30647dccdae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:31.312537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c20bf05-fca4-4eaa-b25e-30647dccdae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:31.314269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c20bf05-fca4-4eaa-b25e-30647dccdae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:31.314867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c20bf05-fca4-4eaa-b25e-30647dccdae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:31.316575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c20bf05-fca4-4eaa-b25e-30647dccdae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:31.340595 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-40a5e62e-5067-48cf-b7fa-fb831f657832 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments/5d5cc19d-0bd9-4a0d-ac5e-27d296c098f4" status: 200 len: 194 microversion: 2.20 time: 0.063898 Oct 11 20:02:31.350386 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2131/4327] 10.222.0.27 () {60 vars in 1454 bytes} [Tue Oct 11 20:02:31 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments/5d5cc19d-0bd9-4a0d-ac5e-27d296c098f4 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 20:02:31.376302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-76d8110b-49c3-4a5f-95e2-0759d1ef5707 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:31.377332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-76d8110b-49c3-4a5f-95e2-0759d1ef5707 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:31.389398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76d8110b-49c3-4a5f-95e2-0759d1ef5707 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:31.390409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76d8110b-49c3-4a5f-95e2-0759d1ef5707 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:31.391060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76d8110b-49c3-4a5f-95e2-0759d1ef5707 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:31.392134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76d8110b-49c3-4a5f-95e2-0759d1ef5707 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:31.392830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76d8110b-49c3-4a5f-95e2-0759d1ef5707 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:31.393926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76d8110b-49c3-4a5f-95e2-0759d1ef5707 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:31.702486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c20bf05-fca4-4eaa-b25e-30647dccdae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:31.717171 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c20bf05-fca4-4eaa-b25e-30647dccdae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1392 microversion: 2.1 time: 0.426253 Oct 11 20:02:31.720894 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2197/4328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:31 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1392 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:31.732545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4da9245c-564e-4679-ae29-085a125b0c3f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:31.735588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4da9245c-564e-4679-ae29-085a125b0c3f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:31.750209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4da9245c-564e-4679-ae29-085a125b0c3f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:31.750802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4da9245c-564e-4679-ae29-085a125b0c3f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:31.753524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4da9245c-564e-4679-ae29-085a125b0c3f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:31.755301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4da9245c-564e-4679-ae29-085a125b0c3f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:31.756761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4da9245c-564e-4679-ae29-085a125b0c3f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:31.758291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4da9245c-564e-4679-ae29-085a125b0c3f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:31.965282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-4da9245c-564e-4679-ae29-085a125b0c3f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lazy-loading 'services' on Instance uuid 34e65c53-e164-4255-a2b8-4338069b7e47 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:02:32.010770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-76d8110b-49c3-4a5f-95e2-0759d1ef5707 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:32.024131 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-76d8110b-49c3-4a5f-95e2-0759d1ef5707 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1506 microversion: 2.1 time: 0.651896 Oct 11 20:02:32.031569 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2132/4329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:31 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:32.047267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fd812bf5-8e09-4fa1-b8c7-bdec55e8e86c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:32.048261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fd812bf5-8e09-4fa1-b8c7-bdec55e8e86c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:32.067694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd812bf5-8e09-4fa1-b8c7-bdec55e8e86c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:32.068070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd812bf5-8e09-4fa1-b8c7-bdec55e8e86c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:32.068907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd812bf5-8e09-4fa1-b8c7-bdec55e8e86c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:32.069788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd812bf5-8e09-4fa1-b8c7-bdec55e8e86c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:32.071017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd812bf5-8e09-4fa1-b8c7-bdec55e8e86c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:32.071669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fd812bf5-8e09-4fa1-b8c7-bdec55e8e86c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:32.143036 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4da9245c-564e-4679-ae29-085a125b0c3f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments/5d5cc19d-0bd9-4a0d-ac5e-27d296c098f4" status: 202 len: 0 microversion: 2.20 time: 0.419441 Oct 11 20:02:32.145170 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2198/4330] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Oct 11 20:02:31 2022] DELETE /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments/5d5cc19d-0bd9-4a0d-ac5e-27d296c098f4 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:02:32.156818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f141b51a-828e-4776-93c2-94f3d2b0a349 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:32.157534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f141b51a-828e-4776-93c2-94f3d2b0a349 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:32.188876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f141b51a-828e-4776-93c2-94f3d2b0a349 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:32.191132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f141b51a-828e-4776-93c2-94f3d2b0a349 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:32.191784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f141b51a-828e-4776-93c2-94f3d2b0a349 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:32.197734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f141b51a-828e-4776-93c2-94f3d2b0a349 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:32.206861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f141b51a-828e-4776-93c2-94f3d2b0a349 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:32.211381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f141b51a-828e-4776-93c2-94f3d2b0a349 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:32.218054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fd812bf5-8e09-4fa1-b8c7-bdec55e8e86c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:32.234769 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fd812bf5-8e09-4fa1-b8c7-bdec55e8e86c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1260 microversion: 2.1 time: 0.201836 Oct 11 20:02:32.242833 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2133/4331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:32 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:32.275552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9411ebf9-3668-49e8-b3dd-b0f54ed1c6ee tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:32.276142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9411ebf9-3668-49e8-b3dd-b0f54ed1c6ee tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:32.301892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9411ebf9-3668-49e8-b3dd-b0f54ed1c6ee tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:32.302409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9411ebf9-3668-49e8-b3dd-b0f54ed1c6ee tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:32.303175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9411ebf9-3668-49e8-b3dd-b0f54ed1c6ee tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:32.304117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9411ebf9-3668-49e8-b3dd-b0f54ed1c6ee tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:32.307872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9411ebf9-3668-49e8-b3dd-b0f54ed1c6ee tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:32.308630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9411ebf9-3668-49e8-b3dd-b0f54ed1c6ee tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:33.445883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9411ebf9-3668-49e8-b3dd-b0f54ed1c6ee tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:33.456857 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9411ebf9-3668-49e8-b3dd-b0f54ed1c6ee tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 1.211302 Oct 11 20:02:33.457451 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2134/4332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:32 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:33.481032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1b14ba5d-4c32-4188-b553-b30576d2d328 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:33.483432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1b14ba5d-4c32-4188-b553-b30576d2d328 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:33.502220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b14ba5d-4c32-4188-b553-b30576d2d328 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:33.502708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b14ba5d-4c32-4188-b553-b30576d2d328 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:33.503192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b14ba5d-4c32-4188-b553-b30576d2d328 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:33.503866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b14ba5d-4c32-4188-b553-b30576d2d328 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:33.504334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b14ba5d-4c32-4188-b553-b30576d2d328 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:33.504770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b14ba5d-4c32-4188-b553-b30576d2d328 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:33.517773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f141b51a-828e-4776-93c2-94f3d2b0a349 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:33.529229 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f141b51a-828e-4776-93c2-94f3d2b0a349 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 1.382836 Oct 11 20:02:33.530957 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2199/4333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:32 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:33.562242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ca8d7a89-596b-4c6f-bfc4-c934f9b76453 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:33.567541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ca8d7a89-596b-4c6f-bfc4-c934f9b76453 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:33.580682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca8d7a89-596b-4c6f-bfc4-c934f9b76453 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:33.589473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca8d7a89-596b-4c6f-bfc4-c934f9b76453 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:33.590220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca8d7a89-596b-4c6f-bfc4-c934f9b76453 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:33.599537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca8d7a89-596b-4c6f-bfc4-c934f9b76453 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:33.600469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca8d7a89-596b-4c6f-bfc4-c934f9b76453 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:33.601129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca8d7a89-596b-4c6f-bfc4-c934f9b76453 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:33.620939 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1b14ba5d-4c32-4188-b553-b30576d2d328 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.162394 Oct 11 20:02:33.626366 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2135/4334] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 20:02:33 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:02:33.635644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0c8693a5-f7ce-4c7f-9dca-72fdd1ef4bdb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:33.639692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0c8693a5-f7ce-4c7f-9dca-72fdd1ef4bdb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:33.657445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c8693a5-f7ce-4c7f-9dca-72fdd1ef4bdb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:33.658213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c8693a5-f7ce-4c7f-9dca-72fdd1ef4bdb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:33.658924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c8693a5-f7ce-4c7f-9dca-72fdd1ef4bdb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:33.659869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c8693a5-f7ce-4c7f-9dca-72fdd1ef4bdb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:33.660788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c8693a5-f7ce-4c7f-9dca-72fdd1ef4bdb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:33.661658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c8693a5-f7ce-4c7f-9dca-72fdd1ef4bdb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:34.317882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0c8693a5-f7ce-4c7f-9dca-72fdd1ef4bdb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:34.343854 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0c8693a5-f7ce-4c7f-9dca-72fdd1ef4bdb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1506 microversion: 2.1 time: 0.712129 Oct 11 20:02:34.346738 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2136/4335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:33 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1506 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:34.360070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ca8d7a89-596b-4c6f-bfc4-c934f9b76453 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:34.363826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62d3317c-4412-4e4b-aaf9-1b991095e8e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:34.364663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-62d3317c-4412-4e4b-aaf9-1b991095e8e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:34.374838 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ca8d7a89-596b-4c6f-bfc4-c934f9b76453 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1392 microversion: 2.1 time: 0.822373 Oct 11 20:02:34.376151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3317c-4412-4e4b-aaf9-1b991095e8e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:34.376639 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2200/4336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:33 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1392 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:34.378338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3317c-4412-4e4b-aaf9-1b991095e8e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:34.379759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3317c-4412-4e4b-aaf9-1b991095e8e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:34.380548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3317c-4412-4e4b-aaf9-1b991095e8e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:34.383463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3317c-4412-4e4b-aaf9-1b991095e8e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:34.384170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62d3317c-4412-4e4b-aaf9-1b991095e8e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:34.485812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1a480209-fa43-49d4-88f5-2a6f59c2d76d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:34.487038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1a480209-fa43-49d4-88f5-2a6f59c2d76d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:34.509307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a480209-fa43-49d4-88f5-2a6f59c2d76d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:34.510479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a480209-fa43-49d4-88f5-2a6f59c2d76d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:34.511414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a480209-fa43-49d4-88f5-2a6f59c2d76d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:34.516402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a480209-fa43-49d4-88f5-2a6f59c2d76d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:34.518250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a480209-fa43-49d4-88f5-2a6f59c2d76d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:34.520347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a480209-fa43-49d4-88f5-2a6f59c2d76d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:34.584629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-62d3317c-4412-4e4b-aaf9-1b991095e8e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:34.598280 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-62d3317c-4412-4e4b-aaf9-1b991095e8e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1308 microversion: 2.1 time: 0.250186 Oct 11 20:02:34.599065 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2137/4337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:34 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1308 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:34.610102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93d159de-31a6-4ef6-9228-d765d05ba80f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:34.613101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-93d159de-31a6-4ef6-9228-d765d05ba80f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:34.647131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d159de-31a6-4ef6-9228-d765d05ba80f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:34.650867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d159de-31a6-4ef6-9228-d765d05ba80f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:34.651475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d159de-31a6-4ef6-9228-d765d05ba80f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:34.652317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d159de-31a6-4ef6-9228-d765d05ba80f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:34.652869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d159de-31a6-4ef6-9228-d765d05ba80f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:34.653373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93d159de-31a6-4ef6-9228-d765d05ba80f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.023715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1a480209-fa43-49d4-88f5-2a6f59c2d76d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:35.043423 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1a480209-fa43-49d4-88f5-2a6f59c2d76d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.564190 Oct 11 20:02:35.060266 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2201/4338] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:34 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:35.083143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3b72d867-c3e7-4997-8581-bbd9e0bd6164 req-fc8e361b-6f10-491d-bc23-fa4ce1f4ab42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d6cd57-1120-449b-ba44-2066fb17c6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a2241e88-c9e7-4296-bc6f-97e0146faa66"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:35.092729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-93d159de-31a6-4ef6-9228-d765d05ba80f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:35.108424 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93d159de-31a6-4ef6-9228-d765d05ba80f tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 0.504894 Oct 11 20:02:35.109324 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2138/4339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:34 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:35.115365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1b1d3cda-6475-47df-a373-cfdc659d3596 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:35.118264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1b1d3cda-6475-47df-a373-cfdc659d3596 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:35.126829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3b72d867-c3e7-4997-8581-bbd9e0bd6164 req-fc8e361b-6f10-491d-bc23-fa4ce1f4ab42 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.127383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3b72d867-c3e7-4997-8581-bbd9e0bd6164 req-fc8e361b-6f10-491d-bc23-fa4ce1f4ab42 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.128035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3b72d867-c3e7-4997-8581-bbd9e0bd6164 req-fc8e361b-6f10-491d-bc23-fa4ce1f4ab42 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.130972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b1d3cda-6475-47df-a373-cfdc659d3596 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.131805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b1d3cda-6475-47df-a373-cfdc659d3596 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.133671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b1d3cda-6475-47df-a373-cfdc659d3596 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.137151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b1d3cda-6475-47df-a373-cfdc659d3596 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.137829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b1d3cda-6475-47df-a373-cfdc659d3596 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.138281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b1d3cda-6475-47df-a373-cfdc659d3596 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.160764 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3b72d867-c3e7-4997-8581-bbd9e0bd6164 req-fc8e361b-6f10-491d-bc23-fa4ce1f4ab42 service nova] Creating event network-vif-plugged:a2241e88-c9e7-4296-bc6f-97e0146faa66 for instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 on n-h2-860864-3 Oct 11 20:02:35.166421 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3b72d867-c3e7-4997-8581-bbd9e0bd6164 req-fc8e361b-6f10-491d-bc23-fa4ce1f4ab42 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104542 Oct 11 20:02:35.167086 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2202/4340] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:35.240288 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1b1d3cda-6475-47df-a373-cfdc659d3596 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129337 Oct 11 20:02:35.240882 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2139/4341] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 20:02:35 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:02:35.373396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40fc989a-b404-4ddb-902e-86f2666a7650 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:35.374319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-40fc989a-b404-4ddb-902e-86f2666a7650 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:35.392750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40fc989a-b404-4ddb-902e-86f2666a7650 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.393348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40fc989a-b404-4ddb-902e-86f2666a7650 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.393879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40fc989a-b404-4ddb-902e-86f2666a7650 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.394693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40fc989a-b404-4ddb-902e-86f2666a7650 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.395396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40fc989a-b404-4ddb-902e-86f2666a7650 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.396005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40fc989a-b404-4ddb-902e-86f2666a7650 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.404879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4f56ca76-dbc6-44d6-9df1-08cdd21f2d6c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:35.407526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4f56ca76-dbc6-44d6-9df1-08cdd21f2d6c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:35.419740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f56ca76-dbc6-44d6-9df1-08cdd21f2d6c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.420693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f56ca76-dbc6-44d6-9df1-08cdd21f2d6c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.421909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f56ca76-dbc6-44d6-9df1-08cdd21f2d6c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.423268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f56ca76-dbc6-44d6-9df1-08cdd21f2d6c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.423887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f56ca76-dbc6-44d6-9df1-08cdd21f2d6c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.424563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f56ca76-dbc6-44d6-9df1-08cdd21f2d6c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.467940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:35.686208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-40fc989a-b404-4ddb-902e-86f2666a7650 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:35.698717 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40fc989a-b404-4ddb-902e-86f2666a7650 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 200 len: 1509 microversion: 2.1 time: 0.329955 Oct 11 20:02:35.702414 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2203/4342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:35 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:35.719061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a6c3459c-752c-44b7-96e0-94e3c10f43e0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:35.720508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a6c3459c-752c-44b7-96e0-94e3c10f43e0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:35.734425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c3459c-752c-44b7-96e0-94e3c10f43e0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.735360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c3459c-752c-44b7-96e0-94e3c10f43e0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.737418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c3459c-752c-44b7-96e0-94e3c10f43e0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.739455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c3459c-752c-44b7-96e0-94e3c10f43e0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.740139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c3459c-752c-44b7-96e0-94e3c10f43e0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.740772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6c3459c-752c-44b7-96e0-94e3c10f43e0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.744841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4f56ca76-dbc6-44d6-9df1-08cdd21f2d6c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:35.765419 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4f56ca76-dbc6-44d6-9df1-08cdd21f2d6c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1392 microversion: 2.1 time: 0.358223 Oct 11 20:02:35.770028 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2140/4343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:35 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1392 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:35.774111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:35.781301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9737f37-ec11-4492-8119-84b5e73b944e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:35.798983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f9737f37-ec11-4492-8119-84b5e73b944e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:35.826838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9737f37-ec11-4492-8119-84b5e73b944e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.830976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9737f37-ec11-4492-8119-84b5e73b944e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.837690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9737f37-ec11-4492-8119-84b5e73b944e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:35.840416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9737f37-ec11-4492-8119-84b5e73b944e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:35.841537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9737f37-ec11-4492-8119-84b5e73b944e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:35.844138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9737f37-ec11-4492-8119-84b5e73b944e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.209741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a6c3459c-752c-44b7-96e0-94e3c10f43e0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:36.230466 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a6c3459c-752c-44b7-96e0-94e3c10f43e0 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1308 microversion: 2.1 time: 0.525450 Oct 11 20:02:36.234239 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2204/4344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:35 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1308 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:36.244430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4722e82a-377e-4d1a-94f1-2a6b58d96dd5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:36.245586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4722e82a-377e-4d1a-94f1-2a6b58d96dd5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:36.258741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4722e82a-377e-4d1a-94f1-2a6b58d96dd5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.259683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4722e82a-377e-4d1a-94f1-2a6b58d96dd5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.260279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4722e82a-377e-4d1a-94f1-2a6b58d96dd5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.261182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4722e82a-377e-4d1a-94f1-2a6b58d96dd5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.262162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4722e82a-377e-4d1a-94f1-2a6b58d96dd5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.262961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4722e82a-377e-4d1a-94f1-2a6b58d96dd5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.290232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f9737f37-ec11-4492-8119-84b5e73b944e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:36.302221 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9737f37-ec11-4492-8119-84b5e73b944e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.530529 Oct 11 20:02:36.303341 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2141/4345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:35 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:36.311642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e8dab38-c1db-4752-91bd-b9237d2cb193 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:36.316754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7e8dab38-c1db-4752-91bd-b9237d2cb193 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:36.347015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e8dab38-c1db-4752-91bd-b9237d2cb193 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.359376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e8dab38-c1db-4752-91bd-b9237d2cb193 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.360106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e8dab38-c1db-4752-91bd-b9237d2cb193 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.361060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e8dab38-c1db-4752-91bd-b9237d2cb193 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.361693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e8dab38-c1db-4752-91bd-b9237d2cb193 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.362289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e8dab38-c1db-4752-91bd-b9237d2cb193 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.573458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4722e82a-377e-4d1a-94f1-2a6b58d96dd5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:36.582229 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4722e82a-377e-4d1a-94f1-2a6b58d96dd5 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.345712 Oct 11 20:02:36.606614 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2205/4346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:36 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:36.612520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3d6550ad-411f-4f00-aa85-594d38e825af tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:36.616521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3d6550ad-411f-4f00-aa85-594d38e825af tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:36.626764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7e8dab38-c1db-4752-91bd-b9237d2cb193 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:36.628201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d6550ad-411f-4f00-aa85-594d38e825af tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.629140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d6550ad-411f-4f00-aa85-594d38e825af tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.629938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d6550ad-411f-4f00-aa85-594d38e825af tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.631233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d6550ad-411f-4f00-aa85-594d38e825af tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.631907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d6550ad-411f-4f00-aa85-594d38e825af tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.633732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d6550ad-411f-4f00-aa85-594d38e825af tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.635679 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e8dab38-c1db-4752-91bd-b9237d2cb193 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 0.330966 Oct 11 20:02:36.650944 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2142/4347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:36 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:36.656355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f17a9a26-1011-4b40-9b3c-68ff7f7b9795 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:36.657252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f17a9a26-1011-4b40-9b3c-68ff7f7b9795 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:36.664723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f17a9a26-1011-4b40-9b3c-68ff7f7b9795 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.665764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f17a9a26-1011-4b40-9b3c-68ff7f7b9795 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.666412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f17a9a26-1011-4b40-9b3c-68ff7f7b9795 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.667337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f17a9a26-1011-4b40-9b3c-68ff7f7b9795 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.667980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f17a9a26-1011-4b40-9b3c-68ff7f7b9795 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.668589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f17a9a26-1011-4b40-9b3c-68ff7f7b9795 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.688266 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3d6550ad-411f-4f00-aa85-594d38e825af tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079945 Oct 11 20:02:36.696029 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2206/4348] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 20:02:36 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:02:36.796270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3c73b035-7f55-485a-9bcb-335d198cac2d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:36.797211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3c73b035-7f55-485a-9bcb-335d198cac2d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:36.805547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c73b035-7f55-485a-9bcb-335d198cac2d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.806555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c73b035-7f55-485a-9bcb-335d198cac2d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.807186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c73b035-7f55-485a-9bcb-335d198cac2d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.808180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c73b035-7f55-485a-9bcb-335d198cac2d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.808793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c73b035-7f55-485a-9bcb-335d198cac2d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.809466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c73b035-7f55-485a-9bcb-335d198cac2d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.843585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f17a9a26-1011-4b40-9b3c-68ff7f7b9795 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:36.852041 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f17a9a26-1011-4b40-9b3c-68ff7f7b9795 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.199941 Oct 11 20:02:36.852634 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2143/4349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:36 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:36.880347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f35c8237-fa20-48b9-8c8d-8a5773319fa3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:36.881300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f35c8237-fa20-48b9-8c8d-8a5773319fa3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:36.889781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f35c8237-fa20-48b9-8c8d-8a5773319fa3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.890664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f35c8237-fa20-48b9-8c8d-8a5773319fa3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.891395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f35c8237-fa20-48b9-8c8d-8a5773319fa3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:36.892303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f35c8237-fa20-48b9-8c8d-8a5773319fa3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:36.893090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f35c8237-fa20-48b9-8c8d-8a5773319fa3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:36.894398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f35c8237-fa20-48b9-8c8d-8a5773319fa3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:37.144841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3c73b035-7f55-485a-9bcb-335d198cac2d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:37.178445 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3c73b035-7f55-485a-9bcb-335d198cac2d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1565 microversion: 2.1 time: 0.387553 Oct 11 20:02:37.204527 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2207/4350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:36 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1565 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:37.211223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f35c8237-fa20-48b9-8c8d-8a5773319fa3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:37.215668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-62dc7a29-65c9-48fd-babb-07e7a0560e74 req-241c5449-0d60-4e38-a61b-72a24a296f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e1df4-1fb8-4bbc-b6f4-59053268bb29", "name": "network-vif-unplugged", "status": "completed", "tag": "971318c7-cccd-4204-b777-6b0137441143"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:37.223223 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f35c8237-fa20-48b9-8c8d-8a5773319fa3 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.351176 Oct 11 20:02:37.224149 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2144/4351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:36 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:37.260913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-62dc7a29-65c9-48fd-babb-07e7a0560e74 req-241c5449-0d60-4e38-a61b-72a24a296f88 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:37.261455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-62dc7a29-65c9-48fd-babb-07e7a0560e74 req-241c5449-0d60-4e38-a61b-72a24a296f88 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:37.261900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-62dc7a29-65c9-48fd-babb-07e7a0560e74 req-241c5449-0d60-4e38-a61b-72a24a296f88 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:37.263293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4f64c919-b32d-4100-9b7e-e089ecea9a55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:37.267098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4f64c919-b32d-4100-9b7e-e089ecea9a55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:37.282110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.compute.server_external_events [req-62dc7a29-65c9-48fd-babb-07e7a0560e74 req-241c5449-0d60-4e38-a61b-72a24a296f88 service nova] Unable to find a host for instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29. Dropping event network-vif-unplugged {{(pid=126956) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 20:02:37.285136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:37.287306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f64c919-b32d-4100-9b7e-e089ecea9a55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:37.289350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f64c919-b32d-4100-9b7e-e089ecea9a55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:37.290960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f64c919-b32d-4100-9b7e-e089ecea9a55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:37.291901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f64c919-b32d-4100-9b7e-e089ecea9a55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:37.292523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f64c919-b32d-4100-9b7e-e089ecea9a55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:37.293226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f64c919-b32d-4100-9b7e-e089ecea9a55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:37.296904 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-62dc7a29-65c9-48fd-babb-07e7a0560e74 req-241c5449-0d60-4e38-a61b-72a24a296f88 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.085414 Oct 11 20:02:37.299359 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2208/4352] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 20:02:37.309822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6a4b35fa-d58e-4ce0-8f58-67e3d128d2d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:37.313506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6a4b35fa-d58e-4ce0-8f58-67e3d128d2d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:37.332275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a4b35fa-d58e-4ce0-8f58-67e3d128d2d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:37.333240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a4b35fa-d58e-4ce0-8f58-67e3d128d2d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:37.334130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a4b35fa-d58e-4ce0-8f58-67e3d128d2d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:37.335925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a4b35fa-d58e-4ce0-8f58-67e3d128d2d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:37.336676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a4b35fa-d58e-4ce0-8f58-67e3d128d2d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:37.337975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a4b35fa-d58e-4ce0-8f58-67e3d128d2d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:37.667510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6a4b35fa-d58e-4ce0-8f58-67e3d128d2d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:37.677038 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6a4b35fa-d58e-4ce0-8f58-67e3d128d2d2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.376397 Oct 11 20:02:37.681888 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2209/4353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:37 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:37.698932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-124245fb-4dd4-4bab-822e-d654d54fc769 req-a0338f16-ca74-4031-9924-e8277eeedae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061c597d-8847-4f24-bc20-3cf90b707636", "tag": "049d046c-17bb-428f-8755-d077a517cd7a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:37.735179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-124245fb-4dd4-4bab-822e-d654d54fc769 req-a0338f16-ca74-4031-9924-e8277eeedae0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:37.739519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-124245fb-4dd4-4bab-822e-d654d54fc769 req-a0338f16-ca74-4031-9924-e8277eeedae0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:37.741439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4f64c919-b32d-4100-9b7e-e089ecea9a55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:37.743097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-124245fb-4dd4-4bab-822e-d654d54fc769 req-a0338f16-ca74-4031-9924-e8277eeedae0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:37.757126 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4f64c919-b32d-4100-9b7e-e089ecea9a55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1565 microversion: 2.1 time: 0.521510 Oct 11 20:02:37.757738 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-124245fb-4dd4-4bab-822e-d654d54fc769 req-a0338f16-ca74-4031-9924-e8277eeedae0 service nova] Creating event network-changed:049d046c-17bb-428f-8755-d077a517cd7a for instance 061c597d-8847-4f24-bc20-3cf90b707636 on n-h1-860864-3 Oct 11 20:02:37.769193 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2145/4354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:37 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1565 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:37.773678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fbe38895-a083-4c41-a9f6-68089a3a5db9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:37.774658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fbe38895-a083-4c41-a9f6-68089a3a5db9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:37.785139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbe38895-a083-4c41-a9f6-68089a3a5db9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:37.786433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbe38895-a083-4c41-a9f6-68089a3a5db9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:37.789205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbe38895-a083-4c41-a9f6-68089a3a5db9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:37.791463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbe38895-a083-4c41-a9f6-68089a3a5db9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:37.792174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbe38895-a083-4c41-a9f6-68089a3a5db9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:37.796184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fbe38895-a083-4c41-a9f6-68089a3a5db9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:37.798165 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-124245fb-4dd4-4bab-822e-d654d54fc769 req-a0338f16-ca74-4031-9924-e8277eeedae0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109282 Oct 11 20:02:37.800394 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2210/4355] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:37.814927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5c72e728-4ee1-46f8-aae0-07b01d311b40 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:37.815842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5c72e728-4ee1-46f8-aae0-07b01d311b40 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:37.835327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c72e728-4ee1-46f8-aae0-07b01d311b40 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:37.837008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c72e728-4ee1-46f8-aae0-07b01d311b40 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:37.837665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c72e728-4ee1-46f8-aae0-07b01d311b40 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:37.838678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c72e728-4ee1-46f8-aae0-07b01d311b40 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:37.840697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c72e728-4ee1-46f8-aae0-07b01d311b40 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:37.841383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c72e728-4ee1-46f8-aae0-07b01d311b40 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:38.221898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fbe38895-a083-4c41-a9f6-68089a3a5db9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:38.236330 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fbe38895-a083-4c41-a9f6-68089a3a5db9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1308 microversion: 2.1 time: 0.476152 Oct 11 20:02:38.238607 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2146/4356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:37 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1308 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:38.248568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-59ed2def-c536-42c3-abe4-18cee538a2e6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:38.251355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-59ed2def-c536-42c3-abe4-18cee538a2e6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:38.275456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ed2def-c536-42c3-abe4-18cee538a2e6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:38.278894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ed2def-c536-42c3-abe4-18cee538a2e6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:38.279694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ed2def-c536-42c3-abe4-18cee538a2e6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:38.280672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ed2def-c536-42c3-abe4-18cee538a2e6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:38.281365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ed2def-c536-42c3-abe4-18cee538a2e6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:38.290471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59ed2def-c536-42c3-abe4-18cee538a2e6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:38.439684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5c72e728-4ee1-46f8-aae0-07b01d311b40 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:38.451330 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5c72e728-4ee1-46f8-aae0-07b01d311b40 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.649254 Oct 11 20:02:38.461896 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2211/4357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:37 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:38.477953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9ee41112-18c6-42f6-a427-68dfcc42f867 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:38.483157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9ee41112-18c6-42f6-a427-68dfcc42f867 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:38.490306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee41112-18c6-42f6-a427-68dfcc42f867 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:38.491113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee41112-18c6-42f6-a427-68dfcc42f867 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:38.493017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee41112-18c6-42f6-a427-68dfcc42f867 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:38.495722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee41112-18c6-42f6-a427-68dfcc42f867 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:38.498165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee41112-18c6-42f6-a427-68dfcc42f867 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:38.500107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ee41112-18c6-42f6-a427-68dfcc42f867 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:38.546930 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9ee41112-18c6-42f6-a427-68dfcc42f867 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083419 Oct 11 20:02:38.552483 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2212/4358] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 20:02:38 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:02:38.559959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3c0c4014-084c-485c-a1a4-229332ba0c84 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:38.567527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c0c4014-084c-485c-a1a4-229332ba0c84 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:38.568433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c0c4014-084c-485c-a1a4-229332ba0c84 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:38.569060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c0c4014-084c-485c-a1a4-229332ba0c84 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:38.607968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3c0c4014-084c-485c-a1a4-229332ba0c84 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Going to try to stop instance {{(pid=126956) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 20:02:38.710091 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3c0c4014-084c-485c-a1a4-229332ba0c84 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.155137 Oct 11 20:02:38.715819 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2213/4359] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:02:38 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:02:38.760735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aaa3c7e3-004c-4d05-8a1d-0696ae591e40 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:38.765224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aaa3c7e3-004c-4d05-8a1d-0696ae591e40 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:38.774445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-59ed2def-c536-42c3-abe4-18cee538a2e6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:38.784700 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-59ed2def-c536-42c3-abe4-18cee538a2e6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 0.544005 Oct 11 20:02:38.785688 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2147/4360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:38 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:38.791055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaa3c7e3-004c-4d05-8a1d-0696ae591e40 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:38.791570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaa3c7e3-004c-4d05-8a1d-0696ae591e40 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:38.792014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaa3c7e3-004c-4d05-8a1d-0696ae591e40 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:38.795567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaa3c7e3-004c-4d05-8a1d-0696ae591e40 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:38.801048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaa3c7e3-004c-4d05-8a1d-0696ae591e40 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:38.801731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aaa3c7e3-004c-4d05-8a1d-0696ae591e40 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:39.104606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aaa3c7e3-004c-4d05-8a1d-0696ae591e40 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:39.115108 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aaa3c7e3-004c-4d05-8a1d-0696ae591e40 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 0.391188 Oct 11 20:02:39.117164 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2214/4361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:38 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:39.265518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6cb49fa2-a1c3-42c1-8604-cb1715cad815 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:39.266256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6cb49fa2-a1c3-42c1-8604-cb1715cad815 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:39.284693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cb49fa2-a1c3-42c1-8604-cb1715cad815 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:39.285202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cb49fa2-a1c3-42c1-8604-cb1715cad815 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:39.285650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cb49fa2-a1c3-42c1-8604-cb1715cad815 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:39.286367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cb49fa2-a1c3-42c1-8604-cb1715cad815 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:39.286866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cb49fa2-a1c3-42c1-8604-cb1715cad815 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:39.287296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cb49fa2-a1c3-42c1-8604-cb1715cad815 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:39.353492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-252d035e-631d-429d-aafc-8e6320c60b5b req-7d303b17-be1a-495d-a717-14b3347f1b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ff88c4-2697-4489-a684-d48f009037c5", "name": "network-vif-plugged", "status": "completed", "tag": "2051ef06-bdbf-4184-a72f-084b247eb5cf"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:39.381675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-252d035e-631d-429d-aafc-8e6320c60b5b req-7d303b17-be1a-495d-a717-14b3347f1b7c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:39.381675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-252d035e-631d-429d-aafc-8e6320c60b5b req-7d303b17-be1a-495d-a717-14b3347f1b7c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:39.381675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-252d035e-631d-429d-aafc-8e6320c60b5b req-7d303b17-be1a-495d-a717-14b3347f1b7c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:39.394211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:39.411642 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-252d035e-631d-429d-aafc-8e6320c60b5b req-7d303b17-be1a-495d-a717-14b3347f1b7c service nova] Creating event network-vif-plugged:2051ef06-bdbf-4184-a72f-084b247eb5cf for instance a1ff88c4-2697-4489-a684-d48f009037c5 on n-h1-860864-3 Oct 11 20:02:39.428229 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-252d035e-631d-429d-aafc-8e6320c60b5b req-7d303b17-be1a-495d-a717-14b3347f1b7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078414 Oct 11 20:02:39.431402 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2215/4362] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:02:39.487924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9b336e0d-5147-4ab6-957d-03865bf50a29 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:39.488584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9b336e0d-5147-4ab6-957d-03865bf50a29 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:39.505577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b336e0d-5147-4ab6-957d-03865bf50a29 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:39.506809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b336e0d-5147-4ab6-957d-03865bf50a29 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:39.508051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b336e0d-5147-4ab6-957d-03865bf50a29 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:39.511030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b336e0d-5147-4ab6-957d-03865bf50a29 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:39.516724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b336e0d-5147-4ab6-957d-03865bf50a29 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:39.517398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b336e0d-5147-4ab6-957d-03865bf50a29 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:39.748804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6cb49fa2-a1c3-42c1-8604-cb1715cad815 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:39.760338 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6cb49fa2-a1c3-42c1-8604-cb1715cad815 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1308 microversion: 2.1 time: 0.495500 Oct 11 20:02:39.760971 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2148/4363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:39 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:39.780306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0d3f514-6f4e-4d75-ab88-a417e779e9b1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:39.783268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e0d3f514-6f4e-4d75-ab88-a417e779e9b1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:39.797432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0d3f514-6f4e-4d75-ab88-a417e779e9b1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:39.798182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0d3f514-6f4e-4d75-ab88-a417e779e9b1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:39.798865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0d3f514-6f4e-4d75-ab88-a417e779e9b1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:39.800104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0d3f514-6f4e-4d75-ab88-a417e779e9b1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:39.801152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0d3f514-6f4e-4d75-ab88-a417e779e9b1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:39.802419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0d3f514-6f4e-4d75-ab88-a417e779e9b1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:39.853682 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e0d3f514-6f4e-4d75-ab88-a417e779e9b1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085943 Oct 11 20:02:39.855238 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2149/4364] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 20:02:39 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:02:39.861556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0bf9aa1-6d16-48c0-8e54-e9296eb1a481 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:39.863562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a0bf9aa1-6d16-48c0-8e54-e9296eb1a481 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:39.876362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0bf9aa1-6d16-48c0-8e54-e9296eb1a481 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:39.877751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0bf9aa1-6d16-48c0-8e54-e9296eb1a481 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:39.879636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0bf9aa1-6d16-48c0-8e54-e9296eb1a481 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:39.880705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0bf9aa1-6d16-48c0-8e54-e9296eb1a481 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:39.881400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0bf9aa1-6d16-48c0-8e54-e9296eb1a481 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:39.884808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0bf9aa1-6d16-48c0-8e54-e9296eb1a481 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:39.908147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9b336e0d-5147-4ab6-957d-03865bf50a29 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:39.919061 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9b336e0d-5147-4ab6-957d-03865bf50a29 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.435537 Oct 11 20:02:39.923439 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2216/4365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:39 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:40.143391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-772edcfa-bd7e-403e-825d-d07427fa9714 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:40.144256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-772edcfa-bd7e-403e-825d-d07427fa9714 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:40.153631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-772edcfa-bd7e-403e-825d-d07427fa9714 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:40.167334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-772edcfa-bd7e-403e-825d-d07427fa9714 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:40.168105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-772edcfa-bd7e-403e-825d-d07427fa9714 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:40.169080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-772edcfa-bd7e-403e-825d-d07427fa9714 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:40.169738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-772edcfa-bd7e-403e-825d-d07427fa9714 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:40.170358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-772edcfa-bd7e-403e-825d-d07427fa9714 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:40.424559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:40.461809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a0bf9aa1-6d16-48c0-8e54-e9296eb1a481 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:40.480586 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a0bf9aa1-6d16-48c0-8e54-e9296eb1a481 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 0.621047 Oct 11 20:02:40.496496 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2150/4366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:39 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:40.614657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-772edcfa-bd7e-403e-825d-d07427fa9714 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:40.626173 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-772edcfa-bd7e-403e-825d-d07427fa9714 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 0.486394 Oct 11 20:02:40.627401 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2217/4367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:40 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:40.785295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-223dd0db-2196-405e-98cf-2f1244bfb82c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:40.785933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-223dd0db-2196-405e-98cf-2f1244bfb82c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:40.797080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-223dd0db-2196-405e-98cf-2f1244bfb82c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:40.799123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-223dd0db-2196-405e-98cf-2f1244bfb82c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:40.799880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-223dd0db-2196-405e-98cf-2f1244bfb82c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:40.804941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-223dd0db-2196-405e-98cf-2f1244bfb82c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:40.810890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-223dd0db-2196-405e-98cf-2f1244bfb82c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:40.811641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-223dd0db-2196-405e-98cf-2f1244bfb82c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:40.866981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a3e7e662-b2b1-4575-98c8-acf824e7d6a9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:40.869863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a3e7e662-b2b1-4575-98c8-acf824e7d6a9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:40.878871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3e7e662-b2b1-4575-98c8-acf824e7d6a9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:40.879922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3e7e662-b2b1-4575-98c8-acf824e7d6a9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:40.881066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3e7e662-b2b1-4575-98c8-acf824e7d6a9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:40.883051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3e7e662-b2b1-4575-98c8-acf824e7d6a9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:40.883898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3e7e662-b2b1-4575-98c8-acf824e7d6a9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:40.884572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3e7e662-b2b1-4575-98c8-acf824e7d6a9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:40.954284 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a3e7e662-b2b1-4575-98c8-acf824e7d6a9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.090902 Oct 11 20:02:40.960781 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2218/4368] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 20:02:40 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:40.966569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-95179cd6-912e-412d-bc7e-a488c1ced8f6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:40.967722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-95179cd6-912e-412d-bc7e-a488c1ced8f6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:40.977022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95179cd6-912e-412d-bc7e-a488c1ced8f6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:40.977762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95179cd6-912e-412d-bc7e-a488c1ced8f6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:40.978418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95179cd6-912e-412d-bc7e-a488c1ced8f6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:40.979339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95179cd6-912e-412d-bc7e-a488c1ced8f6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:40.980091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95179cd6-912e-412d-bc7e-a488c1ced8f6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:40.980698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-95179cd6-912e-412d-bc7e-a488c1ced8f6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:41.032891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-223dd0db-2196-405e-98cf-2f1244bfb82c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:41.047038 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-223dd0db-2196-405e-98cf-2f1244bfb82c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1308 microversion: 2.1 time: 0.266882 Oct 11 20:02:41.048819 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2151/4369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:40 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:41.091280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9f3938c3-e3e3-4737-9c8b-054a24848085 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:41.091873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9f3938c3-e3e3-4737-9c8b-054a24848085 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:41.098553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f3938c3-e3e3-4737-9c8b-054a24848085 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:41.099145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f3938c3-e3e3-4737-9c8b-054a24848085 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:41.099684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f3938c3-e3e3-4737-9c8b-054a24848085 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:41.101664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f3938c3-e3e3-4737-9c8b-054a24848085 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:41.102207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f3938c3-e3e3-4737-9c8b-054a24848085 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:41.102794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f3938c3-e3e3-4737-9c8b-054a24848085 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:41.131023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9f3938c3-e3e3-4737-9c8b-054a24848085 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:02:41.254764 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9f3938c3-e3e3-4737-9c8b-054a24848085 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 204 len: 0 microversion: 2.20 time: 0.168481 Oct 11 20:02:41.255682 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2152/4370] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:02:41 2022] DELETE /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 20:02:41.265963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:41.266790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:41.275829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:41.276320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:41.276758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:41.278162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:41.278665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:41.279406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:41.689301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-95179cd6-912e-412d-bc7e-a488c1ced8f6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:41.707828 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-95179cd6-912e-412d-bc7e-a488c1ced8f6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1487 microversion: 2.1 time: 0.745727 Oct 11 20:02:41.727890 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2219/4371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:40 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1487 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:41.743907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-efebab37-0c4a-44a4-a986-5be35b28dd98 req-95dfc9f6-a3ad-4870-bf9c-de01cecb9f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ff88c4-2697-4489-a684-d48f009037c5", "name": "network-vif-plugged", "status": "completed", "tag": "92f83f08-a2ce-41d2-8984-80d9e9043973"}, {"server_uuid": "a1ff88c4-2697-4489-a684-d48f009037c5", "name": "network-vif-plugged", "status": "completed", "tag": "012e4f8a-e911-49fd-a922-fb486d482f7d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:41.772297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-efebab37-0c4a-44a4-a986-5be35b28dd98 req-95dfc9f6-a3ad-4870-bf9c-de01cecb9f9f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:41.773348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-efebab37-0c4a-44a4-a986-5be35b28dd98 req-95dfc9f6-a3ad-4870-bf9c-de01cecb9f9f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:41.773882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-efebab37-0c4a-44a4-a986-5be35b28dd98 req-95dfc9f6-a3ad-4870-bf9c-de01cecb9f9f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:41.789809 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-efebab37-0c4a-44a4-a986-5be35b28dd98 req-95dfc9f6-a3ad-4870-bf9c-de01cecb9f9f service nova] Creating event network-vif-plugged:92f83f08-a2ce-41d2-8984-80d9e9043973 for instance a1ff88c4-2697-4489-a684-d48f009037c5 on n-h1-860864-3 Oct 11 20:02:41.790688 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-efebab37-0c4a-44a4-a986-5be35b28dd98 req-95dfc9f6-a3ad-4870-bf9c-de01cecb9f9f service nova] Creating event network-vif-plugged:012e4f8a-e911-49fd-a922-fb486d482f7d for instance a1ff88c4-2697-4489-a684-d48f009037c5 on n-h1-860864-3 Oct 11 20:02:41.796753 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-efebab37-0c4a-44a4-a986-5be35b28dd98 req-95dfc9f6-a3ad-4870-bf9c-de01cecb9f9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067386 Oct 11 20:02:41.797945 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2220/4372] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:41.804017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ea60213-03cb-4c44-af69-83a19895cd7e tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:41.805113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ea60213-03cb-4c44-af69-83a19895cd7e tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:41.812946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ea60213-03cb-4c44-af69-83a19895cd7e tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:41.813890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ea60213-03cb-4c44-af69-83a19895cd7e tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:41.814517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ea60213-03cb-4c44-af69-83a19895cd7e tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:41.815468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ea60213-03cb-4c44-af69-83a19895cd7e tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:41.816078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ea60213-03cb-4c44-af69-83a19895cd7e tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:41.816846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ea60213-03cb-4c44-af69-83a19895cd7e tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:41.885258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:41.894680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:41.896478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:41.898000 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-61c6fc9d-2dee-4366-8399-5cb42a591ca1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.637164 Oct 11 20:02:41.899243 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2153/4373] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:02:41 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:02:41.910245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7cf7ee53-ff37-4c17-9dff-af3456b7075f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:41.912041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7cf7ee53-ff37-4c17-9dff-af3456b7075f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:41.928248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee53-ff37-4c17-9dff-af3456b7075f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:41.928847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee53-ff37-4c17-9dff-af3456b7075f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:41.930149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee53-ff37-4c17-9dff-af3456b7075f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:41.931023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee53-ff37-4c17-9dff-af3456b7075f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:41.931561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee53-ff37-4c17-9dff-af3456b7075f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:41.932061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee53-ff37-4c17-9dff-af3456b7075f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:42.328021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8ea60213-03cb-4c44-af69-83a19895cd7e tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:42.342822 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ea60213-03cb-4c44-af69-83a19895cd7e tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 0.542598 Oct 11 20:02:42.345589 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2221/4374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:41 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:42.351990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7cf7ee53-ff37-4c17-9dff-af3456b7075f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:42.363413 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7cf7ee53-ff37-4c17-9dff-af3456b7075f tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 0.460680 Oct 11 20:02:42.364366 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2154/4375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:41 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:42.374013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e0a72ab-ca92-4f62-b66c-74838086abd6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:42.374917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e0a72ab-ca92-4f62-b66c-74838086abd6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:42.375344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3c34a707-6605-444c-a080-7e6b844c72eb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:42.375962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3c34a707-6605-444c-a080-7e6b844c72eb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:42.388288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c34a707-6605-444c-a080-7e6b844c72eb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:42.389083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c34a707-6605-444c-a080-7e6b844c72eb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:42.389855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c34a707-6605-444c-a080-7e6b844c72eb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:42.390785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c34a707-6605-444c-a080-7e6b844c72eb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:42.391403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c34a707-6605-444c-a080-7e6b844c72eb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:42.392121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c34a707-6605-444c-a080-7e6b844c72eb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:42.394535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e0a72ab-ca92-4f62-b66c-74838086abd6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:42.395877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e0a72ab-ca92-4f62-b66c-74838086abd6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:42.396441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e0a72ab-ca92-4f62-b66c-74838086abd6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:42.398463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:42.400533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e0a72ab-ca92-4f62-b66c-74838086abd6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:42.401414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e0a72ab-ca92-4f62-b66c-74838086abd6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:42.402040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e0a72ab-ca92-4f62-b66c-74838086abd6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:42.435891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:42.521705 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e0a72ab-ca92-4f62-b66c-74838086abd6 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "POST /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84/action" status: 202 len: 0 microversion: 2.1 time: 0.174199 Oct 11 20:02:42.524373 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2222/4376] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:02:42 2022] POST /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:02:42.540051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc7eece4-d296-4a9a-9d7f-a598c9691641 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:42.540890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc7eece4-d296-4a9a-9d7f-a598c9691641 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:42.554957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7eece4-d296-4a9a-9d7f-a598c9691641 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:42.556112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7eece4-d296-4a9a-9d7f-a598c9691641 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:42.556926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7eece4-d296-4a9a-9d7f-a598c9691641 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:42.557922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7eece4-d296-4a9a-9d7f-a598c9691641 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:42.558788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7eece4-d296-4a9a-9d7f-a598c9691641 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:42.559410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7eece4-d296-4a9a-9d7f-a598c9691641 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:43.015242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3c34a707-6605-444c-a080-7e6b844c72eb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:43.031028 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3c34a707-6605-444c-a080-7e6b844c72eb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1308 microversion: 2.1 time: 0.661804 Oct 11 20:02:43.031671 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2155/4377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:42 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1308 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:43.052019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:43.052742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:43.091914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:43.092473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:43.093426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:43.094894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:43.095993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:43.096774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:43.104957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dc7eece4-d296-4a9a-9d7f-a598c9691641 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:43.114124 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc7eece4-d296-4a9a-9d7f-a598c9691641 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1495 microversion: 2.1 time: 0.586003 Oct 11 20:02:43.115453 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2223/4378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:42 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1495 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:43.367596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a3f02c09-c897-4ec0-b232-d4fa38bbc1e4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:43.368347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a3f02c09-c897-4ec0-b232-d4fa38bbc1e4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:43.378032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3f02c09-c897-4ec0-b232-d4fa38bbc1e4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:43.378908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3f02c09-c897-4ec0-b232-d4fa38bbc1e4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:43.384240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3f02c09-c897-4ec0-b232-d4fa38bbc1e4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:43.385495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3f02c09-c897-4ec0-b232-d4fa38bbc1e4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:43.386206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3f02c09-c897-4ec0-b232-d4fa38bbc1e4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:43.386930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3f02c09-c897-4ec0-b232-d4fa38bbc1e4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:43.772239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:43.794908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:43.798690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:43.803196 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a1acfe79-d80a-4e61-9a8c-fa8ebf687330 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1723 microversion: 2.20 time: 0.752730 Oct 11 20:02:43.826193 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2156/4379] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:02:43 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1723 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:02:43.850480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5a8cfb3-bdae-4f3b-bec9-d7a43444d99e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:43.853378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f5a8cfb3-bdae-4f3b-bec9-d7a43444d99e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:43.873930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a8cfb3-bdae-4f3b-bec9-d7a43444d99e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:43.875232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a8cfb3-bdae-4f3b-bec9-d7a43444d99e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:43.879189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a8cfb3-bdae-4f3b-bec9-d7a43444d99e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:43.879939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a8cfb3-bdae-4f3b-bec9-d7a43444d99e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:43.881239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a8cfb3-bdae-4f3b-bec9-d7a43444d99e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:43.881678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5a8cfb3-bdae-4f3b-bec9-d7a43444d99e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:44.360480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a3f02c09-c897-4ec0-b232-d4fa38bbc1e4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:44.368945 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a3f02c09-c897-4ec0-b232-d4fa38bbc1e4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1355 microversion: 2.1 time: 1.005344 Oct 11 20:02:44.369868 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2224/4380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:43 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1355 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:44.381203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d36cb48b-5d27-4749-af75-53b41f9ac037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:44.382242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d36cb48b-5d27-4749-af75-53b41f9ac037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:44.396998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d36cb48b-5d27-4749-af75-53b41f9ac037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:44.398255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d36cb48b-5d27-4749-af75-53b41f9ac037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:44.398900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d36cb48b-5d27-4749-af75-53b41f9ac037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:44.399787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d36cb48b-5d27-4749-af75-53b41f9ac037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:44.400904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d36cb48b-5d27-4749-af75-53b41f9ac037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:44.401505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d36cb48b-5d27-4749-af75-53b41f9ac037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:44.865551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f5a8cfb3-bdae-4f3b-bec9-d7a43444d99e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:44.896737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d36cb48b-5d27-4749-af75-53b41f9ac037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:44.921010 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f5a8cfb3-bdae-4f3b-bec9-d7a43444d99e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 1.090243 Oct 11 20:02:44.946266 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d36cb48b-5d27-4749-af75-53b41f9ac037 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1308 microversion: 2.1 time: 0.550996 Oct 11 20:02:44.946943 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2157/4381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:43 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:44.949127 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2225/4382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:44 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:44.973857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9cbde696-9445-4e3d-a455-b33bf1d7f590 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:44.974598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9cbde696-9445-4e3d-a455-b33bf1d7f590 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:44.984565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbde696-9445-4e3d-a455-b33bf1d7f590 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:44.985108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbde696-9445-4e3d-a455-b33bf1d7f590 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:44.985505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbde696-9445-4e3d-a455-b33bf1d7f590 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:44.986268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbde696-9445-4e3d-a455-b33bf1d7f590 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:44.986763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbde696-9445-4e3d-a455-b33bf1d7f590 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:44.987196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9cbde696-9445-4e3d-a455-b33bf1d7f590 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:45.498772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae3ebeea-035a-4569-b4c1-dd7e754a8310 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83c722e280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-378289357", "description": "tempest-description-770993564"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:45.790013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9cbde696-9445-4e3d-a455-b33bf1d7f590 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:45.805308 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9cbde696-9445-4e3d-a455-b33bf1d7f590 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1495 microversion: 2.1 time: 0.856930 Oct 11 20:02:45.806159 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2158/4383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:44 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1495 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:45.811302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e4027b7-dad7-47fb-8f6d-bb2410d1f117 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:45.812476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e4027b7-dad7-47fb-8f6d-bb2410d1f117 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:45.819131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e4027b7-dad7-47fb-8f6d-bb2410d1f117 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:45.820207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e4027b7-dad7-47fb-8f6d-bb2410d1f117 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:45.820877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e4027b7-dad7-47fb-8f6d-bb2410d1f117 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:45.821780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e4027b7-dad7-47fb-8f6d-bb2410d1f117 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:45.823114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e4027b7-dad7-47fb-8f6d-bb2410d1f117 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:45.824230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e4027b7-dad7-47fb-8f6d-bb2410d1f117 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:45.963179 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae3ebeea-035a-4569-b4c1-dd7e754a8310 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.011497 Oct 11 20:02:45.963907 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2226/4384] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 20:02:44 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:46.162362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e4027b7-dad7-47fb-8f6d-bb2410d1f117 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:46.181342 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e4027b7-dad7-47fb-8f6d-bb2410d1f117 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1565 microversion: 2.1 time: 0.373700 Oct 11 20:02:46.182584 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2159/4385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:45 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1565 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:46.188339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-985d0381-5307-48b6-a967-04288b962f71 req-43d99d20-226e-427f-800c-a83eb2ae1ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061c597d-8847-4f24-bc20-3cf90b707636", "name": "network-vif-plugged", "status": "completed", "tag": "049d046c-17bb-428f-8755-d077a517cd7a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:46.220701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-985d0381-5307-48b6-a967-04288b962f71 req-43d99d20-226e-427f-800c-a83eb2ae1ed3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:46.237603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-985d0381-5307-48b6-a967-04288b962f71 req-43d99d20-226e-427f-800c-a83eb2ae1ed3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:46.239182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-985d0381-5307-48b6-a967-04288b962f71 req-43d99d20-226e-427f-800c-a83eb2ae1ed3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:46.257607 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-985d0381-5307-48b6-a967-04288b962f71 req-43d99d20-226e-427f-800c-a83eb2ae1ed3 service nova] Creating event network-vif-plugged:049d046c-17bb-428f-8755-d077a517cd7a for instance 061c597d-8847-4f24-bc20-3cf90b707636 on n-h1-860864-3 Oct 11 20:02:46.263407 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-985d0381-5307-48b6-a967-04288b962f71 req-43d99d20-226e-427f-800c-a83eb2ae1ed3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079304 Oct 11 20:02:46.268676 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2160/4386] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:46.276365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:46.277393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:46.285784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:46.286838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:46.287537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:46.289231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:46.290348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:46.291076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:46.325579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-56ffbbe5-f759-4bf7-94ea-f076245ffab7 req-6b1d678b-30ff-4e4a-bfc8-badc8be2bae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d6cd57-1120-449b-ba44-2066fb17c6e8", "tag": "a2241e88-c9e7-4296-bc6f-97e0146faa66"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:46.367021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-56ffbbe5-f759-4bf7-94ea-f076245ffab7 req-6b1d678b-30ff-4e4a-bfc8-badc8be2bae6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:46.370849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-56ffbbe5-f759-4bf7-94ea-f076245ffab7 req-6b1d678b-30ff-4e4a-bfc8-badc8be2bae6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:46.372916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-56ffbbe5-f759-4bf7-94ea-f076245ffab7 req-6b1d678b-30ff-4e4a-bfc8-badc8be2bae6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:46.416649 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-56ffbbe5-f759-4bf7-94ea-f076245ffab7 req-6b1d678b-30ff-4e4a-bfc8-badc8be2bae6 service nova] Creating event network-changed:a2241e88-c9e7-4296-bc6f-97e0146faa66 for instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 on n-h2-860864-3 Oct 11 20:02:46.429231 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-56ffbbe5-f759-4bf7-94ea-f076245ffab7 req-6b1d678b-30ff-4e4a-bfc8-badc8be2bae6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.462264 Oct 11 20:02:46.430616 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2227/4387] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:46.437459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a701bd87-01ea-4275-b029-f3edebeb26c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:46.438389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a701bd87-01ea-4275-b029-f3edebeb26c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:46.446097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a701bd87-01ea-4275-b029-f3edebeb26c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:46.448022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a701bd87-01ea-4275-b029-f3edebeb26c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:46.448490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a701bd87-01ea-4275-b029-f3edebeb26c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:46.449350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a701bd87-01ea-4275-b029-f3edebeb26c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:46.449810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a701bd87-01ea-4275-b029-f3edebeb26c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:46.450501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a701bd87-01ea-4275-b029-f3edebeb26c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:46.510692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:46.536602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:46.540321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:46.544198 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c26b7299-3523-413c-9bb2-8d5ce2142fc2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 200 len: 1367 microversion: 2.20 time: 0.273722 Oct 11 20:02:46.544790 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2161/4388] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:02:46 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:02:46.557360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-acf2e63b-b625-49dd-9899-d8ce76d91c83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:46.561846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-acf2e63b-b625-49dd-9899-d8ce76d91c83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:46.574956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf2e63b-b625-49dd-9899-d8ce76d91c83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:46.577062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf2e63b-b625-49dd-9899-d8ce76d91c83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:46.578424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf2e63b-b625-49dd-9899-d8ce76d91c83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:46.581835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf2e63b-b625-49dd-9899-d8ce76d91c83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:46.582640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf2e63b-b625-49dd-9899-d8ce76d91c83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:46.584139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acf2e63b-b625-49dd-9899-d8ce76d91c83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:46.917143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a701bd87-01ea-4275-b029-f3edebeb26c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:46.931124 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a701bd87-01ea-4275-b029-f3edebeb26c3 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1804 microversion: 2.1 time: 0.498321 Oct 11 20:02:46.933241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-acf2e63b-b625-49dd-9899-d8ce76d91c83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:46.941359 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-acf2e63b-b625-49dd-9899-d8ce76d91c83 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 0.394335 Oct 11 20:02:46.953950 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2228/4389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:46 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1804 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:46.960988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa57f050-466e-469c-a204-dd5cb99c4af2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:46.961631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa57f050-466e-469c-a204-dd5cb99c4af2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:46.962135 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2162/4390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:46 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:46.969547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f7707a0-b9ca-442c-9cb0-b480782c141c tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83cc2e4670>, body: {"security_group_rule": {"parent_group_id": "700620c1-d5f3-4ed2-bb6d-08d1e35a7836", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:46.976820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa57f050-466e-469c-a204-dd5cb99c4af2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:46.977512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa57f050-466e-469c-a204-dd5cb99c4af2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:46.977963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa57f050-466e-469c-a204-dd5cb99c4af2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:46.978714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa57f050-466e-469c-a204-dd5cb99c4af2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:46.979226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa57f050-466e-469c-a204-dd5cb99c4af2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:46.979597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa57f050-466e-469c-a204-dd5cb99c4af2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:47.428486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa57f050-466e-469c-a204-dd5cb99c4af2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:47.440687 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa57f050-466e-469c-a204-dd5cb99c4af2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1308 microversion: 2.1 time: 0.485219 Oct 11 20:02:47.440993 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2229/4391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:46 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:47.445624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5e70a747-b059-4eb8-a5d8-b1578d6e3b52 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:47.446230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5e70a747-b059-4eb8-a5d8-b1578d6e3b52 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:47.469101 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f7707a0-b9ca-442c-9cb0-b480782c141c tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.505722 Oct 11 20:02:47.469707 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2163/4392] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 20:02:46 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:47.472684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e70a747-b059-4eb8-a5d8-b1578d6e3b52 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:47.473183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e70a747-b059-4eb8-a5d8-b1578d6e3b52 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:47.473618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e70a747-b059-4eb8-a5d8-b1578d6e3b52 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:47.474317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e70a747-b059-4eb8-a5d8-b1578d6e3b52 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:47.474796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e70a747-b059-4eb8-a5d8-b1578d6e3b52 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:47.475206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e70a747-b059-4eb8-a5d8-b1578d6e3b52 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:47.481255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0520f990-7cf7-43f9-8a92-5d55f1f524a8 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:47.482400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0520f990-7cf7-43f9-8a92-5d55f1f524a8 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:47.489493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0520f990-7cf7-43f9-8a92-5d55f1f524a8 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:47.492022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0520f990-7cf7-43f9-8a92-5d55f1f524a8 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:47.493268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0520f990-7cf7-43f9-8a92-5d55f1f524a8 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:47.496792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0520f990-7cf7-43f9-8a92-5d55f1f524a8 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:47.497276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0520f990-7cf7-43f9-8a92-5d55f1f524a8 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:47.497710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0520f990-7cf7-43f9-8a92-5d55f1f524a8 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:47.536265 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0520f990-7cf7-43f9-8a92-5d55f1f524a8 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5/ips" status: 200 len: 217 microversion: 2.1 time: 0.065497 Oct 11 20:02:47.545827 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2164/4393] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:02:47 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5/ips => generated 217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:47.552512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-942f9e65-b229-48dc-8f74-72c98944b97c tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83cc2e49d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-640274025", "description": "tempest-description-672726127"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:47.934580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5e70a747-b059-4eb8-a5d8-b1578d6e3b52 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:47.954841 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5e70a747-b059-4eb8-a5d8-b1578d6e3b52 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1501 microversion: 2.1 time: 0.511384 Oct 11 20:02:47.957696 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2230/4394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:47 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1501 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:47.976106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5e719ca3-37b0-4d1f-b6a1-a447892e2ef6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:47.977010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5e719ca3-37b0-4d1f-b6a1-a447892e2ef6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:47.984224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e719ca3-37b0-4d1f-b6a1-a447892e2ef6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:47.985429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e719ca3-37b0-4d1f-b6a1-a447892e2ef6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:47.985880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e719ca3-37b0-4d1f-b6a1-a447892e2ef6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:47.986635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e719ca3-37b0-4d1f-b6a1-a447892e2ef6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:47.987268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e719ca3-37b0-4d1f-b6a1-a447892e2ef6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:47.987861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e719ca3-37b0-4d1f-b6a1-a447892e2ef6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.050960 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-942f9e65-b229-48dc-8f74-72c98944b97c tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.503680 Oct 11 20:02:48.051569 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2165/4395] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 20:02:47 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:48.056953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:48.057833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:48.073428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:48.074200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:48.074827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.075734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:48.076330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:48.076896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.108261 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] HTTP exception thrown: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Request method failure captured: Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 HTTP/1.1 Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsBXe_18PED8arFm6RWfRK-01rqcQ6UU9NxZql4qoreJliwp_4b8Su6w4JFmoJ9zNuZomadjtqDz1x2uIqE7--x5GVN2lOX5_zUhL2rqoNqvFzXtD6kYZK3PRbuIWVxNGsSb79mVB2dAkp7qqxN8bWVojWByiubzKJFvBNuTIFUS5k Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e49d03e014e4749b522b6a87372994b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}] Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 27affa75f6a849ba802c1397406b201c Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '34e65c53-e164-4255-a2b8-4338069b7e47'} Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:48.110268 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Returning 404 to user: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c44f6f0e-2dba-464f-b917-560f394a7e42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 404 len: 111 microversion: 2.20 time: 0.059195 Oct 11 20:02:48.117652 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2166/4396] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:02:48 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:02:48.119734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6d13818-c7d2-422e-822e-f60eea1e249e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:48.120180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a6d13818-c7d2-422e-822e-f60eea1e249e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:48.135690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6d13818-c7d2-422e-822e-f60eea1e249e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:48.137138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6d13818-c7d2-422e-822e-f60eea1e249e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:48.137620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6d13818-c7d2-422e-822e-f60eea1e249e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.139139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6d13818-c7d2-422e-822e-f60eea1e249e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:48.140951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6d13818-c7d2-422e-822e-f60eea1e249e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:48.141604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6d13818-c7d2-422e-822e-f60eea1e249e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.371941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5e719ca3-37b0-4d1f-b6a1-a447892e2ef6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:02:48.410762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6d13818-c7d2-422e-822e-f60eea1e249e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:48.421747 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6d13818-c7d2-422e-822e-f60eea1e249e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 0.308229 Oct 11 20:02:48.422685 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2167/4397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:48 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:48.428610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-12f80125-739d-448d-a251-e58f15545094 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:48.429679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-12f80125-739d-448d-a251-e58f15545094 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:48.448782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12f80125-739d-448d-a251-e58f15545094 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:48.449527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12f80125-739d-448d-a251-e58f15545094 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:48.450284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12f80125-739d-448d-a251-e58f15545094 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.451384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12f80125-739d-448d-a251-e58f15545094 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:48.452026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12f80125-739d-448d-a251-e58f15545094 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:48.452462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12f80125-739d-448d-a251-e58f15545094 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.459253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:48.484656 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5e719ca3-37b0-4d1f-b6a1-a447892e2ef6 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 204 len: 0 microversion: 2.1 time: 0.522366 Oct 11 20:02:48.488442 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2231/4398] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:47 2022] DELETE /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:02:48.491986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d86d5094-cb69-4e67-b2fc-795681c65169 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83c71fb790>, body: {"security_group_rule": {"parent_group_id": "f83bbf59-fe73-418b-a4e1-72e1ab6c6a2a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:48.506003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-12f80125-739d-448d-a251-e58f15545094 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:02:48.626843 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-12f80125-739d-448d-a251-e58f15545094 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 204 len: 0 microversion: 2.1 time: 0.201049 Oct 11 20:02:48.628763 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2168/4399] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:48 2022] DELETE /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:02:48.638690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f6fc7af6-93c7-4b76-b3c5-fb35d0f4ceaa tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '.version_select at 0x7f83cc1e79d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:48.670346 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f6fc7af6-93c7-4b76-b3c5-fb35d0f4ceaa tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419696406" status: 204 len: 0 microversion: 2.20 time: 0.039274 Oct 11 20:02:48.675911 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2169/4400] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 20:02:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419696406 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:02:48.683145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9975326c-3e7d-43af-b20c-d39097092bab tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:48.684222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9975326c-3e7d-43af-b20c-d39097092bab tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:48.695933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9975326c-3e7d-43af-b20c-d39097092bab tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:48.697331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9975326c-3e7d-43af-b20c-d39097092bab tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:48.698030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9975326c-3e7d-43af-b20c-d39097092bab tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.699033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9975326c-3e7d-43af-b20c-d39097092bab tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:48.699773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9975326c-3e7d-43af-b20c-d39097092bab tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:48.700545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9975326c-3e7d-43af-b20c-d39097092bab tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.837099 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d86d5094-cb69-4e67-b2fc-795681c65169 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.349793 Oct 11 20:02:48.838396 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2232/4401] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 20:02:48 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:48.852824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e6e563be-9cd8-4a8c-920a-d18fe9d8c156 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:48.853963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e6e563be-9cd8-4a8c-920a-d18fe9d8c156 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:48.865608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6e563be-9cd8-4a8c-920a-d18fe9d8c156 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:48.866736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6e563be-9cd8-4a8c-920a-d18fe9d8c156 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:48.867589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6e563be-9cd8-4a8c-920a-d18fe9d8c156 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.868602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6e563be-9cd8-4a8c-920a-d18fe9d8c156 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:48.869276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6e563be-9cd8-4a8c-920a-d18fe9d8c156 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:48.869961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6e563be-9cd8-4a8c-920a-d18fe9d8c156 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:48.957178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9975326c-3e7d-43af-b20c-d39097092bab tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:48.984286 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9975326c-3e7d-43af-b20c-d39097092bab tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1490 microversion: 2.1 time: 0.306298 Oct 11 20:02:48.986277 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2170/4402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:48 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1490 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:48.999271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-63cfaa9a-afa8-48b7-ac4a-9291b3152c1a req-53fab581-8f74-48b1-ae5e-91b807404ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e65c53-e164-4255-a2b8-4338069b7e47", "name": "network-vif-deleted", "tag": "f7bf35aa-741b-418c-92ae-e8af14cd5a52"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:49.015757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-63cfaa9a-afa8-48b7-ac4a-9291b3152c1a req-53fab581-8f74-48b1-ae5e-91b807404ece service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.016669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-63cfaa9a-afa8-48b7-ac4a-9291b3152c1a req-53fab581-8f74-48b1-ae5e-91b807404ece service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.017232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-63cfaa9a-afa8-48b7-ac4a-9291b3152c1a req-53fab581-8f74-48b1-ae5e-91b807404ece service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:49.031811 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-63cfaa9a-afa8-48b7-ac4a-9291b3152c1a req-53fab581-8f74-48b1-ae5e-91b807404ece service nova] Creating event network-vif-deleted:f7bf35aa-741b-418c-92ae-e8af14cd5a52 for instance 34e65c53-e164-4255-a2b8-4338069b7e47 on n-h2-860864-3 Oct 11 20:02:49.038222 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-63cfaa9a-afa8-48b7-ac4a-9291b3152c1a req-53fab581-8f74-48b1-ae5e-91b807404ece service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049118 Oct 11 20:02:49.039182 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2171/4403] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:49.045144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c877f3ea-46dc-4e78-a0a3-7610f4bb6f1f tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:49.045991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c877f3ea-46dc-4e78-a0a3-7610f4bb6f1f tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:49.053161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c877f3ea-46dc-4e78-a0a3-7610f4bb6f1f tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.055644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c877f3ea-46dc-4e78-a0a3-7610f4bb6f1f tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.056201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c877f3ea-46dc-4e78-a0a3-7610f4bb6f1f tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:49.057043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c877f3ea-46dc-4e78-a0a3-7610f4bb6f1f tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.057714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c877f3ea-46dc-4e78-a0a3-7610f4bb6f1f tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.058253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c877f3ea-46dc-4e78-a0a3-7610f4bb6f1f tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:49.128842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e6e563be-9cd8-4a8c-920a-d18fe9d8c156 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:49.139073 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e6e563be-9cd8-4a8c-920a-d18fe9d8c156 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1810 microversion: 2.1 time: 0.299369 Oct 11 20:02:49.140139 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2233/4404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:48 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1810 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:49.145280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61bba1a8-2568-4033-bb91-64c1e8710c27 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83c722e550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-133649217", "description": "tempest-description-56368867"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:49.342078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c877f3ea-46dc-4e78-a0a3-7610f4bb6f1f tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:49.353141 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c877f3ea-46dc-4e78-a0a3-7610f4bb6f1f tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.312588 Oct 11 20:02:49.353947 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2172/4405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:49 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:49.358350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-78799513-14a3-44bf-92f9-fedaf96c6c9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:49.360962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-78799513-14a3-44bf-92f9-fedaf96c6c9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:49.390927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78799513-14a3-44bf-92f9-fedaf96c6c9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.390927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78799513-14a3-44bf-92f9-fedaf96c6c9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.390927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78799513-14a3-44bf-92f9-fedaf96c6c9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:49.390927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78799513-14a3-44bf-92f9-fedaf96c6c9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.390927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78799513-14a3-44bf-92f9-fedaf96c6c9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.390927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78799513-14a3-44bf-92f9-fedaf96c6c9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:49.453318 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-61bba1a8-2568-4033-bb91-64c1e8710c27 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.311908 Oct 11 20:02:49.454296 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2234/4406] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 20:02:49 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:49.466707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c1ee383f-d81f-4dba-bb4c-02a1f936f68e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:49.467311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1ee383f-d81f-4dba-bb4c-02a1f936f68e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:49.485636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ee383f-d81f-4dba-bb4c-02a1f936f68e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.486132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ee383f-d81f-4dba-bb4c-02a1f936f68e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.486790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ee383f-d81f-4dba-bb4c-02a1f936f68e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:49.487682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ee383f-d81f-4dba-bb4c-02a1f936f68e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.488327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ee383f-d81f-4dba-bb4c-02a1f936f68e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.488939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ee383f-d81f-4dba-bb4c-02a1f936f68e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:49.500291 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-78799513-14a3-44bf-92f9-fedaf96c6c9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "PUT /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1085 microversion: 2.1 time: 0.145474 Oct 11 20:02:49.501122 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2173/4407] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 11 20:02:49 2022] PUT /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1085 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:49.505613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e33bdcbd-5a93-4f95-9103-67636c0cd4b7 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83cc0f45e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-909499075", "description": "tempest-description-712190361"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:49.716390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c1ee383f-d81f-4dba-bb4c-02a1f936f68e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:49.733716 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c1ee383f-d81f-4dba-bb4c-02a1f936f68e tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1679 microversion: 2.1 time: 0.273032 Oct 11 20:02:49.734363 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2235/4408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:49 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1679 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:49.740174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f7639328-4b95-4dee-8b23-277548b462af tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:49.742185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f7639328-4b95-4dee-8b23-277548b462af tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:49.752678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7639328-4b95-4dee-8b23-277548b462af tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.753327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7639328-4b95-4dee-8b23-277548b462af tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.753984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7639328-4b95-4dee-8b23-277548b462af tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:49.755016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7639328-4b95-4dee-8b23-277548b462af tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.755553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7639328-4b95-4dee-8b23-277548b462af tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.755996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7639328-4b95-4dee-8b23-277548b462af tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:49.792607 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e33bdcbd-5a93-4f95-9103-67636c0cd4b7 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.290576 Oct 11 20:02:49.793211 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2174/4409] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 20:02:49 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:49.797840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e23ce93-fe73-4f91-a519-0f70d6985351 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Action: 'create', calling method: .version_select at 0x7f83cc1ff4c0>, body: {"keypair": {"name": "tempest-keypair-219034741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0ZB2DizaNkRVl4fSTj7hNqjU7hqerMZu5P+2lmuI83mi8QjOKMnDayUkQjx3n9kuWH2EKWmC0ZfVi5UfY/faVJYIYhU7PbC1lyHb+GWPBjoWcA+EnfboQSNoJS6RgSsA=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:49.814707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-7e23ce93-fe73-4f91-a519-0f70d6985351 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Getting quotas for project 3e49d03e014e4749b522b6a87372994b. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:02:49.821701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-7e23ce93-fe73-4f91-a519-0f70d6985351 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Getting quotas for user 27affa75f6a849ba802c1397406b201c and project 3e49d03e014e4749b522b6a87372994b. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:02:49.852784 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e23ce93-fe73-4f91-a519-0f70d6985351 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.058518 Oct 11 20:02:49.853657 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2175/4410] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 11 20:02:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 20:02:49.859533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e68999ca-cf4c-4f1e-b0c8-736b04b299a4 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83cc2e4e50>, body: {"security_group_rule": {"parent_group_id": "07766f43-2909-4df3-92f4-49175d66061e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "3020ef57-230d-42d4-8d72-c382defe77ce"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:49.949814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7639328-4b95-4dee-8b23-277548b462af tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:49.962724 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f7639328-4b95-4dee-8b23-277548b462af tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1511 microversion: 2.1 time: 0.226734 Oct 11 20:02:49.964764 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2236/4411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:49 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:49.987334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9fe5f99d-e507-4f68-b093-3fbc36179ed5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:49.987969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9fe5f99d-e507-4f68-b093-3fbc36179ed5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:49.995039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fe5f99d-e507-4f68-b093-3fbc36179ed5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.995516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fe5f99d-e507-4f68-b093-3fbc36179ed5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.995968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fe5f99d-e507-4f68-b093-3fbc36179ed5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:49.996738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fe5f99d-e507-4f68-b093-3fbc36179ed5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:49.997204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fe5f99d-e507-4f68-b093-3fbc36179ed5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:49.997639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fe5f99d-e507-4f68-b093-3fbc36179ed5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:50.297182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9fe5f99d-e507-4f68-b093-3fbc36179ed5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:50.310090 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9fe5f99d-e507-4f68-b093-3fbc36179ed5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1511 microversion: 2.1 time: 0.326598 Oct 11 20:02:50.312488 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2237/4412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:49 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:02:50.319174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8fae4a6c-d38d-4483-a051-d372bbe57e7b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:50.320391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8fae4a6c-d38d-4483-a051-d372bbe57e7b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:50.335835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fae4a6c-d38d-4483-a051-d372bbe57e7b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:50.336389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fae4a6c-d38d-4483-a051-d372bbe57e7b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:50.337481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fae4a6c-d38d-4483-a051-d372bbe57e7b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:50.338554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fae4a6c-d38d-4483-a051-d372bbe57e7b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:50.339168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fae4a6c-d38d-4483-a051-d372bbe57e7b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:50.339770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fae4a6c-d38d-4483-a051-d372bbe57e7b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:50.466692 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e68999ca-cf4c-4f1e-b0c8-736b04b299a4 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.611164 Oct 11 20:02:50.467839 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2176/4413] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 20:02:49 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:50.473187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-142a796c-b038-4470-ad27-328946c5251c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:50.474024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-142a796c-b038-4470-ad27-328946c5251c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:50.483522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142a796c-b038-4470-ad27-328946c5251c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:50.484357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142a796c-b038-4470-ad27-328946c5251c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:50.485038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142a796c-b038-4470-ad27-328946c5251c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:50.485972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142a796c-b038-4470-ad27-328946c5251c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:50.488172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142a796c-b038-4470-ad27-328946c5251c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:50.488842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-142a796c-b038-4470-ad27-328946c5251c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:50.537740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-142a796c-b038-4470-ad27-328946c5251c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:02:50.563608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:50.625753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8fae4a6c-d38d-4483-a051-d372bbe57e7b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:50.635059 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8fae4a6c-d38d-4483-a051-d372bbe57e7b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1810 microversion: 2.1 time: 0.321000 Oct 11 20:02:50.635650 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2238/4414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:50 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1810 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:50.640447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-256efadb-7c8d-441b-bef9-78488ed42c22 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:50.641311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-256efadb-7c8d-441b-bef9-78488ed42c22 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:50.663842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-256efadb-7c8d-441b-bef9-78488ed42c22 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:50.665461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-256efadb-7c8d-441b-bef9-78488ed42c22 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:50.666882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-256efadb-7c8d-441b-bef9-78488ed42c22 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:50.667750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-256efadb-7c8d-441b-bef9-78488ed42c22 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:50.668443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-256efadb-7c8d-441b-bef9-78488ed42c22 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:50.669094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-256efadb-7c8d-441b-bef9-78488ed42c22 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:50.686931 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-142a796c-b038-4470-ad27-328946c5251c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 204 len: 0 microversion: 2.1 time: 0.216320 Oct 11 20:02:50.690500 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2177/4415] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:50 2022] DELETE /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:02:50.696813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bbcf31aa-d139-4215-94de-f86ad9778986 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83c73af1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-965368985", "description": "tempest-description-1587346906"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:51.118543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-256efadb-7c8d-441b-bef9-78488ed42c22 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:51.134149 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-256efadb-7c8d-441b-bef9-78488ed42c22 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.497326 Oct 11 20:02:51.141913 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2239/4416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:50 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:51.147062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-114b2124-343c-425f-bb36-16983778e918 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:51.148643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-114b2124-343c-425f-bb36-16983778e918 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:51.158588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114b2124-343c-425f-bb36-16983778e918 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:51.159098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114b2124-343c-425f-bb36-16983778e918 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:51.159731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114b2124-343c-425f-bb36-16983778e918 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:51.160292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114b2124-343c-425f-bb36-16983778e918 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:51.160993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114b2124-343c-425f-bb36-16983778e918 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:51.162006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114b2124-343c-425f-bb36-16983778e918 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:51.168579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:51.406213 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bbcf31aa-d139-4215-94de-f86ad9778986 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.716630 Oct 11 20:02:51.422415 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2178/4417] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 20:02:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:51.432535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb192149-8a34-48c7-a540-f21c96e0c6f6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:51.439004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bb192149-8a34-48c7-a540-f21c96e0c6f6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:51.450897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb192149-8a34-48c7-a540-f21c96e0c6f6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:51.451419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb192149-8a34-48c7-a540-f21c96e0c6f6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:51.452388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb192149-8a34-48c7-a540-f21c96e0c6f6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:51.453433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb192149-8a34-48c7-a540-f21c96e0c6f6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:51.453975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb192149-8a34-48c7-a540-f21c96e0c6f6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:51.454426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb192149-8a34-48c7-a540-f21c96e0c6f6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:51.478442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-114b2124-343c-425f-bb36-16983778e918 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:51.486336 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-114b2124-343c-425f-bb36-16983778e918 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1517 microversion: 2.1 time: 0.350164 Oct 11 20:02:51.486965 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2240/4418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:51 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1517 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:51.688691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f0608ce8-9a32-4ac8-a517-c7c4a68fd1b4 req-e1bafa46-901d-4b9e-a403-39b45f12cd61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ff88c4-2697-4489-a684-d48f009037c5", "name": "network-vif-deleted", "tag": "2051ef06-bdbf-4184-a72f-084b247eb5cf"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:51.704719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f0608ce8-9a32-4ac8-a517-c7c4a68fd1b4 req-e1bafa46-901d-4b9e-a403-39b45f12cd61 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:51.705790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f0608ce8-9a32-4ac8-a517-c7c4a68fd1b4 req-e1bafa46-901d-4b9e-a403-39b45f12cd61 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:51.707955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f0608ce8-9a32-4ac8-a517-c7c4a68fd1b4 req-e1bafa46-901d-4b9e-a403-39b45f12cd61 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:51.721390 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f0608ce8-9a32-4ac8-a517-c7c4a68fd1b4 req-e1bafa46-901d-4b9e-a403-39b45f12cd61 service nova] Creating event network-vif-deleted:2051ef06-bdbf-4184-a72f-084b247eb5cf for instance a1ff88c4-2697-4489-a684-d48f009037c5 on n-h1-860864-3 Oct 11 20:02:51.724495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bb192149-8a34-48c7-a540-f21c96e0c6f6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:51.743019 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bb192149-8a34-48c7-a540-f21c96e0c6f6 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1656 microversion: 2.1 time: 0.314275 Oct 11 20:02:51.744508 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2179/4419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:51 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1656 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:51.759307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc843226-3e8c-4df3-b134-9597be5ba03d tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83cc193280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-737250709", "description": "tempest-description-949411812"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:51.776891 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f0608ce8-9a32-4ac8-a517-c7c4a68fd1b4 req-e1bafa46-901d-4b9e-a403-39b45f12cd61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226931 Oct 11 20:02:51.781010 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2241/4420] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:51.796385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6ea374d-d8ba-4fab-8ad4-c9dc16b2e0a5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:51.797120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6ea374d-d8ba-4fab-8ad4-c9dc16b2e0a5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:51.809506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6ea374d-d8ba-4fab-8ad4-c9dc16b2e0a5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:51.810555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6ea374d-d8ba-4fab-8ad4-c9dc16b2e0a5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:51.811401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6ea374d-d8ba-4fab-8ad4-c9dc16b2e0a5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:51.812413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6ea374d-d8ba-4fab-8ad4-c9dc16b2e0a5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:51.813232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6ea374d-d8ba-4fab-8ad4-c9dc16b2e0a5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:51.813890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6ea374d-d8ba-4fab-8ad4-c9dc16b2e0a5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:52.796973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6ea374d-d8ba-4fab-8ad4-c9dc16b2e0a5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:52.806294 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6ea374d-d8ba-4fab-8ad4-c9dc16b2e0a5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 200 len: 1675 microversion: 2.1 time: 1.023758 Oct 11 20:02:52.806908 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2242/4421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:51 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 1675 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:52.834012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-721d339b-4f98-430d-ae80-b6ac122c41fc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:52.857420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-721d339b-4f98-430d-ae80-b6ac122c41fc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:52.858057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-721d339b-4f98-430d-ae80-b6ac122c41fc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:52.858680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-721d339b-4f98-430d-ae80-b6ac122c41fc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:52.898301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-721d339b-4f98-430d-ae80-b6ac122c41fc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Going to try to start instance {{(pid=126956) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 20:02:52.996950 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-721d339b-4f98-430d-ae80-b6ac122c41fc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.182278 Oct 11 20:02:52.998860 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2243/4422] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:02:52 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:02:53.007846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f9fb576-8484-403f-a18d-da49b790cb57 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:53.009314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0f9fb576-8484-403f-a18d-da49b790cb57 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:53.028064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f9fb576-8484-403f-a18d-da49b790cb57 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:53.028985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f9fb576-8484-403f-a18d-da49b790cb57 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:53.029743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f9fb576-8484-403f-a18d-da49b790cb57 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:53.030809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f9fb576-8484-403f-a18d-da49b790cb57 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:53.031496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f9fb576-8484-403f-a18d-da49b790cb57 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:53.032146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f9fb576-8484-403f-a18d-da49b790cb57 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:53.061772 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc843226-3e8c-4df3-b134-9597be5ba03d tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.315911 Oct 11 20:02:53.063021 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2180/4423] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 20:02:51 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:53.067964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a6cc079-5cda-4da2-88c1-5d323369c98e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:53.068875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9a6cc079-5cda-4da2-88c1-5d323369c98e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:53.088588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a6cc079-5cda-4da2-88c1-5d323369c98e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:53.111275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a6cc079-5cda-4da2-88c1-5d323369c98e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:53.111898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a6cc079-5cda-4da2-88c1-5d323369c98e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:53.112790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a6cc079-5cda-4da2-88c1-5d323369c98e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:53.114637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a6cc079-5cda-4da2-88c1-5d323369c98e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:53.119380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a6cc079-5cda-4da2-88c1-5d323369c98e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:53.643785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0f9fb576-8484-403f-a18d-da49b790cb57 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:53.654792 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f9fb576-8484-403f-a18d-da49b790cb57 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1507 microversion: 2.1 time: 0.653220 Oct 11 20:02:53.674073 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2244/4424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:52 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1507 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:53.674073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c7619c3-3c16-4845-845c-16c7a38e67c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:53.676284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c7619c3-3c16-4845-845c-16c7a38e67c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:53.696196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c7619c3-3c16-4845-845c-16c7a38e67c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:53.697232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c7619c3-3c16-4845-845c-16c7a38e67c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:53.698570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c7619c3-3c16-4845-845c-16c7a38e67c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:53.699592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c7619c3-3c16-4845-845c-16c7a38e67c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:53.700610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c7619c3-3c16-4845-845c-16c7a38e67c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:53.701440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c7619c3-3c16-4845-845c-16c7a38e67c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:53.713343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9a6cc079-5cda-4da2-88c1-5d323369c98e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:53.740098 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a6cc079-5cda-4da2-88c1-5d323369c98e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 200 len: 1517 microversion: 2.1 time: 0.670143 Oct 11 20:02:53.748415 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2181/4425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:53 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 1517 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:53.770414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b12738f1-36c4-4f77-9a67-acbed35d70e1 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83d0803820>, body: {"security_group_rule": {"parent_group_id": "b424c6cd-bcf3-41b0-b997-3994c423d275", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a2e7f324-843c-489b-897f-7ae4d73baa7f"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:54.295456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c7619c3-3c16-4845-845c-16c7a38e67c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:54.305853 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c7619c3-3c16-4845-845c-16c7a38e67c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1665 microversion: 2.1 time: 0.646307 Oct 11 20:02:54.307630 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2245/4426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:53 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1665 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:54.323219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ef6e4ec2-7d90-42d2-9657-68595c3a7a0e req-6c15c43d-a9b3-4a04-8b99-4fcf437233bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ff88c4-2697-4489-a684-d48f009037c5", "name": "network-vif-deleted", "tag": "012e4f8a-e911-49fd-a922-fb486d482f7d"}, {"server_uuid": "a1ff88c4-2697-4489-a684-d48f009037c5", "name": "network-vif-deleted", "tag": "92f83f08-a2ce-41d2-8984-80d9e9043973"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:54.354697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ef6e4ec2-7d90-42d2-9657-68595c3a7a0e req-6c15c43d-a9b3-4a04-8b99-4fcf437233bb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:54.355258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ef6e4ec2-7d90-42d2-9657-68595c3a7a0e req-6c15c43d-a9b3-4a04-8b99-4fcf437233bb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:54.356750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ef6e4ec2-7d90-42d2-9657-68595c3a7a0e req-6c15c43d-a9b3-4a04-8b99-4fcf437233bb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:54.371686 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ef6e4ec2-7d90-42d2-9657-68595c3a7a0e req-6c15c43d-a9b3-4a04-8b99-4fcf437233bb service nova] Creating event network-vif-deleted:012e4f8a-e911-49fd-a922-fb486d482f7d for instance a1ff88c4-2697-4489-a684-d48f009037c5 on n-h1-860864-3 Oct 11 20:02:54.371974 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ef6e4ec2-7d90-42d2-9657-68595c3a7a0e req-6c15c43d-a9b3-4a04-8b99-4fcf437233bb service nova] Creating event network-vif-deleted:92f83f08-a2ce-41d2-8984-80d9e9043973 for instance a1ff88c4-2697-4489-a684-d48f009037c5 on n-h1-860864-3 Oct 11 20:02:54.378505 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ef6e4ec2-7d90-42d2-9657-68595c3a7a0e req-6c15c43d-a9b3-4a04-8b99-4fcf437233bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069439 Oct 11 20:02:54.380033 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2246/4427] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:54.387962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:54.389015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:54.395956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:54.397167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:54.398799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:54.399852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:54.400470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:54.401050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:54.437882 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] HTTP exception thrown: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Request method failure captured: Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 HTTP/1.1 Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcusPV4N1G1LaObGP1tzm-yADkvyi3PGtSx77P_9Yv472CHEyZ33sitKqxomDkpvskpTmUSh_qdMM1x3tXmNBCs1bMC4f9F3LMTgIrvbBAy-_qlZI0daYpHxX_rmhe1P--ZA8nEnwukdEv4WBRRDvIayTyDoTRvLONCdUtl916iT3bU Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df583d3545145c1ae055328f823edbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df583d3545145c1ae055328f823edbc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}] Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestMultiNic-1611500234 Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 28a8f90c691c43e6a131517ff9b3a0cd Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a1ff88c4-2697-4489-a684-d48f009037c5'} Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:54.440454 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:54.444543 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:54.444543 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:54.444543 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:54.444543 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:54.444543 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:54.444543 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:02:54.444543 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:54.446448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Returning 404 to user: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:54.448375 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c582616f-4c46-48cd-b4a3-b4cacc459856 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 404 len: 111 microversion: 2.1 time: 0.067035 Oct 11 20:02:54.453878 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2247/4428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:54 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:54.458966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f7e78216-1e05-417d-b86c-2480c7357d34 req-8e06dc7e-d81f-471f-b27f-c141b7b0faeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b64a493-6d84-4526-a52c-6330d7cfec84", "name": "network-vif-deleted", "tag": "950b887d-3e4a-430b-b86d-71d61dee081b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:54.471152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f7e78216-1e05-417d-b86c-2480c7357d34 req-8e06dc7e-d81f-471f-b27f-c141b7b0faeb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:54.471798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f7e78216-1e05-417d-b86c-2480c7357d34 req-8e06dc7e-d81f-471f-b27f-c141b7b0faeb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:54.472382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f7e78216-1e05-417d-b86c-2480c7357d34 req-8e06dc7e-d81f-471f-b27f-c141b7b0faeb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:54.506196 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f7e78216-1e05-417d-b86c-2480c7357d34 req-8e06dc7e-d81f-471f-b27f-c141b7b0faeb service nova] Creating event network-vif-deleted:950b887d-3e4a-430b-b86d-71d61dee081b for instance 8b64a493-6d84-4526-a52c-6330d7cfec84 on n-h2-860864-3 Oct 11 20:02:54.513967 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f7e78216-1e05-417d-b86c-2480c7357d34 req-8e06dc7e-d81f-471f-b27f-c141b7b0faeb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057752 Oct 11 20:02:54.515038 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2248/4429] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:54.523000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-741112634", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aedac80a-377a-485e-8549-987822ec3514"}], "security_groups": [{"name": "tempest-securitygroup--1341610140"}], "key_name": "tempest-keypair-219034741", "user_data": "}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:54.683329 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b12738f1-36c4-4f77-9a67-acbed35d70e1 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.933318 Oct 11 20:02:54.691285 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2182/4430] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 20:02:53 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:54.698082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] validate_networks() for [('aedac80a-377a-485e-8549-987822ec3514', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:02:54.701947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:54.704735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:54.769851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:54.771923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:54.773729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:54.777704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:54.778633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:54.780112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:54.861303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:54.861928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:54.862375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:54.862850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lazy-loading 'fault' on Instance uuid 8b64a493-6d84-4526-a52c-6330d7cfec84 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:02:54.952729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:54.968203 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6e15b594-65ae-46cb-944b-930d23c8b09a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 200 len: 1304 microversion: 2.1 time: 0.275047 Oct 11 20:02:54.980432 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2183/4431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:54 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 1304 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:55.002097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f43f7dd6-a6b2-4814-8d7b-fd875fa78c0a tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83d070fee0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:55.703455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:02:55.703945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:02:55.704362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:02:55.704780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:02:55.705202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:02:55.719751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:55.720411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:55.721130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:55.722013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:55.722642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:55.723236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:55.724095 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f43f7dd6-a6b2-4814-8d7b-fd875fa78c0a tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a2e7f324-843c-489b-897f-7ae4d73baa7f" status: 202 len: 0 microversion: 2.1 time: 0.741108 Oct 11 20:02:55.728405 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2184/4432] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:02:54 2022] DELETE /compute/v2.1/os-security-groups/a2e7f324-843c-489b-897f-7ae4d73baa7f => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:02:55.735462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:55.738105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:55.752947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:55.753846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:55.754489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:55.755282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Getting quotas for project 3e49d03e014e4749b522b6a87372994b. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:02:55.756178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:55.761846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:55.762581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:55.763588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Getting quotas for user 27affa75f6a849ba802c1397406b201c and project 3e49d03e014e4749b522b6a87372994b. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:02:55.793243 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:02:55.793793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:02:55.796909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 HTTP/1.1 Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '061c597d-8847-4f24-bc20-3cf90b707636'} Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:55.797220 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:55.801013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:55.801013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:55.801013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:55.801013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:55.801013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:55.801013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:02:55.801013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:02:55.801013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:55.801013 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5aa4650f-7229-4333-8650-fe269102e0bc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 404 len: 111 microversion: 2.1 time: 0.072168 Oct 11 20:02:55.801013 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2185/4433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:55 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:55.824313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-406826d7-cb39-4245-8125-af424e15a20b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:55.824947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-406826d7-cb39-4245-8125-af424e15a20b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:55.843050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406826d7-cb39-4245-8125-af424e15a20b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:55.843630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406826d7-cb39-4245-8125-af424e15a20b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:55.844124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406826d7-cb39-4245-8125-af424e15a20b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:55.853013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406826d7-cb39-4245-8125-af424e15a20b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:55.853581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406826d7-cb39-4245-8125-af424e15a20b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:55.854050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406826d7-cb39-4245-8125-af424e15a20b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:55.880182 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4205d203-167f-4288-949d-ec4cfd986abb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.363519 Oct 11 20:02:55.883568 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2249/4434] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 20:02:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 20:02:55.895905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a46ec7e-247b-49ad-82c3-7f24d4a5f4d2 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83c71ecdc0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:56.084138 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a46ec7e-247b-49ad-82c3-7f24d4a5f4d2 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/b424c6cd-bcf3-41b0-b997-3994c423d275" status: 200 len: 247 microversion: 2.1 time: 0.199312 Oct 11 20:02:56.087501 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2250/4435] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 20:02:55 2022] GET /compute/v2.1/os-security-groups/b424c6cd-bcf3-41b0-b997-3994c423d275 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:56.092206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e604fa37-ae12-44f5-b0a2-7619a38bf44d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:56.097390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e604fa37-ae12-44f5-b0a2-7619a38bf44d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:56.216795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e604fa37-ae12-44f5-b0a2-7619a38bf44d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:56.223392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-406826d7-cb39-4245-8125-af424e15a20b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:56.230003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e604fa37-ae12-44f5-b0a2-7619a38bf44d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:56.232033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e604fa37-ae12-44f5-b0a2-7619a38bf44d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:56.232827 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-406826d7-cb39-4245-8125-af424e15a20b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.431489 Oct 11 20:02:56.233861 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2186/4436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:55 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:56.238962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1482702479", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "4bda9a14-e746-4951-9d43-234855a05a4d"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:56.241266 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e604fa37-ae12-44f5-b0a2-7619a38bf44d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1280 microversion: 2.20 time: 0.152515 Oct 11 20:02:56.275031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:02:56.277485 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2251/4437] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:02:56 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1280 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:02:56.291246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:56.292480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: 8b64a493-6d84-4526-a52c-6330d7cfec84] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:56.304665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] validate_networks() for [('4bda9a14-e746-4951-9d43-234855a05a4d', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:02:56.310825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:56.311423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:56.312952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:56.316177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:56.317288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:56.317918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:56.353078 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] HTTP exception thrown: Instance 8b64a493-6d84-4526-a52c-6330d7cfec84 could not be found. Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Request method failure captured: Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 HTTP/1.1 Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRctqQDYAYzJtA-SaQgH8TyKha8TuqXsGVeJZRQQU1o7AgLqH0S6v-fhQq1pbp9JLVD3iRYXqzDpyY3kL9BfsT_WqgnwivPWQi3iQqv3lfVfDVtlROhJfet0MsACVmdANzx1rfZzM21ttQI51jLcfQYEPtXBAq4Os1q175n4NgvwZxyg Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f8f60b56d4134dc386dc502b26f193ae Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerRescueTestJSON-1468127925 Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8f60b56d4134dc386dc502b26f193ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8f60b56d4134dc386dc502b26f193ae", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8f60b56d4134dc386dc502b26f193ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8f60b56d4134dc386dc502b26f193ae"}]}] Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerRescueTestJSON-1468127925 Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f8f60b56d4134dc386dc502b26f193ae Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerRescueTestJSON-1468127925 Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerRescueTestJSON-1468127925-project Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 639fa589545d478da41b8632e5eb2faa Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerRescueTestJSON-1468127925-project Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 8b64a493-6d84-4526-a52c-6330d7cfec84 could not be found. Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '8b64a493-6d84-4526-a52c-6330d7cfec84'} Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b64a493-6d84-4526-a52c-6330d7cfec84 could not be found. Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b64a493-6d84-4526-a52c-6330d7cfec84 could not be found. Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:02:56.361125 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:56.364993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:02:56.364993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:02:56.364993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:02:56.364993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:02:56.364993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:02:56.364993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b64a493-6d84-4526-a52c-6330d7cfec84 could not be found. Oct 11 20:02:56.364993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:02:56.364993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Returning 404 to user: Instance 8b64a493-6d84-4526-a52c-6330d7cfec84 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:02:56.366832 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-deb8bdd3-3b8e-40bc-9987-38e33f21ac7a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84" status: 404 len: 111 microversion: 2.1 time: 0.087173 Oct 11 20:02:56.367528 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2252/4438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:56 2022] GET /compute/v2.1/servers/8b64a493-6d84-4526-a52c-6330d7cfec84 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:02:56.386329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-120752fe-defd-4215-af96-33d971cd4ea5 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83c72e10d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-949003875", "description": "tempest-description-167095301"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:56.853987 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-120752fe-defd-4215-af96-33d971cd4ea5 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.479265 Oct 11 20:02:56.854660 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2253/4439] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 11 20:02:56 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:56.869645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89f2f995-e52a-41e3-b58e-0f887f1af389 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:56.877917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-89f2f995-e52a-41e3-b58e-0f887f1af389 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:56.886274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2f995-e52a-41e3-b58e-0f887f1af389 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:56.888903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2f995-e52a-41e3-b58e-0f887f1af389 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:56.890008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2f995-e52a-41e3-b58e-0f887f1af389 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:56.900889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2f995-e52a-41e3-b58e-0f887f1af389 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:56.902307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2f995-e52a-41e3-b58e-0f887f1af389 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:56.903293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2f995-e52a-41e3-b58e-0f887f1af389 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:57.110509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:02:57.110944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:02:57.111386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:02:57.111794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:02:57.112206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:02:57.129782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:57.130220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:57.130680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:57.131705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:57.132362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:57.133099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:57.154620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:02:57.162258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Getting quotas for user a84c2531dcb24cce9872808db6c1fa6d and project ffd7fdf22e0046e28c70ed06a2dededa. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:02:57.177139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:02:57.181844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:02:57.191835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-89f2f995-e52a-41e3-b58e-0f887f1af389 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:57.202351 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-89f2f995-e52a-41e3-b58e-0f887f1af389 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.337659 Oct 11 20:02:57.203230 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2254/4440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:56 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:57.237369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1b55161d-d704-4c3c-ad3e-6f2d55f6878d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:57.237888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1b55161d-d704-4c3c-ad3e-6f2d55f6878d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:57.244888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b55161d-d704-4c3c-ad3e-6f2d55f6878d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:57.245605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b55161d-d704-4c3c-ad3e-6f2d55f6878d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:57.246055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b55161d-d704-4c3c-ad3e-6f2d55f6878d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:57.247170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b55161d-d704-4c3c-ad3e-6f2d55f6878d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:57.247799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b55161d-d704-4c3c-ad3e-6f2d55f6878d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:57.248394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b55161d-d704-4c3c-ad3e-6f2d55f6878d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:57.258176 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-44b8ec51-68c4-4a51-af77-17c6fa9934f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023125 Oct 11 20:02:57.258879 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2187/4441] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:02:57.269380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5a7b1b75-eb7a-42b5-b99f-234adf6503d3 req-78b3ea31-1fb8-48ce-88df-a0244416fa46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061c597d-8847-4f24-bc20-3cf90b707636", "name": "network-vif-deleted", "tag": "049d046c-17bb-428f-8755-d077a517cd7a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:57.277436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1b55161d-d704-4c3c-ad3e-6f2d55f6878d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:02:57.286564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5a7b1b75-eb7a-42b5-b99f-234adf6503d3 req-78b3ea31-1fb8-48ce-88df-a0244416fa46 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:57.287055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5a7b1b75-eb7a-42b5-b99f-234adf6503d3 req-78b3ea31-1fb8-48ce-88df-a0244416fa46 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:57.287488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5a7b1b75-eb7a-42b5-b99f-234adf6503d3 req-78b3ea31-1fb8-48ce-88df-a0244416fa46 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:57.311199 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5a7b1b75-eb7a-42b5-b99f-234adf6503d3 req-78b3ea31-1fb8-48ce-88df-a0244416fa46 service nova] Creating event network-vif-deleted:049d046c-17bb-428f-8755-d077a517cd7a for instance 061c597d-8847-4f24-bc20-3cf90b707636 on n-h1-860864-3 Oct 11 20:02:57.328639 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5a7b1b75-eb7a-42b5-b99f-234adf6503d3 req-78b3ea31-1fb8-48ce-88df-a0244416fa46 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068285 Oct 11 20:02:57.330238 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2188/4442] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:57.346051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32b5560e-c6a3-4a5c-99c8-d4b378d5da1a tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83c74ecc10>, body: {"security_group_rule": {"parent_group_id": "7430a974-8f8e-4c40-be64-b5893ba4a9f0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:57.404933 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1b55161d-d704-4c3c-ad3e-6f2d55f6878d tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 204 len: 0 microversion: 2.1 time: 0.171349 Oct 11 20:02:57.410492 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2255/4443] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:02:57 2022] DELETE /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:02:57.418167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70c4ebfa-1097-4b55-aecd-a7ca7c25619c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:57.427565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-70c4ebfa-1097-4b55-aecd-a7ca7c25619c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:57.436559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70c4ebfa-1097-4b55-aecd-a7ca7c25619c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:57.437410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70c4ebfa-1097-4b55-aecd-a7ca7c25619c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:57.438518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70c4ebfa-1097-4b55-aecd-a7ca7c25619c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:57.439515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70c4ebfa-1097-4b55-aecd-a7ca7c25619c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:57.440177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70c4ebfa-1097-4b55-aecd-a7ca7c25619c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:57.441104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70c4ebfa-1097-4b55-aecd-a7ca7c25619c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:57.856906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-70c4ebfa-1097-4b55-aecd-a7ca7c25619c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:57.868935 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-70c4ebfa-1097-4b55-aecd-a7ca7c25619c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.456032 Oct 11 20:02:57.870316 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2256/4444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:57 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:57.877469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc5bea47-009a-46ff-afcd-a85bd467175f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:57.878466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc5bea47-009a-46ff-afcd-a85bd467175f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:57.934437 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-32b5560e-c6a3-4a5c-99c8-d4b378d5da1a tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.602377 Oct 11 20:02:57.935157 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2189/4445] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 20:02:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:57.941577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:57.942515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:57.960660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:57.961486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:57.961968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:57.964983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:57.965526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:57.965978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:58.002210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dc5bea47-009a-46ff-afcd-a85bd467175f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:58.017282 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc5bea47-009a-46ff-afcd-a85bd467175f tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1209 microversion: 2.1 time: 0.144035 Oct 11 20:02:58.019231 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2257/4446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:57 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1209 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:58.034246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ac0ae8a8-bca1-4a2a-b67d-afab7809ba39 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:58.044685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ac0ae8a8-bca1-4a2a-b67d-afab7809ba39 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:58.066297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac0ae8a8-bca1-4a2a-b67d-afab7809ba39 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:58.068242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac0ae8a8-bca1-4a2a-b67d-afab7809ba39 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:58.068702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac0ae8a8-bca1-4a2a-b67d-afab7809ba39 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:58.072955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac0ae8a8-bca1-4a2a-b67d-afab7809ba39 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:58.078759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac0ae8a8-bca1-4a2a-b67d-afab7809ba39 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:58.079554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac0ae8a8-bca1-4a2a-b67d-afab7809ba39 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:58.158409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:58.179998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:58.181830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:58.183233 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97e8fc44-ffe2-4331-911a-5b654bc65810 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1338 microversion: 2.20 time: 0.246454 Oct 11 20:02:58.184058 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2190/4447] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:02:57 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1338 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:02:58.189415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ecc07be1-6e5a-406f-9804-95fd108db08b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:58.190306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ecc07be1-6e5a-406f-9804-95fd108db08b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:58.210950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc07be1-6e5a-406f-9804-95fd108db08b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:58.211617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc07be1-6e5a-406f-9804-95fd108db08b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:58.212169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc07be1-6e5a-406f-9804-95fd108db08b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:58.213127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc07be1-6e5a-406f-9804-95fd108db08b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:58.213698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc07be1-6e5a-406f-9804-95fd108db08b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:58.214238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc07be1-6e5a-406f-9804-95fd108db08b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:58.933154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ac0ae8a8-bca1-4a2a-b67d-afab7809ba39 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:58.953343 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ac0ae8a8-bca1-4a2a-b67d-afab7809ba39 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1491 microversion: 2.1 time: 0.930962 Oct 11 20:02:58.966943 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2258/4448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:58 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1491 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:58.974492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3618ab95-7307-4cfd-a8ef-9e1940234cfc tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Action: 'create', calling method: .version_select at 0x7f83c72e1280>, body: {"security_group_rule": {"parent_group_id": "7430a974-8f8e-4c40-be64-b5893ba4a9f0", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:02:59.036332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ecc07be1-6e5a-406f-9804-95fd108db08b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:59.079007 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ecc07be1-6e5a-406f-9804-95fd108db08b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.890321 Oct 11 20:02:59.089136 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2191/4449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:58 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:59.112350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-61b6677f-3629-41f1-b08c-144fc8cc46aa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:59.119090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-61b6677f-3629-41f1-b08c-144fc8cc46aa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:59.149068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b6677f-3629-41f1-b08c-144fc8cc46aa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:59.150394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b6677f-3629-41f1-b08c-144fc8cc46aa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:59.152645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b6677f-3629-41f1-b08c-144fc8cc46aa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:59.158706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b6677f-3629-41f1-b08c-144fc8cc46aa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:59.163056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b6677f-3629-41f1-b08c-144fc8cc46aa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:59.167276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61b6677f-3629-41f1-b08c-144fc8cc46aa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:59.353540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-61b6677f-3629-41f1-b08c-144fc8cc46aa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:59.364712 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-61b6677f-3629-41f1-b08c-144fc8cc46aa tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1213 microversion: 2.1 time: 0.272232 Oct 11 20:02:59.378896 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2192/4450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:59 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1213 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:59.384972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-26035e60-aab5-4f1f-9701-a559cfc09aa8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:59.385889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-26035e60-aab5-4f1f-9701-a559cfc09aa8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:59.400852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26035e60-aab5-4f1f-9701-a559cfc09aa8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:59.402155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26035e60-aab5-4f1f-9701-a559cfc09aa8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:59.403014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26035e60-aab5-4f1f-9701-a559cfc09aa8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:59.403802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26035e60-aab5-4f1f-9701-a559cfc09aa8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:59.404320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26035e60-aab5-4f1f-9701-a559cfc09aa8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:59.404758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26035e60-aab5-4f1f-9701-a559cfc09aa8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:59.865597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-26035e60-aab5-4f1f-9701-a559cfc09aa8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:02:59.899759 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-26035e60-aab5-4f1f-9701-a559cfc09aa8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.516490 Oct 11 20:02:59.915237 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3618ab95-7307-4cfd-a8ef-9e1940234cfc tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.937804 Oct 11 20:02:59.915237 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2259/4451] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 11 20:02:58 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:02:59.915237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:59.915237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:02:59.918989 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2193/4452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:02:59 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:02:59.931061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ffc8911e-5692-466d-8b1c-54fb19af9eee tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83c7530670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:02:59.935266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:59.935807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:59.936222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:02:59.936956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:02:59.937418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:02:59.937841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:00.525074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:00.538041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:00.544302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:00.545739 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-768fcc22-8f26-4dbb-bb59-b68464ebc412 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1406 microversion: 2.20 time: 0.638208 Oct 11 20:03:00.564719 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2260/4453] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:02:59 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1406 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:03:00.570653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a79960e0-6a73-4e27-8cb8-59b319e16d9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:00.571444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a79960e0-6a73-4e27-8cb8-59b319e16d9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:00.586225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a79960e0-6a73-4e27-8cb8-59b319e16d9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:00.587131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a79960e0-6a73-4e27-8cb8-59b319e16d9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:00.587871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a79960e0-6a73-4e27-8cb8-59b319e16d9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:00.589092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a79960e0-6a73-4e27-8cb8-59b319e16d9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:00.589823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a79960e0-6a73-4e27-8cb8-59b319e16d9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:00.590499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a79960e0-6a73-4e27-8cb8-59b319e16d9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:00.634711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-a79960e0-6a73-4e27-8cb8-59b319e16d9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lazy-loading 'flavor' on Instance uuid b7ee4391-e163-4a76-9151-04adeb0111a8 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:03:00.781447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:00.831956 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a79960e0-6a73-4e27-8cb8-59b319e16d9c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.263963 Oct 11 20:03:00.837692 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2261/4454] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:03:00 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:00.853458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f910e1f0-0571-4515-9d98-07dec5c02ed0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:00.854343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f910e1f0-0571-4515-9d98-07dec5c02ed0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:00.869940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f910e1f0-0571-4515-9d98-07dec5c02ed0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:00.870457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f910e1f0-0571-4515-9d98-07dec5c02ed0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:00.871069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f910e1f0-0571-4515-9d98-07dec5c02ed0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:00.877580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f910e1f0-0571-4515-9d98-07dec5c02ed0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:00.878100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f910e1f0-0571-4515-9d98-07dec5c02ed0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:00.883748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f910e1f0-0571-4515-9d98-07dec5c02ed0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:00.988149 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ffc8911e-5692-466d-8b1c-54fb19af9eee tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/7430a974-8f8e-4c40-be64-b5893ba4a9f0" status: 200 len: 663 microversion: 2.1 time: 1.067948 Oct 11 20:03:00.989615 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2194/4455] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 20:02:59 2022] GET /compute/v2.1/os-security-groups/7430a974-8f8e-4c40-be64-b5893ba4a9f0 => generated 663 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:00.997547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-875b8568-bd7c-481f-842f-fb4720202352 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:00.999828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-875b8568-bd7c-481f-842f-fb4720202352 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:01.023497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875b8568-bd7c-481f-842f-fb4720202352 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:01.024353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875b8568-bd7c-481f-842f-fb4720202352 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:01.026862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875b8568-bd7c-481f-842f-fb4720202352 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:01.029658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875b8568-bd7c-481f-842f-fb4720202352 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:01.031156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875b8568-bd7c-481f-842f-fb4720202352 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:01.036804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-875b8568-bd7c-481f-842f-fb4720202352 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:01.296724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-875b8568-bd7c-481f-842f-fb4720202352 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:01.308990 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-875b8568-bd7c-481f-842f-fb4720202352 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1267 microversion: 2.1 time: 0.316168 Oct 11 20:03:01.313112 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2195/4456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:00 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:01.337790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-63fa3cd2-7258-4237-a3e0-14164ded78e7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:01.338411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-63fa3cd2-7258-4237-a3e0-14164ded78e7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:01.373441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63fa3cd2-7258-4237-a3e0-14164ded78e7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:01.383257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63fa3cd2-7258-4237-a3e0-14164ded78e7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:01.384101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63fa3cd2-7258-4237-a3e0-14164ded78e7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:01.384816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63fa3cd2-7258-4237-a3e0-14164ded78e7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:01.385257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63fa3cd2-7258-4237-a3e0-14164ded78e7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:01.385768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63fa3cd2-7258-4237-a3e0-14164ded78e7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:02.588145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63fa3cd2-7258-4237-a3e0-14164ded78e7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:02.607209 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-63fa3cd2-7258-4237-a3e0-14164ded78e7 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1677 microversion: 2.1 time: 1.289514 Oct 11 20:03:02.607209 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2196/4457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:01 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1677 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:02.626889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-190126f9-9cc6-4ada-b1ae-f3f30c95c4ca tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83c7530b80>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:02.925895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f910e1f0-0571-4515-9d98-07dec5c02ed0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '639fa589545d478da41b8632e5eb2faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f60b56d4134dc386dc502b26f193ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:02.937464 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f910e1f0-0571-4515-9d98-07dec5c02ed0 tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 200 len: 1491 microversion: 2.1 time: 2.098238 Oct 11 20:03:02.941792 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2262/4458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:00 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 1491 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:02.953925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:02.957243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:02.973592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:02.974746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:02.975863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:02.976750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:02.977372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:02.977959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:03.506076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:03.527586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:03.535855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:03.539842 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aecfeb4d-584f-47bc-97c2-f280c44e6c39 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1406 microversion: 2.20 time: 0.596611 Oct 11 20:03:03.541902 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2263/4459] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:03:02 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1406 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:03:03.548981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1468062589", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "f388edf0-b57f-4eec-ac36-6c0301a55e93"}, {"uuid": "f16c5d24-296a-4b48-974f-ecdef8edb905"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:03.667347 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-190126f9-9cc6-4ada-b1ae-f3f30c95c4ca tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/b399bdef-d303-4462-b607-710a23e35ab6" status: 202 len: 0 microversion: 2.1 time: 1.058109 Oct 11 20:03:03.668529 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2197/4460] 10.222.0.27 () {58 vars in 1287 bytes} [Tue Oct 11 20:03:02 2022] DELETE /compute/v2.1/os-security-group-rules/b399bdef-d303-4462-b607-710a23e35ab6 => generated 0 bytes in 1061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:03.682296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-52c5446e-6c10-4471-912a-a13c012aee1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:03.682983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-52c5446e-6c10-4471-912a-a13c012aee1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:03.693126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] validate_networks() for [('f388edf0-b57f-4eec-ac36-6c0301a55e93', None, None, None, None, None), ('f16c5d24-296a-4b48-974f-ecdef8edb905', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:03:03.703933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c5446e-6c10-4471-912a-a13c012aee1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:03.704535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c5446e-6c10-4471-912a-a13c012aee1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:03.705050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c5446e-6c10-4471-912a-a13c012aee1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:03.705843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c5446e-6c10-4471-912a-a13c012aee1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:03.706373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c5446e-6c10-4471-912a-a13c012aee1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:03.706943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-52c5446e-6c10-4471-912a-a13c012aee1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:04.317024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-52c5446e-6c10-4471-912a-a13c012aee1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:04.326132 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-52c5446e-6c10-4471-912a-a13c012aee1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1309 microversion: 2.1 time: 0.656299 Oct 11 20:03:04.339074 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2198/4461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:03 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1309 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:04.357306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0b14484-0ff7-47b5-a22c-bfe744204268 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:04.360673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c0b14484-0ff7-47b5-a22c-bfe744204268 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:04.373994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0b14484-0ff7-47b5-a22c-bfe744204268 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:04.382785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0b14484-0ff7-47b5-a22c-bfe744204268 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:04.386372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0b14484-0ff7-47b5-a22c-bfe744204268 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:04.387874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0b14484-0ff7-47b5-a22c-bfe744204268 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:04.388965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0b14484-0ff7-47b5-a22c-bfe744204268 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:04.392635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0b14484-0ff7-47b5-a22c-bfe744204268 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:04.464510 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c0b14484-0ff7-47b5-a22c-bfe744204268 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8/action" status: 200 len: 24573 microversion: 2.1 time: 0.123986 Oct 11 20:03:04.465176 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2199/4462] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:03:04 2022] POST /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8/action => generated 24573 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:03:04.470415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-73adb395-6f48-456f-945e-8e12feed3ecc req-ee7064b2-cfa1-4fab-a4ac-21a5198a8ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a385f615-a24c-47d5-b833-b2786ceb0410", "name": "network-vif-deleted", "tag": "c2369f0c-de84-41bb-97bc-2795c77267ea"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:04.493737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-73adb395-6f48-456f-945e-8e12feed3ecc req-ee7064b2-cfa1-4fab-a4ac-21a5198a8ff9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:04.494234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-73adb395-6f48-456f-945e-8e12feed3ecc req-ee7064b2-cfa1-4fab-a4ac-21a5198a8ff9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:04.498453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-73adb395-6f48-456f-945e-8e12feed3ecc req-ee7064b2-cfa1-4fab-a4ac-21a5198a8ff9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:04.520060 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-73adb395-6f48-456f-945e-8e12feed3ecc req-ee7064b2-cfa1-4fab-a4ac-21a5198a8ff9 service nova] Creating event network-vif-deleted:c2369f0c-de84-41bb-97bc-2795c77267ea for instance a385f615-a24c-47d5-b833-b2786ceb0410 on n-h2-860864-3 Oct 11 20:03:04.526444 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-73adb395-6f48-456f-945e-8e12feed3ecc req-ee7064b2-cfa1-4fab-a4ac-21a5198a8ff9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059700 Oct 11 20:03:04.527516 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2200/4463] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:04.533146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-13b768d1-451b-4735-8b8c-5283b1da5b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:04.533857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-13b768d1-451b-4735-8b8c-5283b1da5b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:04.541278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13b768d1-451b-4735-8b8c-5283b1da5b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:04.542063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13b768d1-451b-4735-8b8c-5283b1da5b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:04.542739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13b768d1-451b-4735-8b8c-5283b1da5b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:04.543627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13b768d1-451b-4735-8b8c-5283b1da5b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:04.544254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13b768d1-451b-4735-8b8c-5283b1da5b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:04.544844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13b768d1-451b-4735-8b8c-5283b1da5b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:05.274470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-13b768d1-451b-4735-8b8c-5283b1da5b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:05.294060 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-13b768d1-451b-4735-8b8c-5283b1da5b05 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1660 microversion: 2.1 time: 0.763821 Oct 11 20:03:05.296344 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2201/4464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:04 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1660 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:05.310446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f44028ca-c73d-4c5a-9b13-d0bc1bd63001 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83cc1283a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:05.736544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:06.176933 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f44028ca-c73d-4c5a-9b13-d0bc1bd63001 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7430a974-8f8e-4c40-be64-b5893ba4a9f0" status: 202 len: 0 microversion: 2.1 time: 0.878837 Oct 11 20:03:06.181522 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2202/4465] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:03:05 2022] DELETE /compute/v2.1/os-security-groups/7430a974-8f8e-4c40-be64-b5893ba4a9f0 => generated 0 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:06.186439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:06.187151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] [instance: a385f615-a24c-47d5-b833-b2786ceb0410] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:06.200686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:03:06.201119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:03:06.201240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.201604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:03:06.201925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.202040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:03:06.202564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.203134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:03:06.203925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.205502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.206165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.223852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.224586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.225409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.227091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.228326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.228571 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] HTTP exception thrown: Instance a385f615-a24c-47d5-b833-b2786ceb0410 could not be found. Oct 11 20:03:06.230007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Request method failure captured: Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 HTTP/1.1 Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRctqQDYAYzJtA-SaQgH8TyKha8TuqXsGVeJZRQQU1o7AgLqH0S6v-fhQq1pbp9JLVD3iRYXqzDpyY3kL9BfsT_WqgnwivPWQi3iQqv3lfVfDVtlROhJfet0MsACVmdANzx1rfZzM21ttQI51jLcfQYEPtXBAq4Os1q175n4NgvwZxyg Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f8f60b56d4134dc386dc502b26f193ae Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerRescueTestJSON-1468127925 Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8f60b56d4134dc386dc502b26f193ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8f60b56d4134dc386dc502b26f193ae", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8f60b56d4134dc386dc502b26f193ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8f60b56d4134dc386dc502b26f193ae"}]}] Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerRescueTestJSON-1468127925 Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f8f60b56d4134dc386dc502b26f193ae Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerRescueTestJSON-1468127925 Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerRescueTestJSON-1468127925-project Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 639fa589545d478da41b8632e5eb2faa Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerRescueTestJSON-1468127925-project Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance a385f615-a24c-47d5-b833-b2786ceb0410 could not be found. Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a385f615-a24c-47d5-b833-b2786ceb0410'} Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a385f615-a24c-47d5-b833-b2786ceb0410 could not be found. Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a385f615-a24c-47d5-b833-b2786ceb0410 could not be found. Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:06.230634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.235131 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:06.235131 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:06.235131 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:06.235131 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:06.235131 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:06.235131 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a385f615-a24c-47d5-b833-b2786ceb0410 could not be found. Oct 11 20:03:06.235131 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.235131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] Returning 404 to user: Instance a385f615-a24c-47d5-b833-b2786ceb0410 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:06.235131 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8df57566-8dee-4d92-b838-e218878a258a tempest-ServerRescueTestJSON-1468127925 tempest-ServerRescueTestJSON-1468127925-project] 10.222.0.27 "GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410" status: 404 len: 111 microversion: 2.1 time: 0.049540 Oct 11 20:03:06.236181 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2203/4466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:06 2022] GET /compute/v2.1/servers/a385f615-a24c-47d5-b833-b2786ceb0410 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:06.241502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:06.242118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:06.248233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.248729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.249166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.249941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.250590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.251023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.274328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:06.279826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Getting quotas for project 1df583d3545145c1ae055328f823edbc. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:03:06.291945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Getting quotas for user 28a8f90c691c43e6a131517ff9b3a0cd and project 1df583d3545145c1ae055328f823edbc. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:03:06.315989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:03:06.319982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:03:06.361614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:06.389869 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba3a8991-64f0-481a-ad2c-50634c44375a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.845734 Oct 11 20:03:06.391445 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2264/4467] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:03:06.396535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9dfef19a-b9a0-472d-aad1-d44fda502188 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:06.404670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9dfef19a-b9a0-472d-aad1-d44fda502188 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:06.425026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dfef19a-b9a0-472d-aad1-d44fda502188 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.429912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dfef19a-b9a0-472d-aad1-d44fda502188 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.431801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dfef19a-b9a0-472d-aad1-d44fda502188 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.432967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dfef19a-b9a0-472d-aad1-d44fda502188 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.434280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dfef19a-b9a0-472d-aad1-d44fda502188 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.435016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9dfef19a-b9a0-472d-aad1-d44fda502188 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.536141 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9dfef19a-b9a0-472d-aad1-d44fda502188 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action" status: 202 len: 0 microversion: 2.1 time: 0.143028 Oct 11 20:03:06.537144 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2265/4468] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:03:06 2022] POST /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:06.547647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-69f25855-6f95-4554-bddd-e95d93b48a9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:06.548757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-69f25855-6f95-4554-bddd-e95d93b48a9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:06.562318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69f25855-6f95-4554-bddd-e95d93b48a9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.562546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69f25855-6f95-4554-bddd-e95d93b48a9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.563150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69f25855-6f95-4554-bddd-e95d93b48a9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.567516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69f25855-6f95-4554-bddd-e95d93b48a9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.568078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69f25855-6f95-4554-bddd-e95d93b48a9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.569101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69f25855-6f95-4554-bddd-e95d93b48a9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.657848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:06.674115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:06.677666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:06.679245 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cb1c4b1f-467c-41f1-8ba0-c88807b161db tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1406 microversion: 2.20 time: 0.441928 Oct 11 20:03:06.680476 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2204/4469] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:03:06 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:03:06.724327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5e90dde-db90-4c96-a5ff-8bc8f5da5240 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83c75e4d30>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:06.784407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-c5e90dde-db90-4c96-a5ff-8bc8f5da5240 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a2e7f324-843c-489b-897f-7ae4d73baa7f does not exist", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 20:03:06.785093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.security_group_api [None req-c5e90dde-db90-4c96-a5ff-8bc8f5da5240 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Neutron security group a2e7f324-843c-489b-897f-7ae4d73baa7f not found {{(pid=126955) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 20:03:06.785648 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c5e90dde-db90-4c96-a5ff-8bc8f5da5240 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] HTTP exception thrown: Security group a2e7f324-843c-489b-897f-7ae4d73baa7f does not exist Oct 11 20:03:06.785648 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-2ee271bf-4772-4a53-9a18-d8424c061ba8'] Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5e90dde-db90-4c96-a5ff-8bc8f5da5240 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Request method failure captured: Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-security-groups/a2e7f324-843c-489b-897f-7ae4d73baa7f HTTP/1.1 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcvkSxc8uyvrr9l8_nHnn5epx_n39r6V09Hzt5byoJfD_J8Ro0A9F1jm-gSiHH50G6eS7iQgXMsQMM77Om0SPfl-ZZCvjNHRxF_Wz426GVt9C7-N7DGxSX4Ap1uW9V_ixstVOtbIr07eWV6NN2P3d7-ZUSVzg_mrhGvNtayORLdu-u8 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 36233b5559fc4e27bfe3494056060f00 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2095450331 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36233b5559fc4e27bfe3494056060f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36233b5559fc4e27bfe3494056060f00", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36233b5559fc4e27bfe3494056060f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36233b5559fc4e27bfe3494056060f00"}]}] Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2095450331 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 36233b5559fc4e27bfe3494056060f00 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2095450331 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-SecurityGroupRulesTestJSON-2095450331-project Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: ae177ec77d9e49b1b1da1714e8607a23 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2095450331-project Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: exception: Security group a2e7f324-843c-489b-897f-7ae4d73baa7f does not exist Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-2ee271bf-4772-4a53-9a18-d8424c061ba8'] Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a2e7f324-843c-489b-897f-7ae4d73baa7f'} Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 20:03:06.788132 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a2e7f324-843c-489b-897f-7ae4d73baa7f does not exist Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ee271bf-4772-4a53-9a18-d8424c061ba8'] Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a2e7f324-843c-489b-897f-7ae4d73baa7f does not exist Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ee271bf-4772-4a53-9a18-d8424c061ba8'] Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a2e7f324-843c-489b-897f-7ae4d73baa7f does not exist Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ee271bf-4772-4a53-9a18-d8424c061ba8'] Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a2e7f324-843c-489b-897f-7ae4d73baa7f does not exist Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ee271bf-4772-4a53-9a18-d8424c061ba8'] Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5e90dde-db90-4c96-a5ff-8bc8f5da5240 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Returning 404 to user: Security group a2e7f324-843c-489b-897f-7ae4d73baa7f does not exist Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-2ee271bf-4772-4a53-9a18-d8424c061ba8'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c5e90dde-db90-4c96-a5ff-8bc8f5da5240 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a2e7f324-843c-489b-897f-7ae4d73baa7f" status: 404 len: 194 microversion: 2.1 time: 0.080999 Oct 11 20:03:06.794217 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2205/4470] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:03:06 2022] DELETE /compute/v2.1/os-security-groups/a2e7f324-843c-489b-897f-7ae4d73baa7f => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:06.802088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5c9efc18-e252-4e61-b91f-3ddb51e56b6b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:06.802743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5c9efc18-e252-4e61-b91f-3ddb51e56b6b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:06.877749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-69f25855-6f95-4554-bddd-e95d93b48a9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:06.891237 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-69f25855-6f95-4554-bddd-e95d93b48a9c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1309 microversion: 2.1 time: 0.352006 Oct 11 20:03:06.893850 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2266/4471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:06 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1309 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:06.902256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-20ba72cf-ad6b-4fe9-bc50-2ea0e512b243 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:06.904835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-20ba72cf-ad6b-4fe9-bc50-2ea0e512b243 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:06.913664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20ba72cf-ad6b-4fe9-bc50-2ea0e512b243 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.914385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20ba72cf-ad6b-4fe9-bc50-2ea0e512b243 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.915014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20ba72cf-ad6b-4fe9-bc50-2ea0e512b243 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.916162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20ba72cf-ad6b-4fe9-bc50-2ea0e512b243 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:06.916880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20ba72cf-ad6b-4fe9-bc50-2ea0e512b243 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:06.917742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20ba72cf-ad6b-4fe9-bc50-2ea0e512b243 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:06.950642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5c9efc18-e252-4e61-b91f-3ddb51e56b6b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:06.958909 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5c9efc18-e252-4e61-b91f-3ddb51e56b6b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1213 microversion: 2.1 time: 0.164809 Oct 11 20:03:06.963186 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2206/4472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:06 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:06.973295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-14c80c54-495b-4932-8cba-0da3ab187b97 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83cc128040>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:07.142392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:07.505739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-20ba72cf-ad6b-4fe9-bc50-2ea0e512b243 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:07.516857 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-20ba72cf-ad6b-4fe9-bc50-2ea0e512b243 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1666 microversion: 2.1 time: 0.620870 Oct 11 20:03:07.517455 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2267/4473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:06 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1666 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:07.532350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3354052a-eba3-420c-a6fa-af10fda166e3 req-c5d26d58-d528-4299-ba2f-547bcfe760c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a125d45-79ec-4fda-9601-334c311a9f7a", "tag": "e4e15471-dfd8-4f5d-be37-fdddaa52dfc8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:07.553982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3354052a-eba3-420c-a6fa-af10fda166e3 req-c5d26d58-d528-4299-ba2f-547bcfe760c4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:07.554641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3354052a-eba3-420c-a6fa-af10fda166e3 req-c5d26d58-d528-4299-ba2f-547bcfe760c4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:07.555075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3354052a-eba3-420c-a6fa-af10fda166e3 req-c5d26d58-d528-4299-ba2f-547bcfe760c4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:07.598415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3354052a-eba3-420c-a6fa-af10fda166e3 req-c5d26d58-d528-4299-ba2f-547bcfe760c4 service nova] Creating event network-changed:e4e15471-dfd8-4f5d-be37-fdddaa52dfc8 for instance 7a125d45-79ec-4fda-9601-334c311a9f7a on n-h1-860864-3 Oct 11 20:03:07.619033 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3354052a-eba3-420c-a6fa-af10fda166e3 req-c5d26d58-d528-4299-ba2f-547bcfe760c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099086 Oct 11 20:03:07.631159 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2268/4474] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:07.693443 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-14c80c54-495b-4932-8cba-0da3ab187b97 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b424c6cd-bcf3-41b0-b997-3994c423d275" status: 202 len: 0 microversion: 2.1 time: 0.728894 Oct 11 20:03:07.694233 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2207/4475] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:03:06 2022] DELETE /compute/v2.1/os-security-groups/b424c6cd-bcf3-41b0-b997-3994c423d275 => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:07.708914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e6b6d881-1bc5-4f02-aec8-c4bfbadaef57 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83c72afe50>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:07.709937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:07.710716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:07.721982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:07.722587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:07.723159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:07.723887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:07.724346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:07.724952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:08.261976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:08.274390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:08.277343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:08.281640 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a2eb42a2-8164-4acd-b8b6-aed6d8b334ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1406 microversion: 2.20 time: 0.575723 Oct 11 20:03:08.284603 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2208/4476] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:03:07 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1406 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:03:08.295294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc86545f-3e7c-4f8c-86f0-5c0ac8582f8c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:08.296155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc86545f-3e7c-4f8c-86f0-5c0ac8582f8c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:08.307222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc86545f-3e7c-4f8c-86f0-5c0ac8582f8c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:08.307924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc86545f-3e7c-4f8c-86f0-5c0ac8582f8c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:08.309666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc86545f-3e7c-4f8c-86f0-5c0ac8582f8c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:08.311261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc86545f-3e7c-4f8c-86f0-5c0ac8582f8c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:08.311899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc86545f-3e7c-4f8c-86f0-5c0ac8582f8c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:08.312836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc86545f-3e7c-4f8c-86f0-5c0ac8582f8c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:08.387160 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e6b6d881-1bc5-4f02-aec8-c4bfbadaef57 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3020ef57-230d-42d4-8d72-c382defe77ce" status: 202 len: 0 microversion: 2.1 time: 0.685726 Oct 11 20:03:08.388714 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2269/4477] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:03:07 2022] DELETE /compute/v2.1/os-security-groups/3020ef57-230d-42d4-8d72-c382defe77ce => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:08.394800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1d05703e-7ddb-46a6-ae77-4fce60768d4c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:08.395917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1d05703e-7ddb-46a6-ae77-4fce60768d4c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:08.408017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d05703e-7ddb-46a6-ae77-4fce60768d4c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:08.408865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d05703e-7ddb-46a6-ae77-4fce60768d4c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:08.409511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d05703e-7ddb-46a6-ae77-4fce60768d4c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:08.410426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d05703e-7ddb-46a6-ae77-4fce60768d4c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:08.411124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d05703e-7ddb-46a6-ae77-4fce60768d4c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:08.411771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d05703e-7ddb-46a6-ae77-4fce60768d4c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:09.158861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1d05703e-7ddb-46a6-ae77-4fce60768d4c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:09.167581 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1d05703e-7ddb-46a6-ae77-4fce60768d4c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1265 microversion: 2.1 time: 0.777609 Oct 11 20:03:09.179344 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2270/4478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:08 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1265 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:09.184515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bce813e3-4453-4aae-8f31-b96d49b6a83f tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83c728ff70>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:09.422874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fc86545f-3e7c-4f8c-86f0-5c0ac8582f8c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:09.462060 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc86545f-3e7c-4f8c-86f0-5c0ac8582f8c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1309 microversion: 2.1 time: 1.174337 Oct 11 20:03:09.472396 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2209/4479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:08 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1309 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:09.482282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1034075e-9cfa-44d1-b8d7-f18a6b2c65c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:09.483330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1034075e-9cfa-44d1-b8d7-f18a6b2c65c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:09.490267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1034075e-9cfa-44d1-b8d7-f18a6b2c65c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:09.490951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1034075e-9cfa-44d1-b8d7-f18a6b2c65c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:09.491583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1034075e-9cfa-44d1-b8d7-f18a6b2c65c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:09.492367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1034075e-9cfa-44d1-b8d7-f18a6b2c65c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:09.493120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1034075e-9cfa-44d1-b8d7-f18a6b2c65c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:09.493767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1034075e-9cfa-44d1-b8d7-f18a6b2c65c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:09.882573 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bce813e3-4453-4aae-8f31-b96d49b6a83f tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/07766f43-2909-4df3-92f4-49175d66061e" status: 202 len: 0 microversion: 2.1 time: 0.701389 Oct 11 20:03:09.883866 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2271/4480] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:03:09 2022] DELETE /compute/v2.1/os-security-groups/07766f43-2909-4df3-92f4-49175d66061e => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:09.893685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:09.894798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1034075e-9cfa-44d1-b8d7-f18a6b2c65c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:09.895553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:09.908479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:09.909249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:09.910098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:09.911218 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1034075e-9cfa-44d1-b8d7-f18a6b2c65c8 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1666 microversion: 2.1 time: 0.433163 Oct 11 20:03:09.911218 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2210/4481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:09 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1666 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:09.928752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c1b29fe4-e281-439c-b657-39e663664859 req-7ca62e83-e529-47f6-a2bc-49b6562e328a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3d25fc4-9e9d-446b-b301-de855a5df2cf", "tag": "5dbcd3b3-f4cf-478d-b105-2d821a707380"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:09.929880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:09.930403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:09.932175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:09.949736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c1b29fe4-e281-439c-b657-39e663664859 req-7ca62e83-e529-47f6-a2bc-49b6562e328a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:09.950229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c1b29fe4-e281-439c-b657-39e663664859 req-7ca62e83-e529-47f6-a2bc-49b6562e328a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:09.950696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c1b29fe4-e281-439c-b657-39e663664859 req-7ca62e83-e529-47f6-a2bc-49b6562e328a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:09.968997 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c1b29fe4-e281-439c-b657-39e663664859 req-7ca62e83-e529-47f6-a2bc-49b6562e328a service nova] Creating event network-changed:5dbcd3b3-f4cf-478d-b105-2d821a707380 for instance b3d25fc4-9e9d-446b-b301-de855a5df2cf on n-h2-860864-3 Oct 11 20:03:09.979990 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c1b29fe4-e281-439c-b657-39e663664859 req-7ca62e83-e529-47f6-a2bc-49b6562e328a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067609 Oct 11 20:03:09.980916 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2211/4482] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:09.986235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b4474e6b-cf8a-4171-8a03-537a2602bee2 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83d0666ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:10.513136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:10.531970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:10.534001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:10.539549 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-94cb63b8-d84a-43d2-8a80-7f782c000510 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1406 microversion: 2.20 time: 0.654250 Oct 11 20:03:10.555576 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2272/4483] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:03:09 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1406 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:03:10.568636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3ba7e24a-d476-4a70-9539-820037d56556 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:10.576018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3ba7e24a-d476-4a70-9539-820037d56556 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:10.583468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ba7e24a-d476-4a70-9539-820037d56556 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:10.584807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ba7e24a-d476-4a70-9539-820037d56556 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:10.585408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ba7e24a-d476-4a70-9539-820037d56556 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:10.586541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ba7e24a-d476-4a70-9539-820037d56556 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:10.587151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ba7e24a-d476-4a70-9539-820037d56556 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:10.587737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ba7e24a-d476-4a70-9539-820037d56556 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:10.817481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3ba7e24a-d476-4a70-9539-820037d56556 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:10.826252 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3ba7e24a-d476-4a70-9539-820037d56556 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1271 microversion: 2.1 time: 0.261472 Oct 11 20:03:10.839062 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2273/4484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:10 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:10.840176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-57d040b2-20f9-4670-9c09-37abe72647ef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:10.840790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-57d040b2-20f9-4670-9c09-37abe72647ef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:10.859235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57d040b2-20f9-4670-9c09-37abe72647ef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:10.859821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57d040b2-20f9-4670-9c09-37abe72647ef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:10.860642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57d040b2-20f9-4670-9c09-37abe72647ef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:10.861630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57d040b2-20f9-4670-9c09-37abe72647ef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:10.862168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57d040b2-20f9-4670-9c09-37abe72647ef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:10.862755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57d040b2-20f9-4670-9c09-37abe72647ef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:11.323013 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b4474e6b-cf8a-4171-8a03-537a2602bee2 tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f83bbf59-fe73-418b-a4e1-72e1ab6c6a2a" status: 202 len: 0 microversion: 2.1 time: 1.340715 Oct 11 20:03:11.325901 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2212/4485] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:03:09 2022] DELETE /compute/v2.1/os-security-groups/f83bbf59-fe73-418b-a4e1-72e1ab6c6a2a => generated 0 bytes in 1344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:11.335846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5eb8bcac-ac81-4849-8c8e-2ab2a44e7f51 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:11.337926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5eb8bcac-ac81-4849-8c8e-2ab2a44e7f51 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:11.351881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eb8bcac-ac81-4849-8c8e-2ab2a44e7f51 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:11.352679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eb8bcac-ac81-4849-8c8e-2ab2a44e7f51 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:11.353304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eb8bcac-ac81-4849-8c8e-2ab2a44e7f51 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:11.354195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eb8bcac-ac81-4849-8c8e-2ab2a44e7f51 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:11.354848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eb8bcac-ac81-4849-8c8e-2ab2a44e7f51 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:11.355435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eb8bcac-ac81-4849-8c8e-2ab2a44e7f51 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:11.468770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-57d040b2-20f9-4670-9c09-37abe72647ef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:11.481884 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-57d040b2-20f9-4670-9c09-37abe72647ef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1309 microversion: 2.1 time: 0.645485 Oct 11 20:03:11.483803 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2274/4486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:10 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1309 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:11.489459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ea08b450-0a10-4879-8a2e-c199bde3cc14 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:11.490874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ea08b450-0a10-4879-8a2e-c199bde3cc14 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:11.507280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea08b450-0a10-4879-8a2e-c199bde3cc14 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:11.508073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea08b450-0a10-4879-8a2e-c199bde3cc14 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:11.508528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea08b450-0a10-4879-8a2e-c199bde3cc14 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:11.509439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea08b450-0a10-4879-8a2e-c199bde3cc14 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:11.510070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea08b450-0a10-4879-8a2e-c199bde3cc14 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:11.510726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ea08b450-0a10-4879-8a2e-c199bde3cc14 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:12.030631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ea08b450-0a10-4879-8a2e-c199bde3cc14 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:12.048738 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ea08b450-0a10-4879-8a2e-c199bde3cc14 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.563329 Oct 11 20:03:12.049032 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2275/4487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:11 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:12.081130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9b9f75c9-1634-4f7f-836f-c26b19eec3ad tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] Calling method '.version_select at 0x7f83c7278940>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:12.296911 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5eb8bcac-ac81-4849-8c8e-2ab2a44e7f51 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1835 microversion: 2.1 time: 0.967404 Oct 11 20:03:12.311043 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2213/4488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:11 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1835 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:12.314998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:12.316351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:12.328252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:12.329094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:12.329308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:12.329985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:12.330518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:12.330937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:12.752369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:12.764565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:12.778659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:12.780368 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3cc5084c-2939-4e14-8dcb-d2e0971d5c66 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1406 microversion: 2.20 time: 0.473486 Oct 11 20:03:12.781260 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2214/4489] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:03:12 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1406 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:03:12.785813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bbea8039-5645-4a38-9e3d-d0213803e517 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:12.786638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bbea8039-5645-4a38-9e3d-d0213803e517 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:12.801235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbea8039-5645-4a38-9e3d-d0213803e517 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:12.802062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbea8039-5645-4a38-9e3d-d0213803e517 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:12.802498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbea8039-5645-4a38-9e3d-d0213803e517 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:12.803820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbea8039-5645-4a38-9e3d-d0213803e517 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:12.810570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbea8039-5645-4a38-9e3d-d0213803e517 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:12.811346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbea8039-5645-4a38-9e3d-d0213803e517 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:12.841069 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9b9f75c9-1634-4f7f-836f-c26b19eec3ad tempest-SecurityGroupRulesTestJSON-2095450331 tempest-SecurityGroupRulesTestJSON-2095450331-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/700620c1-d5f3-4ed2-bb6d-08d1e35a7836" status: 202 len: 0 microversion: 2.1 time: 0.788998 Oct 11 20:03:12.845418 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2276/4490] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:03:12 2022] DELETE /compute/v2.1/os-security-groups/700620c1-d5f3-4ed2-bb6d-08d1e35a7836 => generated 0 bytes in 794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:12.851033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-874bf436-81a2-43e1-aad5-ba64104b7eec tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:12.851890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-874bf436-81a2-43e1-aad5-ba64104b7eec tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:12.871820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874bf436-81a2-43e1-aad5-ba64104b7eec tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:12.874901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874bf436-81a2-43e1-aad5-ba64104b7eec tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:12.875348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874bf436-81a2-43e1-aad5-ba64104b7eec tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:12.876075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874bf436-81a2-43e1-aad5-ba64104b7eec tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:12.876531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874bf436-81a2-43e1-aad5-ba64104b7eec tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:12.880349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-874bf436-81a2-43e1-aad5-ba64104b7eec tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:13.494953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bbea8039-5645-4a38-9e3d-d0213803e517 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:13.505016 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bbea8039-5645-4a38-9e3d-d0213803e517 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1313 microversion: 2.1 time: 0.722654 Oct 11 20:03:13.506393 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2215/4491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:12 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1313 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:13.511813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4c4c5ff8-f896-4d7f-a2e2-9a1d19098b23 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:13.512738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4c4c5ff8-f896-4d7f-a2e2-9a1d19098b23 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:13.522483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4c5ff8-f896-4d7f-a2e2-9a1d19098b23 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:13.523433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4c5ff8-f896-4d7f-a2e2-9a1d19098b23 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:13.524380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4c5ff8-f896-4d7f-a2e2-9a1d19098b23 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:13.525265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4c5ff8-f896-4d7f-a2e2-9a1d19098b23 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:13.525917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4c5ff8-f896-4d7f-a2e2-9a1d19098b23 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:13.526424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c4c5ff8-f896-4d7f-a2e2-9a1d19098b23 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:13.566750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-874bf436-81a2-43e1-aad5-ba64104b7eec tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:13.576564 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-874bf436-81a2-43e1-aad5-ba64104b7eec tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1669 microversion: 2.1 time: 0.728995 Oct 11 20:03:13.577848 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2277/4492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:12 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1669 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:13.582982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e8900f3-3f9b-43eb-89be-e6e2bc6a054e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:13.584506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e8900f3-3f9b-43eb-89be-e6e2bc6a054e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:13.591237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e8900f3-3f9b-43eb-89be-e6e2bc6a054e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:13.592079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e8900f3-3f9b-43eb-89be-e6e2bc6a054e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:13.592742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e8900f3-3f9b-43eb-89be-e6e2bc6a054e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:13.593809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e8900f3-3f9b-43eb-89be-e6e2bc6a054e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:13.594492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e8900f3-3f9b-43eb-89be-e6e2bc6a054e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:13.595103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e8900f3-3f9b-43eb-89be-e6e2bc6a054e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:13.963944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e8900f3-3f9b-43eb-89be-e6e2bc6a054e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:13.973616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4c4c5ff8-f896-4d7f-a2e2-9a1d19098b23 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:13.978036 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e8900f3-3f9b-43eb-89be-e6e2bc6a054e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1309 microversion: 2.1 time: 0.398675 Oct 11 20:03:13.981797 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2278/4493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:13 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1309 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:13.994374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a93a2c0c-24e8-4f3e-a004-9c87f2aebf04 req-0bece64d-d52d-4966-aba5-e994a33d2e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a125d45-79ec-4fda-9601-334c311a9f7a", "name": "network-vif-plugged", "status": "completed", "tag": "e4e15471-dfd8-4f5d-be37-fdddaa52dfc8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:13.998999 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4c4c5ff8-f896-4d7f-a2e2-9a1d19098b23 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1684 microversion: 2.1 time: 0.486893 Oct 11 20:03:14.001460 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2216/4494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:13 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1684 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:14.020951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a93a2c0c-24e8-4f3e-a004-9c87f2aebf04 req-0bece64d-d52d-4966-aba5-e994a33d2e78 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:14.021112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:14.022343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a93a2c0c-24e8-4f3e-a004-9c87f2aebf04 req-0bece64d-d52d-4966-aba5-e994a33d2e78 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:14.023047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a93a2c0c-24e8-4f3e-a004-9c87f2aebf04 req-0bece64d-d52d-4966-aba5-e994a33d2e78 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:14.025864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:14.044855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:14.046127 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a93a2c0c-24e8-4f3e-a004-9c87f2aebf04 req-0bece64d-d52d-4966-aba5-e994a33d2e78 service nova] Creating event network-vif-plugged:e4e15471-dfd8-4f5d-be37-fdddaa52dfc8 for instance 7a125d45-79ec-4fda-9601-334c311a9f7a on n-h1-860864-3 Oct 11 20:03:14.048306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:14.049836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:14.050778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:14.053880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:14.054573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:14.065675 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a93a2c0c-24e8-4f3e-a004-9c87f2aebf04 req-0bece64d-d52d-4966-aba5-e994a33d2e78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082110 Oct 11 20:03:14.066496 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2279/4495] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:14.085934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:14.086923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:14.102806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:14.105469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:14.106090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:14.107161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:14.110130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:14.110984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:14.192766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:03:14.213677 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.compute.api [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Working on deleting snapshot 4185b18c-5230-4eb9-8927-ad518889a9f9 from shelved instance... Oct 11 20:03:14.732857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:14.753474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:14.757319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:14.759685 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ad3aeb1d-a649-478e-baa4-bfedd8f8c859 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1406 microversion: 2.20 time: 0.691192 Oct 11 20:03:14.778295 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2280/4496] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:03:14 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1406 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:03:14.791387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8439f63b-9046-483a-817f-f366a0201431 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:14.800757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8439f63b-9046-483a-817f-f366a0201431 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:14.811907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8439f63b-9046-483a-817f-f366a0201431 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:14.813343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8439f63b-9046-483a-817f-f366a0201431 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:14.813960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8439f63b-9046-483a-817f-f366a0201431 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:14.815138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8439f63b-9046-483a-817f-f366a0201431 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:14.815818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8439f63b-9046-483a-817f-f366a0201431 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:14.816200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8439f63b-9046-483a-817f-f366a0201431 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:14.873779 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8439f63b-9046-483a-817f-f366a0201431 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8/action" status: 200 len: 32639 microversion: 2.1 time: 0.092810 Oct 11 20:03:14.875119 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2281/4497] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:03:14 2022] POST /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8/action => generated 32639 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:03:14.891147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d431040-3499-4ed2-8bdf-9d6ddfe8d316 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:14.892329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0d431040-3499-4ed2-8bdf-9d6ddfe8d316 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:14.909437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d431040-3499-4ed2-8bdf-9d6ddfe8d316 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:14.910175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d431040-3499-4ed2-8bdf-9d6ddfe8d316 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:14.910887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d431040-3499-4ed2-8bdf-9d6ddfe8d316 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:14.911749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d431040-3499-4ed2-8bdf-9d6ddfe8d316 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:14.913265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d431040-3499-4ed2-8bdf-9d6ddfe8d316 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:14.913841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d431040-3499-4ed2-8bdf-9d6ddfe8d316 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:14.942006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:15.234564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0d431040-3499-4ed2-8bdf-9d6ddfe8d316 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:15.250020 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0d431040-3499-4ed2-8bdf-9d6ddfe8d316 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.373521 Oct 11 20:03:15.264027 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2282/4498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:14 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:15.504035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e647ab8f-fb8d-42fa-8250-04f0668c292e tempest-ComputeTenantNetworksTest-1466564486 tempest-ComputeTenantNetworksTest-1466564486-project] Calling method '.version_select at 0x7f83c7333040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:15.626902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Doing local delete in cell 3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) {{(pid=126955) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 11 20:03:15.627854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:15.631256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:15.633854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:15.636982 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.compute.api [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 11 20:03:15.645239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] deallocate_for_instance() {{(pid=126955) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 11 20:03:16.116782 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e647ab8f-fb8d-42fa-8250-04f0668c292e tempest-ComputeTenantNetworksTest-1466564486 tempest-ComputeTenantNetworksTest-1466564486-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.847832 Oct 11 20:03:16.117377 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2283/4499] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 20:03:15 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:16.123989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c45bc36-c69f-4373-bf05-94e9b98d2bbb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:16.133571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c45bc36-c69f-4373-bf05-94e9b98d2bbb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:16.151961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c45bc36-c69f-4373-bf05-94e9b98d2bbb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:16.153265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c45bc36-c69f-4373-bf05-94e9b98d2bbb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:16.153747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c45bc36-c69f-4373-bf05-94e9b98d2bbb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:16.154483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c45bc36-c69f-4373-bf05-94e9b98d2bbb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:16.154987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c45bc36-c69f-4373-bf05-94e9b98d2bbb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:16.155422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c45bc36-c69f-4373-bf05-94e9b98d2bbb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:16.263984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:16.306703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=16 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:16.711559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c45bc36-c69f-4373-bf05-94e9b98d2bbb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:16.724508 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c45bc36-c69f-4373-bf05-94e9b98d2bbb tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1309 microversion: 2.1 time: 0.604676 Oct 11 20:03:16.728301 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2284/4500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:16 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1309 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:16.739463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:16.741015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:16.757291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:16.767221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:16.767707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:16.768647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:16.769191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:16.769692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:16.863845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2e0cf29f07504885ad494d5f0934c188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e08f08b81446e38ca4f9b7f1c4277a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:16.864469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] flavor_id is None. Assuming migration. {{(pid=126956) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 20:03:16.864969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126956) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:03:16.958700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=12 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:17.167566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Updating instance_info_cache with network_info: [] {{(pid=126955) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 20:03:17.570753 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-47c5a0f7-ab0f-467c-b835-72fe4ddb23bf tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8/action" status: 202 len: 0 microversion: 2.1 time: 0.839629 Oct 11 20:03:17.581809 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2285/4501] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:03:16 2022] POST /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8/action => generated 0 bytes in 851 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:17.596521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:17.601924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:17.607212 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6f92abdb-f7e7-4d74-bea5-c9daf13bf0fe tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "DELETE /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 204 len: 0 microversion: 2.1 time: 3.599597 Oct 11 20:03:17.608718 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2217/4502] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:03:14 2022] DELETE /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 0 bytes in 3606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:03:17.614368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5baa7201-4695-4102-b525-ab689c0e6e21 tempest-ComputeTenantNetworksTest-1466564486 tempest-ComputeTenantNetworksTest-1466564486-project] Calling method '.version_select at 0x7f83cc128670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:17.624300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:17.624808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:17.629109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:17.629899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:17.631659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:17.632121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:17.937843 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5baa7201-4695-4102-b525-ab689c0e6e21 tempest-ComputeTenantNetworksTest-1466564486 tempest-ComputeTenantNetworksTest-1466564486-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/95fd33bc-f225-4d2e-a8bf-958ee7331ba6" status: 200 len: 139 microversion: 2.1 time: 0.327725 Oct 11 20:03:17.938449 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2218/4503] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 20:03:17 2022] GET /compute/v2.1/os-tenant-networks/95fd33bc-f225-4d2e-a8bf-958ee7331ba6 => generated 139 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:17.946465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c1c635b2-463a-46d3-8d67-8644eb890dce req-0d0120b5-813f-4752-85e2-c0c18bc24c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d25fc4-9e9d-446b-b301-de855a5df2cf", "name": "network-vif-plugged", "status": "completed", "tag": "5dbcd3b3-f4cf-478d-b105-2d821a707380"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:17.986265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c1c635b2-463a-46d3-8d67-8644eb890dce req-0d0120b5-813f-4752-85e2-c0c18bc24c6b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:17.987356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c1c635b2-463a-46d3-8d67-8644eb890dce req-0d0120b5-813f-4752-85e2-c0c18bc24c6b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:17.989784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c1c635b2-463a-46d3-8d67-8644eb890dce req-0d0120b5-813f-4752-85e2-c0c18bc24c6b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:18.025442 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c1c635b2-463a-46d3-8d67-8644eb890dce req-0d0120b5-813f-4752-85e2-c0c18bc24c6b service nova] Creating event network-vif-plugged:5dbcd3b3-f4cf-478d-b105-2d821a707380 for instance b3d25fc4-9e9d-446b-b301-de855a5df2cf on n-h2-860864-3 Oct 11 20:03:18.040890 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c1c635b2-463a-46d3-8d67-8644eb890dce req-0d0120b5-813f-4752-85e2-c0c18bc24c6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101157 Oct 11 20:03:18.047040 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2219/4504] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:18.074969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c2e5d802-9c90-4ee9-ab58-004325fd34e5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:18.076168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c2e5d802-9c90-4ee9-ab58-004325fd34e5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:18.106571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2e5d802-9c90-4ee9-ab58-004325fd34e5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:18.110288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2e5d802-9c90-4ee9-ab58-004325fd34e5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:18.111050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2e5d802-9c90-4ee9-ab58-004325fd34e5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:18.117483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2e5d802-9c90-4ee9-ab58-004325fd34e5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:18.123783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2e5d802-9c90-4ee9-ab58-004325fd34e5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:18.124548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2e5d802-9c90-4ee9-ab58-004325fd34e5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:18.128009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:18.138401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:18.148103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:18.149552 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-db423b7b-fd11-4e52-a615-e39f0924e05e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1597 microversion: 2.20 time: 0.566369 Oct 11 20:03:18.152501 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2286/4505] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:03:17 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1597 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:03:18.157290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-5b9ce77f-4af2-4ef3-b239-d9d4c30a5625 req-bd06fc3e-7410-4a5e-a6f9-9abd88d64911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "745e09ac-b0bc-4fa9-86c4-ad943b8427a5", "tag": "02d72842-94b4-48eb-87f3-4f729164d162"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:18.201397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5b9ce77f-4af2-4ef3-b239-d9d4c30a5625 req-bd06fc3e-7410-4a5e-a6f9-9abd88d64911 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:18.201397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5b9ce77f-4af2-4ef3-b239-d9d4c30a5625 req-bd06fc3e-7410-4a5e-a6f9-9abd88d64911 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:18.201397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5b9ce77f-4af2-4ef3-b239-d9d4c30a5625 req-bd06fc3e-7410-4a5e-a6f9-9abd88d64911 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:18.232423 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-5b9ce77f-4af2-4ef3-b239-d9d4c30a5625 req-bd06fc3e-7410-4a5e-a6f9-9abd88d64911 service nova] Creating event network-changed:02d72842-94b4-48eb-87f3-4f729164d162 for instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 on n-h1-860864-3 Oct 11 20:03:18.243081 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-5b9ce77f-4af2-4ef3-b239-d9d4c30a5625 req-bd06fc3e-7410-4a5e-a6f9-9abd88d64911 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089256 Oct 11 20:03:18.244785 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2287/4506] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:18.252170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-441865c2-df79-4511-9d65-b0dd7d3586fb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:18.254818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-441865c2-df79-4511-9d65-b0dd7d3586fb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:18.265894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-441865c2-df79-4511-9d65-b0dd7d3586fb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:18.266563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-441865c2-df79-4511-9d65-b0dd7d3586fb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:18.268671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-441865c2-df79-4511-9d65-b0dd7d3586fb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:18.270951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-441865c2-df79-4511-9d65-b0dd7d3586fb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:18.272875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-441865c2-df79-4511-9d65-b0dd7d3586fb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:18.273637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-441865c2-df79-4511-9d65-b0dd7d3586fb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:18.869065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c2e5d802-9c90-4ee9-ab58-004325fd34e5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:18.883463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:18.886623 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c2e5d802-9c90-4ee9-ab58-004325fd34e5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.836472 Oct 11 20:03:18.888901 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2220/4507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:18 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:18.897046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:18.897870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 063e1df4-1fb8-4bbc-b6f4-59053268bb29] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:18.912106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:18.918077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:18.920075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:18.923946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:18.925452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:18.926842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:18.965104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-441865c2-df79-4511-9d65-b0dd7d3586fb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:18.991822 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-441865c2-df79-4511-9d65-b0dd7d3586fb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1693 microversion: 2.1 time: 0.741358 Oct 11 20:03:18.992860 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2288/4508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:18 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1693 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:19.001431 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] HTTP exception thrown: Instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29 could not be found. Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Request method failure captured: Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 HTTP/1.1 Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnI5OPNqEKALykkTrMulwNA85YH_Zdqz_g5mxxtFhZWzC1mgynXOwy-7XOBwQTjUtt_HFqth8q6PFQS1r46sN3cIfMotnurV3uQo5c99ZQnVSr2pWZn-5m3uVl2cj_7fGN0q1zKhyJks1DRVXwQGH05jJBBzz6HnW7DgJ8v9-VauHo Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efd1bdcd18f14e87925a5b41393b9add", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}] Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1914419120-project Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 0647dca89de240ba9fbc1c59ed2b6392 Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1914419120-project Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29 could not be found. Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '063e1df4-1fb8-4bbc-b6f4-59053268bb29'} Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29 could not be found. Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29 could not be found. Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:19.004021 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:19.009972 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:19.009972 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:19.009972 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:19.009972 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:19.009972 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:19.009972 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29 could not be found. Oct 11 20:03:19.009972 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:19.011570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Returning 404 to user: Instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:19.012630 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1758f5f8-92c7-44d7-968a-4f3d7e2127f0 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29" status: 404 len: 111 microversion: 2.1 time: 0.120186 Oct 11 20:03:19.017795 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2221/4509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:18 2022] GET /compute/v2.1/servers/063e1df4-1fb8-4bbc-b6f4-59053268bb29 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:19.025123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-00b95dcc-2b3f-444a-bb38-92c2854fcd3a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:19.025796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-00b95dcc-2b3f-444a-bb38-92c2854fcd3a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:19.029061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a4af608-47c7-457f-ae3a-077d5276e541 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:19.035869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a4af608-47c7-457f-ae3a-077d5276e541 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:19.039935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00b95dcc-2b3f-444a-bb38-92c2854fcd3a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:19.041290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00b95dcc-2b3f-444a-bb38-92c2854fcd3a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:19.041916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00b95dcc-2b3f-444a-bb38-92c2854fcd3a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:19.043180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00b95dcc-2b3f-444a-bb38-92c2854fcd3a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:19.043998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00b95dcc-2b3f-444a-bb38-92c2854fcd3a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:19.044594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00b95dcc-2b3f-444a-bb38-92c2854fcd3a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:19.106837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a4af608-47c7-457f-ae3a-077d5276e541 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:19.107650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a4af608-47c7-457f-ae3a-077d5276e541 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:19.108262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a4af608-47c7-457f-ae3a-077d5276e541 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:19.108987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a4af608-47c7-457f-ae3a-077d5276e541 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:19.109455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a4af608-47c7-457f-ae3a-077d5276e541 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:19.109938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a4af608-47c7-457f-ae3a-077d5276e541 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:19.780299 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-00b95dcc-2b3f-444a-bb38-92c2854fcd3a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.761019 Oct 11 20:03:19.781268 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2222/4510] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 11 20:03:19 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/os-interface => generated 284 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:03:19.786111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c2fd40b-4e87-4f90-ba91-ac95664f1aba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:19.786664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c2fd40b-4e87-4f90-ba91-ac95664f1aba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:19.801852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c2fd40b-4e87-4f90-ba91-ac95664f1aba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:19.802441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c2fd40b-4e87-4f90-ba91-ac95664f1aba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:19.803073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c2fd40b-4e87-4f90-ba91-ac95664f1aba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:19.803698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c2fd40b-4e87-4f90-ba91-ac95664f1aba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:19.806974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c2fd40b-4e87-4f90-ba91-ac95664f1aba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:19.807517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c2fd40b-4e87-4f90-ba91-ac95664f1aba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:19.856341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c2fd40b-4e87-4f90-ba91-ac95664f1aba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:03:19.995308 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c2fd40b-4e87-4f90-ba91-ac95664f1aba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 204 len: 0 microversion: 2.1 time: 0.209799 Oct 11 20:03:19.996330 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2223/4511] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:03:19 2022] DELETE /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:03:20.004559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d1ca889-de10-4ca8-80ca-2fd3bf401368 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:20.006950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0d1ca889-de10-4ca8-80ca-2fd3bf401368 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:20.037326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1ca889-de10-4ca8-80ca-2fd3bf401368 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:20.038168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1ca889-de10-4ca8-80ca-2fd3bf401368 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:20.038828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1ca889-de10-4ca8-80ca-2fd3bf401368 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:20.041644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1ca889-de10-4ca8-80ca-2fd3bf401368 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:20.042617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1ca889-de10-4ca8-80ca-2fd3bf401368 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:20.044349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d1ca889-de10-4ca8-80ca-2fd3bf401368 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:20.332313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a4af608-47c7-457f-ae3a-077d5276e541 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:20.342348 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a4af608-47c7-457f-ae3a-077d5276e541 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1309 microversion: 2.1 time: 1.339525 Oct 11 20:03:20.346818 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2289/4512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:18 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1309 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:20.356982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e3b84c3-266b-4fb8-be8f-8692525cdebb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:20.357845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e3b84c3-266b-4fb8-be8f-8692525cdebb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:20.382465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e3b84c3-266b-4fb8-be8f-8692525cdebb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:20.390487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e3b84c3-266b-4fb8-be8f-8692525cdebb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:20.391781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e3b84c3-266b-4fb8-be8f-8692525cdebb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:20.393341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e3b84c3-266b-4fb8-be8f-8692525cdebb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:20.394639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e3b84c3-266b-4fb8-be8f-8692525cdebb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:20.396495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e3b84c3-266b-4fb8-be8f-8692525cdebb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:20.606130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e3b84c3-266b-4fb8-be8f-8692525cdebb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:20.615932 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e3b84c3-266b-4fb8-be8f-8692525cdebb tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1466 microversion: 2.1 time: 0.262716 Oct 11 20:03:20.616529 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2290/4513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:20 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1466 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:20.621074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-626db643-55ed-4e76-a0fe-eceabbaabf55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:20.621691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-626db643-55ed-4e76-a0fe-eceabbaabf55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:20.654249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0d1ca889-de10-4ca8-80ca-2fd3bf401368 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:20.659959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-626db643-55ed-4e76-a0fe-eceabbaabf55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:20.660380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-626db643-55ed-4e76-a0fe-eceabbaabf55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:20.661235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-626db643-55ed-4e76-a0fe-eceabbaabf55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:20.666507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-626db643-55ed-4e76-a0fe-eceabbaabf55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:20.667199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-626db643-55ed-4e76-a0fe-eceabbaabf55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:20.668923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-626db643-55ed-4e76-a0fe-eceabbaabf55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:20.696154 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0d1ca889-de10-4ca8-80ca-2fd3bf401368 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.698111 Oct 11 20:03:20.714665 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2224/4514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:19 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:20.720161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b02dcecb-1dea-47fb-a87a-bab7ef07545d req-bd1369cc-a0f8-4933-8775-34aaec24ed7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e1df4-1fb8-4bbc-b6f4-59053268bb29", "name": "network-vif-deleted", "tag": "971318c7-cccd-4204-b777-6b0137441143"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:20.734084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b02dcecb-1dea-47fb-a87a-bab7ef07545d req-bd1369cc-a0f8-4933-8775-34aaec24ed7e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:20.735238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b02dcecb-1dea-47fb-a87a-bab7ef07545d req-bd1369cc-a0f8-4933-8775-34aaec24ed7e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:20.735889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b02dcecb-1dea-47fb-a87a-bab7ef07545d req-bd1369cc-a0f8-4933-8775-34aaec24ed7e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:20.749849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.compute.server_external_events [req-b02dcecb-1dea-47fb-a87a-bab7ef07545d req-bd1369cc-a0f8-4933-8775-34aaec24ed7e service nova] Unable to find a host for instance 063e1df4-1fb8-4bbc-b6f4-59053268bb29. Dropping event network-vif-deleted {{(pid=126955) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 20:03:20.751124 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b02dcecb-1dea-47fb-a87a-bab7ef07545d req-bd1369cc-a0f8-4933-8775-34aaec24ed7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.035197 Oct 11 20:03:20.752253 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2225/4515] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 20:03:21.147610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-626db643-55ed-4e76-a0fe-eceabbaabf55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:21.156360 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-626db643-55ed-4e76-a0fe-eceabbaabf55 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1693 microversion: 2.1 time: 0.538815 Oct 11 20:03:21.161807 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2291/4516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:20 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1693 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:21.373577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-158002ad-f3da-44f4-a281-cd8494a46548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:21.375978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-158002ad-f3da-44f4-a281-cd8494a46548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:21.386303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-158002ad-f3da-44f4-a281-cd8494a46548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:21.388812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-158002ad-f3da-44f4-a281-cd8494a46548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:21.389260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-158002ad-f3da-44f4-a281-cd8494a46548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:21.389975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-158002ad-f3da-44f4-a281-cd8494a46548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:21.391311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-158002ad-f3da-44f4-a281-cd8494a46548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:21.391898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-158002ad-f3da-44f4-a281-cd8494a46548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:21.641703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ca5614f-92e5-49b5-bd1f-27d0d871d8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:21.642970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0ca5614f-92e5-49b5-bd1f-27d0d871d8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:21.655628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca5614f-92e5-49b5-bd1f-27d0d871d8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:21.656402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca5614f-92e5-49b5-bd1f-27d0d871d8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:21.656993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca5614f-92e5-49b5-bd1f-27d0d871d8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:21.657923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca5614f-92e5-49b5-bd1f-27d0d871d8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:21.658616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca5614f-92e5-49b5-bd1f-27d0d871d8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:21.659293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ca5614f-92e5-49b5-bd1f-27d0d871d8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:22.005937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0ca5614f-92e5-49b5-bd1f-27d0d871d8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:22.015966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-158002ad-f3da-44f4-a281-cd8494a46548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:22.018458 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0ca5614f-92e5-49b5-bd1f-27d0d871d8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 200 len: 1466 microversion: 2.1 time: 0.380602 Oct 11 20:03:22.022875 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2292/4517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:21 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 1466 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:22.036867 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-158002ad-f3da-44f4-a281-cd8494a46548 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1490 microversion: 2.1 time: 0.671030 Oct 11 20:03:22.038041 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2226/4518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:21 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1490 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:22.070011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3ac419d6-e638-4b8a-a74e-65c9e19dced8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-817666069"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:22.073358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c4a1569d-a717-4054-bfb0-55ba472d02dd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:22.073524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3ac419d6-e638-4b8a-a74e-65c9e19dced8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:22.075932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c4a1569d-a717-4054-bfb0-55ba472d02dd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:22.092482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac419d6-e638-4b8a-a74e-65c9e19dced8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:22.097289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac419d6-e638-4b8a-a74e-65c9e19dced8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:22.097734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac419d6-e638-4b8a-a74e-65c9e19dced8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:22.098472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac419d6-e638-4b8a-a74e-65c9e19dced8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:22.099000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac419d6-e638-4b8a-a74e-65c9e19dced8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:22.099482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac419d6-e638-4b8a-a74e-65c9e19dced8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:22.100876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4a1569d-a717-4054-bfb0-55ba472d02dd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:22.101455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4a1569d-a717-4054-bfb0-55ba472d02dd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:22.102011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4a1569d-a717-4054-bfb0-55ba472d02dd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:22.103102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4a1569d-a717-4054-bfb0-55ba472d02dd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:22.103562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4a1569d-a717-4054-bfb0-55ba472d02dd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:22.107222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4a1569d-a717-4054-bfb0-55ba472d02dd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:22.304734 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3ac419d6-e638-4b8a-a74e-65c9e19dced8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "PUT /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1074 microversion: 2.1 time: 0.239195 Oct 11 20:03:22.322446 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2227/4519] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 11 20:03:22 2022] PUT /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1074 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:22.329555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0648de39-df48-49cb-bf14-d3a22cb9d769 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:22.331023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0648de39-df48-49cb-bf14-d3a22cb9d769 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:22.349707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0648de39-df48-49cb-bf14-d3a22cb9d769 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:22.350785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0648de39-df48-49cb-bf14-d3a22cb9d769 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:22.352472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0648de39-df48-49cb-bf14-d3a22cb9d769 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:22.354275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0648de39-df48-49cb-bf14-d3a22cb9d769 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:22.355292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0648de39-df48-49cb-bf14-d3a22cb9d769 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:22.355901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0648de39-df48-49cb-bf14-d3a22cb9d769 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:23.459805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c4a1569d-a717-4054-bfb0-55ba472d02dd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:23.471281 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c4a1569d-a717-4054-bfb0-55ba472d02dd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 1.447047 Oct 11 20:03:23.472821 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2293/4520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:22 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:23.494304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-17916b5f-1d67-4511-b001-d26482426d33 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:23.496293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-17916b5f-1d67-4511-b001-d26482426d33 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:23.518213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17916b5f-1d67-4511-b001-d26482426d33 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:23.519743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17916b5f-1d67-4511-b001-d26482426d33 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:23.523095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17916b5f-1d67-4511-b001-d26482426d33 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:23.526804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17916b5f-1d67-4511-b001-d26482426d33 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:23.527543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17916b5f-1d67-4511-b001-d26482426d33 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:23.532995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17916b5f-1d67-4511-b001-d26482426d33 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:23.778782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0648de39-df48-49cb-bf14-d3a22cb9d769 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:23.804404 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0648de39-df48-49cb-bf14-d3a22cb9d769 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1693 microversion: 2.1 time: 1.479331 Oct 11 20:03:23.822551 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2228/4521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:22 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1693 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:23.839107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f99c05a2-5b79-4650-a638-cc62ef0bb72d req-20188eda-1216-465b-b5c7-e8e146f7b8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a125d45-79ec-4fda-9601-334c311a9f7a", "tag": "e4e15471-dfd8-4f5d-be37-fdddaa52dfc8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:23.861784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f99c05a2-5b79-4650-a638-cc62ef0bb72d req-20188eda-1216-465b-b5c7-e8e146f7b8db service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:23.863423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f99c05a2-5b79-4650-a638-cc62ef0bb72d req-20188eda-1216-465b-b5c7-e8e146f7b8db service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:23.870862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f99c05a2-5b79-4650-a638-cc62ef0bb72d req-20188eda-1216-465b-b5c7-e8e146f7b8db service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:23.897761 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f99c05a2-5b79-4650-a638-cc62ef0bb72d req-20188eda-1216-465b-b5c7-e8e146f7b8db service nova] Creating event network-changed:e4e15471-dfd8-4f5d-be37-fdddaa52dfc8 for instance 7a125d45-79ec-4fda-9601-334c311a9f7a on n-h1-860864-3 Oct 11 20:03:23.907922 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f99c05a2-5b79-4650-a638-cc62ef0bb72d req-20188eda-1216-465b-b5c7-e8e146f7b8db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094084 Oct 11 20:03:23.913437 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2229/4522] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:23.931006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:23.931730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 4014c74c-a02a-44d4-a85e-9288ae8758b8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:23.960408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:23.965062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:23.966752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:23.974488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:23.977443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:23.978861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:23.980118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.026875 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] HTTP exception thrown: Instance 4014c74c-a02a-44d4-a85e-9288ae8758b8 could not be found. Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Request method failure captured: Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 HTTP/1.1 Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcnI5OPNqEKALykkTrMulwNA85YH_Zdqz_g5mxxtFhZWzC1mgynXOwy-7XOBwQTjUtt_HFqth8q6PFQS1r46sN3cIfMotnurV3uQo5c99ZQnVSr2pWZn-5m3uVl2cj_7fGN0q1zKhyJks1DRVXwQGH05jJBBzz6HnW7DgJ8v9-VauHo Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efd1bdcd18f14e87925a5b41393b9add", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}] Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1914419120-project Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 0647dca89de240ba9fbc1c59ed2b6392 Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1914419120-project Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 4014c74c-a02a-44d4-a85e-9288ae8758b8 could not be found. Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '4014c74c-a02a-44d4-a85e-9288ae8758b8'} Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4014c74c-a02a-44d4-a85e-9288ae8758b8 could not be found. Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4014c74c-a02a-44d4-a85e-9288ae8758b8 could not be found. Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:24.037922 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:24.041876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:24.041876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:24.041876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:24.041876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:24.041876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:24.041876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4014c74c-a02a-44d4-a85e-9288ae8758b8 could not be found. Oct 11 20:03:24.041876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:24.041876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Returning 404 to user: Instance 4014c74c-a02a-44d4-a85e-9288ae8758b8 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:24.043552 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f80d2b54-abf4-4318-afd3-8e314e511b1d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8" status: 404 len: 111 microversion: 2.1 time: 0.126801 Oct 11 20:03:24.045262 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2230/4523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:23 2022] GET /compute/v2.1/servers/4014c74c-a02a-44d4-a85e-9288ae8758b8 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:24.064343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-beb7b420-79ea-420f-8806-48b223894bb3 req-9c37bfe8-f174-4b9e-b2a9-cc823cb77368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "745e09ac-b0bc-4fa9-86c4-ad943b8427a5", "tag": "aadd1b7d-28d7-48a9-a479-ec6ead0843c3"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:24.131040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-beb7b420-79ea-420f-8806-48b223894bb3 req-9c37bfe8-f174-4b9e-b2a9-cc823cb77368 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.133472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-beb7b420-79ea-420f-8806-48b223894bb3 req-9c37bfe8-f174-4b9e-b2a9-cc823cb77368 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.134276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-beb7b420-79ea-420f-8806-48b223894bb3 req-9c37bfe8-f174-4b9e-b2a9-cc823cb77368 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.178162 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-beb7b420-79ea-420f-8806-48b223894bb3 req-9c37bfe8-f174-4b9e-b2a9-cc823cb77368 service nova] Creating event network-changed:aadd1b7d-28d7-48a9-a479-ec6ead0843c3 for instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 on n-h1-860864-3 Oct 11 20:03:24.201488 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-beb7b420-79ea-420f-8806-48b223894bb3 req-9c37bfe8-f174-4b9e-b2a9-cc823cb77368 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152863 Oct 11 20:03:24.205264 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2231/4524] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:24.226416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c381c407-7e16-4885-8119-aac97ed4a51b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:24.232168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c381c407-7e16-4885-8119-aac97ed4a51b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:24.259809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c381c407-7e16-4885-8119-aac97ed4a51b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.262344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c381c407-7e16-4885-8119-aac97ed4a51b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.262926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c381c407-7e16-4885-8119-aac97ed4a51b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.266706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c381c407-7e16-4885-8119-aac97ed4a51b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.268170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c381c407-7e16-4885-8119-aac97ed4a51b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.269057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c381c407-7e16-4885-8119-aac97ed4a51b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.347430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c381c407-7e16-4885-8119-aac97ed4a51b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:03:24.362983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-17916b5f-1d67-4511-b001-d26482426d33 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:24.375659 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-17916b5f-1d67-4511-b001-d26482426d33 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1500 microversion: 2.1 time: 0.899075 Oct 11 20:03:24.381639 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2294/4525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:23 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1500 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:24.415614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0dfd0a0e-7b8c-450a-9b95-092ff7678358 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:24.417714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0dfd0a0e-7b8c-450a-9b95-092ff7678358 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:24.441827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dfd0a0e-7b8c-450a-9b95-092ff7678358 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.446215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dfd0a0e-7b8c-450a-9b95-092ff7678358 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.448030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dfd0a0e-7b8c-450a-9b95-092ff7678358 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.449556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dfd0a0e-7b8c-450a-9b95-092ff7678358 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.450061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dfd0a0e-7b8c-450a-9b95-092ff7678358 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.452275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0dfd0a0e-7b8c-450a-9b95-092ff7678358 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.517366 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c381c407-7e16-4885-8119-aac97ed4a51b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 204 len: 0 microversion: 2.1 time: 0.308374 Oct 11 20:03:24.518554 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2232/4526] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:03:24 2022] DELETE /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:03:24.527895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e1f064cb-f8a4-4742-84dc-f66b529305d5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:24.535327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e1f064cb-f8a4-4742-84dc-f66b529305d5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:24.551072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f064cb-f8a4-4742-84dc-f66b529305d5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.551581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f064cb-f8a4-4742-84dc-f66b529305d5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.552064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f064cb-f8a4-4742-84dc-f66b529305d5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.554077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f064cb-f8a4-4742-84dc-f66b529305d5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.554560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f064cb-f8a4-4742-84dc-f66b529305d5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.555190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f064cb-f8a4-4742-84dc-f66b529305d5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.819871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0dfd0a0e-7b8c-450a-9b95-092ff7678358 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:24.833162 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0dfd0a0e-7b8c-450a-9b95-092ff7678358 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1500 microversion: 2.1 time: 0.425619 Oct 11 20:03:24.838835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2295/4527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:24 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1500 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:24.849552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-de40bb84-d859-4090-816c-0dd067c67321 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:24.850386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-de40bb84-d859-4090-816c-0dd067c67321 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:24.857171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de40bb84-d859-4090-816c-0dd067c67321 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.858251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de40bb84-d859-4090-816c-0dd067c67321 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.858938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de40bb84-d859-4090-816c-0dd067c67321 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.859882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de40bb84-d859-4090-816c-0dd067c67321 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.860552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de40bb84-d859-4090-816c-0dd067c67321 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.861199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-de40bb84-d859-4090-816c-0dd067c67321 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.890897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e1f064cb-f8a4-4742-84dc-f66b529305d5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:24.901346 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e1f064cb-f8a4-4742-84dc-f66b529305d5 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.380500 Oct 11 20:03:24.901982 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2233/4528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:24 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:24.908372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d8dcb734-72f3-45a9-bb0b-f0a63a1c5085 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:24.908997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d8dcb734-72f3-45a9-bb0b-f0a63a1c5085 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:24.920690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8dcb734-72f3-45a9-bb0b-f0a63a1c5085 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.921875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8dcb734-72f3-45a9-bb0b-f0a63a1c5085 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.922686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8dcb734-72f3-45a9-bb0b-f0a63a1c5085 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:24.924192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8dcb734-72f3-45a9-bb0b-f0a63a1c5085 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:24.942441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8dcb734-72f3-45a9-bb0b-f0a63a1c5085 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:24.944280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8dcb734-72f3-45a9-bb0b-f0a63a1c5085 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:25.389292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-de40bb84-d859-4090-816c-0dd067c67321 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:25.400326 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-de40bb84-d859-4090-816c-0dd067c67321 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1508 microversion: 2.1 time: 0.560104 Oct 11 20:03:25.405376 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2296/4529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:24 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1508 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:25.419286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9edcb33f-7e95-49a5-a2e5-0285852939d9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:25.435361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9edcb33f-7e95-49a5-a2e5-0285852939d9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:25.435985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9edcb33f-7e95-49a5-a2e5-0285852939d9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:25.436664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9edcb33f-7e95-49a5-a2e5-0285852939d9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:25.489205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9edcb33f-7e95-49a5-a2e5-0285852939d9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Going to try to stop instance {{(pid=126956) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 20:03:25.513638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d8dcb734-72f3-45a9-bb0b-f0a63a1c5085 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:25.530378 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d8dcb734-72f3-45a9-bb0b-f0a63a1c5085 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1698 microversion: 2.1 time: 0.624237 Oct 11 20:03:25.531370 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2234/4530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:24 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1698 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:25.562227 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9edcb33f-7e95-49a5-a2e5-0285852939d9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "POST /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf/action" status: 202 len: 0 microversion: 2.1 time: 0.154963 Oct 11 20:03:25.562899 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2297/4531] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:03:25 2022] POST /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:25.572474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b7150ef-dab7-4b4d-89ce-27e28ef0c86b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:25.573221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b7150ef-dab7-4b4d-89ce-27e28ef0c86b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:25.586987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b7150ef-dab7-4b4d-89ce-27e28ef0c86b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:25.587589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b7150ef-dab7-4b4d-89ce-27e28ef0c86b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:25.590710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b7150ef-dab7-4b4d-89ce-27e28ef0c86b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:25.592913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b7150ef-dab7-4b4d-89ce-27e28ef0c86b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:25.593757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b7150ef-dab7-4b4d-89ce-27e28ef0c86b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:25.598858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b7150ef-dab7-4b4d-89ce-27e28ef0c86b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:25.770707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b7150ef-dab7-4b4d-89ce-27e28ef0c86b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:25.782492 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b7150ef-dab7-4b4d-89ce-27e28ef0c86b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.214942 Oct 11 20:03:25.783808 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2235/4532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:25 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:25.937300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8d5eb9e4-b63e-4090-8e4c-34ec47c9cb15 req-6136726d-d690-422b-b249-192dc235e38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4014c74c-a02a-44d4-a85e-9288ae8758b8", "name": "network-vif-deleted", "tag": "fe9b7f5a-45d6-47f0-91a9-3c3937912457"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:25.938395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e9c2b75b-7664-4994-af2b-109e196b3138 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:25.939868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e9c2b75b-7664-4994-af2b-109e196b3138 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:25.955874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c2b75b-7664-4994-af2b-109e196b3138 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:25.957411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c2b75b-7664-4994-af2b-109e196b3138 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:25.959733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c2b75b-7664-4994-af2b-109e196b3138 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:25.961498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8d5eb9e4-b63e-4090-8e4c-34ec47c9cb15 req-6136726d-d690-422b-b249-192dc235e38c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:25.961894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c2b75b-7664-4994-af2b-109e196b3138 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:25.962571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c2b75b-7664-4994-af2b-109e196b3138 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:25.963234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e9c2b75b-7664-4994-af2b-109e196b3138 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:25.963988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8d5eb9e4-b63e-4090-8e4c-34ec47c9cb15 req-6136726d-d690-422b-b249-192dc235e38c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:25.967100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8d5eb9e4-b63e-4090-8e4c-34ec47c9cb15 req-6136726d-d690-422b-b249-192dc235e38c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:25.977876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:25.999113 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8d5eb9e4-b63e-4090-8e4c-34ec47c9cb15 req-6136726d-d690-422b-b249-192dc235e38c service nova] Creating event network-vif-deleted:fe9b7f5a-45d6-47f0-91a9-3c3937912457 for instance 4014c74c-a02a-44d4-a85e-9288ae8758b8 on n-h2-860864-3 Oct 11 20:03:26.010746 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8d5eb9e4-b63e-4090-8e4c-34ec47c9cb15 req-6136726d-d690-422b-b249-192dc235e38c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083036 Oct 11 20:03:26.011769 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2298/4533] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:26.160608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c979ba8a-f56e-44b2-94f1-df0da0579a5e tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83c7444550>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:26.225141 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c979ba8a-f56e-44b2-94f1-df0da0579a5e tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/21fa1b51-dd3b-413f-aabc-3f8b7c75e5cc" status: 200 len: 350 microversion: 2.1 time: 0.069561 Oct 11 20:03:26.236091 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2299/4534] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:03:26 2022] GET /compute/v2.1/os-volumes/21fa1b51-dd3b-413f-aabc-3f8b7c75e5cc => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:26.262285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e9c2b75b-7664-4994-af2b-109e196b3138 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:26.270465 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e9c2b75b-7664-4994-af2b-109e196b3138 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.343546 Oct 11 20:03:26.271702 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2236/4535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:25 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:26.425698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee0732c2-cb0b-44dc-a7e5-238906ab5373 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:26.426614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ee0732c2-cb0b-44dc-a7e5-238906ab5373 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:26.438799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee0732c2-cb0b-44dc-a7e5-238906ab5373 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:26.439142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee0732c2-cb0b-44dc-a7e5-238906ab5373 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:26.449872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee0732c2-cb0b-44dc-a7e5-238906ab5373 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:26.450851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee0732c2-cb0b-44dc-a7e5-238906ab5373 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:26.451374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee0732c2-cb0b-44dc-a7e5-238906ab5373 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:26.451828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee0732c2-cb0b-44dc-a7e5-238906ab5373 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:26.561843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-35502f86-441c-416f-a3c8-088f588d875a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:26.562973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35502f86-441c-416f-a3c8-088f588d875a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:26.573006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35502f86-441c-416f-a3c8-088f588d875a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:26.573955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35502f86-441c-416f-a3c8-088f588d875a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:26.576211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35502f86-441c-416f-a3c8-088f588d875a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:26.577428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35502f86-441c-416f-a3c8-088f588d875a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:26.578800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35502f86-441c-416f-a3c8-088f588d875a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:26.579726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35502f86-441c-416f-a3c8-088f588d875a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:26.596936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:27.349165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ee0732c2-cb0b-44dc-a7e5-238906ab5373 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:27.365172 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ee0732c2-cb0b-44dc-a7e5-238906ab5373 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1508 microversion: 2.1 time: 0.943489 Oct 11 20:03:27.367195 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2300/4536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:26 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1508 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:27.383248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-20bc3b83-2eba-4909-bc80-b9dd432664e3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:27.384135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-20bc3b83-2eba-4909-bc80-b9dd432664e3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:27.403467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20bc3b83-2eba-4909-bc80-b9dd432664e3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:27.405962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20bc3b83-2eba-4909-bc80-b9dd432664e3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:27.407879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20bc3b83-2eba-4909-bc80-b9dd432664e3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:27.411916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20bc3b83-2eba-4909-bc80-b9dd432664e3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:27.412727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20bc3b83-2eba-4909-bc80-b9dd432664e3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:27.413744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-20bc3b83-2eba-4909-bc80-b9dd432664e3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:27.825824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-35502f86-441c-416f-a3c8-088f588d875a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:27.841357 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-35502f86-441c-416f-a3c8-088f588d875a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1698 microversion: 2.1 time: 1.285376 Oct 11 20:03:27.844977 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2237/4537] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:26 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1698 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:27.855334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-72a63cd3-c22c-4f14-9e92-f6a209915a63 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:27.863962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-72a63cd3-c22c-4f14-9e92-f6a209915a63 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:27.878681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72a63cd3-c22c-4f14-9e92-f6a209915a63 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:27.880817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72a63cd3-c22c-4f14-9e92-f6a209915a63 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:27.882198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72a63cd3-c22c-4f14-9e92-f6a209915a63 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:27.883870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72a63cd3-c22c-4f14-9e92-f6a209915a63 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:27.885219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72a63cd3-c22c-4f14-9e92-f6a209915a63 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:27.887522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72a63cd3-c22c-4f14-9e92-f6a209915a63 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:28.285209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-20bc3b83-2eba-4909-bc80-b9dd432664e3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:28.307037 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-20bc3b83-2eba-4909-bc80-b9dd432664e3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.932742 Oct 11 20:03:28.307989 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2301/4538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:27 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:28.402649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4535943a-1c14-481b-a147-e06dea0d9785 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:28.403959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4535943a-1c14-481b-a147-e06dea0d9785 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:28.416861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4535943a-1c14-481b-a147-e06dea0d9785 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:28.417648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4535943a-1c14-481b-a147-e06dea0d9785 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:28.418272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4535943a-1c14-481b-a147-e06dea0d9785 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:28.419166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4535943a-1c14-481b-a147-e06dea0d9785 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:28.419779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4535943a-1c14-481b-a147-e06dea0d9785 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:28.420378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4535943a-1c14-481b-a147-e06dea0d9785 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:28.485480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-72a63cd3-c22c-4f14-9e92-f6a209915a63 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:28.501769 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-72a63cd3-c22c-4f14-9e92-f6a209915a63 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.652957 Oct 11 20:03:28.517774 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2238/4539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:27 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:28.651873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4535943a-1c14-481b-a147-e06dea0d9785 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:28.664615 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4535943a-1c14-481b-a147-e06dea0d9785 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1508 microversion: 2.1 time: 0.273939 Oct 11 20:03:28.665240 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2302/4540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:28 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:03:28.842312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5b37a172-30e4-438a-b5f5-fedb0c64a0d8 req-d8c5541d-2798-4d9e-9188-954826858174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c86a44e-bc4e-4fe8-b3cb-fce035d48458", "name": "network-vif-deleted", "tag": "3453a8cd-4bc4-49f3-80f0-9d3ba710c8e8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:28.873151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b334421a-a721-4c4e-a133-9bed4a2b1be4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:28.874366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b334421a-a721-4c4e-a133-9bed4a2b1be4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:28.874622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5b37a172-30e4-438a-b5f5-fedb0c64a0d8 req-d8c5541d-2798-4d9e-9188-954826858174 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:28.875164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5b37a172-30e4-438a-b5f5-fedb0c64a0d8 req-d8c5541d-2798-4d9e-9188-954826858174 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:28.875618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5b37a172-30e4-438a-b5f5-fedb0c64a0d8 req-d8c5541d-2798-4d9e-9188-954826858174 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:28.894421 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5b37a172-30e4-438a-b5f5-fedb0c64a0d8 req-d8c5541d-2798-4d9e-9188-954826858174 service nova] Creating event network-vif-deleted:3453a8cd-4bc4-49f3-80f0-9d3ba710c8e8 for instance 2c86a44e-bc4e-4fe8-b3cb-fce035d48458 on n-h1-860864-3 Oct 11 20:03:28.894657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b334421a-a721-4c4e-a133-9bed4a2b1be4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:28.895154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b334421a-a721-4c4e-a133-9bed4a2b1be4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:28.896198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b334421a-a721-4c4e-a133-9bed4a2b1be4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:28.897291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b334421a-a721-4c4e-a133-9bed4a2b1be4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:28.897922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b334421a-a721-4c4e-a133-9bed4a2b1be4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:28.898514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b334421a-a721-4c4e-a133-9bed4a2b1be4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:28.914473 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5b37a172-30e4-438a-b5f5-fedb0c64a0d8 req-d8c5541d-2798-4d9e-9188-954826858174 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075819 Oct 11 20:03:28.915635 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2239/4541] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:03:29.093220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8afeceed-0e2b-4391-ac92-c4c7d9b52a14 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83c7218ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:29.201588 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8afeceed-0e2b-4391-ac92-c4c7d9b52a14 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bde6da8d-caa5-4fd7-872c-226dea958e25" status: 200 len: 350 microversion: 2.1 time: 0.112580 Oct 11 20:03:29.218871 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2240/4542] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:03:29 2022] GET /compute/v2.1/os-volumes/bde6da8d-caa5-4fd7-872c-226dea958e25 => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:29.310728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b334421a-a721-4c4e-a133-9bed4a2b1be4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:29.324725 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b334421a-a721-4c4e-a133-9bed4a2b1be4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1698 microversion: 2.1 time: 0.458615 Oct 11 20:03:29.325732 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2303/4543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:28 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1698 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:29.346570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f481045d-7fe5-454e-94f4-1459392e1e5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:29.347313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f481045d-7fe5-454e-94f4-1459392e1e5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:29.359687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f481045d-7fe5-454e-94f4-1459392e1e5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:29.361149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f481045d-7fe5-454e-94f4-1459392e1e5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:29.362949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f481045d-7fe5-454e-94f4-1459392e1e5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:29.364268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f481045d-7fe5-454e-94f4-1459392e1e5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:29.367807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f481045d-7fe5-454e-94f4-1459392e1e5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:29.368254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f481045d-7fe5-454e-94f4-1459392e1e5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:29.547329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-946ae94f-a590-48d1-b8d0-484c2d8521a4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:29.548583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-946ae94f-a590-48d1-b8d0-484c2d8521a4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:29.562837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-946ae94f-a590-48d1-b8d0-484c2d8521a4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:29.563373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-946ae94f-a590-48d1-b8d0-484c2d8521a4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:29.564034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-946ae94f-a590-48d1-b8d0-484c2d8521a4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:29.564943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-946ae94f-a590-48d1-b8d0-484c2d8521a4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:29.565584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-946ae94f-a590-48d1-b8d0-484c2d8521a4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:29.566195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-946ae94f-a590-48d1-b8d0-484c2d8521a4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:29.813976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f481045d-7fe5-454e-94f4-1459392e1e5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:29.822931 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f481045d-7fe5-454e-94f4-1459392e1e5e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.482463 Oct 11 20:03:29.830739 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2241/4544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:29 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:29.836751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:29.845846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:29.858057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:29.860099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:29.860742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:29.866315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:29.867072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:29.867701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:29.915756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-946ae94f-a590-48d1-b8d0-484c2d8521a4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:29.927004 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-946ae94f-a590-48d1-b8d0-484c2d8521a4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.390494 Oct 11 20:03:29.929717 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2304/4545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:29 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:29.931775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:29.932282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:29.932729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:29.933188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lazy-loading 'fault' on Instance uuid 2c86a44e-bc4e-4fe8-b3cb-fce035d48458 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:03:29.987307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:29.997935 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3153b775-f7d8-435a-8587-da6a43ba26dc tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 200 len: 1305 microversion: 2.1 time: 0.165820 Oct 11 20:03:29.998941 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2242/4546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:29 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 1305 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:30.353087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7f7d38f5-9f2f-41f4-9137-0a4b9d316d45 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:30.354613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7f7d38f5-9f2f-41f4-9137-0a4b9d316d45 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:30.372750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f7d38f5-9f2f-41f4-9137-0a4b9d316d45 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:30.374494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f7d38f5-9f2f-41f4-9137-0a4b9d316d45 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:30.375148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f7d38f5-9f2f-41f4-9137-0a4b9d316d45 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:30.377941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f7d38f5-9f2f-41f4-9137-0a4b9d316d45 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:30.378602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f7d38f5-9f2f-41f4-9137-0a4b9d316d45 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:30.379215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f7d38f5-9f2f-41f4-9137-0a4b9d316d45 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:30.637918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7f7d38f5-9f2f-41f4-9137-0a4b9d316d45 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:30.649466 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7f7d38f5-9f2f-41f4-9137-0a4b9d316d45 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1698 microversion: 2.1 time: 0.301353 Oct 11 20:03:30.661065 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2305/4547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:30 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1698 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:30.863719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7792814d-9c0e-4e51-ab92-c0d14f7e87d5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:30.864893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7792814d-9c0e-4e51-ab92-c0d14f7e87d5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:30.908189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7792814d-9c0e-4e51-ab92-c0d14f7e87d5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:30.908988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7792814d-9c0e-4e51-ab92-c0d14f7e87d5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:30.909704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7792814d-9c0e-4e51-ab92-c0d14f7e87d5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:30.910847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7792814d-9c0e-4e51-ab92-c0d14f7e87d5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:30.911695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7792814d-9c0e-4e51-ab92-c0d14f7e87d5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:30.912543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7792814d-9c0e-4e51-ab92-c0d14f7e87d5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:30.956157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8c0a67ab-f87f-4e17-ab2e-e8e8de5f2c56 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:30.956825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8c0a67ab-f87f-4e17-ab2e-e8e8de5f2c56 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:30.967567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c0a67ab-f87f-4e17-ab2e-e8e8de5f2c56 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:30.968906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c0a67ab-f87f-4e17-ab2e-e8e8de5f2c56 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:30.970978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c0a67ab-f87f-4e17-ab2e-e8e8de5f2c56 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:30.973214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c0a67ab-f87f-4e17-ab2e-e8e8de5f2c56 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:30.973765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c0a67ab-f87f-4e17-ab2e-e8e8de5f2c56 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:30.974438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c0a67ab-f87f-4e17-ab2e-e8e8de5f2c56 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:31.261718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7792814d-9c0e-4e51-ab92-c0d14f7e87d5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:31.267737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c0a67ab-f87f-4e17-ab2e-e8e8de5f2c56 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:31.276599 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8c0a67ab-f87f-4e17-ab2e-e8e8de5f2c56 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.324509 Oct 11 20:03:31.278766 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2306/4548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:30 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:31.280638 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7792814d-9c0e-4e51-ab92-c0d14f7e87d5 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.432481 Oct 11 20:03:31.282830 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2243/4549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:30 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:31.302559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:31.303156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-50ebcd95-77a8-4a70-a1ca-709492576d4a req-733723ef-6d68-4a7e-b4bc-0522d2b26e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745e09ac-b0bc-4fa9-86c4-ad943b8427a5", "name": "network-vif-plugged", "status": "completed", "tag": "02d72842-94b4-48eb-87f3-4f729164d162"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:31.303383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: 2c86a44e-bc4e-4fe8-b3cb-fce035d48458] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:31.310870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:31.311780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:31.312523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:31.313433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:31.313955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:31.314601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:31.317987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-50ebcd95-77a8-4a70-a1ca-709492576d4a req-733723ef-6d68-4a7e-b4bc-0522d2b26e2b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:31.318684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-50ebcd95-77a8-4a70-a1ca-709492576d4a req-733723ef-6d68-4a7e-b4bc-0522d2b26e2b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:31.331038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-50ebcd95-77a8-4a70-a1ca-709492576d4a req-733723ef-6d68-4a7e-b4bc-0522d2b26e2b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:31.334998 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] HTTP exception thrown: Instance 2c86a44e-bc4e-4fe8-b3cb-fce035d48458 could not be found. Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Request method failure captured: Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 HTTP/1.1 Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnI5OPNqEKALykkTrMulwNA85YH_Zdqz_g5mxxtFhZWzC1mgynXOwy-7XOBwQTjUtt_HFqth8q6PFQS1r46sN3cIfMotnurV3uQo5c99ZQnVSr2pWZn-5m3uVl2cj_7fGN0q1zKhyJks1DRVXwQGH05jJBBzz6HnW7DgJ8v9-VauHo Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efd1bdcd18f14e87925a5b41393b9add", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}] Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1914419120-project Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 0647dca89de240ba9fbc1c59ed2b6392 Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1914419120-project Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 2c86a44e-bc4e-4fe8-b3cb-fce035d48458 could not be found. Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '2c86a44e-bc4e-4fe8-b3cb-fce035d48458'} Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c86a44e-bc4e-4fe8-b3cb-fce035d48458 could not be found. Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c86a44e-bc4e-4fe8-b3cb-fce035d48458 could not be found. Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:31.336897 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:31.341342 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:31.341342 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:31.341342 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:31.341342 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:31.341342 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:31.341342 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c86a44e-bc4e-4fe8-b3cb-fce035d48458 could not be found. Oct 11 20:03:31.341342 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:31.342775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Returning 404 to user: Instance 2c86a44e-bc4e-4fe8-b3cb-fce035d48458 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:31.343844 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8a8c1b76-f24f-48a1-9edb-3481e631a62d tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458" status: 404 len: 111 microversion: 2.1 time: 0.063934 Oct 11 20:03:31.344605 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2307/4550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:31 2022] GET /compute/v2.1/servers/2c86a44e-bc4e-4fe8-b3cb-fce035d48458 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:31.353221 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-50ebcd95-77a8-4a70-a1ca-709492576d4a req-733723ef-6d68-4a7e-b4bc-0522d2b26e2b service nova] Creating event network-vif-plugged:02d72842-94b4-48eb-87f3-4f729164d162 for instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 on n-h1-860864-3 Oct 11 20:03:31.354874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2df95d1f-d6e0-4103-a2e3-3e1d93bce50c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:31.355876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2df95d1f-d6e0-4103-a2e3-3e1d93bce50c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:31.363262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2df95d1f-d6e0-4103-a2e3-3e1d93bce50c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:31.364045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2df95d1f-d6e0-4103-a2e3-3e1d93bce50c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:31.364757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2df95d1f-d6e0-4103-a2e3-3e1d93bce50c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:31.365207 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-50ebcd95-77a8-4a70-a1ca-709492576d4a req-733723ef-6d68-4a7e-b4bc-0522d2b26e2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080055 Oct 11 20:03:31.366381 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2244/4551] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:31.366889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2df95d1f-d6e0-4103-a2e3-3e1d93bce50c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:31.370030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2df95d1f-d6e0-4103-a2e3-3e1d93bce50c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:31.370655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2df95d1f-d6e0-4103-a2e3-3e1d93bce50c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:31.402185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2df95d1f-d6e0-4103-a2e3-3e1d93bce50c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:03:31.534490 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2df95d1f-d6e0-4103-a2e3-3e1d93bce50c tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 204 len: 0 microversion: 2.1 time: 0.183731 Oct 11 20:03:31.535433 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2308/4552] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:03:31 2022] DELETE /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:03:31.548806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-65d4f66b-aaf2-4177-a835-ce08731d4e7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:31.550065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-65d4f66b-aaf2-4177-a835-ce08731d4e7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:31.563337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65d4f66b-aaf2-4177-a835-ce08731d4e7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:31.564466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65d4f66b-aaf2-4177-a835-ce08731d4e7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:31.564926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65d4f66b-aaf2-4177-a835-ce08731d4e7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:31.565663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65d4f66b-aaf2-4177-a835-ce08731d4e7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:31.566138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65d4f66b-aaf2-4177-a835-ce08731d4e7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:31.566637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-65d4f66b-aaf2-4177-a835-ce08731d4e7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:31.681191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3960607-875f-491f-b29e-f3abbe607308 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:31.682706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3960607-875f-491f-b29e-f3abbe607308 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:31.694233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3960607-875f-491f-b29e-f3abbe607308 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:31.695170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3960607-875f-491f-b29e-f3abbe607308 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:31.695860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3960607-875f-491f-b29e-f3abbe607308 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:31.703556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3960607-875f-491f-b29e-f3abbe607308 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:31.704361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3960607-875f-491f-b29e-f3abbe607308 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:31.705577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3960607-875f-491f-b29e-f3abbe607308 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:31.836958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-65d4f66b-aaf2-4177-a835-ce08731d4e7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:31.848519 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-65d4f66b-aaf2-4177-a835-ce08731d4e7b tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1496 microversion: 2.1 time: 0.307674 Oct 11 20:03:31.863401 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2245/4553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:31 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1496 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:31.983796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c3960607-875f-491f-b29e-f3abbe607308 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:32.013543 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3960607-875f-491f-b29e-f3abbe607308 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1698 microversion: 2.1 time: 0.340811 Oct 11 20:03:32.014485 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2309/4554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:31 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1698 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:32.081818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4fe83bf6-9d42-4c45-a04e-b11ca77fcc82 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83c7205940>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:32.147223 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4fe83bf6-9d42-4c45-a04e-b11ca77fcc82 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0c7135fa-bfbb-4465-90a5-9bcf18d640e9" status: 200 len: 351 microversion: 2.1 time: 0.079165 Oct 11 20:03:32.148326 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2246/4555] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:03:32 2022] GET /compute/v2.1/os-volumes/0c7135fa-bfbb-4465-90a5-9bcf18d640e9 => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:32.162717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c7e96fe-99b4-4e09-85c0-dbd1f818e141 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83c728f8b0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:32.301304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e55768cc-13dd-471a-8b29-fced3e6732f4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:32.302570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e55768cc-13dd-471a-8b29-fced3e6732f4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:32.315769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e55768cc-13dd-471a-8b29-fced3e6732f4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:32.316409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e55768cc-13dd-471a-8b29-fced3e6732f4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:32.319111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e55768cc-13dd-471a-8b29-fced3e6732f4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:32.319818 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6c7e96fe-99b4-4e09-85c0-dbd1f818e141 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.161360 Oct 11 20:03:32.319955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e55768cc-13dd-471a-8b29-fced3e6732f4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:32.320295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e55768cc-13dd-471a-8b29-fced3e6732f4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:32.330811 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2310/4556] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 11 20:03:32 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:32.331012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e55768cc-13dd-471a-8b29-fced3e6732f4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:32.337100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f8881e5c-0f61-412c-afb7-86dd0aab76ea tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:32.337751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f8881e5c-0f61-412c-afb7-86dd0aab76ea tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:32.351958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8881e5c-0f61-412c-afb7-86dd0aab76ea tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:32.352510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8881e5c-0f61-412c-afb7-86dd0aab76ea tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:32.352956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8881e5c-0f61-412c-afb7-86dd0aab76ea tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:32.358305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8881e5c-0f61-412c-afb7-86dd0aab76ea tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:32.359005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8881e5c-0f61-412c-afb7-86dd0aab76ea tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:32.359750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8881e5c-0f61-412c-afb7-86dd0aab76ea tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:32.646756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f8881e5c-0f61-412c-afb7-86dd0aab76ea tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:32.656047 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f8881e5c-0f61-412c-afb7-86dd0aab76ea tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.333845 Oct 11 20:03:32.656969 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2311/4557] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:32 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:32.674867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54cf33c4-ed62-4479-94b2-8b556cf0cd31 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83ccbcfaf0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:32.703092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e55768cc-13dd-471a-8b29-fced3e6732f4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:32.713753 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e55768cc-13dd-471a-8b29-fced3e6732f4 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.415255 Oct 11 20:03:32.714359 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2247/4558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:32 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:03:32.861855 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-54cf33c4-ed62-4479-94b2-8b556cf0cd31 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.202784 Oct 11 20:03:32.862470 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2312/4559] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 11 20:03:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:32.868925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4d1726df-e4d3-4cc7-a084-5acf104625b0 req-4b21ddec-fed9-4f60-8cd1-8b362d0dc610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bbcb06-9011-4ae8-874b-b03b92aeb1df", "name": "network-vif-deleted", "tag": "3757429c-6734-44c3-a22e-a3443f350784"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:32.909177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4d1726df-e4d3-4cc7-a084-5acf104625b0 req-4b21ddec-fed9-4f60-8cd1-8b362d0dc610 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:32.916165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4d1726df-e4d3-4cc7-a084-5acf104625b0 req-4b21ddec-fed9-4f60-8cd1-8b362d0dc610 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:32.916760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4d1726df-e4d3-4cc7-a084-5acf104625b0 req-4b21ddec-fed9-4f60-8cd1-8b362d0dc610 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:32.950519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58e479e3-ca44-4036-ba5f-17c8df1c2f91 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Calling method '.version_select at 0x7f83c7218ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:32.953212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4d1726df-e4d3-4cc7-a084-5acf104625b0 req-4b21ddec-fed9-4f60-8cd1-8b362d0dc610 service nova] Creating event network-vif-deleted:3757429c-6734-44c3-a22e-a3443f350784 for instance f3bbcb06-9011-4ae8-874b-b03b92aeb1df on n-h1-860864-3 Oct 11 20:03:32.958868 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4d1726df-e4d3-4cc7-a084-5acf104625b0 req-4b21ddec-fed9-4f60-8cd1-8b362d0dc610 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095131 Oct 11 20:03:32.959562 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2313/4560] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:32.965943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:32.967300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:32.977102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:32.977821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:32.978425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:32.979340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:32.979964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:32.980400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:32.990138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-58e479e3-ca44-4036-ba5f-17c8df1c2f91 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe7acee1-1a35-4b2f-a588-fb83d2e654fb does not exist", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 20:03:32.991580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.security_group_api [None req-58e479e3-ca44-4036-ba5f-17c8df1c2f91 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Neutron security group fe7acee1-1a35-4b2f-a588-fb83d2e654fb not found {{(pid=126955) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 20:03:32.992137 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-58e479e3-ca44-4036-ba5f-17c8df1c2f91 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] HTTP exception thrown: Security group fe7acee1-1a35-4b2f-a588-fb83d2e654fb does not exist Oct 11 20:03:32.992137 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-069f3234-078a-4255-a5dd-ff9b10cc92f7'] Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58e479e3-ca44-4036-ba5f-17c8df1c2f91 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Request method failure captured: Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-security-groups/fe7acee1-1a35-4b2f-a588-fb83d2e654fb HTTP/1.1 Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcwU4CRzDie443TG8itYmMBP82uLg7ZqPdXH8d1bjMfm-IzzbTT8ciy2cTIIQCVyNIsYRZ5h5jJY414lDflybrPkIfufI1T-UyC5mnkLh3lv_AfOe4dC62p9XE4Zoik4AZWN_Autx9VhxV7yc_0-a741EKl0t5tPteqg0RhBtWNXouQ Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 5fc5dfc5850849beb84e741a5a75856a Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5fc5dfc5850849beb84e741a5a75856a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5fc5dfc5850849beb84e741a5a75856a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fc5dfc5850849beb84e741a5a75856a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fc5dfc5850849beb84e741a5a75856a"}]}] Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 5fc5dfc5850849beb84e741a5a75856a Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-SecurityGroupsNegativeTestJSON-2118317384-project Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8078bac037da415cb4d7aa43c01ca970 Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384-project Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: exception: Security group fe7acee1-1a35-4b2f-a588-fb83d2e654fb does not exist Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-069f3234-078a-4255-a5dd-ff9b10cc92f7'] Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'fe7acee1-1a35-4b2f-a588-fb83d2e654fb'} Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 20:03:32.995976 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe7acee1-1a35-4b2f-a588-fb83d2e654fb does not exist Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-069f3234-078a-4255-a5dd-ff9b10cc92f7'] Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe7acee1-1a35-4b2f-a588-fb83d2e654fb does not exist Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-069f3234-078a-4255-a5dd-ff9b10cc92f7'] Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe7acee1-1a35-4b2f-a588-fb83d2e654fb does not exist Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-069f3234-078a-4255-a5dd-ff9b10cc92f7'] Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe7acee1-1a35-4b2f-a588-fb83d2e654fb does not exist Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-069f3234-078a-4255-a5dd-ff9b10cc92f7'] Oct 11 20:03:32.999565 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:33.004849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58e479e3-ca44-4036-ba5f-17c8df1c2f91 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Returning 404 to user: Security group fe7acee1-1a35-4b2f-a588-fb83d2e654fb does not exist Oct 11 20:03:33.004849 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-069f3234-078a-4255-a5dd-ff9b10cc92f7'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:33.006186 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58e479e3-ca44-4036-ba5f-17c8df1c2f91 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/fe7acee1-1a35-4b2f-a588-fb83d2e654fb" status: 404 len: 194 microversion: 2.1 time: 0.290535 Oct 11 20:03:33.007590 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2248/4561] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:03:32 2022] DELETE /compute/v2.1/os-security-groups/fe7acee1-1a35-4b2f-a588-fb83d2e654fb => generated 194 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:33.013333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d7d182ea-0ff8-4143-b7ab-b77722462e92 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83c74cbe50>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:33.033574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:33.034278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:33.034921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:33.035584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lazy-loading 'fault' on Instance uuid f3bbcb06-9011-4ae8-874b-b03b92aeb1df {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:03:33.114687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:33.120858 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d7d182ea-0ff8-4143-b7ab-b77722462e92 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.111808 Oct 11 20:03:33.121437 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2249/4562] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 11 20:03:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:33.126678 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-45de4b3f-53e2-4f24-94de-535d4fc481d7 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004269 Oct 11 20:03:33.127205 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2250/4563] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Oct 11 20:03:33 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 20:03:33.134606 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-68882ceb-197a-426e-9865-93028332b8f2 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 200 len: 1305 microversion: 2.1 time: 0.173638 Oct 11 20:03:33.135203 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2314/4564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:32 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 1305 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:33.136000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-39a46a2b-4984-4658-87e0-ecde043b2c9e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:33.136781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-39a46a2b-4984-4658-87e0-ecde043b2c9e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:33.144074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39a46a2b-4984-4658-87e0-ecde043b2c9e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:33.144786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39a46a2b-4984-4658-87e0-ecde043b2c9e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:33.145384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39a46a2b-4984-4658-87e0-ecde043b2c9e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:33.146886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39a46a2b-4984-4658-87e0-ecde043b2c9e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:33.147506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39a46a2b-4984-4658-87e0-ecde043b2c9e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:33.148085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39a46a2b-4984-4658-87e0-ecde043b2c9e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:33.152291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6464c20f-be0b-4206-a930-47c6c8114f31 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83ccbcfd30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:33.294547 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6464c20f-be0b-4206-a930-47c6c8114f31 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.158269 Oct 11 20:03:33.295316 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2315/4565] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 11 20:03:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:33.304858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77edf413-0655-484f-b3ce-3399f1911026 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Calling method '.version_select at 0x7f83c7295040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:33.412451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-39a46a2b-4984-4658-87e0-ecde043b2c9e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:33.424563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-39a46a2b-4984-4658-87e0-ecde043b2c9e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1698 microversion: 2.1 time: 0.296018 Oct 11 20:03:33.425611 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2251/4566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:33 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1698 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:33.434885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7c05ee9-f3d9-49cb-8c2e-b94b8ba8c783 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83cc1473a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:33.555170 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-77edf413-0655-484f-b3ce-3399f1911026 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.254925 Oct 11 20:03:33.555759 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2316/4567] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 20:03:33 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:33.559557 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e7c05ee9-f3d9-49cb-8c2e-b94b8ba8c783 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.132586 Oct 11 20:03:33.560133 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2252/4568] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 11 20:03:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:33.569881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2a87301-abea-4d46-83cd-ca701e449a43 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Calling method '.version_select at 0x7f83c72e3280>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:33.680615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-10c4be46-7294-4293-900c-c36f9ee1157c req-d7b9c395-628f-4d02-813a-28952104cf10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745e09ac-b0bc-4fa9-86c4-ad943b8427a5", "name": "network-vif-plugged", "status": "completed", "tag": "aadd1b7d-28d7-48a9-a479-ec6ead0843c3"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:33.694929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-10c4be46-7294-4293-900c-c36f9ee1157c req-d7b9c395-628f-4d02-813a-28952104cf10 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:33.695750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-10c4be46-7294-4293-900c-c36f9ee1157c req-d7b9c395-628f-4d02-813a-28952104cf10 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:33.696655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-10c4be46-7294-4293-900c-c36f9ee1157c req-d7b9c395-628f-4d02-813a-28952104cf10 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:33.733332 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-10c4be46-7294-4293-900c-c36f9ee1157c req-d7b9c395-628f-4d02-813a-28952104cf10 service nova] Creating event network-vif-plugged:aadd1b7d-28d7-48a9-a479-ec6ead0843c3 for instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 on n-h1-860864-3 Oct 11 20:03:33.738343 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-10c4be46-7294-4293-900c-c36f9ee1157c req-d7b9c395-628f-4d02-813a-28952104cf10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181437 Oct 11 20:03:33.739927 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2317/4569] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:33.745548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8940f41a-7295-49e3-bb7d-8ce0b4b03b74 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83cc4ac040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:33.755501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-d2a87301-abea-4d46-83cd-ca701e449a43 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 20:03:33.756353 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-d2a87301-abea-4d46-83cd-ca701e449a43 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 11 20:03:33.756353 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-0e3cdb1a-dad7-4309-8f03-8e4484ecb499'] Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2a87301-abea-4d46-83cd-ca701e449a43 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Request method failure captured: Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-security-groups/1a670529-c096-4bb0-8d54-7ac6506ae797 HTTP/1.1 Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcwU4CRzDie443TG8itYmMBP82uLg7ZqPdXH8d1bjMfm-IzzbTT8ciy2cTIIQCVyNIsYRZ5h5jJY414lDflybrPkIfufI1T-UyC5mnkLh3lv_AfOe4dC62p9XE4Zoik4AZWN_Autx9VhxV7yc_0-a741EKl0t5tPteqg0RhBtWNXouQ Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 5fc5dfc5850849beb84e741a5a75856a Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5fc5dfc5850849beb84e741a5a75856a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5fc5dfc5850849beb84e741a5a75856a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fc5dfc5850849beb84e741a5a75856a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fc5dfc5850849beb84e741a5a75856a"}]}] Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 5fc5dfc5850849beb84e741a5a75856a Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-SecurityGroupsNegativeTestJSON-2118317384-project Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8078bac037da415cb4d7aa43c01ca970 Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384-project Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: exception: Insufficient rights for removing default security group. Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-0e3cdb1a-dad7-4309-8f03-8e4484ecb499'] Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '1a670529-c096-4bb0-8d54-7ac6506ae797'} Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 20:03:33.758378 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e3cdb1a-dad7-4309-8f03-8e4484ecb499'] Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e3cdb1a-dad7-4309-8f03-8e4484ecb499'] Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e3cdb1a-dad7-4309-8f03-8e4484ecb499'] Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e3cdb1a-dad7-4309-8f03-8e4484ecb499'] Oct 11 20:03:33.762897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:33.767629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d2a87301-abea-4d46-83cd-ca701e449a43 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 11 20:03:33.767629 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-0e3cdb1a-dad7-4309-8f03-8e4484ecb499'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:33.768473 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d2a87301-abea-4d46-83cd-ca701e449a43 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/1a670529-c096-4bb0-8d54-7ac6506ae797" status: 400 len: 182 microversion: 2.1 time: 0.202866 Oct 11 20:03:33.769086 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2253/4570] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:03:33 2022] DELETE /compute/v2.1/os-security-groups/1a670529-c096-4bb0-8d54-7ac6506ae797 => generated 182 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 20:03:33.777477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9245d791-c09e-4805-82f6-807d046ce1f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:33.778414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9245d791-c09e-4805-82f6-807d046ce1f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:33.787489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9245d791-c09e-4805-82f6-807d046ce1f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:33.788262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9245d791-c09e-4805-82f6-807d046ce1f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:33.789497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9245d791-c09e-4805-82f6-807d046ce1f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:33.792479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9245d791-c09e-4805-82f6-807d046ce1f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:33.793406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9245d791-c09e-4805-82f6-807d046ce1f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:33.794074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9245d791-c09e-4805-82f6-807d046ce1f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:33.950060 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8940f41a-7295-49e3-bb7d-8ce0b4b03b74 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.208608 Oct 11 20:03:33.960782 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2318/4571] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 20:03:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:33.966876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b8ab08ef-29dc-4da5-bfd5-48790c468e57 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:33.968003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b8ab08ef-29dc-4da5-bfd5-48790c468e57 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:33.984526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:33.986310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ab08ef-29dc-4da5-bfd5-48790c468e57 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:33.987219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ab08ef-29dc-4da5-bfd5-48790c468e57 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:33.987659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ab08ef-29dc-4da5-bfd5-48790c468e57 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:33.988704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ab08ef-29dc-4da5-bfd5-48790c468e57 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:33.989468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ab08ef-29dc-4da5-bfd5-48790c468e57 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:33.989894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8ab08ef-29dc-4da5-bfd5-48790c468e57 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:34.019958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9245d791-c09e-4805-82f6-807d046ce1f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:34.033302 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9245d791-c09e-4805-82f6-807d046ce1f2 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.262727 Oct 11 20:03:34.043463 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2254/4572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:33 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:34.060886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6842e8e9-46e9-44e9-b59f-edae05d95770 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Calling method '.version_select at 0x7f83c7218790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:34.124326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG neutronclient.v2_0.client [None req-6842e8e9-46e9-44e9-b59f-edae05d95770 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ebd8e421-9a70-4aaa-b21f-22de8b328efb does not exist", "detail": ""}} {{(pid=126955) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 20:03:34.125680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.security_group_api [None req-6842e8e9-46e9-44e9-b59f-edae05d95770 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Neutron security group ebd8e421-9a70-4aaa-b21f-22de8b328efb not found {{(pid=126955) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 20:03:34.126416 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6842e8e9-46e9-44e9-b59f-edae05d95770 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] HTTP exception thrown: Security group ebd8e421-9a70-4aaa-b21f-22de8b328efb does not exist Oct 11 20:03:34.126416 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-e131cbf3-6831-4f17-864b-b0d38c438edf'] Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6842e8e9-46e9-44e9-b59f-edae05d95770 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Request method failure captured: Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-security-groups/ebd8e421-9a70-4aaa-b21f-22de8b328efb HTTP/1.1 Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcwU4CRzDie443TG8itYmMBP82uLg7ZqPdXH8d1bjMfm-IzzbTT8ciy2cTIIQCVyNIsYRZ5h5jJY414lDflybrPkIfufI1T-UyC5mnkLh3lv_AfOe4dC62p9XE4Zoik4AZWN_Autx9VhxV7yc_0-a741EKl0t5tPteqg0RhBtWNXouQ Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 5fc5dfc5850849beb84e741a5a75856a Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5fc5dfc5850849beb84e741a5a75856a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5fc5dfc5850849beb84e741a5a75856a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fc5dfc5850849beb84e741a5a75856a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fc5dfc5850849beb84e741a5a75856a"}]}] Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 5fc5dfc5850849beb84e741a5a75856a Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-SecurityGroupsNegativeTestJSON-2118317384-project Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8078bac037da415cb4d7aa43c01ca970 Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384-project Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: exception: Security group ebd8e421-9a70-4aaa-b21f-22de8b328efb does not exist Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-e131cbf3-6831-4f17-864b-b0d38c438edf'] Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ebd8e421-9a70-4aaa-b21f-22de8b328efb'} Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 20:03:34.130393 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ebd8e421-9a70-4aaa-b21f-22de8b328efb does not exist Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e131cbf3-6831-4f17-864b-b0d38c438edf'] Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ebd8e421-9a70-4aaa-b21f-22de8b328efb does not exist Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e131cbf3-6831-4f17-864b-b0d38c438edf'] Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ebd8e421-9a70-4aaa-b21f-22de8b328efb does not exist Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e131cbf3-6831-4f17-864b-b0d38c438edf'] Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ebd8e421-9a70-4aaa-b21f-22de8b328efb does not exist Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e131cbf3-6831-4f17-864b-b0d38c438edf'] Oct 11 20:03:34.135610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.140072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6842e8e9-46e9-44e9-b59f-edae05d95770 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Returning 404 to user: Security group ebd8e421-9a70-4aaa-b21f-22de8b328efb does not exist Oct 11 20:03:34.140072 n-d-860864-3 devstack@n-api.service[126955]: Neutron server returns request_ids: ['req-e131cbf3-6831-4f17-864b-b0d38c438edf'] {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:34.140319 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6842e8e9-46e9-44e9-b59f-edae05d95770 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/ebd8e421-9a70-4aaa-b21f-22de8b328efb" status: 404 len: 194 microversion: 2.1 time: 0.095670 Oct 11 20:03:34.140895 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2255/4573] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 20:03:34 2022] GET /compute/v2.1/os-security-groups/ebd8e421-9a70-4aaa-b21f-22de8b328efb => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:34.149395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ef78f612-b3f0-411d-984f-9a35c3789df2 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83c72051f0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:34.201176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b8ab08ef-29dc-4da5-bfd5-48790c468e57 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:34.208955 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b8ab08ef-29dc-4da5-bfd5-48790c468e57 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.246974 Oct 11 20:03:34.209560 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2319/4574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:33 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:34.214184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1756edcc-5a8f-40bd-a934-7086f02086f8 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Action: 'update', calling method: .version_select at 0x7f83c7278670>, body: {"security_group": {"name": "tempest-sg-1018198889", "description": "tempest-description-912224441"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:34.243247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG neutronclient.v2_0.client [None req-1756edcc-5a8f-40bd-a934-7086f02086f8 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d01ea4a5-da88-428d-9ee8-35e182cc5204 does not exist", "detail": ""}} {{(pid=126956) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 20:03:34.243855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.security_group_api [None req-1756edcc-5a8f-40bd-a934-7086f02086f8 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Neutron security group d01ea4a5-da88-428d-9ee8-35e182cc5204 not found {{(pid=126956) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 20:03:34.244392 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1756edcc-5a8f-40bd-a934-7086f02086f8 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] HTTP exception thrown: Security group d01ea4a5-da88-428d-9ee8-35e182cc5204 does not exist Oct 11 20:03:34.244392 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-f5e0203e-eba8-47bc-a814-77b845fb7518'] Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1756edcc-5a8f-40bd-a934-7086f02086f8 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Request method failure captured: Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: request: PUT /compute/v2.1/os-security-groups/d01ea4a5-da88-428d-9ee8-35e182cc5204 HTTP/1.1 Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 101 Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcwU4CRzDie443TG8itYmMBP82uLg7ZqPdXH8d1bjMfm-IzzbTT8ciy2cTIIQCVyNIsYRZ5h5jJY414lDflybrPkIfufI1T-UyC5mnkLh3lv_AfOe4dC62p9XE4Zoik4AZWN_Autx9VhxV7yc_0-a741EKl0t5tPteqg0RhBtWNXouQ Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 5fc5dfc5850849beb84e741a5a75856a Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5fc5dfc5850849beb84e741a5a75856a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5fc5dfc5850849beb84e741a5a75856a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fc5dfc5850849beb84e741a5a75856a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5fc5dfc5850849beb84e741a5a75856a"}]}] Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 5fc5dfc5850849beb84e741a5a75856a Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384 Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-SecurityGroupsNegativeTestJSON-2118317384-project Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 8078bac037da415cb4d7aa43c01ca970 Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2118317384-project Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: {"security_group": {"name": "tempest-sg-1018198889", "description": "tempest-description-912224441"}} Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: exception: Security group d01ea4a5-da88-428d-9ee8-35e182cc5204 does not exist Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-f5e0203e-eba8-47bc-a814-77b845fb7518'] Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'd01ea4a5-da88-428d-9ee8-35e182cc5204', 'body': {'security_group': {'name': 'tempest-sg-1018198889', 'description': 'tempest-description-912224441'}}} Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 20:03:34.246946 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d01ea4a5-da88-428d-9ee8-35e182cc5204 does not exist Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5e0203e-eba8-47bc-a814-77b845fb7518'] Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d01ea4a5-da88-428d-9ee8-35e182cc5204 does not exist Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5e0203e-eba8-47bc-a814-77b845fb7518'] Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d01ea4a5-da88-428d-9ee8-35e182cc5204 does not exist Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5e0203e-eba8-47bc-a814-77b845fb7518'] Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d01ea4a5-da88-428d-9ee8-35e182cc5204 does not exist Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5e0203e-eba8-47bc-a814-77b845fb7518'] Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1756edcc-5a8f-40bd-a934-7086f02086f8 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] Returning 404 to user: Security group d01ea4a5-da88-428d-9ee8-35e182cc5204 does not exist Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: Neutron server returns request_ids: ['req-f5e0203e-eba8-47bc-a814-77b845fb7518'] {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1756edcc-5a8f-40bd-a934-7086f02086f8 tempest-SecurityGroupsNegativeTestJSON-2118317384 tempest-SecurityGroupsNegativeTestJSON-2118317384-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/d01ea4a5-da88-428d-9ee8-35e182cc5204" status: 404 len: 194 microversion: 2.1 time: 0.037878 Oct 11 20:03:34.251466 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2320/4575] 10.222.0.27 () {60 vars in 1290 bytes} [Tue Oct 11 20:03:34 2022] PUT /compute/v2.1/os-security-groups/d01ea4a5-da88-428d-9ee8-35e182cc5204 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:34.255458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:34.255458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: f3bbcb06-9011-4ae8-874b-b03b92aeb1df] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:34.275189 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ef78f612-b3f0-411d-984f-9a35c3789df2 tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.132683 Oct 11 20:03:34.275847 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2256/4576] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Oct 11 20:03:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:34.276138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:34.276730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:34.277090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:34.277815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:34.278281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:34.278750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:34.292201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7fed4d4c-2345-4b0c-b95d-349aacb0094c tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] Calling method '.version_select at 0x7f83cc147af0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:34.295406 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] HTTP exception thrown: Instance f3bbcb06-9011-4ae8-874b-b03b92aeb1df could not be found. Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Request method failure captured: Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df HTTP/1.1 Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnI5OPNqEKALykkTrMulwNA85YH_Zdqz_g5mxxtFhZWzC1mgynXOwy-7XOBwQTjUtt_HFqth8q6PFQS1r46sN3cIfMotnurV3uQo5c99ZQnVSr2pWZn-5m3uVl2cj_7fGN0q1zKhyJks1DRVXwQGH05jJBBzz6HnW7DgJ8v9-VauHo Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efd1bdcd18f14e87925a5b41393b9add", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}] Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1914419120-project Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 0647dca89de240ba9fbc1c59ed2b6392 Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1914419120-project Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance f3bbcb06-9011-4ae8-874b-b03b92aeb1df could not be found. Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'f3bbcb06-9011-4ae8-874b-b03b92aeb1df'} Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3bbcb06-9011-4ae8-874b-b03b92aeb1df could not be found. Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3bbcb06-9011-4ae8-874b-b03b92aeb1df could not be found. Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:34.297933 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.303722 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:34.303722 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:34.303722 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:34.303722 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:34.303722 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:34.303722 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3bbcb06-9011-4ae8-874b-b03b92aeb1df could not be found. Oct 11 20:03:34.303722 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:34.303722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Returning 404 to user: Instance f3bbcb06-9011-4ae8-874b-b03b92aeb1df could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:34.305344 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d164c54c-8db2-40e9-b8cb-964945e5dd23 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df" status: 404 len: 111 microversion: 2.1 time: 0.054545 Oct 11 20:03:34.308347 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2321/4577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:34 2022] GET /compute/v2.1/servers/f3bbcb06-9011-4ae8-874b-b03b92aeb1df => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:34.313171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-786bdbec-9720-4165-8b64-d012bd182a76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:34.313674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-786bdbec-9720-4165-8b64-d012bd182a76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:34.320074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-786bdbec-9720-4165-8b64-d012bd182a76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:34.320569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-786bdbec-9720-4165-8b64-d012bd182a76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:34.321282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-786bdbec-9720-4165-8b64-d012bd182a76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:34.322255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-786bdbec-9720-4165-8b64-d012bd182a76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:34.322762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-786bdbec-9720-4165-8b64-d012bd182a76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:34.323192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-786bdbec-9720-4165-8b64-d012bd182a76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:34.355141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-786bdbec-9720-4165-8b64-d012bd182a76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:03:34.372839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:34.461856 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-786bdbec-9720-4165-8b64-d012bd182a76 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 204 len: 0 microversion: 2.1 time: 0.152097 Oct 11 20:03:34.464753 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2322/4578] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:03:34 2022] DELETE /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:03:34.470119 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7fed4d4c-2345-4b0c-b95d-349aacb0094c tempest-VolumesTestJSON-421472866 tempest-VolumesTestJSON-421472866-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.182503 Oct 11 20:03:34.470722 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2257/4579] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 20:03:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:03:34.473057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99f70711-c143-4262-8fd3-7d163fa5229f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:34.475209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-99f70711-c143-4262-8fd3-7d163fa5229f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:34.477061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c040436c-4036-4d24-aef8-6e8a3179dd28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:34.477674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c040436c-4036-4d24-aef8-6e8a3179dd28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:34.488984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99f70711-c143-4262-8fd3-7d163fa5229f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:34.490433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99f70711-c143-4262-8fd3-7d163fa5229f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:34.491379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99f70711-c143-4262-8fd3-7d163fa5229f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:34.492886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99f70711-c143-4262-8fd3-7d163fa5229f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:34.493666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c040436c-4036-4d24-aef8-6e8a3179dd28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:34.494015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99f70711-c143-4262-8fd3-7d163fa5229f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:34.494834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c040436c-4036-4d24-aef8-6e8a3179dd28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:34.495092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99f70711-c143-4262-8fd3-7d163fa5229f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:34.495819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c040436c-4036-4d24-aef8-6e8a3179dd28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:34.497458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c040436c-4036-4d24-aef8-6e8a3179dd28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:34.499193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c040436c-4036-4d24-aef8-6e8a3179dd28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:34.501291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c040436c-4036-4d24-aef8-6e8a3179dd28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:35.137688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-99f70711-c143-4262-8fd3-7d163fa5229f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:35.153410 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99f70711-c143-4262-8fd3-7d163fa5229f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1698 microversion: 2.1 time: 0.685291 Oct 11 20:03:35.163326 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2323/4580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:34 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1698 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:35.184318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-455585c2-091c-4816-81c9-fef0dcce2f1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:35.188650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-455585c2-091c-4816-81c9-fef0dcce2f1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:35.195831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455585c2-091c-4816-81c9-fef0dcce2f1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:35.196811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455585c2-091c-4816-81c9-fef0dcce2f1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:35.197413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455585c2-091c-4816-81c9-fef0dcce2f1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:35.198520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455585c2-091c-4816-81c9-fef0dcce2f1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:35.199317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455585c2-091c-4816-81c9-fef0dcce2f1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:35.199906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455585c2-091c-4816-81c9-fef0dcce2f1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:35.273143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c040436c-4036-4d24-aef8-6e8a3179dd28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:35.282473 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c040436c-4036-4d24-aef8-6e8a3179dd28 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1675 microversion: 2.1 time: 0.810290 Oct 11 20:03:35.283894 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2258/4581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:34 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1675 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:35.289708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-79c499a2-72e2-45c2-af35-630d87ec792b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:35.290706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-79c499a2-72e2-45c2-af35-630d87ec792b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:35.297848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79c499a2-72e2-45c2-af35-630d87ec792b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:35.299028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79c499a2-72e2-45c2-af35-630d87ec792b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:35.299934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79c499a2-72e2-45c2-af35-630d87ec792b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:35.300935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79c499a2-72e2-45c2-af35-630d87ec792b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:35.303186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79c499a2-72e2-45c2-af35-630d87ec792b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:35.303981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79c499a2-72e2-45c2-af35-630d87ec792b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:35.662250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-455585c2-091c-4816-81c9-fef0dcce2f1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:35.671394 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-455585c2-091c-4816-81c9-fef0dcce2f1a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.506704 Oct 11 20:03:35.672566 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2324/4582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:35 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:35.779933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79c499a2-72e2-45c2-af35-630d87ec792b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:35.796068 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-79c499a2-72e2-45c2-af35-630d87ec792b tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1334 microversion: 2.1 time: 0.510555 Oct 11 20:03:35.797297 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2259/4583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:35 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1334 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:36.183005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8bfeea51-e50f-4bb0-ba80-e4e5b032795c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:36.189215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8bfeea51-e50f-4bb0-ba80-e4e5b032795c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:36.208198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfeea51-e50f-4bb0-ba80-e4e5b032795c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:36.210057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfeea51-e50f-4bb0-ba80-e4e5b032795c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:36.210746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfeea51-e50f-4bb0-ba80-e4e5b032795c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:36.211715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfeea51-e50f-4bb0-ba80-e4e5b032795c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:36.212544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfeea51-e50f-4bb0-ba80-e4e5b032795c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:36.213225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bfeea51-e50f-4bb0-ba80-e4e5b032795c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:36.316576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f60b61dd-b86a-4d90-b5f2-ac193b622570 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:36.318458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f60b61dd-b86a-4d90-b5f2-ac193b622570 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:36.343273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f60b61dd-b86a-4d90-b5f2-ac193b622570 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:36.344303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f60b61dd-b86a-4d90-b5f2-ac193b622570 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:36.355330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f60b61dd-b86a-4d90-b5f2-ac193b622570 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:36.356372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f60b61dd-b86a-4d90-b5f2-ac193b622570 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:36.357030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f60b61dd-b86a-4d90-b5f2-ac193b622570 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:36.357620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f60b61dd-b86a-4d90-b5f2-ac193b622570 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:36.768312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8bfeea51-e50f-4bb0-ba80-e4e5b032795c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:36.781913 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8bfeea51-e50f-4bb0-ba80-e4e5b032795c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1697 microversion: 2.1 time: 0.600082 Oct 11 20:03:36.795835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2325/4584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:36 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1697 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:36.796464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9387db6-a6ac-4afe-a84a-b1f79917ccc1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:36.797300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d9387db6-a6ac-4afe-a84a-b1f79917ccc1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:36.817372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9387db6-a6ac-4afe-a84a-b1f79917ccc1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:36.818242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9387db6-a6ac-4afe-a84a-b1f79917ccc1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:36.819042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9387db6-a6ac-4afe-a84a-b1f79917ccc1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:36.822446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9387db6-a6ac-4afe-a84a-b1f79917ccc1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:36.824165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9387db6-a6ac-4afe-a84a-b1f79917ccc1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:36.825938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9387db6-a6ac-4afe-a84a-b1f79917ccc1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:36.920851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f60b61dd-b86a-4d90-b5f2-ac193b622570 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:36.936620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f60b61dd-b86a-4d90-b5f2-ac193b622570 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1675 microversion: 2.1 time: 0.632821 Oct 11 20:03:36.937216 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2260/4585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:36 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1675 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:03:36.956375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-456166af-78f8-441a-b270-639d0eca318a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:36.956997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-456166af-78f8-441a-b270-639d0eca318a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:36.982192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456166af-78f8-441a-b270-639d0eca318a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:36.982726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456166af-78f8-441a-b270-639d0eca318a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:36.983161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456166af-78f8-441a-b270-639d0eca318a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:36.984431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456166af-78f8-441a-b270-639d0eca318a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:36.985247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456166af-78f8-441a-b270-639d0eca318a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:36.986085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456166af-78f8-441a-b270-639d0eca318a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:37.541778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d9387db6-a6ac-4afe-a84a-b1f79917ccc1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:37.553422 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9387db6-a6ac-4afe-a84a-b1f79917ccc1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.766727 Oct 11 20:03:37.554456 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2326/4586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:36 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:37.563698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-dd01d17a-d8d4-4608-b473-c7f7e2699a35 req-0b75b3b2-2b38-4eb8-b865-21bc23432e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d6cd57-1120-449b-ba44-2066fb17c6e8", "name": "network-vif-unplugged", "status": "completed", "tag": "a2241e88-c9e7-4296-bc6f-97e0146faa66"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:37.577735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-456166af-78f8-441a-b270-639d0eca318a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:37.600548 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-456166af-78f8-441a-b270-639d0eca318a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1671 microversion: 2.1 time: 0.662170 Oct 11 20:03:37.601939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dd01d17a-d8d4-4608-b473-c7f7e2699a35 req-0b75b3b2-2b38-4eb8-b865-21bc23432e16 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:37.602663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dd01d17a-d8d4-4608-b473-c7f7e2699a35 req-0b75b3b2-2b38-4eb8-b865-21bc23432e16 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:37.603112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dd01d17a-d8d4-4608-b473-c7f7e2699a35 req-0b75b3b2-2b38-4eb8-b865-21bc23432e16 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:37.614817 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2261/4587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:36 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1671 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:37.631105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5e77e728-9cc3-4e75-afea-33938922f0bb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:37.631766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5e77e728-9cc3-4e75-afea-33938922f0bb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:37.635859 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-dd01d17a-d8d4-4608-b473-c7f7e2699a35 req-0b75b3b2-2b38-4eb8-b865-21bc23432e16 service nova] Creating event network-vif-unplugged:a2241e88-c9e7-4296-bc6f-97e0146faa66 for instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 on n-h1-860864-3 Oct 11 20:03:37.641297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e77e728-9cc3-4e75-afea-33938922f0bb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:37.642430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-dd01d17a-d8d4-4608-b473-c7f7e2699a35 req-0b75b3b2-2b38-4eb8-b865-21bc23432e16 service nova] Instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:03:37.644946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e77e728-9cc3-4e75-afea-33938922f0bb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:37.645975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e77e728-9cc3-4e75-afea-33938922f0bb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:37.646873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e77e728-9cc3-4e75-afea-33938922f0bb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:37.647346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e77e728-9cc3-4e75-afea-33938922f0bb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:37.647781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e77e728-9cc3-4e75-afea-33938922f0bb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:37.658102 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-dd01d17a-d8d4-4608-b473-c7f7e2699a35 req-0b75b3b2-2b38-4eb8-b865-21bc23432e16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102160 Oct 11 20:03:37.659049 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2327/4588] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:37.737523 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5e77e728-9cc3-4e75-afea-33938922f0bb tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5/ips" status: 200 len: 181 microversion: 2.1 time: 0.092381 Oct 11 20:03:37.745329 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2262/4589] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:03:37 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5/ips => generated 181 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:37.751862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3f94ba43-db40-40b6-b4db-8a8edc0130a2 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:37.753291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3f94ba43-db40-40b6-b4db-8a8edc0130a2 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:37.768385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f94ba43-db40-40b6-b4db-8a8edc0130a2 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:37.769338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f94ba43-db40-40b6-b4db-8a8edc0130a2 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:37.770008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f94ba43-db40-40b6-b4db-8a8edc0130a2 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:37.771752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f94ba43-db40-40b6-b4db-8a8edc0130a2 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:37.772387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f94ba43-db40-40b6-b4db-8a8edc0130a2 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:37.772984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f94ba43-db40-40b6-b4db-8a8edc0130a2 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:37.803370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3f94ba43-db40-40b6-b4db-8a8edc0130a2 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:03:37.811848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03e1d82e-51b8-49cd-9cec-f15016e68954 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:37.813389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-03e1d82e-51b8-49cd-9cec-f15016e68954 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:37.825255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03e1d82e-51b8-49cd-9cec-f15016e68954 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:37.826052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03e1d82e-51b8-49cd-9cec-f15016e68954 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:37.829967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03e1d82e-51b8-49cd-9cec-f15016e68954 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:37.831306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03e1d82e-51b8-49cd-9cec-f15016e68954 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:37.832199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03e1d82e-51b8-49cd-9cec-f15016e68954 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:37.833328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03e1d82e-51b8-49cd-9cec-f15016e68954 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:38.026296 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3f94ba43-db40-40b6-b4db-8a8edc0130a2 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "DELETE /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 204 len: 0 microversion: 2.1 time: 0.278579 Oct 11 20:03:38.030700 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2328/4590] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:03:37 2022] DELETE /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:03:38.048169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-56920aa7-6b5d-4eea-9996-e10f1006d1af tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:38.048877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-56920aa7-6b5d-4eea-9996-e10f1006d1af tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:38.069727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56920aa7-6b5d-4eea-9996-e10f1006d1af tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:38.070273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56920aa7-6b5d-4eea-9996-e10f1006d1af tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:38.077232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56920aa7-6b5d-4eea-9996-e10f1006d1af tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:38.077232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56920aa7-6b5d-4eea-9996-e10f1006d1af tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:38.077232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56920aa7-6b5d-4eea-9996-e10f1006d1af tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:38.080459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56920aa7-6b5d-4eea-9996-e10f1006d1af tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:38.537996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-03e1d82e-51b8-49cd-9cec-f15016e68954 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:38.550609 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-03e1d82e-51b8-49cd-9cec-f15016e68954 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1697 microversion: 2.1 time: 0.743229 Oct 11 20:03:38.551214 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2263/4591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:37 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1697 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:03:38.577072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aca2eb70-3bc6-4bcf-a233-089a37d3698c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:38.586039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aca2eb70-3bc6-4bcf-a233-089a37d3698c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:38.595487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aca2eb70-3bc6-4bcf-a233-089a37d3698c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:38.596004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aca2eb70-3bc6-4bcf-a233-089a37d3698c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:38.596461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aca2eb70-3bc6-4bcf-a233-089a37d3698c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:38.597322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aca2eb70-3bc6-4bcf-a233-089a37d3698c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:38.597793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aca2eb70-3bc6-4bcf-a233-089a37d3698c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:38.598227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aca2eb70-3bc6-4bcf-a233-089a37d3698c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:38.861787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56920aa7-6b5d-4eea-9996-e10f1006d1af tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:38.874080 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-56920aa7-6b5d-4eea-9996-e10f1006d1af tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1675 microversion: 2.1 time: 0.841545 Oct 11 20:03:38.874736 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2329/4592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:38 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1675 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:38.900267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-080acaba-209a-4059-b88a-a12d75543cc3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:38.900889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-080acaba-209a-4059-b88a-a12d75543cc3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:38.926018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-080acaba-209a-4059-b88a-a12d75543cc3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:38.926634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-080acaba-209a-4059-b88a-a12d75543cc3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:38.927128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-080acaba-209a-4059-b88a-a12d75543cc3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:38.927791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-080acaba-209a-4059-b88a-a12d75543cc3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:38.928265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-080acaba-209a-4059-b88a-a12d75543cc3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:38.928730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-080acaba-209a-4059-b88a-a12d75543cc3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:39.435254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aca2eb70-3bc6-4bcf-a233-089a37d3698c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:39.453678 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aca2eb70-3bc6-4bcf-a233-089a37d3698c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1677 microversion: 2.1 time: 0.881301 Oct 11 20:03:39.460973 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2264/4593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:38 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1677 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:39.580860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-434e2b1e-5552-420d-916b-ef62f3a52c08 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:39.581557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-434e2b1e-5552-420d-916b-ef62f3a52c08 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:39.604734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-434e2b1e-5552-420d-916b-ef62f3a52c08 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:39.612662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-434e2b1e-5552-420d-916b-ef62f3a52c08 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:39.613271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-434e2b1e-5552-420d-916b-ef62f3a52c08 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:39.614173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-434e2b1e-5552-420d-916b-ef62f3a52c08 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:39.620578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-434e2b1e-5552-420d-916b-ef62f3a52c08 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:39.624138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-434e2b1e-5552-420d-916b-ef62f3a52c08 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:39.720745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:40.235755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-080acaba-209a-4059-b88a-a12d75543cc3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:40.245213 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-080acaba-209a-4059-b88a-a12d75543cc3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 1.348948 Oct 11 20:03:40.257717 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2330/4594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:38 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:40.278195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-9caf1403-58d3-4415-972b-9ac91d3e78bd req-936735bb-251f-4438-b3f2-9d64d5c6bee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d6cd57-1120-449b-ba44-2066fb17c6e8", "tag": "a2241e88-c9e7-4296-bc6f-97e0146faa66"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:40.299811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9caf1403-58d3-4415-972b-9ac91d3e78bd req-936735bb-251f-4438-b3f2-9d64d5c6bee9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:40.300587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9caf1403-58d3-4415-972b-9ac91d3e78bd req-936735bb-251f-4438-b3f2-9d64d5c6bee9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:40.301179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-9caf1403-58d3-4415-972b-9ac91d3e78bd req-936735bb-251f-4438-b3f2-9d64d5c6bee9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:40.324454 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-9caf1403-58d3-4415-972b-9ac91d3e78bd req-936735bb-251f-4438-b3f2-9d64d5c6bee9 service nova] Creating event network-changed:a2241e88-c9e7-4296-bc6f-97e0146faa66 for instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 on n-h1-860864-3 Oct 11 20:03:40.346503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-9caf1403-58d3-4415-972b-9ac91d3e78bd req-936735bb-251f-4438-b3f2-9d64d5c6bee9 service nova] Instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:03:40.376831 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-9caf1403-58d3-4415-972b-9ac91d3e78bd req-936735bb-251f-4438-b3f2-9d64d5c6bee9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117502 Oct 11 20:03:40.378201 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2331/4595] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:40.385110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7ffc6b6-a47c-4577-9c4f-093f40712d03 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:40.386119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7ffc6b6-a47c-4577-9c4f-093f40712d03 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:40.394077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7ffc6b6-a47c-4577-9c4f-093f40712d03 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:40.400192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7ffc6b6-a47c-4577-9c4f-093f40712d03 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:40.400660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7ffc6b6-a47c-4577-9c4f-093f40712d03 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:40.401452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7ffc6b6-a47c-4577-9c4f-093f40712d03 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:40.407656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7ffc6b6-a47c-4577-9c4f-093f40712d03 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:40.408125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7ffc6b6-a47c-4577-9c4f-093f40712d03 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:40.543026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-434e2b1e-5552-420d-916b-ef62f3a52c08 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:40.557380 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-434e2b1e-5552-420d-916b-ef62f3a52c08 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1697 microversion: 2.1 time: 0.982500 Oct 11 20:03:40.558152 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2265/4596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:39 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1697 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:40.575082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-18d56aa4-ac07-4dd7-9941-20418af4f7cd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:40.576050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-18d56aa4-ac07-4dd7-9941-20418af4f7cd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:40.586416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d56aa4-ac07-4dd7-9941-20418af4f7cd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:40.589931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d56aa4-ac07-4dd7-9941-20418af4f7cd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:40.590691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d56aa4-ac07-4dd7-9941-20418af4f7cd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:40.591627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d56aa4-ac07-4dd7-9941-20418af4f7cd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:40.594955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d56aa4-ac07-4dd7-9941-20418af4f7cd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:40.595625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18d56aa4-ac07-4dd7-9941-20418af4f7cd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:41.166538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b7ffc6b6-a47c-4577-9c4f-093f40712d03 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:41.178190 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7ffc6b6-a47c-4577-9c4f-093f40712d03 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1609 microversion: 2.1 time: 0.796972 Oct 11 20:03:41.179000 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2332/4597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:40 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1609 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:41.280986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-141954a8-c50c-4ffa-931a-150eca392bef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:41.281788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-141954a8-c50c-4ffa-931a-150eca392bef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:41.289186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-141954a8-c50c-4ffa-931a-150eca392bef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:41.307299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-141954a8-c50c-4ffa-931a-150eca392bef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:41.307945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-141954a8-c50c-4ffa-931a-150eca392bef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:41.308890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-141954a8-c50c-4ffa-931a-150eca392bef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:41.309427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-141954a8-c50c-4ffa-931a-150eca392bef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:41.309998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-141954a8-c50c-4ffa-931a-150eca392bef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:41.738139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-141954a8-c50c-4ffa-931a-150eca392bef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:41.754324 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-141954a8-c50c-4ffa-931a-150eca392bef tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.476206 Oct 11 20:03:41.763182 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2333/4598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:41 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:41.788450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b332c0f-efe4-4749-bc1f-45b6c81d246c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:41.797036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b332c0f-efe4-4749-bc1f-45b6c81d246c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:41.825875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332c0f-efe4-4749-bc1f-45b6c81d246c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:41.830710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332c0f-efe4-4749-bc1f-45b6c81d246c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:41.832145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332c0f-efe4-4749-bc1f-45b6c81d246c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:41.833962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332c0f-efe4-4749-bc1f-45b6c81d246c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:41.834879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-18d56aa4-ac07-4dd7-9941-20418af4f7cd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:41.835512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332c0f-efe4-4749-bc1f-45b6c81d246c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:41.837167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b332c0f-efe4-4749-bc1f-45b6c81d246c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:41.843841 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-18d56aa4-ac07-4dd7-9941-20418af4f7cd tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1656 microversion: 2.1 time: 1.284498 Oct 11 20:03:41.860641 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2266/4599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:40 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1656 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:41.865730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-66175511-94a5-4730-a58e-a7177235a8c8 req-a9be8fb3-480d-4337-8be4-b090e7974164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745e09ac-b0bc-4fa9-86c4-ad943b8427a5", "name": "network-vif-deleted", "tag": "02d72842-94b4-48eb-87f3-4f729164d162"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:41.897975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-66175511-94a5-4730-a58e-a7177235a8c8 req-a9be8fb3-480d-4337-8be4-b090e7974164 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:41.898803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-66175511-94a5-4730-a58e-a7177235a8c8 req-a9be8fb3-480d-4337-8be4-b090e7974164 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:41.899438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-66175511-94a5-4730-a58e-a7177235a8c8 req-a9be8fb3-480d-4337-8be4-b090e7974164 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:41.913643 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-66175511-94a5-4730-a58e-a7177235a8c8 req-a9be8fb3-480d-4337-8be4-b090e7974164 service nova] Creating event network-vif-deleted:02d72842-94b4-48eb-87f3-4f729164d162 for instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 on n-h1-860864-3 Oct 11 20:03:41.919583 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-66175511-94a5-4730-a58e-a7177235a8c8 req-a9be8fb3-480d-4337-8be4-b090e7974164 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057381 Oct 11 20:03:41.921549 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2267/4600] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:42.212921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f8aff15-21eb-4fc2-941a-314b50ca65f9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:42.214403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8f8aff15-21eb-4fc2-941a-314b50ca65f9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:42.244514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f8aff15-21eb-4fc2-941a-314b50ca65f9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:42.245993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f8aff15-21eb-4fc2-941a-314b50ca65f9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:42.247002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f8aff15-21eb-4fc2-941a-314b50ca65f9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:42.247994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f8aff15-21eb-4fc2-941a-314b50ca65f9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:42.250390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f8aff15-21eb-4fc2-941a-314b50ca65f9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:42.254102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f8aff15-21eb-4fc2-941a-314b50ca65f9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:42.440339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b332c0f-efe4-4749-bc1f-45b6c81d246c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:42.451319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8f8aff15-21eb-4fc2-941a-314b50ca65f9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0647dca89de240ba9fbc1c59ed2b6392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd1bdcd18f14e87925a5b41393b9add', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:42.465129 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b332c0f-efe4-4749-bc1f-45b6c81d246c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1695 microversion: 2.1 time: 0.697459 Oct 11 20:03:42.465751 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2334/4601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:41 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1695 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:42.467632 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f8aff15-21eb-4fc2-941a-314b50ca65f9 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 200 len: 1609 microversion: 2.1 time: 0.263232 Oct 11 20:03:42.468873 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2268/4602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:42 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 1609 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:42.791031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2cff87af-06ee-46db-af4a-1698c4ee6391 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:42.791654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2cff87af-06ee-46db-af4a-1698c4ee6391 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:42.812399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cff87af-06ee-46db-af4a-1698c4ee6391 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:42.814818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cff87af-06ee-46db-af4a-1698c4ee6391 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:42.817733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cff87af-06ee-46db-af4a-1698c4ee6391 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:42.819338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cff87af-06ee-46db-af4a-1698c4ee6391 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:42.829978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cff87af-06ee-46db-af4a-1698c4ee6391 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:42.835837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2cff87af-06ee-46db-af4a-1698c4ee6391 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:42.876347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f332967-e38c-40fe-8b86-24ad36986645 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:42.877534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8f332967-e38c-40fe-8b86-24ad36986645 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:42.888199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f332967-e38c-40fe-8b86-24ad36986645 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:42.888936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f332967-e38c-40fe-8b86-24ad36986645 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:42.891109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f332967-e38c-40fe-8b86-24ad36986645 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:42.894273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f332967-e38c-40fe-8b86-24ad36986645 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:42.895986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f332967-e38c-40fe-8b86-24ad36986645 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:42.903709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f332967-e38c-40fe-8b86-24ad36986645 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:44.670023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8f332967-e38c-40fe-8b86-24ad36986645 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8f90c691c43e6a131517ff9b3a0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df583d3545145c1ae055328f823edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:44.678609 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f332967-e38c-40fe-8b86-24ad36986645 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 200 len: 1497 microversion: 2.1 time: 1.809354 Oct 11 20:03:44.698956 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2269/4603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:42 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 1497 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:44.712218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b0b42159-1d6b-49d3-aec4-591d71839461 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:44.713252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b0b42159-1d6b-49d3-aec4-591d71839461 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:44.714477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2cff87af-06ee-46db-af4a-1698c4ee6391 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:44.725443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0b42159-1d6b-49d3-aec4-591d71839461 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:44.731356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0b42159-1d6b-49d3-aec4-591d71839461 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:44.732528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0b42159-1d6b-49d3-aec4-591d71839461 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:44.733080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0b42159-1d6b-49d3-aec4-591d71839461 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:44.733737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0b42159-1d6b-49d3-aec4-591d71839461 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:44.734381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0b42159-1d6b-49d3-aec4-591d71839461 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:44.740313 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2cff87af-06ee-46db-af4a-1698c4ee6391 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 1.950611 Oct 11 20:03:44.742590 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2335/4604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:42 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:44.750505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:44.752260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] [instance: b7ee4391-e163-4a76-9151-04adeb0111a8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:44.779016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:44.779938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:44.780632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:44.782609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:44.783420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:44.784234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:44.836872 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] HTTP exception thrown: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 could not be found. Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Request method failure captured: Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 HTTP/1.1 Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcnI5OPNqEKALykkTrMulwNA85YH_Zdqz_g5mxxtFhZWzC1mgynXOwy-7XOBwQTjUtt_HFqth8q6PFQS1r46sN3cIfMotnurV3uQo5c99ZQnVSr2pWZn-5m3uVl2cj_7fGN0q1zKhyJks1DRVXwQGH05jJBBzz6HnW7DgJ8v9-VauHo Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efd1bdcd18f14e87925a5b41393b9add", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efd1bdcd18f14e87925a5b41393b9add"}]}] Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: efd1bdcd18f14e87925a5b41393b9add Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1914419120 Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1914419120-project Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 0647dca89de240ba9fbc1c59ed2b6392 Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1914419120-project Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 could not be found. Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'b7ee4391-e163-4a76-9151-04adeb0111a8'} Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 could not be found. Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 could not be found. Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:44.838944 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:44.843606 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:44.843606 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:44.843606 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:44.843606 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:44.843606 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:44.843606 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 could not be found. Oct 11 20:03:44.843606 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:44.851679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Returning 404 to user: Instance b7ee4391-e163-4a76-9151-04adeb0111a8 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:44.854943 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5740fbbe-030f-48fb-903e-7c0c29e984ba tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8" status: 404 len: 111 microversion: 2.1 time: 0.110494 Oct 11 20:03:44.858092 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2336/4605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:44 2022] GET /compute/v2.1/servers/b7ee4391-e163-4a76-9151-04adeb0111a8 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:44.874647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8ad805e0-1104-4f00-b12b-76e46a5a2171 req-78604681-36ef-4066-b770-66aa2b3b769c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee4391-e163-4a76-9151-04adeb0111a8", "name": "network-vif-deleted", "tag": "8feec027-3d8b-4b4e-9712-8f57ab9fb853"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:44.917338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ad805e0-1104-4f00-b12b-76e46a5a2171 req-78604681-36ef-4066-b770-66aa2b3b769c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:44.917841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ad805e0-1104-4f00-b12b-76e46a5a2171 req-78604681-36ef-4066-b770-66aa2b3b769c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:44.918308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ad805e0-1104-4f00-b12b-76e46a5a2171 req-78604681-36ef-4066-b770-66aa2b3b769c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:44.947593 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8ad805e0-1104-4f00-b12b-76e46a5a2171 req-78604681-36ef-4066-b770-66aa2b3b769c service nova] Creating event network-vif-deleted:8feec027-3d8b-4b4e-9712-8f57ab9fb853 for instance b7ee4391-e163-4a76-9151-04adeb0111a8 on n-h1-860864-3 Oct 11 20:03:44.958858 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8ad805e0-1104-4f00-b12b-76e46a5a2171 req-78604681-36ef-4066-b770-66aa2b3b769c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097810 Oct 11 20:03:44.966020 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2337/4606] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:44.978425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4ecb4288-7992-4f19-a995-da87a313f9c5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] Calling method '.version_select at 0x7f83cc5de310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:45.021349 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4ecb4288-7992-4f19-a995-da87a313f9c5 tempest-ServerActionsTestJSON-1914419120 tempest-ServerActionsTestJSON-1914419120-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106054146" status: 202 len: 0 microversion: 2.1 time: 0.053387 Oct 11 20:03:45.023859 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2338/4607] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 20:03:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106054146 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:03:45.097071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b0b42159-1d6b-49d3-aec4-591d71839461 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:45.106975 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b0b42159-1d6b-49d3-aec4-591d71839461 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1692 microversion: 2.1 time: 0.406777 Oct 11 20:03:45.117359 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2270/4608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:44 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1692 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:45.134383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-37386d54-f016-4a0a-a7c0-818bb87adb6e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:45.135548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-37386d54-f016-4a0a-a7c0-818bb87adb6e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:45.155408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37386d54-f016-4a0a-a7c0-818bb87adb6e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:45.157411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37386d54-f016-4a0a-a7c0-818bb87adb6e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:45.159444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37386d54-f016-4a0a-a7c0-818bb87adb6e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:45.160879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37386d54-f016-4a0a-a7c0-818bb87adb6e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:45.164951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37386d54-f016-4a0a-a7c0-818bb87adb6e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:45.166500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37386d54-f016-4a0a-a7c0-818bb87adb6e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:45.233318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:45.368343 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-37386d54-f016-4a0a-a7c0-818bb87adb6e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8/action" status: 204 len: 0 microversion: 2.1 time: 0.237758 Oct 11 20:03:45.369849 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2339/4609] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:03:45 2022] POST /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8/action => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:03:45.381650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0be6e19e-461b-4a9d-8f77-fc765f544163 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:45.383011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0be6e19e-461b-4a9d-8f77-fc765f544163 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:45.403429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0be6e19e-461b-4a9d-8f77-fc765f544163 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:45.404447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0be6e19e-461b-4a9d-8f77-fc765f544163 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:45.407892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0be6e19e-461b-4a9d-8f77-fc765f544163 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:45.409101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0be6e19e-461b-4a9d-8f77-fc765f544163 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:45.409966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0be6e19e-461b-4a9d-8f77-fc765f544163 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:45.411899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0be6e19e-461b-4a9d-8f77-fc765f544163 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:45.713710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:45.717971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:45.749776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:45.750355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:45.750976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:45.764969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:45.769213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:45.769688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:45.823117 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] HTTP exception thrown: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Request method failure captured: Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 HTTP/1.1 Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcusPV4N1G1LaObGP1tzm-yADkvyi3PGtSx77P_9Yv472CHEyZ33sitKqxomDkpvskpTmUSh_qdMM1x3tXmNBCs1bMC4f9F3LMTgIrvbBAy-_qlZI0daYpHxX_rmhe1P--ZA8nEnwukdEv4WBRRDvIayTyDoTRvLONCdUtl916iT3bU Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df583d3545145c1ae055328f823edbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df583d3545145c1ae055328f823edbc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}] Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 28a8f90c691c43e6a131517ff9b3a0cd Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '745e09ac-b0bc-4fa9-86c4-ad943b8427a5'} Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:45.825233 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:45.829054 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:45.829054 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:45.829054 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:45.829054 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:45.829054 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:45.829054 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:45.829054 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:45.829054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Returning 404 to user: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:45.829054 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-44003130-6ccd-4959-b228-ee6f6b534d1a tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 404 len: 111 microversion: 2.1 time: 0.120861 Oct 11 20:03:45.835728 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2340/4610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:45 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:45.836389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9db9fdf1-fc8a-40f8-9173-6d6caa0083e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:45.837159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9db9fdf1-fc8a-40f8-9173-6d6caa0083e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:45.844781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9db9fdf1-fc8a-40f8-9173-6d6caa0083e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:45.845281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9db9fdf1-fc8a-40f8-9173-6d6caa0083e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:45.846048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9db9fdf1-fc8a-40f8-9173-6d6caa0083e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:45.847601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9db9fdf1-fc8a-40f8-9173-6d6caa0083e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:45.848173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9db9fdf1-fc8a-40f8-9173-6d6caa0083e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:45.849133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9db9fdf1-fc8a-40f8-9173-6d6caa0083e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:46.164094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0be6e19e-461b-4a9d-8f77-fc765f544163 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:46.179296 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0be6e19e-461b-4a9d-8f77-fc765f544163 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1692 microversion: 2.1 time: 0.801203 Oct 11 20:03:46.180258 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2271/4611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:45 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1692 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:03:46.404012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9db9fdf1-fc8a-40f8-9173-6d6caa0083e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:46.416343 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9db9fdf1-fc8a-40f8-9173-6d6caa0083e1 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.583415 Oct 11 20:03:46.421144 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2341/4612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:45 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:47.030625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a4265009-5521-4361-8877-14570cffbf4e req-b0816a87-54ca-468b-9900-38ed33fa0368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745e09ac-b0bc-4fa9-86c4-ad943b8427a5", "name": "network-vif-deleted", "tag": "aadd1b7d-28d7-48a9-a479-ec6ead0843c3"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:47.074590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a4265009-5521-4361-8877-14570cffbf4e req-b0816a87-54ca-468b-9900-38ed33fa0368 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:47.075061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a4265009-5521-4361-8877-14570cffbf4e req-b0816a87-54ca-468b-9900-38ed33fa0368 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:47.075502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a4265009-5521-4361-8877-14570cffbf4e req-b0816a87-54ca-468b-9900-38ed33fa0368 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:47.113486 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a4265009-5521-4361-8877-14570cffbf4e req-b0816a87-54ca-468b-9900-38ed33fa0368 service nova] Creating event network-vif-deleted:aadd1b7d-28d7-48a9-a479-ec6ead0843c3 for instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 on n-h1-860864-3 Oct 11 20:03:47.130778 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a4265009-5521-4361-8877-14570cffbf4e req-b0816a87-54ca-468b-9900-38ed33fa0368 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110530 Oct 11 20:03:47.131408 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2272/4613] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:47.207811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-201d81db-a2d8-4ccf-a865-dd79fd658279 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:47.208968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-201d81db-a2d8-4ccf-a865-dd79fd658279 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:47.219277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201d81db-a2d8-4ccf-a865-dd79fd658279 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:47.222642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201d81db-a2d8-4ccf-a865-dd79fd658279 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:47.224379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201d81db-a2d8-4ccf-a865-dd79fd658279 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:47.227391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201d81db-a2d8-4ccf-a865-dd79fd658279 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:47.228376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201d81db-a2d8-4ccf-a865-dd79fd658279 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:47.231749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201d81db-a2d8-4ccf-a865-dd79fd658279 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:47.451337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a83f81e6-c9c6-4233-bb25-249d65329aa3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:47.452048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a83f81e6-c9c6-4233-bb25-249d65329aa3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:47.469795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a83f81e6-c9c6-4233-bb25-249d65329aa3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:47.474933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a83f81e6-c9c6-4233-bb25-249d65329aa3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:47.477037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a83f81e6-c9c6-4233-bb25-249d65329aa3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:47.478477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a83f81e6-c9c6-4233-bb25-249d65329aa3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:47.479642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a83f81e6-c9c6-4233-bb25-249d65329aa3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:47.480989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a83f81e6-c9c6-4233-bb25-249d65329aa3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:48.160719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-201d81db-a2d8-4ccf-a865-dd79fd658279 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:48.172041 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-201d81db-a2d8-4ccf-a865-dd79fd658279 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1692 microversion: 2.1 time: 0.968668 Oct 11 20:03:48.172633 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2342/4614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:47 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1692 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:48.205235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a83f81e6-c9c6-4233-bb25-249d65329aa3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:48.244497 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a83f81e6-c9c6-4233-bb25-249d65329aa3 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.794074 Oct 11 20:03:48.258551 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2273/4615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:47 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:48.846512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2239f3e5-ddd2-4bf8-9f50-68581f44537c req-7ef4cd83-3368-411d-9ca9-b1c099c1fdfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d6cd57-1120-449b-ba44-2066fb17c6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a2241e88-c9e7-4296-bc6f-97e0146faa66"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:48.883905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2239f3e5-ddd2-4bf8-9f50-68581f44537c req-7ef4cd83-3368-411d-9ca9-b1c099c1fdfd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:48.884665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2239f3e5-ddd2-4bf8-9f50-68581f44537c req-7ef4cd83-3368-411d-9ca9-b1c099c1fdfd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:48.886734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2239f3e5-ddd2-4bf8-9f50-68581f44537c req-7ef4cd83-3368-411d-9ca9-b1c099c1fdfd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:48.921009 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2239f3e5-ddd2-4bf8-9f50-68581f44537c req-7ef4cd83-3368-411d-9ca9-b1c099c1fdfd service nova] Creating event network-vif-plugged:a2241e88-c9e7-4296-bc6f-97e0146faa66 for instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 on n-h1-860864-3 Oct 11 20:03:48.931297 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2239f3e5-ddd2-4bf8-9f50-68581f44537c req-7ef4cd83-3368-411d-9ca9-b1c099c1fdfd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089132 Oct 11 20:03:48.933792 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2343/4616] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:03:49.200699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb78f367-1256-4cbd-bfb5-c46f6dab88fe tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:49.201321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bb78f367-1256-4cbd-bfb5-c46f6dab88fe tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:49.211748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb78f367-1256-4cbd-bfb5-c46f6dab88fe tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:49.212482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb78f367-1256-4cbd-bfb5-c46f6dab88fe tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:49.213494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb78f367-1256-4cbd-bfb5-c46f6dab88fe tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:49.214394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb78f367-1256-4cbd-bfb5-c46f6dab88fe tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:49.214995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb78f367-1256-4cbd-bfb5-c46f6dab88fe tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:49.215550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb78f367-1256-4cbd-bfb5-c46f6dab88fe tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:49.276919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5470a4d5-adf9-447b-8225-00630fe3fec4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:49.277688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5470a4d5-adf9-447b-8225-00630fe3fec4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:49.287767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5470a4d5-adf9-447b-8225-00630fe3fec4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:49.291160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5470a4d5-adf9-447b-8225-00630fe3fec4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:49.291791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5470a4d5-adf9-447b-8225-00630fe3fec4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:49.294259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5470a4d5-adf9-447b-8225-00630fe3fec4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:49.294730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5470a4d5-adf9-447b-8225-00630fe3fec4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:49.295158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5470a4d5-adf9-447b-8225-00630fe3fec4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:50.015658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bb78f367-1256-4cbd-bfb5-c46f6dab88fe tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:50.026237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bb78f367-1256-4cbd-bfb5-c46f6dab88fe tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1684 microversion: 2.1 time: 0.829779 Oct 11 20:03:50.032670 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2274/4617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:49 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1684 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:50.083599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5470a4d5-adf9-447b-8225-00630fe3fec4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:50.098273 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5470a4d5-adf9-447b-8225-00630fe3fec4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.825800 Oct 11 20:03:50.102504 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2344/4618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:49 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:50.439724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e1b09d8-4480-4e9b-b78f-279c2376413f tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Action: 'create', calling method: .version_select at 0x7f83c7370c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-203579662", "metadata": {"Type": "work"}}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e1b09d8-4480-4e9b-b78f-279c2376413f tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Request method failure captured: Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 121 Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcwlXGYaCv_lT6imCOnOXuUEhCuZBmXl1ZJfpaS_Y6o-aJ7-AhHe_poTbKYAEVSShleqEDWGky4hVlClTGV61QrlNxMrB3IkQTW6z6HCTz8jBdiws6455wTusd0KXXAjaz4de7XcYbwuCDcsAZHPDJu_9zjMVjMGSIjkl-HzDR6LvP4 Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f54f36bb18d642958a124507b630a41f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f54f36bb18d642958a124507b630a41f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}] Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bb4c3ecc23804b6ca04e451cc1fd11d2 Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-203579662", "metadata": {"Type": "work"}}} Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-203579662', 'metadata': {'Type': 'work'}}}} Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi '#$%' Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 20:03:50.445918 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 20:03:50.451114 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.453408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e1b09d8-4480-4e9b-b78f-279c2376413f tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:50.454505 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9e1b09d8-4480-4e9b-b78f-279c2376413f tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.255630 Oct 11 20:03:50.455568 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2275/4619] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 11 20:03:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:03:50.466692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-608284c9-ba08-4435-b775-9c6724dc00a4 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Action: 'create', calling method: .version_select at 0x7f83cc485670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2113918509", "metadata": {"Type": "work"}}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-608284c9-ba08-4435-b775-9c6724dc00a4 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Request method failure captured: Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 120 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcwlXGYaCv_lT6imCOnOXuUEhCuZBmXl1ZJfpaS_Y6o-aJ7-AhHe_poTbKYAEVSShleqEDWGky4hVlClTGV61QrlNxMrB3IkQTW6z6HCTz8jBdiws6455wTusd0KXXAjaz4de7XcYbwuCDcsAZHPDJu_9zjMVjMGSIjkl-HzDR6LvP4 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f54f36bb18d642958a124507b630a41f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f54f36bb18d642958a124507b630a41f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}] Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bb4c3ecc23804b6ca04e451cc1fd11d2 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2113918509", "metadata": {"Type": "work"}}} Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2113918509', 'metadata': {'Type': 'work'}}}} Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi '0' Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 20:03:50.472188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 20:03:50.480020 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.486898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-608284c9-ba08-4435-b775-9c6724dc00a4 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:50.488287 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-608284c9-ba08-4435-b775-9c6724dc00a4 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026980 Oct 11 20:03:50.490107 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2345/4620] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 11 20:03:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 20:03:50.500078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7bd9b855-7bdc-45c8-ad16-fa74e462d755 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Action: 'create', calling method: .version_select at 0x7f83c72055e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-955706806", "metadata": {"Type": "work"}}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7bd9b855-7bdc-45c8-ad16-fa74e462d755 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Request method failure captured: Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 118 Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcwlXGYaCv_lT6imCOnOXuUEhCuZBmXl1ZJfpaS_Y6o-aJ7-AhHe_poTbKYAEVSShleqEDWGky4hVlClTGV61QrlNxMrB3IkQTW6z6HCTz8jBdiws6455wTusd0KXXAjaz4de7XcYbwuCDcsAZHPDJu_9zjMVjMGSIjkl-HzDR6LvP4 Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f54f36bb18d642958a124507b630a41f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f54f36bb18d642958a124507b630a41f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}] Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bb4c3ecc23804b6ca04e451cc1fd11d2 Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-955706806", "metadata": {"Type": "work"}}} Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-955706806', 'metadata': {'Type': 'work'}}}} Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi '' Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 20:03:50.508589 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 20:03:50.513624 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.515168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7bd9b855-7bdc-45c8-ad16-fa74e462d755 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:50.516285 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7bd9b855-7bdc-45c8-ad16-fa74e462d755 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020751 Oct 11 20:03:50.517542 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2276/4621] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 11 20:03:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:03:50.533928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ff0468d-baf3-4a5c-b942-099858fbad79 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Calling method '.version_select at 0x7f83c72e18b0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:50.596793 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1ff0468d-baf3-4a5c-b942-099858fbad79 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] HTTP exception thrown: Volume tempest-invalid-131875212 could not be found. Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ff0468d-baf3-4a5c-b942-099858fbad79 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Request method failure captured: Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-131875212 HTTP/1.1 Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcwlXGYaCv_lT6imCOnOXuUEhCuZBmXl1ZJfpaS_Y6o-aJ7-AhHe_poTbKYAEVSShleqEDWGky4hVlClTGV61QrlNxMrB3IkQTW6z6HCTz8jBdiws6455wTusd0KXXAjaz4de7XcYbwuCDcsAZHPDJu_9zjMVjMGSIjkl-HzDR6LvP4 Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f54f36bb18d642958a124507b630a41f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f54f36bb18d642958a124507b630a41f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}] Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bb4c3ecc23804b6ca04e451cc1fd11d2 Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: exception: Volume tempest-invalid-131875212 could not be found. Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'tempest-invalid-131875212'} Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-131875212 could not be found. (HTTP 404) (Request-ID: req-c9459c6e-e775-4a76-b270-4a1336a50729) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 20:03:50.600229 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-131875212 could not be found. Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-131875212 could not be found. Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-131875212 could not be found. Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ff0468d-baf3-4a5c-b942-099858fbad79 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Returning 404 to user: Volume tempest-invalid-131875212 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1ff0468d-baf3-4a5c-b942-099858fbad79 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-131875212" status: 404 len: 98 microversion: 2.1 time: 0.078318 Oct 11 20:03:50.604184 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2346/4622] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Oct 11 20:03:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-131875212 => generated 98 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 20:03:50.616777 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f74303d8-6dbb-4c0b-863b-3841619de204 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007026 Oct 11 20:03:50.617402 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2277/4623] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 11 20:03:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 20:03:50.627979 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9ae05e4-72a8-4d8a-866a-d7d029dfdaad tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003955 Oct 11 20:03:50.628488 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2347/4624] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 11 20:03:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 20:03:50.640117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a3819b9-fd2e-430b-8485-02f261e3b990 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Calling method '.version_select at 0x7f83cc2a6040>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:50.703632 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-4a3819b9-fd2e-430b-8485-02f261e3b990 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] HTTP exception thrown: Volume 99a11359-4b85-414d-b7b1-3cfb31336fd9 could not be found. Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a3819b9-fd2e-430b-8485-02f261e3b990 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Request method failure captured: Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-volumes/99a11359-4b85-414d-b7b1-3cfb31336fd9 HTTP/1.1 Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcwlXGYaCv_lT6imCOnOXuUEhCuZBmXl1ZJfpaS_Y6o-aJ7-AhHe_poTbKYAEVSShleqEDWGky4hVlClTGV61QrlNxMrB3IkQTW6z6HCTz8jBdiws6455wTusd0KXXAjaz4de7XcYbwuCDcsAZHPDJu_9zjMVjMGSIjkl-HzDR6LvP4 Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f54f36bb18d642958a124507b630a41f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f54f36bb18d642958a124507b630a41f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}] Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: bb4c3ecc23804b6ca04e451cc1fd11d2 Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: exception: Volume 99a11359-4b85-414d-b7b1-3cfb31336fd9 could not be found. Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '99a11359-4b85-414d-b7b1-3cfb31336fd9'} Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99a11359-4b85-414d-b7b1-3cfb31336fd9 could not be found. (HTTP 404) (Request-ID: req-feb625c5-2324-4e7e-814a-dc0079976ae9) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 20:03:50.707146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99a11359-4b85-414d-b7b1-3cfb31336fd9 could not be found. Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99a11359-4b85-414d-b7b1-3cfb31336fd9 could not be found. Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99a11359-4b85-414d-b7b1-3cfb31336fd9 could not be found. Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a3819b9-fd2e-430b-8485-02f261e3b990 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Returning 404 to user: Volume 99a11359-4b85-414d-b7b1-3cfb31336fd9 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a3819b9-fd2e-430b-8485-02f261e3b990 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/99a11359-4b85-414d-b7b1-3cfb31336fd9" status: 404 len: 109 microversion: 2.1 time: 0.074542 Oct 11 20:03:50.711065 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2278/4625] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:03:50 2022] DELETE /compute/v2.1/os-volumes/99a11359-4b85-414d-b7b1-3cfb31336fd9 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:50.719175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cc9c8422-ff0c-4096-a478-97bd59b218e9 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Calling method '.version_select at 0x7f83cc44e280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:50.773755 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-cc9c8422-ff0c-4096-a478-97bd59b218e9 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] HTTP exception thrown: Volume e115b100-dbd4-4c6b-a8bf-0e47456502fa could not be found. Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cc9c8422-ff0c-4096-a478-97bd59b218e9 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Request method failure captured: Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-volumes/e115b100-dbd4-4c6b-a8bf-0e47456502fa HTTP/1.1 Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcwlXGYaCv_lT6imCOnOXuUEhCuZBmXl1ZJfpaS_Y6o-aJ7-AhHe_poTbKYAEVSShleqEDWGky4hVlClTGV61QrlNxMrB3IkQTW6z6HCTz8jBdiws6455wTusd0KXXAjaz4de7XcYbwuCDcsAZHPDJu_9zjMVjMGSIjkl-HzDR6LvP4 Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f54f36bb18d642958a124507b630a41f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f54f36bb18d642958a124507b630a41f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f54f36bb18d642958a124507b630a41f"}]}] Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f54f36bb18d642958a124507b630a41f Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesNegativeTest-1523090712 Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: bb4c3ecc23804b6ca04e451cc1fd11d2 Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesNegativeTest-1523090712-project Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: exception: Volume e115b100-dbd4-4c6b-a8bf-0e47456502fa could not be found. Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'e115b100-dbd4-4c6b-a8bf-0e47456502fa'} Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e115b100-dbd4-4c6b-a8bf-0e47456502fa could not be found. (HTTP 404) (Request-ID: req-5daea27b-380e-4483-bad0-9345bd2c4c27) Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 20:03:50.776304 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e115b100-dbd4-4c6b-a8bf-0e47456502fa could not be found. Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e115b100-dbd4-4c6b-a8bf-0e47456502fa could not be found. Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e115b100-dbd4-4c6b-a8bf-0e47456502fa could not be found. Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cc9c8422-ff0c-4096-a478-97bd59b218e9 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] Returning 404 to user: Volume e115b100-dbd4-4c6b-a8bf-0e47456502fa could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cc9c8422-ff0c-4096-a478-97bd59b218e9 tempest-VolumesNegativeTest-1523090712 tempest-VolumesNegativeTest-1523090712-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e115b100-dbd4-4c6b-a8bf-0e47456502fa" status: 404 len: 109 microversion: 2.1 time: 0.063043 Oct 11 20:03:50.781903 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2348/4626] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:03:50 2022] GET /compute/v2.1/os-volumes/e115b100-dbd4-4c6b-a8bf-0e47456502fa => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:51.128360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-19d078b4-2077-4fa5-921d-d0dbd0594f17 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:51.129303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-19d078b4-2077-4fa5-921d-d0dbd0594f17 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:51.150002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d078b4-2077-4fa5-921d-d0dbd0594f17 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:51.151666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d078b4-2077-4fa5-921d-d0dbd0594f17 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:51.157081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d078b4-2077-4fa5-921d-d0dbd0594f17 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:51.159355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d078b4-2077-4fa5-921d-d0dbd0594f17 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:51.160571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d078b4-2077-4fa5-921d-d0dbd0594f17 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:51.162491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d078b4-2077-4fa5-921d-d0dbd0594f17 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:51.518261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:51.519471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:51.548219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:51.552331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:51.555147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:51.556248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:51.558365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:51.559089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:51.606011 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] HTTP exception thrown: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Request method failure captured: Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 HTTP/1.1 Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcusPV4N1G1LaObGP1tzm-yADkvyi3PGtSx77P_9Yv472CHEyZ33sitKqxomDkpvskpTmUSh_qdMM1x3tXmNBCs1bMC4f9F3LMTgIrvbBAy-_qlZI0daYpHxX_rmhe1P--ZA8nEnwukdEv4WBRRDvIayTyDoTRvLONCdUtl916iT3bU Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df583d3545145c1ae055328f823edbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df583d3545145c1ae055328f823edbc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}] Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 28a8f90c691c43e6a131517ff9b3a0cd Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '745e09ac-b0bc-4fa9-86c4-ad943b8427a5'} Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:51.608312 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:51.612358 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.618089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Returning 404 to user: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:51.620018 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bab44636-3a24-49d0-9dc8-d0960f22209c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "DELETE /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 404 len: 111 microversion: 2.1 time: 0.108341 Oct 11 20:03:51.621373 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2349/4627] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:03:51 2022] DELETE /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:51.631054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:51.631924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: 745e09ac-b0bc-4fa9-86c4-ad943b8427a5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:51.649199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:51.649867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:51.650427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:51.651319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:51.653226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:51.654395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:51.678586 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] HTTP exception thrown: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Request method failure captured: Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 HTTP/1.1 Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcusPV4N1G1LaObGP1tzm-yADkvyi3PGtSx77P_9Yv472CHEyZ33sitKqxomDkpvskpTmUSh_qdMM1x3tXmNBCs1bMC4f9F3LMTgIrvbBAy-_qlZI0daYpHxX_rmhe1P--ZA8nEnwukdEv4WBRRDvIayTyDoTRvLONCdUtl916iT3bU Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df583d3545145c1ae055328f823edbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df583d3545145c1ae055328f823edbc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}] Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 28a8f90c691c43e6a131517ff9b3a0cd Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '745e09ac-b0bc-4fa9-86c4-ad943b8427a5'} Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:51.680440 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.685007 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.685007 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:51.685007 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:51.685007 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:51.685007 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:51.685007 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. Oct 11 20:03:51.685007 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.685007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Returning 404 to user: Instance 745e09ac-b0bc-4fa9-86c4-ad943b8427a5 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:51.685007 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4aa695ea-72f8-4ab6-bfc8-97c48d12cd28 tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5" status: 404 len: 111 microversion: 2.1 time: 0.057898 Oct 11 20:03:51.687822 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2350/4628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:51 2022] GET /compute/v2.1/servers/745e09ac-b0bc-4fa9-86c4-ad943b8427a5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:51.695666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:51.697270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:51.704600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:51.705613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:51.706264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:51.708147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:51.708837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:51.709448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:51.724976 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] HTTP exception thrown: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Request method failure captured: Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 HTTP/1.1 Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcusPV4N1G1LaObGP1tzm-yADkvyi3PGtSx77P_9Yv472CHEyZ33sitKqxomDkpvskpTmUSh_qdMM1x3tXmNBCs1bMC4f9F3LMTgIrvbBAy-_qlZI0daYpHxX_rmhe1P--ZA8nEnwukdEv4WBRRDvIayTyDoTRvLONCdUtl916iT3bU Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df583d3545145c1ae055328f823edbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df583d3545145c1ae055328f823edbc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}] Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 28a8f90c691c43e6a131517ff9b3a0cd Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a1ff88c4-2697-4489-a684-d48f009037c5'} Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:51.726580 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Returning 404 to user: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:51.730983 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c5669a9e-3b63-42f1-8842-cc5b99fbc18c tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 404 len: 111 microversion: 2.1 time: 0.038380 Oct 11 20:03:51.734013 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2351/4629] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:03:51 2022] DELETE /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:51.737113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:51.737729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] [instance: a1ff88c4-2697-4489-a684-d48f009037c5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:51.746021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:51.746589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:51.747006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:51.748200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:51.748671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:51.749185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:51.765157 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] HTTP exception thrown: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Request method failure captured: Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 HTTP/1.1 Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcusPV4N1G1LaObGP1tzm-yADkvyi3PGtSx77P_9Yv472CHEyZ33sitKqxomDkpvskpTmUSh_qdMM1x3tXmNBCs1bMC4f9F3LMTgIrvbBAy-_qlZI0daYpHxX_rmhe1P--ZA8nEnwukdEv4WBRRDvIayTyDoTRvLONCdUtl916iT3bU Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1df583d3545145c1ae055328f823edbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1df583d3545145c1ae055328f823edbc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1df583d3545145c1ae055328f823edbc"}]}] Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1df583d3545145c1ae055328f823edbc Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestMultiNic-1611500234 Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 28a8f90c691c43e6a131517ff9b3a0cd Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestMultiNic-1611500234-project Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'a1ff88c4-2697-4489-a684-d48f009037c5'} Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:03:51.767205 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.771763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:03:51.771763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:03:51.771763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:03:51.771763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:03:51.771763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:03:51.771763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. Oct 11 20:03:51.771763 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:03:51.776480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] Returning 404 to user: Instance a1ff88c4-2697-4489-a684-d48f009037c5 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:03:51.778086 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4470961d-5e5f-4c99-9a60-ae19fa15b91d tempest-ServersTestMultiNic-1611500234 tempest-ServersTestMultiNic-1611500234-project] 10.222.0.27 "GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5" status: 404 len: 111 microversion: 2.1 time: 0.044739 Oct 11 20:03:51.782091 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2352/4630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:51 2022] GET /compute/v2.1/servers/a1ff88c4-2697-4489-a684-d48f009037c5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:03:51.796311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-19d078b4-2077-4fa5-921d-d0dbd0594f17 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:51.829566 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-19d078b4-2077-4fa5-921d-d0dbd0594f17 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.708120 Oct 11 20:03:51.830446 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2279/4631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:51 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:52.771789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-47477796-4398-4bfb-bd92-49d8892ae0c6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:52.772342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-47477796-4398-4bfb-bd92-49d8892ae0c6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:52.791994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47477796-4398-4bfb-bd92-49d8892ae0c6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:52.792500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47477796-4398-4bfb-bd92-49d8892ae0c6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:52.794044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47477796-4398-4bfb-bd92-49d8892ae0c6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:52.794832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47477796-4398-4bfb-bd92-49d8892ae0c6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:52.795298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47477796-4398-4bfb-bd92-49d8892ae0c6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:52.795720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47477796-4398-4bfb-bd92-49d8892ae0c6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:52.861823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4cd20ffa-687a-42a2-90fe-37157e458942 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:52.862629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4cd20ffa-687a-42a2-90fe-37157e458942 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:52.874625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cd20ffa-687a-42a2-90fe-37157e458942 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:52.875248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cd20ffa-687a-42a2-90fe-37157e458942 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:52.875800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cd20ffa-687a-42a2-90fe-37157e458942 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:52.876570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cd20ffa-687a-42a2-90fe-37157e458942 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:52.879563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cd20ffa-687a-42a2-90fe-37157e458942 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:52.881312 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-47477796-4398-4bfb-bd92-49d8892ae0c6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/ips" status: 200 len: 150 microversion: 2.20 time: 0.113208 Oct 11 20:03:52.881723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4cd20ffa-687a-42a2-90fe-37157e458942 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:52.882649 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2353/4632] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Oct 11 20:03:52 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/ips => generated 150 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:03:53.827086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4cd20ffa-687a-42a2-90fe-37157e458942 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:53.845782 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4cd20ffa-687a-42a2-90fe-37157e458942 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.993025 Oct 11 20:03:53.850998 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2280/4633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:52 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:03:54.876595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbf11f10-4a46-4661-a627-181c8c1f7730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:54.877219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cbf11f10-4a46-4661-a627-181c8c1f7730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:54.895817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf11f10-4a46-4661-a627-181c8c1f7730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:54.906168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf11f10-4a46-4661-a627-181c8c1f7730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:54.907170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf11f10-4a46-4661-a627-181c8c1f7730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:54.910671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf11f10-4a46-4661-a627-181c8c1f7730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:54.911979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf11f10-4a46-4661-a627-181c8c1f7730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:54.912579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf11f10-4a46-4661-a627-181c8c1f7730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:55.852145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cbf11f10-4a46-4661-a627-181c8c1f7730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:55.861888 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cbf11f10-4a46-4661-a627-181c8c1f7730 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1510 microversion: 2.1 time: 0.989116 Oct 11 20:03:55.862486 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2354/4634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:54 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1510 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:56.888672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-08c6235d-1c28-4694-95f3-e2a4c3324bc4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:56.889903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-08c6235d-1c28-4694-95f3-e2a4c3324bc4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:56.905658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:03:56.911782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08c6235d-1c28-4694-95f3-e2a4c3324bc4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:56.914387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08c6235d-1c28-4694-95f3-e2a4c3324bc4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:56.914907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08c6235d-1c28-4694-95f3-e2a4c3324bc4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:56.915659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08c6235d-1c28-4694-95f3-e2a4c3324bc4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:56.918621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08c6235d-1c28-4694-95f3-e2a4c3324bc4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:56.921303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08c6235d-1c28-4694-95f3-e2a4c3324bc4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:57.538178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-08c6235d-1c28-4694-95f3-e2a4c3324bc4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:57.552089 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-08c6235d-1c28-4694-95f3-e2a4c3324bc4 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1487 microversion: 2.1 time: 0.667760 Oct 11 20:03:57.563148 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2281/4635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:56 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1487 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:57.597242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ca18ebc0-9767-4e59-867c-c735d8fbd805 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1048478501"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:57.610053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ca18ebc0-9767-4e59-867c-c735d8fbd805 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:57.638743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca18ebc0-9767-4e59-867c-c735d8fbd805 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:57.642860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca18ebc0-9767-4e59-867c-c735d8fbd805 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:57.647279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca18ebc0-9767-4e59-867c-c735d8fbd805 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:57.649741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca18ebc0-9767-4e59-867c-c735d8fbd805 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:57.652096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca18ebc0-9767-4e59-867c-c735d8fbd805 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:57.652740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca18ebc0-9767-4e59-867c-c735d8fbd805 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:57.908946 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ca18ebc0-9767-4e59-867c-c735d8fbd805 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "PUT /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1061 microversion: 2.1 time: 0.325990 Oct 11 20:03:57.909717 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2355/4636] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 11 20:03:57 2022] PUT /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1061 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:57.919904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b6dc2837-68e2-445a-b188-07ad41c1709c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:03:57.921319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b6dc2837-68e2-445a-b188-07ad41c1709c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:57.933348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7aa52597-2164-47f8-ba76-8d959c6e6d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:57.934272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7aa52597-2164-47f8-ba76-8d959c6e6d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:57.952714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6dc2837-68e2-445a-b188-07ad41c1709c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:57.954307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6dc2837-68e2-445a-b188-07ad41c1709c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:57.955960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa52597-2164-47f8-ba76-8d959c6e6d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:57.956364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6dc2837-68e2-445a-b188-07ad41c1709c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:57.957429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa52597-2164-47f8-ba76-8d959c6e6d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:57.958116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa52597-2164-47f8-ba76-8d959c6e6d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:57.961912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa52597-2164-47f8-ba76-8d959c6e6d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:57.964018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa52597-2164-47f8-ba76-8d959c6e6d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:57.964236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6dc2837-68e2-445a-b188-07ad41c1709c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:57.964725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa52597-2164-47f8-ba76-8d959c6e6d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:57.965532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6dc2837-68e2-445a-b188-07ad41c1709c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:57.969579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6dc2837-68e2-445a-b188-07ad41c1709c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:58.053867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-b6dc2837-68e2-445a-b188-07ad41c1709c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lazy-loading 'flavor' on Instance uuid 7a125d45-79ec-4fda-9601-334c311a9f7a {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:03:58.612910 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b6dc2837-68e2-445a-b188-07ad41c1709c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "POST /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/action" status: 202 len: 0 microversion: 2.20 time: 0.697574 Oct 11 20:03:58.613562 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2282/4637] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 20:03:57 2022] POST /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:03:58.626660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:58.635014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:58.665055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:58.665620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:58.666214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:58.667121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:58.667601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:58.668037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:58.824223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7aa52597-2164-47f8-ba76-8d959c6e6d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:58.839597 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7aa52597-2164-47f8-ba76-8d959c6e6d9b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1488 microversion: 2.1 time: 0.910181 Oct 11 20:03:58.861337 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2356/4638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:57 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1488 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:03:58.871527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e74af8aa-38ac-408b-9250-402364f8237a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:58.872506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e74af8aa-38ac-408b-9250-402364f8237a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:58.886941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e74af8aa-38ac-408b-9250-402364f8237a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:58.887844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e74af8aa-38ac-408b-9250-402364f8237a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:58.889912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e74af8aa-38ac-408b-9250-402364f8237a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:58.890920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e74af8aa-38ac-408b-9250-402364f8237a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:58.896711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e74af8aa-38ac-408b-9250-402364f8237a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:58.897536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e74af8aa-38ac-408b-9250-402364f8237a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:59.432595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:59.455296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:59.462352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:59.465129 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7ca30dd9-4583-4648-b758-bba525a96ab8 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1721 microversion: 2.20 time: 0.845726 Oct 11 20:03:59.468808 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2283/4639] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:03:58 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1721 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:03:59.579394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e74af8aa-38ac-408b-9250-402364f8237a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:03:59.588432 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e74af8aa-38ac-408b-9250-402364f8237a tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1488 microversion: 2.1 time: 0.725451 Oct 11 20:03:59.591055 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2357/4640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:03:58 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1488 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:03:59.617323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8653d676-3ef2-4eff-a548-7288fb144103 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:03:59.617886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8653d676-3ef2-4eff-a548-7288fb144103 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:03:59.639396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8653d676-3ef2-4eff-a548-7288fb144103 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:59.641097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8653d676-3ef2-4eff-a548-7288fb144103 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:59.643867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8653d676-3ef2-4eff-a548-7288fb144103 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:59.645458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8653d676-3ef2-4eff-a548-7288fb144103 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:03:59.649278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8653d676-3ef2-4eff-a548-7288fb144103 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:03:59.649945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8653d676-3ef2-4eff-a548-7288fb144103 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:03:59.727338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8653d676-3ef2-4eff-a548-7288fb144103 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:03:59.788579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:00.026183 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8653d676-3ef2-4eff-a548-7288fb144103 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 204 len: 0 microversion: 2.1 time: 0.413724 Oct 11 20:04:00.033422 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2284/4641] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:03:59 2022] DELETE /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:04:00.041748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3113e38c-ba22-43cc-99cf-e6b246a0586b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:00.043066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3113e38c-ba22-43cc-99cf-e6b246a0586b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:00.058154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3113e38c-ba22-43cc-99cf-e6b246a0586b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:00.061108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3113e38c-ba22-43cc-99cf-e6b246a0586b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:00.061978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3113e38c-ba22-43cc-99cf-e6b246a0586b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:00.064234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3113e38c-ba22-43cc-99cf-e6b246a0586b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:00.065330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3113e38c-ba22-43cc-99cf-e6b246a0586b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:00.065925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3113e38c-ba22-43cc-99cf-e6b246a0586b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:00.499123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:00.500522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:00.515506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:00.519103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:00.520510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:00.522297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:00.524702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:00.528664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:00.970664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3113e38c-ba22-43cc-99cf-e6b246a0586b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:00.983837 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3113e38c-ba22-43cc-99cf-e6b246a0586b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1494 microversion: 2.1 time: 0.949218 Oct 11 20:04:00.986165 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2358/4642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:00 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1494 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:04:01.315324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:01.343061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:01.349941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:01.382177 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d21d5b0c-2f3d-4c09-b3b0-1536826bf4a2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1721 microversion: 2.20 time: 0.857887 Oct 11 20:04:01.390217 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2285/4643] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:00 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1721 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:02.016829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-59669cbe-4451-499b-aa8e-21be5d01bbce tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:02.017740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59669cbe-4451-499b-aa8e-21be5d01bbce tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:02.038987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59669cbe-4451-499b-aa8e-21be5d01bbce tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:02.039692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59669cbe-4451-499b-aa8e-21be5d01bbce tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:02.040821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59669cbe-4451-499b-aa8e-21be5d01bbce tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:02.041779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59669cbe-4451-499b-aa8e-21be5d01bbce tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:02.042402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59669cbe-4451-499b-aa8e-21be5d01bbce tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:02.043296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59669cbe-4451-499b-aa8e-21be5d01bbce tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:02.420159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:02.421112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:02.442908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:02.443766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:02.447345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:02.448270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:02.449639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:02.453474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:03.381895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59669cbe-4451-499b-aa8e-21be5d01bbce tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:03.401370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:03.403348 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-59669cbe-4451-499b-aa8e-21be5d01bbce tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 200 len: 1494 microversion: 2.1 time: 1.393108 Oct 11 20:04:03.404053 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2359/4644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:02 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 1494 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:03.424755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:03.429281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:03.430143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3c65389a-9210-459a-a80c-582b8e6de31e req-d77c9475-a135-483a-9f6e-4c41689c39dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d25fc4-9e9d-446b-b301-de855a5df2cf", "name": "network-vif-deleted", "tag": "5dbcd3b3-f4cf-478d-b105-2d821a707380"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:03.432995 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c990d398-a8fd-4c91-a07a-d07118d403a1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1721 microversion: 2.20 time: 1.017439 Oct 11 20:04:03.438741 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2286/4645] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:02 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1721 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:04:03.481837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3c65389a-9210-459a-a80c-582b8e6de31e req-d77c9475-a135-483a-9f6e-4c41689c39dd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:03.482332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3c65389a-9210-459a-a80c-582b8e6de31e req-d77c9475-a135-483a-9f6e-4c41689c39dd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:03.483759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3c65389a-9210-459a-a80c-582b8e6de31e req-d77c9475-a135-483a-9f6e-4c41689c39dd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:03.514576 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3c65389a-9210-459a-a80c-582b8e6de31e req-d77c9475-a135-483a-9f6e-4c41689c39dd service nova] Creating event network-vif-deleted:5dbcd3b3-f4cf-478d-b105-2d821a707380 for instance b3d25fc4-9e9d-446b-b301-de855a5df2cf on n-h2-860864-3 Oct 11 20:04:03.528800 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3c65389a-9210-459a-a80c-582b8e6de31e req-d77c9475-a135-483a-9f6e-4c41689c39dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123485 Oct 11 20:04:03.529800 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2360/4646] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:04:04.428274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:04.428895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:04.442051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.442583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.443029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.444525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.444993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.445417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.468193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:04.468813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:04.471205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:04.481821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.485930 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.486728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf HTTP/1.1 Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'b3d25fc4-9e9d-446b-b301-de855a5df2cf'} Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.490100 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.494898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.494898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.494898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.494898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:04.494898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:04.494898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.494898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.494898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:04.497503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.498491 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e0f00afa-2dd2-4fe2-bc83-cf637941254e tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 404 len: 111 microversion: 2.1 time: 0.074165 Oct 11 20:04:04.499193 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2287/4647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:04 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:04.512161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.512161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.512161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.532150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:04.532636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:04.553013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.553529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.553970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.554717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.555173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.555591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.620689 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf HTTP/1.1 Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'b3d25fc4-9e9d-446b-b301-de855a5df2cf'} Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:04.622910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.626757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.626757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.626757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.626757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.626757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.626757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.626757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:04.626757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:04.626757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.626757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.637100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:04.638368 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2896dbe6-0236-43bd-86ac-7bf4d0b9b66b tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 404 len: 111 microversion: 2.1 time: 0.119447 Oct 11 20:04:04.639725 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2288/4648] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:04:04 2022] DELETE /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:04.650099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:04.651191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: b3d25fc4-9e9d-446b-b301-de855a5df2cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:04.658306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.659290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.660752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.663430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.664371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.665105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.684116 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf HTTP/1.1 Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'b3d25fc4-9e9d-446b-b301-de855a5df2cf'} Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.687314 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.694030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.694030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.694030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.694030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:04.694030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:04.694030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. Oct 11 20:04:04.694030 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.696469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance b3d25fc4-9e9d-446b-b301-de855a5df2cf could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:04.697800 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8980b4d9-17ee-4bf3-8866-afad9c60d02d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf" status: 404 len: 111 microversion: 2.1 time: 0.052165 Oct 11 20:04:04.698959 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2289/4649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:04 2022] GET /compute/v2.1/servers/b3d25fc4-9e9d-446b-b301-de855a5df2cf => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:04.712595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:04.713617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:04.723146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.724172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.724852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.725930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.726661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.727566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.745863 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 HTTP/1.1 Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '061c597d-8847-4f24-bc20-3cf90b707636'} Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:04.748141 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:04:04.751940 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.751940 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.751940 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.751940 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.751940 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.751940 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.751940 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:04.751940 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:04.751940 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:04:04.751940 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.759995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:04.762087 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1c74c334-62a9-4d73-8e48-c6e07f790316 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 404 len: 111 microversion: 2.1 time: 0.055109 Oct 11 20:04:04.763265 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2290/4650] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:04:04 2022] DELETE /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:04.775369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:04.776932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 061c597d-8847-4f24-bc20-3cf90b707636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:04.786600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.787706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.788681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.789947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.791158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.792231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.824198 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 HTTP/1.1 Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '061c597d-8847-4f24-bc20-3cf90b707636'} Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.825764 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.829716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.829716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.829716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.829716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:04.829716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:04.829716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. Oct 11 20:04:04.829716 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.829716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance 061c597d-8847-4f24-bc20-3cf90b707636 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:04.832642 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9fd62c3d-e1f3-4df2-898f-24fa428ced14 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636" status: 404 len: 111 microversion: 2.1 time: 0.060676 Oct 11 20:04:04.835660 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2291/4651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:04 2022] GET /compute/v2.1/servers/061c597d-8847-4f24-bc20-3cf90b707636 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:04.846174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:04.849142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:04.863735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.865253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.867347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.868356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.869742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.872154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.906696 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be HTTP/1.1 Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'c6f29c5a-1f92-4faf-90c8-24627b3f31be'} Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:04.908560 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:04:04.913371 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.913371 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.913371 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.913371 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.913371 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.913371 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.913371 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:04.913371 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:04.913371 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:04:04.913371 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.922755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:04.924006 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-64261af4-a110-414a-b754-bd72ec071ea9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 404 len: 111 microversion: 2.1 time: 0.084981 Oct 11 20:04:04.925407 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2292/4652] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:04:04 2022] DELETE /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:04.933794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:04.938827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6f29c5a-1f92-4faf-90c8-24627b3f31be] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:04.963687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.964339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.964928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.965940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:04.966650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:04.967556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:04.995267 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be HTTP/1.1 Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'c6f29c5a-1f92-4faf-90c8-24627b3f31be'} Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:04.999909 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.004556 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.004556 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.004556 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.004556 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:05.004556 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:05.004556 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. Oct 11 20:04:05.004556 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.004556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance c6f29c5a-1f92-4faf-90c8-24627b3f31be could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:05.005067 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a04a585-2ecb-41f2-93c8-a157bbe86a74 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be" status: 404 len: 111 microversion: 2.1 time: 0.075383 Oct 11 20:04:05.009257 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2293/4653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:04 2022] GET /compute/v2.1/servers/c6f29c5a-1f92-4faf-90c8-24627b3f31be => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:05.023526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:05.025494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:05.043008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.044031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.045871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.048460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.049215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.050385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.097918 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 HTTP/1.1 Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'af7fe3a5-dbd2-435f-a3ff-165d30307447'} Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:05.103187 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:04:05.107429 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.107429 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.107429 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.107429 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.107429 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.107429 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.107429 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:05.107429 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:05.107429 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:04:05.107429 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.111611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:05.115285 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-133a727b-16ff-4f98-a58c-59d7c9106ccc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 404 len: 111 microversion: 2.1 time: 0.099299 Oct 11 20:04:05.116165 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2294/4654] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:04:05 2022] DELETE /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:05.129693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:05.133461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: af7fe3a5-dbd2-435f-a3ff-165d30307447] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:05.147426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.148351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.150271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.152795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.153850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.156953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.203803 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 HTTP/1.1 Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'af7fe3a5-dbd2-435f-a3ff-165d30307447'} Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.212039 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.216054 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.216054 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.216054 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.216054 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:05.216054 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:05.216054 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. Oct 11 20:04:05.216054 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.220382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance af7fe3a5-dbd2-435f-a3ff-165d30307447 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:05.223764 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e1c116ba-b369-4726-a8d4-ad7518ea4262 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447" status: 404 len: 111 microversion: 2.1 time: 0.103143 Oct 11 20:04:05.230597 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2295/4655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:05 2022] GET /compute/v2.1/servers/af7fe3a5-dbd2-435f-a3ff-165d30307447 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:05.249321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:05.256876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:05.272477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.273079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.274775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.275691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.277054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.278897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.319061 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a HTTP/1.1 Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'c6a538e9-f310-4739-bf23-3db32cca228a'} Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:05.320817 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:04:05.324835 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.324835 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.324835 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.324835 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.324835 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.324835 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.324835 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:05.324835 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:05.324835 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:04:05.324835 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.326973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:05.328073 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-76524ff2-1f28-42e4-ac29-075f78c7f470 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 404 len: 111 microversion: 2.1 time: 0.093052 Oct 11 20:04:05.329187 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2296/4656] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:04:05 2022] DELETE /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:05.338054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:05.342025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: c6a538e9-f310-4739-bf23-3db32cca228a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:05.361713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.365502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.366339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.367359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.368671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.369186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.397141 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a HTTP/1.1 Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'c6a538e9-f310-4739-bf23-3db32cca228a'} Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.414794 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.418847 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.418847 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.418847 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.418847 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:05.418847 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:05.418847 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. Oct 11 20:04:05.418847 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.418847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance c6a538e9-f310-4739-bf23-3db32cca228a could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:05.418847 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-677e588f-e9f3-48b7-bc32-a4a64e6ee54d tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a" status: 404 len: 111 microversion: 2.1 time: 0.082584 Oct 11 20:04:05.418847 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2297/4657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:05 2022] GET /compute/v2.1/servers/c6a538e9-f310-4739-bf23-3db32cca228a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 20:04:05.425914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:05.426551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:05.438555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.439211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.449322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.450218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.450801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.451514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.480949 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 HTTP/1.1 Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f536ba50-8666-4272-91ea-a92f7a6e8e87'} Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:05.492593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:04:05.497267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.497267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.497267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.497267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.497267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.497267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.497267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:05.497267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:05.497267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:04:05.497267 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.501111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:05.503585 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9f4c354-487e-4f2f-a0b5-2ffd9c692a69 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 404 len: 111 microversion: 2.1 time: 0.082158 Oct 11 20:04:05.511497 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2298/4658] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:04:05 2022] DELETE /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:05.525132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:05.535656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f536ba50-8666-4272-91ea-a92f7a6e8e87] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:05.549325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.554625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.556011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.564137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.566633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.568731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:05.569186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.592669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:05.596001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:05.598907 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e3864c1-9c99-42b2-a73a-8ef023d35d42 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1721 microversion: 2.20 time: 1.137286 Oct 11 20:04:05.599584 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 HTTP/1.1 Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f536ba50-8666-4272-91ea-a92f7a6e8e87'} Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.601166 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.605013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.605013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.605013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.605013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:05.605013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:05.605013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. Oct 11 20:04:05.605013 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.605013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance f536ba50-8666-4272-91ea-a92f7a6e8e87 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:05.605013 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b76b5b4d-a762-40d7-b8c0-6e98678262ae tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87" status: 404 len: 111 microversion: 2.1 time: 0.084291 Oct 11 20:04:05.605013 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2299/4659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:05 2022] GET /compute/v2.1/servers/f536ba50-8666-4272-91ea-a92f7a6e8e87 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:05.606940 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2361/4660] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:04 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1721 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:05.627055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4b05f98-351d-4d70-b617-b674ca95731c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:05.630039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a4b05f98-351d-4d70-b617-b674ca95731c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 728db27d-d985-495b-a9b9-aa26fd765990] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:05.656731 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-a4b05f98-351d-4d70-b617-b674ca95731c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4b05f98-351d-4d70-b617-b674ca95731c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990 HTTP/1.1 Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '728db27d-d985-495b-a9b9-aa26fd765990'} Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.659117 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.663958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.663958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.663958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.663958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:05.663958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:05.663958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:04:05.663958 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.663958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4b05f98-351d-4d70-b617-b674ca95731c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:05.663958 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a4b05f98-351d-4d70-b617-b674ca95731c tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990" status: 404 len: 111 microversion: 2.1 time: 0.052948 Oct 11 20:04:05.669572 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2300/4661] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:04:05 2022] DELETE /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:05.679001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ceed12f5-8be2-4620-8679-3a0482fe20f8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:05.679612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ceed12f5-8be2-4620-8679-3a0482fe20f8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: 728db27d-d985-495b-a9b9-aa26fd765990] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:05.694303 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-ceed12f5-8be2-4620-8679-3a0482fe20f8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ceed12f5-8be2-4620-8679-3a0482fe20f8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990 HTTP/1.1 Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '728db27d-d985-495b-a9b9-aa26fd765990'} Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:05.697288 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:05.704821 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:05.704821 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:05.704821 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:05.704821 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. Oct 11 20:04:05.704821 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:05.704821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ceed12f5-8be2-4620-8679-3a0482fe20f8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance 728db27d-d985-495b-a9b9-aa26fd765990 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:05.704821 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ceed12f5-8be2-4620-8679-3a0482fe20f8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990" status: 404 len: 111 microversion: 2.1 time: 0.023922 Oct 11 20:04:05.704821 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2362/4662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:05 2022] GET /compute/v2.1/servers/728db27d-d985-495b-a9b9-aa26fd765990 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:05.707880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e5c2de8-c2a1-486d-a18f-0f73c0445716 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:05.708543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e5c2de8-c2a1-486d-a18f-0f73c0445716 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:05.725242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e5c2de8-c2a1-486d-a18f-0f73c0445716 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.725774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e5c2de8-c2a1-486d-a18f-0f73c0445716 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.738554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e5c2de8-c2a1-486d-a18f-0f73c0445716 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.740588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e5c2de8-c2a1-486d-a18f-0f73c0445716 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:05.741082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e5c2de8-c2a1-486d-a18f-0f73c0445716 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:05.741527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e5c2de8-c2a1-486d-a18f-0f73c0445716 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:05.809092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e5c2de8-c2a1-486d-a18f-0f73c0445716 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:04:06.013919 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2e5c2de8-c2a1-486d-a18f-0f73c0445716 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 204 len: 0 microversion: 2.1 time: 0.304840 Oct 11 20:04:06.013919 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2301/4663] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:04:05 2022] DELETE /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:04:06.026338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eee251d4-66f1-437c-a987-95fe903c1012 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:06.027023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eee251d4-66f1-437c-a987-95fe903c1012 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:06.049639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eee251d4-66f1-437c-a987-95fe903c1012 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:06.054153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eee251d4-66f1-437c-a987-95fe903c1012 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:06.059522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eee251d4-66f1-437c-a987-95fe903c1012 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:06.063456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eee251d4-66f1-437c-a987-95fe903c1012 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:06.064192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eee251d4-66f1-437c-a987-95fe903c1012 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:06.067025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eee251d4-66f1-437c-a987-95fe903c1012 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:06.521236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eee251d4-66f1-437c-a987-95fe903c1012 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:06.532193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1595444510", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": "none"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:06.549670 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eee251d4-66f1-437c-a987-95fe903c1012 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1480 microversion: 2.1 time: 0.531832 Oct 11 20:04:06.569737 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2363/4664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:06 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1480 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:06.635394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:06.636919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:06.661242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:04:06.662510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:04:06.663870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:06.664588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:04:06.665128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:04:06.666203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:04:06.666426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:06.669512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:06.670733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:06.671467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:06.673668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:06.700277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:06.701170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:06.706057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:06.707606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:06.708359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:06.709393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:06.723616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:06.775683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Getting quotas for project 653eb832df684b58a0bee7c715e0dbbb. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:04:06.789887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Getting quotas for user e5646f2e6f314bfc83276b006fa6c03e and project 653eb832df684b58a0bee7c715e0dbbb. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:04:06.833601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:04:06.843750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:04:06.937769 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0894b18f-d249-4555-81e3-8fcd739723ea tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.698285 Oct 11 20:04:06.953828 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2302/4665] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 20:04:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 20:04:06.962325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4b073749-b3cd-4a69-a3fe-ee9b7e1a53e4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:06.963251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4b073749-b3cd-4a69-a3fe-ee9b7e1a53e4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:07.115425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:07.131739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:07.133373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:07.138060 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-67df4aaa-5c78-409f-ab77-5e5e80e43231 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1721 microversion: 2.20 time: 0.506510 Oct 11 20:04:07.138850 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2364/4666] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:06 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1721 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:07.281232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4b073749-b3cd-4a69-a3fe-ee9b7e1a53e4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:07.301538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4b073749-b3cd-4a69-a3fe-ee9b7e1a53e4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:07.312532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4b073749-b3cd-4a69-a3fe-ee9b7e1a53e4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:07.332985 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4b073749-b3cd-4a69-a3fe-ee9b7e1a53e4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962" status: 200 len: 1281 microversion: 2.47 time: 0.372174 Oct 11 20:04:07.335625 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2303/4667] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:06 2022] GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962 => generated 1281 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:07.577165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a4cd2bfa-a9c8-4a17-943b-5be2f100d5cc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:07.577774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a4cd2bfa-a9c8-4a17-943b-5be2f100d5cc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:07.589826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4cd2bfa-a9c8-4a17-943b-5be2f100d5cc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:07.590411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4cd2bfa-a9c8-4a17-943b-5be2f100d5cc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:07.590906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4cd2bfa-a9c8-4a17-943b-5be2f100d5cc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:07.592868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4cd2bfa-a9c8-4a17-943b-5be2f100d5cc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:07.595136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4cd2bfa-a9c8-4a17-943b-5be2f100d5cc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:07.595769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4cd2bfa-a9c8-4a17-943b-5be2f100d5cc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:08.164629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:08.166227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:08.178211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:08.184174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:08.184948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:08.186020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:08.186776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:08.187434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:08.236627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4cd2bfa-a9c8-4a17-943b-5be2f100d5cc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:08.255241 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a4cd2bfa-a9c8-4a17-943b-5be2f100d5cc tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1480 microversion: 2.1 time: 0.678370 Oct 11 20:04:08.257697 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2365/4668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:07 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1480 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:08.366180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:08.366937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:08.377621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:08.383498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:08.384315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:08.385957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:08.388015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:08.388942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:08.831811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:08.852791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:08.854177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:08.866050 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb9eb09b-30a5-4070-b2a6-54e8c11c1051 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962" status: 200 len: 1277 microversion: 2.47 time: 0.493924 Oct 11 20:04:08.879133 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2366/4669] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:08 2022] GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962 => generated 1277 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:04:08.897088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ddafb27d-0595-447f-a07c-81d35c125f74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:08.908778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ddafb27d-0595-447f-a07c-81d35c125f74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:08.927521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddafb27d-0595-447f-a07c-81d35c125f74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:08.928038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddafb27d-0595-447f-a07c-81d35c125f74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:08.930826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddafb27d-0595-447f-a07c-81d35c125f74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:08.931610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddafb27d-0595-447f-a07c-81d35c125f74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:08.933477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddafb27d-0595-447f-a07c-81d35c125f74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:08.933933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ddafb27d-0595-447f-a07c-81d35c125f74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:09.055809 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ddafb27d-0595-447f-a07c-81d35c125f74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8/action" status: 200 len: 24572 microversion: 2.1 time: 0.175030 Oct 11 20:04:09.058084 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2367/4670] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:04:08 2022] POST /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8/action => generated 24572 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:04:09.286832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-155f33be-d739-4768-8e97-8bdd6bb62ef9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:09.287783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-155f33be-d739-4768-8e97-8bdd6bb62ef9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:09.301633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-155f33be-d739-4768-8e97-8bdd6bb62ef9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:09.302302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-155f33be-d739-4768-8e97-8bdd6bb62ef9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:09.303017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-155f33be-d739-4768-8e97-8bdd6bb62ef9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:09.303873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-155f33be-d739-4768-8e97-8bdd6bb62ef9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:09.305783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-155f33be-d739-4768-8e97-8bdd6bb62ef9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:09.308348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-155f33be-d739-4768-8e97-8bdd6bb62ef9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:09.381791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:09.408033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:09.416523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:09.421647 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-37f9f977-a168-4e2c-ba17-32afc67a77b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1721 microversion: 2.20 time: 1.258012 Oct 11 20:04:09.423578 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2304/4671] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:08 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1721 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:09.896779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-155f33be-d739-4768-8e97-8bdd6bb62ef9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:09.897224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:09.897641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:09.905709 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-155f33be-d739-4768-8e97-8bdd6bb62ef9 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1480 microversion: 2.1 time: 0.623711 Oct 11 20:04:09.910024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:09.913101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:09.914065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:09.915401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:09.918510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:09.919274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:09.926397 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2368/4672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:09 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1480 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:10.065991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fecba08d-b3ae-47b0-b9d8-fa99a85a32d8 req-11881bd9-c826-4a40-9cfc-b212caaa8368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54ce835-5aaa-41d9-a3d8-7c3debc17c6f", "name": "network-vif-deleted", "tag": "eef2e5f6-d641-4728-8057-83da0ade845a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:10.084468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fecba08d-b3ae-47b0-b9d8-fa99a85a32d8 req-11881bd9-c826-4a40-9cfc-b212caaa8368 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:10.085817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fecba08d-b3ae-47b0-b9d8-fa99a85a32d8 req-11881bd9-c826-4a40-9cfc-b212caaa8368 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:10.086395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fecba08d-b3ae-47b0-b9d8-fa99a85a32d8 req-11881bd9-c826-4a40-9cfc-b212caaa8368 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:10.122435 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fecba08d-b3ae-47b0-b9d8-fa99a85a32d8 req-11881bd9-c826-4a40-9cfc-b212caaa8368 service nova] Creating event network-vif-deleted:eef2e5f6-d641-4728-8057-83da0ade845a for instance f54ce835-5aaa-41d9-a3d8-7c3debc17c6f on n-h1-860864-3 Oct 11 20:04:10.141788 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fecba08d-b3ae-47b0-b9d8-fa99a85a32d8 req-11881bd9-c826-4a40-9cfc-b212caaa8368 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079825 Oct 11 20:04:10.143453 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2369/4673] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:04:10.246460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:10.273419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:10.276361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:10.282845 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bc0973b7-729c-4040-a106-4a1ffe5f0ed9 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962" status: 200 len: 1339 microversion: 2.47 time: 0.387306 Oct 11 20:04:10.354612 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2305/4674] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:09 2022] GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962 => generated 1339 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:04:10.464168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:10.466841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:10.492130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:10.492915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:10.493672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:10.498461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:10.499609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:10.504314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:10.939603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:10.942944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:10.958487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:10.959413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:10.960112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:10.961068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:10.962774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:10.964400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:11.109482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:11.110436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:11.113793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:11.119420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lazy-loading 'fault' on Instance uuid f54ce835-5aaa-41d9-a3d8-7c3debc17c6f {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:04:12.142394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84c2531dcb24cce9872808db6c1fa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd7fdf22e0046e28c70ed06a2dededa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:12.152202 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ec3aa0b3-1f41-409c-bb47-77f427ab40b8 tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 200 len: 1283 microversion: 2.1 time: 1.217740 Oct 11 20:04:12.164754 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2306/4675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:10 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 1283 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:12.188318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:12.196653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:12.238877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:12.239394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:12.239851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:12.240588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:12.241071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:12.241515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:12.390496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:12.409817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:12.421327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:12.424146 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b6f93f62-1602-476d-9ab3-bc1e0e054858 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962" status: 200 len: 1360 microversion: 2.47 time: 0.243056 Oct 11 20:04:12.429474 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2307/4676] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:12 2022] GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962 => generated 1360 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:12.458005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6416b15e-bcf8-4302-bf18-eb98b5ededc4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-834817192"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:12.461117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6416b15e-bcf8-4302-bf18-eb98b5ededc4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:12.474399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6416b15e-bcf8-4302-bf18-eb98b5ededc4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:12.478950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6416b15e-bcf8-4302-bf18-eb98b5ededc4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:12.480714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6416b15e-bcf8-4302-bf18-eb98b5ededc4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:12.481937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6416b15e-bcf8-4302-bf18-eb98b5ededc4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:12.483987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6416b15e-bcf8-4302-bf18-eb98b5ededc4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:12.484686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6416b15e-bcf8-4302-bf18-eb98b5ededc4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:12.516004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:12.543510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:12.551829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:12.552687 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6cb7418-98f2-47a0-a6b1-67153c6f079b tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1721 microversion: 2.20 time: 2.103031 Oct 11 20:04:12.553288 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2370/4677] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:10 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1721 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:12.878384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:12.947919 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6416b15e-bcf8-4302-bf18-eb98b5ededc4 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "POST /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962/action" status: 202 len: 52 microversion: 2.47 time: 0.493624 Oct 11 20:04:12.948965 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2308/4678] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 20:04:12 2022] POST /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962/action => generated 52 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Oct 11 20:04:12.960651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6b98bd6-2586-42a5-a52a-d30fb8482d5d tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:12.961178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6b98bd6-2586-42a5-a52a-d30fb8482d5d tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:12.979303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b98bd6-2586-42a5-a52a-d30fb8482d5d tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:12.979822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b98bd6-2586-42a5-a52a-d30fb8482d5d tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:12.980274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b98bd6-2586-42a5-a52a-d30fb8482d5d tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:12.981558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b98bd6-2586-42a5-a52a-d30fb8482d5d tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:12.982042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b98bd6-2586-42a5-a52a-d30fb8482d5d tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:12.982483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b98bd6-2586-42a5-a52a-d30fb8482d5d tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:13.057468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6b98bd6-2586-42a5-a52a-d30fb8482d5d tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:04:13.198159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:13.201413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] [instance: f54ce835-5aaa-41d9-a3d8-7c3debc17c6f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:13.266107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:13.269011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:13.270922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:13.278792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:13.280321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:13.283312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:13.350960 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6b98bd6-2586-42a5-a52a-d30fb8482d5d tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962" status: 204 len: 0 microversion: 2.47 time: 0.394256 Oct 11 20:04:13.357170 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2371/4679] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:04:12 2022] DELETE /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:04:13.369398 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] HTTP exception thrown: Instance f54ce835-5aaa-41d9-a3d8-7c3debc17c6f could not be found. Oct 11 20:04:13.382296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:13.386690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Request method failure captured: Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f HTTP/1.1 Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsswqQHLQ3m208ZwcAjCSXHsnWwJsf_eqfDrXIRXHXhQqZQLudwVuh4ZvahiVzcYDziB4aBBgnkIsw0-zD1ZASy-oRBMQCh_Z4milMzOKC6k0gm1gXkwkqfCZtZXjG5e2MD-ocpZ0ChW7-_vRo7a1pGitysVeah4K6b-SiwC3E4-TI Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ffd7fdf22e0046e28c70ed06a2dededa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ffd7fdf22e0046e28c70ed06a2dededa"}]}] Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersTestJSON-1329468480 Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ffd7fdf22e0046e28c70ed06a2dededa Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersTestJSON-1329468480 Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: a84c2531dcb24cce9872808db6c1fa6d Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersTestJSON-1329468480-project Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance f54ce835-5aaa-41d9-a3d8-7c3debc17c6f could not be found. Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'f54ce835-5aaa-41d9-a3d8-7c3debc17c6f'} Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f54ce835-5aaa-41d9-a3d8-7c3debc17c6f could not be found. Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f54ce835-5aaa-41d9-a3d8-7c3debc17c6f could not be found. Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:13.390720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:13.395148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:13.395148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:13.395148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:13.395148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:13.395148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:13.395148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f54ce835-5aaa-41d9-a3d8-7c3debc17c6f could not be found. Oct 11 20:04:13.395148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:13.408378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] Returning 404 to user: Instance f54ce835-5aaa-41d9-a3d8-7c3debc17c6f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:13.411399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:13.413844 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-39f4d1a9-4884-4715-919f-05c134b4bcde tempest-ServersTestJSON-1329468480 tempest-ServersTestJSON-1329468480-project] 10.222.0.27 "GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f" status: 404 len: 111 microversion: 2.1 time: 0.221495 Oct 11 20:04:13.414680 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2309/4680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:13 2022] GET /compute/v2.1/servers/f54ce835-5aaa-41d9-a3d8-7c3debc17c6f => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:13.420316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:13.423992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:13.424831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:13.435606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:13.437502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:13.603987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:13.604674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:13.648561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:13.649351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:13.651329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:13.652460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:13.653145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:13.653741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:13.785771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:13.803023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:13.804490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:13.805696 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7af25a29-6156-45ee-a7b5-e460ba3dcc34 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962" status: 200 len: 1366 microversion: 2.47 time: 0.444533 Oct 11 20:04:13.806269 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2372/4681] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:13 2022] GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962 => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:14.732886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:14.746047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:14.748207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:14.751266 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-73fecb8b-bd13-4382-a54d-a370ba84152e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1721 microversion: 2.20 time: 1.163766 Oct 11 20:04:14.766643 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2310/4682] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:13 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1721 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:14.833992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:14.834813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:14.847790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:14.849508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:14.849975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:14.852554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:14.853043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:14.853479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:15.008951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:15.022752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:15.024232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:15.034416 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-81428839-0851-4678-a014-bd8af00aee64 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962" status: 200 len: 1366 microversion: 2.47 time: 0.204187 Oct 11 20:04:15.047857 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2373/4683] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:14 2022] GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:15.622832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc0b5e5b-1f4f-4a39-9169-f8abdf2e1099 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:15.623805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc0b5e5b-1f4f-4a39-9169-f8abdf2e1099 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:15.644213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc0b5e5b-1f4f-4a39-9169-f8abdf2e1099 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:15.645307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc0b5e5b-1f4f-4a39-9169-f8abdf2e1099 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:15.645982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc0b5e5b-1f4f-4a39-9169-f8abdf2e1099 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:15.647301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc0b5e5b-1f4f-4a39-9169-f8abdf2e1099 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:15.649467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc0b5e5b-1f4f-4a39-9169-f8abdf2e1099 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:15.654120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc0b5e5b-1f4f-4a39-9169-f8abdf2e1099 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:15.780689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:15.781242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:15.799469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:15.800550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:15.807228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:15.826631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:15.827515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:15.828190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:16.383912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:16.395702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:16.397178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:16.398371 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-452570b4-ef2a-4fa4-8c12-6a9ef0498359 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1742 microversion: 2.20 time: 0.621930 Oct 11 20:04:16.398969 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2374/4684] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:15 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1742 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:04:16.406560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:16.414400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:16.426642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:16.429590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:16.430808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:16.433624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:16.435163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:16.439152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:16.452146 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc0b5e5b-1f4f-4a39-9169-f8abdf2e1099 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1835 microversion: 2.1 time: 0.835898 Oct 11 20:04:16.457591 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2311/4685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:15 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1835 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:16.665976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:16.677642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:16.692788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5646f2e6f314bfc83276b006fa6c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653eb832df684b58a0bee7c715e0dbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:16.703949 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae3eb3db-a67e-4b46-9d44-2bff50c9750b tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962" status: 200 len: 1366 microversion: 2.47 time: 0.301028 Oct 11 20:04:16.704654 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2375/4686] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:16 2022] GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:17.427862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:17.428487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:17.438165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:17.441542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:17.461753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:17.464654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:17.469207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:17.470063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:17.475476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:17.480393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:17.735760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:17.736387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] [instance: 98f50d87-53bb-4586-86ca-5e1550f83962] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:17.761705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:17.762211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:17.762700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:17.767801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:17.768388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:17.768907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:17.831458 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] HTTP exception thrown: Instance 98f50d87-53bb-4586-86ca-5e1550f83962 could not be found. Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Request method failure captured: Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962 HTTP/1.1 Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcw1hUM7bv0jZIEIC70OE2aVHedvAhXrxYAnbE8sWvhmVZF75ANPvVIy06rDQVhNldmo7CIc36gYcx07RnCwf28PuGyon9nm8GzRI9uWKDy9qeWygdqvqMZGGF05uet5OouHHRZQIfwvoit-HdmtzQ16KCfXcgI8_fP7QOhY9DSyMBA Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 653eb832df684b58a0bee7c715e0dbbb Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAaction247Test-69732230 Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/653eb832df684b58a0bee7c715e0dbbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_653eb832df684b58a0bee7c715e0dbbb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/653eb832df684b58a0bee7c715e0dbbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/653eb832df684b58a0bee7c715e0dbbb"}]}] Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAaction247Test-69732230 Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 653eb832df684b58a0bee7c715e0dbbb Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAaction247Test-69732230 Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAaction247Test-69732230-project Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: e5646f2e6f314bfc83276b006fa6c03e Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAaction247Test-69732230-project Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 98f50d87-53bb-4586-86ca-5e1550f83962 could not be found. Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '98f50d87-53bb-4586-86ca-5e1550f83962'} Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f50d87-53bb-4586-86ca-5e1550f83962 could not be found. Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f50d87-53bb-4586-86ca-5e1550f83962 could not be found. Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:17.845209 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:17.850707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:17.850707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:17.850707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:17.850707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:17.850707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:17.850707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f50d87-53bb-4586-86ca-5e1550f83962 could not be found. Oct 11 20:04:17.850707 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:17.850707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] Returning 404 to user: Instance 98f50d87-53bb-4586-86ca-5e1550f83962 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:17.856380 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-021ba033-140c-49a7-b956-2ac4084d14d0 tempest-ServersAaction247Test-69732230 tempest-ServersAaction247Test-69732230-project] 10.222.0.27 "GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962" status: 404 len: 111 microversion: 2.47 time: 0.121161 Oct 11 20:04:17.857032 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2376/4687] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:17 2022] GET /compute/v2.1/servers/98f50d87-53bb-4586-86ca-5e1550f83962 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 20:04:18.497134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:18.524526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:18.533277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:18.538812 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d4ded215-9abc-406d-8f18-e1c77f68e040 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.112961 Oct 11 20:04:18.559525 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2312/4688] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:17 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:19.565049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:19.566592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:19.585751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:19.586325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:19.588564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:19.590380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:19.600450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:19.601059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:20.443089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-55984040", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:20.659994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] validate_networks() for [('4362c5de-7a61-4899-8592-aa9019178da7', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:04:20.743918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:20.770343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:20.779956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:20.790537 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1f376fd7-a228-4076-b780-d99422287822 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.229583 Oct 11 20:04:20.795735 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2377/4689] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:19 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:21.823808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:21.824853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:21.870980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:21.884204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:21.884922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:21.892580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:21.896521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:21.897662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:22.789895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:22.823089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:22.836757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:22.848354 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6ab2ae2-f82d-4029-952d-9e4952b861ae tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.028833 Oct 11 20:04:22.853882 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2378/4690] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:21 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:22.862257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-e729d88d-c134-4bc8-9580-eddfb56285b0 req-72a2b425-71d7-4d91-a200-9d00d3a5fceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a125d45-79ec-4fda-9601-334c311a9f7a", "name": "network-vif-plugged", "status": "completed", "tag": "e4e15471-dfd8-4f5d-be37-fdddaa52dfc8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:22.918325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e729d88d-c134-4bc8-9580-eddfb56285b0 req-72a2b425-71d7-4d91-a200-9d00d3a5fceb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:22.919158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e729d88d-c134-4bc8-9580-eddfb56285b0 req-72a2b425-71d7-4d91-a200-9d00d3a5fceb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:22.921585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e729d88d-c134-4bc8-9580-eddfb56285b0 req-72a2b425-71d7-4d91-a200-9d00d3a5fceb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:22.952615 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-e729d88d-c134-4bc8-9580-eddfb56285b0 req-72a2b425-71d7-4d91-a200-9d00d3a5fceb service nova] Creating event network-vif-plugged:e4e15471-dfd8-4f5d-be37-fdddaa52dfc8 for instance 7a125d45-79ec-4fda-9601-334c311a9f7a on n-h1-860864-3 Oct 11 20:04:22.973051 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-e729d88d-c134-4bc8-9580-eddfb56285b0 req-72a2b425-71d7-4d91-a200-9d00d3a5fceb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117572 Oct 11 20:04:22.976213 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2379/4691] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:04:22.983975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9d648310-3607-4821-954b-05048a40ce94 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:22.988584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9d648310-3607-4821-954b-05048a40ce94 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:23.002179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d648310-3607-4821-954b-05048a40ce94 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:23.004795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d648310-3607-4821-954b-05048a40ce94 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:23.008026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d648310-3607-4821-954b-05048a40ce94 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:23.009667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d648310-3607-4821-954b-05048a40ce94 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:23.011751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d648310-3607-4821-954b-05048a40ce94 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:23.012991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d648310-3607-4821-954b-05048a40ce94 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:23.118485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9d648310-3607-4821-954b-05048a40ce94 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:04:23.277290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:23.510872 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9d648310-3607-4821-954b-05048a40ce94 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 204 len: 0 microversion: 2.1 time: 0.527571 Oct 11 20:04:23.512744 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2380/4692] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:04:22 2022] DELETE /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:04:23.549372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c2d6e2e1-5d40-4edf-a5e7-76dca210a1c4 req-e27f1af1-fce6-41d2-9c94-c18fce7fcf8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d6cd57-1120-449b-ba44-2066fb17c6e8", "tag": "a2241e88-c9e7-4296-bc6f-97e0146faa66"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:23.607832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c2d6e2e1-5d40-4edf-a5e7-76dca210a1c4 req-e27f1af1-fce6-41d2-9c94-c18fce7fcf8d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:23.608369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c2d6e2e1-5d40-4edf-a5e7-76dca210a1c4 req-e27f1af1-fce6-41d2-9c94-c18fce7fcf8d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:23.609602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c2d6e2e1-5d40-4edf-a5e7-76dca210a1c4 req-e27f1af1-fce6-41d2-9c94-c18fce7fcf8d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:23.632978 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c2d6e2e1-5d40-4edf-a5e7-76dca210a1c4 req-e27f1af1-fce6-41d2-9c94-c18fce7fcf8d service nova] Creating event network-changed:a2241e88-c9e7-4296-bc6f-97e0146faa66 for instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 on n-h1-860864-3 Oct 11 20:04:23.648488 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c2d6e2e1-5d40-4edf-a5e7-76dca210a1c4 req-e27f1af1-fce6-41d2-9c94-c18fce7fcf8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130070 Oct 11 20:04:23.651059 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2381/4693] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:04:23.667562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc017bd4-3115-446b-ba80-40b13594ad2b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:23.668959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc017bd4-3115-446b-ba80-40b13594ad2b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:23.692535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc017bd4-3115-446b-ba80-40b13594ad2b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:23.695211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc017bd4-3115-446b-ba80-40b13594ad2b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:23.696114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc017bd4-3115-446b-ba80-40b13594ad2b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:23.697691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc017bd4-3115-446b-ba80-40b13594ad2b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:23.700615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc017bd4-3115-446b-ba80-40b13594ad2b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:23.701244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc017bd4-3115-446b-ba80-40b13594ad2b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:24.032806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:04:24.033362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:04:24.034507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:04:24.034946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:04:24.035359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:04:24.054002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:24.054501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:24.057583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:24.058350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:24.062918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:24.063377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:24.226265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Getting quotas for project a6aefbcc43964768b0cfcec5ea2f3611. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:04:24.271022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:24.272370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Getting quotas for user 721c9cd3d7dc4132af77999c14cdca92 and project a6aefbcc43964768b0cfcec5ea2f3611. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:04:24.388924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:04:24.406204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:04:24.687771 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-857cdaf0-6ea7-45b9-b86e-6ffcff3b0926 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.615173 Oct 11 20:04:24.701106 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2313/4694] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 20:04:24.718288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:24.728934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:24.778607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:24.782798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:24.783246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:24.784543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:24.785002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:24.785429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:26.288043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dc017bd4-3115-446b-ba80-40b13594ad2b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:26.309187 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc017bd4-3115-446b-ba80-40b13594ad2b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1690 microversion: 2.1 time: 2.653777 Oct 11 20:04:26.311460 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2382/4695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:23 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1690 bytes in 2659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:26.332695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f8dea0bc-268e-42e4-8d41-8c5d1db8880e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:26.333707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f8dea0bc-268e-42e4-8d41-8c5d1db8880e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:26.354270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8dea0bc-268e-42e4-8d41-8c5d1db8880e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:26.355091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8dea0bc-268e-42e4-8d41-8c5d1db8880e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:26.355721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8dea0bc-268e-42e4-8d41-8c5d1db8880e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:26.356627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8dea0bc-268e-42e4-8d41-8c5d1db8880e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:26.357243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8dea0bc-268e-42e4-8d41-8c5d1db8880e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:26.357827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f8dea0bc-268e-42e4-8d41-8c5d1db8880e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:26.846971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f8dea0bc-268e-42e4-8d41-8c5d1db8880e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:26.863485 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f8dea0bc-268e-42e4-8d41-8c5d1db8880e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1226 microversion: 2.1 time: 0.550232 Oct 11 20:04:26.865936 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2383/4696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:26 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1226 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:27.129884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:27.151668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:27.177062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:27.180014 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d10a7324-e763-46df-9846-55cdf74570b5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 2.477893 Oct 11 20:04:27.186242 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2314/4697] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:24 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 2485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:27.339309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce952770-4178-400c-a585-31b5023627b9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:27.339914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ce952770-4178-400c-a585-31b5023627b9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:27.358999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce952770-4178-400c-a585-31b5023627b9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:27.363926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce952770-4178-400c-a585-31b5023627b9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:27.364698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce952770-4178-400c-a585-31b5023627b9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:27.366162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce952770-4178-400c-a585-31b5023627b9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:27.370668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce952770-4178-400c-a585-31b5023627b9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:27.371354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce952770-4178-400c-a585-31b5023627b9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:27.891186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eda091b0-0974-4590-b1f3-585b14f539a5 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:27.892080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eda091b0-0974-4590-b1f3-585b14f539a5 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:27.911797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eda091b0-0974-4590-b1f3-585b14f539a5 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:27.914777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eda091b0-0974-4590-b1f3-585b14f539a5 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:27.915621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eda091b0-0974-4590-b1f3-585b14f539a5 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:27.938687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eda091b0-0974-4590-b1f3-585b14f539a5 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:27.941057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eda091b0-0974-4590-b1f3-585b14f539a5 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:27.942015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eda091b0-0974-4590-b1f3-585b14f539a5 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:28.331319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eda091b0-0974-4590-b1f3-585b14f539a5 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:28.347825 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eda091b0-0974-4590-b1f3-585b14f539a5 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1292 microversion: 2.1 time: 0.460542 Oct 11 20:04:28.362115 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2315/4698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:27 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1292 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:28.402180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:28.407608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:28.438864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:28.449354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:28.453371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:28.461628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:28.462129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:28.465076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:28.505464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ce952770-4178-400c-a585-31b5023627b9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:28.526747 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ce952770-4178-400c-a585-31b5023627b9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1690 microversion: 2.1 time: 1.186100 Oct 11 20:04:28.553823 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2384/4699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:27 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1690 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:29.385731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-25ad5798-4667-4aaf-9149-b67703fd7fbf tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:29.386443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-25ad5798-4667-4aaf-9149-b67703fd7fbf tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:29.400681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25ad5798-4667-4aaf-9149-b67703fd7fbf tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:29.401175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25ad5798-4667-4aaf-9149-b67703fd7fbf tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:29.405298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25ad5798-4667-4aaf-9149-b67703fd7fbf tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:29.409275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25ad5798-4667-4aaf-9149-b67703fd7fbf tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:29.409897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25ad5798-4667-4aaf-9149-b67703fd7fbf tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:29.412329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-25ad5798-4667-4aaf-9149-b67703fd7fbf tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:29.579495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:29.597006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-25ad5798-4667-4aaf-9149-b67703fd7fbf tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:29.606109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:29.607915 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-25ad5798-4667-4aaf-9149-b67703fd7fbf tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1280 microversion: 2.1 time: 0.226088 Oct 11 20:04:29.614012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:29.615364 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2385/4700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:29 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1280 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:04:29.620455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4665d762-5e30-49f6-b896-43f920b1f877 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:29.621946 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56d65957-7268-4ce7-92f4-833f7225a1ac tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.244455 Oct 11 20:04:29.625795 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2316/4701] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:28 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:29.629205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4665d762-5e30-49f6-b896-43f920b1f877 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:29.644484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4665d762-5e30-49f6-b896-43f920b1f877 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:29.645256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4665d762-5e30-49f6-b896-43f920b1f877 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:29.646884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4665d762-5e30-49f6-b896-43f920b1f877 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:29.649019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4665d762-5e30-49f6-b896-43f920b1f877 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:29.649681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4665d762-5e30-49f6-b896-43f920b1f877 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:29.649918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4665d762-5e30-49f6-b896-43f920b1f877 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:29.998760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4665d762-5e30-49f6-b896-43f920b1f877 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:30.021281 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4665d762-5e30-49f6-b896-43f920b1f877 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1622 microversion: 2.1 time: 0.392099 Oct 11 20:04:30.026722 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2386/4702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:29 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1622 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:30.644115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5e6bcded-2cbe-411f-aa34-61560f7ad39f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:30.644687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5e6bcded-2cbe-411f-aa34-61560f7ad39f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:30.653874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:30.655280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:30.667721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:30.686142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:30.686723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:30.688061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6bcded-2cbe-411f-aa34-61560f7ad39f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:30.698729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:30.699234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:30.699681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:30.702640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6bcded-2cbe-411f-aa34-61560f7ad39f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:30.703225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6bcded-2cbe-411f-aa34-61560f7ad39f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:30.703995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6bcded-2cbe-411f-aa34-61560f7ad39f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:30.704475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6bcded-2cbe-411f-aa34-61560f7ad39f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:30.704909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6bcded-2cbe-411f-aa34-61560f7ad39f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:31.223928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5e6bcded-2cbe-411f-aa34-61560f7ad39f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:31.241922 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5e6bcded-2cbe-411f-aa34-61560f7ad39f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1280 microversion: 2.1 time: 0.601855 Oct 11 20:04:31.254857 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2317/4703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:30 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1280 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:04:31.277153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f38df058-1d03-40f5-a4a2-2945d90a8cae req-0af30d9f-7653-401b-aa92-37e42f278b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d6cd57-1120-449b-ba44-2066fb17c6e8", "name": "network-vif-deleted", "tag": "a2241e88-c9e7-4296-bc6f-97e0146faa66"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:31.294898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f38df058-1d03-40f5-a4a2-2945d90a8cae req-0af30d9f-7653-401b-aa92-37e42f278b53 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:31.295706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f38df058-1d03-40f5-a4a2-2945d90a8cae req-0af30d9f-7653-401b-aa92-37e42f278b53 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:31.296471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f38df058-1d03-40f5-a4a2-2945d90a8cae req-0af30d9f-7653-401b-aa92-37e42f278b53 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:31.392605 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f38df058-1d03-40f5-a4a2-2945d90a8cae req-0af30d9f-7653-401b-aa92-37e42f278b53 service nova] Creating event network-vif-deleted:a2241e88-c9e7-4296-bc6f-97e0146faa66 for instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 on n-h1-860864-3 Oct 11 20:04:31.420599 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f38df058-1d03-40f5-a4a2-2945d90a8cae req-0af30d9f-7653-401b-aa92-37e42f278b53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162184 Oct 11 20:04:31.424559 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2318/4704] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:04:31.443950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:31.450553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:31.476419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:31.479590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:31.480111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:31.501325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:31.508404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:31.508936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:31.613981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:31.650663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:31.652498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:31.653944 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ab3af11a-5b59-4489-8116-9ed5530477f7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.004444 Oct 11 20:04:31.666947 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2387/4705] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:30 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:04:31.703401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:31.707965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:31.709245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:31.712225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lazy-loading 'fault' on Instance uuid 82d6cd57-1120-449b-ba44-2066fb17c6e8 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:04:31.959082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:31.972103 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b5d10bb-9cb4-401d-9144-bc8c35873b2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 200 len: 1356 microversion: 2.1 time: 0.546349 Oct 11 20:04:31.992224 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2319/4706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:31 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 1356 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:32.268719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62e501da-d467-4a5b-a478-c8e6423c16d8 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:32.269796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-62e501da-d467-4a5b-a478-c8e6423c16d8 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:32.303255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e501da-d467-4a5b-a478-c8e6423c16d8 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:32.303781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e501da-d467-4a5b-a478-c8e6423c16d8 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:32.304224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e501da-d467-4a5b-a478-c8e6423c16d8 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:32.319473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e501da-d467-4a5b-a478-c8e6423c16d8 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:32.320070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e501da-d467-4a5b-a478-c8e6423c16d8 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:32.320784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62e501da-d467-4a5b-a478-c8e6423c16d8 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:32.521034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-62e501da-d467-4a5b-a478-c8e6423c16d8 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:32.543925 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-62e501da-d467-4a5b-a478-c8e6423c16d8 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1280 microversion: 2.1 time: 0.276427 Oct 11 20:04:32.567709 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2388/4707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:32 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1280 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:32.684842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:32.685950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:32.715060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:32.723506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:32.723506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:32.724075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:32.724543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:32.724977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:33.007049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:33.008849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 82d6cd57-1120-449b-ba44-2066fb17c6e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:33.020557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:33.024474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:33.027499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:33.029705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:33.030366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:33.032228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:33.081926 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] HTTP exception thrown: Instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 could not be found. Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Request method failure captured: Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 HTTP/1.1 Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcuuQjfIszkyOtJSECoXLkoDQN-z4e4y6WzgPHiOSPLqH5SV-HvPoQdiMi_GwUDM2EltrUPWVnUG7Mw5CMaCpk0b-jW44fhL6WJJqofKREBBrNQ7WBjPWizW0ivaOVl1mT2-eDn57Y1mQoC_gVSHEDqQtnZgH9UL0JndxPnm8zhH4eU Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: abba65df7ef6403db3d5b466eb12fb94 Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abba65df7ef6403db3d5b466eb12fb94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abba65df7ef6403db3d5b466eb12fb94", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abba65df7ef6403db3d5b466eb12fb94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abba65df7ef6403db3d5b466eb12fb94"}]}] Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: abba65df7ef6403db3d5b466eb12fb94 Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestNetworkAdvancedServerOps-97175932-project Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: c3eaa8c79a0645fd93e6e3398426237f Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestNetworkAdvancedServerOps-97175932-project Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 could not be found. Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '82d6cd57-1120-449b-ba44-2066fb17c6e8'} Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 could not be found. Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 could not be found. Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:33.095925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:33.102553 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:33.102553 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:33.102553 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:33.102553 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:33.102553 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:33.102553 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:33.102553 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 could not be found. Oct 11 20:04:33.102553 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:33.109368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Returning 404 to user: Instance 82d6cd57-1120-449b-ba44-2066fb17c6e8 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:33.113574 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3ed6f7eb-056f-4b30-99bf-2e5ff53ca75b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8" status: 404 len: 111 microversion: 2.1 time: 0.111595 Oct 11 20:04:33.120547 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2389/4708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:33 2022] GET /compute/v2.1/servers/82d6cd57-1120-449b-ba44-2066fb17c6e8 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:33.572376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d1446678-2e5c-4228-8785-27ef01f2a62b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:33.573383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d1446678-2e5c-4228-8785-27ef01f2a62b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:33.589649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1446678-2e5c-4228-8785-27ef01f2a62b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:33.601082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1446678-2e5c-4228-8785-27ef01f2a62b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:33.602317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1446678-2e5c-4228-8785-27ef01f2a62b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:33.610786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1446678-2e5c-4228-8785-27ef01f2a62b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:33.613993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1446678-2e5c-4228-8785-27ef01f2a62b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:33.614625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d1446678-2e5c-4228-8785-27ef01f2a62b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:33.765396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:33.793119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:33.797408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:33.801276 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0b90bbf8-4934-4bf9-9dbb-b3477810dd7f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.120811 Oct 11 20:04:33.807017 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2320/4709] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:32 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:34.842589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:34.844353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:34.856349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:34.863580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:34.887428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:34.894782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:34.897229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:34.902461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:34.903570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:34.905928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:34.980057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d1446678-2e5c-4228-8785-27ef01f2a62b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:35.000012 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d1446678-2e5c-4228-8785-27ef01f2a62b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1322 microversion: 2.1 time: 1.423491 Oct 11 20:04:35.015214 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2390/4710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:33 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1322 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:35.674076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:35.686299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:35.688762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:35.699865 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2755a880-37fe-477d-8978-51399c91e1d9 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 0.863143 Oct 11 20:04:35.702266 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2321/4711] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:34 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:04:36.026219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bfaa6873-ed49-4561-81f8-3726010c9b87 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:36.026968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bfaa6873-ed49-4561-81f8-3726010c9b87 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:36.030024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:36.048049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaa6873-ed49-4561-81f8-3726010c9b87 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:36.050170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaa6873-ed49-4561-81f8-3726010c9b87 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:36.052740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaa6873-ed49-4561-81f8-3726010c9b87 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:36.057465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaa6873-ed49-4561-81f8-3726010c9b87 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:36.060006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaa6873-ed49-4561-81f8-3726010c9b87 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:36.061781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfaa6873-ed49-4561-81f8-3726010c9b87 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:36.730572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:36.732266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:36.757489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:36.766211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bfaa6873-ed49-4561-81f8-3726010c9b87 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:36.775536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:36.780731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:36.782764 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bfaa6873-ed49-4561-81f8-3726010c9b87 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1322 microversion: 2.1 time: 0.760822 Oct 11 20:04:36.787313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:36.805685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:36.806123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:36.812964 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2391/4712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:36 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1322 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:37.465238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:37.475480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:37.485765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:37.489884 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-64068b42-628d-4986-b9ba-28db6b791b4f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 0.764637 Oct 11 20:04:37.497728 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2322/4713] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:36 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:37.562687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fba53bcd-9dc5-474f-8390-ae24493bf89b req-6c92a883-a26a-4c8d-984b-2befa982e104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d695193d-d0dd-4755-bac2-0fd6ebdb890f", "tag": "8e26543d-feb2-4450-bba3-ead6dd1b0790"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:37.622638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fba53bcd-9dc5-474f-8390-ae24493bf89b req-6c92a883-a26a-4c8d-984b-2befa982e104 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:37.628042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fba53bcd-9dc5-474f-8390-ae24493bf89b req-6c92a883-a26a-4c8d-984b-2befa982e104 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:37.632157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fba53bcd-9dc5-474f-8390-ae24493bf89b req-6c92a883-a26a-4c8d-984b-2befa982e104 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:37.696749 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fba53bcd-9dc5-474f-8390-ae24493bf89b req-6c92a883-a26a-4c8d-984b-2befa982e104 service nova] Creating event network-changed:8e26543d-feb2-4450-bba3-ead6dd1b0790 for instance d695193d-d0dd-4755-bac2-0fd6ebdb890f on n-h2-860864-3 Oct 11 20:04:37.725419 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fba53bcd-9dc5-474f-8390-ae24493bf89b req-6c92a883-a26a-4c8d-984b-2befa982e104 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167760 Oct 11 20:04:37.734712 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2392/4714] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:04:37.819674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:37.820213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:37.854014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:37.856793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:37.859645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:37.863424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:37.863924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:37.870776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:38.521475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:38.522174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:38.556975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:38.558043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:38.559537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:38.563430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:38.568288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:38.572098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:39.604905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:39.618928 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1322 microversion: 2.1 time: 1.802905 Oct 11 20:04:39.621084 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2323/4715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:37 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1322 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:39.623317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:39.634214 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-867d2c63-a169-427a-b75f-6ecf6a3cc4ab tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004220 Oct 11 20:04:39.635177 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2324/4716] 10.222.0.27 () {56 vars in 886 bytes} [Tue Oct 11 20:04:39 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 20:04:40.239949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:40.273946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:40.283987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:40.285393 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0526350-2d60-4fb6-b824-c765cca1ea07 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.768794 Oct 11 20:04:40.310936 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2393/4717] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:38 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:40.647638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b474884a-f54f-41db-87d5-43d6aa640c1f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:40.648977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b474884a-f54f-41db-87d5-43d6aa640c1f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:40.666629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b474884a-f54f-41db-87d5-43d6aa640c1f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:40.668920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b474884a-f54f-41db-87d5-43d6aa640c1f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:40.669855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b474884a-f54f-41db-87d5-43d6aa640c1f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:40.676217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b474884a-f54f-41db-87d5-43d6aa640c1f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:40.684853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b474884a-f54f-41db-87d5-43d6aa640c1f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:40.696466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b474884a-f54f-41db-87d5-43d6aa640c1f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:41.255336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b474884a-f54f-41db-87d5-43d6aa640c1f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:41.264027 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b474884a-f54f-41db-87d5-43d6aa640c1f tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1322 microversion: 2.1 time: 0.622620 Oct 11 20:04:41.264604 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2325/4718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:40 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:41.322942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:41.324273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:41.339969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:41.342514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:41.349743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:41.350884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:41.354303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:41.357559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:42.290931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fb589271-b26e-4e4a-83b4-6b5a7fccc699 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:42.292471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fb589271-b26e-4e4a-83b4-6b5a7fccc699 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:42.301720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb589271-b26e-4e4a-83b4-6b5a7fccc699 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:42.313258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb589271-b26e-4e4a-83b4-6b5a7fccc699 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:42.316674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb589271-b26e-4e4a-83b4-6b5a7fccc699 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:42.317970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb589271-b26e-4e4a-83b4-6b5a7fccc699 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:42.322118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb589271-b26e-4e4a-83b4-6b5a7fccc699 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:42.325564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb589271-b26e-4e4a-83b4-6b5a7fccc699 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:42.435014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:42.448230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:42.463827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:42.465081 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-114c1e1c-eaf7-4ad5-953d-4307b4bf5fd3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.146344 Oct 11 20:04:42.465675 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2394/4719] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:41 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:43.492854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:43.493631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:43.511554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:43.531476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:43.539497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:43.552941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:43.554116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:43.557520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:43.616372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fb589271-b26e-4e4a-83b4-6b5a7fccc699 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:43.623651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:43.630324 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fb589271-b26e-4e4a-83b4-6b5a7fccc699 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1322 microversion: 2.1 time: 1.342445 Oct 11 20:04:43.637917 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2326/4720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:42 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1322 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:44.659572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aebeb808-c299-43f4-a03a-8f2a4005bf46 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:44.660280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aebeb808-c299-43f4-a03a-8f2a4005bf46 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:44.683475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aebeb808-c299-43f4-a03a-8f2a4005bf46 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:44.684000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aebeb808-c299-43f4-a03a-8f2a4005bf46 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:44.684441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aebeb808-c299-43f4-a03a-8f2a4005bf46 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:44.685149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aebeb808-c299-43f4-a03a-8f2a4005bf46 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:44.685604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aebeb808-c299-43f4-a03a-8f2a4005bf46 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:44.686030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aebeb808-c299-43f4-a03a-8f2a4005bf46 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:45.284799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:45.302632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:45.311526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:45.319205 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1af55505-3c0e-48a5-8d88-fc178b43e507 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.827820 Oct 11 20:04:45.323500 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2395/4721] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:43 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:04:45.608018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aebeb808-c299-43f4-a03a-8f2a4005bf46 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:45.617432 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aebeb808-c299-43f4-a03a-8f2a4005bf46 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1322 microversion: 2.1 time: 0.962535 Oct 11 20:04:45.618028 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2327/4722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:44 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1322 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:04:46.352388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:46.353627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:46.367567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:46.368334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:46.369068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:46.369973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:46.372391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:46.373028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:46.641826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-66d42f6c-acbc-4ea1-b4a8-d54b23cd40b4 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:46.644973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-66d42f6c-acbc-4ea1-b4a8-d54b23cd40b4 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:46.656198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66d42f6c-acbc-4ea1-b4a8-d54b23cd40b4 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:46.659500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66d42f6c-acbc-4ea1-b4a8-d54b23cd40b4 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:46.660230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66d42f6c-acbc-4ea1-b4a8-d54b23cd40b4 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:46.663083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66d42f6c-acbc-4ea1-b4a8-d54b23cd40b4 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:46.663867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66d42f6c-acbc-4ea1-b4a8-d54b23cd40b4 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:46.664546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66d42f6c-acbc-4ea1-b4a8-d54b23cd40b4 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:48.208085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:48.225969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:48.227456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:48.228659 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f3981c89-e2f4-4f7e-bfa6-9f081d8bbd75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.880203 Oct 11 20:04:48.242556 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2396/4723] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:46 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:48.266354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-66d42f6c-acbc-4ea1-b4a8-d54b23cd40b4 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:48.270852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fbc335e3-50f5-4e3a-8249-ddb9e5edda7f req-eaf9c49c-5ba3-4ca0-a740-5eb88890b259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d695193d-d0dd-4755-bac2-0fd6ebdb890f", "name": "network-vif-plugged", "status": "completed", "tag": "8e26543d-feb2-4450-bba3-ead6dd1b0790"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:48.275035 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-66d42f6c-acbc-4ea1-b4a8-d54b23cd40b4 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1322 microversion: 2.1 time: 1.637154 Oct 11 20:04:48.279541 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2328/4724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:46 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1322 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:48.296536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fbc335e3-50f5-4e3a-8249-ddb9e5edda7f req-eaf9c49c-5ba3-4ca0-a740-5eb88890b259 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:48.297022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fbc335e3-50f5-4e3a-8249-ddb9e5edda7f req-eaf9c49c-5ba3-4ca0-a740-5eb88890b259 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:48.297454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fbc335e3-50f5-4e3a-8249-ddb9e5edda7f req-eaf9c49c-5ba3-4ca0-a740-5eb88890b259 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:48.350037 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fbc335e3-50f5-4e3a-8249-ddb9e5edda7f req-eaf9c49c-5ba3-4ca0-a740-5eb88890b259 service nova] Creating event network-vif-plugged:8e26543d-feb2-4450-bba3-ead6dd1b0790 for instance d695193d-d0dd-4755-bac2-0fd6ebdb890f on n-h2-860864-3 Oct 11 20:04:48.373116 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fbc335e3-50f5-4e3a-8249-ddb9e5edda7f req-eaf9c49c-5ba3-4ca0-a740-5eb88890b259 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137475 Oct 11 20:04:48.373740 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2397/4725] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:04:49.260007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:49.261303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:49.285797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:49.288262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:49.289071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:49.294163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:49.294986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:49.301234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:49.310359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-41b8aa5f-9a0e-4a6f-bdf0-4b3d7d973bc1 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:49.311501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-41b8aa5f-9a0e-4a6f-bdf0-4b3d7d973bc1 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:49.342499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b8aa5f-9a0e-4a6f-bdf0-4b3d7d973bc1 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:49.343121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b8aa5f-9a0e-4a6f-bdf0-4b3d7d973bc1 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:49.343489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b8aa5f-9a0e-4a6f-bdf0-4b3d7d973bc1 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:49.344202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b8aa5f-9a0e-4a6f-bdf0-4b3d7d973bc1 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:49.344662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b8aa5f-9a0e-4a6f-bdf0-4b3d7d973bc1 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:49.345212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41b8aa5f-9a0e-4a6f-bdf0-4b3d7d973bc1 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:50.107408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-41b8aa5f-9a0e-4a6f-bdf0-4b3d7d973bc1 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:50.121673 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-41b8aa5f-9a0e-4a6f-bdf0-4b3d7d973bc1 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1322 microversion: 2.1 time: 0.819755 Oct 11 20:04:50.122876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2398/4726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:49 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1322 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:50.968685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:50.988618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:50.997809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:51.009050 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e70accc-c785-4347-8dd2-595f216cabce tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.745185 Oct 11 20:04:51.014430 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2329/4727] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:49 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:51.149557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c145577-572b-4e31-9356-2d40564b670b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:51.150198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c145577-572b-4e31-9356-2d40564b670b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:51.179168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c145577-572b-4e31-9356-2d40564b670b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:51.179712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c145577-572b-4e31-9356-2d40564b670b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:51.185812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c145577-572b-4e31-9356-2d40564b670b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:51.187749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c145577-572b-4e31-9356-2d40564b670b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:51.188317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c145577-572b-4e31-9356-2d40564b670b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:51.191834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c145577-572b-4e31-9356-2d40564b670b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:51.264908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:52.046891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:52.047692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:52.059423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:52.065141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:52.069079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:52.070448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:52.071209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:52.071896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:52.408647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c145577-572b-4e31-9356-2d40564b670b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:52.436094 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c145577-572b-4e31-9356-2d40564b670b tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1518 microversion: 2.1 time: 1.288384 Oct 11 20:04:52.437105 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2399/4728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:51 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1518 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:52.749758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2956410e-3504-4ea9-a3ee-5fe224fffdd9 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-713182241", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2956410e-3504-4ea9-a3ee-5fe224fffdd9 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Request method failure captured: Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 242 Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcxDgfope3Ev-sI28qmLs1rLXmxjqySLtYLmI-LXMXUYJmPLBSLeTFORtHGslI_np93CSab-QWZzj1RW9z_sYZu5FgoE7pKSeAAfY5sbsyxMT2dDMRsQbrM5x_JMspWT3sfCtg1Cq2_dwbWDpbzgsvq16PKWWBEhkjyASCNAGgrdHWg Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6aefbcc43964768b0cfcec5ea2f3611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}] Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 721c9cd3d7dc4132af77999c14cdca92 Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-713182241", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-713182241', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '4362c5de-7a61-4899-8592-aa9019178da7'}]}}} Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise error Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:52.758188 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2956410e-3504-4ea9-a3ee-5fe224fffdd9 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2956410e-3504-4ea9-a3ee-5fe224fffdd9 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.018623 Oct 11 20:04:52.762515 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2400/4729] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:04:52 2022] POST /compute/v2.1/servers => generated 175 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:04:52.773277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-876febf6-13b3-4eb6-996c-7dade9d74618 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:52.773780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-876febf6-13b3-4eb6-996c-7dade9d74618 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: 890fcd2e-a2de-418e-a73a-683b7691b8cd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:52.824382 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-876febf6-13b3-4eb6-996c-7dade9d74618 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] HTTP exception thrown: Instance 890fcd2e-a2de-418e-a73a-683b7691b8cd could not be found. Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-876febf6-13b3-4eb6-996c-7dade9d74618 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Request method failure captured: Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/890fcd2e-a2de-418e-a73a-683b7691b8cd/metadata HTTP/1.1 Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcxDgfope3Ev-sI28qmLs1rLXmxjqySLtYLmI-LXMXUYJmPLBSLeTFORtHGslI_np93CSab-QWZzj1RW9z_sYZu5FgoE7pKSeAAfY5sbsyxMT2dDMRsQbrM5x_JMspWT3sfCtg1Cq2_dwbWDpbzgsvq16PKWWBEhkjyASCNAGgrdHWg Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6aefbcc43964768b0cfcec5ea2f3611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}] Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 721c9cd3d7dc4132af77999c14cdca92 Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 890fcd2e-a2de-418e-a73a-683b7691b8cd could not be found. Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': '890fcd2e-a2de-418e-a73a-683b7691b8cd'} Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890fcd2e-a2de-418e-a73a-683b7691b8cd could not be found. Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890fcd2e-a2de-418e-a73a-683b7691b8cd could not be found. Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:52.876178 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:52.880280 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:52.880280 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:52.880280 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890fcd2e-a2de-418e-a73a-683b7691b8cd could not be found. Oct 11 20:04:52.880280 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:04:52.880280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-876febf6-13b3-4eb6-996c-7dade9d74618 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Returning 404 to user: Instance 890fcd2e-a2de-418e-a73a-683b7691b8cd could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:52.880280 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-876febf6-13b3-4eb6-996c-7dade9d74618 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/890fcd2e-a2de-418e-a73a-683b7691b8cd/metadata" status: 404 len: 111 microversion: 2.1 time: 0.108428 Oct 11 20:04:52.883633 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2401/4730] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 20:04:52 2022] GET /compute/v2.1/servers/890fcd2e-a2de-418e-a73a-683b7691b8cd/metadata => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:53.269823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:53.308304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:53.311700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:53.313662 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-df91b6ac-fad8-43d1-ab1c-27e1492356a7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.270670 Oct 11 20:04:53.328665 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2330/4731] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:52 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:04:53.378794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bed1aafc-a526-42a3-b988-b416d9fc956e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-943216230", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bed1aafc-a526-42a3-b988-b416d9fc956e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Request method failure captured: Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 498 Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxDgfope3Ev-sI28qmLs1rLXmxjqySLtYLmI-LXMXUYJmPLBSLeTFORtHGslI_np93CSab-QWZzj1RW9z_sYZu5FgoE7pKSeAAfY5sbsyxMT2dDMRsQbrM5x_JMspWT3sfCtg1Cq2_dwbWDpbzgsvq16PKWWBEhkjyASCNAGgrdHWg Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6aefbcc43964768b0cfcec5ea2f3611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}] Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 721c9cd3d7dc4132af77999c14cdca92 Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-943216230", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-943216230', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4362c5de-7a61-4899-8592-aa9019178da7'}]}}} Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 20:04:53.385109 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.388588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bed1aafc-a526-42a3-b988-b416d9fc956e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:53.399367 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bed1aafc-a526-42a3-b988-b416d9fc956e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.024747 Oct 11 20:04:53.412655 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2331/4732] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:04:53 2022] POST /compute/v2.1/servers => generated 687 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 20:04:53.664887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-279600fa-b101-400a-8f15-29f0276bf6d0 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2029694308", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-279600fa-b101-400a-8f15-29f0276bf6d0 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Request method failure captured: Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 500 Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxDgfope3Ev-sI28qmLs1rLXmxjqySLtYLmI-LXMXUYJmPLBSLeTFORtHGslI_np93CSab-QWZzj1RW9z_sYZu5FgoE7pKSeAAfY5sbsyxMT2dDMRsQbrM5x_JMspWT3sfCtg1Cq2_dwbWDpbzgsvq16PKWWBEhkjyASCNAGgrdHWg Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6aefbcc43964768b0cfcec5ea2f3611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}] Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 721c9cd3d7dc4132af77999c14cdca92 Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2029694308", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2029694308', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4362c5de-7a61-4899-8592-aa9019178da7'}]}}} Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 20:04:53.670313 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.674357 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.691531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-747294616", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "58880487-e5b4-4102-a8bd-e186e53d2cd6"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:53.700421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-279600fa-b101-400a-8f15-29f0276bf6d0 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:53.706517 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-279600fa-b101-400a-8f15-29f0276bf6d0 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.045584 Oct 11 20:04:53.710900 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2332/4733] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:04:53 2022] POST /compute/v2.1/servers => generated 689 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:04:53.798339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a2f776a-5930-417a-a2b7-5315e801e2bc tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1916222577", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a2f776a-5930-417a-a2b7-5315e801e2bc tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Request method failure captured: Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 754 Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxDgfope3Ev-sI28qmLs1rLXmxjqySLtYLmI-LXMXUYJmPLBSLeTFORtHGslI_np93CSab-QWZzj1RW9z_sYZu5FgoE7pKSeAAfY5sbsyxMT2dDMRsQbrM5x_JMspWT3sfCtg1Cq2_dwbWDpbzgsvq16PKWWBEhkjyASCNAGgrdHWg Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6aefbcc43964768b0cfcec5ea2f3611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}] Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 721c9cd3d7dc4132af77999c14cdca92 Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1916222577", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1916222577', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4362c5de-7a61-4899-8592-aa9019178da7'}]}}} Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 20:04:53.802828 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 20:04:53.814474 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 20:04:53.816888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.816888 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.816888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a2f776a-5930-417a-a2b7-5315e801e2bc tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:53.816888 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a2f776a-5930-417a-a2b7-5315e801e2bc tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010036 Oct 11 20:04:53.816888 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2333/4734] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:04:53 2022] POST /compute/v2.1/servers => generated 1197 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 11 20:04:53.939849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e11557b8-5fe7-499f-b9d8-87703a202759 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-23043728", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e11557b8-5fe7-499f-b9d8-87703a202759 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Request method failure captured: Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 1264 Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxDgfope3Ev-sI28qmLs1rLXmxjqySLtYLmI-LXMXUYJmPLBSLeTFORtHGslI_np93CSab-QWZzj1RW9z_sYZu5FgoE7pKSeAAfY5sbsyxMT2dDMRsQbrM5x_JMspWT3sfCtg1Cq2_dwbWDpbzgsvq16PKWWBEhkjyASCNAGgrdHWg Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6aefbcc43964768b0cfcec5ea2f3611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}] Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 721c9cd3d7dc4132af77999c14cdca92 Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-23043728", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4362c5de-7a61-4899-8592-aa9019178da7"}]}} Oct 11 20:04:53.960825 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-23043728', 'imageRef': 'd10025cd-51f6-4b3b-a33d-5e8072e792b3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4362c5de-7a61-4899-8592-aa9019178da7'}]}}} Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.963234 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 20:04:53.964559 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 20:04:53.966757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 20:04:53.966757 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:53.971994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e11557b8-5fe7-499f-b9d8-87703a202759 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:53.978162 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e11557b8-5fe7-499f-b9d8-87703a202759 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.040289 Oct 11 20:04:53.982404 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2334/4735] 10.222.0.27 () {60 vars in 1148 bytes} [Tue Oct 11 20:04:53 2022] POST /compute/v2.1/servers => generated 2221 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 11 20:04:54.002972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6078db77-e418-42de-aedc-18360f756d75 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:54.003511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6078db77-e418-42de-aedc-18360f756d75 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: 5fb4349b-1eb7-4ab5-b3b4-084afae1ada0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:54.040012 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6078db77-e418-42de-aedc-18360f756d75 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] HTTP exception thrown: Instance 5fb4349b-1eb7-4ab5-b3b4-084afae1ada0 could not be found. Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6078db77-e418-42de-aedc-18360f756d75 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Request method failure captured: Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/5fb4349b-1eb7-4ab5-b3b4-084afae1ada0/metadata/test2 HTTP/1.1 Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxDgfope3Ev-sI28qmLs1rLXmxjqySLtYLmI-LXMXUYJmPLBSLeTFORtHGslI_np93CSab-QWZzj1RW9z_sYZu5FgoE7pKSeAAfY5sbsyxMT2dDMRsQbrM5x_JMspWT3sfCtg1Cq2_dwbWDpbzgsvq16PKWWBEhkjyASCNAGgrdHWg Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6aefbcc43964768b0cfcec5ea2f3611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}] Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 721c9cd3d7dc4132af77999c14cdca92 Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 5fb4349b-1eb7-4ab5-b3b4-084afae1ada0 could not be found. Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'server_id': '5fb4349b-1eb7-4ab5-b3b4-084afae1ada0', 'id': 'test2'} Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb4349b-1eb7-4ab5-b3b4-084afae1ada0 could not be found. Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb4349b-1eb7-4ab5-b3b4-084afae1ada0 could not be found. Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:04:54.041825 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:04:54.046898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:04:54.046898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:04:54.046898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb4349b-1eb7-4ab5-b3b4-084afae1ada0 could not be found. Oct 11 20:04:54.046898 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:04:54.046898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6078db77-e418-42de-aedc-18360f756d75 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Returning 404 to user: Instance 5fb4349b-1eb7-4ab5-b3b4-084afae1ada0 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:04:54.057998 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6078db77-e418-42de-aedc-18360f756d75 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/5fb4349b-1eb7-4ab5-b3b4-084afae1ada0/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.070712 Oct 11 20:04:54.059161 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2335/4736] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 11 20:04:53 2022] GET /compute/v2.1/servers/5fb4349b-1eb7-4ab5-b3b4-084afae1ada0/metadata/test2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:04:54.100226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-79a42c8a-ed0c-4d91-b457-6b96eed1fd9e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:54.103035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-79a42c8a-ed0c-4d91-b457-6b96eed1fd9e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:54.143275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79a42c8a-ed0c-4d91-b457-6b96eed1fd9e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:54.144376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79a42c8a-ed0c-4d91-b457-6b96eed1fd9e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:54.145519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79a42c8a-ed0c-4d91-b457-6b96eed1fd9e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:54.146799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79a42c8a-ed0c-4d91-b457-6b96eed1fd9e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:54.149088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79a42c8a-ed0c-4d91-b457-6b96eed1fd9e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:54.150408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79a42c8a-ed0c-4d91-b457-6b96eed1fd9e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:54.263074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-79a42c8a-ed0c-4d91-b457-6b96eed1fd9e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:04:54.564752 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-79a42c8a-ed0c-4d91-b457-6b96eed1fd9e tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 204 len: 0 microversion: 2.1 time: 0.477202 Oct 11 20:04:54.572792 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2336/4737] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:04:54 2022] DELETE /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:04:54.582395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:54.586473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:54.604341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:54.606068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:54.606548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:54.607298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:54.607761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:54.608503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:54.946414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:54.971087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:54.977755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:54.983041 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3c7f5b37-8bf4-402f-969f-16fc8879c0ec tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 0.409622 Oct 11 20:04:54.999954 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2337/4738] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:54 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:55.014355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bdd1991f-9712-491d-899c-ba0b5ee5d069 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '.version_select at 0x7f83c7181af0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:55.033029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:04:55.055174 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bdd1991f-9712-491d-899c-ba0b5ee5d069 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-541413794" status: 202 len: 0 microversion: 2.1 time: 0.053526 Oct 11 20:04:55.058868 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2338/4739] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 11 20:04:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-541413794 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:04:55.075066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-36ac5715-3e4a-4d86-9331-d14c9617d7ca tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:55.082726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-36ac5715-3e4a-4d86-9331-d14c9617d7ca tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:55.116933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36ac5715-3e4a-4d86-9331-d14c9617d7ca tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:55.118098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36ac5715-3e4a-4d86-9331-d14c9617d7ca tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:55.118991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36ac5715-3e4a-4d86-9331-d14c9617d7ca tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:55.122292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36ac5715-3e4a-4d86-9331-d14c9617d7ca tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:55.123803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36ac5715-3e4a-4d86-9331-d14c9617d7ca tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:55.124622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36ac5715-3e4a-4d86-9331-d14c9617d7ca tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:55.346772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-36ac5715-3e4a-4d86-9331-d14c9617d7ca tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:55.372506 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-36ac5715-3e4a-4d86-9331-d14c9617d7ca tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1524 microversion: 2.1 time: 0.302967 Oct 11 20:04:55.373898 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2339/4740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:55 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1524 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:55.390567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d869fdab-3cf3-4ed8-85e1-a2c5d657873c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'create', calling method: .version_select at 0x7f83c71733a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-51365918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6NuYd9R6+08D05yJdd7qbXhMMvvE8uNXKJZmABF0KkDaS9ScfvzZ94vYjOloc6WybfuNMEsQ6ph/Aq3YNA47hAekg9LBF1UGdU7u1s/OnPS1A0AbiDT51MrbFNhbIOTA=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:04:55.426567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d869fdab-3cf3-4ed8-85e1-a2c5d657873c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for project abba65df7ef6403db3d5b466eb12fb94. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:04:55.437055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-d869fdab-3cf3-4ed8-85e1-a2c5d657873c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for user c3eaa8c79a0645fd93e6e3398426237f and project abba65df7ef6403db3d5b466eb12fb94. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:04:55.528398 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d869fdab-3cf3-4ed8-85e1-a2c5d657873c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.152819 Oct 11 20:04:55.530134 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2340/4741] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:04:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:04:55.867844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] validate_networks() for [('58880487-e5b4-4102-a8bd-e186e53d2cd6', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:04:56.016805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:56.022040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:56.039845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:56.043460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:56.046322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:56.047809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:56.048942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:56.068339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:57.478252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:57.502614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:57.507651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:57.509497 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b6a5e2b8-1cb4-4356-a723-6d1542630882 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1737 microversion: 2.20 time: 1.498325 Oct 11 20:04:57.530987 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2341/4742] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:56 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1737 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:04:57.565079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-81187560-8b9b-4745-b406-7c97549adb5c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:57.570452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-81187560-8b9b-4745-b406-7c97549adb5c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:57.604871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81187560-8b9b-4745-b406-7c97549adb5c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:57.605747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81187560-8b9b-4745-b406-7c97549adb5c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:57.606617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81187560-8b9b-4745-b406-7c97549adb5c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:57.609763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81187560-8b9b-4745-b406-7c97549adb5c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:57.611532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81187560-8b9b-4745-b406-7c97549adb5c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:57.612339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81187560-8b9b-4745-b406-7c97549adb5c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:59.394419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-81187560-8b9b-4745-b406-7c97549adb5c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:04:59.408780 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-81187560-8b9b-4745-b406-7c97549adb5c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1524 microversion: 2.1 time: 1.874933 Oct 11 20:04:59.414151 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2342/4743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:04:57 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1524 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:04:59.432872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:04:59.435443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:04:59.448570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:59.456131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:59.460037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:59.463676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:59.466190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:59.468304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:59.585227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:04:59.585762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:04:59.586175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:04:59.586611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:04:59.587183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:04:59.624730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:59.625255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:59.628538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:59.630281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:04:59.630982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:04:59.633622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:04:59.692970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Getting quotas for project 89cd0f7a012141948a916d7d3c2b6fe3. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:04:59.728263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Getting quotas for user 29170f9d0a1c4c69b3caeb2d72c1d095 and project 89cd0f7a012141948a916d7d3c2b6fe3. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:04:59.778920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:04:59.795078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:04:59.989794 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff0f041a-b478-4522-80b1-c958f9891b16 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.620603 Oct 11 20:04:59.990790 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2402/4744] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 6622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:05:00.215009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:00.250165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:00.255504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:00.259794 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4ab1d688-ef7d-42ff-adf1-13939a5de519 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1719 microversion: 2.20 time: 0.843707 Oct 11 20:05:00.310850 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2343/4745] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:04:59 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1719 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:00.323749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ba2f6ace-136a-4031-baf2-7d9c66c91173 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:00.325743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ba2f6ace-136a-4031-baf2-7d9c66c91173 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:00.506887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9d207b85-0c79-4462-9b79-84e4a321dee0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: .version_select at 0x7f83d07d6b80>, body: {"keypair": {"name": "tempest-keypair-568769103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA4OjL41x7kRqp4DLeBPSiwFEDHl2Dy5kNaIpYqDIkkjtsveQqqopp8ZEkRWB3xRAOsYSp7SbCrc4Hd7Jr0yJh2/OBafQxhpSLfT8dvitQejdqUVu37agPO1WYWql4VSA=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:00.537058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ba2f6ace-136a-4031-baf2-7d9c66c91173 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:00.548791 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ba2f6ace-136a-4031-baf2-7d9c66c91173 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1216 microversion: 2.1 time: 0.235795 Oct 11 20:05:00.554404 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2344/4746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:00 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1216 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:00.572208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-607931c0-8c8d-4377-954f-fd0d4f3c512a req-75a35f21-a848-4ade-8b11-2554dde524bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d695193d-d0dd-4755-bac2-0fd6ebdb890f", "name": "network-vif-deleted", "tag": "8e26543d-feb2-4450-bba3-ead6dd1b0790"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:00.575782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9d207b85-0c79-4462-9b79-84e4a321dee0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:05:00.596562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-9d207b85-0c79-4462-9b79-84e4a321dee0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for user f4202e77bb27447ba5363091634d9731 and project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:05:00.619114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-607931c0-8c8d-4377-954f-fd0d4f3c512a req-75a35f21-a848-4ade-8b11-2554dde524bf service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:00.619641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-607931c0-8c8d-4377-954f-fd0d4f3c512a req-75a35f21-a848-4ade-8b11-2554dde524bf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:00.620067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-607931c0-8c8d-4377-954f-fd0d4f3c512a req-75a35f21-a848-4ade-8b11-2554dde524bf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:00.694497 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-607931c0-8c8d-4377-954f-fd0d4f3c512a req-75a35f21-a848-4ade-8b11-2554dde524bf service nova] Creating event network-vif-deleted:8e26543d-feb2-4450-bba3-ead6dd1b0790 for instance d695193d-d0dd-4755-bac2-0fd6ebdb890f on n-h2-860864-3 Oct 11 20:05:00.711921 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-607931c0-8c8d-4377-954f-fd0d4f3c512a req-75a35f21-a848-4ade-8b11-2554dde524bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155715 Oct 11 20:05:00.712639 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2345/4747] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:00.728165 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9d207b85-0c79-4462-9b79-84e4a321dee0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.736154 Oct 11 20:05:00.731636 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2403/4748] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:04:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:00.753805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:00.756710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:00.776946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:00.778063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:00.779077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:00.780356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:00.780942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:00.781529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:00.911095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:00.911589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:00.912952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:00.913435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lazy-loading 'fault' on Instance uuid d695193d-d0dd-4755-bac2-0fd6ebdb890f {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:05:01.160417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721c9cd3d7dc4132af77999c14cdca92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aefbcc43964768b0cfcec5ea2f3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:01.199676 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-de2bda32-44fe-40e6-9e18-bad1d4b8920c tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 200 len: 1312 microversion: 2.1 time: 0.466019 Oct 11 20:05:01.208774 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2346/4749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:00 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 1312 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:01.292494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:01.293324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:01.305059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:01.307904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:01.308652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:01.309624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:01.310727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:01.312928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:01.580753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d40e778a-d720-4a2d-91c6-a4a4ea1133a8 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:01.581611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d40e778a-d720-4a2d-91c6-a4a4ea1133a8 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:01.600332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40e778a-d720-4a2d-91c6-a4a4ea1133a8 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:01.606908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40e778a-d720-4a2d-91c6-a4a4ea1133a8 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:01.614141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40e778a-d720-4a2d-91c6-a4a4ea1133a8 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:01.617932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40e778a-d720-4a2d-91c6-a4a4ea1133a8 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:01.622054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40e778a-d720-4a2d-91c6-a4a4ea1133a8 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:01.623862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d40e778a-d720-4a2d-91c6-a4a4ea1133a8 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:01.883361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d40e778a-d720-4a2d-91c6-a4a4ea1133a8 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:01.916698 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d40e778a-d720-4a2d-91c6-a4a4ea1133a8 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1212 microversion: 2.1 time: 0.344402 Oct 11 20:05:01.924460 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2347/4750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:01 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1212 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:01.940333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:01.964490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:01.967310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:01.971938 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aeaf8861-d632-4a48-9023-716b2dccba6c tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1722 microversion: 2.20 time: 0.683582 Oct 11 20:05:01.978989 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2404/4751] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:01 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1722 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:02.006113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-59d29091-0f87-4a17-9da2-8a82de0e5982 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86ad9c80-47ff-4975-babb-ce918f6da95b"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:02.011746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-59d29091-0f87-4a17-9da2-8a82de0e5982 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:02.038444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59d29091-0f87-4a17-9da2-8a82de0e5982 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:02.038983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59d29091-0f87-4a17-9da2-8a82de0e5982 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:02.039433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59d29091-0f87-4a17-9da2-8a82de0e5982 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:02.040186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59d29091-0f87-4a17-9da2-8a82de0e5982 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:02.040684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59d29091-0f87-4a17-9da2-8a82de0e5982 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:02.041134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-59d29091-0f87-4a17-9da2-8a82de0e5982 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:02.101134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a1049bc0-f7a2-4637-9355-4c18b9fea8cf req-a3536af5-af10-44d7-ad7a-b4fdb6a3182d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a125d45-79ec-4fda-9601-334c311a9f7a", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e15471-dfd8-4f5d-be37-fdddaa52dfc8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:02.154751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a1049bc0-f7a2-4637-9355-4c18b9fea8cf req-a3536af5-af10-44d7-ad7a-b4fdb6a3182d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:02.156796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a1049bc0-f7a2-4637-9355-4c18b9fea8cf req-a3536af5-af10-44d7-ad7a-b4fdb6a3182d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:02.163139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a1049bc0-f7a2-4637-9355-4c18b9fea8cf req-a3536af5-af10-44d7-ad7a-b4fdb6a3182d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:02.193992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.compute.server_external_events [req-a1049bc0-f7a2-4637-9355-4c18b9fea8cf req-a3536af5-af10-44d7-ad7a-b4fdb6a3182d service nova] Unable to find a host for instance 7a125d45-79ec-4fda-9601-334c311a9f7a. Dropping event network-vif-unplugged {{(pid=126956) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 20:05:02.195476 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a1049bc0-f7a2-4637-9355-4c18b9fea8cf req-a3536af5-af10-44d7-ad7a-b4fdb6a3182d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.099032 Oct 11 20:05:02.200132 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2405/4752] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 106 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 11 20:05:02.231458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:02.232229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] [instance: d695193d-d0dd-4755-bac2-0fd6ebdb890f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:02.242589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:02.245231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:02.245776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:02.246727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:02.247881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:02.259208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:02.279513 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] HTTP exception thrown: Instance d695193d-d0dd-4755-bac2-0fd6ebdb890f could not be found. Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Request method failure captured: Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f HTTP/1.1 Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcxDgfope3Ev-sI28qmLs1rLXmxjqySLtYLmI-LXMXUYJmPLBSLeTFORtHGslI_np93CSab-QWZzj1RW9z_sYZu5FgoE7pKSeAAfY5sbsyxMT2dDMRsQbrM5x_JMspWT3sfCtg1Cq2_dwbWDpbzgsvq16PKWWBEhkjyASCNAGgrdHWg Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6aefbcc43964768b0cfcec5ea2f3611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6aefbcc43964768b0cfcec5ea2f3611"}]}] Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: a6aefbcc43964768b0cfcec5ea2f3611 Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1376509472 Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 721c9cd3d7dc4132af77999c14cdca92 Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1376509472-project Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance d695193d-d0dd-4755-bac2-0fd6ebdb890f could not be found. Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'd695193d-d0dd-4755-bac2-0fd6ebdb890f'} Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d695193d-d0dd-4755-bac2-0fd6ebdb890f could not be found. Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d695193d-d0dd-4755-bac2-0fd6ebdb890f could not be found. Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:05:02.281414 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:05:02.286155 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:05:02.286155 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:05:02.286155 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:05:02.286155 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:05:02.286155 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:05:02.286155 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:05:02.286155 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d695193d-d0dd-4755-bac2-0fd6ebdb890f could not be found. Oct 11 20:05:02.286155 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:05:02.287742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] Returning 404 to user: Instance d695193d-d0dd-4755-bac2-0fd6ebdb890f could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:05:02.288803 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb651d07-85f5-4ae2-ac6d-8a15ef4c5090 tempest-ServerMetadataNegativeTestJSON-1376509472 tempest-ServerMetadataNegativeTestJSON-1376509472-project] 10.222.0.27 "GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f" status: 404 len: 111 microversion: 2.1 time: 0.061452 Oct 11 20:05:02.293138 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2406/4753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:02 2022] GET /compute/v2.1/servers/d695193d-d0dd-4755-bac2-0fd6ebdb890f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:05:02.765423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:02.946848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3178c734-e5b8-4c30-9a15-20c9b82f388b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:02.948133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3178c734-e5b8-4c30-9a15-20c9b82f388b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:02.976205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3178c734-e5b8-4c30-9a15-20c9b82f388b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:02.977881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3178c734-e5b8-4c30-9a15-20c9b82f388b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:02.978604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3178c734-e5b8-4c30-9a15-20c9b82f388b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:02.979480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3178c734-e5b8-4c30-9a15-20c9b82f388b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:02.980094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3178c734-e5b8-4c30-9a15-20c9b82f388b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:02.980858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3178c734-e5b8-4c30-9a15-20c9b82f388b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:02.986464 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-59d29091-0f87-4a17-9da2-8a82de0e5982 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "POST /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.986835 Oct 11 20:05:02.987702 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2348/4754] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Oct 11 20:05:01 2022] POST /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/os-volume_attachments => generated 188 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:05:03.212904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-baf86666-2df7-4835-ae01-714ede049edb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:03.213400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-baf86666-2df7-4835-ae01-714ede049edb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:03.230234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-baf86666-2df7-4835-ae01-714ede049edb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:03.230822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-baf86666-2df7-4835-ae01-714ede049edb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:03.231276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-baf86666-2df7-4835-ae01-714ede049edb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:03.231970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-baf86666-2df7-4835-ae01-714ede049edb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:03.232424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-baf86666-2df7-4835-ae01-714ede049edb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:03.232842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-baf86666-2df7-4835-ae01-714ede049edb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:03.289482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3178c734-e5b8-4c30-9a15-20c9b82f388b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:03.301413 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3178c734-e5b8-4c30-9a15-20c9b82f388b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1274 microversion: 2.1 time: 0.356431 Oct 11 20:05:03.303220 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2407/4755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:02 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1274 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:05:03.793260 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-baf86666-2df7-4835-ae01-714ede049edb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/os-volume_attachments/86ad9c80-47ff-4975-babb-ce918f6da95b" status: 202 len: 0 microversion: 2.20 time: 0.584185 Oct 11 20:05:03.797925 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2349/4756] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Oct 11 20:05:03 2022] DELETE /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/os-volume_attachments/86ad9c80-47ff-4975-babb-ce918f6da95b => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:05:03.918792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f2d10861-ce36-4d2c-901c-7f3927ecdb8a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:03.919487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f2d10861-ce36-4d2c-901c-7f3927ecdb8a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:03.934619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2d10861-ce36-4d2c-901c-7f3927ecdb8a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:03.938982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2d10861-ce36-4d2c-901c-7f3927ecdb8a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:03.943016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2d10861-ce36-4d2c-901c-7f3927ecdb8a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:03.946513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2d10861-ce36-4d2c-901c-7f3927ecdb8a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:03.950220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2d10861-ce36-4d2c-901c-7f3927ecdb8a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:03.950902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2d10861-ce36-4d2c-901c-7f3927ecdb8a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:04.059185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f2d10861-ce36-4d2c-901c-7f3927ecdb8a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126956) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 20:05:04.240216 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f2d10861-ce36-4d2c-901c-7f3927ecdb8a tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "POST /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/action" status: 202 len: 0 microversion: 2.20 time: 0.320925 Oct 11 20:05:04.241266 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2408/4757] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 20:05:03 2022] POST /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:05:04.251135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:04.253955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:04.264830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:04.266389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:04.270997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:04.273643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:04.275011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:04.276305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:04.329224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6a42181-593c-4fdf-82fd-35e71fa89f4d tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:04.332355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6a42181-593c-4fdf-82fd-35e71fa89f4d tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:04.357923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6a42181-593c-4fdf-82fd-35e71fa89f4d tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:04.363259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6a42181-593c-4fdf-82fd-35e71fa89f4d tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:04.369384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6a42181-593c-4fdf-82fd-35e71fa89f4d tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:04.371849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6a42181-593c-4fdf-82fd-35e71fa89f4d tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:04.376560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6a42181-593c-4fdf-82fd-35e71fa89f4d tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:04.378339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6a42181-593c-4fdf-82fd-35e71fa89f4d tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:05.575288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:05.591884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:05.596819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:05.600052 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e565c857-7cbe-49a4-969f-60fb6ca489cc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1670 microversion: 2.20 time: 1.352913 Oct 11 20:05:05.601438 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2350/4758] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:04 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1670 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:05.751135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6a42181-593c-4fdf-82fd-35e71fa89f4d tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:05.761034 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6a42181-593c-4fdf-82fd-35e71fa89f4d tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1316 microversion: 2.1 time: 1.436136 Oct 11 20:05:05.764954 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2409/4759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:04 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1316 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:06.630822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:06.631589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:06.657469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:06.658652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:06.659341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:06.660335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:06.664302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:06.666221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:06.789894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c16a866-3710-490d-bbc2-c5070dd13535 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:06.790625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4c16a866-3710-490d-bbc2-c5070dd13535 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:06.811528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:06.822622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c16a866-3710-490d-bbc2-c5070dd13535 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:06.825710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c16a866-3710-490d-bbc2-c5070dd13535 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:06.828204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c16a866-3710-490d-bbc2-c5070dd13535 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:06.836433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c16a866-3710-490d-bbc2-c5070dd13535 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:06.842871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c16a866-3710-490d-bbc2-c5070dd13535 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:06.843482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c16a866-3710-490d-bbc2-c5070dd13535 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:07.897108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:07.918574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:07.922091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:07.924066 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0464ce58-31f5-4760-b89c-097e5725ce9d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1672 microversion: 2.20 time: 1.297572 Oct 11 20:05:07.924648 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2351/4760] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:06 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1672 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:05:08.412507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4c16a866-3710-490d-bbc2-c5070dd13535 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:08.427428 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4c16a866-3710-490d-bbc2-c5070dd13535 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1316 microversion: 2.1 time: 1.635970 Oct 11 20:05:08.428631 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2410/4761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:06 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1316 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:05:08.968748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:08.970809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:08.987696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:08.989308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:08.990955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:08.992366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:08.995130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:08.997877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:09.275333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-82e27b89-92a8-422a-8630-f4bd10f18e54 req-da3311a0-d05d-41a9-82f3-de8c623c2b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9286220c-2c3c-414e-86fe-65ce878ccfda", "tag": "b2f7d192-4f14-4be4-a2d1-6156f2ed5244"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:09.298287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-82e27b89-92a8-422a-8630-f4bd10f18e54 req-da3311a0-d05d-41a9-82f3-de8c623c2b46 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:09.299189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-82e27b89-92a8-422a-8630-f4bd10f18e54 req-da3311a0-d05d-41a9-82f3-de8c623c2b46 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:09.299819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-82e27b89-92a8-422a-8630-f4bd10f18e54 req-da3311a0-d05d-41a9-82f3-de8c623c2b46 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:09.322903 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-82e27b89-92a8-422a-8630-f4bd10f18e54 req-da3311a0-d05d-41a9-82f3-de8c623c2b46 service nova] Creating event network-changed:b2f7d192-4f14-4be4-a2d1-6156f2ed5244 for instance 9286220c-2c3c-414e-86fe-65ce878ccfda on n-h1-860864-3 Oct 11 20:05:09.332720 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-82e27b89-92a8-422a-8630-f4bd10f18e54 req-da3311a0-d05d-41a9-82f3-de8c623c2b46 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061045 Oct 11 20:05:09.334101 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2411/4762] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:05:09.458685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b9c66fc-abc4-4f50-9209-16a51b4459a6 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:09.460692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0b9c66fc-abc4-4f50-9209-16a51b4459a6 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:09.475004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9c66fc-abc4-4f50-9209-16a51b4459a6 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:09.475971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9c66fc-abc4-4f50-9209-16a51b4459a6 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:09.476581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9c66fc-abc4-4f50-9209-16a51b4459a6 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:09.477712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9c66fc-abc4-4f50-9209-16a51b4459a6 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:09.478312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9c66fc-abc4-4f50-9209-16a51b4459a6 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:09.478905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b9c66fc-abc4-4f50-9209-16a51b4459a6 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:09.659131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:09.851693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:09.868542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:09.878145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:09.881768 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-36db3af0-903a-4865-a49b-9468e9f1b5b3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 0.917605 Oct 11 20:05:09.888006 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2352/4763] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:08 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:09.899778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1214121885", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3044e01-188f-474d-8296-ce2a6945a204"}], "security_groups": [{"name": "tempest-securitygroup--263079685"}], "key_name": "tempest-keypair-568769103", "user_data": "}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:09.974790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0b9c66fc-abc4-4f50-9209-16a51b4459a6 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:09.987590 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b9c66fc-abc4-4f50-9209-16a51b4459a6 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1316 microversion: 2.1 time: 0.538079 Oct 11 20:05:09.988950 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2412/4764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:09 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:05:10.145377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] validate_networks() for [('e3044e01-188f-474d-8296-ce2a6945a204', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:05:10.548419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:10.913788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:10.914428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:10.917618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=10 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:10.926782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:10.927296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:10.927740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:10.928453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:10.941424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:10.942119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:11.747791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:05:11.748308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:05:11.748896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:05:11.749556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:05:11.751313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:05:11.775497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:11.777810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:11.779459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:11.783757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:11.784605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:11.786770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:11.816253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:11.835638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:05:11.837821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:11.845303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:11.846592 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-451ec182-d008-4681-8b88-b2fc394faf15 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 0.936797 Oct 11 20:05:11.847187 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2413/4765] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:10 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:05:11.852956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for user f4202e77bb27447ba5363091634d9731 and project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:05:11.862298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-877a4e82-0505-42d4-bbf8-08dbcc30629f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:11.874958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-877a4e82-0505-42d4-bbf8-08dbcc30629f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:11.888004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:05:11.895543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:05:11.903636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-877a4e82-0505-42d4-bbf8-08dbcc30629f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:11.904145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-877a4e82-0505-42d4-bbf8-08dbcc30629f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:11.904587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-877a4e82-0505-42d4-bbf8-08dbcc30629f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:11.911013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-877a4e82-0505-42d4-bbf8-08dbcc30629f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:11.913103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-877a4e82-0505-42d4-bbf8-08dbcc30629f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:11.913812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-877a4e82-0505-42d4-bbf8-08dbcc30629f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:12.046211 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a7c31eee-1537-447c-99ac-fc075696f836 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.152337 Oct 11 20:05:12.049443 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2353/4766] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:05:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:05:12.067606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5d180c0c-576a-4de3-912f-7b600713eb4b req-2bd62a4e-f685-4892-8375-f1af60015290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a125d45-79ec-4fda-9601-334c311a9f7a", "tag": "e4e15471-dfd8-4f5d-be37-fdddaa52dfc8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:12.095929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5d180c0c-576a-4de3-912f-7b600713eb4b req-2bd62a4e-f685-4892-8375-f1af60015290 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:12.100609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5d180c0c-576a-4de3-912f-7b600713eb4b req-2bd62a4e-f685-4892-8375-f1af60015290 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:12.101349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5d180c0c-576a-4de3-912f-7b600713eb4b req-2bd62a4e-f685-4892-8375-f1af60015290 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:12.135398 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5d180c0c-576a-4de3-912f-7b600713eb4b req-2bd62a4e-f685-4892-8375-f1af60015290 service nova] Creating event network-changed:e4e15471-dfd8-4f5d-be37-fdddaa52dfc8 for instance 7a125d45-79ec-4fda-9601-334c311a9f7a on n-h2-860864-3 Oct 11 20:05:12.149072 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5d180c0c-576a-4de3-912f-7b600713eb4b req-2bd62a4e-f685-4892-8375-f1af60015290 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098242 Oct 11 20:05:12.150058 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2354/4767] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:12.161257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-229b820d-3a93-42a8-a1aa-73e4864dd95e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:12.167496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-229b820d-3a93-42a8-a1aa-73e4864dd95e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:12.337110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-229b820d-3a93-42a8-a1aa-73e4864dd95e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:12.349601 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-229b820d-3a93-42a8-a1aa-73e4864dd95e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1241 microversion: 2.1 time: 0.197578 Oct 11 20:05:12.351523 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2355/4768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:12 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1241 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:12.527960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-877a4e82-0505-42d4-bbf8-08dbcc30629f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:12.547434 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-877a4e82-0505-42d4-bbf8-08dbcc30629f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1316 microversion: 2.1 time: 0.698936 Oct 11 20:05:12.570185 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2414/4769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:11 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:12.878050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:12.878846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:12.901971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:12.903249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:12.905786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:12.908060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:12.909384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:12.910952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:13.249700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:13.269890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:13.272876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:13.279982 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7cdcdd2a-d08d-4582-8c52-da0d25ac8eb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 0.406543 Oct 11 20:05:13.283044 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2356/4770] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:12 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:05:13.392719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ab664cda-e64d-4baf-82d5-554573d8c2f3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:13.394099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ab664cda-e64d-4baf-82d5-554573d8c2f3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:13.412022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab664cda-e64d-4baf-82d5-554573d8c2f3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:13.412905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab664cda-e64d-4baf-82d5-554573d8c2f3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:13.413498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab664cda-e64d-4baf-82d5-554573d8c2f3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:13.414337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab664cda-e64d-4baf-82d5-554573d8c2f3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:13.414944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab664cda-e64d-4baf-82d5-554573d8c2f3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:13.420106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab664cda-e64d-4baf-82d5-554573d8c2f3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:13.580094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56c25210-e23f-47c8-abee-fb611870281b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:13.581930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56c25210-e23f-47c8-abee-fb611870281b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:13.595545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56c25210-e23f-47c8-abee-fb611870281b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:13.599296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56c25210-e23f-47c8-abee-fb611870281b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:13.599964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56c25210-e23f-47c8-abee-fb611870281b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:13.603203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56c25210-e23f-47c8-abee-fb611870281b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:13.604667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56c25210-e23f-47c8-abee-fb611870281b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:13.605390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56c25210-e23f-47c8-abee-fb611870281b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:13.761911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ab664cda-e64d-4baf-82d5-554573d8c2f3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:13.771210 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ab664cda-e64d-4baf-82d5-554573d8c2f3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1245 microversion: 2.1 time: 0.397432 Oct 11 20:05:13.771759 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2415/4771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:13 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1245 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:14.319276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:14.322623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:14.350770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:14.354220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:14.356548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:14.365418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:14.366077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:14.367902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:14.369414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56c25210-e23f-47c8-abee-fb611870281b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:14.385425 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56c25210-e23f-47c8-abee-fb611870281b tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1316 microversion: 2.1 time: 0.813231 Oct 11 20:05:14.387233 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2357/4772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:13 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1316 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:14.797364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-19db4b79-ae99-46ee-b72c-714c8c294924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:14.797998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-19db4b79-ae99-46ee-b72c-714c8c294924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:14.808834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19db4b79-ae99-46ee-b72c-714c8c294924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:14.809365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19db4b79-ae99-46ee-b72c-714c8c294924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:14.809811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19db4b79-ae99-46ee-b72c-714c8c294924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:14.820570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19db4b79-ae99-46ee-b72c-714c8c294924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:14.821070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19db4b79-ae99-46ee-b72c-714c8c294924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:14.821519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19db4b79-ae99-46ee-b72c-714c8c294924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:15.596260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-19db4b79-ae99-46ee-b72c-714c8c294924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:15.610244 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-19db4b79-ae99-46ee-b72c-714c8c294924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1311 microversion: 2.1 time: 0.815946 Oct 11 20:05:15.629690 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2358/4773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:14 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1311 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:15.635956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1fdf9ba6-2888-4146-9b32-7efb3bc41659 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:15.639335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1fdf9ba6-2888-4146-9b32-7efb3bc41659 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:15.661861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fdf9ba6-2888-4146-9b32-7efb3bc41659 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:15.662813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fdf9ba6-2888-4146-9b32-7efb3bc41659 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:15.663417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fdf9ba6-2888-4146-9b32-7efb3bc41659 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:15.664321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fdf9ba6-2888-4146-9b32-7efb3bc41659 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:15.671035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fdf9ba6-2888-4146-9b32-7efb3bc41659 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:15.673917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1fdf9ba6-2888-4146-9b32-7efb3bc41659 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:16.422104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:16.431899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:16.441752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:16.442987 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bb65d967-70bb-4b86-85ac-4f8d0e1fcad6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 2.139316 Oct 11 20:05:16.453796 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2416/4774] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:14 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:05:16.648209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd294055-7885-47f5-8597-3d697228c815 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:16.649291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bd294055-7885-47f5-8597-3d697228c815 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:16.678074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd294055-7885-47f5-8597-3d697228c815 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:16.685950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd294055-7885-47f5-8597-3d697228c815 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:16.686925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd294055-7885-47f5-8597-3d697228c815 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:16.691871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd294055-7885-47f5-8597-3d697228c815 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:16.694434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd294055-7885-47f5-8597-3d697228c815 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:16.695700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd294055-7885-47f5-8597-3d697228c815 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:16.912172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1fdf9ba6-2888-4146-9b32-7efb3bc41659 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:16.923215 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1fdf9ba6-2888-4146-9b32-7efb3bc41659 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1316 microversion: 2.1 time: 1.292156 Oct 11 20:05:16.929909 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2359/4775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:15 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1316 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:17.220702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd294055-7885-47f5-8597-3d697228c815 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:17.231738 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bd294055-7885-47f5-8597-3d697228c815 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1299 microversion: 2.1 time: 0.588056 Oct 11 20:05:17.233892 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2417/4776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:16 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1299 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:17.479777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:17.480389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:17.497244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:17.497760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:17.498234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:17.498973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:17.499443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:17.500490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:17.959280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9855cf3c-7892-4fab-973e-4294c169e584 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:17.959909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9855cf3c-7892-4fab-973e-4294c169e584 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:17.976602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9855cf3c-7892-4fab-973e-4294c169e584 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:17.980172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9855cf3c-7892-4fab-973e-4294c169e584 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:17.982856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9855cf3c-7892-4fab-973e-4294c169e584 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:17.983749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9855cf3c-7892-4fab-973e-4294c169e584 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:17.990304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9855cf3c-7892-4fab-973e-4294c169e584 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:17.990964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9855cf3c-7892-4fab-973e-4294c169e584 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:18.642688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:18.659272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:18.665534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:18.666825 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-df9b401c-6fd3-406c-b5ed-b65afb0470f6 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 1.190983 Oct 11 20:05:18.667397 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2360/4777] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:17 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:18.679607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e5c1c8b-1086-42fd-930d-a791500d9589 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:18.681760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7e5c1c8b-1086-42fd-930d-a791500d9589 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:18.698232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e5c1c8b-1086-42fd-930d-a791500d9589 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:18.699626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e5c1c8b-1086-42fd-930d-a791500d9589 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:18.701458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e5c1c8b-1086-42fd-930d-a791500d9589 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:18.702463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e5c1c8b-1086-42fd-930d-a791500d9589 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:18.704624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e5c1c8b-1086-42fd-930d-a791500d9589 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:18.705988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e5c1c8b-1086-42fd-930d-a791500d9589 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:18.906944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7e5c1c8b-1086-42fd-930d-a791500d9589 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:18.929896 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e5c1c8b-1086-42fd-930d-a791500d9589 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1299 microversion: 2.1 time: 0.255812 Oct 11 20:05:18.933894 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2361/4778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:18 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:19.026324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9855cf3c-7892-4fab-973e-4294c169e584 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:19.043800 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9855cf3c-7892-4fab-973e-4294c169e584 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1316 microversion: 2.1 time: 1.086603 Oct 11 20:05:19.045837 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2418/4779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:17 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1316 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:05:19.700580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:19.701291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:19.717884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:19.719746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:19.722832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:19.726853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:19.727618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:19.729406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:19.962382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38053a47-9245-4377-9d4d-2f4963ae49ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:19.964296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-38053a47-9245-4377-9d4d-2f4963ae49ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:19.989569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38053a47-9245-4377-9d4d-2f4963ae49ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:19.997728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38053a47-9245-4377-9d4d-2f4963ae49ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:19.999420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38053a47-9245-4377-9d4d-2f4963ae49ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:20.002737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38053a47-9245-4377-9d4d-2f4963ae49ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:20.004010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38053a47-9245-4377-9d4d-2f4963ae49ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:20.007045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38053a47-9245-4377-9d4d-2f4963ae49ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:20.702436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:20.728636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:20.744284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:20.749023 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-66ac041f-f1fd-4bf9-9bfc-bfbd9f81495f tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 1.052804 Oct 11 20:05:20.752271 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2362/4780] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:19 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:20.762636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8cd8625f-4401-4984-80d3-9cab249f6813 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:20.764699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8cd8625f-4401-4984-80d3-9cab249f6813 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:20.779603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cd8625f-4401-4984-80d3-9cab249f6813 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:20.782044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cd8625f-4401-4984-80d3-9cab249f6813 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:20.783007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cd8625f-4401-4984-80d3-9cab249f6813 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:20.784724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cd8625f-4401-4984-80d3-9cab249f6813 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:20.786403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cd8625f-4401-4984-80d3-9cab249f6813 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:20.787269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cd8625f-4401-4984-80d3-9cab249f6813 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:21.310912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-38053a47-9245-4377-9d4d-2f4963ae49ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:21.329729 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-38053a47-9245-4377-9d4d-2f4963ae49ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1366 microversion: 2.1 time: 1.367208 Oct 11 20:05:21.330858 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2419/4781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:19 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1366 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:21.336221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c087d690-1f79-4728-93a4-237f6eb9b4db req-11155144-c210-4a89-af90-db42d03fd0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9286220c-2c3c-414e-86fe-65ce878ccfda", "name": "network-vif-plugged", "status": "completed", "tag": "b2f7d192-4f14-4be4-a2d1-6156f2ed5244"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:21.404916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c087d690-1f79-4728-93a4-237f6eb9b4db req-11155144-c210-4a89-af90-db42d03fd0ba service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:21.425164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c087d690-1f79-4728-93a4-237f6eb9b4db req-11155144-c210-4a89-af90-db42d03fd0ba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:21.427234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c087d690-1f79-4728-93a4-237f6eb9b4db req-11155144-c210-4a89-af90-db42d03fd0ba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:21.430401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:21.483609 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c087d690-1f79-4728-93a4-237f6eb9b4db req-11155144-c210-4a89-af90-db42d03fd0ba service nova] Creating event network-vif-plugged:b2f7d192-4f14-4be4-a2d1-6156f2ed5244 for instance 9286220c-2c3c-414e-86fe-65ce878ccfda on n-h1-860864-3 Oct 11 20:05:21.496110 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c087d690-1f79-4728-93a4-237f6eb9b4db req-11155144-c210-4a89-af90-db42d03fd0ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163681 Oct 11 20:05:21.512840 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2420/4782] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:21.780803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:21.781921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:21.802752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:21.804377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:21.805708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:21.807473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:21.811283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:21.822742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:21.825748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:22.348915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:22.487293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8cd8625f-4401-4984-80d3-9cab249f6813 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:22.503863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:22.512221 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8cd8625f-4401-4984-80d3-9cab249f6813 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1316 microversion: 2.1 time: 1.758603 Oct 11 20:05:22.515055 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2363/4783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:20 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1316 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:22.523048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d752f5ee-1953-45d0-a0ff-acbd53decaa3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:22.528430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d752f5ee-1953-45d0-a0ff-acbd53decaa3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:22.545617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d752f5ee-1953-45d0-a0ff-acbd53decaa3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:22.553436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d752f5ee-1953-45d0-a0ff-acbd53decaa3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:22.554216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d752f5ee-1953-45d0-a0ff-acbd53decaa3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:22.555177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d752f5ee-1953-45d0-a0ff-acbd53decaa3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:22.555834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d752f5ee-1953-45d0-a0ff-acbd53decaa3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:22.556425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d752f5ee-1953-45d0-a0ff-acbd53decaa3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:22.924658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:22.950905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:22.960020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:22.965189 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fe1413b3-027e-4f11-9a7e-9cb393316abd tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 1.187564 Oct 11 20:05:22.970442 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2421/4784] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:21 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:05:23.449918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d752f5ee-1953-45d0-a0ff-acbd53decaa3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:23.466868 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d752f5ee-1953-45d0-a0ff-acbd53decaa3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1366 microversion: 2.1 time: 0.944153 Oct 11 20:05:23.470338 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2364/4785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:22 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1366 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:23.542685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c6f88bb5-6e2c-4126-8494-8d7c50bd075a tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:23.543324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c6f88bb5-6e2c-4126-8494-8d7c50bd075a tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:23.563065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f88bb5-6e2c-4126-8494-8d7c50bd075a tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:23.563782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f88bb5-6e2c-4126-8494-8d7c50bd075a tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:23.564394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f88bb5-6e2c-4126-8494-8d7c50bd075a tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:23.566010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f88bb5-6e2c-4126-8494-8d7c50bd075a tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:23.570133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f88bb5-6e2c-4126-8494-8d7c50bd075a tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:23.570890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6f88bb5-6e2c-4126-8494-8d7c50bd075a tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:23.998020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:23.998904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:24.022368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:24.025057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:24.026179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:24.029964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:24.034285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:24.034921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:26.123813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c6f88bb5-6e2c-4126-8494-8d7c50bd075a tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:26.132948 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c6f88bb5-6e2c-4126-8494-8d7c50bd075a tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1506 microversion: 2.1 time: 2.595423 Oct 11 20:05:26.159654 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2422/4786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:23 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1506 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:26.185636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7cac83cc-6214-44b3-85f5-1003281901a6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:26.188723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7cac83cc-6214-44b3-85f5-1003281901a6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:26.200299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cac83cc-6214-44b3-85f5-1003281901a6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:26.203184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cac83cc-6214-44b3-85f5-1003281901a6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:26.203770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cac83cc-6214-44b3-85f5-1003281901a6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:26.212767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cac83cc-6214-44b3-85f5-1003281901a6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:26.214271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cac83cc-6214-44b3-85f5-1003281901a6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:26.215072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cac83cc-6214-44b3-85f5-1003281901a6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:27.151279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:27.202044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:27.220602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:27.239292 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dcda2594-5adf-4ffd-8184-c4511b6b82bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 3.243143 Oct 11 20:05:27.240399 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2365/4787] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:23 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 3248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:27.260204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-693927af-65bf-42a4-8aa8-414caf109754 req-99dc6832-533d-4f30-b217-cdf3c7ca452e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef13443d-3c56-4ec8-b242-fc39fa2f1a16", "tag": "4d2ad5fc-9d05-40e0-894f-e50bd481dd5a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:27.361653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:27.363828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-693927af-65bf-42a4-8aa8-414caf109754 req-99dc6832-533d-4f30-b217-cdf3c7ca452e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:27.364318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-693927af-65bf-42a4-8aa8-414caf109754 req-99dc6832-533d-4f30-b217-cdf3c7ca452e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:27.364750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-693927af-65bf-42a4-8aa8-414caf109754 req-99dc6832-533d-4f30-b217-cdf3c7ca452e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:27.378629 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-693927af-65bf-42a4-8aa8-414caf109754 req-99dc6832-533d-4f30-b217-cdf3c7ca452e service nova] Creating event network-changed:4d2ad5fc-9d05-40e0-894f-e50bd481dd5a for instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 on n-h2-860864-3 Oct 11 20:05:27.388360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7cac83cc-6214-44b3-85f5-1003281901a6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:27.397239 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7cac83cc-6214-44b3-85f5-1003281901a6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1366 microversion: 2.1 time: 1.236200 Oct 11 20:05:27.397843 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2423/4788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:26 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1366 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:27.403745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3d4484d3-7efe-4aab-a694-e6aaa773bacd tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:27.406974 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-693927af-65bf-42a4-8aa8-414caf109754 req-99dc6832-533d-4f30-b217-cdf3c7ca452e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164215 Oct 11 20:05:27.407712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3d4484d3-7efe-4aab-a694-e6aaa773bacd tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:27.415488 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2366/4789] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:27.419047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d4484d3-7efe-4aab-a694-e6aaa773bacd tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:27.419742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d4484d3-7efe-4aab-a694-e6aaa773bacd tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:27.420348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d4484d3-7efe-4aab-a694-e6aaa773bacd tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:27.421271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d4484d3-7efe-4aab-a694-e6aaa773bacd tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:27.422518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d4484d3-7efe-4aab-a694-e6aaa773bacd tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:27.423132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d4484d3-7efe-4aab-a694-e6aaa773bacd tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:27.455678 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3d4484d3-7efe-4aab-a694-e6aaa773bacd tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda/ips" status: 200 len: 110 microversion: 2.1 time: 0.055551 Oct 11 20:05:27.470592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-26adb321-9b3d-4220-b940-e3e6d26cf478 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:27.471478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-26adb321-9b3d-4220-b940-e3e6d26cf478 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:27.474892 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2424/4790] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:05:27 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda/ips => generated 110 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:27.479153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26adb321-9b3d-4220-b940-e3e6d26cf478 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:27.479833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26adb321-9b3d-4220-b940-e3e6d26cf478 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:27.480432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26adb321-9b3d-4220-b940-e3e6d26cf478 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:27.481328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26adb321-9b3d-4220-b940-e3e6d26cf478 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:27.481940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26adb321-9b3d-4220-b940-e3e6d26cf478 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:27.482566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26adb321-9b3d-4220-b940-e3e6d26cf478 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:27.523385 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-26adb321-9b3d-4220-b940-e3e6d26cf478 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda/ips" status: 200 len: 110 microversion: 2.1 time: 0.057675 Oct 11 20:05:27.537026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1f77281-15c0-4427-81bf-663c1a31a3ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:27.537800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1f77281-15c0-4427-81bf-663c1a31a3ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:27.543307 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2367/4791] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:05:27 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda/ips => generated 110 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:27.546193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1f77281-15c0-4427-81bf-663c1a31a3ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:27.547495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1f77281-15c0-4427-81bf-663c1a31a3ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:27.548093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1f77281-15c0-4427-81bf-663c1a31a3ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:27.548975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1f77281-15c0-4427-81bf-663c1a31a3ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:27.549601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1f77281-15c0-4427-81bf-663c1a31a3ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:27.550371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1f77281-15c0-4427-81bf-663c1a31a3ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:27.578764 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1f77281-15c0-4427-81bf-663c1a31a3ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda/ips/tempest-ServerAddressesTestJSON-2047160841-network" status: 200 len: 95 microversion: 2.1 time: 0.046247 Oct 11 20:05:27.597773 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2425/4792] 10.222.0.27 () {58 vars in 1401 bytes} [Tue Oct 11 20:05:27 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda/ips/tempest-ServerAddressesTestJSON-2047160841-network => generated 95 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:05:27.605083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-edd9bdac-1e43-4d89-8f26-62719039d9ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:27.605926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-edd9bdac-1e43-4d89-8f26-62719039d9ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:27.648220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edd9bdac-1e43-4d89-8f26-62719039d9ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:27.651546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edd9bdac-1e43-4d89-8f26-62719039d9ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:27.652391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edd9bdac-1e43-4d89-8f26-62719039d9ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:27.661494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edd9bdac-1e43-4d89-8f26-62719039d9ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:27.668012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edd9bdac-1e43-4d89-8f26-62719039d9ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:27.672550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-edd9bdac-1e43-4d89-8f26-62719039d9ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:27.899195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-edd9bdac-1e43-4d89-8f26-62719039d9ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:05:28.272376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:28.274918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:28.288032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:28.288545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:28.288994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:28.289708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:28.290178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:28.290641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:28.335936 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-edd9bdac-1e43-4d89-8f26-62719039d9ad tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 204 len: 0 microversion: 2.1 time: 0.739971 Oct 11 20:05:28.341099 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2368/4793] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:05:27 2022] DELETE /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 0 bytes in 748 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:05:28.379589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6cd6f76a-b9c8-4937-9dae-da1dceda8aa5 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:28.380633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6cd6f76a-b9c8-4937-9dae-da1dceda8aa5 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:28.403037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cd6f76a-b9c8-4937-9dae-da1dceda8aa5 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:28.404395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cd6f76a-b9c8-4937-9dae-da1dceda8aa5 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:28.404813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cd6f76a-b9c8-4937-9dae-da1dceda8aa5 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:28.417054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cd6f76a-b9c8-4937-9dae-da1dceda8aa5 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:28.423760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cd6f76a-b9c8-4937-9dae-da1dceda8aa5 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:28.424655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6cd6f76a-b9c8-4937-9dae-da1dceda8aa5 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:29.043882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:29.076904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:29.079445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:29.090569 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f2b35fa-d403-473b-9bfe-1ee0ed032d45 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 0.821927 Oct 11 20:05:29.091896 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2426/4794] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:28 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:29.095833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6cd6f76a-b9c8-4937-9dae-da1dceda8aa5 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:29.098218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cddfd2a8-ed03-4934-ae8b-d1d8a91f6b9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:29.099162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cddfd2a8-ed03-4934-ae8b-d1d8a91f6b9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:29.105231 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6cd6f76a-b9c8-4937-9dae-da1dceda8aa5 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1512 microversion: 2.1 time: 0.757665 Oct 11 20:05:29.107076 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2369/4795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:28 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1512 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:29.125891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cddfd2a8-ed03-4934-ae8b-d1d8a91f6b9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:29.126398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-750146494", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "01dab556-3f63-4f57-b822-9fcc331f61ca"}], "key_name": "tempest-TestNetworkAdvancedServerOps-51365918", "security_groups": [{"name": "tempest-secgroup-smoke-2006364747"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:29.127219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cddfd2a8-ed03-4934-ae8b-d1d8a91f6b9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:29.128227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cddfd2a8-ed03-4934-ae8b-d1d8a91f6b9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:29.129583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cddfd2a8-ed03-4934-ae8b-d1d8a91f6b9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:29.130639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cddfd2a8-ed03-4934-ae8b-d1d8a91f6b9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:29.131309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cddfd2a8-ed03-4934-ae8b-d1d8a91f6b9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:29.744106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] validate_networks() for [('01dab556-3f63-4f57-b822-9fcc331f61ca', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:05:30.224502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cddfd2a8-ed03-4934-ae8b-d1d8a91f6b9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:30.234556 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cddfd2a8-ed03-4934-ae8b-d1d8a91f6b9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1366 microversion: 2.1 time: 1.140622 Oct 11 20:05:30.244633 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2427/4796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:29 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1366 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:30.254866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:30.255775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:30.281260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:30.281975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:30.282614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:30.287217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:30.287879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:30.288642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:31.768865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:31.785462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:31.787841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:31.788962 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1bd7f435-1b0b-4a9f-969f-d7f88cdedfd7 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 1.542772 Oct 11 20:05:31.791726 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2428/4797] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:30 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:31.805292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-48b2fc7c-6694-44b2-8d9d-38c951f1ac74 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:31.806080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-48b2fc7c-6694-44b2-8d9d-38c951f1ac74 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:31.826949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b2fc7c-6694-44b2-8d9d-38c951f1ac74 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:31.827514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b2fc7c-6694-44b2-8d9d-38c951f1ac74 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:31.827992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b2fc7c-6694-44b2-8d9d-38c951f1ac74 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:31.828876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b2fc7c-6694-44b2-8d9d-38c951f1ac74 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:31.829336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b2fc7c-6694-44b2-8d9d-38c951f1ac74 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:31.829785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48b2fc7c-6694-44b2-8d9d-38c951f1ac74 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:32.433312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-48b2fc7c-6694-44b2-8d9d-38c951f1ac74 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29170f9d0a1c4c69b3caeb2d72c1d095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0f7a012141948a916d7d3c2b6fe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:32.442565 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-48b2fc7c-6694-44b2-8d9d-38c951f1ac74 tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 200 len: 1512 microversion: 2.1 time: 0.649401 Oct 11 20:05:32.450972 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2429/4798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:31 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 1512 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:32.462506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cfa4e18b-319c-46a6-86e3-81efdde33e19 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:32.462506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cfa4e18b-319c-46a6-86e3-81efdde33e19 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:32.472778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa4e18b-319c-46a6-86e3-81efdde33e19 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:32.473299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa4e18b-319c-46a6-86e3-81efdde33e19 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:32.478905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa4e18b-319c-46a6-86e3-81efdde33e19 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:32.480011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa4e18b-319c-46a6-86e3-81efdde33e19 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:32.480582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa4e18b-319c-46a6-86e3-81efdde33e19 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:32.480959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa4e18b-319c-46a6-86e3-81efdde33e19 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:32.889614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:05:32.891272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:05:32.892453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:05:32.893042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:05:32.893874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:05:32.920005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:32.920746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:32.929966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:32.932735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:32.934096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:32.934763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:33.008821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for project abba65df7ef6403db3d5b466eb12fb94. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:05:33.021465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for user c3eaa8c79a0645fd93e6e3398426237f and project abba65df7ef6403db3d5b466eb12fb94. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:05:33.060106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:05:33.066272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:05:33.197304 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-14edc0ad-5b9a-414b-ad81-8bdf357abfa9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.079717 Oct 11 20:05:33.207415 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2370/4799] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:05:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 4093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:05:33.218948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05b60be9-fc19-48aa-8f87-6b76c3b78d82 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Action: 'create', calling method: .version_select at 0x7f83d06b6700>, body: {"keypair": {"name": "tempest-keypair-2029063671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyWnQaiGBYfVI4qQI4EcLBlOGSPnhrQrTfHQ+WO6OtPodOtwjVKQh/GhyxO/3qOzCkp4IDu3nX8OKFBX4s0mJtvoSYjOaVHepZKeoZxd79LpYEp/fCYGnzsIf3pJg/49A=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:33.248582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-05b60be9-fc19-48aa-8f87-6b76c3b78d82 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Getting quotas for project e99631a5809b4f3ab73232f4940a6722. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:05:33.262659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-05b60be9-fc19-48aa-8f87-6b76c3b78d82 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Getting quotas for user 09e46a1f1cb2445588c04964d140825f and project e99631a5809b4f3ab73232f4940a6722. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:05:33.300276 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05b60be9-fc19-48aa-8f87-6b76c3b78d82 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.090528 Oct 11 20:05:33.316874 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2371/4800] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 11 20:05:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 20:05:33.323760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:33.324566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:33.333208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:33.333844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:33.334409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:33.335252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:33.335780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:33.336316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:33.423786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cfa4e18b-319c-46a6-86e3-81efdde33e19 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:33.460598 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cfa4e18b-319c-46a6-86e3-81efdde33e19 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1366 microversion: 2.1 time: 1.012717 Oct 11 20:05:33.463867 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2430/4801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:32 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1366 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:33.473916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-03c14cff-1c7d-436e-b1cc-3429f1f4e4e8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:33.482746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-03c14cff-1c7d-436e-b1cc-3429f1f4e4e8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:34.233789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-03c14cff-1c7d-436e-b1cc-3429f1f4e4e8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:34.272648 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-03c14cff-1c7d-436e-b1cc-3429f1f4e4e8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1264 microversion: 2.1 time: 0.804513 Oct 11 20:05:34.277855 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2431/4802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:33 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1264 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:34.300757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-98147001-c26e-4c39-8d9b-a7aaa35b7cdd req-00fbca0c-ddd4-4c41-8c4f-3918a19aab25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9286220c-2c3c-414e-86fe-65ce878ccfda", "name": "network-vif-deleted", "tag": "b2f7d192-4f14-4be4-a2d1-6156f2ed5244"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:34.338496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-98147001-c26e-4c39-8d9b-a7aaa35b7cdd req-00fbca0c-ddd4-4c41-8c4f-3918a19aab25 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:34.339282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-98147001-c26e-4c39-8d9b-a7aaa35b7cdd req-00fbca0c-ddd4-4c41-8c4f-3918a19aab25 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:34.341009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-98147001-c26e-4c39-8d9b-a7aaa35b7cdd req-00fbca0c-ddd4-4c41-8c4f-3918a19aab25 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:34.369030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-98147001-c26e-4c39-8d9b-a7aaa35b7cdd req-00fbca0c-ddd4-4c41-8c4f-3918a19aab25 service nova] Creating event network-vif-deleted:b2f7d192-4f14-4be4-a2d1-6156f2ed5244 for instance 9286220c-2c3c-414e-86fe-65ce878ccfda on n-h1-860864-3 Oct 11 20:05:34.378593 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-98147001-c26e-4c39-8d9b-a7aaa35b7cdd req-00fbca0c-ddd4-4c41-8c4f-3918a19aab25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096301 Oct 11 20:05:34.381156 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2432/4803] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:34.387944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:34.389092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] [instance: 9286220c-2c3c-414e-86fe-65ce878ccfda] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:34.392347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:34.409102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:34.419190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:34.425503 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-90c9c87f-f0a3-4db4-b159-cae58f6b88f3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 1.106176 Oct 11 20:05:34.426143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:34.428289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:34.429355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:34.433975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:34.435016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:34.437714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:34.453052 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2372/4804] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:33 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:34.491177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9933a6ab-84e3-4c06-9531-9cc97284c6f1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:34.491802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9933a6ab-84e3-4c06-9531-9cc97284c6f1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:34.493246 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] HTTP exception thrown: Instance 9286220c-2c3c-414e-86fe-65ce878ccfda could not be found. Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Request method failure captured: Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda HTTP/1.1 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcxkpSMU4n_HxU1lOmZRHcRTWeDhfDQrA9i5tLwc7swn3VChaki1kG3rlyR3zrPridG5H4HnEgvQhLg6lLQPtLmdRz5wlo_D18S9AFOKKVF-vcW7vDQ4M7c3GAZEERWyRlkbsABKrouquyLwOd5ODkzZkcuwJCAEkBLmTlQKYeV9PJ4 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 89cd0f7a012141948a916d7d3c2b6fe3 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerAddressesTestJSON-1348594554 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/89cd0f7a012141948a916d7d3c2b6fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_89cd0f7a012141948a916d7d3c2b6fe3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/89cd0f7a012141948a916d7d3c2b6fe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/89cd0f7a012141948a916d7d3c2b6fe3"}]}] Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerAddressesTestJSON-1348594554 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 89cd0f7a012141948a916d7d3c2b6fe3 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1348594554 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerAddressesTestJSON-1348594554-project Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 29170f9d0a1c4c69b3caeb2d72c1d095 Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerAddressesTestJSON-1348594554-project Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 9286220c-2c3c-414e-86fe-65ce878ccfda could not be found. Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '9286220c-2c3c-414e-86fe-65ce878ccfda'} Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9286220c-2c3c-414e-86fe-65ce878ccfda could not be found. Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9286220c-2c3c-414e-86fe-65ce878ccfda could not be found. Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:05:34.496993 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:05:34.504318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:05:34.504318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:05:34.504318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:05:34.504318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:05:34.504318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:05:34.504318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9286220c-2c3c-414e-86fe-65ce878ccfda could not be found. Oct 11 20:05:34.504318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:05:34.506187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9933a6ab-84e3-4c06-9531-9cc97284c6f1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:34.507470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] Returning 404 to user: Instance 9286220c-2c3c-414e-86fe-65ce878ccfda could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:05:34.508366 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1873eef6-3a1b-441d-820b-3ccf5d94cd7f tempest-ServerAddressesTestJSON-1348594554 tempest-ServerAddressesTestJSON-1348594554-project] 10.222.0.27 "GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda" status: 404 len: 111 microversion: 2.1 time: 0.125808 Oct 11 20:05:34.508950 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2433/4805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:34 2022] GET /compute/v2.1/servers/9286220c-2c3c-414e-86fe-65ce878ccfda => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:05:34.512979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9933a6ab-84e3-4c06-9531-9cc97284c6f1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:34.513547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9933a6ab-84e3-4c06-9531-9cc97284c6f1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:34.516429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9933a6ab-84e3-4c06-9531-9cc97284c6f1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:34.517034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9933a6ab-84e3-4c06-9531-9cc97284c6f1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:34.517714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9933a6ab-84e3-4c06-9531-9cc97284c6f1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:35.138969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9933a6ab-84e3-4c06-9531-9cc97284c6f1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:35.153397 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9933a6ab-84e3-4c06-9531-9cc97284c6f1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1366 microversion: 2.1 time: 0.667638 Oct 11 20:05:35.158827 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2373/4806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:34 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1366 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:35.329529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5b638f31-031d-4764-bbf2-98336c1ce4aa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:35.330787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5b638f31-031d-4764-bbf2-98336c1ce4aa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:35.345251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b638f31-031d-4764-bbf2-98336c1ce4aa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:35.346675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b638f31-031d-4764-bbf2-98336c1ce4aa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:35.347716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b638f31-031d-4764-bbf2-98336c1ce4aa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:35.349184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b638f31-031d-4764-bbf2-98336c1ce4aa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:35.349968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b638f31-031d-4764-bbf2-98336c1ce4aa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:35.351114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5b638f31-031d-4764-bbf2-98336c1ce4aa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:35.459452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:35.460420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:35.475190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:35.475718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:35.476175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:35.479056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:35.479543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:35.480000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:35.742228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5b638f31-031d-4764-bbf2-98336c1ce4aa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:35.755660 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5b638f31-031d-4764-bbf2-98336c1ce4aa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1324 microversion: 2.1 time: 0.454263 Oct 11 20:05:35.758187 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2434/4807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:35 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:36.180301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd316b56-ad8a-4ac5-a52d-ae98f0056fd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:36.180918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bd316b56-ad8a-4ac5-a52d-ae98f0056fd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:36.189040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd316b56-ad8a-4ac5-a52d-ae98f0056fd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:36.189541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd316b56-ad8a-4ac5-a52d-ae98f0056fd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:36.189987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd316b56-ad8a-4ac5-a52d-ae98f0056fd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:36.196074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd316b56-ad8a-4ac5-a52d-ae98f0056fd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:36.196669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd316b56-ad8a-4ac5-a52d-ae98f0056fd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:36.197134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd316b56-ad8a-4ac5-a52d-ae98f0056fd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:36.219926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:36.242734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:36.245256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:36.248395 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-42f912ed-5a68-4219-9f2d-ca150a4b1c44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 0.794433 Oct 11 20:05:36.266737 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2374/4808] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:35 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:05:36.724302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8235f13a-2109-4c63-8ffc-3d6e26c08393 req-41c3fa76-1de2-4f4a-8c33-c79a1aa82fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef13443d-3c56-4ec8-b242-fc39fa2f1a16", "name": "network-vif-plugged", "status": "completed", "tag": "4d2ad5fc-9d05-40e0-894f-e50bd481dd5a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:36.763240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8235f13a-2109-4c63-8ffc-3d6e26c08393 req-41c3fa76-1de2-4f4a-8c33-c79a1aa82fa0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:36.764297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8235f13a-2109-4c63-8ffc-3d6e26c08393 req-41c3fa76-1de2-4f4a-8c33-c79a1aa82fa0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:36.765829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8235f13a-2109-4c63-8ffc-3d6e26c08393 req-41c3fa76-1de2-4f4a-8c33-c79a1aa82fa0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:36.789407 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8235f13a-2109-4c63-8ffc-3d6e26c08393 req-41c3fa76-1de2-4f4a-8c33-c79a1aa82fa0 service nova] Creating event network-vif-plugged:4d2ad5fc-9d05-40e0-894f-e50bd481dd5a for instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 on n-h2-860864-3 Oct 11 20:05:36.797702 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8235f13a-2109-4c63-8ffc-3d6e26c08393 req-41c3fa76-1de2-4f4a-8c33-c79a1aa82fa0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078467 Oct 11 20:05:36.799468 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2375/4809] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:05:36.840211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c18966a9-2361-4fad-a7e5-5549cf6adfc4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:36.848229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c18966a9-2361-4fad-a7e5-5549cf6adfc4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:36.883539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c18966a9-2361-4fad-a7e5-5549cf6adfc4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:36.884668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c18966a9-2361-4fad-a7e5-5549cf6adfc4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:36.885185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c18966a9-2361-4fad-a7e5-5549cf6adfc4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:36.887136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c18966a9-2361-4fad-a7e5-5549cf6adfc4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:36.888669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c18966a9-2361-4fad-a7e5-5549cf6adfc4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:36.890546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c18966a9-2361-4fad-a7e5-5549cf6adfc4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:36.992395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd316b56-ad8a-4ac5-a52d-ae98f0056fd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:37.009597 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bd316b56-ad8a-4ac5-a52d-ae98f0056fd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1366 microversion: 2.1 time: 0.833108 Oct 11 20:05:37.010204 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2435/4810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:36 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1366 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:37.091216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c18966a9-2361-4fad-a7e5-5549cf6adfc4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:37.102339 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c18966a9-2361-4fad-a7e5-5549cf6adfc4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1322 microversion: 2.1 time: 0.300774 Oct 11 20:05:37.102974 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2376/4811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:36 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:37.293317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:37.295031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:37.305827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=54 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:37.313565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:37.318296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:37.319163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:37.321361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:37.321999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:37.323252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:37.679197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:37.704644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:37.706831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:37.710275 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e7fa9b45-9abe-4e64-bcb1-1e8bc692cddc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 0.420788 Oct 11 20:05:37.726638 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2436/4812] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:37 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:38.037780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5eec5deb-c190-4c32-878e-74b66d03ef59 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:38.038399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5eec5deb-c190-4c32-878e-74b66d03ef59 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:38.054286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eec5deb-c190-4c32-878e-74b66d03ef59 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:38.055167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eec5deb-c190-4c32-878e-74b66d03ef59 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:38.055799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eec5deb-c190-4c32-878e-74b66d03ef59 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:38.059437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eec5deb-c190-4c32-878e-74b66d03ef59 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:38.060098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eec5deb-c190-4c32-878e-74b66d03ef59 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:38.061321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5eec5deb-c190-4c32-878e-74b66d03ef59 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:38.131287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f44ab480-c9d8-451e-bc2b-468122c58078 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:38.131953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f44ab480-c9d8-451e-bc2b-468122c58078 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:38.139865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f44ab480-c9d8-451e-bc2b-468122c58078 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:38.140489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f44ab480-c9d8-451e-bc2b-468122c58078 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:38.142860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f44ab480-c9d8-451e-bc2b-468122c58078 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:38.143710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f44ab480-c9d8-451e-bc2b-468122c58078 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:38.144254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f44ab480-c9d8-451e-bc2b-468122c58078 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:38.144747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f44ab480-c9d8-451e-bc2b-468122c58078 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:38.598370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5eec5deb-c190-4c32-878e-74b66d03ef59 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:38.611682 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5eec5deb-c190-4c32-878e-74b66d03ef59 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1366 microversion: 2.1 time: 0.577983 Oct 11 20:05:38.612291 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2377/4813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:38 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:38.629463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f44ab480-c9d8-451e-bc2b-468122c58078 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:38.643763 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f44ab480-c9d8-451e-bc2b-468122c58078 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1390 microversion: 2.1 time: 0.517711 Oct 11 20:05:38.644581 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2437/4814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:38 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1390 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:38.739625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:38.740284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:38.754510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:38.755233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:38.755668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:38.756384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:38.756843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:38.757267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:39.463434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:39.481727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:39.489674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:39.494075 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ede6e99e-5e11-4fb7-9d8a-ff0ccced2295 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 0.757178 Oct 11 20:05:39.496193 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2378/4815] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:38 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:39.633812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1072975817", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c8f77053-7e4e-4df6-9803-f2259d58f7bb"}, {"port": "c43aaecd-6f25-402d-af31-5703ca8f952b", "tag": "port-1"}, {"port": "64e233cb-7770-4bcd-b9b7-a977e0aa27eb", "tag": "port-2"}, {"uuid": "7286daf1-dea3-4fd7-a6a9-602c4bedfd73", "tag": "net-1"}, {"uuid": "7286daf1-dea3-4fd7-a6a9-602c4bedfd73"}, {"uuid": "6e01d89b-5c37-438c-9443-3de3e2699065", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6e01d89b-5c37-438c-9443-3de3e2699065", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9f6316a2-9d7b-4441-8a93-a10e6e73b5e8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a17392e6-9d70-401b-90d8-8936c0df9e33", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4c5b6d99-3df0-4bbe-8fbe-67dfa9b6713f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1146695099"}], "key_name": "tempest-keypair-2029063671", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:39.638968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-799c0848-63ce-47b9-aca0-9ff8c8a11403 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:39.641248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-799c0848-63ce-47b9-aca0-9ff8c8a11403 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:39.655835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799c0848-63ce-47b9-aca0-9ff8c8a11403 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:39.656741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799c0848-63ce-47b9-aca0-9ff8c8a11403 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:39.657423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799c0848-63ce-47b9-aca0-9ff8c8a11403 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:39.658324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799c0848-63ce-47b9-aca0-9ff8c8a11403 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:39.658997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799c0848-63ce-47b9-aca0-9ff8c8a11403 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:39.659603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799c0848-63ce-47b9-aca0-9ff8c8a11403 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:39.954737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] validate_networks() for [('c8f77053-7e4e-4df6-9803-f2259d58f7bb', None, None, None, None, None), (None, None, 'c43aaecd-6f25-402d-af31-5703ca8f952b', None, None, None), (None, None, '64e233cb-7770-4bcd-b9b7-a977e0aa27eb', None, None, None), ('7286daf1-dea3-4fd7-a6a9-602c4bedfd73', None, None, None, None, None), ('7286daf1-dea3-4fd7-a6a9-602c4bedfd73', None, None, None, None, None), ('6e01d89b-5c37-438c-9443-3de3e2699065', '10.2.2.100', None, None, None, None), ('6e01d89b-5c37-438c-9443-3de3e2699065', '10.2.2.200', None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:05:40.169771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-799c0848-63ce-47b9-aca0-9ff8c8a11403 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:40.188698 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-799c0848-63ce-47b9-aca0-9ff8c8a11403 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1556 microversion: 2.1 time: 0.553709 Oct 11 20:05:40.192173 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2379/4816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:39 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1556 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:40.202659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d388bd2-9af1-48d5-b8e8-e8af8b98c060 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:40.208465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0d388bd2-9af1-48d5-b8e8-e8af8b98c060 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:40.222625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d388bd2-9af1-48d5-b8e8-e8af8b98c060 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:40.223504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d388bd2-9af1-48d5-b8e8-e8af8b98c060 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:40.224287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d388bd2-9af1-48d5-b8e8-e8af8b98c060 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:40.225370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d388bd2-9af1-48d5-b8e8-e8af8b98c060 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:40.226026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d388bd2-9af1-48d5-b8e8-e8af8b98c060 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:40.226411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d388bd2-9af1-48d5-b8e8-e8af8b98c060 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:41.520460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0d388bd2-9af1-48d5-b8e8-e8af8b98c060 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:41.533625 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0d388bd2-9af1-48d5-b8e8-e8af8b98c060 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1390 microversion: 2.1 time: 1.340163 Oct 11 20:05:41.552888 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2380/4817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:40 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1390 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:41.565432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2fcac462-8877-4592-9b8c-a7579e2cf2b5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:41.565953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2fcac462-8877-4592-9b8c-a7579e2cf2b5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:41.582944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fcac462-8877-4592-9b8c-a7579e2cf2b5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:41.583265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fcac462-8877-4592-9b8c-a7579e2cf2b5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:41.583715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fcac462-8877-4592-9b8c-a7579e2cf2b5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:41.584436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fcac462-8877-4592-9b8c-a7579e2cf2b5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:41.584899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fcac462-8877-4592-9b8c-a7579e2cf2b5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:41.585325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fcac462-8877-4592-9b8c-a7579e2cf2b5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:42.203349 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2fcac462-8877-4592-9b8c-a7579e2cf2b5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.649144 Oct 11 20:05:42.204548 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2381/4818] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:05:41 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-interface => generated 284 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:42.210624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:42.212915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:42.229288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:42.236564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:42.237118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:42.238130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:42.241865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:42.242414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:42.321364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:42.977634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:43.221776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:43.241430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:43.247754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:43.254759 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc56cdf8-8987-495a-af52-12bc4054fe75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 1.044748 Oct 11 20:05:43.256327 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2382/4819] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:42 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:43.273668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:43.716450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1793483417", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "16959e66-e92d-4a43-9397-455514feff28"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:43.823142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] validate_networks() for [('16959e66-e92d-4a43-9397-455514feff28', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:05:44.241681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:45.178280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:05:45.178885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:05:45.179900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:05:45.180563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:05:45.181201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:05:45.207028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:45.209766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:45.211333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:45.225411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:45.226157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:45.226798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:45.283542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Getting quotas for project 34fcf8a0f434402c972354e38714837c. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:05:45.301195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Getting quotas for user f945d19d1e484547954ff814f4a8e0d1 and project 34fcf8a0f434402c972354e38714837c. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:05:45.350111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:05:45.353806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:05:45.468127 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a93c84b2-7739-4b1a-b9db-cfe074852d3b tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.209658 Oct 11 20:05:45.472164 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2383/4820] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:05:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:05:45.481651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5454211e-df7c-4fe5-82e9-e7b302587998 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:45.484034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5454211e-df7c-4fe5-82e9-e7b302587998 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:45.498105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5454211e-df7c-4fe5-82e9-e7b302587998 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:45.499538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5454211e-df7c-4fe5-82e9-e7b302587998 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:45.500203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5454211e-df7c-4fe5-82e9-e7b302587998 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:45.504631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5454211e-df7c-4fe5-82e9-e7b302587998 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:45.505454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5454211e-df7c-4fe5-82e9-e7b302587998 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:45.506238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5454211e-df7c-4fe5-82e9-e7b302587998 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:46.036626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5454211e-df7c-4fe5-82e9-e7b302587998 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:46.051645 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5454211e-df7c-4fe5-82e9-e7b302587998 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1390 microversion: 2.1 time: 0.578004 Oct 11 20:05:46.054842 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2384/4821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:45 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1390 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:46.071787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-9e67a602-21a3-4add-9945-dd891a692c63 req-2612323e-09d9-409f-a486-d704ec1ceafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a125d45-79ec-4fda-9601-334c311a9f7a", "name": "network-vif-plugged", "status": "completed", "tag": "e4e15471-dfd8-4f5d-be37-fdddaa52dfc8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:46.110619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9e67a602-21a3-4add-9945-dd891a692c63 req-2612323e-09d9-409f-a486-d704ec1ceafd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:46.111614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9e67a602-21a3-4add-9945-dd891a692c63 req-2612323e-09d9-409f-a486-d704ec1ceafd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:46.112145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9e67a602-21a3-4add-9945-dd891a692c63 req-2612323e-09d9-409f-a486-d704ec1ceafd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:46.159282 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-9e67a602-21a3-4add-9945-dd891a692c63 req-2612323e-09d9-409f-a486-d704ec1ceafd service nova] Creating event network-vif-plugged:e4e15471-dfd8-4f5d-be37-fdddaa52dfc8 for instance 7a125d45-79ec-4fda-9601-334c311a9f7a on n-h2-860864-3 Oct 11 20:05:46.175211 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-9e67a602-21a3-4add-9945-dd891a692c63 req-2612323e-09d9-409f-a486-d704ec1ceafd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118736 Oct 11 20:05:46.181241 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2385/4822] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:46.226486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-932cbc4e-509e-4562-8669-2b3d4847e554 req-7c4ce86f-58d9-4b02-ab0d-d2d145fd0441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:46.260117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-932cbc4e-509e-4562-8669-2b3d4847e554 req-7c4ce86f-58d9-4b02-ab0d-d2d145fd0441 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:46.262495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-932cbc4e-509e-4562-8669-2b3d4847e554 req-7c4ce86f-58d9-4b02-ab0d-d2d145fd0441 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:46.263368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-932cbc4e-509e-4562-8669-2b3d4847e554 req-7c4ce86f-58d9-4b02-ab0d-d2d145fd0441 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:46.304007 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-932cbc4e-509e-4562-8669-2b3d4847e554 req-7c4ce86f-58d9-4b02-ab0d-d2d145fd0441 service nova] Creating event network-changed:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h1-860864-3 Oct 11 20:05:46.319188 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-932cbc4e-509e-4562-8669-2b3d4847e554 req-7c4ce86f-58d9-4b02-ab0d-d2d145fd0441 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134057 Oct 11 20:05:46.323320 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2386/4823] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:46.336553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:46.339875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:46.367935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:46.368520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:46.369045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:46.369886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:46.370485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:46.371194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:47.462364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:47.480013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:47.491774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:47.493101 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a89dd475-7c3c-420a-af07-b373365a8d44 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 1.168035 Oct 11 20:05:47.496964 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2387/4824] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:46 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:47.525449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-701f0095-901b-4c7c-8c14-e939a4fd2f4d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:47.529877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-701f0095-901b-4c7c-8c14-e939a4fd2f4d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:47.555340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-701f0095-901b-4c7c-8c14-e939a4fd2f4d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:47.555982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-701f0095-901b-4c7c-8c14-e939a4fd2f4d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:47.556493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-701f0095-901b-4c7c-8c14-e939a4fd2f4d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:47.557435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-701f0095-901b-4c7c-8c14-e939a4fd2f4d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:47.557965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-701f0095-901b-4c7c-8c14-e939a4fd2f4d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:47.558477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-701f0095-901b-4c7c-8c14-e939a4fd2f4d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:47.802641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-701f0095-901b-4c7c-8c14-e939a4fd2f4d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:47.823194 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-701f0095-901b-4c7c-8c14-e939a4fd2f4d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1286 microversion: 2.1 time: 0.312819 Oct 11 20:05:47.824433 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2388/4825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:47 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1286 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:47.838880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f393bc2b-4a88-4ede-934c-87c41030a045 req-5d732ab8-1f41-44cc-8532-2be988a9950f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef13443d-3c56-4ec8-b242-fc39fa2f1a16", "tag": "4d2ad5fc-9d05-40e0-894f-e50bd481dd5a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:47.852404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f393bc2b-4a88-4ede-934c-87c41030a045 req-5d732ab8-1f41-44cc-8532-2be988a9950f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:47.867367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f393bc2b-4a88-4ede-934c-87c41030a045 req-5d732ab8-1f41-44cc-8532-2be988a9950f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:47.868165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f393bc2b-4a88-4ede-934c-87c41030a045 req-5d732ab8-1f41-44cc-8532-2be988a9950f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:47.881262 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f393bc2b-4a88-4ede-934c-87c41030a045 req-5d732ab8-1f41-44cc-8532-2be988a9950f service nova] Creating event network-changed:4d2ad5fc-9d05-40e0-894f-e50bd481dd5a for instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 on n-h2-860864-3 Oct 11 20:05:47.902320 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f393bc2b-4a88-4ede-934c-87c41030a045 req-5d732ab8-1f41-44cc-8532-2be988a9950f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076230 Oct 11 20:05:47.903622 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2389/4826] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:47.914359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-91d8faa5-abc4-4d1f-8595-fb2105bc93df tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:47.924138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-91d8faa5-abc4-4d1f-8595-fb2105bc93df tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:47.931155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91d8faa5-abc4-4d1f-8595-fb2105bc93df tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:47.931924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91d8faa5-abc4-4d1f-8595-fb2105bc93df tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:47.932590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91d8faa5-abc4-4d1f-8595-fb2105bc93df tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:47.934994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91d8faa5-abc4-4d1f-8595-fb2105bc93df tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:47.935676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91d8faa5-abc4-4d1f-8595-fb2105bc93df tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:47.947274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-91d8faa5-abc4-4d1f-8595-fb2105bc93df tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:48.633695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=85 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:49.852233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-91d8faa5-abc4-4d1f-8595-fb2105bc93df tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:49.861175 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-91d8faa5-abc4-4d1f-8595-fb2105bc93df tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1390 microversion: 2.1 time: 1.955391 Oct 11 20:05:49.875219 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2390/4827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:47 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1390 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:49.883313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:49.884198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:49.892740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:49.893490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:49.894090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:49.895231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:49.896007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:49.896593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:50.296326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:50.308435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:50.309908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:50.311201 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc513e5a-3d59-405c-adc1-3a41679d3686 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1728 microversion: 2.20 time: 0.434539 Oct 11 20:05:50.318082 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2391/4828] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:49 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1728 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:50.323348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3628fff1-e5ca-4c28-aad5-3fd1c7d76ceb tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:50.331667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3628fff1-e5ca-4c28-aad5-3fd1c7d76ceb tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:50.341707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3628fff1-e5ca-4c28-aad5-3fd1c7d76ceb tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:50.342376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3628fff1-e5ca-4c28-aad5-3fd1c7d76ceb tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:50.343072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3628fff1-e5ca-4c28-aad5-3fd1c7d76ceb tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:50.347494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3628fff1-e5ca-4c28-aad5-3fd1c7d76ceb tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:50.348124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3628fff1-e5ca-4c28-aad5-3fd1c7d76ceb tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:50.348664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3628fff1-e5ca-4c28-aad5-3fd1c7d76ceb tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:50.443152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:05:50.443684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:05:50.445197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:05:50.445625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:05:50.453930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:05:50.487236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:50.488995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:50.491756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:50.494550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:50.497259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:50.498633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:50.586883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Getting quotas for project e99631a5809b4f3ab73232f4940a6722. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:05:50.608653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Getting quotas for user 09e46a1f1cb2445588c04964d140825f and project e99631a5809b4f3ab73232f4940a6722. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:05:50.832974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3628fff1-e5ca-4c28-aad5-3fd1c7d76ceb tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:50.846374 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3628fff1-e5ca-4c28-aad5-3fd1c7d76ceb tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1316 microversion: 2.1 time: 0.524788 Oct 11 20:05:50.863307 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2392/4829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:50 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:50.890670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4702a801-84b2-4e53-9feb-872dfe97b1d2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:50.891812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4702a801-84b2-4e53-9feb-872dfe97b1d2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:50.898493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:50.910465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4702a801-84b2-4e53-9feb-872dfe97b1d2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:50.912212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4702a801-84b2-4e53-9feb-872dfe97b1d2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:50.913576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4702a801-84b2-4e53-9feb-872dfe97b1d2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:50.916033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4702a801-84b2-4e53-9feb-872dfe97b1d2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:50.917630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4702a801-84b2-4e53-9feb-872dfe97b1d2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:50.919257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4702a801-84b2-4e53-9feb-872dfe97b1d2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:50.941954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:05:50.945271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9f6316a2-9d7b-4441-8a93-a10e6e73b5e8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a17392e6-9d70-401b-90d8-8936c0df9e33',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c5b6d99-3df0-4bbe-8fbe-67dfa9b6713f',volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:05:51.314728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4702a801-84b2-4e53-9feb-872dfe97b1d2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:51.330618 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4702a801-84b2-4e53-9feb-872dfe97b1d2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1390 microversion: 2.1 time: 0.444672 Oct 11 20:05:51.336921 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2393/4830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:50 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1390 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:51.348659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-81174907-86da-47d0-ac7d-e1c4345c2a72 req-f3ffa347-fe5b-4b67-b44c-5ddac98183b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273b2877-d6d3-4848-9ec4-28752c52ef93", "tag": "e8351252-c592-4cd1-a265-69c10d498754"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:51.372258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-81174907-86da-47d0-ac7d-e1c4345c2a72 req-f3ffa347-fe5b-4b67-b44c-5ddac98183b3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:51.375462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-81174907-86da-47d0-ac7d-e1c4345c2a72 req-f3ffa347-fe5b-4b67-b44c-5ddac98183b3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:51.377172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-81174907-86da-47d0-ac7d-e1c4345c2a72 req-f3ffa347-fe5b-4b67-b44c-5ddac98183b3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:51.410389 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-81174907-86da-47d0-ac7d-e1c4345c2a72 req-f3ffa347-fe5b-4b67-b44c-5ddac98183b3 service nova] Creating event network-changed:e8351252-c592-4cd1-a265-69c10d498754 for instance 273b2877-d6d3-4848-9ec4-28752c52ef93 on n-h1-860864-3 Oct 11 20:05:51.423607 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-81174907-86da-47d0-ac7d-e1c4345c2a72 req-f3ffa347-fe5b-4b67-b44c-5ddac98183b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084083 Oct 11 20:05:51.427395 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2394/4831] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:51.441550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:51.443794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:51.461360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:51.463366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:51.464471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:51.467557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:51.468163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:51.469731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:51.596184 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c4cc8623-2a9a-4f29-bb67-196b2e34a659 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 11.969418 Oct 11 20:05:51.596904 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2438/4832] 10.222.0.27 () {62 vars in 1189 bytes} [Tue Oct 11 20:05:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 11973 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 20:05:51.615639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-edcd126e-bd17-4357-8b7b-66557c7e0388 req-914ba522-6477-4593-abc4-ed2921ae569e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "name": "network-vif-plugged", "status": "completed", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:51.656601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-edcd126e-bd17-4357-8b7b-66557c7e0388 req-914ba522-6477-4593-abc4-ed2921ae569e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:51.660258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-edcd126e-bd17-4357-8b7b-66557c7e0388 req-914ba522-6477-4593-abc4-ed2921ae569e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:51.660910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-edcd126e-bd17-4357-8b7b-66557c7e0388 req-914ba522-6477-4593-abc4-ed2921ae569e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:51.686683 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-edcd126e-bd17-4357-8b7b-66557c7e0388 req-914ba522-6477-4593-abc4-ed2921ae569e service nova] Creating event network-vif-plugged:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h1-860864-3 Oct 11 20:05:51.693166 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-edcd126e-bd17-4357-8b7b-66557c7e0388 req-914ba522-6477-4593-abc4-ed2921ae569e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094943 Oct 11 20:05:51.694510 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2439/4833] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:05:51.709269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-19a908e3-d6b4-4723-9f15-4ba00f72e16f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:51.711546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-19a908e3-d6b4-4723-9f15-4ba00f72e16f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:51.903458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-19a908e3-d6b4-4723-9f15-4ba00f72e16f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:51.916891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:51.918390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-19a908e3-d6b4-4723-9f15-4ba00f72e16f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:51.924012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-19a908e3-d6b4-4723-9f15-4ba00f72e16f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:51.925286 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-19a908e3-d6b4-4723-9f15-4ba00f72e16f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1286 microversion: 2.32 time: 0.222284 Oct 11 20:05:51.925855 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2440/4834] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:51 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1286 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:51.938609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-081ddc29-0e23-4270-877c-05efa2064ba8 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:51.940645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-081ddc29-0e23-4270-877c-05efa2064ba8 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:51.948330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:51.949820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:51.954220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0bdaffe3-38a7-476c-8a97-02129e714bcc tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1715 microversion: 2.20 time: 0.525254 Oct 11 20:05:51.957682 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2395/4835] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:51 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1715 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:51.959038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ddc29-0e23-4270-877c-05efa2064ba8 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:51.959916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ddc29-0e23-4270-877c-05efa2064ba8 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:51.960796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ddc29-0e23-4270-877c-05efa2064ba8 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:51.961858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ddc29-0e23-4270-877c-05efa2064ba8 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:51.962569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ddc29-0e23-4270-877c-05efa2064ba8 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:51.963741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-081ddc29-0e23-4270-877c-05efa2064ba8 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:52.210196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-081ddc29-0e23-4270-877c-05efa2064ba8 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:52.228166 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-081ddc29-0e23-4270-877c-05efa2064ba8 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1316 microversion: 2.1 time: 0.299108 Oct 11 20:05:52.229532 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2441/4836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:51 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:52.363484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a2c0aea-fe6f-4d36-b8ed-4fd19a6663f7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:52.364486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9a2c0aea-fe6f-4d36-b8ed-4fd19a6663f7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:52.385253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a2c0aea-fe6f-4d36-b8ed-4fd19a6663f7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:52.385795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a2c0aea-fe6f-4d36-b8ed-4fd19a6663f7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:52.386564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a2c0aea-fe6f-4d36-b8ed-4fd19a6663f7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:52.387476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a2c0aea-fe6f-4d36-b8ed-4fd19a6663f7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:52.387997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a2c0aea-fe6f-4d36-b8ed-4fd19a6663f7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:52.388623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a2c0aea-fe6f-4d36-b8ed-4fd19a6663f7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:52.599407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9a2c0aea-fe6f-4d36-b8ed-4fd19a6663f7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:52.611853 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a2c0aea-fe6f-4d36-b8ed-4fd19a6663f7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1390 microversion: 2.1 time: 0.252199 Oct 11 20:05:52.615207 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2396/4837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:52 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1390 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:52.952113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:52.953348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:52.968795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:52.972166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:52.973783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:52.975611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:52.978928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:52.980837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:53.177519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:53.196610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:53.198710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:53.203336 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f9d2ba4f-3583-4d08-951b-c56176cf3523 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1520 microversion: 2.32 time: 0.257034 Oct 11 20:05:53.205217 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2442/4838] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:52 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:53.252353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-de00f39c-d305-4b43-937a-198b5a78b9d2 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:53.253091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-de00f39c-d305-4b43-937a-198b5a78b9d2 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:53.263274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de00f39c-d305-4b43-937a-198b5a78b9d2 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:53.271073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de00f39c-d305-4b43-937a-198b5a78b9d2 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:53.271583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de00f39c-d305-4b43-937a-198b5a78b9d2 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:53.274497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de00f39c-d305-4b43-937a-198b5a78b9d2 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:53.275090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de00f39c-d305-4b43-937a-198b5a78b9d2 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:53.276849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de00f39c-d305-4b43-937a-198b5a78b9d2 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:53.453594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-de00f39c-d305-4b43-937a-198b5a78b9d2 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:53.467301 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-de00f39c-d305-4b43-937a-198b5a78b9d2 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1316 microversion: 2.1 time: 0.219487 Oct 11 20:05:53.467991 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2397/4839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:53 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:53.650158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce7468ed-493f-4e1f-8891-53f4a10e354f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:53.651048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ce7468ed-493f-4e1f-8891-53f4a10e354f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:53.662921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce7468ed-493f-4e1f-8891-53f4a10e354f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:53.663417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce7468ed-493f-4e1f-8891-53f4a10e354f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:53.663849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce7468ed-493f-4e1f-8891-53f4a10e354f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:53.667894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce7468ed-493f-4e1f-8891-53f4a10e354f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:53.668387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce7468ed-493f-4e1f-8891-53f4a10e354f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:53.668820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce7468ed-493f-4e1f-8891-53f4a10e354f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:53.953846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ce7468ed-493f-4e1f-8891-53f4a10e354f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:53.964394 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ce7468ed-493f-4e1f-8891-53f4a10e354f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1390 microversion: 2.1 time: 0.325602 Oct 11 20:05:53.975265 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2443/4840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:53 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1390 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:54.256440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:54.261396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:54.292671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:54.307789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:54.307789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:54.310816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:54.311637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:54.312301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:54.428094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:54.442302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:54.443781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:54.445196 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4ef16612-42b3-4493-8f09-d60012a26ac1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1594 microversion: 2.32 time: 0.212423 Oct 11 20:05:54.445763 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2398/4841] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:54 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1594 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:54.491646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1a63b75c-8f46-4ff7-b708-9877b822634f tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:54.492214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1a63b75c-8f46-4ff7-b708-9877b822634f tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:54.504712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a63b75c-8f46-4ff7-b708-9877b822634f tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:54.505210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a63b75c-8f46-4ff7-b708-9877b822634f tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:54.505642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a63b75c-8f46-4ff7-b708-9877b822634f tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:54.506343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a63b75c-8f46-4ff7-b708-9877b822634f tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:54.506822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a63b75c-8f46-4ff7-b708-9877b822634f tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:54.507243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a63b75c-8f46-4ff7-b708-9877b822634f tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:54.802719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1a63b75c-8f46-4ff7-b708-9877b822634f tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:54.813188 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1a63b75c-8f46-4ff7-b708-9877b822634f tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1316 microversion: 2.1 time: 0.324682 Oct 11 20:05:54.816189 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2444/4842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:54 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:55.002013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-18236baf-d012-47f9-b726-ac7a3f57895b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:55.004056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-18236baf-d012-47f9-b726-ac7a3f57895b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:55.023969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18236baf-d012-47f9-b726-ac7a3f57895b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:55.024472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18236baf-d012-47f9-b726-ac7a3f57895b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:55.024914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18236baf-d012-47f9-b726-ac7a3f57895b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:55.033840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18236baf-d012-47f9-b726-ac7a3f57895b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:55.034435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18236baf-d012-47f9-b726-ac7a3f57895b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:55.036549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18236baf-d012-47f9-b726-ac7a3f57895b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:55.254316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:55.310235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:05:55.476093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:55.478579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:55.485820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:55.486811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:55.487454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:55.489936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:55.490604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:55.491240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:55.633381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-18236baf-d012-47f9-b726-ac7a3f57895b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:55.652107 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-18236baf-d012-47f9-b726-ac7a3f57895b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1563 microversion: 2.1 time: 0.648202 Oct 11 20:05:55.652990 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2399/4843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:54 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1563 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:55.676645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-213c2b13-32f5-45ea-9614-84969854c944 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:55.677480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-213c2b13-32f5-45ea-9614-84969854c944 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:55.684858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-213c2b13-32f5-45ea-9614-84969854c944 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:55.685836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-213c2b13-32f5-45ea-9614-84969854c944 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:55.686489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-213c2b13-32f5-45ea-9614-84969854c944 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:55.687775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-213c2b13-32f5-45ea-9614-84969854c944 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:55.688416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-213c2b13-32f5-45ea-9614-84969854c944 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:55.689013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-213c2b13-32f5-45ea-9614-84969854c944 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:55.736913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:55.754287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:55.756331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:55.759576 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-08501944-17b4-4930-a7e1-4c9944d8d232 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1594 microversion: 2.32 time: 0.287416 Oct 11 20:05:55.766094 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2445/4844] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:55 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1594 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:05:55.837071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-880633d7-b0cf-4d58-8c76-55ff047bd442 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:55.838701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-880633d7-b0cf-4d58-8c76-55ff047bd442 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:55.850444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-880633d7-b0cf-4d58-8c76-55ff047bd442 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:55.854857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-880633d7-b0cf-4d58-8c76-55ff047bd442 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:55.855887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-880633d7-b0cf-4d58-8c76-55ff047bd442 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:55.856819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-880633d7-b0cf-4d58-8c76-55ff047bd442 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:55.857491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-880633d7-b0cf-4d58-8c76-55ff047bd442 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:55.858145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-880633d7-b0cf-4d58-8c76-55ff047bd442 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:56.078970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-213c2b13-32f5-45ea-9614-84969854c944 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:56.103766 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-213c2b13-32f5-45ea-9614-84969854c944 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1563 microversion: 2.1 time: 0.429821 Oct 11 20:05:56.107785 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2400/4845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:55 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1563 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:05:56.205179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-880633d7-b0cf-4d58-8c76-55ff047bd442 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:56.214467 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-880633d7-b0cf-4d58-8c76-55ff047bd442 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1316 microversion: 2.1 time: 0.381791 Oct 11 20:05:56.230183 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2446/4846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:55 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:56.792403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:56.793127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:56.805229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:56.811101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:56.812124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:56.815926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:56.816748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:56.817394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:57.251617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d348c3e4-9919-4fb8-9141-c86fcbcb70b4 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:57.253459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d348c3e4-9919-4fb8-9141-c86fcbcb70b4 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:57.272326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d348c3e4-9919-4fb8-9141-c86fcbcb70b4 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:57.275587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d348c3e4-9919-4fb8-9141-c86fcbcb70b4 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:57.280149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d348c3e4-9919-4fb8-9141-c86fcbcb70b4 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:57.281728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d348c3e4-9919-4fb8-9141-c86fcbcb70b4 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:57.282374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d348c3e4-9919-4fb8-9141-c86fcbcb70b4 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:57.285460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d348c3e4-9919-4fb8-9141-c86fcbcb70b4 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:57.313864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:57.336641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:57.355412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:57.357192 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1db3868d-4d4d-4e62-8365-cb4fd9c09613 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1662 microversion: 2.32 time: 0.569937 Oct 11 20:05:57.361537 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2401/4847] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:56 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1662 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:58.001093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d348c3e4-9919-4fb8-9141-c86fcbcb70b4 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:58.017041 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d348c3e4-9919-4fb8-9141-c86fcbcb70b4 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1316 microversion: 2.1 time: 0.770465 Oct 11 20:05:58.030764 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2447/4848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:57 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1316 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:05:58.209829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-9b7b30b3-a11e-4bac-be3a-e272fceea013 req-fcd8581e-c0b5-4e7c-9d88-6c1fadfd611e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273b2877-d6d3-4848-9ec4-28752c52ef93", "name": "network-vif-plugged", "status": "completed", "tag": "e8351252-c592-4cd1-a265-69c10d498754"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:05:58.237751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9b7b30b3-a11e-4bac-be3a-e272fceea013 req-fcd8581e-c0b5-4e7c-9d88-6c1fadfd611e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:58.238489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9b7b30b3-a11e-4bac-be3a-e272fceea013 req-fcd8581e-c0b5-4e7c-9d88-6c1fadfd611e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:58.240744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9b7b30b3-a11e-4bac-be3a-e272fceea013 req-fcd8581e-c0b5-4e7c-9d88-6c1fadfd611e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:58.278234 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-9b7b30b3-a11e-4bac-be3a-e272fceea013 req-fcd8581e-c0b5-4e7c-9d88-6c1fadfd611e service nova] Creating event network-vif-plugged:e8351252-c592-4cd1-a265-69c10d498754 for instance 273b2877-d6d3-4848-9ec4-28752c52ef93 on n-h1-860864-3 Oct 11 20:05:58.289447 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-9b7b30b3-a11e-4bac-be3a-e272fceea013 req-fcd8581e-c0b5-4e7c-9d88-6c1fadfd611e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086687 Oct 11 20:05:58.290898 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2402/4849] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:05:58.390157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:58.391465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:58.406873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:58.407637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:58.408243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:58.409968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:58.413114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:58.413759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:59.042367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-92c872a0-c1a9-4924-998f-483d433e4e78 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:05:59.043853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-92c872a0-c1a9-4924-998f-483d433e4e78 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:05:59.052337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:59.074092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92c872a0-c1a9-4924-998f-483d433e4e78 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:59.077618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92c872a0-c1a9-4924-998f-483d433e4e78 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:59.083923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92c872a0-c1a9-4924-998f-483d433e4e78 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:59.085366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:59.086271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92c872a0-c1a9-4924-998f-483d433e4e78 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:05:59.088102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92c872a0-c1a9-4924-998f-483d433e4e78 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:05:59.089845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:05:59.091378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92c872a0-c1a9-4924-998f-483d433e4e78 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:05:59.100333 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-77e5a3ec-b3c4-455b-a11e-69ecf7fb0a05 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1662 microversion: 2.32 time: 0.714741 Oct 11 20:05:59.106777 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2448/4850] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:05:58 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1662 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:05:59.109377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:00.137947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:00.140419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:00.161557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:00.162988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:00.164347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:00.167238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:00.169509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:00.170950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:00.393976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-92c872a0-c1a9-4924-998f-483d433e4e78 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:00.402499 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-92c872a0-c1a9-4924-998f-483d433e4e78 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1316 microversion: 2.1 time: 1.364863 Oct 11 20:06:00.409464 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2403/4851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:05:59 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1316 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:06:00.527199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:01.191659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:01.215213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:01.218411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:01.219974 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8554b029-df71-42a1-919d-6e10c466ab92 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1662 microversion: 2.32 time: 1.088074 Oct 11 20:06:01.220807 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2449/4852] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:00 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1662 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:01.434381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fb81df4c-d910-494e-8cc5-f60600670802 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:01.436465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fb81df4c-d910-494e-8cc5-f60600670802 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:01.462906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb81df4c-d910-494e-8cc5-f60600670802 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:01.471621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb81df4c-d910-494e-8cc5-f60600670802 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:01.472369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb81df4c-d910-494e-8cc5-f60600670802 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:01.473292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb81df4c-d910-494e-8cc5-f60600670802 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:01.477410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb81df4c-d910-494e-8cc5-f60600670802 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:01.478377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb81df4c-d910-494e-8cc5-f60600670802 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:01.908407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:02.088031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fb81df4c-d910-494e-8cc5-f60600670802 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:02.102877 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fb81df4c-d910-494e-8cc5-f60600670802 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1503 microversion: 2.1 time: 0.670985 Oct 11 20:06:02.106276 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2404/4853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:01 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1503 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:02.134592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6f1eeb3-e5a8-4273-a3ab-06470ec509d9 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:02.135031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d6f1eeb3-e5a8-4273-a3ab-06470ec509d9 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:02.156051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f1eeb3-e5a8-4273-a3ab-06470ec509d9 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:02.161976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f1eeb3-e5a8-4273-a3ab-06470ec509d9 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:02.162629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f1eeb3-e5a8-4273-a3ab-06470ec509d9 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:02.163462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f1eeb3-e5a8-4273-a3ab-06470ec509d9 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:02.164513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f1eeb3-e5a8-4273-a3ab-06470ec509d9 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:02.165056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f1eeb3-e5a8-4273-a3ab-06470ec509d9 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:02.340860 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d6f1eeb3-e5a8-4273-a3ab-06470ec509d9 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "DELETE /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.212670 Oct 11 20:06:02.343047 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2405/4854] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Oct 11 20:06:02 2022] DELETE /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93/os-server-password => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:06:02.359413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:02.360574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:02.375490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:02.376183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:02.377036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:02.377935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:02.378766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:02.381570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:02.408869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-22be17d8-d0fb-418a-aec1-60d7312a9a4d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Action: 'create', calling method: .version_select at 0x7f83ccb46f70>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1434184970", "policies": ["affinity"]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:02.437826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-22be17d8-d0fb-418a-aec1-60d7312a9a4d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:02.490637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-22be17d8-d0fb-418a-aec1-60d7312a9a4d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:02.598127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-22be17d8-d0fb-418a-aec1-60d7312a9a4d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:02.607735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-22be17d8-d0fb-418a-aec1-60d7312a9a4d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:02.657577 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-22be17d8-d0fb-418a-aec1-60d7312a9a4d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.759326 Oct 11 20:06:02.666778 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2450/4855] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 11 20:06:01 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:02.673096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f06337cf-fdcf-4557-8fdb-ee2d383d2270 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:02.673604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f06337cf-fdcf-4557-8fdb-ee2d383d2270 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:02.698469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f06337cf-fdcf-4557-8fdb-ee2d383d2270 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:02.700934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f06337cf-fdcf-4557-8fdb-ee2d383d2270 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:02.702437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f06337cf-fdcf-4557-8fdb-ee2d383d2270 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:02.703786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f06337cf-fdcf-4557-8fdb-ee2d383d2270 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:02.704271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f06337cf-fdcf-4557-8fdb-ee2d383d2270 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:02.704714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f06337cf-fdcf-4557-8fdb-ee2d383d2270 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:02.757090 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f06337cf-fdcf-4557-8fdb-ee2d383d2270 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.088948 Oct 11 20:06:02.757994 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2451/4856] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 11 20:06:02 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93/os-server-password => generated 16 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:06:02.765409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d7add5f8-bbed-45e4-b989-3efad4629d94 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Action: 'create', calling method: .version_select at 0x7f83ccb46ca0>, body: {"server_group": {"name": "tempest-server-group-843814050", "policies": ["affinity"]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:02.791382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d7add5f8-bbed-45e4-b989-3efad4629d94 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:02.799086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d7add5f8-bbed-45e4-b989-3efad4629d94 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:02.871563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d7add5f8-bbed-45e4-b989-3efad4629d94 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:02.883471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-d7add5f8-bbed-45e4-b989-3efad4629d94 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:02.893969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:02.898254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:02.905383 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d7add5f8-bbed-45e4-b989-3efad4629d94 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.145747 Oct 11 20:06:02.906962 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2452/4857] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 11 20:06:02 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:02.908941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:02.910332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:02.912867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a5cfb03e-cbdb-4de6-801c-d6a19eb2ad8d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:02.913562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a5cfb03e-cbdb-4de6-801c-d6a19eb2ad8d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:02.919956 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b2bd299-1163-425f-afe5-70937f049c59 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1709 microversion: 2.32 time: 0.570982 Oct 11 20:06:02.923061 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2406/4858] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:02 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1709 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:02.931372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f216e33c-a957-4003-8813-0c1c23ac7a76 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Action: 'create', calling method: .version_select at 0x7f83c70ddc10>, body: {"server_group": {"name": "tempest-server-group-843814050", "policies": ["affinity"]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:02.938078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5cfb03e-cbdb-4de6-801c-d6a19eb2ad8d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:02.943231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5cfb03e-cbdb-4de6-801c-d6a19eb2ad8d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:02.944234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5cfb03e-cbdb-4de6-801c-d6a19eb2ad8d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:02.945127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5cfb03e-cbdb-4de6-801c-d6a19eb2ad8d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:02.945747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5cfb03e-cbdb-4de6-801c-d6a19eb2ad8d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:02.946492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5cfb03e-cbdb-4de6-801c-d6a19eb2ad8d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:02.974874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f216e33c-a957-4003-8813-0c1c23ac7a76 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:02.989499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f216e33c-a957-4003-8813-0c1c23ac7a76 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:03.027501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a5cfb03e-cbdb-4de6-801c-d6a19eb2ad8d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:06:03.114227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f216e33c-a957-4003-8813-0c1c23ac7a76 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:03.133911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-f216e33c-a957-4003-8813-0c1c23ac7a76 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:03.174677 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a5cfb03e-cbdb-4de6-801c-d6a19eb2ad8d tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "DELETE /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 204 len: 0 microversion: 2.1 time: 0.265957 Oct 11 20:06:03.175546 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f216e33c-a957-4003-8813-0c1c23ac7a76 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.250825 Oct 11 20:06:03.176016 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2453/4859] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:06:02 2022] DELETE /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:06:03.177473 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2407/4860] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 11 20:06:02 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:03.185761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-648379b1-a279-442b-9ada-037f1f65d146 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:03.186475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-648379b1-a279-442b-9ada-037f1f65d146 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:03.193445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648379b1-a279-442b-9ada-037f1f65d146 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:03.196658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648379b1-a279-442b-9ada-037f1f65d146 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:03.197378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648379b1-a279-442b-9ada-037f1f65d146 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:03.198644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648379b1-a279-442b-9ada-037f1f65d146 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:03.199389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648379b1-a279-442b-9ada-037f1f65d146 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:03.200050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648379b1-a279-442b-9ada-037f1f65d146 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:03.202514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9cc71be2-97f5-4922-8421-df52786dd4ec tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:03.292566 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9cc71be2-97f5-4922-8421-df52786dd4ec tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/c51336d7-0a95-46b6-aaa1-52853fc1f3c9" status: 204 len: 0 microversion: 2.1 time: 0.100492 Oct 11 20:06:03.293426 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2408/4861] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 20:06:03 2022] DELETE /compute/v2.1/os-server-groups/c51336d7-0a95-46b6-aaa1-52853fc1f3c9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:06:03.302064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7240c64b-2fda-448e-9285-9b0009d16705 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:03.328389 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7240c64b-2fda-448e-9285-9b0009d16705 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.030110 Oct 11 20:06:03.330454 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2409/4862] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 20:06:03 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:06:03.353310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a6a6384-032d-4c2d-baab-d1189492b5d7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:03.410417 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a6a6384-032d-4c2d-baab-d1189492b5d7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/605f6d1e-3d45-4f9a-9903-24aed75cf711" status: 204 len: 0 microversion: 2.1 time: 0.063011 Oct 11 20:06:03.414557 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2410/4863] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 20:06:03 2022] DELETE /compute/v2.1/os-server-groups/605f6d1e-3d45-4f9a-9903-24aed75cf711 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:06:03.430713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1c35e892-1654-4181-b7f9-98246706dcbf tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:03.464291 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1c35e892-1654-4181-b7f9-98246706dcbf tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.042236 Oct 11 20:06:03.465507 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2411/4864] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 20:06:03 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:06:03.478797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1131b8ec-e0e2-4b0e-a1ad-c731fb519344 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Action: 'create', calling method: .version_select at 0x7f83c737a670>, body: {"server_group": {"name": "tempest-server-group-1779688461", "policies": ["affinity"]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:03.550799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-1131b8ec-e0e2-4b0e-a1ad-c731fb519344 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:03.567056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-1131b8ec-e0e2-4b0e-a1ad-c731fb519344 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:03.730366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-1131b8ec-e0e2-4b0e-a1ad-c731fb519344 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:03.770160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-648379b1-a279-442b-9ada-037f1f65d146 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:03.772093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-1131b8ec-e0e2-4b0e-a1ad-c731fb519344 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:03.779866 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-648379b1-a279-442b-9ada-037f1f65d146 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1509 microversion: 2.1 time: 0.599468 Oct 11 20:06:03.785081 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2454/4865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:03 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1509 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:03.815405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:03.830062 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1131b8ec-e0e2-4b0e-a1ad-c731fb519344 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.355839 Oct 11 20:06:03.831495 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2412/4866] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 11 20:06:03 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:03.842085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f88636dc-6dff-40ce-bf3a-04887a2e1961 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:03.894059 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f88636dc-6dff-40ce-bf3a-04887a2e1961 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/75763706-fcff-470d-a2b0-c7b8dcee91b2" status: 204 len: 0 microversion: 2.1 time: 0.055969 Oct 11 20:06:03.894794 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2455/4867] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 20:06:03 2022] DELETE /compute/v2.1/os-server-groups/75763706-fcff-470d-a2b0-c7b8dcee91b2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:06:03.903122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b75859b0-c060-4287-9f17-2074f06df453 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:03.933749 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b75859b0-c060-4287-9f17-2074f06df453 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034538 Oct 11 20:06:03.934785 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2413/4868] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 20:06:03 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:03.953678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-effe4c5f-3a9f-460a-b447-89345f3f4c1f tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Action: 'create', calling method: .version_select at 0x7f83d0835550>, body: {"server_group": {"name": "tempest-server-group-430182792", "policies": ["anti-affinity"]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:03.980651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:03.984173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:04.028610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:04.030853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:04.031457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:04.035515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:04.035983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:04.036414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:04.064399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-effe4c5f-3a9f-460a-b447-89345f3f4c1f tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:04.086378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-effe4c5f-3a9f-460a-b447-89345f3f4c1f tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:04.232469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-effe4c5f-3a9f-460a-b447-89345f3f4c1f tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:04.259628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-effe4c5f-3a9f-460a-b447-89345f3f4c1f tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_groups'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:04.285319 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-effe4c5f-3a9f-460a-b447-89345f3f4c1f tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.342179 Oct 11 20:06:04.288154 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2456/4869] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 11 20:06:03 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:06:04.306005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ac763705-0c34-4816-9c8b-ef4ed7f06496 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:04.363474 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ac763705-0c34-4816-9c8b-ef4ed7f06496 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/c5473736-c792-4d83-9617-196c5ec5fe6c" status: 204 len: 0 microversion: 2.1 time: 0.065562 Oct 11 20:06:04.364171 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2457/4870] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 20:06:04 2022] DELETE /compute/v2.1/os-server-groups/c5473736-c792-4d83-9617-196c5ec5fe6c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:06:04.373485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-924c0494-07b1-4bc1-aea2-5a1c9c0b86b2 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:04.414784 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-924c0494-07b1-4bc1-aea2-5a1c9c0b86b2 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.046290 Oct 11 20:06:04.415914 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2458/4871] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 20:06:04 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:04.624450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-44709801", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "daccdefb-b986-41e2-ac29-102ecba476da"}]}, "os:scheduler_hints": {"group": "df0c4100-a27b-4706-80eb-319fbe5bb554"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:04.746928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] validate_networks() for [('daccdefb-b986-41e2-ac29-102ecba476da', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:06:04.910691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:04.922541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:04.925098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:04.928161 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4be38ea5-3fe5-4731-8f04-0d1e8ef93292 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1756 microversion: 2.32 time: 0.967396 Oct 11 20:06:04.952621 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2414/4872] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:03 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1756 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:04.960697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-83ff0df9-6528-4472-a19b-eac3410b6d00 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:04.964941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-83ff0df9-6528-4472-a19b-eac3410b6d00 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:04.985020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83ff0df9-6528-4472-a19b-eac3410b6d00 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:04.985952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83ff0df9-6528-4472-a19b-eac3410b6d00 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:04.986795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83ff0df9-6528-4472-a19b-eac3410b6d00 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:04.988063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83ff0df9-6528-4472-a19b-eac3410b6d00 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:04.988745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83ff0df9-6528-4472-a19b-eac3410b6d00 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:04.989411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-83ff0df9-6528-4472-a19b-eac3410b6d00 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:06.176890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-83ff0df9-6528-4472-a19b-eac3410b6d00 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:06.188619 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-83ff0df9-6528-4472-a19b-eac3410b6d00 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1509 microversion: 2.1 time: 1.233665 Oct 11 20:06:06.191078 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2415/4873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:04 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1509 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:06.196875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:06.206673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:06.233196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:06.233709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:06.234150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:06.242049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:06.242652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:06.243166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:07.762106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:07.777427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:07.782011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:07.786937 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-71d80934-0db4-414c-92cc-3cda51844ac5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1756 microversion: 2.32 time: 1.594563 Oct 11 20:06:07.789118 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2416/4874] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:06 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1756 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:07.794124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5bc6c2d7-0e89-45e5-9f41-2057a59ec8f6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:07.795580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5bc6c2d7-0e89-45e5-9f41-2057a59ec8f6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:07.803442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bc6c2d7-0e89-45e5-9f41-2057a59ec8f6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:07.804396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bc6c2d7-0e89-45e5-9f41-2057a59ec8f6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:07.804999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bc6c2d7-0e89-45e5-9f41-2057a59ec8f6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:07.805916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bc6c2d7-0e89-45e5-9f41-2057a59ec8f6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:07.806685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bc6c2d7-0e89-45e5-9f41-2057a59ec8f6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:07.807271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bc6c2d7-0e89-45e5-9f41-2057a59ec8f6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:08.308875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:06:08.310443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:06:08.311223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:06:08.312462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:06:08.313290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:06:08.349214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5bc6c2d7-0e89-45e5-9f41-2057a59ec8f6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:08.360297 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5bc6c2d7-0e89-45e5-9f41-2057a59ec8f6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1563 microversion: 2.1 time: 0.569896 Oct 11 20:06:08.365446 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2417/4875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:07 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1563 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:08.405781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:08.406283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:08.410897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-44d6d535-dedf-4d45-95fd-7b45089d3121 req-d7d17210-f196-415d-98b4-41f2fc28d1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:08.417223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:08.419426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:08.423556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:08.424009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:08.456097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-44d6d535-dedf-4d45-95fd-7b45089d3121 req-d7d17210-f196-415d-98b4-41f2fc28d1b8 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:08.456604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-44d6d535-dedf-4d45-95fd-7b45089d3121 req-d7d17210-f196-415d-98b4-41f2fc28d1b8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:08.457039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-44d6d535-dedf-4d45-95fd-7b45089d3121 req-d7d17210-f196-415d-98b4-41f2fc28d1b8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:08.521357 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-44d6d535-dedf-4d45-95fd-7b45089d3121 req-d7d17210-f196-415d-98b4-41f2fc28d1b8 service nova] Creating event network-changed:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h1-860864-3 Oct 11 20:06:08.521595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:08.531115 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-44d6d535-dedf-4d45-95fd-7b45089d3121 req-d7d17210-f196-415d-98b4-41f2fc28d1b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148685 Oct 11 20:06:08.532398 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2418/4876] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:08.538359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:08.580543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:08.586013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:08.588293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:06:08.595481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:06:08.599091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:08.600020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:08.601479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:08.603396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:08.627635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:08.628142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:08.715556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126956) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 11 20:06:08.795374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_group_members'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:08.825222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:08.834324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:08.834904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:08.837282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lazy-loading 'fault' on Instance uuid 273b2877-d6d3-4848-9ec4-28752c52ef93 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:06:08.859932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_group_members'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:08.974658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f945d19d1e484547954ff814f4a8e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcf8a0f434402c972354e38714837c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:08.979865 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5e6223fd-2409-4e1f-9180-6fe5958f97ce tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 200 len: 1306 microversion: 2.1 time: 0.445877 Oct 11 20:06:08.987341 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2419/4877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:08 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 1306 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:08.992671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:08.993219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_group_members'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:08.993357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:09.002033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Getting quotas for user 97aff8e7683346c9987ce9c49a12a50a and project 79ab9b8dd9ee49b99ef75af3c106c9d9. Resources: {'server_group_members'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:09.006936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:09.007440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:09.007878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:09.008586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:09.016335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:09.016782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:09.027070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:09.065019 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7d788b00-8aed-4f0c-bbbb-91e97882f7da tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.449292 Oct 11 20:06:09.066049 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2459/4878] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:06:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 4451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 20:06:09.094309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eadf5df6-2fab-42db-bfb3-f28fb78270fc tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:09.098056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eadf5df6-2fab-42db-bfb3-f28fb78270fc tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:09.295609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eadf5df6-2fab-42db-bfb3-f28fb78270fc tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:09.305106 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eadf5df6-2fab-42db-bfb3-f28fb78270fc tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1211 microversion: 2.1 time: 0.228267 Oct 11 20:06:09.306320 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2460/4879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:09 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1211 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:09.627494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:09.649086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:09.650991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:09.659839 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-10e1092b-20b6-4fa4-b4fa-33a14e0d1c12 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1803 microversion: 2.32 time: 0.668664 Oct 11 20:06:09.661313 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2420/4880] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:08 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1803 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:10.005614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:10.006962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] [instance: 273b2877-d6d3-4848-9ec4-28752c52ef93] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:10.017414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:10.024364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:10.025115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:10.026054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:10.026801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:10.027464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:10.047799 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] HTTP exception thrown: Instance 273b2877-d6d3-4848-9ec4-28752c52ef93 could not be found. Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Request method failure captured: Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 HTTP/1.1 Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcyUL7t0J4D1DxPbzWjZ_g96Qm_x_OE4fydQLUWKYHciGBL89qucCXf7jVyGj-FrhEQ8FkKcI__Ps9dHEuMAHNvIrsg-Nd5ZVtzA_pL683ZjQSb7iUP-GQfZIdFCTsq1Lvb6jOR8PYmkY9idGZsPk9T0Vatg5pZWgyQROfuFy7UEdkY Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 34fcf8a0f434402c972354e38714837c Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerPasswordTestJSON-1446005047 Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34fcf8a0f434402c972354e38714837c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34fcf8a0f434402c972354e38714837c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34fcf8a0f434402c972354e38714837c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34fcf8a0f434402c972354e38714837c"}]}] Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerPasswordTestJSON-1446005047 Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 34fcf8a0f434402c972354e38714837c Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1446005047 Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerPasswordTestJSON-1446005047-project Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: f945d19d1e484547954ff814f4a8e0d1 Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerPasswordTestJSON-1446005047-project Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 273b2877-d6d3-4848-9ec4-28752c52ef93 could not be found. Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '273b2877-d6d3-4848-9ec4-28752c52ef93'} Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 273b2877-d6d3-4848-9ec4-28752c52ef93 could not be found. Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273b2877-d6d3-4848-9ec4-28752c52ef93 could not be found. Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:10.066403 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:10.071327 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:10.071327 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:10.071327 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:10.071327 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:10.071327 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:10.071327 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273b2877-d6d3-4848-9ec4-28752c52ef93 could not be found. Oct 11 20:06:10.071327 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:10.075900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] Returning 404 to user: Instance 273b2877-d6d3-4848-9ec4-28752c52ef93 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:10.077202 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1901b9ce-f077-4eec-9de1-c910e1886c42 tempest-ServerPasswordTestJSON-1446005047 tempest-ServerPasswordTestJSON-1446005047-project] 10.222.0.27 "GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93" status: 404 len: 111 microversion: 2.1 time: 0.075743 Oct 11 20:06:10.080177 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2461/4881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:10 2022] GET /compute/v2.1/servers/273b2877-d6d3-4848-9ec4-28752c52ef93 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:06:10.333136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-17687d69-aef7-47d2-a838-c2b45d0acf8b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:10.333748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-17687d69-aef7-47d2-a838-c2b45d0acf8b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:10.348624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17687d69-aef7-47d2-a838-c2b45d0acf8b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:10.349432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17687d69-aef7-47d2-a838-c2b45d0acf8b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:10.350191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17687d69-aef7-47d2-a838-c2b45d0acf8b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:10.351096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17687d69-aef7-47d2-a838-c2b45d0acf8b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:10.352583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17687d69-aef7-47d2-a838-c2b45d0acf8b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:10.355089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17687d69-aef7-47d2-a838-c2b45d0acf8b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:10.545643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-17687d69-aef7-47d2-a838-c2b45d0acf8b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:10.554624 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-17687d69-aef7-47d2-a838-c2b45d0acf8b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1207 microversion: 2.1 time: 0.225978 Oct 11 20:06:10.568336 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2421/4882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:10 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1207 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:10.688003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:10.688625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:10.703285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:10.704153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:10.704609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:10.705447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:10.706053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:10.706785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:10.812577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-91eac085-0095-4a2b-ae0e-b554f6333eba req-46d4a3c4-aa28-4a1f-b419-4f6d618a3e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273b2877-d6d3-4848-9ec4-28752c52ef93", "name": "network-vif-deleted", "tag": "e8351252-c592-4cd1-a265-69c10d498754"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:10.828066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-91eac085-0095-4a2b-ae0e-b554f6333eba req-46d4a3c4-aa28-4a1f-b419-4f6d618a3e62 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:10.828635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-91eac085-0095-4a2b-ae0e-b554f6333eba req-46d4a3c4-aa28-4a1f-b419-4f6d618a3e62 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:10.829172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-91eac085-0095-4a2b-ae0e-b554f6333eba req-46d4a3c4-aa28-4a1f-b419-4f6d618a3e62 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:10.843209 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-91eac085-0095-4a2b-ae0e-b554f6333eba req-46d4a3c4-aa28-4a1f-b419-4f6d618a3e62 service nova] Creating event network-vif-deleted:e8351252-c592-4cd1-a265-69c10d498754 for instance 273b2877-d6d3-4848-9ec4-28752c52ef93 on n-h1-860864-3 Oct 11 20:06:10.853269 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-91eac085-0095-4a2b-ae0e-b554f6333eba req-46d4a3c4-aa28-4a1f-b419-4f6d618a3e62 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046137 Oct 11 20:06:10.854306 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2422/4883] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:06:11.247375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:11.266984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:11.268610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:11.269815 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fed12dcb-5400-491c-9e41-e2eeb15fa89a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1850 microversion: 2.32 time: 0.586438 Oct 11 20:06:11.274281 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2462/4884] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:10 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1850 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:11.592712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0ea18df-b3f3-4f3a-9a44-b7cc7649470b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:11.593416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e0ea18df-b3f3-4f3a-9a44-b7cc7649470b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:11.605485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0ea18df-b3f3-4f3a-9a44-b7cc7649470b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:11.606455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0ea18df-b3f3-4f3a-9a44-b7cc7649470b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:11.608132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0ea18df-b3f3-4f3a-9a44-b7cc7649470b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:11.609366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0ea18df-b3f3-4f3a-9a44-b7cc7649470b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:11.610430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0ea18df-b3f3-4f3a-9a44-b7cc7649470b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:11.611543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0ea18df-b3f3-4f3a-9a44-b7cc7649470b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:11.830749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e0ea18df-b3f3-4f3a-9a44-b7cc7649470b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:11.843954 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e0ea18df-b3f3-4f3a-9a44-b7cc7649470b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1269 microversion: 2.1 time: 0.255404 Oct 11 20:06:11.846234 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2423/4885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:11 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1269 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:12.300617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:12.301237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:12.315328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:12.319428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:12.320107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:12.320993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:12.322345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:12.323882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:12.877219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe6a8374-f4ba-4841-9931-965738468fa1 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:12.877970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fe6a8374-f4ba-4841-9931-965738468fa1 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:12.911109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe6a8374-f4ba-4841-9931-965738468fa1 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:12.913990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe6a8374-f4ba-4841-9931-965738468fa1 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:12.917900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe6a8374-f4ba-4841-9931-965738468fa1 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:12.921705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe6a8374-f4ba-4841-9931-965738468fa1 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:12.922273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe6a8374-f4ba-4841-9931-965738468fa1 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:12.922753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe6a8374-f4ba-4841-9931-965738468fa1 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:13.115110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fe6a8374-f4ba-4841-9931-965738468fa1 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:13.124128 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fe6a8374-f4ba-4841-9931-965738468fa1 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1269 microversion: 2.1 time: 0.254272 Oct 11 20:06:13.131913 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2424/4886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:12 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1269 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:13.352364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c7a3ac4-5605-41c2-990f-b1d6664e1858 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:13.353037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c7a3ac4-5605-41c2-990f-b1d6664e1858 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:13.369154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c7a3ac4-5605-41c2-990f-b1d6664e1858 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:13.372878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c7a3ac4-5605-41c2-990f-b1d6664e1858 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:13.375060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c7a3ac4-5605-41c2-990f-b1d6664e1858 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:13.375933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c7a3ac4-5605-41c2-990f-b1d6664e1858 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:13.377262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c7a3ac4-5605-41c2-990f-b1d6664e1858 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:13.379705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c7a3ac4-5605-41c2-990f-b1d6664e1858 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:13.440619 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c7a3ac4-5605-41c2-990f-b1d6664e1858 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/ips" status: 200 len: 149 microversion: 2.1 time: 0.091999 Oct 11 20:06:13.441739 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2425/4887] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:06:13 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/ips => generated 149 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:06:13.967849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:13.972009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:14.025849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:14.055785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:14.057387 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5e84d19d-11e5-4b14-8840-b41ec0668487 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1850 microversion: 2.32 time: 1.761686 Oct 11 20:06:14.106926 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2463/4888] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:12 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1850 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:14.164907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fbec0a5-5609-45ec-95e2-25accdceeb80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:14.166978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9fbec0a5-5609-45ec-95e2-25accdceeb80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:14.175831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=16 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:14.190388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbec0a5-5609-45ec-95e2-25accdceeb80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:14.191198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbec0a5-5609-45ec-95e2-25accdceeb80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:14.194405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbec0a5-5609-45ec-95e2-25accdceeb80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:14.197274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbec0a5-5609-45ec-95e2-25accdceeb80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:14.205165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbec0a5-5609-45ec-95e2-25accdceeb80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:14.210634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fbec0a5-5609-45ec-95e2-25accdceeb80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:14.813612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9fbec0a5-5609-45ec-95e2-25accdceeb80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:14.820413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:14.833660 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9fbec0a5-5609-45ec-95e2-25accdceeb80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1311 microversion: 2.1 time: 0.668867 Oct 11 20:06:14.839069 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2426/4889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:14 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1311 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:15.127022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:15.127783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:15.157882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:15.158454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:15.158927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:15.159697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:15.160318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:15.160750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:15.651995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:15.681675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:15.690073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:15.695840 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0d42efac-466a-4ef7-9039-7f7e9794c0c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1850 microversion: 2.32 time: 0.574300 Oct 11 20:06:15.699402 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2464/4890] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:15 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1850 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:15.813028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ef961183-c722-4a86-8be4-b5a518cc8475 req-56f24e56-6a8d-4946-aa2f-d6a6643ddec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "tag": "6f0763b2-25ba-4ba9-b513-99fb41f73411"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:15.850806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ef961183-c722-4a86-8be4-b5a518cc8475 req-56f24e56-6a8d-4946-aa2f-d6a6643ddec5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:15.851353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ef961183-c722-4a86-8be4-b5a518cc8475 req-56f24e56-6a8d-4946-aa2f-d6a6643ddec5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:15.851718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ef961183-c722-4a86-8be4-b5a518cc8475 req-56f24e56-6a8d-4946-aa2f-d6a6643ddec5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:15.864591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-195e309c-9709-44a0-8efb-4e6f4923e84d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:15.865118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-195e309c-9709-44a0-8efb-4e6f4923e84d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:15.883587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-195e309c-9709-44a0-8efb-4e6f4923e84d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:15.884081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-195e309c-9709-44a0-8efb-4e6f4923e84d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:15.884806 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ef961183-c722-4a86-8be4-b5a518cc8475 req-56f24e56-6a8d-4946-aa2f-d6a6643ddec5 service nova] Creating event network-changed:6f0763b2-25ba-4ba9-b513-99fb41f73411 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:06:15.892148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-195e309c-9709-44a0-8efb-4e6f4923e84d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:15.894352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-195e309c-9709-44a0-8efb-4e6f4923e84d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:15.896313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-195e309c-9709-44a0-8efb-4e6f4923e84d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:15.897124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-195e309c-9709-44a0-8efb-4e6f4923e84d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:15.897255 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ef961183-c722-4a86-8be4-b5a518cc8475 req-56f24e56-6a8d-4946-aa2f-d6a6643ddec5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088917 Oct 11 20:06:15.902063 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2427/4891] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:16.680989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0cfdf8db-c187-41c4-b2ab-c5e36a2e68c3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "508b0ced-96e9-4f4f-a049-1cde40bbcb1c"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:16.683530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0cfdf8db-c187-41c4-b2ab-c5e36a2e68c3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:16.694615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-195e309c-9709-44a0-8efb-4e6f4923e84d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:16.711035 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-195e309c-9709-44a0-8efb-4e6f4923e84d tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1311 microversion: 2.1 time: 0.850939 Oct 11 20:06:16.711778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cfdf8db-c187-41c4-b2ab-c5e36a2e68c3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:16.714539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cfdf8db-c187-41c4-b2ab-c5e36a2e68c3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:16.715028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cfdf8db-c187-41c4-b2ab-c5e36a2e68c3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:16.715922 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2465/4892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:15 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1311 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:16.717039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cfdf8db-c187-41c4-b2ab-c5e36a2e68c3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:16.718693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cfdf8db-c187-41c4-b2ab-c5e36a2e68c3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:16.719216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cfdf8db-c187-41c4-b2ab-c5e36a2e68c3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:16.736129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:16.740846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:16.759917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:16.761558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:16.762018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:16.765062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:16.765672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:16.766118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:17.243611 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0cfdf8db-c187-41c4-b2ab-c5e36a2e68c3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.566833 Oct 11 20:06:17.245067 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2428/4893] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:06:16 2022] POST /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:06:17.744594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d87d952b-90c8-4c6b-a572-bdf4abdf0de7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:17.745225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d87d952b-90c8-4c6b-a572-bdf4abdf0de7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:17.781124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d87d952b-90c8-4c6b-a572-bdf4abdf0de7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:17.781654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d87d952b-90c8-4c6b-a572-bdf4abdf0de7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:17.782104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d87d952b-90c8-4c6b-a572-bdf4abdf0de7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:17.786596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d87d952b-90c8-4c6b-a572-bdf4abdf0de7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:17.787478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d87d952b-90c8-4c6b-a572-bdf4abdf0de7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:17.788160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d87d952b-90c8-4c6b-a572-bdf4abdf0de7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:17.832843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:17.850171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:17.862872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:17.864296 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9031c662-ac1b-46b9-a686-c7ef1883c0cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1850 microversion: 2.32 time: 1.133075 Oct 11 20:06:17.865001 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2466/4894] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:16 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1850 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:18.524470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d87d952b-90c8-4c6b-a572-bdf4abdf0de7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:18.537283 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d87d952b-90c8-4c6b-a572-bdf4abdf0de7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1311 microversion: 2.1 time: 0.797039 Oct 11 20:06:18.541652 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2429/4895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:17 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1311 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:18.892802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:18.893520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:18.897327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:18.904580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:18.914064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:18.914647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:18.915476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:18.916021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:18.916543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:19.300210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=40 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:19.441252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5ca80b75-f6cb-4db7-90f4-baa0c6b1a742 req-3d0a081c-9524-4466-9c06-a52752ef7795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "tag": "c43aaecd-6f25-402d-af31-5703ca8f952b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:19.470751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ca80b75-f6cb-4db7-90f4-baa0c6b1a742 req-3d0a081c-9524-4466-9c06-a52752ef7795 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:19.471518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ca80b75-f6cb-4db7-90f4-baa0c6b1a742 req-3d0a081c-9524-4466-9c06-a52752ef7795 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:19.473189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ca80b75-f6cb-4db7-90f4-baa0c6b1a742 req-3d0a081c-9524-4466-9c06-a52752ef7795 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:19.484202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:19.506075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:19.516869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:19.521582 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5fa525a0-b961-4f33-95be-ef0c5ed65e24 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1871 microversion: 2.32 time: 0.634155 Oct 11 20:06:19.523896 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5ca80b75-f6cb-4db7-90f4-baa0c6b1a742 req-3d0a081c-9524-4466-9c06-a52752ef7795 service nova] Creating event network-changed:c43aaecd-6f25-402d-af31-5703ca8f952b for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:06:19.525782 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2467/4896] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:18 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1871 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:19.545959 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5ca80b75-f6cb-4db7-90f4-baa0c6b1a742 req-3d0a081c-9524-4466-9c06-a52752ef7795 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111689 Oct 11 20:06:19.547322 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2430/4897] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:19.565158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-49fac883-9cd2-44ee-b057-2795571ab807 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:19.565791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-49fac883-9cd2-44ee-b057-2795571ab807 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:19.574673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49fac883-9cd2-44ee-b057-2795571ab807 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:19.575478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49fac883-9cd2-44ee-b057-2795571ab807 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:19.576170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49fac883-9cd2-44ee-b057-2795571ab807 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:19.577161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49fac883-9cd2-44ee-b057-2795571ab807 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:19.580455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49fac883-9cd2-44ee-b057-2795571ab807 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:19.582002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49fac883-9cd2-44ee-b057-2795571ab807 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:20.016417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49fac883-9cd2-44ee-b057-2795571ab807 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:20.065933 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-49fac883-9cd2-44ee-b057-2795571ab807 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1311 microversion: 2.1 time: 0.491591 Oct 11 20:06:20.083407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c2aa2fcb-52f9-4c21-a2f6-26f758994f3b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:20.086072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c2aa2fcb-52f9-4c21-a2f6-26f758994f3b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:20.095328 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2468/4898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:19 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1311 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:20.098824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fcb-52f9-4c21-a2f6-26f758994f3b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:20.109318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fcb-52f9-4c21-a2f6-26f758994f3b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:20.110380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fcb-52f9-4c21-a2f6-26f758994f3b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:20.111955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fcb-52f9-4c21-a2f6-26f758994f3b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:20.112663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fcb-52f9-4c21-a2f6-26f758994f3b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:20.113389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fcb-52f9-4c21-a2f6-26f758994f3b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:20.349052 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c2aa2fcb-52f9-4c21-a2f6-26f758994f3b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806/action" status: 200 len: 24569 microversion: 2.1 time: 0.269444 Oct 11 20:06:20.349848 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2431/4899] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:06:20 2022] POST /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806/action => generated 24569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:06:20.557142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:20.558005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:20.572848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:20.574216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:20.575658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:20.579892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:20.580673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:20.581225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:20.591657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1218609377", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": "none"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:20.664578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:06:20.665296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:06:20.665970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:06:20.666597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:06:20.667207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:06:20.676912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:20.677804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:20.678552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:20.679541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:20.680236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:20.680868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:20.702660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Getting quotas for project 55c7c39978b041f4a1970a72246abdcb. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:20.709367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Getting quotas for user 308b5f9c9d364b49b8f2278094f7292d and project 55c7c39978b041f4a1970a72246abdcb. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:20.724411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:06:20.727065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: 27ef4876-2721-4ac1-930c-34430e2ed6b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:06:20.784219 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c9705e9a-8b9c-4b8d-8a1f-f14c5c1586da tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.389228 Oct 11 20:06:20.785467 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2469/4900] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 20:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 20:06:20.811970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0663fe9-9e7d-4a04-aa98-4d7e7acc6b53 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:20.814808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d0663fe9-9e7d-4a04-aa98-4d7e7acc6b53 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: 27ef4876-2721-4ac1-930c-34430e2ed6b5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:21.046258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0663fe9-9e7d-4a04-aa98-4d7e7acc6b53 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:21.064376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0663fe9-9e7d-4a04-aa98-4d7e7acc6b53 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:21.065728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0663fe9-9e7d-4a04-aa98-4d7e7acc6b53 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:21.067404 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0663fe9-9e7d-4a04-aa98-4d7e7acc6b53 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5" status: 200 len: 1278 microversion: 2.47 time: 0.274516 Oct 11 20:06:21.067991 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2470/4901] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:20 2022] GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5 => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:21.111435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40e62d38-8d1b-48da-adf2-63f83218e889 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:21.115908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-40e62d38-8d1b-48da-adf2-63f83218e889 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:21.128119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e62d38-8d1b-48da-adf2-63f83218e889 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:21.128631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e62d38-8d1b-48da-adf2-63f83218e889 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:21.129169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e62d38-8d1b-48da-adf2-63f83218e889 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:21.129893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e62d38-8d1b-48da-adf2-63f83218e889 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:21.130356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e62d38-8d1b-48da-adf2-63f83218e889 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:21.141692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40e62d38-8d1b-48da-adf2-63f83218e889 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:21.161817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:21.178382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:21.181802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:21.184926 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6066f07-6095-4373-a246-294d01ad986e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1871 microversion: 2.32 time: 0.631226 Oct 11 20:06:21.185911 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2432/4902] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:20 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1871 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:21.205271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2056781635", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": "none"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:21.301555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:06:21.302175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:06:21.302455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:06:21.303450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:06:21.304037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:06:21.323690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:21.324734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:21.329563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:21.331461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:21.332909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:21.333759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:21.368475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Getting quotas for project 55c7c39978b041f4a1970a72246abdcb. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:21.377322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Getting quotas for user 308b5f9c9d364b49b8f2278094f7292d and project 55c7c39978b041f4a1970a72246abdcb. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:21.400232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:06:21.404393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:06:21.477572 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-171ac874-cfa0-4654-8dff-555433c46033 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.289844 Oct 11 20:06:21.479086 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2433/4903] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 20:06:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 292 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 20:06:21.494298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-baa3b8d7-c5f8-4aef-99dc-f24f2cd24b54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:21.500524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-baa3b8d7-c5f8-4aef-99dc-f24f2cd24b54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:21.565263 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-baa3b8d7-c5f8-4aef-99dc-f24f2cd24b54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "PUT /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 992 microversion: 2.47 time: 0.078026 Oct 11 20:06:21.581697 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2434/4904] 10.222.0.27 () {62 vars in 1297 bytes} [Tue Oct 11 20:06:21 2022] PUT /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 992 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 20:06:21.593515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-decf79a9-ae08-4b9e-8fd6-710dc736030b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:21.594308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-decf79a9-ae08-4b9e-8fd6-710dc736030b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:21.750710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-40e62d38-8d1b-48da-adf2-63f83218e889 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:21.759886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-decf79a9-ae08-4b9e-8fd6-710dc736030b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:21.763076 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40e62d38-8d1b-48da-adf2-63f83218e889 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1311 microversion: 2.1 time: 0.654470 Oct 11 20:06:21.767201 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2471/4905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:21 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1311 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:21.775512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d15b8961-92d8-4a88-ad6f-0fb07d7266f2 req-971bf1f9-f3e2-4d4c-a8cd-4d5a0d956a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e34d60-b4e5-46a7-a5de-0b5a4a814d1d", "tag": "337657b8-c392-431c-97f8-4a2154acfc66"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:21.778970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-decf79a9-ae08-4b9e-8fd6-710dc736030b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:21.780630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-decf79a9-ae08-4b9e-8fd6-710dc736030b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:21.787797 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-decf79a9-ae08-4b9e-8fd6-710dc736030b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1278 microversion: 2.47 time: 0.203985 Oct 11 20:06:21.789943 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2435/4906] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:21 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:21.797183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d15b8961-92d8-4a88-ad6f-0fb07d7266f2 req-971bf1f9-f3e2-4d4c-a8cd-4d5a0d956a65 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:21.797670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d15b8961-92d8-4a88-ad6f-0fb07d7266f2 req-971bf1f9-f3e2-4d4c-a8cd-4d5a0d956a65 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:21.798099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d15b8961-92d8-4a88-ad6f-0fb07d7266f2 req-971bf1f9-f3e2-4d4c-a8cd-4d5a0d956a65 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:21.826384 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d15b8961-92d8-4a88-ad6f-0fb07d7266f2 req-971bf1f9-f3e2-4d4c-a8cd-4d5a0d956a65 service nova] Creating event network-changed:337657b8-c392-431c-97f8-4a2154acfc66 for instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d on n-h1-860864-3 Oct 11 20:06:21.846194 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d15b8961-92d8-4a88-ad6f-0fb07d7266f2 req-971bf1f9-f3e2-4d4c-a8cd-4d5a0d956a65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075870 Oct 11 20:06:21.846933 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2472/4907] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:22.217447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:22.219229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:22.237483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:22.239293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:22.244144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:22.245454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:22.246092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:22.246555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:22.733003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:22.743326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:22.744791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:22.753865 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-871f688b-4da1-4158-84df-b95b5c2d7bb8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1892 microversion: 2.32 time: 0.537400 Oct 11 20:06:22.754879 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2436/4908] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:22 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1892 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:22.791623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-986cf1d1-cdd4-482e-ad31-4b3fdec1c0c7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:22.792568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-986cf1d1-cdd4-482e-ad31-4b3fdec1c0c7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:22.810896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986cf1d1-cdd4-482e-ad31-4b3fdec1c0c7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:22.812681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986cf1d1-cdd4-482e-ad31-4b3fdec1c0c7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:22.816404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986cf1d1-cdd4-482e-ad31-4b3fdec1c0c7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:22.817580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986cf1d1-cdd4-482e-ad31-4b3fdec1c0c7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:22.819469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986cf1d1-cdd4-482e-ad31-4b3fdec1c0c7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:22.820792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-986cf1d1-cdd4-482e-ad31-4b3fdec1c0c7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:22.823801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:22.824708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:22.833346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:22.842357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:22.843087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:22.844104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:22.844810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:22.845498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:23.525593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-986cf1d1-cdd4-482e-ad31-4b3fdec1c0c7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:23.538570 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-986cf1d1-cdd4-482e-ad31-4b3fdec1c0c7 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1311 microversion: 2.1 time: 0.753095 Oct 11 20:06:23.541323 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2473/4909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:22 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1311 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:23.607560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:23.624706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:23.630133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:23.631573 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2e9ce2e7-3c19-4077-a5e8-884337d7e5f2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1282 microversion: 2.47 time: 0.811915 Oct 11 20:06:23.636941 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2437/4910] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:22 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1282 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:23.805257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:23.808371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:23.837984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:23.839084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:23.839536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:23.840262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:23.849804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:23.850809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:24.503998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b8fbf81a-6ebb-4f54-a3ca-9b94ce6fd27b req-7fbc19b1-e1a3-4c94-a98c-cc419d9b044a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "tag": "64e233cb-7770-4bcd-b9b7-a977e0aa27eb"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:24.529555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b8fbf81a-6ebb-4f54-a3ca-9b94ce6fd27b req-7fbc19b1-e1a3-4c94-a98c-cc419d9b044a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:24.530057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b8fbf81a-6ebb-4f54-a3ca-9b94ce6fd27b req-7fbc19b1-e1a3-4c94-a98c-cc419d9b044a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:24.530501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b8fbf81a-6ebb-4f54-a3ca-9b94ce6fd27b req-7fbc19b1-e1a3-4c94-a98c-cc419d9b044a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:24.561504 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b8fbf81a-6ebb-4f54-a3ca-9b94ce6fd27b req-7fbc19b1-e1a3-4c94-a98c-cc419d9b044a service nova] Creating event network-changed:64e233cb-7770-4bcd-b9b7-a977e0aa27eb for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:06:24.567677 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b8fbf81a-6ebb-4f54-a3ca-9b94ce6fd27b req-7fbc19b1-e1a3-4c94-a98c-cc419d9b044a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068280 Oct 11 20:06:24.573627 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2438/4911] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:06:24.596657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6c637fa-7827-4772-b1a6-bbeed2956b79 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:24.597375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d6c637fa-7827-4772-b1a6-bbeed2956b79 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:24.612812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6c637fa-7827-4772-b1a6-bbeed2956b79 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:24.614840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6c637fa-7827-4772-b1a6-bbeed2956b79 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:24.615957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6c637fa-7827-4772-b1a6-bbeed2956b79 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:24.617027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6c637fa-7827-4772-b1a6-bbeed2956b79 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:24.617809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6c637fa-7827-4772-b1a6-bbeed2956b79 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:24.618736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6c637fa-7827-4772-b1a6-bbeed2956b79 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:25.260594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d6c637fa-7827-4772-b1a6-bbeed2956b79 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:25.267318 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d6c637fa-7827-4772-b1a6-bbeed2956b79 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1311 microversion: 2.1 time: 0.692311 Oct 11 20:06:25.271526 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2439/4912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:24 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1311 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:25.281736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:25.284986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:25.289199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:25.301517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:25.306982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:25.311551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:25.313545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:25.314093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:25.314889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:25.315377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:25.316719 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2040dc60-6863-4d99-a53e-b922bf9230e1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1892 microversion: 2.32 time: 1.531510 Oct 11 20:06:25.319044 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2474/4913] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:23 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1892 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:25.322063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:25.711209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:25.723522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:25.736353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:25.741044 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b681bc51-fc00-4e47-955d-ca7f94831ccf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1338 microversion: 2.47 time: 0.468544 Oct 11 20:06:25.744701 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2440/4914] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:25 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1338 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:26.298517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7728f9c2-e332-47eb-a527-d89ee2ece599 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:26.299759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7728f9c2-e332-47eb-a527-d89ee2ece599 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:26.309612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7728f9c2-e332-47eb-a527-d89ee2ece599 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:26.310403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7728f9c2-e332-47eb-a527-d89ee2ece599 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:26.311118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7728f9c2-e332-47eb-a527-d89ee2ece599 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:26.312119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7728f9c2-e332-47eb-a527-d89ee2ece599 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:26.313026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7728f9c2-e332-47eb-a527-d89ee2ece599 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:26.314040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7728f9c2-e332-47eb-a527-d89ee2ece599 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:26.346903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:26.347552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:26.357984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:26.358482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:26.358994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:26.359723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:26.360191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:26.360632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:26.826930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:26.842484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:26.844153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:26.848360 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8e20fc69-b92d-42e7-b93d-c06647c0b78c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1892 microversion: 2.32 time: 0.508368 Oct 11 20:06:26.848360 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2441/4915] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:26 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1892 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:26.858247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-3983ff1f-cc81-4440-9817-7c2220d74ebd req-deb40302-39b1-44a0-9197-61967aed95f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "tag": "ac77e5e9-a5ab-4a34-b656-059e80fc5465"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:26.891483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3983ff1f-cc81-4440-9817-7c2220d74ebd req-deb40302-39b1-44a0-9197-61967aed95f6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:26.895655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3983ff1f-cc81-4440-9817-7c2220d74ebd req-deb40302-39b1-44a0-9197-61967aed95f6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:26.895655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3983ff1f-cc81-4440-9817-7c2220d74ebd req-deb40302-39b1-44a0-9197-61967aed95f6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:26.922806 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-3983ff1f-cc81-4440-9817-7c2220d74ebd req-deb40302-39b1-44a0-9197-61967aed95f6 service nova] Creating event network-changed:ac77e5e9-a5ab-4a34-b656-059e80fc5465 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:06:26.933534 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-3983ff1f-cc81-4440-9817-7c2220d74ebd req-deb40302-39b1-44a0-9197-61967aed95f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079445 Oct 11 20:06:26.937491 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2442/4916] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:26.950825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:26.951714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:26.967127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:26.971262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:26.971806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:26.972621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:26.973263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:26.973700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:26.988788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7728f9c2-e332-47eb-a527-d89ee2ece599 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:27.006668 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7728f9c2-e332-47eb-a527-d89ee2ece599 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1311 microversion: 2.1 time: 0.714207 Oct 11 20:06:27.007608 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2475/4917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:26 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1311 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:27.414597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:27.432601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:27.440174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:27.442094 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eeecc30f-adf4-4f86-a598-e5d1631731d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1336 microversion: 2.47 time: 0.503066 Oct 11 20:06:27.445224 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2443/4918] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:26 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1336 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:27.771458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-508d647d-a015-4070-b13a-4c597a8ff89a req-5434f525-155e-4006-adc5-70d77540a26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e34d60-b4e5-46a7-a5de-0b5a4a814d1d", "name": "network-vif-plugged", "status": "completed", "tag": "337657b8-c392-431c-97f8-4a2154acfc66"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:27.785163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-508d647d-a015-4070-b13a-4c597a8ff89a req-5434f525-155e-4006-adc5-70d77540a26d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:27.788780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-508d647d-a015-4070-b13a-4c597a8ff89a req-5434f525-155e-4006-adc5-70d77540a26d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:27.789242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-508d647d-a015-4070-b13a-4c597a8ff89a req-5434f525-155e-4006-adc5-70d77540a26d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:27.860594 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-508d647d-a015-4070-b13a-4c597a8ff89a req-5434f525-155e-4006-adc5-70d77540a26d service nova] Creating event network-vif-plugged:337657b8-c392-431c-97f8-4a2154acfc66 for instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d on n-h1-860864-3 Oct 11 20:06:27.874930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:27.875549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:27.884503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:27.884846 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-508d647d-a015-4070-b13a-4c597a8ff89a req-5434f525-155e-4006-adc5-70d77540a26d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117626 Oct 11 20:06:27.885003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:27.885427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:27.890820 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2476/4919] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:27.891000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:27.891486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:27.892125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:28.043717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-09ad4d57-bcba-475c-aab4-838faafd46f8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:28.048092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-09ad4d57-bcba-475c-aab4-838faafd46f8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:28.069751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ad4d57-bcba-475c-aab4-838faafd46f8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:28.075364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ad4d57-bcba-475c-aab4-838faafd46f8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:28.078140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ad4d57-bcba-475c-aab4-838faafd46f8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:28.080096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ad4d57-bcba-475c-aab4-838faafd46f8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:28.085139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ad4d57-bcba-475c-aab4-838faafd46f8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:28.085693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09ad4d57-bcba-475c-aab4-838faafd46f8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:28.383115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:28.404689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:28.409933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:28.411897 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3da755bc-0eb3-41e1-a7a0-07c27243e80c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1892 microversion: 2.32 time: 0.541028 Oct 11 20:06:28.414791 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2444/4920] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:27 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1892 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:28.425992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3f1d22c6-d06d-4fbe-9c95-21873a99f206 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:28.437093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3f1d22c6-d06d-4fbe-9c95-21873a99f206 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:28.464492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1d22c6-d06d-4fbe-9c95-21873a99f206 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:28.466410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1d22c6-d06d-4fbe-9c95-21873a99f206 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:28.467172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1d22c6-d06d-4fbe-9c95-21873a99f206 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:28.472964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1d22c6-d06d-4fbe-9c95-21873a99f206 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:28.473207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-09ad4d57-bcba-475c-aab4-838faafd46f8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:28.473900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1d22c6-d06d-4fbe-9c95-21873a99f206 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:28.479236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1d22c6-d06d-4fbe-9c95-21873a99f206 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:28.511698 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-09ad4d57-bcba-475c-aab4-838faafd46f8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1311 microversion: 2.1 time: 0.478657 Oct 11 20:06:28.515390 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2477/4921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:28 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1311 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:28.532404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:28.535287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:28.560473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:28.563051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:28.563734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:28.568364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:28.570425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:28.571190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:28.579218 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3f1d22c6-d06d-4fbe-9c95-21873a99f206 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.162967 Oct 11 20:06:28.588550 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2445/4922] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 11 20:06:28 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a/os-volume_attachments => generated 25 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:28.705627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-96c23ae3-1b45-4d69-af49-36edbe4cf08d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:28.706103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-96c23ae3-1b45-4d69-af49-36edbe4cf08d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:28.719479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96c23ae3-1b45-4d69-af49-36edbe4cf08d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:28.720116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96c23ae3-1b45-4d69-af49-36edbe4cf08d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:28.720589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96c23ae3-1b45-4d69-af49-36edbe4cf08d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:28.721325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96c23ae3-1b45-4d69-af49-36edbe4cf08d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:28.721797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96c23ae3-1b45-4d69-af49-36edbe4cf08d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:28.722233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96c23ae3-1b45-4d69-af49-36edbe4cf08d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:28.782215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-96c23ae3-1b45-4d69-af49-36edbe4cf08d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:06:28.802710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:28.818299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:28.820085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:28.821294 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1ceaf1d3-3ade-4df2-ae13-52f8f7a835f6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1357 microversion: 2.47 time: 0.301521 Oct 11 20:06:28.821869 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2478/4923] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:28 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1357 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:28.853698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:28.858214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:28.870167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:28.870702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:28.873605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:28.874171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:28.876017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:28.877929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:28.878394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.001305 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-96c23ae3-1b45-4d69-af49-36edbe4cf08d tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 204 len: 0 microversion: 2.20 time: 0.300044 Oct 11 20:06:29.005527 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2446/4924] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:06:28 2022] DELETE /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:06:29.020018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-15a2e150-5519-484d-ac07-6bcf6be9ba98 req-48276845-f6b6-4dd5-b6bc-e5b2216054f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "tag": "44a07f61-efb7-4155-a25a-5ce814a621c5"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:29.031472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:29.036997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-15a2e150-5519-484d-ac07-6bcf6be9ba98 req-48276845-f6b6-4dd5-b6bc-e5b2216054f4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.037700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-15a2e150-5519-484d-ac07-6bcf6be9ba98 req-48276845-f6b6-4dd5-b6bc-e5b2216054f4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.038340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-15a2e150-5519-484d-ac07-6bcf6be9ba98 req-48276845-f6b6-4dd5-b6bc-e5b2216054f4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.046625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:06:29.047357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:06:29.048000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:06:29.048849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:06:29.049746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:06:29.051657 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-15a2e150-5519-484d-ac07-6bcf6be9ba98 req-48276845-f6b6-4dd5-b6bc-e5b2216054f4 service nova] Creating event network-changed:44a07f61-efb7-4155-a25a-5ce814a621c5 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:06:29.057048 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-15a2e150-5519-484d-ac07-6bcf6be9ba98 req-48276845-f6b6-4dd5-b6bc-e5b2216054f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051686 Oct 11 20:06:29.057838 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2447/4925] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:29.063939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:29.064659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:29.072591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.073112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.073707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.074469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.075036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.075558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.129455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:29.136727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.137496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.138017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.139197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.139819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.140295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.177556 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-234d2520-1cee-4689-80ba-546c9495b0c6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "POST /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b/action" status: 202 len: 1079 microversion: 2.47 time: 0.328650 Oct 11 20:06:29.178638 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2479/4926] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 11 20:06:28 2022] POST /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b/action => generated 1079 bytes in 330 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 11 20:06:29.198778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:29.199623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:29.207111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.208377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.208840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.209714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.210186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.210696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.360267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:29.369492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:29.370799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:29.372148 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6fb9c5f7-c0da-45b6-9f9e-3969b14f2106 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.177448 Oct 11 20:06:29.382550 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2480/4927] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:29 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:29.442750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:29.444298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:29.451489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.451985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.453179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.453179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.453552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.453998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.478614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:29.628996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:29.648153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:29.649729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:29.651062 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-be9784da-1aef-49be-87b4-a227ab8d2cb3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1721 microversion: 2.20 time: 0.592311 Oct 11 20:06:29.651636 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2448/4928] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:29 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1721 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:29.674397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f3212551-47a9-4a5e-a9d3-eb558962a351 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:29.687509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f3212551-47a9-4a5e-a9d3-eb558962a351 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:29.698208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3212551-47a9-4a5e-a9d3-eb558962a351 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.708375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3212551-47a9-4a5e-a9d3-eb558962a351 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.709400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3212551-47a9-4a5e-a9d3-eb558962a351 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.716292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3212551-47a9-4a5e-a9d3-eb558962a351 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:29.717105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3212551-47a9-4a5e-a9d3-eb558962a351 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:29.717787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3212551-47a9-4a5e-a9d3-eb558962a351 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:29.859248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:29.876860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:29.880655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:29.910184 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-df18d5a0-d3f6-4b93-bba0-27cb8a46b571 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.448574 Oct 11 20:06:29.910184 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2481/4929] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:29 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:30.399620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:30.400251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:30.415881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:30.416386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:30.416830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:30.417550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:30.418011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:30.418503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:30.657084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:30.667612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:30.671536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:30.678047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f3212551-47a9-4a5e-a9d3-eb558962a351 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:30.691156 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0057ddb4-4fae-46df-b444-3260e24573e6 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.290942 Oct 11 20:06:30.706569 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2482/4930] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:30 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:30.711338 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f3212551-47a9-4a5e-a9d3-eb558962a351 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1497 microversion: 2.1 time: 1.037820 Oct 11 20:06:30.714555 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2449/4931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:29 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1497 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:30.724486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:30.725190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:30.729753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:30.740148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93262517-0dc1-4586-9346-246f39d78d80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:30.752545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:30.753281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:30.753732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:30.756043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:30.759283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:30.759690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:30.780678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.compute.server_groups [None req-93262517-0dc1-4586-9346-246f39d78d80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Querying cell 3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) for 1 instances {{(pid=126955) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 20:06:30.785547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93262517-0dc1-4586-9346-246f39d78d80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:30.786728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93262517-0dc1-4586-9346-246f39d78d80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:30.787431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93262517-0dc1-4586-9346-246f39d78d80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:30.850694 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93262517-0dc1-4586-9346-246f39d78d80 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/df0c4100-a27b-4706-80eb-319fbe5bb554" status: 200 len: 222 microversion: 2.1 time: 0.114771 Oct 11 20:06:30.854609 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2450/4932] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 20:06:30 2022] GET /compute/v2.1/os-server-groups/df0c4100-a27b-4706-80eb-319fbe5bb554 => generated 222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:30.896395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6f69925-962d-4c1e-b90b-29f0effa52b4 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:30.897272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d6f69925-962d-4c1e-b90b-29f0effa52b4 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:30.906218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f69925-962d-4c1e-b90b-29f0effa52b4 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:30.907179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f69925-962d-4c1e-b90b-29f0effa52b4 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:30.907879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f69925-962d-4c1e-b90b-29f0effa52b4 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:30.908846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f69925-962d-4c1e-b90b-29f0effa52b4 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:30.909552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f69925-962d-4c1e-b90b-29f0effa52b4 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:30.910230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6f69925-962d-4c1e-b90b-29f0effa52b4 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:30.946399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d6f69925-962d-4c1e-b90b-29f0effa52b4 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:06:31.049909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:31.062100 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d6f69925-962d-4c1e-b90b-29f0effa52b4 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 204 len: 0 microversion: 2.1 time: 0.194620 Oct 11 20:06:31.063477 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2451/4933] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:06:30 2022] DELETE /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:06:31.071775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:31.072698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:31.083634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:31.084443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:31.085756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:31.085756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:31.086353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:31.086941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:31.351150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:31.453202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:31.464903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:31.467304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:31.468761 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b54e4417-37e9-40d2-b703-f732617527e5 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1721 microversion: 2.20 time: 0.760868 Oct 11 20:06:31.469981 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2483/4934] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:30 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1721 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:31.487571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-81d661f8-9ba2-4dbe-af47-23c86bbe0d31 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:31.488701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-81d661f8-9ba2-4dbe-af47-23c86bbe0d31 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:31.508508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d661f8-9ba2-4dbe-af47-23c86bbe0d31 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:31.509082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d661f8-9ba2-4dbe-af47-23c86bbe0d31 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:31.509611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d661f8-9ba2-4dbe-af47-23c86bbe0d31 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:31.510550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d661f8-9ba2-4dbe-af47-23c86bbe0d31 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:31.511166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d661f8-9ba2-4dbe-af47-23c86bbe0d31 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:31.511625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81d661f8-9ba2-4dbe-af47-23c86bbe0d31 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:31.540346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:31.558599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:31.565284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:31.566645 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-03574121-b153-45f2-8647-d113e386bfad tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.501237 Oct 11 20:06:31.567326 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2452/4935] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:31 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:31.586668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1f12d28f-c675-4724-9f8a-897e68f7b7a8 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:31.587858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f12d28f-c675-4724-9f8a-897e68f7b7a8 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:31.595470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f12d28f-c675-4724-9f8a-897e68f7b7a8 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:31.607403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f12d28f-c675-4724-9f8a-897e68f7b7a8 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:31.608186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f12d28f-c675-4724-9f8a-897e68f7b7a8 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:31.609136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f12d28f-c675-4724-9f8a-897e68f7b7a8 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:31.609774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f12d28f-c675-4724-9f8a-897e68f7b7a8 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:31.610383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f12d28f-c675-4724-9f8a-897e68f7b7a8 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:31.766339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:32.084640 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1f12d28f-c675-4724-9f8a-897e68f7b7a8 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1833 microversion: 2.1 time: 0.516191 Oct 11 20:06:32.086542 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2453/4936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:31 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1833 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:32.092830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-cd273390-a492-4142-84db-bfe4675f56cd req-c45139f4-95cb-485a-8a95-af7a1a229cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "tag": "2b9dfd70-7039-45c5-860c-01d7197e52b8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:32.104071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd273390-a492-4142-84db-bfe4675f56cd req-c45139f4-95cb-485a-8a95-af7a1a229cbc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.104752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd273390-a492-4142-84db-bfe4675f56cd req-c45139f4-95cb-485a-8a95-af7a1a229cbc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.105357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd273390-a492-4142-84db-bfe4675f56cd req-c45139f4-95cb-485a-8a95-af7a1a229cbc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:32.127943 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-cd273390-a492-4142-84db-bfe4675f56cd req-c45139f4-95cb-485a-8a95-af7a1a229cbc service nova] Creating event network-changed:2b9dfd70-7039-45c5-860c-01d7197e52b8 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:06:32.133751 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-cd273390-a492-4142-84db-bfe4675f56cd req-c45139f4-95cb-485a-8a95-af7a1a229cbc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045493 Oct 11 20:06:32.134390 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2454/4937] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:32.154512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:32.158647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:32.166116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-81d661f8-9ba2-4dbe-af47-23c86bbe0d31 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:32.177100 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-81d661f8-9ba2-4dbe-af47-23c86bbe0d31 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1503 microversion: 2.1 time: 0.705796 Oct 11 20:06:32.183542 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2484/4938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:31 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1503 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:32.195260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.195965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.196583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:32.197289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.198366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2492c32d-826c-4002-8564-50d6471ca5a9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:32.199026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.199889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:32.200703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2492c32d-826c-4002-8564-50d6471ca5a9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:32.239271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2492c32d-826c-4002-8564-50d6471ca5a9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.240128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2492c32d-826c-4002-8564-50d6471ca5a9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.240866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2492c32d-826c-4002-8564-50d6471ca5a9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:32.241907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2492c32d-826c-4002-8564-50d6471ca5a9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.242593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2492c32d-826c-4002-8564-50d6471ca5a9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.243192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2492c32d-826c-4002-8564-50d6471ca5a9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:32.511152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:32.525457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:32.526961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:32.536061 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e40409d-abc6-48c1-b2ea-c196d9cfefa0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.400417 Oct 11 20:06:32.552520 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2455/4939] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:32 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:32.557740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1fda19b1-7ca1-4ca7-91a7-dbb4f6e7e22e req-589c1cae-c841-4a29-aa0e-00e22db0da68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a125d45-79ec-4fda-9601-334c311a9f7a", "name": "network-vif-deleted", "tag": "e4e15471-dfd8-4f5d-be37-fdddaa52dfc8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:32.593665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1fda19b1-7ca1-4ca7-91a7-dbb4f6e7e22e req-589c1cae-c841-4a29-aa0e-00e22db0da68 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.594645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1fda19b1-7ca1-4ca7-91a7-dbb4f6e7e22e req-589c1cae-c841-4a29-aa0e-00e22db0da68 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.595317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1fda19b1-7ca1-4ca7-91a7-dbb4f6e7e22e req-589c1cae-c841-4a29-aa0e-00e22db0da68 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:32.623672 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1fda19b1-7ca1-4ca7-91a7-dbb4f6e7e22e req-589c1cae-c841-4a29-aa0e-00e22db0da68 service nova] Creating event network-vif-deleted:e4e15471-dfd8-4f5d-be37-fdddaa52dfc8 for instance 7a125d45-79ec-4fda-9601-334c311a9f7a on n-h2-860864-3 Oct 11 20:06:32.638656 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1fda19b1-7ca1-4ca7-91a7-dbb4f6e7e22e req-589c1cae-c841-4a29-aa0e-00e22db0da68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084258 Oct 11 20:06:32.640045 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2456/4940] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:32.654897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:32.656109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:32.665385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.666463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.667284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:32.671347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.685565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.686845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:32.758647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.759486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.760086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:32.760728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lazy-loading 'fault' on Instance uuid 7a125d45-79ec-4fda-9601-334c311a9f7a {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:06:32.912678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:32.923929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:32.928029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27affa75f6a849ba802c1397406b201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49d03e014e4749b522b6a87372994b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:32.931460 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7f229a83-2b39-460e-a959-13d5e73b36c2 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 200 len: 1370 microversion: 2.20 time: 0.287556 Oct 11 20:06:32.948057 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2457/4941] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:32 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:32.964540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:32.966875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:32.985758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.986308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.986814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:32.989950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:32.990462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:32.990964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:33.057667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2492c32d-826c-4002-8564-50d6471ca5a9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:33.069606 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2492c32d-826c-4002-8564-50d6471ca5a9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1682 microversion: 2.1 time: 0.883067 Oct 11 20:06:33.084002 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2485/4942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:32 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1682 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:33.205849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3f8b081d-3c6c-418c-88d8-053eea489cb6 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:33.207388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3f8b081d-3c6c-418c-88d8-053eea489cb6 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:33.219373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f8b081d-3c6c-418c-88d8-053eea489cb6 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:33.221481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f8b081d-3c6c-418c-88d8-053eea489cb6 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:33.221999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f8b081d-3c6c-418c-88d8-053eea489cb6 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:33.223663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f8b081d-3c6c-418c-88d8-053eea489cb6 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:33.225630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f8b081d-3c6c-418c-88d8-053eea489cb6 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:33.226249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f8b081d-3c6c-418c-88d8-053eea489cb6 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:33.638785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:33.659105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:33.682319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:33.682319 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a156500-fb07-472a-97a4-29aa9a1cdec9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.724735 Oct 11 20:06:33.682319 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2458/4943] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:32 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:33.682810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3f8b081d-3c6c-418c-88d8-053eea489cb6 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:33.689107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-309efa08-82e8-4727-8ad8-221078ab11b4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:33.691454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-309efa08-82e8-4727-8ad8-221078ab11b4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:33.697944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-309efa08-82e8-4727-8ad8-221078ab11b4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:33.698448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-309efa08-82e8-4727-8ad8-221078ab11b4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:33.698922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-309efa08-82e8-4727-8ad8-221078ab11b4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:33.700261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-309efa08-82e8-4727-8ad8-221078ab11b4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:33.700892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-309efa08-82e8-4727-8ad8-221078ab11b4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:33.701327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-309efa08-82e8-4727-8ad8-221078ab11b4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:33.709122 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3f8b081d-3c6c-418c-88d8-053eea489cb6 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1503 microversion: 2.1 time: 0.507960 Oct 11 20:06:33.710002 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2486/4944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:33 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1503 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:06:33.729161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:33.729981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:33.738292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:33.739326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:33.739886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:33.740677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:33.741210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:33.741834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:33.757419 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-309efa08-82e8-4727-8ad8-221078ab11b4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806/action" status: 200 len: 32641 microversion: 2.1 time: 0.081615 Oct 11 20:06:33.761018 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2459/4945] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:06:33 2022] POST /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806/action => generated 32641 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:06:33.870036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:33.885665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:33.891682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:33.891682 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-021c3500-c686-4ea0-b80d-1bcbf11b6670 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.179019 Oct 11 20:06:33.894704 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2487/4946] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:33 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:33.923955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:33.925373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:33.934956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:33.935651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:33.936296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:33.937363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:33.938074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:33.938980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:33.963888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:33.965674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:33.975229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:33.976176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:33.976810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:33.977987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:33.985144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:33.986397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:34.015019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2e0cf29f07504885ad494d5f0934c188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e08f08b81446e38ca4f9b7f1c4277a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:34.016043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] flavor_id is None. Assuming migration. {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 20:06:34.016865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:06:34.018356 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] HTTP exception thrown: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Request method failure captured: Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a HTTP/1.1 Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcsBXe_18PED8arFm6RWfRK-01rqcQ6UU9NxZql4qoreJliwp_4b8Su6w4JFmoJ9zNuZomadjtqDz1x2uIqE7--x5GVN2lOX5_zUhL2rqoNqvFzXtD6kYZK3PRbuIWVxNGsSb79mVB2dAkp7qqxN8bWVojWByiubzKJFvBNuTIFUS5k Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e49d03e014e4749b522b6a87372994b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}] Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 27affa75f6a849ba802c1397406b201c Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '7a125d45-79ec-4fda-9601-334c311a9f7a'} Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:34.020365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:34.025136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:34.025136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:34.025136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:34.025136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:34.025136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:34.025136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:34.025136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:34.025136 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:34.029768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Returning 404 to user: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:34.030976 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a25e13b8-78ca-4b99-8297-ee08e18b2db3 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 404 len: 111 microversion: 2.20 time: 0.072587 Oct 11 20:06:34.035389 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2488/4947] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:33 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 20:06:34.041876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ddeab702-a64b-4834-98c3-49f31e3e58bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '.version_select at 0x7f83cc339430>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:34.118793 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ddeab702-a64b-4834-98c3-49f31e3e58bb tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-219034741" status: 204 len: 0 microversion: 2.20 time: 0.081468 Oct 11 20:06:34.119740 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2489/4948] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Oct 11 20:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-219034741 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:06:34.256001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-245e3204-1012-4462-a2ea-b16c92d27737 req-b039af82-cfbb-464f-9927-d1b5666042e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "tag": "d27720b2-53eb-4849-ad71-71c85b3b9502"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:34.303911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-245e3204-1012-4462-a2ea-b16c92d27737 req-b039af82-cfbb-464f-9927-d1b5666042e5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:34.304914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-245e3204-1012-4462-a2ea-b16c92d27737 req-b039af82-cfbb-464f-9927-d1b5666042e5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:34.309219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-245e3204-1012-4462-a2ea-b16c92d27737 req-b039af82-cfbb-464f-9927-d1b5666042e5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:34.345449 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-245e3204-1012-4462-a2ea-b16c92d27737 req-b039af82-cfbb-464f-9927-d1b5666042e5 service nova] Creating event network-changed:d27720b2-53eb-4849-ad71-71c85b3b9502 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:06:34.360787 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-245e3204-1012-4462-a2ea-b16c92d27737 req-b039af82-cfbb-464f-9927-d1b5666042e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109279 Oct 11 20:06:34.362821 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2490/4949] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:06:34.694093 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4d14120d-64dc-45b5-9f50-4277e3e986f2 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806/action" status: 202 len: 0 microversion: 2.1 time: 0.774868 Oct 11 20:06:34.694754 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2460/4950] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:06:33 2022] POST /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806/action => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:06:34.704618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a5cd4fd-6d1a-4590-a478-304b033e1145 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:34.705628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0a5cd4fd-6d1a-4590-a478-304b033e1145 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:34.711228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:34.711858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:34.726004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:34.726802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:34.727366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:34.728293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:34.728653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a5cd4fd-6d1a-4590-a478-304b033e1145 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:34.729251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a5cd4fd-6d1a-4590-a478-304b033e1145 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:34.729707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a5cd4fd-6d1a-4590-a478-304b033e1145 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:34.730562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:34.732210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a5cd4fd-6d1a-4590-a478-304b033e1145 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:34.732411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:34.732698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a5cd4fd-6d1a-4590-a478-304b033e1145 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:34.733587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a5cd4fd-6d1a-4590-a478-304b033e1145 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:35.186920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0a5cd4fd-6d1a-4590-a478-304b033e1145 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:35.195827 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a5cd4fd-6d1a-4590-a478-304b033e1145 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1691 microversion: 2.1 time: 0.496510 Oct 11 20:06:35.206631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:35.206631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:35.210975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:35.213980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:35.216384 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2491/4951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:34 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1691 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:35.222084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:35.222750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:35.228269 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-806be076-a392-43a1-a126-76e64d869056 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.521770 Oct 11 20:06:35.228972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:35.229791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:35.230815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:35.231951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:35.232575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:35.233160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:35.249602 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2461/4952] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:34 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:35.273920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:35.275216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:35.276703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1b593f59-7912-48cc-99b7-41ff5fd17957 req-0cbdcf6c-3d89-453d-bf55-97b919cb3685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e34d60-b4e5-46a7-a5de-0b5a4a814d1d", "name": "network-vif-deleted", "tag": "337657b8-c392-431c-97f8-4a2154acfc66"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:35.277329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:35.278513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lazy-loading 'fault' on Instance uuid 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:06:35.293793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1b593f59-7912-48cc-99b7-41ff5fd17957 req-0cbdcf6c-3d89-453d-bf55-97b919cb3685 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:35.294586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1b593f59-7912-48cc-99b7-41ff5fd17957 req-0cbdcf6c-3d89-453d-bf55-97b919cb3685 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:35.295127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1b593f59-7912-48cc-99b7-41ff5fd17957 req-0cbdcf6c-3d89-453d-bf55-97b919cb3685 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:35.310414 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1b593f59-7912-48cc-99b7-41ff5fd17957 req-0cbdcf6c-3d89-453d-bf55-97b919cb3685 service nova] Creating event network-vif-deleted:337657b8-c392-431c-97f8-4a2154acfc66 for instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d on n-h1-860864-3 Oct 11 20:06:35.323938 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1b593f59-7912-48cc-99b7-41ff5fd17957 req-0cbdcf6c-3d89-453d-bf55-97b919cb3685 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071988 Oct 11 20:06:35.325333 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2462/4953] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:35.334121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:35.335122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:35.348562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:35.349335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:35.349976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:35.351151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:35.351985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:35.352852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:35.375800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97aff8e7683346c9987ce9c49a12a50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ab9b8dd9ee49b99ef75af3c106c9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:35.388291 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b8827e00-7aba-4d48-b5e2-e6c8c25d437c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 200 len: 1301 microversion: 2.1 time: 0.169269 Oct 11 20:06:35.390544 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2492/4954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:35 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 1301 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:35.497990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:35.513585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:35.516635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:35.518610 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cb1bd56e-daa1-4f61-ad09-3d2e4b4ff92e tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.190820 Oct 11 20:06:35.519262 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2463/4955] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:35 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:36.221889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1b354d44-62ca-4cfc-a59e-881368216a46 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:36.222630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1b354d44-62ca-4cfc-a59e-881368216a46 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:36.233520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b354d44-62ca-4cfc-a59e-881368216a46 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:36.236677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b354d44-62ca-4cfc-a59e-881368216a46 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:36.237396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b354d44-62ca-4cfc-a59e-881368216a46 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:36.238646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b354d44-62ca-4cfc-a59e-881368216a46 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:36.239507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b354d44-62ca-4cfc-a59e-881368216a46 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:36.240379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1b354d44-62ca-4cfc-a59e-881368216a46 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:36.267879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:36.268529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:36.300426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:36.302361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:36.305293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:36.306325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:36.307024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:36.308812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.110305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1b354d44-62ca-4cfc-a59e-881368216a46 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:37.118779 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1b354d44-62ca-4cfc-a59e-881368216a46 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1691 microversion: 2.1 time: 0.900900 Oct 11 20:06:37.119998 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2493/4956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:36 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1691 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:37.125579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.126404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:37.132521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:37.133219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:37.133838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.134887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:37.135675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:37.136268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.156540 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] HTTP exception thrown: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Request method failure captured: Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d HTTP/1.1 Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcypbRL-l0H8I0usuqRSR2HvZG3XNltKAXQAXU3NMkcijNuOuMmqmQzrY-WAuhmebvX2wPio013FvU9MHgF6xrP7AZtwz5XakXUcYMV8ziZ1W8QCsfiTVBLvPE_PRH8-MSTfMBqzak0eI_UOlDw2m4ywjPnP6GRMuQdwwCa7bo_Jw5U Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79ab9b8dd9ee49b99ef75af3c106c9d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}] Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 97aff8e7683346c9987ce9c49a12a50a Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '16e34d60-b4e5-46a7-a5de-0b5a4a814d1d'} Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.158787 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.166087 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.166087 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.166087 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.166087 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:37.166087 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:37.166087 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.166087 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.168055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Returning 404 to user: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:37.169518 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-96c88502-d02e-4cf6-9b8c-9f4ba2ab4f4e tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 404 len: 111 microversion: 2.1 time: 0.048316 Oct 11 20:06:37.170970 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2494/4957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:37 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:06:37.181030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.181979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:37.189201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:37.190030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:37.190715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.192059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:37.192767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:37.193738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.273270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:37.283864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:37.285975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:37.287514 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ef84c06b-0e64-4443-a11d-afa48fed3c51 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 1.025766 Oct 11 20:06:37.288630 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2464/4958] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:36 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:37.303501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:37.318797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b31a5840-5448-4992-a3e3-1f1e35d2643c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: .version_select at 0x7f83c71ac940>, body: {"keypair": {"name": "tempest-keypair-1109846199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMgm/RlNmYwXp/LkBe2c0tqXat5H4DwVezp0Vkq5zPhSjn4KFj9c5nNyg+SW2W0sb8HXHz+lBYx7cqtOLsHGYiATQp6C66zCUqBW6a3rDyuHwCMcI1FUF6CJfFZ8bEoHA=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:37.322403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:37.327812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:37.332314 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a7f84a06-ccae-4b03-9145-aa91fc54ef54 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.159384 Oct 11 20:06:37.335409 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2495/4959] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:37 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:37.342349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cf68b72f-f736-4d12-8fa2-3b06090e30db tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.366322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b31a5840-5448-4992-a3e3-1f1e35d2643c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:37.367223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:37.381351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.compute.server_groups [None req-cf68b72f-f736-4d12-8fa2-3b06090e30db tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Querying cell 3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) for 1 instances {{(pid=126956) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 20:06:37.383800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf68b72f-f736-4d12-8fa2-3b06090e30db tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:37.384457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf68b72f-f736-4d12-8fa2-3b06090e30db tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:37.385084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf68b72f-f736-4d12-8fa2-3b06090e30db tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.388723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b31a5840-5448-4992-a3e3-1f1e35d2643c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for user f4202e77bb27447ba5363091634d9731 and project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:37.435759 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b31a5840-5448-4992-a3e3-1f1e35d2643c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144918 Oct 11 20:06:37.436388 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2465/4960] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:06:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:37.441458 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cf68b72f-f736-4d12-8fa2-3b06090e30db tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.104335 Oct 11 20:06:37.443001 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2496/4961] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 20:06:37 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:37.455057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ef03b86-4361-4525-9aa4-0169b0caf27c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.469966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.compute.server_groups [None req-7ef03b86-4361-4525-9aa4-0169b0caf27c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Querying cell 3761bc1b-af0e-4a73-8d30-87f40644ce7a(cell1) for 1 instances {{(pid=126955) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 20:06:37.470909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ef03b86-4361-4525-9aa4-0169b0caf27c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:37.471409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ef03b86-4361-4525-9aa4-0169b0caf27c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:37.471853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ef03b86-4361-4525-9aa4-0169b0caf27c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.483250 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7ef03b86-4361-4525-9aa4-0169b0caf27c tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/df0c4100-a27b-4706-80eb-319fbe5bb554" status: 200 len: 184 microversion: 2.1 time: 0.031998 Oct 11 20:06:37.484204 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2466/4962] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 11 20:06:37 2022] GET /compute/v2.1/os-server-groups/df0c4100-a27b-4706-80eb-319fbe5bb554 => generated 184 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:37.495161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.496220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:37.505668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:37.506999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:37.507823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.508824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:37.509652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:37.510550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.531401 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] HTTP exception thrown: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Request method failure captured: Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d HTTP/1.1 Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcypbRL-l0H8I0usuqRSR2HvZG3XNltKAXQAXU3NMkcijNuOuMmqmQzrY-WAuhmebvX2wPio013FvU9MHgF6xrP7AZtwz5XakXUcYMV8ziZ1W8QCsfiTVBLvPE_PRH8-MSTfMBqzak0eI_UOlDw2m4ywjPnP6GRMuQdwwCa7bo_Jw5U Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79ab9b8dd9ee49b99ef75af3c106c9d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}] Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 97aff8e7683346c9987ce9c49a12a50a Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '16e34d60-b4e5-46a7-a5de-0b5a4a814d1d'} Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:06:37.533586 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.538050 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.547373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Returning 404 to user: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:37.548532 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-38822d48-e555-487d-9bc0-a66ee1a6d62b tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 404 len: 111 microversion: 2.1 time: 0.057265 Oct 11 20:06:37.550443 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2497/4963] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:06:37 2022] DELETE /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:06:37.557523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.558316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] [instance: 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:37.567678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:37.568686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:37.569375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.570958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:37.571843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:37.572933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:37.596188 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] HTTP exception thrown: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Request method failure captured: Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d HTTP/1.1 Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcypbRL-l0H8I0usuqRSR2HvZG3XNltKAXQAXU3NMkcijNuOuMmqmQzrY-WAuhmebvX2wPio013FvU9MHgF6xrP7AZtwz5XakXUcYMV8ziZ1W8QCsfiTVBLvPE_PRH8-MSTfMBqzak0eI_UOlDw2m4ywjPnP6GRMuQdwwCa7bo_Jw5U Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79ab9b8dd9ee49b99ef75af3c106c9d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}] Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 97aff8e7683346c9987ce9c49a12a50a Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '16e34d60-b4e5-46a7-a5de-0b5a4a814d1d'} Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.600148 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.609050 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.609050 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.609050 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.609050 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:37.609050 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:37.609050 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. Oct 11 20:06:37.609050 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.616117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Returning 404 to user: Instance 16e34d60-b4e5-46a7-a5de-0b5a4a814d1d could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:37.617123 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cfa64cf9-a2c7-4877-b169-7a1e1f37c827 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d" status: 404 len: 111 microversion: 2.1 time: 0.063653 Oct 11 20:06:37.617919 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2467/4964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:37 2022] GET /compute/v2.1/servers/16e34d60-b4e5-46a7-a5de-0b5a4a814d1d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:06:37.629489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5ce1f7bb-47c1-4b7b-b3c8-3676bbb9f929 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.645896 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-5ce1f7bb-47c1-4b7b-b3c8-3676bbb9f929 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] HTTP exception thrown: Instance group c5473736-c792-4d83-9617-196c5ec5fe6c could not be found. Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5ce1f7bb-47c1-4b7b-b3c8-3676bbb9f929 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Request method failure captured: Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-server-groups/c5473736-c792-4d83-9617-196c5ec5fe6c HTTP/1.1 Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcypbRL-l0H8I0usuqRSR2HvZG3XNltKAXQAXU3NMkcijNuOuMmqmQzrY-WAuhmebvX2wPio013FvU9MHgF6xrP7AZtwz5XakXUcYMV8ziZ1W8QCsfiTVBLvPE_PRH8-MSTfMBqzak0eI_UOlDw2m4ywjPnP6GRMuQdwwCa7bo_Jw5U Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79ab9b8dd9ee49b99ef75af3c106c9d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}] Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 97aff8e7683346c9987ce9c49a12a50a Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance group c5473736-c792-4d83-9617-196c5ec5fe6c could not be found. Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'c5473736-c792-4d83-9617-196c5ec5fe6c'} Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c5473736-c792-4d83-9617-196c5ec5fe6c could not be found. Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c5473736-c792-4d83-9617-196c5ec5fe6c could not be found. Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.647709 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.654698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.654698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.654698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:37.654698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:37.654698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c5473736-c792-4d83-9617-196c5ec5fe6c could not be found. Oct 11 20:06:37.654698 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.654698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5ce1f7bb-47c1-4b7b-b3c8-3676bbb9f929 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Returning 404 to user: Instance group c5473736-c792-4d83-9617-196c5ec5fe6c could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:37.654698 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5ce1f7bb-47c1-4b7b-b3c8-3676bbb9f929 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/c5473736-c792-4d83-9617-196c5ec5fe6c" status: 404 len: 117 microversion: 2.1 time: 0.025681 Oct 11 20:06:37.654698 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2498/4965] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 20:06:37 2022] DELETE /compute/v2.1/os-server-groups/c5473736-c792-4d83-9617-196c5ec5fe6c => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:06:37.661201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-43417d57-de92-4085-b10c-12b814fd5e15 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.669928 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-43417d57-de92-4085-b10c-12b814fd5e15 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] HTTP exception thrown: Instance group 75763706-fcff-470d-a2b0-c7b8dcee91b2 could not be found. Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-43417d57-de92-4085-b10c-12b814fd5e15 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Request method failure captured: Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-server-groups/75763706-fcff-470d-a2b0-c7b8dcee91b2 HTTP/1.1 Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcypbRL-l0H8I0usuqRSR2HvZG3XNltKAXQAXU3NMkcijNuOuMmqmQzrY-WAuhmebvX2wPio013FvU9MHgF6xrP7AZtwz5XakXUcYMV8ziZ1W8QCsfiTVBLvPE_PRH8-MSTfMBqzak0eI_UOlDw2m4ywjPnP6GRMuQdwwCa7bo_Jw5U Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79ab9b8dd9ee49b99ef75af3c106c9d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}] Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 97aff8e7683346c9987ce9c49a12a50a Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance group 75763706-fcff-470d-a2b0-c7b8dcee91b2 could not be found. Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '75763706-fcff-470d-a2b0-c7b8dcee91b2'} Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 75763706-fcff-470d-a2b0-c7b8dcee91b2 could not be found. Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 75763706-fcff-470d-a2b0-c7b8dcee91b2 could not be found. Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.680668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.685893 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.685893 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.685893 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:37.685893 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:37.685893 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 75763706-fcff-470d-a2b0-c7b8dcee91b2 could not be found. Oct 11 20:06:37.685893 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.685893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-43417d57-de92-4085-b10c-12b814fd5e15 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Returning 404 to user: Instance group 75763706-fcff-470d-a2b0-c7b8dcee91b2 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:37.685893 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-43417d57-de92-4085-b10c-12b814fd5e15 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/75763706-fcff-470d-a2b0-c7b8dcee91b2" status: 404 len: 117 microversion: 2.1 time: 0.025235 Oct 11 20:06:37.685893 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2468/4966] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 20:06:37 2022] DELETE /compute/v2.1/os-server-groups/75763706-fcff-470d-a2b0-c7b8dcee91b2 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:06:37.691903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a04a2ace-fe57-4941-b6c3-83e4f8fbb1e8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.715641 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a04a2ace-fe57-4941-b6c3-83e4f8fbb1e8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] HTTP exception thrown: Instance group 605f6d1e-3d45-4f9a-9903-24aed75cf711 could not be found. Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a04a2ace-fe57-4941-b6c3-83e4f8fbb1e8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Request method failure captured: Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-server-groups/605f6d1e-3d45-4f9a-9903-24aed75cf711 HTTP/1.1 Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcypbRL-l0H8I0usuqRSR2HvZG3XNltKAXQAXU3NMkcijNuOuMmqmQzrY-WAuhmebvX2wPio013FvU9MHgF6xrP7AZtwz5XakXUcYMV8ziZ1W8QCsfiTVBLvPE_PRH8-MSTfMBqzak0eI_UOlDw2m4ywjPnP6GRMuQdwwCa7bo_Jw5U Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79ab9b8dd9ee49b99ef75af3c106c9d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}] Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 97aff8e7683346c9987ce9c49a12a50a Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance group 605f6d1e-3d45-4f9a-9903-24aed75cf711 could not be found. Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '605f6d1e-3d45-4f9a-9903-24aed75cf711'} Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 605f6d1e-3d45-4f9a-9903-24aed75cf711 could not be found. Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 605f6d1e-3d45-4f9a-9903-24aed75cf711 could not be found. Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.721603 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.726634 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.726634 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.726634 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:37.726634 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:37.726634 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 605f6d1e-3d45-4f9a-9903-24aed75cf711 could not be found. Oct 11 20:06:37.726634 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.726634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a04a2ace-fe57-4941-b6c3-83e4f8fbb1e8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Returning 404 to user: Instance group 605f6d1e-3d45-4f9a-9903-24aed75cf711 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:37.726634 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a04a2ace-fe57-4941-b6c3-83e4f8fbb1e8 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/605f6d1e-3d45-4f9a-9903-24aed75cf711" status: 404 len: 117 microversion: 2.1 time: 0.035708 Oct 11 20:06:37.727267 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2499/4967] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 20:06:37 2022] DELETE /compute/v2.1/os-server-groups/605f6d1e-3d45-4f9a-9903-24aed75cf711 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:06:37.738355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5aa57fda-3635-4806-a588-1de6b701fcda tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.747047 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5aa57fda-3635-4806-a588-1de6b701fcda tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] HTTP exception thrown: Instance group c51336d7-0a95-46b6-aaa1-52853fc1f3c9 could not be found. Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5aa57fda-3635-4806-a588-1de6b701fcda tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Request method failure captured: Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/os-server-groups/c51336d7-0a95-46b6-aaa1-52853fc1f3c9 HTTP/1.1 Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcypbRL-l0H8I0usuqRSR2HvZG3XNltKAXQAXU3NMkcijNuOuMmqmQzrY-WAuhmebvX2wPio013FvU9MHgF6xrP7AZtwz5XakXUcYMV8ziZ1W8QCsfiTVBLvPE_PRH8-MSTfMBqzak0eI_UOlDw2m4ywjPnP6GRMuQdwwCa7bo_Jw5U Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79ab9b8dd9ee49b99ef75af3c106c9d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ab9b8dd9ee49b99ef75af3c106c9d9"}]}] Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 79ab9b8dd9ee49b99ef75af3c106c9d9 Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerGroupTestJSON-1261072080 Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 97aff8e7683346c9987ce9c49a12a50a Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerGroupTestJSON-1261072080-project Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance group c51336d7-0a95-46b6-aaa1-52853fc1f3c9 could not be found. Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'c51336d7-0a95-46b6-aaa1-52853fc1f3c9'} Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c51336d7-0a95-46b6-aaa1-52853fc1f3c9 could not be found. Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c51336d7-0a95-46b6-aaa1-52853fc1f3c9 could not be found. Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.748857 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:37.754032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:37.754032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:37.754032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:37.754032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:37.754032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c51336d7-0a95-46b6-aaa1-52853fc1f3c9 could not be found. Oct 11 20:06:37.754032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:37.757365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5aa57fda-3635-4806-a588-1de6b701fcda tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Returning 404 to user: Instance group c51336d7-0a95-46b6-aaa1-52853fc1f3c9 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:37.760578 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5aa57fda-3635-4806-a588-1de6b701fcda tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/c51336d7-0a95-46b6-aaa1-52853fc1f3c9" status: 404 len: 117 microversion: 2.1 time: 0.024417 Oct 11 20:06:37.762496 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2469/4968] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 20:06:37 2022] DELETE /compute/v2.1/os-server-groups/c51336d7-0a95-46b6-aaa1-52853fc1f3c9 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:06:37.771179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87361407-28e6-405e-b47f-b906c96f7379 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:37.812790 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87361407-28e6-405e-b47f-b906c96f7379 tempest-ServerGroupTestJSON-1261072080 tempest-ServerGroupTestJSON-1261072080-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/df0c4100-a27b-4706-80eb-319fbe5bb554" status: 204 len: 0 microversion: 2.1 time: 0.045281 Oct 11 20:06:37.813724 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2500/4969] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 20:06:37 2022] DELETE /compute/v2.1/os-server-groups/df0c4100-a27b-4706-80eb-319fbe5bb554 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:06:38.148023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-472ee2cb-038e-4590-b785-b9e6a0618a00 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:38.149129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-472ee2cb-038e-4590-b785-b9e6a0618a00 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:38.157152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-472ee2cb-038e-4590-b785-b9e6a0618a00 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:38.158076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-472ee2cb-038e-4590-b785-b9e6a0618a00 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:38.158830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-472ee2cb-038e-4590-b785-b9e6a0618a00 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:38.159732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-472ee2cb-038e-4590-b785-b9e6a0618a00 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:38.160416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-472ee2cb-038e-4590-b785-b9e6a0618a00 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:38.161193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-472ee2cb-038e-4590-b785-b9e6a0618a00 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:38.316511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:38.317742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:38.325756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:38.326585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:38.327384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:38.328358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:38.329072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:38.329726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:38.814222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:38.831478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:38.833551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:38.835628 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4128194f-1674-462b-b3a3-42dd39b8b6c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.523473 Oct 11 20:06:38.852993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-472ee2cb-038e-4590-b785-b9e6a0618a00 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:38.858056 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2501/4970] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:38 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:38.867043 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-472ee2cb-038e-4590-b785-b9e6a0618a00 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1696 microversion: 2.1 time: 0.723701 Oct 11 20:06:38.870591 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2470/4971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:38 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1696 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:38.873852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:38.875216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:38.883134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:38.883966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:38.884673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:38.885607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:38.886516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:38.887499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:39.060116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:39.094980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:39.097324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:39.098985 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0068a23d-f02a-483b-aabb-8622f263f713 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.234429 Oct 11 20:06:39.112802 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2502/4972] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:38 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:39.532681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:39.533396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:39.540827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:39.541616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:39.542214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:39.543265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:39.543903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:39.544501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:39.561746 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] HTTP exception thrown: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Request method failure captured: Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a HTTP/1.1 Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsBXe_18PED8arFm6RWfRK-01rqcQ6UU9NxZql4qoreJliwp_4b8Su6w4JFmoJ9zNuZomadjtqDz1x2uIqE7--x5GVN2lOX5_zUhL2rqoNqvFzXtD6kYZK3PRbuIWVxNGsSb79mVB2dAkp7qqxN8bWVojWByiubzKJFvBNuTIFUS5k Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e49d03e014e4749b522b6a87372994b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}] Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 27affa75f6a849ba802c1397406b201c Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '7a125d45-79ec-4fda-9601-334c311a9f7a'} Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:06:39.563777 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:39.569759 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:39.571746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Returning 404 to user: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:39.572857 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0d75f5a7-c265-45f6-9c67-b8ec850313d1 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 404 len: 111 microversion: 2.20 time: 0.044224 Oct 11 20:06:39.582580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:39.583770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 7a125d45-79ec-4fda-9601-334c311a9f7a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:39.588527 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2471/4973] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:06:39 2022] DELETE /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:06:39.593220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:39.593935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:39.594610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:39.595605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:39.596241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:39.596864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:39.612776 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] HTTP exception thrown: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Request method failure captured: Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a HTTP/1.1 Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcsBXe_18PED8arFm6RWfRK-01rqcQ6UU9NxZql4qoreJliwp_4b8Su6w4JFmoJ9zNuZomadjtqDz1x2uIqE7--x5GVN2lOX5_zUhL2rqoNqvFzXtD6kYZK3PRbuIWVxNGsSb79mVB2dAkp7qqxN8bWVojWByiubzKJFvBNuTIFUS5k Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e49d03e014e4749b522b6a87372994b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}] Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 27affa75f6a849ba802c1397406b201c Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '7a125d45-79ec-4fda-9601-334c311a9f7a'} Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:39.614790 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:39.621318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:39.621318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:39.621318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:39.621318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:39.621318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:39.621318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:39.621318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. Oct 11 20:06:39.621318 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:39.622953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Returning 404 to user: Instance 7a125d45-79ec-4fda-9601-334c311a9f7a could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:39.624203 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8d73e5cf-c158-43ce-91af-84e9bd698199 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a" status: 404 len: 111 microversion: 2.20 time: 0.045705 Oct 11 20:06:39.628337 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2503/4974] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:39 2022] GET /compute/v2.1/servers/7a125d45-79ec-4fda-9601-334c311a9f7a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:06:39.863987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:39.865348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:39.878467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:39.879327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:39.880008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:39.880950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:39.881625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:39.882289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:39.894403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-da58a70c-bd08-4cb8-8326-d3e09c620b37 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:39.895449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-da58a70c-bd08-4cb8-8326-d3e09c620b37 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:39.904408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da58a70c-bd08-4cb8-8326-d3e09c620b37 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:39.908667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da58a70c-bd08-4cb8-8326-d3e09c620b37 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:39.911676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da58a70c-bd08-4cb8-8326-d3e09c620b37 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:39.912520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da58a70c-bd08-4cb8-8326-d3e09c620b37 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:39.913071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da58a70c-bd08-4cb8-8326-d3e09c620b37 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:39.913581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da58a70c-bd08-4cb8-8326-d3e09c620b37 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:40.341114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:40.356972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:40.358457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:40.359703 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e3e0ad9b-97af-4202-825c-c6a4ceaeb386 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.499810 Oct 11 20:06:40.383592 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2472/4975] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:39 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:40.398359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:40.399015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:40.414611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:40.414890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:40.415537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:40.416443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:40.417101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:40.417524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:40.487065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-da58a70c-bd08-4cb8-8326-d3e09c620b37 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:40.497564 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-da58a70c-bd08-4cb8-8326-d3e09c620b37 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1696 microversion: 2.1 time: 0.607132 Oct 11 20:06:40.503847 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2504/4976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:39 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1696 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:06:40.541812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:40.553602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:40.563290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:40.571953 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f10b2be8-b729-4791-893f-2bd9c701dc4c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.186666 Oct 11 20:06:40.587167 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2473/4977] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:40 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:41.392250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:41.393648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:41.404659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:41.407887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:41.409068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:41.412000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:41.414768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:41.415347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:41.531256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a165e583-fa58-4581-ac7b-f339c7ac6358 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:41.532047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a165e583-fa58-4581-ac7b-f339c7ac6358 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:41.545991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a165e583-fa58-4581-ac7b-f339c7ac6358 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:41.547511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a165e583-fa58-4581-ac7b-f339c7ac6358 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:41.548196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a165e583-fa58-4581-ac7b-f339c7ac6358 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:41.549249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a165e583-fa58-4581-ac7b-f339c7ac6358 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:41.549949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a165e583-fa58-4581-ac7b-f339c7ac6358 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:41.550653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a165e583-fa58-4581-ac7b-f339c7ac6358 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:42.530578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a165e583-fa58-4581-ac7b-f339c7ac6358 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:42.539125 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a165e583-fa58-4581-ac7b-f339c7ac6358 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1696 microversion: 2.1 time: 1.011616 Oct 11 20:06:42.547890 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2474/4978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:41 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1696 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:06:42.559729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:42.560264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:42.560264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:42.566519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:42.569301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:42.569780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:42.570363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:42.570893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:42.571055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:42.571411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:42.571845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:42.572535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:42.574096 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-69d31b53-f427-47ae-a1d1-0dc8055df3ee tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 1.186009 Oct 11 20:06:42.588766 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2505/4979] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:41 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:42.602036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-158242270", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3044e01-188f-474d-8296-ce2a6945a204"}], "security_groups": [{"name": "tempest-securitygroup--73063741"}], "key_name": "tempest-keypair-1109846199", "user_data": "}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:42.765302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:42.781333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:42.783291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:42.784797 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c4cbc2f2-985f-4890-8419-b2b1f57ed28c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.236076 Oct 11 20:06:42.785612 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2475/4980] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:42 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:42.988002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] validate_networks() for [('e3044e01-188f-474d-8296-ce2a6945a204', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:06:43.562758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-49775933-46e0-4805-ae48-e108a7eea173 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:43.564156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-49775933-46e0-4805-ae48-e108a7eea173 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:43.570965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49775933-46e0-4805-ae48-e108a7eea173 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:43.571804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49775933-46e0-4805-ae48-e108a7eea173 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:43.572498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49775933-46e0-4805-ae48-e108a7eea173 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:43.575475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49775933-46e0-4805-ae48-e108a7eea173 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:43.576201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49775933-46e0-4805-ae48-e108a7eea173 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:43.576882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-49775933-46e0-4805-ae48-e108a7eea173 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.007176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-49775933-46e0-4805-ae48-e108a7eea173 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:44.021524 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-49775933-46e0-4805-ae48-e108a7eea173 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1696 microversion: 2.1 time: 0.463961 Oct 11 20:06:44.034551 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2476/4981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:43 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1696 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:06:44.054335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:44.055693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:44.063922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:44.065575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:44.067208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.068475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:44.069373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:44.070042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.416248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:06:44.418324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:06:44.419086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:06:44.420236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:06:44.420934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:06:44.439052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:44.442315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:44.443488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.444584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:44.447453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:44.452060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.497204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:44.510494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:44.514588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for user f4202e77bb27447ba5363091634d9731 and project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:44.532238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:44.533721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:44.534945 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-54823767-4da1-4464-adb0-10e5923779d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.498674 Oct 11 20:06:44.544690 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2477/4982] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:44 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:44.553111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:06:44.556752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:06:44.567337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:44.568001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:44.590566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:44.600073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:44.601162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.602097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:44.603521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:44.604241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.681713 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-be433ce8-8ec6-4482-ac3d-76f9667ba283 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.088386 Oct 11 20:06:44.683718 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2506/4983] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:06:42 2022] POST /compute/v2.1/servers => generated 400 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:06:44.696869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:44.700129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:44.711069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:44.711966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:44.713126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.716562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:44.717356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:44.717969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.740352 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] HTTP exception thrown: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Request method failure captured: Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 HTTP/1.1 Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcsBXe_18PED8arFm6RWfRK-01rqcQ6UU9NxZql4qoreJliwp_4b8Su6w4JFmoJ9zNuZomadjtqDz1x2uIqE7--x5GVN2lOX5_zUhL2rqoNqvFzXtD6kYZK3PRbuIWVxNGsSb79mVB2dAkp7qqxN8bWVojWByiubzKJFvBNuTIFUS5k Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e49d03e014e4749b522b6a87372994b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}] Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 27affa75f6a849ba802c1397406b201c Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '34e65c53-e164-4255-a2b8-4338069b7e47'} Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:06:44.742389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:06:44.748400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:06:44.751702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Returning 404 to user: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:44.752900 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c1edf1d-31de-434a-ab67-15633f13a54e tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 404 len: 111 microversion: 2.20 time: 0.067075 Oct 11 20:06:44.757534 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2507/4984] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:06:44 2022] DELETE /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:06:44.764711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c691f10-3935-41c2-9db5-d0bd6f7efaee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:44.765971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4c691f10-3935-41c2-9db5-d0bd6f7efaee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:44.796229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:44.815491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:44.816884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:44.822820 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97d1ba7c-3f06-49fc-a2a0-a1a278136559 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.276699 Oct 11 20:06:44.823558 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2478/4985] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:44 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:44.837553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:44.838552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] [instance: 34e65c53-e164-4255-a2b8-4338069b7e47] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:44.856081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:44.858771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:44.859489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.860452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:44.864028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:44.864827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:44.884832 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] HTTP exception thrown: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Request method failure captured: Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 HTTP/1.1 Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcsBXe_18PED8arFm6RWfRK-01rqcQ6UU9NxZql4qoreJliwp_4b8Su6w4JFmoJ9zNuZomadjtqDz1x2uIqE7--x5GVN2lOX5_zUhL2rqoNqvFzXtD6kYZK3PRbuIWVxNGsSb79mVB2dAkp7qqxN8bWVojWByiubzKJFvBNuTIFUS5k Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3e49d03e014e4749b522b6a87372994b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3e49d03e014e4749b522b6a87372994b"}]}] Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 3e49d03e014e4749b522b6a87372994b Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1825344811 Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 27affa75f6a849ba802c1397406b201c Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1825344811-project Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '34e65c53-e164-4255-a2b8-4338069b7e47'} Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:44.887511 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:06:44.891916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:44.891916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:06:44.891916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:06:44.891916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:06:44.891916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:06:44.891916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:06:44.891916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. Oct 11 20:06:44.891916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:06:44.895238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] Returning 404 to user: Instance 34e65c53-e164-4255-a2b8-4338069b7e47 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:06:44.896409 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8e07551e-aa34-4981-899e-75fe544aab75 tempest-AttachVolumeShelveTestJSON-1825344811 tempest-AttachVolumeShelveTestJSON-1825344811-project] 10.222.0.27 "GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47" status: 404 len: 111 microversion: 2.20 time: 0.070580 Oct 11 20:06:44.896545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4c691f10-3935-41c2-9db5-d0bd6f7efaee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:44.901312 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2479/4986] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:44 2022] GET /compute/v2.1/servers/34e65c53-e164-4255-a2b8-4338069b7e47 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:06:44.909278 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4c691f10-3935-41c2-9db5-d0bd6f7efaee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1241 microversion: 2.1 time: 0.150293 Oct 11 20:06:44.926406 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2508/4987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:44 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1241 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:45.050015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4e49850-cc74-44d3-9a1c-74873b84d686 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:45.050877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a4e49850-cc74-44d3-9a1c-74873b84d686 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:45.102499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e49850-cc74-44d3-9a1c-74873b84d686 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:45.102499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e49850-cc74-44d3-9a1c-74873b84d686 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:45.102499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e49850-cc74-44d3-9a1c-74873b84d686 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:45.102499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e49850-cc74-44d3-9a1c-74873b84d686 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:45.102499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e49850-cc74-44d3-9a1c-74873b84d686 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:45.102499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e49850-cc74-44d3-9a1c-74873b84d686 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:45.529225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a4e49850-cc74-44d3-9a1c-74873b84d686 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:45.539770 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a4e49850-cc74-44d3-9a1c-74873b84d686 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1696 microversion: 2.1 time: 0.497120 Oct 11 20:06:45.556606 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2480/4988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:45 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1696 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:45.562019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:45.562566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:45.588288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:45.588787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:45.589857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:45.591079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:45.591727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:45.592183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:45.853490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:45.854127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:45.865499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:45.866581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:45.867265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:45.868775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:45.869425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:45.871018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:45.960470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:45.973261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:45.975535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:45.982060 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f849e1d3-14cd-4e9e-86f5-0bea7d001740 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.424572 Oct 11 20:06:45.983179 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2509/4989] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:45 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:45.990932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f0b15bdf-4a1a-4420-9b47-f50ef483ea31 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:45.992063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f0b15bdf-4a1a-4420-9b47-f50ef483ea31 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:46.001705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0b15bdf-4a1a-4420-9b47-f50ef483ea31 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:46.002426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0b15bdf-4a1a-4420-9b47-f50ef483ea31 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:46.003267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0b15bdf-4a1a-4420-9b47-f50ef483ea31 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:46.004407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0b15bdf-4a1a-4420-9b47-f50ef483ea31 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:46.005166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0b15bdf-4a1a-4420-9b47-f50ef483ea31 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:46.006057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f0b15bdf-4a1a-4420-9b47-f50ef483ea31 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:46.063486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:46.081731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:46.083242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:46.088226 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4680656b-ec9f-41e7-8693-a5e1a9f90e63 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.237054 Oct 11 20:06:46.090637 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2481/4990] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:45 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:46.142318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f0b15bdf-4a1a-4420-9b47-f50ef483ea31 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:46.157228 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f0b15bdf-4a1a-4420-9b47-f50ef483ea31 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1293 microversion: 2.1 time: 0.171752 Oct 11 20:06:46.171345 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2510/4991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:45 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1293 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:46.567217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0951c85a-c887-444f-aaa2-9fd05aee1507 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:46.568979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0951c85a-c887-444f-aaa2-9fd05aee1507 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:46.579193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0951c85a-c887-444f-aaa2-9fd05aee1507 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:46.579947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0951c85a-c887-444f-aaa2-9fd05aee1507 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:46.580618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0951c85a-c887-444f-aaa2-9fd05aee1507 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:46.581521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0951c85a-c887-444f-aaa2-9fd05aee1507 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:46.581984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0951c85a-c887-444f-aaa2-9fd05aee1507 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:46.582606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0951c85a-c887-444f-aaa2-9fd05aee1507 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:46.693991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1927559849", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": "none"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:46.773051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:06:46.773638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:06:46.774348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:06:46.774929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:06:46.776331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:06:46.798619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:46.799281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:46.800636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:46.802591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:46.803321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:46.803850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:46.826084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Getting quotas for project 9e3c76e010614490bb54b046f8a38909. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:06:46.829340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:46.834043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Getting quotas for user 9a2d866682094b2c91374bc05a7d7c1c and project 9e3c76e010614490bb54b046f8a38909. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:06:46.851360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:06:46.854556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:06:46.915326 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eadb085f-3dd8-438c-a5c2-5ef0565b9b38 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.541403 Oct 11 20:06:46.916578 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2482/4992] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 20:06:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 20:06:46.928519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b4748404-9a16-47e3-a896-36480ff28eee tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:46.929463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b4748404-9a16-47e3-a896-36480ff28eee tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:47.307921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b4748404-9a16-47e3-a896-36480ff28eee tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.326962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b4748404-9a16-47e3-a896-36480ff28eee tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.330871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b4748404-9a16-47e3-a896-36480ff28eee tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.333082 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b4748404-9a16-47e3-a896-36480ff28eee tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1278 microversion: 2.57 time: 0.408584 Oct 11 20:06:47.354981 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2483/4993] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:46 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1278 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:47.364495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:47.365426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:47.374971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:47.376250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:47.376810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0951c85a-c887-444f-aaa2-9fd05aee1507 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.377266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:47.378183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:47.379796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:47.380428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:47.387763 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0951c85a-c887-444f-aaa2-9fd05aee1507 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1696 microversion: 2.1 time: 0.824749 Oct 11 20:06:47.388360 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2511/4994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:46 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1696 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:47.399846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:47.400868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:47.413381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:47.413957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:47.414318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:47.415057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:47.415519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:47.415949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:47.588130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.603645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.606591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.608150 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-07ec2374-011a-4485-874e-bff16e8a2891 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.216544 Oct 11 20:06:47.609936 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2512/4995] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:47 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:47.616407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99a16230-e646-4b97-a480-75a433dbcdc2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:47.617375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-99a16230-e646-4b97-a480-75a433dbcdc2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:47.627402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99a16230-e646-4b97-a480-75a433dbcdc2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:47.628311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99a16230-e646-4b97-a480-75a433dbcdc2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:47.629059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99a16230-e646-4b97-a480-75a433dbcdc2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:47.631515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99a16230-e646-4b97-a480-75a433dbcdc2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:47.633067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99a16230-e646-4b97-a480-75a433dbcdc2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:47.633769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99a16230-e646-4b97-a480-75a433dbcdc2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:47.757451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-99a16230-e646-4b97-a480-75a433dbcdc2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.772168 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99a16230-e646-4b97-a480-75a433dbcdc2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1299 microversion: 2.1 time: 0.160543 Oct 11 20:06:47.773531 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2513/4996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:47 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:47.922036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.939993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.945810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:47.950051 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e562cdd2-c055-4bc7-8043-876876629adb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.593729 Oct 11 20:06:47.970555 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2484/4997] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:47 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:48.372471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:48.373095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:48.385070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:48.386013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:48.397367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:48.398887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:48.399421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:48.399862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:48.414481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5d64c99-a135-4c05-b975-c9926d5cbf74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:48.415340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c5d64c99-a135-4c05-b975-c9926d5cbf74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:48.425915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5d64c99-a135-4c05-b975-c9926d5cbf74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:48.426732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5d64c99-a135-4c05-b975-c9926d5cbf74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:48.428237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5d64c99-a135-4c05-b975-c9926d5cbf74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:48.429930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5d64c99-a135-4c05-b975-c9926d5cbf74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:48.433992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5d64c99-a135-4c05-b975-c9926d5cbf74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:48.434776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5d64c99-a135-4c05-b975-c9926d5cbf74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:48.564395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:48.579067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:48.583416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:48.588017 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f7c4de18-e080-4207-9232-ad48d8bf4437 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1330 microversion: 2.57 time: 0.221550 Oct 11 20:06:48.590298 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2514/4998] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:48 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1330 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:48.641190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:48.641922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:48.649803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:48.655810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:48.656445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:48.657431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:48.658032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:48.660212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:48.736733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c5d64c99-a135-4c05-b975-c9926d5cbf74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:48.749368 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c5d64c99-a135-4c05-b975-c9926d5cbf74 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1696 microversion: 2.1 time: 0.340276 Oct 11 20:06:48.763293 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2485/4999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:48 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1696 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:06:48.797150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-099fbe12-a51b-402c-8f46-86877913b0a0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:48.797774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-099fbe12-a51b-402c-8f46-86877913b0a0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:48.811581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099fbe12-a51b-402c-8f46-86877913b0a0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:48.814218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099fbe12-a51b-402c-8f46-86877913b0a0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:48.814813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099fbe12-a51b-402c-8f46-86877913b0a0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:48.815580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099fbe12-a51b-402c-8f46-86877913b0a0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:48.816050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099fbe12-a51b-402c-8f46-86877913b0a0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:48.818845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099fbe12-a51b-402c-8f46-86877913b0a0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:48.819504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:48.832789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:48.834430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:48.843289 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c128d73-a442-4020-ba7e-8402c6b5a668 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.206597 Oct 11 20:06:48.844067 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2515/5000] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:48 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:48.862709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:48.981877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:48.982503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:48.994134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:48.995093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:48.996249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:48.997369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:48.999081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:48.999694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:49.188308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-099fbe12-a51b-402c-8f46-86877913b0a0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:49.199797 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-099fbe12-a51b-402c-8f46-86877913b0a0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1365 microversion: 2.1 time: 0.405759 Oct 11 20:06:49.201180 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2486/5001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:48 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1365 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:06:49.434642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:49.447129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:49.452804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:49.459637 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bd1dc786-e33e-4d58-8a07-f76e016357c9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.482251 Oct 11 20:06:49.460888 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2516/5002] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:48 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:49.618173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:49.619130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:49.642721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:49.644633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:49.645692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:49.647895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:49.648553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:49.649265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:49.752218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:49.773824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1cd00d6-eab5-49fe-ba3d-159994e5db64 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:49.775019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1cd00d6-eab5-49fe-ba3d-159994e5db64 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:49.782318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:49.783643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1cd00d6-eab5-49fe-ba3d-159994e5db64 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:49.784314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1cd00d6-eab5-49fe-ba3d-159994e5db64 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:49.784913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1cd00d6-eab5-49fe-ba3d-159994e5db64 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:49.785963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1cd00d6-eab5-49fe-ba3d-159994e5db64 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:49.786691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1cd00d6-eab5-49fe-ba3d-159994e5db64 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:49.787283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:49.787760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1cd00d6-eab5-49fe-ba3d-159994e5db64 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:49.791321 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1ed97906-20d9-4fd2-8ecf-b09080972569 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1338 microversion: 2.57 time: 0.178069 Oct 11 20:06:49.802816 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2487/5003] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:49 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1338 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:49.877936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:49.878871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:49.891218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:49.895212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:49.897372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:49.899900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:49.903879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:49.905313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:50.141416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.157307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.162482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.164193 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-43526196-cda4-402f-86c4-362df5383816 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.290911 Oct 11 20:06:50.165127 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2488/5004] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:49 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:50.234480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b5d4e03e-1165-4836-98aa-faa6bf43212b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:50.236009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b5d4e03e-1165-4836-98aa-faa6bf43212b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:50.243647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d4e03e-1165-4836-98aa-faa6bf43212b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:50.244470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d4e03e-1165-4836-98aa-faa6bf43212b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:50.245194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d4e03e-1165-4836-98aa-faa6bf43212b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:50.246195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d4e03e-1165-4836-98aa-faa6bf43212b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:50.246936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d4e03e-1165-4836-98aa-faa6bf43212b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:50.247494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5d4e03e-1165-4836-98aa-faa6bf43212b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:50.422661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f1cd00d6-eab5-49fe-ba3d-159994e5db64 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.436900 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1cd00d6-eab5-49fe-ba3d-159994e5db64 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1696 microversion: 2.1 time: 0.665409 Oct 11 20:06:50.439087 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2517/5005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:49 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1696 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:50.487923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:50.488751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:50.501873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:50.504227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:50.520197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:50.524237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:50.528851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:50.529859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:50.576461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b5d4e03e-1165-4836-98aa-faa6bf43212b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.587276 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b5d4e03e-1165-4836-98aa-faa6bf43212b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1365 microversion: 2.1 time: 0.362826 Oct 11 20:06:50.593421 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2489/5006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:50 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:50.824062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:50.824973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:50.831964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:50.832897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:50.833522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:50.834436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:50.835395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:50.835875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:50.919975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.935020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.939754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.952691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.957570 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7014bb20-1286-42cf-8fa7-1d18dcf8a36b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.474885 Oct 11 20:06:50.972713 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2518/5007] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:50 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:50.982075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.989447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-56d2bb95-1cdd-4153-8eb9-9c178bcd68e1 req-013adcbb-1da2-4bed-ae66-6468175c6925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc1cee7-9aca-468a-9d10-9f985b7adcbe", "tag": "69d6abd1-2254-46cc-8590-0ba134f40ebf"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:50.990086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:50.993444 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bf9b5a90-f2c1-4ac6-8971-a0c1ac2cbae6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1336 microversion: 2.57 time: 0.175773 Oct 11 20:06:50.998431 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2490/5008] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:50 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1336 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:51.009572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-56d2bb95-1cdd-4153-8eb9-9c178bcd68e1 req-013adcbb-1da2-4bed-ae66-6468175c6925 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:51.010249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-56d2bb95-1cdd-4153-8eb9-9c178bcd68e1 req-013adcbb-1da2-4bed-ae66-6468175c6925 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:51.015847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-56d2bb95-1cdd-4153-8eb9-9c178bcd68e1 req-013adcbb-1da2-4bed-ae66-6468175c6925 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:51.035217 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-56d2bb95-1cdd-4153-8eb9-9c178bcd68e1 req-013adcbb-1da2-4bed-ae66-6468175c6925 service nova] Creating event network-changed:69d6abd1-2254-46cc-8590-0ba134f40ebf for instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe on n-h2-860864-3 Oct 11 20:06:51.054203 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-56d2bb95-1cdd-4153-8eb9-9c178bcd68e1 req-013adcbb-1da2-4bed-ae66-6468175c6925 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077204 Oct 11 20:06:51.056032 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2519/5009] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:51.193888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:51.194435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:51.205949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:51.208289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:51.208922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:51.212365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:51.213027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:51.216750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:51.355724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:51.367528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:51.369802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:51.372436 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b4820291-d5d0-4897-847c-4a7c7390cc09 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.184118 Oct 11 20:06:51.373505 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2491/5010] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:51 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:51.613369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-921f5ec7-32ac-4564-84b4-a344cfe5d230 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:51.614509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-921f5ec7-32ac-4564-84b4-a344cfe5d230 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:51.627770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921f5ec7-32ac-4564-84b4-a344cfe5d230 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:51.628435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921f5ec7-32ac-4564-84b4-a344cfe5d230 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:51.628999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921f5ec7-32ac-4564-84b4-a344cfe5d230 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:51.631786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921f5ec7-32ac-4564-84b4-a344cfe5d230 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:51.632737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921f5ec7-32ac-4564-84b4-a344cfe5d230 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:51.636787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-921f5ec7-32ac-4564-84b4-a344cfe5d230 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:51.770265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c879f226-9f5e-4822-84d0-98fd6c0933a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:51.771772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c879f226-9f5e-4822-84d0-98fd6c0933a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:51.797597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c879f226-9f5e-4822-84d0-98fd6c0933a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:51.798375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c879f226-9f5e-4822-84d0-98fd6c0933a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:51.799088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c879f226-9f5e-4822-84d0-98fd6c0933a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:51.799993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c879f226-9f5e-4822-84d0-98fd6c0933a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:51.800629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c879f226-9f5e-4822-84d0-98fd6c0933a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:51.801231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c879f226-9f5e-4822-84d0-98fd6c0933a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:52.418713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-921f5ec7-32ac-4564-84b4-a344cfe5d230 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:52.431289 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-921f5ec7-32ac-4564-84b4-a344cfe5d230 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1365 microversion: 2.1 time: 0.821760 Oct 11 20:06:52.447086 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2492/5011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:51 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1365 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:06:52.453483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:52.454352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:52.461446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:52.462212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:52.462686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:52.463568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:52.464792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:52.465478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:52.753124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c879f226-9f5e-4822-84d0-98fd6c0933a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:52.788219 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c879f226-9f5e-4822-84d0-98fd6c0933a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1695 microversion: 2.1 time: 1.327136 Oct 11 20:06:52.789462 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2520/5012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:51 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1695 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:52.827776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:52.830932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:52.848044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:52.850118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:52.851056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:52.854101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:52.862478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:52.863811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.191151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:53.204921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:53.210721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:53.212614 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a670e1c3-df1d-4fd2-814c-d92f74016811 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1357 microversion: 2.57 time: 0.421852 Oct 11 20:06:53.215181 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2521/5013] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:52 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1357 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:53.235002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:53.235627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:53.242012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.242519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.242987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.243686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.246318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.249022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.253060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:53.272313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:53.274306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:53.275804 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dff597e0-7088-4a50-a364-56a1e36c70a7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.827407 Oct 11 20:06:53.276968 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2493/5014] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:52 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:53.286666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-cd796db0-4cfb-4fbb-8c1c-245da4c1a6a8 req-33d78221-da0b-44bd-adbf-170aac6f19da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "name": "network-vif-unplugged", "status": "completed", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:53.337704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd796db0-4cfb-4fbb-8c1c-245da4c1a6a8 req-33d78221-da0b-44bd-adbf-170aac6f19da service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.338215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd796db0-4cfb-4fbb-8c1c-245da4c1a6a8 req-33d78221-da0b-44bd-adbf-170aac6f19da service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.340196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-cd796db0-4cfb-4fbb-8c1c-245da4c1a6a8 req-33d78221-da0b-44bd-adbf-170aac6f19da service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.354298 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-cd796db0-4cfb-4fbb-8c1c-245da4c1a6a8 req-33d78221-da0b-44bd-adbf-170aac6f19da service nova] Creating event network-vif-unplugged:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h2-860864-3 Oct 11 20:06:53.360860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-cd796db0-4cfb-4fbb-8c1c-245da4c1a6a8 req-33d78221-da0b-44bd-adbf-170aac6f19da service nova] Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:06:53.376714 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-cd796db0-4cfb-4fbb-8c1c-245da4c1a6a8 req-33d78221-da0b-44bd-adbf-170aac6f19da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098347 Oct 11 20:06:53.381134 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2494/5015] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:53.389207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:53.394019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:53.403306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.403854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.404387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.405625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.406438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.407235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.422798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:53.467412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:53.471730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:53.485989 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cb9ebcda-e3b6-4c20-90fc-3e929f5ec6cc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.259241 Oct 11 20:06:53.500024 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2522/5016] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:53 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:53.518445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6de40e7d-1ee3-4a1c-bcf3-b50e21ee033f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:53.520118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6de40e7d-1ee3-4a1c-bcf3-b50e21ee033f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:53.530401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6de40e7d-1ee3-4a1c-bcf3-b50e21ee033f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.531150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6de40e7d-1ee3-4a1c-bcf3-b50e21ee033f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.531790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6de40e7d-1ee3-4a1c-bcf3-b50e21ee033f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.532714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6de40e7d-1ee3-4a1c-bcf3-b50e21ee033f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.533343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6de40e7d-1ee3-4a1c-bcf3-b50e21ee033f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.534458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6de40e7d-1ee3-4a1c-bcf3-b50e21ee033f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.588497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:06:53.589174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:06:53.589470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:06:53.589882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:06:53.590291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:06:53.687725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:53.696025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.696804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.697268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.698048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.698723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.699570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.766355 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-69eaf241-335c-4bb6-a14b-fed568cd1f9a tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "POST /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51/action" status: 202 len: 1138 microversion: 2.57 time: 0.383501 Oct 11 20:06:53.779636 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2495/5017] 10.222.0.27 () {62 vars in 1320 bytes} [Tue Oct 11 20:06:53 2022] POST /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51/action => generated 1138 bytes in 397 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 20:06:53.794824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:53.796767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:53.814583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.817276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.817907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.832107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:53.832615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:53.833060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:53.973876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6de40e7d-1ee3-4a1c-bcf3-b50e21ee033f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:53.987681 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6de40e7d-1ee3-4a1c-bcf3-b50e21ee033f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1365 microversion: 2.1 time: 0.479600 Oct 11 20:06:53.989038 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2523/5018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:53 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1365 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:53.994687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae50a2eb-89d0-4dde-8b95-de66dc9d2804 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:53.996206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ae50a2eb-89d0-4dde-8b95-de66dc9d2804 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:54.006281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae50a2eb-89d0-4dde-8b95-de66dc9d2804 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:54.006810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae50a2eb-89d0-4dde-8b95-de66dc9d2804 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:54.007254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae50a2eb-89d0-4dde-8b95-de66dc9d2804 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:54.007970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae50a2eb-89d0-4dde-8b95-de66dc9d2804 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:54.009419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae50a2eb-89d0-4dde-8b95-de66dc9d2804 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:54.010062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae50a2eb-89d0-4dde-8b95-de66dc9d2804 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:54.077719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:54.089901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:54.096629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:54.106498 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b212a155-0331-48fe-ba9c-465556b96dda tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.310038 Oct 11 20:06:54.107644 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2496/5019] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:53 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:54.307038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:54.308036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:54.320698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:54.321401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:54.322029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:54.322935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:54.324161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:54.324923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:54.475842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:54.736667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae50a2eb-89d0-4dde-8b95-de66dc9d2804 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:54.750038 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae50a2eb-89d0-4dde-8b95-de66dc9d2804 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1695 microversion: 2.1 time: 0.759246 Oct 11 20:06:54.752094 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2524/5020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:53 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1695 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:54.759987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:54.761370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:54.769900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:54.770346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:54.770817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:54.771522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:54.771968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:54.772570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:54.802936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:54.901621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:54.993634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:55.007380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:55.009489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:55.012975 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c38ac064-1be6-4807-a8d8-6d74975d29fd tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.256649 Oct 11 20:06:55.013835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2525/5021] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:54 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:55.018353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:55.019550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eba8c019-78b3-4899-b483-fc99b1fa78bb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:55.020453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eba8c019-78b3-4899-b483-fc99b1fa78bb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:55.030907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eba8c019-78b3-4899-b483-fc99b1fa78bb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:55.031754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eba8c019-78b3-4899-b483-fc99b1fa78bb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:55.033734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eba8c019-78b3-4899-b483-fc99b1fa78bb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:55.035007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eba8c019-78b3-4899-b483-fc99b1fa78bb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:55.036588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:55.038959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eba8c019-78b3-4899-b483-fc99b1fa78bb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:55.039108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:55.039640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eba8c019-78b3-4899-b483-fc99b1fa78bb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:55.040373 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-63a70f96-7925-41b5-971d-1c0e25f800ef tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.737086 Oct 11 20:06:55.041406 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2497/5022] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:54 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:55.139350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:55.140473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:55.147441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:55.148295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:55.149131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:55.150115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:55.150946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:55.152021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:55.337569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:55.347822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:55.349685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:55.351701 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a486ef00-88b6-4a98-95f2-9025f8521db0 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.217905 Oct 11 20:06:55.352721 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2498/5023] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:55 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:55.415738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c4555dde-cf55-4ed6-9b86-aa39a98e6855 req-ac94fb9c-55a1-41f8-b83a-5b5821ce65e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:55.426792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c4555dde-cf55-4ed6-9b86-aa39a98e6855 req-ac94fb9c-55a1-41f8-b83a-5b5821ce65e3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:55.428396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c4555dde-cf55-4ed6-9b86-aa39a98e6855 req-ac94fb9c-55a1-41f8-b83a-5b5821ce65e3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:55.428940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c4555dde-cf55-4ed6-9b86-aa39a98e6855 req-ac94fb9c-55a1-41f8-b83a-5b5821ce65e3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:55.443409 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c4555dde-cf55-4ed6-9b86-aa39a98e6855 req-ac94fb9c-55a1-41f8-b83a-5b5821ce65e3 service nova] Creating event network-changed:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h2-860864-3 Oct 11 20:06:55.452542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-c4555dde-cf55-4ed6-9b86-aa39a98e6855 req-ac94fb9c-55a1-41f8-b83a-5b5821ce65e3 service nova] Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:06:55.465606 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c4555dde-cf55-4ed6-9b86-aa39a98e6855 req-ac94fb9c-55a1-41f8-b83a-5b5821ce65e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053785 Oct 11 20:06:55.466817 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2499/5024] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:06:55.502595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eba8c019-78b3-4899-b483-fc99b1fa78bb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:55.521492 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eba8c019-78b3-4899-b483-fc99b1fa78bb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1365 microversion: 2.1 time: 0.506210 Oct 11 20:06:55.524103 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2526/5025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:55 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1365 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:55.781202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-70547542-ab5e-46bb-a7b0-33b5f8653613 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:55.782869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-70547542-ab5e-46bb-a7b0-33b5f8653613 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:55.791477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70547542-ab5e-46bb-a7b0-33b5f8653613 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:55.793035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70547542-ab5e-46bb-a7b0-33b5f8653613 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:55.793944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70547542-ab5e-46bb-a7b0-33b5f8653613 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:55.795130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70547542-ab5e-46bb-a7b0-33b5f8653613 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:55.795896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70547542-ab5e-46bb-a7b0-33b5f8653613 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:55.796707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70547542-ab5e-46bb-a7b0-33b5f8653613 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:56.040128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:56.042054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:56.055022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:56.055848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:56.056446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:56.062843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:56.063450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:56.063900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:56.377642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.397851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.399594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.400782 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-403b0069-d4a1-426d-ac77-93a815ea7e36 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.364973 Oct 11 20:06:56.401427 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2527/5026] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:56 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:56.414407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:56.415171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:56.427675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:56.428462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:56.429104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:56.430261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:56.430583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:56.431021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:56.571261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-70547542-ab5e-46bb-a7b0-33b5f8653613 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.590184 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-70547542-ab5e-46bb-a7b0-33b5f8653613 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1695 microversion: 2.1 time: 0.812613 Oct 11 20:06:56.591996 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2500/5027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:55 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1695 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:56.624801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:56.627108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:56.640392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:56.640911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:56.641372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:56.642086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:56.642728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:56.643170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:56.761005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.773380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:56.778967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.781388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.782963 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-96320024-d265-4e4e-880a-6257a27c55de tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.189783 Oct 11 20:06:56.783918 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2501/5028] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:56 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:56.790556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0f997fe8-e7d6-4462-a5e7-bf1468e290fb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:56.791451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0f997fe8-e7d6-4462-a5e7-bf1468e290fb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:56.800418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f997fe8-e7d6-4462-a5e7-bf1468e290fb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:56.802042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f997fe8-e7d6-4462-a5e7-bf1468e290fb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:56.802730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f997fe8-e7d6-4462-a5e7-bf1468e290fb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:56.803631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f997fe8-e7d6-4462-a5e7-bf1468e290fb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:56.804711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f997fe8-e7d6-4462-a5e7-bf1468e290fb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:56.805347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f997fe8-e7d6-4462-a5e7-bf1468e290fb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:56.811178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.826495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.828256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.829710 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ca7200ad-e8fc-43c7-b1fe-5773c7e9689d tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.427074 Oct 11 20:06:56.830795 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2528/5029] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:56 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:56.833736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:56.972663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0f997fe8-e7d6-4462-a5e7-bf1468e290fb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:56.982885 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0f997fe8-e7d6-4462-a5e7-bf1468e290fb tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1365 microversion: 2.1 time: 0.197125 Oct 11 20:06:56.983634 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2502/5030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:56 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:57.431662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:57.434257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:57.443554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:57.444200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:57.444656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:57.445357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:57.445994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:57.447137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:57.539928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:57.548900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:57.550346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:57.551536 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f9965156-3914-4fab-b2f5-5772d5067263 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.126023 Oct 11 20:06:57.552163 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2529/5031] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:57 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:57.616572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-caa18ea6-b042-4942-9c33-6c8b2ecde890 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:57.618478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-caa18ea6-b042-4942-9c33-6c8b2ecde890 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:57.627214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=12 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:57.629200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa18ea6-b042-4942-9c33-6c8b2ecde890 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:57.630079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa18ea6-b042-4942-9c33-6c8b2ecde890 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:57.630827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa18ea6-b042-4942-9c33-6c8b2ecde890 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:57.631992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa18ea6-b042-4942-9c33-6c8b2ecde890 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:57.632659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa18ea6-b042-4942-9c33-6c8b2ecde890 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:57.633793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa18ea6-b042-4942-9c33-6c8b2ecde890 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:57.797785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-caa18ea6-b042-4942-9c33-6c8b2ecde890 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:57.813095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:57.814057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:57.824781 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-caa18ea6-b042-4942-9c33-6c8b2ecde890 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1693 microversion: 2.1 time: 0.210950 Oct 11 20:06:57.825522 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2503/5032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:57 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1693 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:57.826989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:57.828424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:57.829412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:57.830445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:57.830934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:57.831358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:57.861396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:57.862880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:57.872484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:57.873240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:57.873929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:57.874914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:57.875628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:57.876124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:57.915389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:57.926187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:57.929189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:57.931244 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ed2b0ef8-bca4-49ac-9ee5-39061fb0a552 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.124054 Oct 11 20:06:57.943535 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2530/5033] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:57 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:58.006320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-84b38889-ff4a-4b53-8786-2e7c2903f040 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:58.006972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-84b38889-ff4a-4b53-8786-2e7c2903f040 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:58.015744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84b38889-ff4a-4b53-8786-2e7c2903f040 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:58.016515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84b38889-ff4a-4b53-8786-2e7c2903f040 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:58.017128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84b38889-ff4a-4b53-8786-2e7c2903f040 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:58.018177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84b38889-ff4a-4b53-8786-2e7c2903f040 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:58.018849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84b38889-ff4a-4b53-8786-2e7c2903f040 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:58.019478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84b38889-ff4a-4b53-8786-2e7c2903f040 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:58.225510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:58.240224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:58.241756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:58.243388 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a60bd24-c1ee-4f80-868d-90f14fa8c93f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.389215 Oct 11 20:06:58.259497 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2504/5034] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:57 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:06:58.294812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-84b38889-ff4a-4b53-8786-2e7c2903f040 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:58.305796 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-84b38889-ff4a-4b53-8786-2e7c2903f040 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1365 microversion: 2.1 time: 0.303157 Oct 11 20:06:58.306821 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2531/5035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:58 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:06:58.378596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e353d048-4d20-4fdf-8178-b48b3f345a2d req-bd9ddf8e-b3f5-4707-abe0-f2bc1175bf49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc1cee7-9aca-468a-9d10-9f985b7adcbe", "name": "network-vif-plugged", "status": "completed", "tag": "69d6abd1-2254-46cc-8590-0ba134f40ebf"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:06:58.390111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e353d048-4d20-4fdf-8178-b48b3f345a2d req-bd9ddf8e-b3f5-4707-abe0-f2bc1175bf49 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:58.390630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e353d048-4d20-4fdf-8178-b48b3f345a2d req-bd9ddf8e-b3f5-4707-abe0-f2bc1175bf49 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:58.391210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e353d048-4d20-4fdf-8178-b48b3f345a2d req-bd9ddf8e-b3f5-4707-abe0-f2bc1175bf49 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:58.430165 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e353d048-4d20-4fdf-8178-b48b3f345a2d req-bd9ddf8e-b3f5-4707-abe0-f2bc1175bf49 service nova] Creating event network-vif-plugged:69d6abd1-2254-46cc-8590-0ba134f40ebf for instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe on n-h2-860864-3 Oct 11 20:06:58.438040 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e353d048-4d20-4fdf-8178-b48b3f345a2d req-bd9ddf8e-b3f5-4707-abe0-f2bc1175bf49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063358 Oct 11 20:06:58.439230 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2505/5036] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:06:58.580439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:58.581722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:58.590627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:58.591310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:58.591970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:58.592769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:58.593467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:58.593797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:58.674543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:58.683800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:58.685249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:58.686416 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99551f1e-f72c-41a5-a646-e7bb1397488b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.109931 Oct 11 20:06:58.705252 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2532/5037] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:58 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:58.850236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d8b8e6af-6716-423a-9601-e1ad48436fea tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:58.851222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d8b8e6af-6716-423a-9601-e1ad48436fea tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:58.863243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b8e6af-6716-423a-9601-e1ad48436fea tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:58.864093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b8e6af-6716-423a-9601-e1ad48436fea tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:58.864541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b8e6af-6716-423a-9601-e1ad48436fea tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:58.865261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b8e6af-6716-423a-9601-e1ad48436fea tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:58.865722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b8e6af-6716-423a-9601-e1ad48436fea tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:58.866344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b8e6af-6716-423a-9601-e1ad48436fea tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:58.970158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:58.972705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:58.983449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:06:58.988070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:58.989305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:58.990057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:58.992820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:58.993811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:58.994469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:59.085514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d8b8e6af-6716-423a-9601-e1ad48436fea tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.098205 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d8b8e6af-6716-423a-9601-e1ad48436fea tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1693 microversion: 2.1 time: 0.252582 Oct 11 20:06:59.114551 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2506/5038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:58 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1693 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:59.184227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.196179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.199062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.203847 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-49d51563-6890-4d62-8f22-e07ba5e9df2f tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.244913 Oct 11 20:06:59.215092 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2533/5039] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:58 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:59.271705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:59.272406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:59.296784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:59.297615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:59.298279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:59.299239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:59.299906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:59.300509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:59.333683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a89cc7cd-6eea-44c3-8316-c3d54264481d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:59.334580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a89cc7cd-6eea-44c3-8316-c3d54264481d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:59.343503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a89cc7cd-6eea-44c3-8316-c3d54264481d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:59.344435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a89cc7cd-6eea-44c3-8316-c3d54264481d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:59.345116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a89cc7cd-6eea-44c3-8316-c3d54264481d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:59.346979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a89cc7cd-6eea-44c3-8316-c3d54264481d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:59.347695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a89cc7cd-6eea-44c3-8316-c3d54264481d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:59.348565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a89cc7cd-6eea-44c3-8316-c3d54264481d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:59.721719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.732715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.734505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.735921 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e42ee3f-9e9e-4434-92f2-0fd774574dcb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.468426 Oct 11 20:06:59.746559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a89cc7cd-6eea-44c3-8316-c3d54264481d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.747713 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2507/5040] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:59 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:06:59.752264 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a89cc7cd-6eea-44c3-8316-c3d54264481d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1365 microversion: 2.1 time: 0.424404 Oct 11 20:06:59.752967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:06:59.762595 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2534/5041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:06:59 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1365 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:06:59.762762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:06:59.768852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:59.769457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:59.770020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:59.770866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:06:59.771447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:06:59.772091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:06:59.845211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.853462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.855600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:06:59.856896 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1b5c5f33-37cd-4871-8bce-c960b66e43ad tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1366 microversion: 2.47 time: 0.107974 Oct 11 20:06:59.857558 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2508/5042] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:06:59 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:00.132182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-293aed83-f7a3-4baf-8ec7-9d24eea46fa0 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:00.133043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-293aed83-f7a3-4baf-8ec7-9d24eea46fa0 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:00.140405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-293aed83-f7a3-4baf-8ec7-9d24eea46fa0 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:00.140904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-293aed83-f7a3-4baf-8ec7-9d24eea46fa0 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:00.141410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-293aed83-f7a3-4baf-8ec7-9d24eea46fa0 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:00.142513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-293aed83-f7a3-4baf-8ec7-9d24eea46fa0 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:00.143276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-293aed83-f7a3-4baf-8ec7-9d24eea46fa0 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:00.143928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-293aed83-f7a3-4baf-8ec7-9d24eea46fa0 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:00.242224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:00.243347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:00.250451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:00.253333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:00.255454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:00.257760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:00.258725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:00.264557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:00.319114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-293aed83-f7a3-4baf-8ec7-9d24eea46fa0 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:00.332483 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-293aed83-f7a3-4baf-8ec7-9d24eea46fa0 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1690 microversion: 2.1 time: 0.203957 Oct 11 20:07:00.342336 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2535/5043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:00 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1690 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:00.361400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-549683ab-8485-4557-91e5-fa66949af74a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:00.361955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-549683ab-8485-4557-91e5-fa66949af74a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:00.372382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-549683ab-8485-4557-91e5-fa66949af74a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:00.372875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-549683ab-8485-4557-91e5-fa66949af74a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:00.373663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-549683ab-8485-4557-91e5-fa66949af74a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:00.374370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-549683ab-8485-4557-91e5-fa66949af74a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:00.374791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-549683ab-8485-4557-91e5-fa66949af74a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:00.375222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-549683ab-8485-4557-91e5-fa66949af74a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:00.377907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:00.395073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:00.397744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:00.400509 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6ce41304-d8ed-4ed9-acac-146fc5f649d4 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.162279 Oct 11 20:07:00.403185 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2509/5044] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:00 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:00.562807 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-549683ab-8485-4557-91e5-fa66949af74a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806/action" status: 202 len: 0 microversion: 2.1 time: 0.204189 Oct 11 20:07:00.565005 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2536/5045] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:07:00 2022] POST /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:07:00.573566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-729af3fc-a02e-426b-813e-a9216edc799f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:00.574167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-729af3fc-a02e-426b-813e-a9216edc799f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:00.591223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-729af3fc-a02e-426b-813e-a9216edc799f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:00.591733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-729af3fc-a02e-426b-813e-a9216edc799f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:00.592180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-729af3fc-a02e-426b-813e-a9216edc799f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:00.592960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-729af3fc-a02e-426b-813e-a9216edc799f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:00.593500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-729af3fc-a02e-426b-813e-a9216edc799f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:00.594289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-729af3fc-a02e-426b-813e-a9216edc799f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:00.772167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:00.774089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:00.797271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:00.798464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:00.799932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:00.802440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:00.803121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:00.803713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:01.065723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-729af3fc-a02e-426b-813e-a9216edc799f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.083614 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-729af3fc-a02e-426b-813e-a9216edc799f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1689 microversion: 2.1 time: 0.514806 Oct 11 20:07:01.085229 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2510/5046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:00 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1689 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:01.099695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84f62193-5f04-4a11-8c3c-b62b6d65eab4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:01.102130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-84f62193-5f04-4a11-8c3c-b62b6d65eab4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:01.116524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f62193-5f04-4a11-8c3c-b62b6d65eab4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:01.117501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f62193-5f04-4a11-8c3c-b62b6d65eab4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:01.118620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f62193-5f04-4a11-8c3c-b62b6d65eab4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:01.122045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f62193-5f04-4a11-8c3c-b62b6d65eab4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:01.122749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f62193-5f04-4a11-8c3c-b62b6d65eab4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:01.123390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f62193-5f04-4a11-8c3c-b62b6d65eab4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:01.232291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.246082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.250029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.251234 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-432e9a7f-a34c-4554-9a27-74a8f9f0fe93 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.485497 Oct 11 20:07:01.254850 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2537/5047] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:00 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:01.268552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:01.269172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:01.279775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:01.280311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:01.280860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:01.281570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:01.282024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:01.282450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:01.439113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.450093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.456818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.458972 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3c3e966a-297d-4e5d-b3d7-a892de2362c0 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1372 microversion: 2.47 time: 0.203040 Oct 11 20:07:01.459742 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2538/5048] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:01 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:01.472165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:01.473109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:01.488964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:01.489718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:01.491379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:01.492331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:01.495255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:01.495933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:01.518380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-84f62193-5f04-4a11-8c3c-b62b6d65eab4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.528314 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-84f62193-5f04-4a11-8c3c-b62b6d65eab4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1555 microversion: 2.1 time: 0.441512 Oct 11 20:07:01.529496 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2511/5049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:01 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1555 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:01.555744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a9a547d0-0eb3-4f20-ba02-5a5e5791c46b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:01.558071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a9a547d0-0eb3-4f20-ba02-5a5e5791c46b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:01.571120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9a547d0-0eb3-4f20-ba02-5a5e5791c46b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:01.572195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9a547d0-0eb3-4f20-ba02-5a5e5791c46b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:01.573909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9a547d0-0eb3-4f20-ba02-5a5e5791c46b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:01.574884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9a547d0-0eb3-4f20-ba02-5a5e5791c46b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:01.575560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9a547d0-0eb3-4f20-ba02-5a5e5791c46b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:01.576364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a9a547d0-0eb3-4f20-ba02-5a5e5791c46b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:01.637919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.648714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.650640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:01.652691 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2421f07d-ceda-497d-957e-bc21aefde121 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.191087 Oct 11 20:07:01.661216 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2539/5050] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:01 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:01.716565 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a9a547d0-0eb3-4f20-ba02-5a5e5791c46b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165254 Oct 11 20:07:01.717193 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2512/5051] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:07:01 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:07:02.113232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38611b9b-5645-4f75-adf2-0bc903d96b03 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:02.113841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-38611b9b-5645-4f75-adf2-0bc903d96b03 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:02.124564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38611b9b-5645-4f75-adf2-0bc903d96b03 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:02.127032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38611b9b-5645-4f75-adf2-0bc903d96b03 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:02.128027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38611b9b-5645-4f75-adf2-0bc903d96b03 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:02.129590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38611b9b-5645-4f75-adf2-0bc903d96b03 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:02.132939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38611b9b-5645-4f75-adf2-0bc903d96b03 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:02.133377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38611b9b-5645-4f75-adf2-0bc903d96b03 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:02.180272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:02.304599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:02.305270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:02.345495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:02.346580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:02.347256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:02.352129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:02.353087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:02.353770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:02.440386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-38611b9b-5645-4f75-adf2-0bc903d96b03 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:02.452715 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-38611b9b-5645-4f75-adf2-0bc903d96b03 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1689 microversion: 2.1 time: 0.343443 Oct 11 20:07:02.453666 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2540/5052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:02 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1689 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:07:02.494395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:02.495509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:02.504636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:02.507435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:02.507887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:02.508633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:02.509093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:02.509515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:02.701617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:02.719308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:02.726552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:02.729939 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6d3d7aca-20da-4d7e-a160-20055edfdcf2 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1372 microversion: 2.47 time: 0.239379 Oct 11 20:07:02.732914 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2541/5053] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:02 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1372 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:02.741885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:02.742782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:02.761176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:02.761671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:02.762516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:02.763255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:02.763896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:02.764717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:02.841156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:02.854967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:02.860975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:02.863201 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-356fc3d3-cab2-45cc-8ad7-5596590640f3 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.571422 Oct 11 20:07:02.864240 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2513/5054] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:02 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:02.921104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:02.933220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:02.936951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:02.939216 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-283cbb0b-da85-4493-a063-85868ad4a893 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.204013 Oct 11 20:07:02.952163 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2542/5055] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:02 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:03.156668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-bfc84588-d394-41e0-96e5-610dba08e6ff req-e1e676e0-bbbd-4915-a91d-6835bb547380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "name": "network-vif-plugged", "status": "completed", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:03.182105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bfc84588-d394-41e0-96e5-610dba08e6ff req-e1e676e0-bbbd-4915-a91d-6835bb547380 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:03.183168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bfc84588-d394-41e0-96e5-610dba08e6ff req-e1e676e0-bbbd-4915-a91d-6835bb547380 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:03.185041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bfc84588-d394-41e0-96e5-610dba08e6ff req-e1e676e0-bbbd-4915-a91d-6835bb547380 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:03.208668 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-bfc84588-d394-41e0-96e5-610dba08e6ff req-e1e676e0-bbbd-4915-a91d-6835bb547380 service nova] Creating event network-vif-plugged:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h2-860864-3 Oct 11 20:07:03.216465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-bfc84588-d394-41e0-96e5-610dba08e6ff req-e1e676e0-bbbd-4915-a91d-6835bb547380 service nova] Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:07:03.240601 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-bfc84588-d394-41e0-96e5-610dba08e6ff req-e1e676e0-bbbd-4915-a91d-6835bb547380 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090739 Oct 11 20:07:03.241400 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2514/5056] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:03.326822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8a53a436-b982-4707-9cb9-934a5bc801d8 req-773f7747-9850-44c5-a39e-2e96e4a22caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc1cee7-9aca-468a-9d10-9f985b7adcbe", "tag": "69d6abd1-2254-46cc-8590-0ba134f40ebf"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:03.338244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8a53a436-b982-4707-9cb9-934a5bc801d8 req-773f7747-9850-44c5-a39e-2e96e4a22caa service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:03.339405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8a53a436-b982-4707-9cb9-934a5bc801d8 req-773f7747-9850-44c5-a39e-2e96e4a22caa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:03.339872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8a53a436-b982-4707-9cb9-934a5bc801d8 req-773f7747-9850-44c5-a39e-2e96e4a22caa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:03.352406 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8a53a436-b982-4707-9cb9-934a5bc801d8 req-773f7747-9850-44c5-a39e-2e96e4a22caa service nova] Creating event network-changed:69d6abd1-2254-46cc-8590-0ba134f40ebf for instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe on n-h2-860864-3 Oct 11 20:07:03.357988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8a53a436-b982-4707-9cb9-934a5bc801d8 req-773f7747-9850-44c5-a39e-2e96e4a22caa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038111 Oct 11 20:07:03.358630 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2543/5057] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:03.477855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1b5b7b78-2e1e-49ed-bbb3-7906d6278aa1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:03.479490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1b5b7b78-2e1e-49ed-bbb3-7906d6278aa1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:03.500654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5b7b78-2e1e-49ed-bbb3-7906d6278aa1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:03.504986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5b7b78-2e1e-49ed-bbb3-7906d6278aa1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:03.506880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5b7b78-2e1e-49ed-bbb3-7906d6278aa1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:03.509831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5b7b78-2e1e-49ed-bbb3-7906d6278aa1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:03.512504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5b7b78-2e1e-49ed-bbb3-7906d6278aa1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:03.515454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5b7b78-2e1e-49ed-bbb3-7906d6278aa1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:03.759427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:03.760982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:03.770598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:03.771463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:03.772116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:03.773581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:03.774519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:03.775274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:03.994046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.012106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.013575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.014821 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1200d417-f86f-4923-bf0e-2ecf2860bd3c tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1357 microversion: 2.47 time: 0.261058 Oct 11 20:07:04.015397 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2544/5058] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:03 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:04.020041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:04.020662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:04.027520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b5b7b78-2e1e-49ed-bbb3-7906d6278aa1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.039214 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1b5b7b78-2e1e-49ed-bbb3-7906d6278aa1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1689 microversion: 2.1 time: 0.565631 Oct 11 20:07:04.040113 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2515/5059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:03 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1689 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:04.045522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:04.061230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:04.063989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:04.064733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:04.068213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:04.081521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:04.082029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:04.083777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:04.092947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:04.093457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:04.093911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:04.097248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:04.097754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:04.098206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:04.253416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.262898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.264360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.265622 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-626f5e4b-1aad-47ab-a5f2-7d4b5647b598 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.224386 Oct 11 20:07:04.273971 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2516/5060] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:04 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:04.284988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:04.299243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.300396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Searching by: {'deleted': False, 'project_id': '55c7c39978b041f4a1970a72246abdcb'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 20:07:04.317418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:04.318491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:04.319103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:04.324035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:04.325520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:04.325999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:04.537630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.578758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.586551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.590500 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-53d3220d-e080-4857-88fd-d49795eb3078 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.573913 Oct 11 20:07:04.591427 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2545/5061] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:04 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:04.639068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 20:07:04.804705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.829279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:04.830296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:04.831650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:04.866198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.868596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:04.920763 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-741013bb-d897-48b3-b2e9-5f8e417a81d7 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.645253 Oct 11 20:07:04.921803 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2517/5062] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 11 20:07:04 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:04.955252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f22dac2f-f90b-4eae-8d40-c20d9425552b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:04.956258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f22dac2f-f90b-4eae-8d40-c20d9425552b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:04.969052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f22dac2f-f90b-4eae-8d40-c20d9425552b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:04.969785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f22dac2f-f90b-4eae-8d40-c20d9425552b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:04.972404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f22dac2f-f90b-4eae-8d40-c20d9425552b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:04.973928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f22dac2f-f90b-4eae-8d40-c20d9425552b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:04.974916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f22dac2f-f90b-4eae-8d40-c20d9425552b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:04.976363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f22dac2f-f90b-4eae-8d40-c20d9425552b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:05.017159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f22dac2f-f90b-4eae-8d40-c20d9425552b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:07:05.068771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a38d89b6-a5c9-472d-9d2c-7b2448df65cc tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:05.069407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a38d89b6-a5c9-472d-9d2c-7b2448df65cc tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:05.089294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38d89b6-a5c9-472d-9d2c-7b2448df65cc tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:05.090291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38d89b6-a5c9-472d-9d2c-7b2448df65cc tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:05.090787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38d89b6-a5c9-472d-9d2c-7b2448df65cc tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:05.091761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38d89b6-a5c9-472d-9d2c-7b2448df65cc tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:05.092238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38d89b6-a5c9-472d-9d2c-7b2448df65cc tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:05.093625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a38d89b6-a5c9-472d-9d2c-7b2448df65cc tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:05.172894 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f22dac2f-f90b-4eae-8d40-c20d9425552b tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 204 len: 0 microversion: 2.47 time: 0.222329 Oct 11 20:07:05.174198 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2546/5063] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:07:04 2022] DELETE /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:07:05.188905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:05.189639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:05.211263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:05.211771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:05.212214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:05.212925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:05.214269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:05.215625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:05.419760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:05.448187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:05.455451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:05.457755 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-68b074ed-17f7-4a50-bc4b-9c99d95acccc tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1363 microversion: 2.47 time: 0.279187 Oct 11 20:07:05.459036 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2547/5064] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:05 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:05.473881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:05.477956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:05.483638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a38d89b6-a5c9-472d-9d2c-7b2448df65cc tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:05.491996 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a38d89b6-a5c9-472d-9d2c-7b2448df65cc tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1689 microversion: 2.1 time: 0.428022 Oct 11 20:07:05.492478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:05.492620 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2518/5065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:05 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1689 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:05.493910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:05.494797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:05.496423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:05.497124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:05.497810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:05.501604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c05aa84a-e724-447a-9e82-8de5fd5b3cd8 req-b939b634-8813-42d8-acf4-330609231e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-plugged", "status": "completed", "tag": "6f0763b2-25ba-4ba9-b513-99fb41f73411"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:05.528065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c05aa84a-e724-447a-9e82-8de5fd5b3cd8 req-b939b634-8813-42d8-acf4-330609231e48 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:05.528625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c05aa84a-e724-447a-9e82-8de5fd5b3cd8 req-b939b634-8813-42d8-acf4-330609231e48 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:05.528959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c05aa84a-e724-447a-9e82-8de5fd5b3cd8 req-b939b634-8813-42d8-acf4-330609231e48 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:05.554804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:05.563340 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c05aa84a-e724-447a-9e82-8de5fd5b3cd8 req-b939b634-8813-42d8-acf4-330609231e48 service nova] Creating event network-vif-plugged:6f0763b2-25ba-4ba9-b513-99fb41f73411 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:07:05.572200 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c05aa84a-e724-447a-9e82-8de5fd5b3cd8 req-b939b634-8813-42d8-acf4-330609231e48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078429 Oct 11 20:07:05.576221 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2519/5066] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:05.624178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:05.628803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:05.629728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:05.635942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:05.637453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:05.638675 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e91ef2a0-a46f-40d8-8936-5cf2b0e16225 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.177425 Oct 11 20:07:05.639247 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2548/5067] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:05 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:05.645049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:05.649559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:05.649907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:05.650662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:05.654832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:05.655441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:05.990207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b7f1bf22-f258-4011-84b8-3f75b5392850 req-3b542517-6b83-4431-bc4a-f2687c85c684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "name": "network-vif-unplugged", "status": "completed", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:06.000892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:06.011059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b7f1bf22-f258-4011-84b8-3f75b5392850 req-3b542517-6b83-4431-bc4a-f2687c85c684 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:06.011550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b7f1bf22-f258-4011-84b8-3f75b5392850 req-3b542517-6b83-4431-bc4a-f2687c85c684 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:06.011987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b7f1bf22-f258-4011-84b8-3f75b5392850 req-3b542517-6b83-4431-bc4a-f2687c85c684 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:06.013669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:06.022921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:06.025697 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-33a50e18-2852-49f2-b9df-769cdfc8f600 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.405477 Oct 11 20:07:06.026511 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2520/5068] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:05 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:06.047167 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b7f1bf22-f258-4011-84b8-3f75b5392850 req-3b542517-6b83-4431-bc4a-f2687c85c684 service nova] Creating event network-vif-unplugged:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h1-860864-3 Oct 11 20:07:06.061057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-b7f1bf22-f258-4011-84b8-3f75b5392850 req-3b542517-6b83-4431-bc4a-f2687c85c684 service nova] Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:07:06.075661 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b7f1bf22-f258-4011-84b8-3f75b5392850 req-3b542517-6b83-4431-bc4a-f2687c85c684 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089603 Oct 11 20:07:06.076721 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2549/5069] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:06.488725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:06.489380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:06.497366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:06.497883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:06.498334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:06.505595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:06.506103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:06.506587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:06.521498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0e6e449-c48c-4331-9ccd-c01f87bfc108 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:06.523309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a0e6e449-c48c-4331-9ccd-c01f87bfc108 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:06.531937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e6e449-c48c-4331-9ccd-c01f87bfc108 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:06.532641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e6e449-c48c-4331-9ccd-c01f87bfc108 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:06.533254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e6e449-c48c-4331-9ccd-c01f87bfc108 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:06.534410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e6e449-c48c-4331-9ccd-c01f87bfc108 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:06.535058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e6e449-c48c-4331-9ccd-c01f87bfc108 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:06.536007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0e6e449-c48c-4331-9ccd-c01f87bfc108 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:06.740335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:06.755492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:06.764484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:06.766157 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-98072dc9-ceac-4215-a9a5-f4c8c313a42d tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1363 microversion: 2.47 time: 0.281605 Oct 11 20:07:06.769185 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2521/5070] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:06 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:06.779191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:06.780082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:06.795903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:06.796620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:06.797340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:06.798232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:06.800888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:06.801402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:06.996887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:07.009642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:07.011996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:07.017451 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-53134c24-e6b8-46a9-a864-2d2745213027 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.247193 Oct 11 20:07:07.025435 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2522/5071] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:06 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:07.063006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:07.063644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:07.072125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a0e6e449-c48c-4331-9ccd-c01f87bfc108 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:07.080438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:07.080681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:07.083082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:07.084076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:07.086394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:07.087060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:07.089804 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a0e6e449-c48c-4331-9ccd-c01f87bfc108 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1689 microversion: 2.1 time: 0.572480 Oct 11 20:07:07.099104 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2550/5072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:06 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1689 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:07:07.795008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:07.795716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:07.816851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:07.818155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:07.818982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:07.820354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:07.821152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:07.821828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:07.906734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:07.907399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:07.908100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:07.908674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lazy-loading 'fault' on Instance uuid fc8841c0-0d7c-4579-bec4-dea9bda1190b {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:07:07.928437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:07.946095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:07.950514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:07.956486 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a16e3f04-8c8a-4423-a330-a273614f57a5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.907950 Oct 11 20:07:07.957440 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2523/5073] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:07 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:07.980225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:07.991686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:07.994083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:07.998830 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3cb6bcea-35bc-416d-9040-99911e69ebf5 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 200 len: 1368 microversion: 2.47 time: 0.210829 Oct 11 20:07:08.000079 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2551/5074] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:07 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:08.056120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:08.056759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:08.073511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:08.075489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:08.078366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:08.081074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:08.083126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:08.083799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:08.085640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:08.113481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8cf7ff20-9ba5-43fa-8437-775a034977f8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:08.114862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8cf7ff20-9ba5-43fa-8437-775a034977f8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:08.124942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cf7ff20-9ba5-43fa-8437-775a034977f8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:08.125607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cf7ff20-9ba5-43fa-8437-775a034977f8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:08.126050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cf7ff20-9ba5-43fa-8437-775a034977f8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:08.130836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cf7ff20-9ba5-43fa-8437-775a034977f8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:08.131801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cf7ff20-9ba5-43fa-8437-775a034977f8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:08.132583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cf7ff20-9ba5-43fa-8437-775a034977f8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:08.229543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:08.239739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:08.241660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:08.243138 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4e8bcaf9-2497-4e27-83e6-9a1b43855153 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.199525 Oct 11 20:07:08.243917 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2524/5075] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:08 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:08.328711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-6ac21bf9-3f22-4638-9e67-b7ca71d15654 req-f0a71778-188f-4d33-9e48-22a542c682cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:08.360928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6ac21bf9-3f22-4638-9e67-b7ca71d15654 req-f0a71778-188f-4d33-9e48-22a542c682cb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:08.361501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6ac21bf9-3f22-4638-9e67-b7ca71d15654 req-f0a71778-188f-4d33-9e48-22a542c682cb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:08.362113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6ac21bf9-3f22-4638-9e67-b7ca71d15654 req-f0a71778-188f-4d33-9e48-22a542c682cb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:08.418653 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6ac21bf9-3f22-4638-9e67-b7ca71d15654 req-f0a71778-188f-4d33-9e48-22a542c682cb service nova] Creating event network-changed:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h1-860864-3 Oct 11 20:07:08.426116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-6ac21bf9-3f22-4638-9e67-b7ca71d15654 req-f0a71778-188f-4d33-9e48-22a542c682cb service nova] Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:07:08.442361 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-6ac21bf9-3f22-4638-9e67-b7ca71d15654 req-f0a71778-188f-4d33-9e48-22a542c682cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119351 Oct 11 20:07:08.444439 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2525/5076] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:07:08.456450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8cf7ff20-9ba5-43fa-8437-775a034977f8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:08.467816 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8cf7ff20-9ba5-43fa-8437-775a034977f8 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1689 microversion: 2.1 time: 0.358146 Oct 11 20:07:08.469367 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2552/5077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:08 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1689 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:08.988340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:08.989154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:09.008139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.008638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.009081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.009793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.010804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.016075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.036306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:09.037481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: fc8841c0-0d7c-4579-bec4-dea9bda1190b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:09.052814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.053894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.054557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.056551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.058158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.059931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.098378 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] HTTP exception thrown: Instance fc8841c0-0d7c-4579-bec4-dea9bda1190b could not be found. Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Request method failure captured: Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b HTTP/1.1 Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcy8JYdyc0g4wkPHsv7qvzFhiRwzqcm11RIwzsnecL-0Or2lWUzxyEic60bXnWlIHnnVf9qieX67we-1M_BdJOGnelVZkkjNAOvdHyaKWq_0uaGznWX526u1WaXGWy1pvCGk_V8P5oxQRYuWCRB5xdUO47nvFkx-1IR_p23iKXm33Qk Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 55c7c39978b041f4a1970a72246abdcb Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerShowV247Test-2013645379 Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/55c7c39978b041f4a1970a72246abdcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_55c7c39978b041f4a1970a72246abdcb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/55c7c39978b041f4a1970a72246abdcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/55c7c39978b041f4a1970a72246abdcb"}]}] Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerShowV247Test-2013645379 Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 55c7c39978b041f4a1970a72246abdcb Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerShowV247Test-2013645379 Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerShowV247Test-2013645379-project Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 308b5f9c9d364b49b8f2278094f7292d Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerShowV247Test-2013645379-project Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance fc8841c0-0d7c-4579-bec4-dea9bda1190b could not be found. Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'fc8841c0-0d7c-4579-bec4-dea9bda1190b'} Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc8841c0-0d7c-4579-bec4-dea9bda1190b could not be found. Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc8841c0-0d7c-4579-bec4-dea9bda1190b could not be found. Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:09.100961 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:09.106275 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:09.106275 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:09.106275 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:09.106275 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:07:09.106275 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:07:09.106275 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc8841c0-0d7c-4579-bec4-dea9bda1190b could not be found. Oct 11 20:07:09.106275 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:09.106275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Returning 404 to user: Instance fc8841c0-0d7c-4579-bec4-dea9bda1190b could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:07:09.106275 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c561811e-b897-4d4c-bb1e-61d684b615ae tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b" status: 404 len: 111 microversion: 2.47 time: 0.078694 Oct 11 20:07:09.106275 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2553/5078] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:09 2022] GET /compute/v2.1/servers/fc8841c0-0d7c-4579-bec4-dea9bda1190b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:07:09.119011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0315b16-c680-4ae6-9366-1e1043214527 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:09.120012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0315b16-c680-4ae6-9366-1e1043214527 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: 27ef4876-2721-4ac1-930c-34430e2ed6b5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:09.127630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0315b16-c680-4ae6-9366-1e1043214527 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.128380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0315b16-c680-4ae6-9366-1e1043214527 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.129032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0315b16-c680-4ae6-9366-1e1043214527 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.130037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0315b16-c680-4ae6-9366-1e1043214527 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.137456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0315b16-c680-4ae6-9366-1e1043214527 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.138827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0315b16-c680-4ae6-9366-1e1043214527 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.201908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0315b16-c680-4ae6-9366-1e1043214527 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: 27ef4876-2721-4ac1-930c-34430e2ed6b5] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:07:09.366973 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0315b16-c680-4ae6-9366-1e1043214527 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "DELETE /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5" status: 204 len: 0 microversion: 2.47 time: 0.256610 Oct 11 20:07:09.371308 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2554/5079] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:07:09 2022] DELETE /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:07:09.380912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:09.381637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:09.392179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.395203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.396461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.397243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.397781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.398222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.403837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:09.517673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:09.524961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:09.536481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:09.538241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:09.540198 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-58ff2f04-5ab3-48e5-88e0-18fc7783c006 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.169782 Oct 11 20:07:09.541355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:09.542318 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2555/5080] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:09 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:09.544913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:09.547456 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-67ba0894-2fa4-42ec-9c6c-1242b8339afa tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.564472 Oct 11 20:07:09.547697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:09.548304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: 27ef4876-2721-4ac1-930c-34430e2ed6b5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:09.548734 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2526/5081] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:08 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:09.564412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.564412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.564412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.564412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.564412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.564412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.567059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b88759ab-6cf9-4ec0-a268-efacd211d35f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:09.568227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b88759ab-6cf9-4ec0-a268-efacd211d35f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:09.575219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88759ab-6cf9-4ec0-a268-efacd211d35f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.576496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88759ab-6cf9-4ec0-a268-efacd211d35f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.577170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88759ab-6cf9-4ec0-a268-efacd211d35f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.578100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88759ab-6cf9-4ec0-a268-efacd211d35f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:09.578588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88759ab-6cf9-4ec0-a268-efacd211d35f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:09.579024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88759ab-6cf9-4ec0-a268-efacd211d35f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:09.674436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:09.684043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:09.685836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:09.687301 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7c85d4e3-ec3c-4250-8ff3-53635f5c7333 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5" status: 200 len: 1363 microversion: 2.47 time: 0.144109 Oct 11 20:07:09.688118 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2556/5082] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:09 2022] GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:09.766185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b88759ab-6cf9-4ec0-a268-efacd211d35f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:09.778340 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b88759ab-6cf9-4ec0-a268-efacd211d35f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1689 microversion: 2.1 time: 0.226577 Oct 11 20:07:09.779237 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2527/5083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:09 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:10.571235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:10.571850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:10.584392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:10.584813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:10.585312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:10.585312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:10.585509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:10.586002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:10.590091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:10.590543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:10.599469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:10.600282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:10.606187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:10.607226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:10.607882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:10.608687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:10.740936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:10.755881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:10.763955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:10.767604 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a646782-a103-4cb9-904a-624e14f028e9 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.198621 Oct 11 20:07:10.767604 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2557/5084] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:10 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:10.772536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:10.773576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: 27ef4876-2721-4ac1-930c-34430e2ed6b5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:10.786912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:10.790184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:10.791022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:10.794074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:10.796277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:10.796816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:11.019323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:11.041171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:11.042689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:11.043901 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3ce4aa35-3850-4b70-8aad-14c631b37308 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5" status: 200 len: 1363 microversion: 2.47 time: 0.277100 Oct 11 20:07:11.059280 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2558/5085] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:10 2022] GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:11.071023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f19113ab-d57f-4ccd-8642-3364e4210c2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:11.071887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f19113ab-d57f-4ccd-8642-3364e4210c2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:11.078410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f19113ab-d57f-4ccd-8642-3364e4210c2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:11.079205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f19113ab-d57f-4ccd-8642-3364e4210c2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:11.079848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f19113ab-d57f-4ccd-8642-3364e4210c2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:11.080731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f19113ab-d57f-4ccd-8642-3364e4210c2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:11.081364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f19113ab-d57f-4ccd-8642-3364e4210c2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:11.082508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f19113ab-d57f-4ccd-8642-3364e4210c2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:11.170188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:11.180273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:11.182395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:11.184027 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-939821ae-c269-4125-b88b-0842f566bd4e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.603973 Oct 11 20:07:11.184901 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2528/5086] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:10 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:11.436237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f19113ab-d57f-4ccd-8642-3364e4210c2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:11.447481 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f19113ab-d57f-4ccd-8642-3364e4210c2e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1689 microversion: 2.1 time: 0.385880 Oct 11 20:07:11.448073 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2559/5087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:11 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1689 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:11.799850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:11.802009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:11.835575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:11.836402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:11.836910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:11.837681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:11.838798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:11.839412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:11.979025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:11.991827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:11.993288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:11.994881 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d900dc01-be41-4435-8d65-0e96921c09d7 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.203111 Oct 11 20:07:12.010928 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2529/5088] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:11 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:12.077806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:12.079798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: 27ef4876-2721-4ac1-930c-34430e2ed6b5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:12.096048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:12.096733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:12.099142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:12.100058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:12.100516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:12.100941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:12.173669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:12.174167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:12.175067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:12.175526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lazy-loading 'fault' on Instance uuid 27ef4876-2721-4ac1-930c-34430e2ed6b5 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:07:12.212677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:12.214298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:12.222878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:12.223830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:12.224383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:12.225215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:12.226172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:12.226861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:12.260843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:12.274024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:12.275587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '308b5f9c9d364b49b8f2278094f7292d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c7c39978b041f4a1970a72246abdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:12.277110 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a7e9c24-d80c-4741-bb7b-45891ef484bf tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5" status: 200 len: 1368 microversion: 2.47 time: 0.204705 Oct 11 20:07:12.292922 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2560/5089] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:12 2022] GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:12.473178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7fd59ec4-029a-4586-82d5-88ca7272bb9b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:12.476413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7fd59ec4-029a-4586-82d5-88ca7272bb9b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:12.489897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fd59ec4-029a-4586-82d5-88ca7272bb9b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:12.490764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fd59ec4-029a-4586-82d5-88ca7272bb9b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:12.491534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fd59ec4-029a-4586-82d5-88ca7272bb9b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:12.492491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fd59ec4-029a-4586-82d5-88ca7272bb9b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:12.493435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fd59ec4-029a-4586-82d5-88ca7272bb9b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:12.494619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fd59ec4-029a-4586-82d5-88ca7272bb9b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:12.534146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:12.553348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:12.562965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:12.564400 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11910c57-0c8d-4891-b950-76113c2c85cf tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.356464 Oct 11 20:07:12.566959 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2530/5090] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:12 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:12.782981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7fd59ec4-029a-4586-82d5-88ca7272bb9b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:12.798937 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7fd59ec4-029a-4586-82d5-88ca7272bb9b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1682 microversion: 2.1 time: 0.326514 Oct 11 20:07:12.801189 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2561/5091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:12 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1682 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:07:13.022868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:13.024229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:13.033358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:13.034181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:13.034859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:13.036070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:13.036524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:13.037648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:13.196628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:13.208816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:13.210490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:13.212427 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e8a6bf9-997f-46fa-8577-5a7f305f075b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.195063 Oct 11 20:07:13.216700 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2531/5092] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:13 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:13.317355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:13.318923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] [instance: 27ef4876-2721-4ac1-930c-34430e2ed6b5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:13.330105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:13.330806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:13.331856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:13.332936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:13.333665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:13.334420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:13.360692 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] HTTP exception thrown: Instance 27ef4876-2721-4ac1-930c-34430e2ed6b5 could not be found. Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Request method failure captured: Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5 HTTP/1.1 Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcy8JYdyc0g4wkPHsv7qvzFhiRwzqcm11RIwzsnecL-0Or2lWUzxyEic60bXnWlIHnnVf9qieX67we-1M_BdJOGnelVZkkjNAOvdHyaKWq_0uaGznWX526u1WaXGWy1pvCGk_V8P5oxQRYuWCRB5xdUO47nvFkx-1IR_p23iKXm33Qk Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 55c7c39978b041f4a1970a72246abdcb Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerShowV247Test-2013645379 Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/55c7c39978b041f4a1970a72246abdcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_55c7c39978b041f4a1970a72246abdcb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/55c7c39978b041f4a1970a72246abdcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/55c7c39978b041f4a1970a72246abdcb"}]}] Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerShowV247Test-2013645379 Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 55c7c39978b041f4a1970a72246abdcb Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerShowV247Test-2013645379 Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerShowV247Test-2013645379-project Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 308b5f9c9d364b49b8f2278094f7292d Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerShowV247Test-2013645379-project Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 27ef4876-2721-4ac1-930c-34430e2ed6b5 could not be found. Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '27ef4876-2721-4ac1-930c-34430e2ed6b5'} Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ef4876-2721-4ac1-930c-34430e2ed6b5 could not be found. Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ef4876-2721-4ac1-930c-34430e2ed6b5 could not be found. Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:13.362972 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:13.367834 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:13.367834 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:13.367834 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:13.367834 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:07:13.367834 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:07:13.367834 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ef4876-2721-4ac1-930c-34430e2ed6b5 could not be found. Oct 11 20:07:13.367834 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:13.370708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] Returning 404 to user: Instance 27ef4876-2721-4ac1-930c-34430e2ed6b5 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:07:13.371930 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e85a4246-d154-4e66-a3ed-29855d2cc0f3 tempest-ServerShowV247Test-2013645379 tempest-ServerShowV247Test-2013645379-project] 10.222.0.27 "GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5" status: 404 len: 111 microversion: 2.47 time: 0.058555 Oct 11 20:07:13.372506 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2562/5093] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:13 2022] GET /compute/v2.1/servers/27ef4876-2721-4ac1-930c-34430e2ed6b5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:07:13.593630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:13.594576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:13.602315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:13.605126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:13.605585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:13.608735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:13.610127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:13.610858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:13.894588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:13.909633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:13.912287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:13.914372 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c0159040-da5a-4939-b539-74e029f14fdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.325468 Oct 11 20:07:13.915621 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2532/5094] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:13 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:14.246469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:14.248675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:14.263644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:14.264751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:14.265579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:14.267013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:14.270045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:14.270799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:14.375476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-afa5996c-76d0-4739-8ae3-36d741336de4 req-a74cd47a-b093-4c51-b2fd-80ed1cc0dc0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "name": "network-vif-plugged", "status": "completed", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:14.389322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-afa5996c-76d0-4739-8ae3-36d741336de4 req-a74cd47a-b093-4c51-b2fd-80ed1cc0dc0f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:14.389974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-afa5996c-76d0-4739-8ae3-36d741336de4 req-a74cd47a-b093-4c51-b2fd-80ed1cc0dc0f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:14.390566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-afa5996c-76d0-4739-8ae3-36d741336de4 req-a74cd47a-b093-4c51-b2fd-80ed1cc0dc0f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:14.408427 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-afa5996c-76d0-4739-8ae3-36d741336de4 req-a74cd47a-b093-4c51-b2fd-80ed1cc0dc0f service nova] Creating event network-vif-plugged:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h1-860864-3 Oct 11 20:07:14.417608 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-afa5996c-76d0-4739-8ae3-36d741336de4 req-a74cd47a-b093-4c51-b2fd-80ed1cc0dc0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045883 Oct 11 20:07:14.419563 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2533/5095] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:14.684860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:14.701146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:14.704103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:14.706262 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-06bf5bd9-6df1-403c-945b-25056c07419b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.466825 Oct 11 20:07:14.707828 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2563/5096] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:14 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:14.948735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:14.949815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:14.967646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:14.970753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:14.978709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:14.980562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:14.981637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:14.988063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:14.989316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:14.992612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:15.737752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:15.740493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:15.777384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:15.783399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:15.784103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:15.785059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:15.786622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:15.790913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:15.798907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:15.809005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:15.812389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:15.819698 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e836d362-f997-4547-b644-7ac2422a557b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.876054 Oct 11 20:07:15.834551 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2534/5097] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:14 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:15.950890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:15.966049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:15.969630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:15.976813 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e07a4e9-4357-44be-916c-7e74c16d06c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.244613 Oct 11 20:07:15.977993 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2564/5098] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:15 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:16.468933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3449d5b2-9f42-4b2a-8f3e-d56431c51779 req-3f15dbc3-45fc-4a83-9ac8-e07a343e7d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-plugged", "status": "completed", "tag": "2b9dfd70-7039-45c5-860c-01d7197e52b8"}, {"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-plugged", "status": "completed", "tag": "d27720b2-53eb-4849-ad71-71c85b3b9502"}, {"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-plugged", "status": "completed", "tag": "64e233cb-7770-4bcd-b9b7-a977e0aa27eb"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:16.491844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3449d5b2-9f42-4b2a-8f3e-d56431c51779 req-3f15dbc3-45fc-4a83-9ac8-e07a343e7d65 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:16.492407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3449d5b2-9f42-4b2a-8f3e-d56431c51779 req-3f15dbc3-45fc-4a83-9ac8-e07a343e7d65 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:16.493044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3449d5b2-9f42-4b2a-8f3e-d56431c51779 req-3f15dbc3-45fc-4a83-9ac8-e07a343e7d65 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:16.494388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-220237133", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": "none"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:16.512017 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3449d5b2-9f42-4b2a-8f3e-d56431c51779 req-3f15dbc3-45fc-4a83-9ac8-e07a343e7d65 service nova] Creating event network-vif-plugged:2b9dfd70-7039-45c5-860c-01d7197e52b8 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:07:16.512871 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3449d5b2-9f42-4b2a-8f3e-d56431c51779 req-3f15dbc3-45fc-4a83-9ac8-e07a343e7d65 service nova] Creating event network-vif-plugged:d27720b2-53eb-4849-ad71-71c85b3b9502 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:07:16.513762 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3449d5b2-9f42-4b2a-8f3e-d56431c51779 req-3f15dbc3-45fc-4a83-9ac8-e07a343e7d65 service nova] Creating event network-vif-plugged:64e233cb-7770-4bcd-b9b7-a977e0aa27eb for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:07:16.521814 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3449d5b2-9f42-4b2a-8f3e-d56431c51779 req-3f15dbc3-45fc-4a83-9ac8-e07a343e7d65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.057621 Oct 11 20:07:16.523079 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2565/5099] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:16.605907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:07:16.606848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:07:16.608407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:07:16.609727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:07:16.611405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:07:16.640057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:16.641604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:16.643161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:16.644362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:16.646408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:16.646954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:16.672439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Getting quotas for project ef3043b3aba34e59a44aa2acc3d59132. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:07:16.679295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Getting quotas for user 098d54a5eb4749a3a75f68b1ea654093 and project ef3043b3aba34e59a44aa2acc3d59132. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:07:16.694708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:07:16.697937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:07:16.763820 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b36e608d-e2f1-414e-a000-b82440d530fb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.434108 Oct 11 20:07:16.764835 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2535/5100] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 20:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 20:07:16.778678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-52556c8f-cba4-47c7-9e96-7da07748d7e4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:16.780150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-52556c8f-cba4-47c7-9e96-7da07748d7e4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:16.848660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:16.849293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:16.861500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:16.863521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:16.867381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:16.870078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:16.870773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:16.873399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:16.934715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-52556c8f-cba4-47c7-9e96-7da07748d7e4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:16.950588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-52556c8f-cba4-47c7-9e96-7da07748d7e4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:16.955297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-52556c8f-cba4-47c7-9e96-7da07748d7e4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:16.958225 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-52556c8f-cba4-47c7-9e96-7da07748d7e4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1277 microversion: 2.54 time: 0.184293 Oct 11 20:07:16.958848 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2566/5101] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:16 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:17.005576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:17.006203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:17.016380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:17.019754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:17.020764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:17.022661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:17.023428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:17.024072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:17.185877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:17.199328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:17.204739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:17.205968 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a158556f-1ac4-4d1c-9791-db0a29f39254 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.204989 Oct 11 20:07:17.223514 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2567/5102] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:16 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:17.258860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:17.277936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:17.283549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:17.286275 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c73f395-695d-48c8-9a1d-979ddac7d17a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.441939 Oct 11 20:07:17.288732 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2536/5103] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:16 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:17.985262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:17.986810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:17.998657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:17.999260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:17.999807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:18.000628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:18.001161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:18.001659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:18.235671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:18.236530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:18.244377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:18.244874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:18.245310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:18.246044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:18.246499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:18.246980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:18.378833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:18.391541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:18.394146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:18.396124 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e4fe06fb-41ee-4379-a77c-28ef8ecd5b7b tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.164212 Oct 11 20:07:18.398678 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2537/5104] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:18 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:18.422656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:18.423821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:18.439515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:18.440153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:18.440849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:18.441805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:18.442743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:18.443544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:18.456934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:18.474322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:18.477188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:18.481477 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0af0f6b1-ff29-4a96-b5dc-bfe812c2359b tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1329 microversion: 2.54 time: 0.499387 Oct 11 20:07:18.483158 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2568/5105] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:17 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1329 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:18.496658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:18.549887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c61981d5-fb4b-4b9e-8f10-0c9eebe03af5 req-ea711b81-2066-4dc0-ae97-d842b82a4b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-plugged", "status": "completed", "tag": "44a07f61-efb7-4155-a25a-5ce814a621c5"}, {"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-plugged", "status": "completed", "tag": "c43aaecd-6f25-402d-af31-5703ca8f952b"}, {"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-plugged", "status": "completed", "tag": "ac77e5e9-a5ab-4a34-b656-059e80fc5465"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:18.565438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c61981d5-fb4b-4b9e-8f10-0c9eebe03af5 req-ea711b81-2066-4dc0-ae97-d842b82a4b9f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:18.566981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c61981d5-fb4b-4b9e-8f10-0c9eebe03af5 req-ea711b81-2066-4dc0-ae97-d842b82a4b9f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:18.568530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c61981d5-fb4b-4b9e-8f10-0c9eebe03af5 req-ea711b81-2066-4dc0-ae97-d842b82a4b9f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:18.598454 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c61981d5-fb4b-4b9e-8f10-0c9eebe03af5 req-ea711b81-2066-4dc0-ae97-d842b82a4b9f service nova] Creating event network-vif-plugged:44a07f61-efb7-4155-a25a-5ce814a621c5 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:07:18.599713 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c61981d5-fb4b-4b9e-8f10-0c9eebe03af5 req-ea711b81-2066-4dc0-ae97-d842b82a4b9f service nova] Creating event network-vif-plugged:c43aaecd-6f25-402d-af31-5703ca8f952b for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:07:18.600409 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c61981d5-fb4b-4b9e-8f10-0c9eebe03af5 req-ea711b81-2066-4dc0-ae97-d842b82a4b9f service nova] Creating event network-vif-plugged:ac77e5e9-a5ab-4a34-b656-059e80fc5465 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:07:18.609865 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c61981d5-fb4b-4b9e-8f10-0c9eebe03af5 req-ea711b81-2066-4dc0-ae97-d842b82a4b9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.063675 Oct 11 20:07:18.616101 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2569/5106] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:07:18.807553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:18.821833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:18.842278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:18.847539 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e09e27df-c888-4f85-abe9-5a87ed5480c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.445869 Oct 11 20:07:18.848389 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2538/5107] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:18 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:19.429225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:19.430761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:19.441045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:19.442800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:19.443483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:19.444999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:19.446740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:19.448104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:19.515305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:19.516568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:19.530025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:19.531909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:19.532512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:19.533118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:19.534095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:19.535069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:19.536247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:19.539953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:19.541758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:19.543299 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fd0ab864-c14f-4e82-bab1-c72f0c103398 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.118311 Oct 11 20:07:19.544264 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2570/5108] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:19 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:19.623086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:19.635707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:19.637161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:19.638304 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56a16266-f86d-49c3-a460-fa0436a785ac tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1335 microversion: 2.54 time: 0.129387 Oct 11 20:07:19.638902 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2539/5109] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:19 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1335 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:19.877479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:19.878090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:19.888207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:19.888728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:19.889194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:19.889903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:19.890367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:19.890811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:20.360658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:20.377221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:20.380148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:20.385786 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9583f181-ae53-4554-9276-1c52e25d561f tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1880 microversion: 2.32 time: 0.512098 Oct 11 20:07:20.386942 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2571/5110] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:19 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1880 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:20.571550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:20.572966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:20.583763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:20.595275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:20.595991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:20.600192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:20.600192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:20.600192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:20.667225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:20.668565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:20.688061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:20.689532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:20.690031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:20.690468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:20.691248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:20.692695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:20.693152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:20.720374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:20.734892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:20.741959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:20.746380 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-47e99342-9543-4e0a-9fc0-cb1f42804420 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.179028 Oct 11 20:07:20.758741 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2540/5111] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:20 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:20.791280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:20.801610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:20.803152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:20.804859 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9b22ff2a-1785-48bc-96fa-41ff9862d5e5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1335 microversion: 2.54 time: 0.141933 Oct 11 20:07:20.818686 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2572/5112] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:20 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1335 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:21.412729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:21.413365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:21.422375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:21.422909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:21.423620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:21.424502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:21.425119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:21.425839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:21.791466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:21.798205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:21.801034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:21.812803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:21.814559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:21.815946 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-08733c8e-421b-4907-abca-1ff7c3f79400 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2833 microversion: 2.32 time: 0.407382 Oct 11 20:07:21.816681 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2541/5113] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:21 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2833 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:21.816983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:21.817742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:21.818213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:21.818978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:21.819440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:21.819865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:21.844575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:21.845221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:21.867810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:21.868500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:21.869251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:21.870351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:21.871464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:21.872830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:21.949600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:21.968344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:21.972318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:21.978769 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a5574717-a9de-492c-b4db-3d3d59f3f58d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.204588 Oct 11 20:07:21.979374 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2573/5114] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:21 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:22.008369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f4b75644-c25d-4e3f-a0f4-af410868c441 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:22.009004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f4b75644-c25d-4e3f-a0f4-af410868c441 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:22.017348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4b75644-c25d-4e3f-a0f4-af410868c441 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:22.018390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4b75644-c25d-4e3f-a0f4-af410868c441 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:22.018870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4b75644-c25d-4e3f-a0f4-af410868c441 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:22.019948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4b75644-c25d-4e3f-a0f4-af410868c441 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:22.020531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4b75644-c25d-4e3f-a0f4-af410868c441 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:22.021031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4b75644-c25d-4e3f-a0f4-af410868c441 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:22.052231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:22.110159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:22.128351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:22.131589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:22.137177 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5d59c3e7-63e6-4134-af3a-c698a1f41126 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1356 microversion: 2.54 time: 0.302677 Oct 11 20:07:22.141236 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2542/5115] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:21 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1356 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:22.177076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c89e3025-edc4-4380-9020-c8521db1e568 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Action: 'create', calling method: .version_select at 0x7f83c756dc10>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1225850513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMASE5ri373g30YOMVthp2t29fxk/hlHHIKfMPvd7dIKUFPfLCGuxtNTx75aSzSFsIXLasH9+nbcevDfHfVX1pljZYG6EMjRcSQPOF4iyLAwlyJ9H4/5Oq77bZ7GqQRvQ=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:22.199484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c89e3025-edc4-4380-9020-c8521db1e568 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Getting quotas for project ef3043b3aba34e59a44aa2acc3d59132. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:07:22.207260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-c89e3025-edc4-4380-9020-c8521db1e568 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Getting quotas for user 098d54a5eb4749a3a75f68b1ea654093 and project ef3043b3aba34e59a44aa2acc3d59132. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:07:22.251850 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f4b75644-c25d-4e3f-a0f4-af410868c441 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.252665 Oct 11 20:07:22.252449 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2574/5116] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 11 20:07:21 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387/os-interface => generated 1831 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:22.284521 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c89e3025-edc4-4380-9020-c8521db1e568 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.113278 Oct 11 20:07:22.286078 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2543/5117] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 11 20:07:22 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 20:07:22.298139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1225850513", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:22.303130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:22.317782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:22.318212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:22.319007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:22.320230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:22.320909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:22.325763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:22.455716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:07:22.456310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:07:22.456892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:07:22.457404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:07:22.457916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:07:22.564741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:22.581731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:22.582252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:22.582729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:22.584523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:22.586479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:22.586974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:22.646447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7c64bbc3-f7cc-47a0-9ad7-55347550d21d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "POST /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872/action" status: 202 len: 1139 microversion: 2.54 time: 0.353039 Oct 11 20:07:22.647130 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2575/5118] 10.222.0.27 () {62 vars in 1320 bytes} [Tue Oct 11 20:07:22 2022] POST /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872/action => generated 1139 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 20:07:22.675173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:22.675812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:22.698604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:22.699259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:22.706108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:22.706108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:22.706108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:22.706108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:23.014170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:23.026985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:23.037497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:23.037989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:23.038430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:23.039783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:23.040244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:23.042467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:23.051611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:23.065919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:23.079377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:23.080658 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7d90e3b9-0b01-430e-bc02-954243187abb tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.411739 Oct 11 20:07:23.081304 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2544/5119] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:22 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:23.282080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:23.298415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:23.301374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:23.302645 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-320448a3-58f5-435a-a0bb-15d79083dc72 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.296854 Oct 11 20:07:23.315390 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2576/5120] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:23 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:24.118446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:24.120455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:24.137893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:24.141748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:24.142263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:24.147795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:24.148433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:24.148956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:24.300426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:24.331026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:24.332237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:24.359862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:24.361797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:24.362791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:24.364590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:24.366729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:24.368282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:24.370511 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e81f3f8f-b7bb-40d5-8cda-3030f79e17aa tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.258454 Oct 11 20:07:24.371014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:24.371737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:24.387245 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2545/5121] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:24 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:24.847653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:24.858964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:24.860482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:24.861599 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0781659d-b2a7-4769-acf5-3e26dcba868d tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1366 microversion: 2.57 time: 0.536358 Oct 11 20:07:24.862166 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2577/5122] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:24 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1366 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:25.060835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-de76de20-c0b0-4471-9599-744bb297d255 req-c80c2e26-2539-4247-a60f-2b50326ae887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "tag": "6f0763b2-25ba-4ba9-b513-99fb41f73411"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:25.083424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-de76de20-c0b0-4471-9599-744bb297d255 req-c80c2e26-2539-4247-a60f-2b50326ae887 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:25.086227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-de76de20-c0b0-4471-9599-744bb297d255 req-c80c2e26-2539-4247-a60f-2b50326ae887 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:25.086723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-de76de20-c0b0-4471-9599-744bb297d255 req-c80c2e26-2539-4247-a60f-2b50326ae887 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:25.103714 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-de76de20-c0b0-4471-9599-744bb297d255 req-c80c2e26-2539-4247-a60f-2b50326ae887 service nova] Creating event network-changed:6f0763b2-25ba-4ba9-b513-99fb41f73411 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:07:25.109755 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-de76de20-c0b0-4471-9599-744bb297d255 req-c80c2e26-2539-4247-a60f-2b50326ae887 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053458 Oct 11 20:07:25.113605 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2546/5123] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:25.408397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:25.409060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:25.421082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:25.422346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:25.422829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:25.423543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:25.424005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:25.424848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:25.552132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:25.568980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:25.570505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:25.572447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8e48e004-6034-4566-a2ff-e9abe9496412 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.168547 Oct 11 20:07:25.597383 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2578/5124] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:25 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:25.892501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:25.894431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:25.908584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:25.909409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:25.910070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:25.912426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:25.913205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:25.914047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:26.031045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:26.042103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:26.044122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:26.045341 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-df091ee1-d380-4198-b15a-145d01d0b410 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1372 microversion: 2.57 time: 0.158139 Oct 11 20:07:26.046388 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2547/5125] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:25 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:26.605033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:26.606174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:26.619627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:26.620478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:26.621715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:26.622765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:26.623758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:26.624636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:26.709031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:26.721631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:26.723862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:26.726029 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a53e5437-5225-4254-b5c6-1ad612c2d5c5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.126088 Oct 11 20:07:26.739508 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2579/5126] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:26 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:27.080223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:27.089288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:27.089915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:27.106845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:27.107380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:27.107853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:27.108639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:27.108993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:27.113305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:27.281586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:27.295202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:27.302639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:27.304833 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-68b8e1c3-3d9b-467b-bc39-b2d47d55e520 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1372 microversion: 2.57 time: 0.226487 Oct 11 20:07:27.311474 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2548/5127] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:27 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:27.757360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:27.758181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:27.762155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:27.771161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:27.771675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:27.772156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:27.772821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:27.773281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:27.773710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:27.854139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:27.863334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:27.864795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:27.865975 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c574f68-3cfa-402e-988e-bcceacb33536 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.112744 Oct 11 20:07:27.867103 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2580/5128] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:27 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:28.342474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:28.343880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:28.360855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:28.361372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:28.361823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:28.362573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:28.363044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:28.363489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:28.469369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:28.479560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:28.481109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:28.491676 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-73c21b0a-44dc-4ae3-b377-7997a78461a6 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1357 microversion: 2.57 time: 0.148323 Oct 11 20:07:28.494565 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2549/5129] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:28 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:28.528743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e7af0716-c52c-446c-bdc6-7b3848c13795 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:28.529252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e7af0716-c52c-446c-bdc6-7b3848c13795 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:28.546873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7af0716-c52c-446c-bdc6-7b3848c13795 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:28.547419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7af0716-c52c-446c-bdc6-7b3848c13795 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:28.547885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7af0716-c52c-446c-bdc6-7b3848c13795 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:28.548604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7af0716-c52c-446c-bdc6-7b3848c13795 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:28.549058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7af0716-c52c-446c-bdc6-7b3848c13795 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:28.549478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7af0716-c52c-446c-bdc6-7b3848c13795 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:28.598488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e7af0716-c52c-446c-bdc6-7b3848c13795 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:07:28.711770 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e7af0716-c52c-446c-bdc6-7b3848c13795 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "DELETE /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 204 len: 0 microversion: 2.57 time: 0.189174 Oct 11 20:07:28.723475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:28.724289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:28.729939 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2581/5130] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:07:28 2022] DELETE /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:07:28.733937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:28.735021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:28.735675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:28.736649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:28.737383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:28.738124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:28.850353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:28.859376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:28.860846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:28.862003 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-78e9c10a-de99-4ec1-9fa3-f8ceb1d85b86 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1363 microversion: 2.57 time: 0.144243 Oct 11 20:07:28.871615 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2550/5131] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:28 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:28.897018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:28.898346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:28.908610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:28.909447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:28.910088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:28.911095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:28.911872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:28.912500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:29.021356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:29.033894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:29.035867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:29.038010 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-48ee0136-deca-4c4b-8145-abd79ab23ded tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.146430 Oct 11 20:07:29.039856 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2582/5132] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:28 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:29.891352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:29.892915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:29.900606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:29.901111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:29.901557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:29.902272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:29.902767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:29.903205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:30.011124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:30.021749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:30.023349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a2d866682094b2c91374bc05a7d7c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c76e010614490bb54b046f8a38909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:30.024688 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1b5f45bc-94fb-4dd5-95aa-1eea3d8d6f65 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 200 len: 1363 microversion: 2.57 time: 0.138500 Oct 11 20:07:30.025270 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2551/5133] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:29 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:30.067792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:30.067792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:30.075480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:30.076121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:30.076629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:30.077407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:30.078048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:30.078552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:30.213058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:30.222105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:30.223880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:30.225090 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3617fa71-9d78-4545-9fd4-59a65965a50f tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.163512 Oct 11 20:07:30.225863 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2583/5134] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:30 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:31.052956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:31.053554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] [instance: 584ccd77-cd91-40f6-af79-3e603d12ba51] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:31.073380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:31.074448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:31.074931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:31.075673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:31.076248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:31.076686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:31.098319 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] HTTP exception thrown: Instance 584ccd77-cd91-40f6-af79-3e603d12ba51 could not be found. Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Request method failure captured: Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 HTTP/1.1 Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRczW1j6VAy7K1q50vnBrsvgbYd5LMwFIOSgVHbnIfuA8bcabGEQfEF3eW2SXsVGQ-bVJJoUTs9e1R0dgdihu2Wl4RRFMOWNe4UXJECLSvSMTk4iny1umtXEqtnsOM9JzKoHHizQg_Lrpr6n1Lib9wWJ-Eh5GtjRgFEEJKouidb5pOeA Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.57 Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9e3c76e010614490bb54b046f8a38909 Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerShowV257Test-1447278653 Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e3c76e010614490bb54b046f8a38909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e3c76e010614490bb54b046f8a38909", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e3c76e010614490bb54b046f8a38909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e3c76e010614490bb54b046f8a38909"}]}] Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerShowV257Test-1447278653 Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9e3c76e010614490bb54b046f8a38909 Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerShowV257Test-1447278653 Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerShowV257Test-1447278653-project Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 9a2d866682094b2c91374bc05a7d7c1c Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerShowV257Test-1447278653-project Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 584ccd77-cd91-40f6-af79-3e603d12ba51 could not be found. Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '584ccd77-cd91-40f6-af79-3e603d12ba51'} Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 584ccd77-cd91-40f6-af79-3e603d12ba51 could not be found. Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 584ccd77-cd91-40f6-af79-3e603d12ba51 could not be found. Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:31.100281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:31.106457 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:31.106457 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:31.106457 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:31.106457 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:07:31.106457 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:07:31.106457 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 584ccd77-cd91-40f6-af79-3e603d12ba51 could not be found. Oct 11 20:07:31.106457 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:31.107781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] Returning 404 to user: Instance 584ccd77-cd91-40f6-af79-3e603d12ba51 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:07:31.108665 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a93f5b59-d1d0-4697-aa9a-ba49166e75c3 tempest-ServerShowV257Test-1447278653 tempest-ServerShowV257Test-1447278653-project] 10.222.0.27 "GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51" status: 404 len: 111 microversion: 2.57 time: 0.061079 Oct 11 20:07:31.109576 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2552/5135] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:31 2022] GET /compute/v2.1/servers/584ccd77-cd91-40f6-af79-3e603d12ba51 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:07:31.253469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:31.255263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:31.264692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:31.265808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:31.266689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:31.267627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:31.268302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:31.269049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:31.384109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:31.396233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:31.399984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:31.401722 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8342c7e3-f3d6-4be8-800f-2acc51fa6f27 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.153948 Oct 11 20:07:31.416359 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2584/5136] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:31 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:32.430744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:32.431368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:32.437902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:32.439436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:32.440109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:32.440380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:32.441103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:32.441727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:32.442151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:32.539643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:32.548632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:32.550945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:32.552357 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93483413-454f-4ae1-bda8-070f2df51473 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.125853 Oct 11 20:07:32.553494 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2553/5137] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:32 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:33.581442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:33.582418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:33.592163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:33.592829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:33.593647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:33.594425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:33.594933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:33.595405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:33.706020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:33.738070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:33.739679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:33.740977 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-23691838-5787-4a6d-b00f-b3e8a8ba8142 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.164007 Oct 11 20:07:33.742894 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2585/5138] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:33 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:34.771251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:34.771994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:34.784006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:34.787265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:34.788005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:34.788897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:34.790799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:34.793032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:34.921397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:34.931223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:34.938203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:34.939469 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-17ad0cac-1f10-4cf0-99f7-f433c2c86ca7 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.173581 Oct 11 20:07:34.940788 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2554/5139] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:34 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:35.967745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:35.969146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:35.976735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:35.977702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:35.978070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:35.978841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:35.979302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:35.979733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:36.153650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:36.170158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:36.172331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:36.173835 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a6188f19-0173-4ab4-b602-dad8793d27fc tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.209944 Oct 11 20:07:36.174781 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2586/5140] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:35 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:37.059523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9fc134ba-2a3f-4374-8ae6-05047e702f7b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:37.061846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9fc134ba-2a3f-4374-8ae6-05047e702f7b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:37.080491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc134ba-2a3f-4374-8ae6-05047e702f7b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.080998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc134ba-2a3f-4374-8ae6-05047e702f7b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.081443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc134ba-2a3f-4374-8ae6-05047e702f7b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.082162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc134ba-2a3f-4374-8ae6-05047e702f7b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.082644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc134ba-2a3f-4374-8ae6-05047e702f7b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.083073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9fc134ba-2a3f-4374-8ae6-05047e702f7b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.191382 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9fc134ba-2a3f-4374-8ae6-05047e702f7b tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806/action" status: 200 len: 63101 microversion: 2.1 time: 0.136249 Oct 11 20:07:37.208042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:37.209435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:37.212366 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2555/5141] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:07:37 2022] POST /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806/action => generated 63101 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 20:07:37.227786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.228638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.229270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.230209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.230891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.233280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.253438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:37.341199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:37.354864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:37.357751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:37.359023 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1d9445a3-3a84-4424-b7fb-6670c6712aa3 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.155631 Oct 11 20:07:37.363314 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2587/5142] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:37 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:37.394367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e31915e3-1cf0-49dd-92c4-f47c625d90f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:37.395754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e31915e3-1cf0-49dd-92c4-f47c625d90f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:37.412309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e31915e3-1cf0-49dd-92c4-f47c625d90f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.414442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e31915e3-1cf0-49dd-92c4-f47c625d90f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.415706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e31915e3-1cf0-49dd-92c4-f47c625d90f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.419280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e31915e3-1cf0-49dd-92c4-f47c625d90f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.421181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e31915e3-1cf0-49dd-92c4-f47c625d90f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.422003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e31915e3-1cf0-49dd-92c4-f47c625d90f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.462799 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e31915e3-1cf0-49dd-92c4-f47c625d90f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe/ips" status: 200 len: 148 microversion: 2.1 time: 0.073173 Oct 11 20:07:37.463728 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2556/5143] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:07:37 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe/ips => generated 148 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:37.478258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "508b0ced-96e9-4f4f-a049-1cde40bbcb1c"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:37.481621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:37.500004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.501657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.502298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.503861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.506654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.507472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.667134 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Invalid volume: volume 508b0ced-96e9-4f4f-a049-1cde40bbcb1c is already attached to instances: ef13443d-3c56-4ec8-b242-fc39fa2f1a16 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe/os-volume_attachments HTTP/1.1 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 74 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: {"volumeAttachment": {"volumeId": "508b0ced-96e9-4f4f-a049-1cde40bbcb1c"}} Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: exception: Invalid volume: volume 508b0ced-96e9-4f4f-a049-1cde40bbcb1c is already attached to instances: ef13443d-3c56-4ec8-b242-fc39fa2f1a16 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': 'ecc1cee7-9aca-468a-9d10-9f985b7adcbe', 'body': {'volumeAttachment': {'volumeId': '508b0ced-96e9-4f4f-a049-1cde40bbcb1c'}}} Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 508b0ced-96e9-4f4f-a049-1cde40bbcb1c is already attached to instances: ef13443d-3c56-4ec8-b242-fc39fa2f1a16 Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:07:37.668871 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 508b0ced-96e9-4f4f-a049-1cde40bbcb1c is already attached to instances: ef13443d-3c56-4ec8-b242-fc39fa2f1a16 Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 508b0ced-96e9-4f4f-a049-1cde40bbcb1c is already attached to instances: ef13443d-3c56-4ec8-b242-fc39fa2f1a16 Oct 11 20:07:37.674389 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:07:37.679377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 400 to user: Invalid volume: volume 508b0ced-96e9-4f4f-a049-1cde40bbcb1c is already attached to instances: ef13443d-3c56-4ec8-b242-fc39fa2f1a16 {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:07:37.680936 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bfe3c536-0c4b-44b9-8093-6b4330b5cc84 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.208889 Oct 11 20:07:37.687045 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2588/5144] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:07:37 2022] POST /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe/os-volume_attachments => generated 174 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 20:07:37.690651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4ecd0ebd-913b-4317-87f8-27e1cfe3e678 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:37.691289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ecd0ebd-913b-4317-87f8-27e1cfe3e678 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:37.702851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ecd0ebd-913b-4317-87f8-27e1cfe3e678 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.705425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ecd0ebd-913b-4317-87f8-27e1cfe3e678 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.706005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ecd0ebd-913b-4317-87f8-27e1cfe3e678 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.706760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ecd0ebd-913b-4317-87f8-27e1cfe3e678 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.710975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ecd0ebd-913b-4317-87f8-27e1cfe3e678 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.711683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ecd0ebd-913b-4317-87f8-27e1cfe3e678 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.753502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ecd0ebd-913b-4317-87f8-27e1cfe3e678 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:07:37.760054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:37.893301 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4ecd0ebd-913b-4317-87f8-27e1cfe3e678 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 204 len: 0 microversion: 2.1 time: 0.206388 Oct 11 20:07:37.894696 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2557/5145] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:07:37 2022] DELETE /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:07:37.904293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ad9b48c-e010-49c7-9192-084564331a96 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:37.905061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6ad9b48c-e010-49c7-9192-084564331a96 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:37.919161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ad9b48c-e010-49c7-9192-084564331a96 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.919965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ad9b48c-e010-49c7-9192-084564331a96 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.921711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ad9b48c-e010-49c7-9192-084564331a96 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:37.924221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ad9b48c-e010-49c7-9192-084564331a96 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:37.925883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ad9b48c-e010-49c7-9192-084564331a96 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:37.927852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ad9b48c-e010-49c7-9192-084564331a96 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:38.334174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6ad9b48c-e010-49c7-9192-084564331a96 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:38.346425 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6ad9b48c-e010-49c7-9192-084564331a96 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1678 microversion: 2.1 time: 0.444080 Oct 11 20:07:38.347315 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2589/5146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:37 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1678 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:38.388548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:38.390279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:38.397908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:38.406584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:38.410488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:38.411364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:38.412377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:38.415544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:38.416390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:38.564376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:38.577937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:38.580052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:38.582245 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ac8472cc-40a3-49b7-81bd-99234a1e4d09 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.198992 Oct 11 20:07:38.583534 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2558/5147] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:38 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:39.324442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] Calling method '.version_select at 0x7f83c724d280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:39.326802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:39.327580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:39.328600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:39.351060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:39.351611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:39.351972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:39.364849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:39.365568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:39.366171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:39.374504 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-881c2327-3d84-47dd-b1ad-4ed8011210cd tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243 tempest-PortsAdminExtendedAttrsIpV6TestJSON-347785243-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.332789 Oct 11 20:07:39.375667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-181a1fe7-9e9c-48df-8813-7ad75ab0a811 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:39.375861 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2590/5148] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 20:07:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:39.376537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-181a1fe7-9e9c-48df-8813-7ad75ab0a811 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:39.398248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-181a1fe7-9e9c-48df-8813-7ad75ab0a811 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:39.398890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-181a1fe7-9e9c-48df-8813-7ad75ab0a811 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:39.400692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-181a1fe7-9e9c-48df-8813-7ad75ab0a811 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:39.401422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-181a1fe7-9e9c-48df-8813-7ad75ab0a811 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:39.401975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-181a1fe7-9e9c-48df-8813-7ad75ab0a811 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:39.402483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-181a1fe7-9e9c-48df-8813-7ad75ab0a811 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:39.619199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:39.620399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:39.631295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:39.644427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:39.645135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:39.646053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:39.646781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:39.647287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:39.772292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:39.787235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:39.789202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:39.792100 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-36ecc0ff-3b5f-4c25-9833-e94a23e4ac5d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.177208 Oct 11 20:07:39.793061 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2591/5149] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:39 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:39.930452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-181a1fe7-9e9c-48df-8813-7ad75ab0a811 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:39.945442 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-181a1fe7-9e9c-48df-8813-7ad75ab0a811 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1678 microversion: 2.1 time: 0.574634 Oct 11 20:07:39.946644 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2559/5150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:39 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1678 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:07:40.818668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:40.819211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:40.832708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:40.833514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:40.834246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:40.834985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:40.835447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:40.835937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:40.971718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bbdc2f71-d46d-47a5-bf25-cfdff1bebcb9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:40.972341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bbdc2f71-d46d-47a5-bf25-cfdff1bebcb9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:40.974388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:40.987092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:40.988543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:40.989732 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cef82f9a-d27b-41f2-a147-02ea718da4b1 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.175409 Oct 11 20:07:40.990293 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2592/5151] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:40 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:40.998557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdc2f71-d46d-47a5-bf25-cfdff1bebcb9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:40.999835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdc2f71-d46d-47a5-bf25-cfdff1bebcb9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:41.000915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdc2f71-d46d-47a5-bf25-cfdff1bebcb9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:41.002431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdc2f71-d46d-47a5-bf25-cfdff1bebcb9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:41.003162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdc2f71-d46d-47a5-bf25-cfdff1bebcb9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:41.004084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdc2f71-d46d-47a5-bf25-cfdff1bebcb9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:41.175466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bbdc2f71-d46d-47a5-bf25-cfdff1bebcb9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:41.196497 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bbdc2f71-d46d-47a5-bf25-cfdff1bebcb9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1612 microversion: 2.1 time: 0.228069 Oct 11 20:07:41.197375 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2560/5152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:40 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1612 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:41.588263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-7dc42a1b-faa9-4161-a2e4-0e5e3249c64e req-af5e3cce-362b-4375-9e69-5d250f0e1c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc1cee7-9aca-468a-9d10-9f985b7adcbe", "name": "network-vif-deleted", "tag": "69d6abd1-2254-46cc-8590-0ba134f40ebf"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:41.600147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7dc42a1b-faa9-4161-a2e4-0e5e3249c64e req-af5e3cce-362b-4375-9e69-5d250f0e1c94 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:41.601499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7dc42a1b-faa9-4161-a2e4-0e5e3249c64e req-af5e3cce-362b-4375-9e69-5d250f0e1c94 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:41.602801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7dc42a1b-faa9-4161-a2e4-0e5e3249c64e req-af5e3cce-362b-4375-9e69-5d250f0e1c94 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:41.616374 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-7dc42a1b-faa9-4161-a2e4-0e5e3249c64e req-af5e3cce-362b-4375-9e69-5d250f0e1c94 service nova] Creating event network-vif-deleted:69d6abd1-2254-46cc-8590-0ba134f40ebf for instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe on n-h2-860864-3 Oct 11 20:07:41.623173 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-7dc42a1b-faa9-4161-a2e4-0e5e3249c64e req-af5e3cce-362b-4375-9e69-5d250f0e1c94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039532 Oct 11 20:07:41.624043 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2593/5153] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:07:42.019286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:42.020613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:42.035453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:42.035963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:42.036412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:42.037133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:42.037597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:42.038033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:42.222796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:42.223508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:42.238831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:42.249943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:42.251246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:42.252462 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e88da34d-582d-4f54-8871-65a252d3a5f4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.237453 Oct 11 20:07:42.253068 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2561/5154] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:42 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:42.261815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:42.262570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:42.262811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:42.263562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:42.264018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:42.264443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:42.357160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:42.357660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:42.358110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:42.358583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lazy-loading 'fault' on Instance uuid ecc1cee7-9aca-468a-9d10-9f985b7adcbe {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:07:42.495201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:42.502870 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4ea10243-23d5-49a7-8ce6-f04ef0878882 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 200 len: 1331 microversion: 2.1 time: 0.285301 Oct 11 20:07:42.505170 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2594/5155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:42 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 1331 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:07:43.283410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:43.284130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:43.298757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:43.299343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:43.299860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:43.300838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:43.307726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:43.308557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:43.473551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:43.489911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:43.510608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:43.512997 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-064b30b6-81cb-4d3e-9d51-06f18a78d55d tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.233992 Oct 11 20:07:43.515859 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2562/5156] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:43 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:43.543989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:43.544776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:43.569457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:43.573732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:43.575710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:43.576614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:43.579635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:43.583138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:43.616472 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe HTTP/1.1 Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ecc1cee7-9aca-468a-9d10-9f985b7adcbe'} Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:43.625994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:43.631044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:43.631044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:43.631044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:43.631044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:07:43.631044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:07:43.631044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:07:43.631044 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:43.633570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:07:43.636169 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-28f08988-267e-4923-a806-c9e1566200d1 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 404 len: 111 microversion: 2.1 time: 0.107899 Oct 11 20:07:43.637319 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2563/5157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:43 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 20:07:43.654482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aca79692-5b1b-4a13-9cb4-56ca2090635b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '.version_select at 0x7f83d06f9700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:43.700798 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aca79692-5b1b-4a13-9cb4-56ca2090635b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109846199" status: 202 len: 0 microversion: 2.1 time: 0.059092 Oct 11 20:07:43.701515 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2564/5158] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 20:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109846199 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:07:43.987100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-287a8ae6-4df0-491a-ba0a-576acac638f5 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:43.987993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-287a8ae6-4df0-491a-ba0a-576acac638f5 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:44.000293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a8ae6-4df0-491a-ba0a-576acac638f5 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:44.001149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a8ae6-4df0-491a-ba0a-576acac638f5 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:44.002842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a8ae6-4df0-491a-ba0a-576acac638f5 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:44.004982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a8ae6-4df0-491a-ba0a-576acac638f5 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:44.005641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a8ae6-4df0-491a-ba0a-576acac638f5 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:44.007301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-287a8ae6-4df0-491a-ba0a-576acac638f5 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:44.548205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:44.548921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:44.576624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:44.577524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:44.578469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:44.579641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:44.580470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:44.581869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:44.701713 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-287a8ae6-4df0-491a-ba0a-576acac638f5 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1833 microversion: 2.1 time: 1.295602 Oct 11 20:07:44.702229 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2595/5159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:43 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1833 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:07:44.720774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:44.741029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:44.743873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:44.745402 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-537abeb9-2731-4ce0-a9ae-aa2ae4762b68 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.202950 Oct 11 20:07:44.746001 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2565/5160] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:44 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:45.776980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:45.777839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:45.792541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:45.793128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:45.793679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:45.794704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:45.795271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:45.795770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:45.967909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:45.984989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:45.987850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:45.989458 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1b15b7f-7683-40fa-92b1-7a1ff10a6baf tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.216773 Oct 11 20:07:45.991125 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2596/5161] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:45 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:46.016860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f9aa26a-f25b-4e44-9772-883bde3ead9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:46.017472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8f9aa26a-f25b-4e44-9772-883bde3ead9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:46.026836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9aa26a-f25b-4e44-9772-883bde3ead9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:46.027714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9aa26a-f25b-4e44-9772-883bde3ead9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:46.028236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9aa26a-f25b-4e44-9772-883bde3ead9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:46.029008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9aa26a-f25b-4e44-9772-883bde3ead9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:46.029644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9aa26a-f25b-4e44-9772-883bde3ead9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:46.030299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9aa26a-f25b-4e44-9772-883bde3ead9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:46.183125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-8f9aa26a-f25b-4e44-9772-883bde3ead9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lazy-loading 'services' on Instance uuid ef13443d-3c56-4ec8-b242-fc39fa2f1a16 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:07:46.301106 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f9aa26a-f25b-4e44-9772-883bde3ead9c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments/508b0ced-96e9-4f4f-a049-1cde40bbcb1c" status: 202 len: 0 microversion: 2.1 time: 0.288487 Oct 11 20:07:46.306037 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2566/5162] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:07:46 2022] DELETE /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments/508b0ced-96e9-4f4f-a049-1cde40bbcb1c => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:07:46.317728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c25ef53-cc87-447c-98c8-8f8391afdc22 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:46.330370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c25ef53-cc87-447c-98c8-8f8391afdc22 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:46.345334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c25ef53-cc87-447c-98c8-8f8391afdc22 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:46.364869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c25ef53-cc87-447c-98c8-8f8391afdc22 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:46.365395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c25ef53-cc87-447c-98c8-8f8391afdc22 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:46.366162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c25ef53-cc87-447c-98c8-8f8391afdc22 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:46.366672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c25ef53-cc87-447c-98c8-8f8391afdc22 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:46.367132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c25ef53-cc87-447c-98c8-8f8391afdc22 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:46.437556 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c25ef53-cc87-447c-98c8-8f8391afdc22 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129995 Oct 11 20:07:46.438146 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2597/5163] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:07:46 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:47.020792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:47.021529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:47.037764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:47.038340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-58664212-6b35-4a8e-aac2-3fafed2acc63 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:47.038870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:47.038870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:47.040280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-58664212-6b35-4a8e-aac2-3fafed2acc63 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:47.041380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:47.041868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:47.045811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:47.055915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58664212-6b35-4a8e-aac2-3fafed2acc63 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:47.057317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58664212-6b35-4a8e-aac2-3fafed2acc63 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:47.059114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58664212-6b35-4a8e-aac2-3fafed2acc63 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:47.061216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58664212-6b35-4a8e-aac2-3fafed2acc63 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:47.062596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58664212-6b35-4a8e-aac2-3fafed2acc63 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:47.063264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58664212-6b35-4a8e-aac2-3fafed2acc63 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:47.143240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-58664212-6b35-4a8e-aac2-3fafed2acc63 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:07:47.214259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:47.228246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:47.236161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:47.237856 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3f1eebfd-e472-408f-85dc-ba5aabe259f6 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.222203 Oct 11 20:07:47.252994 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2567/5164] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:47 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:47.326216 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-58664212-6b35-4a8e-aac2-3fafed2acc63 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 204 len: 0 microversion: 2.1 time: 0.293756 Oct 11 20:07:47.328030 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2598/5165] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:07:47 2022] DELETE /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:07:47.343123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fba1f01a-95e5-4330-b606-206b932b43ee tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:47.344003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fba1f01a-95e5-4330-b606-206b932b43ee tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:47.369139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fba1f01a-95e5-4330-b606-206b932b43ee tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:47.369564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fba1f01a-95e5-4330-b606-206b932b43ee tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:47.372040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fba1f01a-95e5-4330-b606-206b932b43ee tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:47.372984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fba1f01a-95e5-4330-b606-206b932b43ee tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:47.373615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fba1f01a-95e5-4330-b606-206b932b43ee tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:47.374426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fba1f01a-95e5-4330-b606-206b932b43ee tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:47.426606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-08247c02-52c0-4876-bc19-4d6484aa7328 req-3338ebd0-400f-4366-85dd-30c94dc71df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:47.455998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-08247c02-52c0-4876-bc19-4d6484aa7328 req-3338ebd0-400f-4366-85dd-30c94dc71df0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:47.457337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-08247c02-52c0-4876-bc19-4d6484aa7328 req-3338ebd0-400f-4366-85dd-30c94dc71df0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:47.459576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-08247c02-52c0-4876-bc19-4d6484aa7328 req-3338ebd0-400f-4366-85dd-30c94dc71df0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:47.498319 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-08247c02-52c0-4876-bc19-4d6484aa7328 req-3338ebd0-400f-4366-85dd-30c94dc71df0 service nova] Creating event network-changed:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h1-860864-3 Oct 11 20:07:47.511705 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-08247c02-52c0-4876-bc19-4d6484aa7328 req-3338ebd0-400f-4366-85dd-30c94dc71df0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257018 Oct 11 20:07:47.512766 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2568/5166] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:47.527368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f85590a-fa30-4477-b037-a4fdaefeed15 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:47.533888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f85590a-fa30-4477-b037-a4fdaefeed15 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:47.556888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f85590a-fa30-4477-b037-a4fdaefeed15 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:47.559207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f85590a-fa30-4477-b037-a4fdaefeed15 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:47.561136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f85590a-fa30-4477-b037-a4fdaefeed15 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:47.565952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f85590a-fa30-4477-b037-a4fdaefeed15 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:47.567353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f85590a-fa30-4477-b037-a4fdaefeed15 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:47.569756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f85590a-fa30-4477-b037-a4fdaefeed15 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:47.662993 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f85590a-fa30-4477-b037-a4fdaefeed15 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146216 Oct 11 20:07:47.665956 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2569/5167] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:07:47 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:47.847048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fba1f01a-95e5-4330-b606-206b932b43ee tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:47.861660 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fba1f01a-95e5-4330-b606-206b932b43ee tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1688 microversion: 2.1 time: 0.524402 Oct 11 20:07:47.864833 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2599/5168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:47 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1688 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:48.271834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:48.272586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:48.295314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:48.296209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:48.296970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:48.298010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:48.298776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:48.300303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:48.547171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:48.579965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:48.589486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:48.596482 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6f400b0d-bcc2-4b35-aab5-3780a20278d4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.328063 Oct 11 20:07:48.599666 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2570/5169] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:48 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:48.678771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6deb003a-6069-4744-9111-b7df90b1867e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:48.682060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6deb003a-6069-4744-9111-b7df90b1867e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:48.733548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6deb003a-6069-4744-9111-b7df90b1867e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:48.737321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6deb003a-6069-4744-9111-b7df90b1867e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:48.741212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6deb003a-6069-4744-9111-b7df90b1867e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:48.743852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6deb003a-6069-4744-9111-b7df90b1867e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:48.744393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6deb003a-6069-4744-9111-b7df90b1867e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:48.744779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6deb003a-6069-4744-9111-b7df90b1867e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:48.826260 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6deb003a-6069-4744-9111-b7df90b1867e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153593 Oct 11 20:07:48.828277 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2600/5170] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:07:48 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:48.893664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc416123-256c-495b-8b83-e8a8c46180b6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:48.894499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc416123-256c-495b-8b83-e8a8c46180b6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:48.903524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc416123-256c-495b-8b83-e8a8c46180b6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:48.904564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc416123-256c-495b-8b83-e8a8c46180b6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:48.916545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc416123-256c-495b-8b83-e8a8c46180b6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:48.920365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc416123-256c-495b-8b83-e8a8c46180b6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:48.921068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc416123-256c-495b-8b83-e8a8c46180b6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:48.921716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc416123-256c-495b-8b83-e8a8c46180b6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:49.521200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc416123-256c-495b-8b83-e8a8c46180b6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:49.549236 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc416123-256c-495b-8b83-e8a8c46180b6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1688 microversion: 2.1 time: 0.659679 Oct 11 20:07:49.549850 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2571/5171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:48 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1688 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:49.629936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:49.631084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:49.642267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:49.646499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:49.647265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:49.648283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:49.650031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:49.659320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:49.840850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-34e8256b-ddc7-4faa-9f27-65104e1ffdd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:49.844729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-34e8256b-ddc7-4faa-9f27-65104e1ffdd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:49.867570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e8256b-ddc7-4faa-9f27-65104e1ffdd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:49.873381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e8256b-ddc7-4faa-9f27-65104e1ffdd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:49.878721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e8256b-ddc7-4faa-9f27-65104e1ffdd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:49.884207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e8256b-ddc7-4faa-9f27-65104e1ffdd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:49.884830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e8256b-ddc7-4faa-9f27-65104e1ffdd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:49.886838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34e8256b-ddc7-4faa-9f27-65104e1ffdd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:49.983329 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-34e8256b-ddc7-4faa-9f27-65104e1ffdd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147604 Oct 11 20:07:49.983964 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2572/5172] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:07:49 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:07:50.047561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:50.070650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:50.077598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:50.079216 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6c0310ea-c894-4578-826d-4ac1d225b941 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.454579 Oct 11 20:07:50.082541 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2601/5173] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:49 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:50.156227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-076ad227-7582-4d8e-8d31-2386f792195a req-66a0d85b-a61c-4606-8368-1482a3e1249d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53702612-69c8-4d6a-8f6c-e9fc8f41f806", "name": "network-vif-deleted", "tag": "a41a779b-6569-4641-9152-b92e866d964c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:50.193086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-076ad227-7582-4d8e-8d31-2386f792195a req-66a0d85b-a61c-4606-8368-1482a3e1249d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:50.193661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-076ad227-7582-4d8e-8d31-2386f792195a req-66a0d85b-a61c-4606-8368-1482a3e1249d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:50.194955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-076ad227-7582-4d8e-8d31-2386f792195a req-66a0d85b-a61c-4606-8368-1482a3e1249d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:50.219505 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-076ad227-7582-4d8e-8d31-2386f792195a req-66a0d85b-a61c-4606-8368-1482a3e1249d service nova] Creating event network-vif-deleted:a41a779b-6569-4641-9152-b92e866d964c for instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 on n-h1-860864-3 Oct 11 20:07:50.231696 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-076ad227-7582-4d8e-8d31-2386f792195a req-66a0d85b-a61c-4606-8368-1482a3e1249d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079645 Oct 11 20:07:50.232722 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2573/5174] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:50.575373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:50.575995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:50.586744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:50.587299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:50.587825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:50.588689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:50.589169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:50.589686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:50.674408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:50.674944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:50.675391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:50.675855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lazy-loading 'fault' on Instance uuid 53702612-69c8-4d6a-8f6c-e9fc8f41f806 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:07:50.677971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:50.840054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:50.855190 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6058f886-62c0-409d-ba10-d171a4f5c2b3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 200 len: 1354 microversion: 2.1 time: 0.280217 Oct 11 20:07:50.856154 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2602/5175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:50 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 1354 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:50.997888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe900526-888a-4790-bee9-18b474586340 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:51.000537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fe900526-888a-4790-bee9-18b474586340 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:51.031279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe900526-888a-4790-bee9-18b474586340 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:51.034231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe900526-888a-4790-bee9-18b474586340 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:51.036122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe900526-888a-4790-bee9-18b474586340 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:51.039110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe900526-888a-4790-bee9-18b474586340 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:51.041518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe900526-888a-4790-bee9-18b474586340 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:51.043449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe900526-888a-4790-bee9-18b474586340 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:51.096848 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fe900526-888a-4790-bee9-18b474586340 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104521 Oct 11 20:07:51.097641 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2574/5176] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:07:50 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:51.121178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:51.122508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:51.127088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:51.143575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:51.146692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:51.153013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:51.157144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:51.157652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:51.161767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:51.294059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:51.312023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:51.314121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:51.315752 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-519a915e-ef2d-4d4e-a6ae-eda4e241e8c4 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.199862 Oct 11 20:07:51.329184 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2603/5177] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:51 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:51.885549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:51.886559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 53702612-69c8-4d6a-8f6c-e9fc8f41f806] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:51.894643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:51.898004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:51.899014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:51.899950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:51.900525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:51.901057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:51.908603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:07:51.924971 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] HTTP exception thrown: Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 could not be found. Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Request method failure captured: Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 HTTP/1.1 Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcuuQjfIszkyOtJSECoXLkoDQN-z4e4y6WzgPHiOSPLqH5SV-HvPoQdiMi_GwUDM2EltrUPWVnUG7Mw5CMaCpk0b-jW44fhL6WJJqofKREBBrNQ7WBjPWizW0ivaOVl1mT2-eDn57Y1mQoC_gVSHEDqQtnZgH9UL0JndxPnm8zhH4eU Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: abba65df7ef6403db3d5b466eb12fb94 Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abba65df7ef6403db3d5b466eb12fb94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abba65df7ef6403db3d5b466eb12fb94", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abba65df7ef6403db3d5b466eb12fb94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abba65df7ef6403db3d5b466eb12fb94"}]}] Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: abba65df7ef6403db3d5b466eb12fb94 Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestNetworkAdvancedServerOps-97175932-project Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: c3eaa8c79a0645fd93e6e3398426237f Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestNetworkAdvancedServerOps-97175932-project Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 could not be found. Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '53702612-69c8-4d6a-8f6c-e9fc8f41f806'} Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 could not be found. Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 could not be found. Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:51.928062 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 could not be found. Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Returning 404 to user: Instance 53702612-69c8-4d6a-8f6c-e9fc8f41f806 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-265074eb-e373-4f69-bd7b-8905b07123ae tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806" status: 404 len: 111 microversion: 2.1 time: 0.051267 Oct 11 20:07:51.936495 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2575/5178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:51 2022] GET /compute/v2.1/servers/53702612-69c8-4d6a-8f6c-e9fc8f41f806 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 20:07:52.111148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a4e6162d-3195-41af-b854-6e9c108bba24 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:52.115528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a4e6162d-3195-41af-b854-6e9c108bba24 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:52.128126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e6162d-3195-41af-b854-6e9c108bba24 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:52.128887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e6162d-3195-41af-b854-6e9c108bba24 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:52.129501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e6162d-3195-41af-b854-6e9c108bba24 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:52.130409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e6162d-3195-41af-b854-6e9c108bba24 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:52.131236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e6162d-3195-41af-b854-6e9c108bba24 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:52.132015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a4e6162d-3195-41af-b854-6e9c108bba24 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:52.172992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1558516489", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "ddfb4c5e-5a7c-4e8f-a35a-eb3995156619"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:07:52.189887 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a4e6162d-3195-41af-b854-6e9c108bba24 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083325 Oct 11 20:07:52.191015 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2576/5179] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:07:52 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:52.267699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] validate_networks() for [('ddfb4c5e-5a7c-4e8f-a35a-eb3995156619', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:07:52.344234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:52.345347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:52.353279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:52.354203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:52.354979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:52.356352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:52.357122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:52.357789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:52.559132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:52.569188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:52.571584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:52.573026 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-606640db-7756-46d2-9dbc-7f324ff08b61 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.233827 Oct 11 20:07:52.575158 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2577/5180] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:52 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:07:53.206620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c35909c5-ebde-4f0e-9e87-935ea54c5977 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:53.209895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c35909c5-ebde-4f0e-9e87-935ea54c5977 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:53.223531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35909c5-ebde-4f0e-9e87-935ea54c5977 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:53.224948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35909c5-ebde-4f0e-9e87-935ea54c5977 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:53.225801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35909c5-ebde-4f0e-9e87-935ea54c5977 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:53.228845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35909c5-ebde-4f0e-9e87-935ea54c5977 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:53.229495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35909c5-ebde-4f0e-9e87-935ea54c5977 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:53.230096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c35909c5-ebde-4f0e-9e87-935ea54c5977 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:53.310504 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c35909c5-ebde-4f0e-9e87-935ea54c5977 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110923 Oct 11 20:07:53.317591 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2578/5181] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:07:53 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:07:53.601115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:53.602187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:53.608562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:53.609838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:53.610566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:53.611612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:53.612310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:53.613113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:53.876211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:53.889355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:53.891075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:53.900178 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7d466462-cb52-4fc3-be9a-0d8090d5c140 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1408 microversion: 2.54 time: 0.303625 Oct 11 20:07:53.901143 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2579/5182] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:53 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:54.104362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:07:54.104961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:07:54.105277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:07:54.106351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:07:54.107856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:07:54.124758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:54.125713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:54.126396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:54.127705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:54.128389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:54.129151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:54.168679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Getting quotas for project 9ed3bc3632e24e7b935fd448505a4a0d. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:07:54.182501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Getting quotas for user 65f5d487f49548ea8de04740c803b4ef and project 9ed3bc3632e24e7b935fd448505a4a0d. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:07:54.228697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:07:54.249036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:07:54.329088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ab8d7134-465a-4829-b0e8-f5236a439dde tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:54.340219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ab8d7134-465a-4829-b0e8-f5236a439dde tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:54.369344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8d7134-465a-4829-b0e8-f5236a439dde tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:54.370672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8d7134-465a-4829-b0e8-f5236a439dde tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:54.372121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8d7134-465a-4829-b0e8-f5236a439dde tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:54.381372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8d7134-465a-4829-b0e8-f5236a439dde tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:54.381876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8d7134-465a-4829-b0e8-f5236a439dde tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:54.382677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab8d7134-465a-4829-b0e8-f5236a439dde tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:54.514043 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c6fca33e-e5e5-4967-af5d-8a27633fb35f tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.418295 Oct 11 20:07:54.526213 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2604/5183] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:07:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:07:54.531315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44aab588-d05c-4507-981b-fa724a9d2a1d tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:54.532165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-44aab588-d05c-4507-981b-fa724a9d2a1d tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:54.566494 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ab8d7134-465a-4829-b0e8-f5236a439dde tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.241878 Oct 11 20:07:54.568457 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2580/5184] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:07:54 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:54.649271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-44aab588-d05c-4507-981b-fa724a9d2a1d tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:54.660601 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-44aab588-d05c-4507-981b-fa724a9d2a1d tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1228 microversion: 2.1 time: 0.131856 Oct 11 20:07:54.678948 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2605/5185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:54 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1228 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:54.928812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:54.929851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:54.942184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:54.945577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:54.947230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:54.949288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:54.951433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:54.953203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:55.103847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:55.119458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:55.123841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:55.125504 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e69b3870-0644-467f-ab29-f2e21fa0467c tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1414 microversion: 2.54 time: 0.202011 Oct 11 20:07:55.159529 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2581/5186] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:54 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1414 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:55.583058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c8725473-42db-4cdd-b199-5f4cc75cf2e5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:55.588469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c8725473-42db-4cdd-b199-5f4cc75cf2e5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:55.616378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8725473-42db-4cdd-b199-5f4cc75cf2e5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:55.617878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8725473-42db-4cdd-b199-5f4cc75cf2e5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:55.618654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8725473-42db-4cdd-b199-5f4cc75cf2e5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:55.619619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8725473-42db-4cdd-b199-5f4cc75cf2e5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:55.620480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8725473-42db-4cdd-b199-5f4cc75cf2e5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:55.621627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8725473-42db-4cdd-b199-5f4cc75cf2e5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:55.672436 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c8725473-42db-4cdd-b199-5f4cc75cf2e5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096712 Oct 11 20:07:55.674518 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2606/5187] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:07:55 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:07:55.694425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0b56ddfb-07ea-485d-bb2a-4a25bd527e6e tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:55.697846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0b56ddfb-07ea-485d-bb2a-4a25bd527e6e tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:55.727833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b56ddfb-07ea-485d-bb2a-4a25bd527e6e tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:55.727833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b56ddfb-07ea-485d-bb2a-4a25bd527e6e tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:55.734802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b56ddfb-07ea-485d-bb2a-4a25bd527e6e tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:55.735764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b56ddfb-07ea-485d-bb2a-4a25bd527e6e tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:55.737872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b56ddfb-07ea-485d-bb2a-4a25bd527e6e tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:55.738344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b56ddfb-07ea-485d-bb2a-4a25bd527e6e tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:55.844933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ef881283-bff1-4383-bb7d-2bd483b4a9d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:55.845545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef881283-bff1-4383-bb7d-2bd483b4a9d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:55.853898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef881283-bff1-4383-bb7d-2bd483b4a9d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:55.854495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef881283-bff1-4383-bb7d-2bd483b4a9d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:55.854965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef881283-bff1-4383-bb7d-2bd483b4a9d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:55.855863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef881283-bff1-4383-bb7d-2bd483b4a9d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:55.856343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef881283-bff1-4383-bb7d-2bd483b4a9d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:55.856805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef881283-bff1-4383-bb7d-2bd483b4a9d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:55.961663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef881283-bff1-4383-bb7d-2bd483b4a9d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:07:56.009193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0b56ddfb-07ea-485d-bb2a-4a25bd527e6e tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:56.019902 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0b56ddfb-07ea-485d-bb2a-4a25bd527e6e tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1224 microversion: 2.1 time: 0.332316 Oct 11 20:07:56.025150 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2582/5188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:55 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1224 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:56.162278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:56.164496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:56.181332 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ef881283-bff1-4383-bb7d-2bd483b4a9d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 204 len: 0 microversion: 2.1 time: 0.340610 Oct 11 20:07:56.181979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:56.182509 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2607/5189] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:07:55 2022] DELETE /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:07:56.186335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:56.186906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:56.189995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:56.191530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:56.193641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:56.199022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-60e0a117-7732-4f45-b89d-eea3e596e100 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:56.200190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-60e0a117-7732-4f45-b89d-eea3e596e100 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:56.218672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e0a117-7732-4f45-b89d-eea3e596e100 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:56.221883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e0a117-7732-4f45-b89d-eea3e596e100 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:56.224990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e0a117-7732-4f45-b89d-eea3e596e100 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:56.226109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e0a117-7732-4f45-b89d-eea3e596e100 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:56.227431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e0a117-7732-4f45-b89d-eea3e596e100 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:56.229087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-60e0a117-7732-4f45-b89d-eea3e596e100 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:56.391572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:56.415444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:56.420409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:56.423047 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e4828838-ab60-41c6-b7d1-9df8390ff27a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1414 microversion: 2.54 time: 0.266660 Oct 11 20:07:56.426253 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2583/5190] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:56 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1414 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:56.656474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-60e0a117-7732-4f45-b89d-eea3e596e100 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:56.670947 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-60e0a117-7732-4f45-b89d-eea3e596e100 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1680 microversion: 2.1 time: 0.482351 Oct 11 20:07:56.672364 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2608/5191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:56 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1680 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:07:57.057090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d25231e8-a4a0-4baf-80e2-b8cc44eb1f54 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:57.058323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d25231e8-a4a0-4baf-80e2-b8cc44eb1f54 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:57.076784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d25231e8-a4a0-4baf-80e2-b8cc44eb1f54 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:57.077656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d25231e8-a4a0-4baf-80e2-b8cc44eb1f54 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:57.079021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d25231e8-a4a0-4baf-80e2-b8cc44eb1f54 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:57.081115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d25231e8-a4a0-4baf-80e2-b8cc44eb1f54 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:57.083111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d25231e8-a4a0-4baf-80e2-b8cc44eb1f54 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:57.085322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d25231e8-a4a0-4baf-80e2-b8cc44eb1f54 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:57.252450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d25231e8-a4a0-4baf-80e2-b8cc44eb1f54 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:57.262859 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d25231e8-a4a0-4baf-80e2-b8cc44eb1f54 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1280 microversion: 2.1 time: 0.220461 Oct 11 20:07:57.263458 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2584/5192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:57 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1280 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:57.455679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:57.456294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:57.479730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:57.484785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:57.486682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:57.487626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:57.492301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:57.492982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:57.593853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:57.605401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:57.608808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:57.610659 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a54b38e6-2bb2-47ef-9c60-d2d6d16b598a tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1399 microversion: 2.54 time: 0.158824 Oct 11 20:07:57.612844 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2609/5193] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:57 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1399 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:57.649461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-78bbb154-5037-4956-b7e3-20f5be44e1da tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '.version_select at 0x7f83cc1ff3a0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:57.682728 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-78bbb154-5037-4956-b7e3-20f5be44e1da tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1225850513" status: 204 len: 0 microversion: 2.54 time: 0.045905 Oct 11 20:07:57.702314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62f6d719-f890-40d0-94f1-5e347555b515 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:57.703559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-62f6d719-f890-40d0-94f1-5e347555b515 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:57.706855 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2585/5194] 10.222.0.27 () {60 vars in 1319 bytes} [Tue Oct 11 20:07:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1225850513 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:07:57.717265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4f710724-e22a-443a-9c98-758cceb4fb7d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:57.718169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4f710724-e22a-443a-9c98-758cceb4fb7d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:57.721175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f6d719-f890-40d0-94f1-5e347555b515 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:57.721965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f6d719-f890-40d0-94f1-5e347555b515 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:57.723483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f6d719-f890-40d0-94f1-5e347555b515 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:57.724841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f6d719-f890-40d0-94f1-5e347555b515 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:57.726648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f6d719-f890-40d0-94f1-5e347555b515 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:57.728729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f6d719-f890-40d0-94f1-5e347555b515 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:57.733250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f710724-e22a-443a-9c98-758cceb4fb7d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:57.737968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f710724-e22a-443a-9c98-758cceb4fb7d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:57.738467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f710724-e22a-443a-9c98-758cceb4fb7d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:57.739245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f710724-e22a-443a-9c98-758cceb4fb7d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:57.739730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f710724-e22a-443a-9c98-758cceb4fb7d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:57.743276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f710724-e22a-443a-9c98-758cceb4fb7d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:57.791632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-62f6d719-f890-40d0-94f1-5e347555b515 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:07:57.932918 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-62f6d719-f890-40d0-94f1-5e347555b515 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 204 len: 0 microversion: 2.54 time: 0.240805 Oct 11 20:07:57.933522 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2610/5195] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:07:57 2022] DELETE /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:07:57.943302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:57.944598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:57.957564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:57.958344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:57.960821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:57.961790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:57.963746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:57.964760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:58.684100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:58.697100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:58.698687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:58.699863 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-16cea692-0e76-4270-b1f1-198925e62e92 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1405 microversion: 2.54 time: 0.761782 Oct 11 20:07:58.700752 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2611/5196] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:57 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1405 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:58.706468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bc4e4082-b241-491b-94a7-53fab0593f25 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:58.707401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bc4e4082-b241-491b-94a7-53fab0593f25 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:58.715793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc4e4082-b241-491b-94a7-53fab0593f25 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:58.716296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc4e4082-b241-491b-94a7-53fab0593f25 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:58.716817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc4e4082-b241-491b-94a7-53fab0593f25 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:58.717570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc4e4082-b241-491b-94a7-53fab0593f25 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:58.718114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc4e4082-b241-491b-94a7-53fab0593f25 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:58.718648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc4e4082-b241-491b-94a7-53fab0593f25 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:58.891383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc4e4082-b241-491b-94a7-53fab0593f25 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:58.900865 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bc4e4082-b241-491b-94a7-53fab0593f25 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1286 microversion: 2.1 time: 0.198800 Oct 11 20:07:58.901744 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2612/5197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:58 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1286 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:58.989371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4f710724-e22a-443a-9c98-758cceb4fb7d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:59.004740 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4f710724-e22a-443a-9c98-758cceb4fb7d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1680 microversion: 2.1 time: 1.296158 Oct 11 20:07:59.021658 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2586/5198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:57 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1680 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:07:59.461810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] Calling method '.version_select at 0x7f83c7166280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:59.464482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:59.465237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:59.465981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:59.487405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:59.488241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:59.488919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:59.502640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:59.503130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:59.503548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:59.511946 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b0c10e34-078a-493a-9298-553b46e61382 tempest-PortsAdminExtendedAttrsTestJSON-235661710 tempest-PortsAdminExtendedAttrsTestJSON-235661710-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.229151 Oct 11 20:07:59.512765 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2613/5199] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 20:07:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:07:59.738112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:59.739678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:59.750480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:59.751591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:59.752703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:59.753884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:59.755051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:59.756373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:59.901910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:59.914394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:59.916282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:07:59.917926 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b5eb4057-dc88-4a25-8732-4d067ef384d5 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1405 microversion: 2.54 time: 0.187694 Oct 11 20:07:59.918739 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2587/5200] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:07:59 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:07:59.930308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-884a3177-8f07-4cbe-9ee0-e594a22a027a tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:07:59.931048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-884a3177-8f07-4cbe-9ee0-e594a22a027a tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:07:59.944360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-884a3177-8f07-4cbe-9ee0-e594a22a027a tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:59.945511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-884a3177-8f07-4cbe-9ee0-e594a22a027a tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:59.946117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-884a3177-8f07-4cbe-9ee0-e594a22a027a tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:07:59.946892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-884a3177-8f07-4cbe-9ee0-e594a22a027a tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:07:59.947366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-884a3177-8f07-4cbe-9ee0-e594a22a027a tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:07:59.947805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-884a3177-8f07-4cbe-9ee0-e594a22a027a tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:00.030582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5f643e1a-b459-4dbd-8f0f-e76cc5380c2b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:00.032055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f643e1a-b459-4dbd-8f0f-e76cc5380c2b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:00.044807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f643e1a-b459-4dbd-8f0f-e76cc5380c2b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:00.045732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f643e1a-b459-4dbd-8f0f-e76cc5380c2b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:00.046443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f643e1a-b459-4dbd-8f0f-e76cc5380c2b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:00.047621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f643e1a-b459-4dbd-8f0f-e76cc5380c2b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:00.048354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f643e1a-b459-4dbd-8f0f-e76cc5380c2b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:00.049288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f643e1a-b459-4dbd-8f0f-e76cc5380c2b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:00.122709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-884a3177-8f07-4cbe-9ee0-e594a22a027a tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:00.137660 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-884a3177-8f07-4cbe-9ee0-e594a22a027a tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1286 microversion: 2.1 time: 0.212225 Oct 11 20:08:00.139283 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2614/5201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:07:59 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1286 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:00.476214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5f643e1a-b459-4dbd-8f0f-e76cc5380c2b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:00.494031 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5f643e1a-b459-4dbd-8f0f-e76cc5380c2b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1680 microversion: 2.1 time: 0.467599 Oct 11 20:08:00.513838 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2588/5202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:00 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1680 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:08:00.951800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:00.954496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:00.989823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:00.991085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:00.991810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:00.996742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:00.997631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:00.998299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:01.104612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:01.105391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:01.106438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:01.106966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lazy-loading 'fault' on Instance uuid 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:08:01.162893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-774d16ee-e3d3-4788-a455-1d8fb44bb1f1 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:01.163653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-774d16ee-e3d3-4788-a455-1d8fb44bb1f1 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:01.180221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-774d16ee-e3d3-4788-a455-1d8fb44bb1f1 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:01.180751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-774d16ee-e3d3-4788-a455-1d8fb44bb1f1 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:01.181459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-774d16ee-e3d3-4788-a455-1d8fb44bb1f1 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:01.182180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-774d16ee-e3d3-4788-a455-1d8fb44bb1f1 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:01.184357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-774d16ee-e3d3-4788-a455-1d8fb44bb1f1 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:01.184811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-774d16ee-e3d3-4788-a455-1d8fb44bb1f1 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:01.274317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:01.286151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:01.287693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '098d54a5eb4749a3a75f68b1ea654093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3043b3aba34e59a44aa2acc3d59132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:01.289742 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e5f5d8d1-7de1-4974-a665-a1b46e4226e8 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 200 len: 1410 microversion: 2.54 time: 0.345442 Oct 11 20:08:01.290335 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2615/5203] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:08:00 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 1410 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:08:01.503487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e26db01-aec0-4cd6-bafc-d8ce29936ba5 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '.version_select at 0x7f83c755a790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:01.542587 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e26db01-aec0-4cd6-bafc-d8ce29936ba5 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-51365918" status: 202 len: 0 microversion: 2.1 time: 0.042801 Oct 11 20:08:01.544098 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2616/5204] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 11 20:08:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-51365918 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:08:01.571411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5c0ae8dc-0ba5-4612-9d47-af3d34aad42e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:01.572069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5c0ae8dc-0ba5-4612-9d47-af3d34aad42e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:01.583960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c0ae8dc-0ba5-4612-9d47-af3d34aad42e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:01.584466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c0ae8dc-0ba5-4612-9d47-af3d34aad42e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:01.584912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c0ae8dc-0ba5-4612-9d47-af3d34aad42e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:01.585867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c0ae8dc-0ba5-4612-9d47-af3d34aad42e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:01.586398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c0ae8dc-0ba5-4612-9d47-af3d34aad42e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:01.590598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c0ae8dc-0ba5-4612-9d47-af3d34aad42e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:02.181925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5c0ae8dc-0ba5-4612-9d47-af3d34aad42e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:02.199262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-774d16ee-e3d3-4788-a455-1d8fb44bb1f1 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:02.213932 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5c0ae8dc-0ba5-4612-9d47-af3d34aad42e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 200 len: 1613 microversion: 2.1 time: 0.668486 Oct 11 20:08:02.214991 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2617/5205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:01 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 1613 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:02.218478 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-774d16ee-e3d3-4788-a455-1d8fb44bb1f1 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1328 microversion: 2.1 time: 1.059460 Oct 11 20:08:02.222029 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2589/5206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:01 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1328 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:02.230080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-9a755fd5-a98b-417a-87a8-96082a748ef4 req-230d387e-c454-4d1c-b50a-981c33696e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef13443d-3c56-4ec8-b242-fc39fa2f1a16", "name": "network-vif-deleted", "tag": "4d2ad5fc-9d05-40e0-894f-e50bd481dd5a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:02.232053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc7ad40c-c966-4663-80c7-9c5e5ed6a72d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'create', calling method: .version_select at 0x7f83c71343a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-669027188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAOxhhlc3mEcBcDNZujA5zNmQFwRgPbxTtS++KDiLI1y3ctGPBLfak4+IPIjCGhqnWD/0UxfqCCEKZbB3Y2PZyNmEOmn2uMLQIsq2fkNEzcQHXTJAn4TLbFD6BI8mjkdQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:02.259973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9a755fd5-a98b-417a-87a8-96082a748ef4 req-230d387e-c454-4d1c-b50a-981c33696e35 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:02.261420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9a755fd5-a98b-417a-87a8-96082a748ef4 req-230d387e-c454-4d1c-b50a-981c33696e35 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:02.263338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9a755fd5-a98b-417a-87a8-96082a748ef4 req-230d387e-c454-4d1c-b50a-981c33696e35 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:02.274613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-dc7ad40c-c966-4663-80c7-9c5e5ed6a72d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for project abba65df7ef6403db3d5b466eb12fb94. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:08:02.281304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-dc7ad40c-c966-4663-80c7-9c5e5ed6a72d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for user c3eaa8c79a0645fd93e6e3398426237f and project abba65df7ef6403db3d5b466eb12fb94. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:08:02.287742 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-9a755fd5-a98b-417a-87a8-96082a748ef4 req-230d387e-c454-4d1c-b50a-981c33696e35 service nova] Creating event network-vif-deleted:4d2ad5fc-9d05-40e0-894f-e50bd481dd5a for instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 on n-h2-860864-3 Oct 11 20:08:02.305150 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-9a755fd5-a98b-417a-87a8-96082a748ef4 req-230d387e-c454-4d1c-b50a-981c33696e35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080665 Oct 11 20:08:02.305872 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2590/5207] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:02.325001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:02.325528 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc7ad40c-c966-4663-80c7-9c5e5ed6a72d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.106433 Oct 11 20:08:02.326202 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2618/5208] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:08:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:02.326821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] [instance: 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:02.336624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:02.337063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:02.337514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:02.338346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:02.338842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:02.339665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:02.358074 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] HTTP exception thrown: Instance 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 could not be found. Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Request method failure captured: Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 HTTP/1.1 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcz01NL01zNbDyFI7JV7E9yzOLk1hSFAgXdIkWVuRF2GM2-ObZ-Xo1KZtlJZNW9_gxURmely-ejwQZLEMPN_TCCYzeQROtSvatbO8vfaD1rbl0hsgo03rn4_5DA9v2aU_DpHDu0DiuWwJjIKeHFxuRu6KywJX_ItYKn1X2zvl64rVd4 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.54 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ef3043b3aba34e59a44aa2acc3d59132 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerShowV254Test-1494810184 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef3043b3aba34e59a44aa2acc3d59132"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef3043b3aba34e59a44aa2acc3d59132", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef3043b3aba34e59a44aa2acc3d59132"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef3043b3aba34e59a44aa2acc3d59132"}]}] Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerShowV254Test-1494810184 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ef3043b3aba34e59a44aa2acc3d59132 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerShowV254Test-1494810184 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerShowV254Test-1494810184-project Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 098d54a5eb4749a3a75f68b1ea654093 Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerShowV254Test-1494810184-project Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 could not be found. Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872'} Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 could not be found. Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 could not be found. Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:08:02.360540 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:02.365654 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:02.365654 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:08:02.365654 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:08:02.365654 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:08:02.365654 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:08:02.365654 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 could not be found. Oct 11 20:08:02.365654 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:02.365654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] Returning 404 to user: Instance 1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:08:02.365654 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-301b6d9f-9e0f-4469-ba47-b35ba9b56f82 tempest-ServerShowV254Test-1494810184 tempest-ServerShowV254Test-1494810184-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872" status: 404 len: 111 microversion: 2.54 time: 0.048486 Oct 11 20:08:02.365654 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2591/5209] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:08:02 2022] GET /compute/v2.1/servers/1a1f084f-c2f7-4fb6-a9f4-5486b9e8c872 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 20:08:03.244368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:03.245614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:03.249449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-062f84f6-19a8-4bd5-97c7-f10b13135ed6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:03.250810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-062f84f6-19a8-4bd5-97c7-f10b13135ed6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:03.255697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:03.256210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:03.256670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:03.257911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:03.258595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:03.259204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:03.262515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:03.268579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-062f84f6-19a8-4bd5-97c7-f10b13135ed6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:03.269082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-062f84f6-19a8-4bd5-97c7-f10b13135ed6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:03.269522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-062f84f6-19a8-4bd5-97c7-f10b13135ed6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:03.270234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-062f84f6-19a8-4bd5-97c7-f10b13135ed6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:03.270733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-062f84f6-19a8-4bd5-97c7-f10b13135ed6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:03.271170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-062f84f6-19a8-4bd5-97c7-f10b13135ed6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:03.280770 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 HTTP/1.1 Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ef13443d-3c56-4ec8-b242-fc39fa2f1a16'} Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:08:03.283133 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:08:03.289335 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:03.289335 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:08:03.289335 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:08:03.289335 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:08:03.289335 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:08:03.289335 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:08:03.289335 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:08:03.290854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:08:03.291951 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ee3090a6-c1e7-4e43-abe0-e9cb0571c581 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 404 len: 111 microversion: 2.1 time: 0.052519 Oct 11 20:08:03.293643 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2619/5210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:03 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:08:03.305614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6118421b-9b9e-45cf-b7a8-e7e3816f8fb4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '.version_select at 0x7f83c70f8c10>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:03.332791 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6118421b-9b9e-45cf-b7a8-e7e3816f8fb4 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-568769103" status: 202 len: 0 microversion: 2.1 time: 0.031277 Oct 11 20:08:03.333894 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2620/5211] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 20:08:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-568769103 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:08:03.531136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-062f84f6-19a8-4bd5-97c7-f10b13135ed6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:03.546705 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-062f84f6-19a8-4bd5-97c7-f10b13135ed6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1328 microversion: 2.1 time: 0.300598 Oct 11 20:08:03.556213 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2592/5212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:03 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1328 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:04.339479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:04.343821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-29bd736d-f169-4855-bd97-ec01099d5c13 req-f230e930-d635-41ba-b488-fc4a405d9ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935da2ad-d414-4ab7-b8ac-bf11d6cf74ff", "tag": "7c10fd4a-d539-4963-8bc3-2e500b659415"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:04.355027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-29bd736d-f169-4855-bd97-ec01099d5c13 req-f230e930-d635-41ba-b488-fc4a405d9ae4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:04.356120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-29bd736d-f169-4855-bd97-ec01099d5c13 req-f230e930-d635-41ba-b488-fc4a405d9ae4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:04.356857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-29bd736d-f169-4855-bd97-ec01099d5c13 req-f230e930-d635-41ba-b488-fc4a405d9ae4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:04.373069 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-29bd736d-f169-4855-bd97-ec01099d5c13 req-f230e930-d635-41ba-b488-fc4a405d9ae4 service nova] Creating event network-changed:7c10fd4a-d539-4963-8bc3-2e500b659415 for instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff on n-h2-860864-3 Oct 11 20:08:04.380717 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-29bd736d-f169-4855-bd97-ec01099d5c13 req-f230e930-d635-41ba-b488-fc4a405d9ae4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041909 Oct 11 20:08:04.383276 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2621/5213] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:04.575025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6b7362b-2872-4cb0-98ba-62824623f1ca tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:04.579307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a6b7362b-2872-4cb0-98ba-62824623f1ca tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:04.597885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b7362b-2872-4cb0-98ba-62824623f1ca tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:04.599107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b7362b-2872-4cb0-98ba-62824623f1ca tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:04.601579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b7362b-2872-4cb0-98ba-62824623f1ca tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:04.603474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b7362b-2872-4cb0-98ba-62824623f1ca tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:04.637934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b7362b-2872-4cb0-98ba-62824623f1ca tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:04.638539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b7362b-2872-4cb0-98ba-62824623f1ca tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:05.093585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6b7362b-2872-4cb0-98ba-62824623f1ca tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:05.106093 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6b7362b-2872-4cb0-98ba-62824623f1ca tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1328 microversion: 2.1 time: 0.539399 Oct 11 20:08:05.108035 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2593/5214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:04 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1328 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:05.215211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a37e507-08d2-4053-b8c0-0719fc3e1f4f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: .version_select at 0x7f83c70f3550>, body: {"keypair": {"name": "tempest-keypair-284920473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlD+9CO85enp8Z8alhhCqslOyx/RaSn2dW4sp5oorrjsCuDEuuOl6U4gAArRGCDyEiiKXftZwMKkuwT49KNXWH7zjRQfXAK8UQZEBLmlL9h7l+8/eVDmuzHpLxpnnl6gw=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:05.237733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-5a37e507-08d2-4053-b8c0-0719fc3e1f4f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:08:05.250561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-5a37e507-08d2-4053-b8c0-0719fc3e1f4f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for user f4202e77bb27447ba5363091634d9731 and project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:08:05.291142 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a37e507-08d2-4053-b8c0-0719fc3e1f4f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.082605 Oct 11 20:08:05.296582 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2622/5215] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:08:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:05.836934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e98e1733-d734-4d6c-89c0-3958ac03a8e2 tempest-ExtensionsTest-549044056 tempest-ExtensionsTest-549044056-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:05.839610 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e98e1733-d734-4d6c-89c0-3958ac03a8e2 tempest-ExtensionsTest-549044056 tempest-ExtensionsTest-549044056-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.189123 Oct 11 20:08:05.840165 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2594/5216] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 11 20:08:05 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:05.856549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b35411c2-833a-4587-ad95-437782264510 tempest-ExtensionsTest-549044056 tempest-ExtensionsTest-549044056-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:05.858708 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b35411c2-833a-4587-ad95-437782264510 tempest-ExtensionsTest-549044056 tempest-ExtensionsTest-549044056-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.011388 Oct 11 20:08:05.859474 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2623/5217] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 11 20:08:05 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:08:06.233513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-636fe1a6-4f62-4258-b28d-7d2388bea1cb tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:06.234986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-636fe1a6-4f62-4258-b28d-7d2388bea1cb tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:06.281579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-636fe1a6-4f62-4258-b28d-7d2388bea1cb tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:06.282623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-636fe1a6-4f62-4258-b28d-7d2388bea1cb tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:06.284034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-636fe1a6-4f62-4258-b28d-7d2388bea1cb tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:06.286477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-636fe1a6-4f62-4258-b28d-7d2388bea1cb tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:06.287051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-636fe1a6-4f62-4258-b28d-7d2388bea1cb tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:06.287555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-636fe1a6-4f62-4258-b28d-7d2388bea1cb tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:06.776647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-636fe1a6-4f62-4258-b28d-7d2388bea1cb tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:06.780787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:06.786784 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-636fe1a6-4f62-4258-b28d-7d2388bea1cb tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1328 microversion: 2.1 time: 0.560681 Oct 11 20:08:06.787617 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2595/5218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:06 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1328 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:08:07.810809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-59a719e7-17b1-4f92-9e5a-e984923c72ad tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:07.811546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59a719e7-17b1-4f92-9e5a-e984923c72ad tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:07.826387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59a719e7-17b1-4f92-9e5a-e984923c72ad tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:07.827597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59a719e7-17b1-4f92-9e5a-e984923c72ad tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:07.828615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59a719e7-17b1-4f92-9e5a-e984923c72ad tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:07.832016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59a719e7-17b1-4f92-9e5a-e984923c72ad tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:07.833075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59a719e7-17b1-4f92-9e5a-e984923c72ad tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:07.834405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59a719e7-17b1-4f92-9e5a-e984923c72ad tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:08.487334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59a719e7-17b1-4f92-9e5a-e984923c72ad tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:08.498490 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-59a719e7-17b1-4f92-9e5a-e984923c72ad tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1328 microversion: 2.1 time: 0.691481 Oct 11 20:08:08.516688 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2624/5219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:07 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1328 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:09.155983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-672111321", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3044e01-188f-474d-8296-ce2a6945a204"}], "security_groups": [{"name": "tempest-securitygroup--534673488"}], "key_name": "tempest-keypair-284920473", "user_data": "}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:09.193973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:09.401043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] validate_networks() for [('e3044e01-188f-474d-8296-ce2a6945a204', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:08:09.524172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2bf83e23-b179-4c84-ac2e-2265451e1360 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:09.524791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2bf83e23-b179-4c84-ac2e-2265451e1360 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:09.535738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf83e23-b179-4c84-ac2e-2265451e1360 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:09.543402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf83e23-b179-4c84-ac2e-2265451e1360 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:09.544334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf83e23-b179-4c84-ac2e-2265451e1360 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:09.545292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf83e23-b179-4c84-ac2e-2265451e1360 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:09.545935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf83e23-b179-4c84-ac2e-2265451e1360 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:09.546730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf83e23-b179-4c84-ac2e-2265451e1360 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:09.951523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2bf83e23-b179-4c84-ac2e-2265451e1360 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:09.970416 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2bf83e23-b179-4c84-ac2e-2265451e1360 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1328 microversion: 2.1 time: 0.442675 Oct 11 20:08:09.978668 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2625/5220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:09 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1328 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:09.989907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:09.990775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:09.997487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:10.018073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:10.018604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:10.019053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:10.025982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:10.028225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:10.028890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:10.667727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:10.686619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:10.688647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:10.690289 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0895d03a-4183-4e6e-80ef-29719ecfdcbb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2951 microversion: 2.32 time: 0.709941 Oct 11 20:08:10.700229 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2626/5221] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:08:09 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2951 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:08:10.700229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b9783c6e-a2bc-486d-aa70-76b68652683b req-41d92148-fdae-4e09-9f89-35733a0fb4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935da2ad-d414-4ab7-b8ac-bf11d6cf74ff", "name": "network-vif-plugged", "status": "completed", "tag": "7c10fd4a-d539-4963-8bc3-2e500b659415"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:10.715462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b9783c6e-a2bc-486d-aa70-76b68652683b req-41d92148-fdae-4e09-9f89-35733a0fb4a3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:10.715462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b9783c6e-a2bc-486d-aa70-76b68652683b req-41d92148-fdae-4e09-9f89-35733a0fb4a3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:10.715462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b9783c6e-a2bc-486d-aa70-76b68652683b req-41d92148-fdae-4e09-9f89-35733a0fb4a3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:10.739157 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b9783c6e-a2bc-486d-aa70-76b68652683b req-41d92148-fdae-4e09-9f89-35733a0fb4a3 service nova] Creating event network-vif-plugged:7c10fd4a-d539-4963-8bc3-2e500b659415 for instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff on n-h2-860864-3 Oct 11 20:08:10.764984 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b9783c6e-a2bc-486d-aa70-76b68652683b req-41d92148-fdae-4e09-9f89-35733a0fb4a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071578 Oct 11 20:08:10.766036 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2627/5222] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:10.771432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7181d1be-ffee-48fb-b5c2-fb51091d74cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:10.772025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7181d1be-ffee-48fb-b5c2-fb51091d74cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:10.787551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7181d1be-ffee-48fb-b5c2-fb51091d74cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:10.789196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7181d1be-ffee-48fb-b5c2-fb51091d74cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:10.794637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7181d1be-ffee-48fb-b5c2-fb51091d74cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:10.801263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7181d1be-ffee-48fb-b5c2-fb51091d74cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:10.802327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7181d1be-ffee-48fb-b5c2-fb51091d74cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:10.803036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7181d1be-ffee-48fb-b5c2-fb51091d74cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:11.041469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:08:11.042051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:08:11.042368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:08:11.046882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:08:11.047692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:08:11.070852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:11.071819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:11.072383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:11.074444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:11.076106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:11.078744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:11.150995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:08:11.164046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for user f4202e77bb27447ba5363091634d9731 and project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:08:11.200728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:08:11.218604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:08:11.269416 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7181d1be-ffee-48fb-b5c2-fb51091d74cb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.501493 Oct 11 20:08:11.270263 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2628/5223] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 11 20:08:10 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387/os-interface => generated 1831 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:08:11.276148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8ebaee3b-4898-4bf2-9e9a-f9d85b4a2a16 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:11.276770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8ebaee3b-4898-4bf2-9e9a-f9d85b4a2a16 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:11.300558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ebaee3b-4898-4bf2-9e9a-f9d85b4a2a16 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:11.303226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ebaee3b-4898-4bf2-9e9a-f9d85b4a2a16 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:11.303770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ebaee3b-4898-4bf2-9e9a-f9d85b4a2a16 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:11.304667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ebaee3b-4898-4bf2-9e9a-f9d85b4a2a16 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:11.305280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ebaee3b-4898-4bf2-9e9a-f9d85b4a2a16 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:11.310492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8ebaee3b-4898-4bf2-9e9a-f9d85b4a2a16 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:11.327971 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-26123b4a-e788-4cb2-bde0-2d18145d7fe9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.179434 Oct 11 20:08:11.329245 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2596/5224] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:08:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:08:11.349197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-206fe679-8b12-4d1e-b743-2e6122497289 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:11.352680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-206fe679-8b12-4d1e-b743-2e6122497289 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:11.531327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-206fe679-8b12-4d1e-b743-2e6122497289 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:11.542671 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-206fe679-8b12-4d1e-b743-2e6122497289 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1240 microversion: 2.1 time: 0.203833 Oct 11 20:08:11.545179 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2597/5225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:11 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1240 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:11.780942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8ebaee3b-4898-4bf2-9e9a-f9d85b4a2a16 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:11.800054 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8ebaee3b-4898-4bf2-9e9a-f9d85b4a2a16 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1328 microversion: 2.1 time: 0.527998 Oct 11 20:08:11.802942 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2629/5226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:11 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1328 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:12.574203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-718f4338-272b-45cf-b5cb-1d8eab996840 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:12.576023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-718f4338-272b-45cf-b5cb-1d8eab996840 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:12.607570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718f4338-272b-45cf-b5cb-1d8eab996840 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:12.609260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718f4338-272b-45cf-b5cb-1d8eab996840 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:12.610135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718f4338-272b-45cf-b5cb-1d8eab996840 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:12.613534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718f4338-272b-45cf-b5cb-1d8eab996840 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:12.617505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718f4338-272b-45cf-b5cb-1d8eab996840 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:12.618069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718f4338-272b-45cf-b5cb-1d8eab996840 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:12.766673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-718f4338-272b-45cf-b5cb-1d8eab996840 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:12.784706 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-718f4338-272b-45cf-b5cb-1d8eab996840 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1236 microversion: 2.1 time: 0.216316 Oct 11 20:08:12.785299 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2598/5227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:12 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1236 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:12.831430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6df3140-045f-4376-a5c6-47175ed93348 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:12.832235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6df3140-045f-4376-a5c6-47175ed93348 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:12.845802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6df3140-045f-4376-a5c6-47175ed93348 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:12.848594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6df3140-045f-4376-a5c6-47175ed93348 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:12.851558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6df3140-045f-4376-a5c6-47175ed93348 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:12.852510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6df3140-045f-4376-a5c6-47175ed93348 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:12.852990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6df3140-045f-4376-a5c6-47175ed93348 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:12.854547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6df3140-045f-4376-a5c6-47175ed93348 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:13.480447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6df3140-045f-4376-a5c6-47175ed93348 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:13.491902 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6df3140-045f-4376-a5c6-47175ed93348 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1529 microversion: 2.1 time: 0.667620 Oct 11 20:08:13.501184 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2630/5228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:12 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1529 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:13.527936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a8688223-dc00-48d1-9605-9abd4d796b90 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:13.529074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a8688223-dc00-48d1-9605-9abd4d796b90 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:13.539794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8688223-dc00-48d1-9605-9abd4d796b90 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:13.541292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8688223-dc00-48d1-9605-9abd4d796b90 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:13.542079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8688223-dc00-48d1-9605-9abd4d796b90 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:13.543378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8688223-dc00-48d1-9605-9abd4d796b90 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:13.546210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8688223-dc00-48d1-9605-9abd4d796b90 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:13.547225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8688223-dc00-48d1-9605-9abd4d796b90 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:13.809722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff7192f1-555d-4df1-9b2b-64943902e4cf tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:13.810331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ff7192f1-555d-4df1-9b2b-64943902e4cf tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:13.823576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7192f1-555d-4df1-9b2b-64943902e4cf tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:13.824072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7192f1-555d-4df1-9b2b-64943902e4cf tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:13.824510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7192f1-555d-4df1-9b2b-64943902e4cf tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:13.825210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7192f1-555d-4df1-9b2b-64943902e4cf tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:13.825663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7192f1-555d-4df1-9b2b-64943902e4cf tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:13.826087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff7192f1-555d-4df1-9b2b-64943902e4cf tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:14.040428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ff7192f1-555d-4df1-9b2b-64943902e4cf tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:14.055549 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff7192f1-555d-4df1-9b2b-64943902e4cf tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1298 microversion: 2.1 time: 0.249511 Oct 11 20:08:14.071110 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2631/5229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:13 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1298 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:14.369101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a8688223-dc00-48d1-9605-9abd4d796b90 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:14.380195 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a8688223-dc00-48d1-9605-9abd4d796b90 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1529 microversion: 2.1 time: 0.858021 Oct 11 20:08:14.380810 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2599/5230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:13 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1529 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:14.786639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:14.787436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:14.797130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:14.799634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:14.800297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:14.801204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:14.801832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:14.807246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:14.844176 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] HTTP exception thrown: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Request method failure captured: Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff HTTP/1.1 Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRc0X9N0cta1CpdWi8UIZGhlPXr7FLGzFz0c_jEa6pPhhzKFb5_K4zCrGtaTIONrLpj9Sct_AwggI9NAvDvqytyjvoeegbfLhvDIl2o8ZSJThn9nslz0_qPyyd-idY5RGXM_lvQnQhc_Yh1SlnWrY9_bs5dsobO0z7SevLv47lRlkWXE Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f27472c26fc545f391d2da9b5b529a4f Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1864376444 Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f27472c26fc545f391d2da9b5b529a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f27472c26fc545f391d2da9b5b529a4f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f27472c26fc545f391d2da9b5b529a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f27472c26fc545f391d2da9b5b529a4f"}]}] Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1864376444 Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f27472c26fc545f391d2da9b5b529a4f Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1864376444 Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1864376444-project Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 21b68e75763741c5a7cbc54670b523a5 Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1864376444-project Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '935da2ad-d414-4ab7-b8ac-bf11d6cf74ff'} Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:08:14.858400 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:08:14.863160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Returning 404 to user: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:08:14.869015 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e598383c-f3e1-4136-b2de-5ba62524c952 tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] 10.222.0.27 "DELETE /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 404 len: 111 microversion: 2.1 time: 0.468842 Oct 11 20:08:14.875772 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2632/5231] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:08:14 2022] DELETE /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 111 bytes in 476 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:08:14.887166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f606429-ec48-4607-9958-c0823b6256f0 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:14.887782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8f606429-ec48-4607-9958-c0823b6256f0 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:14.899170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f606429-ec48-4607-9958-c0823b6256f0 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:14.899673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f606429-ec48-4607-9958-c0823b6256f0 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:14.904442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f606429-ec48-4607-9958-c0823b6256f0 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:14.907157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f606429-ec48-4607-9958-c0823b6256f0 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:14.907827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f606429-ec48-4607-9958-c0823b6256f0 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:14.914067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f606429-ec48-4607-9958-c0823b6256f0 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:15.080552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0e03196e-eec0-478e-8d33-c9e4984415a8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:15.081734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0e03196e-eec0-478e-8d33-c9e4984415a8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:15.100794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e03196e-eec0-478e-8d33-c9e4984415a8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:15.107276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e03196e-eec0-478e-8d33-c9e4984415a8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:15.108683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e03196e-eec0-478e-8d33-c9e4984415a8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:15.109712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e03196e-eec0-478e-8d33-c9e4984415a8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:15.111171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e03196e-eec0-478e-8d33-c9e4984415a8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:15.111779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e03196e-eec0-478e-8d33-c9e4984415a8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:15.262279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8f606429-ec48-4607-9958-c0823b6256f0 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:15.266442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0e03196e-eec0-478e-8d33-c9e4984415a8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:15.269290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=16 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:15.271073 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f606429-ec48-4607-9958-c0823b6256f0 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1529 microversion: 2.1 time: 0.389251 Oct 11 20:08:15.275646 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2600/5232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:14 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1529 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:15.297609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Action: 'update', calling method: >, body: {"server": {"name": "935da2ad-d414-4ab7-b8ac-bf11d6cf74ff_new"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:15.300603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:15.301323 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0e03196e-eec0-478e-8d33-c9e4984415a8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1298 microversion: 2.1 time: 0.225295 Oct 11 20:08:15.304504 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2633/5233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:15 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1298 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:15.311409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:15.311916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:15.312363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:15.313086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:15.313553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:15.313987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:15.349497 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] HTTP exception thrown: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Request method failure captured: Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: request: PUT /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff HTTP/1.1 Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 64 Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc0X9N0cta1CpdWi8UIZGhlPXr7FLGzFz0c_jEa6pPhhzKFb5_K4zCrGtaTIONrLpj9Sct_AwggI9NAvDvqytyjvoeegbfLhvDIl2o8ZSJThn9nslz0_qPyyd-idY5RGXM_lvQnQhc_Yh1SlnWrY9_bs5dsobO0z7SevLv47lRlkWXE Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f27472c26fc545f391d2da9b5b529a4f Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1864376444 Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f27472c26fc545f391d2da9b5b529a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f27472c26fc545f391d2da9b5b529a4f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f27472c26fc545f391d2da9b5b529a4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f27472c26fc545f391d2da9b5b529a4f"}]}] Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1864376444 Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f27472c26fc545f391d2da9b5b529a4f Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1864376444 Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1864376444-project Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 21b68e75763741c5a7cbc54670b523a5 Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1864376444-project Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: {"server": {"name": "935da2ad-d414-4ab7-b8ac-bf11d6cf74ff_new"}} Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '935da2ad-d414-4ab7-b8ac-bf11d6cf74ff', 'body': {'server': {'name': '935da2ad-d414-4ab7-b8ac-bf11d6cf74ff_new'}}} Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:08:15.352251 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:15.357593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] Returning 404 to user: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:08:15.366827 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-10201180-e67f-4cf9-bc23-6e1e57572abd tempest-ServersNegativeTestMultiTenantJSON-1864376444 tempest-ServersNegativeTestMultiTenantJSON-1864376444-project] 10.222.0.27 "PUT /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 404 len: 111 microversion: 2.1 time: 0.059880 Oct 11 20:08:15.374052 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2601/5234] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 11 20:08:15 2022] PUT /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:08:15.381367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ac4a1cc-518f-452b-bb2d-9e20a5f33f81 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:15.382052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0ac4a1cc-518f-452b-bb2d-9e20a5f33f81 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:15.390685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4a1cc-518f-452b-bb2d-9e20a5f33f81 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:15.391193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4a1cc-518f-452b-bb2d-9e20a5f33f81 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:15.396103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4a1cc-518f-452b-bb2d-9e20a5f33f81 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:15.399565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4a1cc-518f-452b-bb2d-9e20a5f33f81 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:15.400284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4a1cc-518f-452b-bb2d-9e20a5f33f81 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:15.402611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4a1cc-518f-452b-bb2d-9e20a5f33f81 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:15.492352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0ac4a1cc-518f-452b-bb2d-9e20a5f33f81 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:08:15.715401 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0ac4a1cc-518f-452b-bb2d-9e20a5f33f81 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "DELETE /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 204 len: 0 microversion: 2.1 time: 0.339652 Oct 11 20:08:15.719557 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2634/5235] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:08:15 2022] DELETE /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:08:15.730293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f3d013f9-bdcd-4fd0-991e-3e786b7193f6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:15.731252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f3d013f9-bdcd-4fd0-991e-3e786b7193f6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:15.747396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d013f9-bdcd-4fd0-991e-3e786b7193f6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:15.750511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d013f9-bdcd-4fd0-991e-3e786b7193f6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:15.751269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d013f9-bdcd-4fd0-991e-3e786b7193f6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:15.757008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d013f9-bdcd-4fd0-991e-3e786b7193f6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:15.758683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d013f9-bdcd-4fd0-991e-3e786b7193f6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:15.766271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3d013f9-bdcd-4fd0-991e-3e786b7193f6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:16.271280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1569278365", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "07ccf359-eb5e-48f0-b00a-6e6e861f1376"}], "key_name": "tempest-TestNetworkAdvancedServerOps-669027188", "security_groups": [{"name": "tempest-secgroup-smoke-678863767"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:16.733760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f3d013f9-bdcd-4fd0-991e-3e786b7193f6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:16.746381 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f3d013f9-bdcd-4fd0-991e-3e786b7193f6 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1535 microversion: 2.1 time: 1.022623 Oct 11 20:08:16.758606 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2602/5236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:15 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1535 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:16.759130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-efa69923-42c8-44a1-95c4-945c4264d0bd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:16.762828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-efa69923-42c8-44a1-95c4-945c4264d0bd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:16.774886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] validate_networks() for [('07ccf359-eb5e-48f0-b00a-6e6e861f1376', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:08:16.793163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efa69923-42c8-44a1-95c4-945c4264d0bd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:16.793879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efa69923-42c8-44a1-95c4-945c4264d0bd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:16.795117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efa69923-42c8-44a1-95c4-945c4264d0bd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:16.795853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efa69923-42c8-44a1-95c4-945c4264d0bd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:16.796320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efa69923-42c8-44a1-95c4-945c4264d0bd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:16.796747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efa69923-42c8-44a1-95c4-945c4264d0bd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:17.540331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-efa69923-42c8-44a1-95c4-945c4264d0bd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:17.552627 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-efa69923-42c8-44a1-95c4-945c4264d0bd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1365 microversion: 2.1 time: 0.802445 Oct 11 20:08:17.559878 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2603/5237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:16 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1365 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:17.780665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-33124bde-2480-453e-8804-3738e5bd00a5 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:17.781885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-33124bde-2480-453e-8804-3738e5bd00a5 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:17.792689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33124bde-2480-453e-8804-3738e5bd00a5 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:17.793195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33124bde-2480-453e-8804-3738e5bd00a5 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:17.793640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33124bde-2480-453e-8804-3738e5bd00a5 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:17.794476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33124bde-2480-453e-8804-3738e5bd00a5 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:17.800804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33124bde-2480-453e-8804-3738e5bd00a5 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:17.801325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33124bde-2480-453e-8804-3738e5bd00a5 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:18.588940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-33124bde-2480-453e-8804-3738e5bd00a5 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f5d487f49548ea8de04740c803b4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed3bc3632e24e7b935fd448505a4a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:18.603907 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-33124bde-2480-453e-8804-3738e5bd00a5 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 200 len: 1535 microversion: 2.1 time: 0.828006 Oct 11 20:08:18.619340 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2604/5238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:17 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 1535 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:08:18.636166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c762a7e9-ce0b-4818-bce1-4c5d7c10678f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:18.636803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c762a7e9-ce0b-4818-bce1-4c5d7c10678f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:18.658567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c762a7e9-ce0b-4818-bce1-4c5d7c10678f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:18.659076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c762a7e9-ce0b-4818-bce1-4c5d7c10678f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:18.659517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c762a7e9-ce0b-4818-bce1-4c5d7c10678f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:18.662721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c762a7e9-ce0b-4818-bce1-4c5d7c10678f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:18.663216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c762a7e9-ce0b-4818-bce1-4c5d7c10678f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:18.670558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c762a7e9-ce0b-4818-bce1-4c5d7c10678f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:18.687613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:08:18.688298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:08:18.689413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:08:18.690429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:08:18.691141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:08:18.718406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:18.720655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:18.721982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:18.728259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:18.729056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:18.746935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:18.789668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for project abba65df7ef6403db3d5b466eb12fb94. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:08:18.805010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for user c3eaa8c79a0645fd93e6e3398426237f and project abba65df7ef6403db3d5b466eb12fb94. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:08:18.830318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:08:18.837670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:08:19.013147 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-438fd6a5-3a52-4717-888c-e726c4ffac39 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.733074 Oct 11 20:08:19.018156 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2635/5239] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:08:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 2752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:08:19.051407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-df84cf71-5910-4de6-8b28-45168892ae0b req-6d65b0b8-825a-4ee0-87ae-22cb65318dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935da2ad-d414-4ab7-b8ac-bf11d6cf74ff", "name": "network-vif-deleted", "tag": "7c10fd4a-d539-4963-8bc3-2e500b659415"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:19.086598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-df84cf71-5910-4de6-8b28-45168892ae0b req-6d65b0b8-825a-4ee0-87ae-22cb65318dd2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:19.087386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-df84cf71-5910-4de6-8b28-45168892ae0b req-6d65b0b8-825a-4ee0-87ae-22cb65318dd2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:19.088044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-df84cf71-5910-4de6-8b28-45168892ae0b req-6d65b0b8-825a-4ee0-87ae-22cb65318dd2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:19.108384 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-df84cf71-5910-4de6-8b28-45168892ae0b req-6d65b0b8-825a-4ee0-87ae-22cb65318dd2 service nova] Creating event network-vif-deleted:7c10fd4a-d539-4963-8bc3-2e500b659415 for instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff on n-h2-860864-3 Oct 11 20:08:19.124826 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-df84cf71-5910-4de6-8b28-45168892ae0b req-6d65b0b8-825a-4ee0-87ae-22cb65318dd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104958 Oct 11 20:08:19.127176 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2636/5240] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:19.136016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b8c99de5-0cfb-463f-8c68-69824763a375 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:19.137593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b8c99de5-0cfb-463f-8c68-69824763a375 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:19.166865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c762a7e9-ce0b-4818-bce1-4c5d7c10678f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:19.188475 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c762a7e9-ce0b-4818-bce1-4c5d7c10678f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1365 microversion: 2.1 time: 0.565819 Oct 11 20:08:19.199309 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2605/5241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:18 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1365 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:19.278133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b8c99de5-0cfb-463f-8c68-69824763a375 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:19.303755 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b8c99de5-0cfb-463f-8c68-69824763a375 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1266 microversion: 2.1 time: 0.174463 Oct 11 20:08:19.310721 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2637/5242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:19 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:19.632864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:19.633477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] [instance: 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:19.644072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:19.644567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:19.645007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:19.645708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:19.659643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:19.660113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:19.698731 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] HTTP exception thrown: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Request method failure captured: Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff HTTP/1.1 Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc0LPvkyxupZDjINvqYHMxxJKqeFzoIpHIiKdDfXbqHXgDr9IJC5MMCJXQ6ZvYcmJl3KkwPUaQGcq_iuBI2Z7m6rsb4tDjxwHzbg_X6KbP4a3sfbWmpHq-do3afiVtxLYYiuPX9UxYm1hkqUTIpB4wqb3-G9ZzQoIQKlgil8fnNl-2c Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 9ed3bc3632e24e7b935fd448505a4a0d Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1364208135 Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ed3bc3632e24e7b935fd448505a4a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ed3bc3632e24e7b935fd448505a4a0d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ed3bc3632e24e7b935fd448505a4a0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ed3bc3632e24e7b935fd448505a4a0d"}]}] Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1364208135 Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 9ed3bc3632e24e7b935fd448505a4a0d Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1364208135 Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1364208135-project Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 65f5d487f49548ea8de04740c803b4ef Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1364208135-project Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '935da2ad-d414-4ab7-b8ac-bf11d6cf74ff'} Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:19.700557 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:19.705738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:08:19.705738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:19.705738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:08:19.705738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:08:19.705738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:08:19.705738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:08:19.705738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:08:19.705738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. Oct 11 20:08:19.705738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:08:19.712993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] Returning 404 to user: Instance 935da2ad-d414-4ab7-b8ac-bf11d6cf74ff could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:08:19.715932 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3145a7d7-c956-4ea9-9c5e-155187c0cfc3 tempest-ServersNegativeTestMultiTenantJSON-1364208135 tempest-ServersNegativeTestMultiTenantJSON-1364208135-project] 10.222.0.27 "GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff" status: 404 len: 111 microversion: 2.1 time: 0.086420 Oct 11 20:08:19.719810 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2606/5243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:19 2022] GET /compute/v2.1/servers/935da2ad-d414-4ab7-b8ac-bf11d6cf74ff => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:08:20.215422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ff28608-97ab-45f6-88d4-f5665ac7e0b8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:20.216081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2ff28608-97ab-45f6-88d4-f5665ac7e0b8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:20.236259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ff28608-97ab-45f6-88d4-f5665ac7e0b8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:20.236775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ff28608-97ab-45f6-88d4-f5665ac7e0b8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:20.237366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ff28608-97ab-45f6-88d4-f5665ac7e0b8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:20.238021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ff28608-97ab-45f6-88d4-f5665ac7e0b8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:20.238514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ff28608-97ab-45f6-88d4-f5665ac7e0b8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:20.238963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ff28608-97ab-45f6-88d4-f5665ac7e0b8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:20.336979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9cbd9f9d-e49d-4d73-ad10-2bc0919826a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:20.338472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9cbd9f9d-e49d-4d73-ad10-2bc0919826a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:20.538014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9cbd9f9d-e49d-4d73-ad10-2bc0919826a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:20.577386 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9cbd9f9d-e49d-4d73-ad10-2bc0919826a6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1266 microversion: 2.1 time: 0.220809 Oct 11 20:08:20.578058 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2607/5244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:20 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:21.144406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2ff28608-97ab-45f6-88d4-f5665ac7e0b8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:21.154355 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2ff28608-97ab-45f6-88d4-f5665ac7e0b8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1365 microversion: 2.1 time: 0.944709 Oct 11 20:08:21.186619 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2638/5245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:20 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1365 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:21.209184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-53cdef1a-0992-442d-8e18-99ae64bfec67 req-04f82b5b-7089-4aeb-946b-6e6ccc16a111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c", "tag": "7a6ee646-45ba-413e-bbb5-3801ce477302"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:21.218112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:21.230377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-53cdef1a-0992-442d-8e18-99ae64bfec67 req-04f82b5b-7089-4aeb-946b-6e6ccc16a111 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:21.233100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-53cdef1a-0992-442d-8e18-99ae64bfec67 req-04f82b5b-7089-4aeb-946b-6e6ccc16a111 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:21.234586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-53cdef1a-0992-442d-8e18-99ae64bfec67 req-04f82b5b-7089-4aeb-946b-6e6ccc16a111 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:21.269284 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-53cdef1a-0992-442d-8e18-99ae64bfec67 req-04f82b5b-7089-4aeb-946b-6e6ccc16a111 service nova] Creating event network-changed:7a6ee646-45ba-413e-bbb5-3801ce477302 for instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c on n-h1-860864-3 Oct 11 20:08:21.277861 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-53cdef1a-0992-442d-8e18-99ae64bfec67 req-04f82b5b-7089-4aeb-946b-6e6ccc16a111 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072254 Oct 11 20:08:21.278923 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2608/5246] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:21.605691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3ad37f9e-46b0-4ff0-8cfa-9c9eb2db6b25 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:21.606184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3ad37f9e-46b0-4ff0-8cfa-9c9eb2db6b25 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:21.613706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ad37f9e-46b0-4ff0-8cfa-9c9eb2db6b25 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:21.614187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ad37f9e-46b0-4ff0-8cfa-9c9eb2db6b25 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:21.614641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ad37f9e-46b0-4ff0-8cfa-9c9eb2db6b25 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:21.615334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ad37f9e-46b0-4ff0-8cfa-9c9eb2db6b25 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:21.627559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ad37f9e-46b0-4ff0-8cfa-9c9eb2db6b25 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:21.628120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ad37f9e-46b0-4ff0-8cfa-9c9eb2db6b25 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:21.770596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3ad37f9e-46b0-4ff0-8cfa-9c9eb2db6b25 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:21.779471 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3ad37f9e-46b0-4ff0-8cfa-9c9eb2db6b25 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1324 microversion: 2.1 time: 0.178498 Oct 11 20:08:21.793989 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2639/5247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:21 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1324 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:22.197190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6fc1f0bf-0c34-4d6a-8e49-83779e63ee64 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:22.198550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6fc1f0bf-0c34-4d6a-8e49-83779e63ee64 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:22.219413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc1f0bf-0c34-4d6a-8e49-83779e63ee64 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:22.219413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc1f0bf-0c34-4d6a-8e49-83779e63ee64 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:22.219413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc1f0bf-0c34-4d6a-8e49-83779e63ee64 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:22.219654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc1f0bf-0c34-4d6a-8e49-83779e63ee64 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:22.220135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc1f0bf-0c34-4d6a-8e49-83779e63ee64 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:22.220646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fc1f0bf-0c34-4d6a-8e49-83779e63ee64 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:22.771615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6fc1f0bf-0c34-4d6a-8e49-83779e63ee64 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:22.787021 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6fc1f0bf-0c34-4d6a-8e49-83779e63ee64 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1365 microversion: 2.1 time: 0.597017 Oct 11 20:08:22.804308 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2609/5248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:22 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1365 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:22.806274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4341733c-ebeb-40c4-a7ef-919ec8741925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:22.808338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4341733c-ebeb-40c4-a7ef-919ec8741925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:22.818495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4341733c-ebeb-40c4-a7ef-919ec8741925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:22.819924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4341733c-ebeb-40c4-a7ef-919ec8741925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:22.820472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4341733c-ebeb-40c4-a7ef-919ec8741925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:22.821286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4341733c-ebeb-40c4-a7ef-919ec8741925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:22.821855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4341733c-ebeb-40c4-a7ef-919ec8741925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:22.822479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4341733c-ebeb-40c4-a7ef-919ec8741925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:23.044826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4341733c-ebeb-40c4-a7ef-919ec8741925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:23.054038 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4341733c-ebeb-40c4-a7ef-919ec8741925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1324 microversion: 2.1 time: 0.254713 Oct 11 20:08:23.055801 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2640/5249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:22 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:23.813939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f35e8dd-b297-436f-ad89-ee6c5dfd77ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:23.815305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f35e8dd-b297-436f-ad89-ee6c5dfd77ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:23.855719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f35e8dd-b297-436f-ad89-ee6c5dfd77ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:23.855719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f35e8dd-b297-436f-ad89-ee6c5dfd77ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:23.856670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f35e8dd-b297-436f-ad89-ee6c5dfd77ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:23.859874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f35e8dd-b297-436f-ad89-ee6c5dfd77ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:23.859874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f35e8dd-b297-436f-ad89-ee6c5dfd77ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:23.859874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f35e8dd-b297-436f-ad89-ee6c5dfd77ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:24.078353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1a408922-12e2-4263-94d1-921a794db836 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:24.082851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1a408922-12e2-4263-94d1-921a794db836 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:24.104598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a408922-12e2-4263-94d1-921a794db836 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:24.108637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a408922-12e2-4263-94d1-921a794db836 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:24.110022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a408922-12e2-4263-94d1-921a794db836 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:24.112265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a408922-12e2-4263-94d1-921a794db836 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:24.114831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a408922-12e2-4263-94d1-921a794db836 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:24.118652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a408922-12e2-4263-94d1-921a794db836 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:24.784737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2f35e8dd-b297-436f-ad89-ee6c5dfd77ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:24.795774 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f35e8dd-b297-436f-ad89-ee6c5dfd77ad tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1365 microversion: 2.1 time: 0.986151 Oct 11 20:08:24.801542 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2610/5250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:23 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1365 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:24.966373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1a408922-12e2-4263-94d1-921a794db836 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:24.978343 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1a408922-12e2-4263-94d1-921a794db836 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1391 microversion: 2.1 time: 0.904397 Oct 11 20:08:24.987875 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2641/5251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:24 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1391 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:08:25.830060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2daffae-1a03-4d83-8405-6d9a845978ac tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:25.831117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a2daffae-1a03-4d83-8405-6d9a845978ac tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:25.844611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2daffae-1a03-4d83-8405-6d9a845978ac tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:25.845947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2daffae-1a03-4d83-8405-6d9a845978ac tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:25.846405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2daffae-1a03-4d83-8405-6d9a845978ac tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:25.848390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2daffae-1a03-4d83-8405-6d9a845978ac tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:25.848860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2daffae-1a03-4d83-8405-6d9a845978ac tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:25.849308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2daffae-1a03-4d83-8405-6d9a845978ac tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:26.012758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-29820137-25f9-46be-b10a-2c8b59e85980 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:26.013530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-29820137-25f9-46be-b10a-2c8b59e85980 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:26.030092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29820137-25f9-46be-b10a-2c8b59e85980 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:26.034394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29820137-25f9-46be-b10a-2c8b59e85980 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:26.034874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29820137-25f9-46be-b10a-2c8b59e85980 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:26.041215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29820137-25f9-46be-b10a-2c8b59e85980 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:26.043311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29820137-25f9-46be-b10a-2c8b59e85980 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:26.044226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29820137-25f9-46be-b10a-2c8b59e85980 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:26.088771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:26.252967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a2daffae-1a03-4d83-8405-6d9a845978ac tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:26.267402 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a2daffae-1a03-4d83-8405-6d9a845978ac tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1365 microversion: 2.1 time: 0.441618 Oct 11 20:08:26.269675 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2611/5252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:25 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:26.512967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ed991b32-0df0-4b8a-bdca-fa3bd275351c req-673eb0bd-18eb-4ed4-ad4c-1afc0e47f7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c", "name": "network-vif-plugged", "status": "completed", "tag": "7a6ee646-45ba-413e-bbb5-3801ce477302"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:26.539567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ed991b32-0df0-4b8a-bdca-fa3bd275351c req-673eb0bd-18eb-4ed4-ad4c-1afc0e47f7b0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:26.540741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ed991b32-0df0-4b8a-bdca-fa3bd275351c req-673eb0bd-18eb-4ed4-ad4c-1afc0e47f7b0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:26.541806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ed991b32-0df0-4b8a-bdca-fa3bd275351c req-673eb0bd-18eb-4ed4-ad4c-1afc0e47f7b0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:26.573728 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ed991b32-0df0-4b8a-bdca-fa3bd275351c req-673eb0bd-18eb-4ed4-ad4c-1afc0e47f7b0 service nova] Creating event network-vif-plugged:7a6ee646-45ba-413e-bbb5-3801ce477302 for instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c on n-h1-860864-3 Oct 11 20:08:26.586270 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ed991b32-0df0-4b8a-bdca-fa3bd275351c req-673eb0bd-18eb-4ed4-ad4c-1afc0e47f7b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080899 Oct 11 20:08:26.589873 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2612/5253] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:08:26.633526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-29820137-25f9-46be-b10a-2c8b59e85980 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:26.647860 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-29820137-25f9-46be-b10a-2c8b59e85980 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1391 microversion: 2.1 time: 0.639160 Oct 11 20:08:26.652858 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2642/5254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:26 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1391 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:08:27.295085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1105e2ce-b51f-46ea-9382-2dea2fb4bafd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:27.296025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1105e2ce-b51f-46ea-9382-2dea2fb4bafd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:27.310332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1105e2ce-b51f-46ea-9382-2dea2fb4bafd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:27.310870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1105e2ce-b51f-46ea-9382-2dea2fb4bafd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:27.311323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1105e2ce-b51f-46ea-9382-2dea2fb4bafd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:27.315935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1105e2ce-b51f-46ea-9382-2dea2fb4bafd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:27.319712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1105e2ce-b51f-46ea-9382-2dea2fb4bafd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:27.320165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1105e2ce-b51f-46ea-9382-2dea2fb4bafd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:27.684507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-468585ca-8e9a-4595-b764-ee8ed433efda tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:27.685306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-468585ca-8e9a-4595-b764-ee8ed433efda tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:27.692654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-468585ca-8e9a-4595-b764-ee8ed433efda tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:27.693476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-468585ca-8e9a-4595-b764-ee8ed433efda tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:27.694130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-468585ca-8e9a-4595-b764-ee8ed433efda tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:27.696161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-468585ca-8e9a-4595-b764-ee8ed433efda tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:27.696892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-468585ca-8e9a-4595-b764-ee8ed433efda tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:27.697527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-468585ca-8e9a-4595-b764-ee8ed433efda tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:27.735242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1105e2ce-b51f-46ea-9382-2dea2fb4bafd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:27.750563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1105e2ce-b51f-46ea-9382-2dea2fb4bafd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1365 microversion: 2.1 time: 0.458094 Oct 11 20:08:27.760629 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2613/5255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:27 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1365 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:28.089766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c15fe0f8-6e6d-428e-afe4-e5ac17604b60 req-83ccd8d1-c730-4fde-bdb7-36932c15293c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f7286d-3c5c-4f68-8e00-d6bacf31e6c3", "tag": "a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:28.103704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c15fe0f8-6e6d-428e-afe4-e5ac17604b60 req-83ccd8d1-c730-4fde-bdb7-36932c15293c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:28.106127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c15fe0f8-6e6d-428e-afe4-e5ac17604b60 req-83ccd8d1-c730-4fde-bdb7-36932c15293c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:28.107096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c15fe0f8-6e6d-428e-afe4-e5ac17604b60 req-83ccd8d1-c730-4fde-bdb7-36932c15293c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:28.146100 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c15fe0f8-6e6d-428e-afe4-e5ac17604b60 req-83ccd8d1-c730-4fde-bdb7-36932c15293c service nova] Creating event network-changed:a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4 for instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 on n-h2-860864-3 Oct 11 20:08:28.159796 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c15fe0f8-6e6d-428e-afe4-e5ac17604b60 req-83ccd8d1-c730-4fde-bdb7-36932c15293c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071364 Oct 11 20:08:28.166252 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2614/5256] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:28.201813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-468585ca-8e9a-4595-b764-ee8ed433efda tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:28.210359 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-468585ca-8e9a-4595-b764-ee8ed433efda tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1391 microversion: 2.1 time: 0.531083 Oct 11 20:08:28.225541 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2643/5257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:27 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1391 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:08:28.799362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03403a4f-d84e-4be1-8796-3f457b11bad7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:28.800150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-03403a4f-d84e-4be1-8796-3f457b11bad7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:28.822544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03403a4f-d84e-4be1-8796-3f457b11bad7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:28.826772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03403a4f-d84e-4be1-8796-3f457b11bad7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:28.828022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03403a4f-d84e-4be1-8796-3f457b11bad7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:28.829241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03403a4f-d84e-4be1-8796-3f457b11bad7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:28.830436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03403a4f-d84e-4be1-8796-3f457b11bad7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:28.832481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03403a4f-d84e-4be1-8796-3f457b11bad7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:29.232955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c6330b38-5c5f-4788-8399-01b6716c6580 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:29.233656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c6330b38-5c5f-4788-8399-01b6716c6580 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:29.237431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:29.254194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6330b38-5c5f-4788-8399-01b6716c6580 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:29.254900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6330b38-5c5f-4788-8399-01b6716c6580 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:29.255460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6330b38-5c5f-4788-8399-01b6716c6580 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:29.258012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6330b38-5c5f-4788-8399-01b6716c6580 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:29.258687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6330b38-5c5f-4788-8399-01b6716c6580 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:29.259295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6330b38-5c5f-4788-8399-01b6716c6580 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:29.285815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:29.634829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-03403a4f-d84e-4be1-8796-3f457b11bad7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:29.643309 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-03403a4f-d84e-4be1-8796-3f457b11bad7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1556 microversion: 2.1 time: 0.859133 Oct 11 20:08:29.643935 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2615/5258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:28 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1556 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:29.668141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3915f6be-7ade-403c-b960-63995c15c1dd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:29.668649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3915f6be-7ade-403c-b960-63995c15c1dd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:29.686417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3915f6be-7ade-403c-b960-63995c15c1dd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:29.686417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3915f6be-7ade-403c-b960-63995c15c1dd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:29.686417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3915f6be-7ade-403c-b960-63995c15c1dd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:29.686417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3915f6be-7ade-403c-b960-63995c15c1dd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:29.686417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3915f6be-7ade-403c-b960-63995c15c1dd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:29.687430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3915f6be-7ade-403c-b960-63995c15c1dd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:29.858368 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3915f6be-7ade-403c-b960-63995c15c1dd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.193227 Oct 11 20:08:29.860756 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2616/5259] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:08:29 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:08:29.871867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c6330b38-5c5f-4788-8399-01b6716c6580 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:29.886212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c6330b38-5c5f-4788-8399-01b6716c6580 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1391 microversion: 2.1 time: 0.656943 Oct 11 20:08:29.886937 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2644/5260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:29 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1391 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:30.911030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:30.918475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5f4dc649-52e8-4727-9e15-5beac70bb975 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:30.919256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f4dc649-52e8-4727-9e15-5beac70bb975 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:30.934878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f4dc649-52e8-4727-9e15-5beac70bb975 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:30.937265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f4dc649-52e8-4727-9e15-5beac70bb975 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:30.938583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f4dc649-52e8-4727-9e15-5beac70bb975 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:30.940466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f4dc649-52e8-4727-9e15-5beac70bb975 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:30.942330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f4dc649-52e8-4727-9e15-5beac70bb975 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:30.944982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f4dc649-52e8-4727-9e15-5beac70bb975 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:32.551402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5f4dc649-52e8-4727-9e15-5beac70bb975 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:32.561970 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5f4dc649-52e8-4727-9e15-5beac70bb975 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1391 microversion: 2.1 time: 1.652436 Oct 11 20:08:32.564335 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2617/5261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:30 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1391 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:33.592886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-65696064-8b82-4a46-9835-bd1f1ac6db0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:33.593564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-65696064-8b82-4a46-9835-bd1f1ac6db0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:33.607698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65696064-8b82-4a46-9835-bd1f1ac6db0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:33.608891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65696064-8b82-4a46-9835-bd1f1ac6db0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:33.609563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65696064-8b82-4a46-9835-bd1f1ac6db0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:33.611516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65696064-8b82-4a46-9835-bd1f1ac6db0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:33.613237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65696064-8b82-4a46-9835-bd1f1ac6db0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:33.616029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-65696064-8b82-4a46-9835-bd1f1ac6db0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:34.446502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-65696064-8b82-4a46-9835-bd1f1ac6db0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:34.454913 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-65696064-8b82-4a46-9835-bd1f1ac6db0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1391 microversion: 2.1 time: 0.866527 Oct 11 20:08:34.455540 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2645/5262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:33 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1391 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:34.570651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b2ab07d3-1f25-437c-9914-eb1afa16e7c5 req-09b1b55f-d291-435d-adab-9f39da4602e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f7286d-3c5c-4f68-8e00-d6bacf31e6c3", "name": "network-vif-plugged", "status": "completed", "tag": "a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:34.584886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b2ab07d3-1f25-437c-9914-eb1afa16e7c5 req-09b1b55f-d291-435d-adab-9f39da4602e1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:34.585382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b2ab07d3-1f25-437c-9914-eb1afa16e7c5 req-09b1b55f-d291-435d-adab-9f39da4602e1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:34.585984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b2ab07d3-1f25-437c-9914-eb1afa16e7c5 req-09b1b55f-d291-435d-adab-9f39da4602e1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:34.600265 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b2ab07d3-1f25-437c-9914-eb1afa16e7c5 req-09b1b55f-d291-435d-adab-9f39da4602e1 service nova] Creating event network-vif-plugged:a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4 for instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 on n-h2-860864-3 Oct 11 20:08:34.610182 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b2ab07d3-1f25-437c-9914-eb1afa16e7c5 req-09b1b55f-d291-435d-adab-9f39da4602e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.477498 Oct 11 20:08:34.611392 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2618/5263] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:35.483268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c35a148d-469a-4622-afe6-89c6d439f90d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:35.484232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c35a148d-469a-4622-afe6-89c6d439f90d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:35.501555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c35a148d-469a-4622-afe6-89c6d439f90d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:35.503858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c35a148d-469a-4622-afe6-89c6d439f90d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:35.504807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c35a148d-469a-4622-afe6-89c6d439f90d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:35.507803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c35a148d-469a-4622-afe6-89c6d439f90d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:35.508464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c35a148d-469a-4622-afe6-89c6d439f90d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:35.509439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c35a148d-469a-4622-afe6-89c6d439f90d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:36.109676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-683bf539-620b-413c-bd52-82f34ea594ed req-6f54513a-883c-4c2b-89c4-59ca651f6493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c", "tag": "7a6ee646-45ba-413e-bbb5-3801ce477302"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:36.160752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-683bf539-620b-413c-bd52-82f34ea594ed req-6f54513a-883c-4c2b-89c4-59ca651f6493 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:36.166658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-683bf539-620b-413c-bd52-82f34ea594ed req-6f54513a-883c-4c2b-89c4-59ca651f6493 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:36.168485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-683bf539-620b-413c-bd52-82f34ea594ed req-6f54513a-883c-4c2b-89c4-59ca651f6493 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:36.220756 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-683bf539-620b-413c-bd52-82f34ea594ed req-6f54513a-883c-4c2b-89c4-59ca651f6493 service nova] Creating event network-changed:7a6ee646-45ba-413e-bbb5-3801ce477302 for instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c on n-h1-860864-3 Oct 11 20:08:36.237014 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-683bf539-620b-413c-bd52-82f34ea594ed req-6f54513a-883c-4c2b-89c4-59ca651f6493 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133365 Oct 11 20:08:36.240623 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2619/5264] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:36.263517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c35a148d-469a-4622-afe6-89c6d439f90d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:36.273697 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c35a148d-469a-4622-afe6-89c6d439f90d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1391 microversion: 2.1 time: 0.795980 Oct 11 20:08:36.274308 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2646/5265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:35 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1391 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:37.300283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-327b8dd4-8c12-473d-b378-ae3cedbc883c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:37.300992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-327b8dd4-8c12-473d-b378-ae3cedbc883c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:37.315607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327b8dd4-8c12-473d-b378-ae3cedbc883c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:37.317471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327b8dd4-8c12-473d-b378-ae3cedbc883c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:37.321525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327b8dd4-8c12-473d-b378-ae3cedbc883c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:37.322582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327b8dd4-8c12-473d-b378-ae3cedbc883c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:37.323244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327b8dd4-8c12-473d-b378-ae3cedbc883c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:37.323830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-327b8dd4-8c12-473d-b378-ae3cedbc883c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:37.329870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=99 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:37.909510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-327b8dd4-8c12-473d-b378-ae3cedbc883c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:37.935516 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-327b8dd4-8c12-473d-b378-ae3cedbc883c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1564 microversion: 2.1 time: 0.635855 Oct 11 20:08:37.938655 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2620/5266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:37 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1564 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:37.966262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6826a253-a351-42b5-8ff3-a0b8043ccbf7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:37.966921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6826a253-a351-42b5-8ff3-a0b8043ccbf7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:37.990153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6826a253-a351-42b5-8ff3-a0b8043ccbf7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:37.990775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6826a253-a351-42b5-8ff3-a0b8043ccbf7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:37.991227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6826a253-a351-42b5-8ff3-a0b8043ccbf7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:37.991952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6826a253-a351-42b5-8ff3-a0b8043ccbf7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:37.992411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6826a253-a351-42b5-8ff3-a0b8043ccbf7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:37.992842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6826a253-a351-42b5-8ff3-a0b8043ccbf7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:38.349543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6826a253-a351-42b5-8ff3-a0b8043ccbf7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:38.362034 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6826a253-a351-42b5-8ff3-a0b8043ccbf7 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1564 microversion: 2.1 time: 0.400854 Oct 11 20:08:38.365235 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2647/5267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:37 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1564 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:08:43.911317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-755eba7e-5d9c-40e8-a455-1c50a101ca21 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:08:43.912608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-755eba7e-5d9c-40e8-a455-1c50a101ca21 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:08:43.916474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:43.922552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ac680c81-4bbb-4855-bdab-e6670e433b44 req-f72ecb2d-8a6d-44a0-9604-f67111e4c069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f7286d-3c5c-4f68-8e00-d6bacf31e6c3", "tag": "a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:08:43.938028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755eba7e-5d9c-40e8-a455-1c50a101ca21 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:43.939762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755eba7e-5d9c-40e8-a455-1c50a101ca21 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:43.940462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755eba7e-5d9c-40e8-a455-1c50a101ca21 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:43.944432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:08:43.945830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755eba7e-5d9c-40e8-a455-1c50a101ca21 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:43.946304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ac680c81-4bbb-4855-bdab-e6670e433b44 req-f72ecb2d-8a6d-44a0-9604-f67111e4c069 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:08:43.946827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ac680c81-4bbb-4855-bdab-e6670e433b44 req-f72ecb2d-8a6d-44a0-9604-f67111e4c069 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:43.947267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ac680c81-4bbb-4855-bdab-e6670e433b44 req-f72ecb2d-8a6d-44a0-9604-f67111e4c069 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:43.947537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755eba7e-5d9c-40e8-a455-1c50a101ca21 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:08:43.948211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755eba7e-5d9c-40e8-a455-1c50a101ca21 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:08:43.972177 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ac680c81-4bbb-4855-bdab-e6670e433b44 req-f72ecb2d-8a6d-44a0-9604-f67111e4c069 service nova] Creating event network-changed:a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4 for instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 on n-h2-860864-3 Oct 11 20:08:43.984018 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ac680c81-4bbb-4855-bdab-e6670e433b44 req-f72ecb2d-8a6d-44a0-9604-f67111e4c069 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062947 Oct 11 20:08:43.998730 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2648/5268] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:08:44.410893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-755eba7e-5d9c-40e8-a455-1c50a101ca21 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:08:44.434183 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-755eba7e-5d9c-40e8-a455-1c50a101ca21 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1564 microversion: 2.1 time: 0.527334 Oct 11 20:08:44.437948 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2621/5269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:08:43 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1564 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:00.980482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54cc41df-8bff-4d53-80b0-30dad884787c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:00.999480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-54cc41df-8bff-4d53-80b0-30dad884787c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:01.017062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=35 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:09:01.046036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54cc41df-8bff-4d53-80b0-30dad884787c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:01.046562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54cc41df-8bff-4d53-80b0-30dad884787c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:01.047899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54cc41df-8bff-4d53-80b0-30dad884787c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:01.048855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54cc41df-8bff-4d53-80b0-30dad884787c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:01.049465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54cc41df-8bff-4d53-80b0-30dad884787c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:01.050071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54cc41df-8bff-4d53-80b0-30dad884787c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:01.138354 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-54cc41df-8bff-4d53-80b0-30dad884787c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3/action" status: 200 len: 24569 microversion: 2.1 time: 0.167145 Oct 11 20:09:01.139065 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2649/5270] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:09:00 2022] POST /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3/action => generated 24569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:09:01.168370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-573c6c3d-19e0-4dad-ba98-4c772f0c374c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:01.168370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-573c6c3d-19e0-4dad-ba98-4c772f0c374c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:01.180926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:09:01.185224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=11 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:09:01.193218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-573c6c3d-19e0-4dad-ba98-4c772f0c374c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:01.197923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-573c6c3d-19e0-4dad-ba98-4c772f0c374c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:01.198643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-573c6c3d-19e0-4dad-ba98-4c772f0c374c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:01.200729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-573c6c3d-19e0-4dad-ba98-4c772f0c374c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:01.204022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-573c6c3d-19e0-4dad-ba98-4c772f0c374c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:01.204755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-573c6c3d-19e0-4dad-ba98-4c772f0c374c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:01.266226 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-573c6c3d-19e0-4dad-ba98-4c772f0c374c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/ips" status: 200 len: 151 microversion: 2.1 time: 0.110446 Oct 11 20:09:01.276675 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2622/5271] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:09:01 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/ips => generated 151 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:04.102038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d33523d-79b0-4628-a425-7dc108347cd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d43a65d-9a0a-478d-86fc-4ff72624bec3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:04.104849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8d33523d-79b0-4628-a425-7dc108347cd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:04.118341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d33523d-79b0-4628-a425-7dc108347cd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:04.119007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d33523d-79b0-4628-a425-7dc108347cd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:04.121456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d33523d-79b0-4628-a425-7dc108347cd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:04.122398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d33523d-79b0-4628-a425-7dc108347cd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:04.123067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d33523d-79b0-4628-a425-7dc108347cd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:04.124863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d33523d-79b0-4628-a425-7dc108347cd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:04.650415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8d33523d-79b0-4628-a425-7dc108347cd9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.551472 Oct 11 20:09:04.652076 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2650/5272] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:09:04 2022] POST /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 194 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:12.231791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5d0e8b7a-cd9d-4d82-bc03-aee9b330770d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:12.232443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5d0e8b7a-cd9d-4d82-bc03-aee9b330770d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:12.269789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:09:12.270644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:09:12.272234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d0e8b7a-cd9d-4d82-bc03-aee9b330770d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:12.272763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d0e8b7a-cd9d-4d82-bc03-aee9b330770d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:12.281993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d0e8b7a-cd9d-4d82-bc03-aee9b330770d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:12.282829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d0e8b7a-cd9d-4d82-bc03-aee9b330770d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:12.287530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d0e8b7a-cd9d-4d82-bc03-aee9b330770d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:12.294088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d0e8b7a-cd9d-4d82-bc03-aee9b330770d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:13.459629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5d0e8b7a-cd9d-4d82-bc03-aee9b330770d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:13.472373 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5d0e8b7a-cd9d-4d82-bc03-aee9b330770d tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1682 microversion: 2.1 time: 1.244304 Oct 11 20:09:13.482934 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2623/5273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:12 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1682 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:13.718619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8cbf6ec3-222e-43aa-baaa-7d5cff7713c6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:13.723512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8cbf6ec3-222e-43aa-baaa-7d5cff7713c6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:13.738652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cbf6ec3-222e-43aa-baaa-7d5cff7713c6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:13.742383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cbf6ec3-222e-43aa-baaa-7d5cff7713c6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:13.745178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cbf6ec3-222e-43aa-baaa-7d5cff7713c6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:13.747882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cbf6ec3-222e-43aa-baaa-7d5cff7713c6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:13.748724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cbf6ec3-222e-43aa-baaa-7d5cff7713c6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:13.749331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8cbf6ec3-222e-43aa-baaa-7d5cff7713c6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:13.846913 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8cbf6ec3-222e-43aa-baaa-7d5cff7713c6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3/action" status: 200 len: 32639 microversion: 2.1 time: 0.132646 Oct 11 20:09:13.848841 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2651/5274] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:09:13 2022] POST /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3/action => generated 32639 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:09:13.992739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-135b8813-b723-4c40-94f5-401758db86d3 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:13.993388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-135b8813-b723-4c40-94f5-401758db86d3 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:13.999860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-135b8813-b723-4c40-94f5-401758db86d3 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:14.006627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-135b8813-b723-4c40-94f5-401758db86d3 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:14.008611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-135b8813-b723-4c40-94f5-401758db86d3 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:14.011559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-135b8813-b723-4c40-94f5-401758db86d3 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:14.013197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-135b8813-b723-4c40-94f5-401758db86d3 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:14.016240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-135b8813-b723-4c40-94f5-401758db86d3 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:14.539678 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-135b8813-b723-4c40-94f5-401758db86d3 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1833 microversion: 2.1 time: 0.550851 Oct 11 20:09:14.570095 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2624/5275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:13 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1833 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:14.575594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:14.578141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:14.591086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:14.591844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:14.592780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:14.607679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:14.608548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:14.611766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:14.718563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lazy-loading 'flavor' on Instance uuid 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:09:14.748559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Going to try to live migrate instance to another host {{(pid=126956) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 20:09:18.901372 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98f7bb58-ba8e-434e-a8e5-905d6a4f5c5f tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3/action" status: 202 len: 0 microversion: 2.1 time: 4.328580 Oct 11 20:09:18.906814 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2652/5276] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:09:14 2022] POST /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3/action => generated 0 bytes in 4337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 20:09:18.916342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e78413d-3ffb-4dd3-9995-a08b02a97aef tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:18.916971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e78413d-3ffb-4dd3-9995-a08b02a97aef tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:18.934675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e78413d-3ffb-4dd3-9995-a08b02a97aef tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:18.935183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e78413d-3ffb-4dd3-9995-a08b02a97aef tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:18.935632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e78413d-3ffb-4dd3-9995-a08b02a97aef tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:18.936352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e78413d-3ffb-4dd3-9995-a08b02a97aef tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:18.936820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e78413d-3ffb-4dd3-9995-a08b02a97aef tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:18.937253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e78413d-3ffb-4dd3-9995-a08b02a97aef tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:19.665927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2e78413d-3ffb-4dd3-9995-a08b02a97aef tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:19.677080 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2e78413d-3ffb-4dd3-9995-a08b02a97aef tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1692 microversion: 2.1 time: 0.764519 Oct 11 20:09:19.686560 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2625/5277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:18 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1692 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:20.703760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8710af6e-31af-4c0c-8206-ee60a69354cb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:20.704377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8710af6e-31af-4c0c-8206-ee60a69354cb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:20.723364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8710af6e-31af-4c0c-8206-ee60a69354cb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:20.723869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8710af6e-31af-4c0c-8206-ee60a69354cb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:20.724307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8710af6e-31af-4c0c-8206-ee60a69354cb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:20.725020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8710af6e-31af-4c0c-8206-ee60a69354cb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:20.725487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8710af6e-31af-4c0c-8206-ee60a69354cb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:20.725915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8710af6e-31af-4c0c-8206-ee60a69354cb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:21.059132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8710af6e-31af-4c0c-8206-ee60a69354cb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:21.071210 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8710af6e-31af-4c0c-8206-ee60a69354cb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1692 microversion: 2.1 time: 0.371243 Oct 11 20:09:21.085879 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2653/5278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:20 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1692 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:21.158712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d43a65d-9a0a-478d-86fc-4ff72624bec3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:21.171003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:21.202730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:21.206414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:21.206941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:21.212043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:21.212943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:21.214310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:21.387860 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Invalid volume: volume 8d43a65d-9a0a-478d-86fc-4ff72624bec3 is already attached to instances: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments HTTP/1.1 Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 74 Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: {"volumeAttachment": {"volumeId": "8d43a65d-9a0a-478d-86fc-4ff72624bec3"}} Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid volume: volume 8d43a65d-9a0a-478d-86fc-4ff72624bec3 is already attached to instances: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'server_id': '8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c', 'body': {'volumeAttachment': {'volumeId': '8d43a65d-9a0a-478d-86fc-4ff72624bec3'}}} Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8d43a65d-9a0a-478d-86fc-4ff72624bec3 is already attached to instances: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:09:21.389844 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8d43a65d-9a0a-478d-86fc-4ff72624bec3 is already attached to instances: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8d43a65d-9a0a-478d-86fc-4ff72624bec3 is already attached to instances: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c Oct 11 20:09:21.394183 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:09:21.396938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 400 to user: Invalid volume: volume 8d43a65d-9a0a-478d-86fc-4ff72624bec3 is already attached to instances: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:09:21.397983 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8821452a-e470-44a4-b517-73e9729d991b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.249178 Oct 11 20:09:21.402929 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2626/5279] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:09:21 2022] POST /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 174 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:09:21.530251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-14acd10f-af81-46c7-8c26-0a6ab9cc0c93 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:21.531355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-14acd10f-af81-46c7-8c26-0a6ab9cc0c93 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:21.577820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14acd10f-af81-46c7-8c26-0a6ab9cc0c93 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:21.579279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14acd10f-af81-46c7-8c26-0a6ab9cc0c93 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:21.580214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14acd10f-af81-46c7-8c26-0a6ab9cc0c93 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:21.583329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14acd10f-af81-46c7-8c26-0a6ab9cc0c93 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:21.584194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14acd10f-af81-46c7-8c26-0a6ab9cc0c93 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:21.585030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14acd10f-af81-46c7-8c26-0a6ab9cc0c93 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:21.795031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-14acd10f-af81-46c7-8c26-0a6ab9cc0c93 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lazy-loading 'services' on Instance uuid 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:09:21.948946 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-14acd10f-af81-46c7-8c26-0a6ab9cc0c93 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments/8d43a65d-9a0a-478d-86fc-4ff72624bec3" status: 202 len: 0 microversion: 2.1 time: 0.425556 Oct 11 20:09:21.949873 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2654/5280] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:09:21 2022] DELETE /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments/8d43a65d-9a0a-478d-86fc-4ff72624bec3 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:09:21.965406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-36e30731-a757-40d9-be01-2841bc10c6bc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:21.974474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-36e30731-a757-40d9-be01-2841bc10c6bc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:21.992393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36e30731-a757-40d9-be01-2841bc10c6bc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:21.993621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36e30731-a757-40d9-be01-2841bc10c6bc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:21.994389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36e30731-a757-40d9-be01-2841bc10c6bc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:22.013627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36e30731-a757-40d9-be01-2841bc10c6bc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:22.014680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36e30731-a757-40d9-be01-2841bc10c6bc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:22.015856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-36e30731-a757-40d9-be01-2841bc10c6bc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:22.108279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6285d2d1-7e46-4638-93e8-299e58b5911c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:22.109263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6285d2d1-7e46-4638-93e8-299e58b5911c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:22.114609 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-36e30731-a757-40d9-be01-2841bc10c6bc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151505 Oct 11 20:09:22.116973 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2627/5281] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:09:21 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:22.118028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6285d2d1-7e46-4638-93e8-299e58b5911c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:22.118769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6285d2d1-7e46-4638-93e8-299e58b5911c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:22.119359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6285d2d1-7e46-4638-93e8-299e58b5911c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:22.120257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6285d2d1-7e46-4638-93e8-299e58b5911c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:22.120981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6285d2d1-7e46-4638-93e8-299e58b5911c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:22.121567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6285d2d1-7e46-4638-93e8-299e58b5911c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:22.525658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6285d2d1-7e46-4638-93e8-299e58b5911c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:22.534675 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6285d2d1-7e46-4638-93e8-299e58b5911c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1692 microversion: 2.1 time: 0.430888 Oct 11 20:09:22.538750 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2655/5282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:22 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1692 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:22.853259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ba444d9f-52d1-4ddf-9a60-8b8806f5673c req-aaab5e19-18c5-47ca-8b12-20cde8a72f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f7286d-3c5c-4f68-8e00-d6bacf31e6c3", "name": "network-vif-unplugged", "status": "completed", "tag": "a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:22.880122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ba444d9f-52d1-4ddf-9a60-8b8806f5673c req-aaab5e19-18c5-47ca-8b12-20cde8a72f69 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:22.881883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ba444d9f-52d1-4ddf-9a60-8b8806f5673c req-aaab5e19-18c5-47ca-8b12-20cde8a72f69 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:22.882566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ba444d9f-52d1-4ddf-9a60-8b8806f5673c req-aaab5e19-18c5-47ca-8b12-20cde8a72f69 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:22.902077 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ba444d9f-52d1-4ddf-9a60-8b8806f5673c req-aaab5e19-18c5-47ca-8b12-20cde8a72f69 service nova] Creating event network-vif-unplugged:a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4 for instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 on n-h2-860864-3 Oct 11 20:09:22.926683 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ba444d9f-52d1-4ddf-9a60-8b8806f5673c req-aaab5e19-18c5-47ca-8b12-20cde8a72f69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076821 Oct 11 20:09:22.928144 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2628/5283] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:23.131161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6544b7e3-0b19-4a7c-95a5-08f44dd2401a tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:23.133707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6544b7e3-0b19-4a7c-95a5-08f44dd2401a tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:23.149593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6544b7e3-0b19-4a7c-95a5-08f44dd2401a tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:23.150572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6544b7e3-0b19-4a7c-95a5-08f44dd2401a tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:23.151226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6544b7e3-0b19-4a7c-95a5-08f44dd2401a tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:23.154758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6544b7e3-0b19-4a7c-95a5-08f44dd2401a tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:23.155484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6544b7e3-0b19-4a7c-95a5-08f44dd2401a tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:23.156125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6544b7e3-0b19-4a7c-95a5-08f44dd2401a tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:23.250180 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6544b7e3-0b19-4a7c-95a5-08f44dd2401a tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126181 Oct 11 20:09:23.258809 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2656/5284] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:09:23 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:23.573406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-74e93c6c-3de9-47d6-b9f7-38098d0bfabd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:23.575031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-74e93c6c-3de9-47d6-b9f7-38098d0bfabd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:23.592904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e93c6c-3de9-47d6-b9f7-38098d0bfabd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:23.597690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e93c6c-3de9-47d6-b9f7-38098d0bfabd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:23.601658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e93c6c-3de9-47d6-b9f7-38098d0bfabd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:23.604531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e93c6c-3de9-47d6-b9f7-38098d0bfabd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:23.605357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e93c6c-3de9-47d6-b9f7-38098d0bfabd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:23.607199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e93c6c-3de9-47d6-b9f7-38098d0bfabd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:24.267087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89163be1-f125-46c8-a74f-f285559712e8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:24.271157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-89163be1-f125-46c8-a74f-f285559712e8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:24.306361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89163be1-f125-46c8-a74f-f285559712e8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:24.307235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89163be1-f125-46c8-a74f-f285559712e8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:24.308584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89163be1-f125-46c8-a74f-f285559712e8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:24.309418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89163be1-f125-46c8-a74f-f285559712e8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:24.311517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89163be1-f125-46c8-a74f-f285559712e8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:24.314259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89163be1-f125-46c8-a74f-f285559712e8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:24.457139 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-89163be1-f125-46c8-a74f-f285559712e8 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196030 Oct 11 20:09:24.463467 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2657/5285] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:09:24 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:25.460784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-74e93c6c-3de9-47d6-b9f7-38098d0bfabd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:25.470059 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-74e93c6c-3de9-47d6-b9f7-38098d0bfabd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1692 microversion: 2.1 time: 1.902658 Oct 11 20:09:25.471826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-511e7770-5f0b-4cb6-9df3-641dba3405ec tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:25.473891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-511e7770-5f0b-4cb6-9df3-641dba3405ec tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:25.476968 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2629/5286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:23 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1692 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:25.484957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-511e7770-5f0b-4cb6-9df3-641dba3405ec tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:25.488004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-511e7770-5f0b-4cb6-9df3-641dba3405ec tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:25.488714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-511e7770-5f0b-4cb6-9df3-641dba3405ec tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:25.491064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-511e7770-5f0b-4cb6-9df3-641dba3405ec tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:25.492964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-511e7770-5f0b-4cb6-9df3-641dba3405ec tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:25.493585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-511e7770-5f0b-4cb6-9df3-641dba3405ec tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:25.579677 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-511e7770-5f0b-4cb6-9df3-641dba3405ec tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112595 Oct 11 20:09:25.580612 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2658/5287] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:09:25 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:26.505146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-69a4f99b-9e2a-49b1-ae19-4a087261ea0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:26.505760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-69a4f99b-9e2a-49b1-ae19-4a087261ea0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:26.531881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a4f99b-9e2a-49b1-ae19-4a087261ea0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:26.537768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a4f99b-9e2a-49b1-ae19-4a087261ea0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:26.542443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a4f99b-9e2a-49b1-ae19-4a087261ea0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:26.543548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a4f99b-9e2a-49b1-ae19-4a087261ea0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:26.549517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a4f99b-9e2a-49b1-ae19-4a087261ea0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:26.550632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a4f99b-9e2a-49b1-ae19-4a087261ea0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:26.595721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-afc2dd56-d31e-4862-a37c-79c98f126973 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:26.607888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-afc2dd56-d31e-4862-a37c-79c98f126973 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:26.674073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-afc2dd56-d31e-4862-a37c-79c98f126973 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:26.675139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-afc2dd56-d31e-4862-a37c-79c98f126973 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:26.675595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-afc2dd56-d31e-4862-a37c-79c98f126973 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:26.676321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-afc2dd56-d31e-4862-a37c-79c98f126973 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:26.676790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-afc2dd56-d31e-4862-a37c-79c98f126973 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:26.677234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-afc2dd56-d31e-4862-a37c-79c98f126973 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:26.859926 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-afc2dd56-d31e-4862-a37c-79c98f126973 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.270802 Oct 11 20:09:26.877474 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2659/5288] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:09:26 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 197 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:27.398394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2990482f-f5e5-4c4d-94a2-46f0117c08f4 req-4152bd46-0e2f-4919-bfb1-858f7c1a5ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f7286d-3c5c-4f68-8e00-d6bacf31e6c3", "tag": "a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:27.413932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2990482f-f5e5-4c4d-94a2-46f0117c08f4 req-4152bd46-0e2f-4919-bfb1-858f7c1a5ea5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:27.414836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2990482f-f5e5-4c4d-94a2-46f0117c08f4 req-4152bd46-0e2f-4919-bfb1-858f7c1a5ea5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:27.415637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2990482f-f5e5-4c4d-94a2-46f0117c08f4 req-4152bd46-0e2f-4919-bfb1-858f7c1a5ea5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:27.452128 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2990482f-f5e5-4c4d-94a2-46f0117c08f4 req-4152bd46-0e2f-4919-bfb1-858f7c1a5ea5 service nova] Creating event network-changed:a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4 for instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 on n-h2-860864-3 Oct 11 20:09:27.468884 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2990482f-f5e5-4c4d-94a2-46f0117c08f4 req-4152bd46-0e2f-4919-bfb1-858f7c1a5ea5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072700 Oct 11 20:09:27.472155 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2660/5289] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:09:27.893629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d2c95d2a-39ab-42b6-9efa-d8d250267cf0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:27.896524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d2c95d2a-39ab-42b6-9efa-d8d250267cf0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:27.919507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2c95d2a-39ab-42b6-9efa-d8d250267cf0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:27.920252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2c95d2a-39ab-42b6-9efa-d8d250267cf0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:27.921497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2c95d2a-39ab-42b6-9efa-d8d250267cf0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:27.923471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2c95d2a-39ab-42b6-9efa-d8d250267cf0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:27.925213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2c95d2a-39ab-42b6-9efa-d8d250267cf0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:27.929504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d2c95d2a-39ab-42b6-9efa-d8d250267cf0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:27.948103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-69a4f99b-9e2a-49b1-ae19-4a087261ea0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:27.972796 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-69a4f99b-9e2a-49b1-ae19-4a087261ea0f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1692 microversion: 2.1 time: 1.467750 Oct 11 20:09:27.979715 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2630/5290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:26 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1692 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:28.030602 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d2c95d2a-39ab-42b6-9efa-d8d250267cf0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142690 Oct 11 20:09:28.032026 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2661/5291] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:09:27 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:29.007739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cdbbaae6-13b6-428b-9c64-41d1ec3d59fa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:29.009563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cdbbaae6-13b6-428b-9c64-41d1ec3d59fa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:29.030086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdbbaae6-13b6-428b-9c64-41d1ec3d59fa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:29.031561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdbbaae6-13b6-428b-9c64-41d1ec3d59fa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:29.033566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdbbaae6-13b6-428b-9c64-41d1ec3d59fa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:29.035733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdbbaae6-13b6-428b-9c64-41d1ec3d59fa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:29.039418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdbbaae6-13b6-428b-9c64-41d1ec3d59fa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:29.041128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdbbaae6-13b6-428b-9c64-41d1ec3d59fa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:29.048161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4b8b0d68-1581-49f5-a66e-6cf0d8c388f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:29.052117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4b8b0d68-1581-49f5-a66e-6cf0d8c388f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:29.086116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b8b0d68-1581-49f5-a66e-6cf0d8c388f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:29.088804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b8b0d68-1581-49f5-a66e-6cf0d8c388f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:29.089289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b8b0d68-1581-49f5-a66e-6cf0d8c388f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:29.090030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b8b0d68-1581-49f5-a66e-6cf0d8c388f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:29.090508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b8b0d68-1581-49f5-a66e-6cf0d8c388f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:29.093197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b8b0d68-1581-49f5-a66e-6cf0d8c388f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:29.163449 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4b8b0d68-1581-49f5-a66e-6cf0d8c388f6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123108 Oct 11 20:09:29.166586 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2662/5292] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:09:29 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:30.176746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-697989b6-b178-4d79-8aab-5402dd011e9b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:30.179192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-697989b6-b178-4d79-8aab-5402dd011e9b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:30.200010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697989b6-b178-4d79-8aab-5402dd011e9b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:30.200406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697989b6-b178-4d79-8aab-5402dd011e9b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:30.200852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697989b6-b178-4d79-8aab-5402dd011e9b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:30.201683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697989b6-b178-4d79-8aab-5402dd011e9b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:30.202166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697989b6-b178-4d79-8aab-5402dd011e9b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:30.202914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-697989b6-b178-4d79-8aab-5402dd011e9b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:30.211926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:09:30.228329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cdbbaae6-13b6-428b-9c64-41d1ec3d59fa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:30.245730 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cdbbaae6-13b6-428b-9c64-41d1ec3d59fa tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1692 microversion: 2.1 time: 1.244276 Oct 11 20:09:30.254725 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2631/5293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:29 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1692 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:30.297602 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-697989b6-b178-4d79-8aab-5402dd011e9b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125350 Oct 11 20:09:30.305194 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2663/5294] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:09:30 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:09:31.277752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-96373650-0f30-4b9c-9313-141fbe1a6608 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:31.278930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-96373650-0f30-4b9c-9313-141fbe1a6608 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:31.288751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96373650-0f30-4b9c-9313-141fbe1a6608 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:31.292729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96373650-0f30-4b9c-9313-141fbe1a6608 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:31.294405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96373650-0f30-4b9c-9313-141fbe1a6608 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:31.297704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96373650-0f30-4b9c-9313-141fbe1a6608 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:31.298194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96373650-0f30-4b9c-9313-141fbe1a6608 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:31.301385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-96373650-0f30-4b9c-9313-141fbe1a6608 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:31.312528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3a9a81fd-151d-43ef-bf9d-54ece5af1456 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:31.316812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3a9a81fd-151d-43ef-bf9d-54ece5af1456 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:31.342287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=34 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:09:31.346479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a9a81fd-151d-43ef-bf9d-54ece5af1456 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:31.352834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a9a81fd-151d-43ef-bf9d-54ece5af1456 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:31.355285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a9a81fd-151d-43ef-bf9d-54ece5af1456 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:31.360390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a9a81fd-151d-43ef-bf9d-54ece5af1456 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:31.361401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a9a81fd-151d-43ef-bf9d-54ece5af1456 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:31.362983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a9a81fd-151d-43ef-bf9d-54ece5af1456 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:31.482041 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3a9a81fd-151d-43ef-bf9d-54ece5af1456 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174223 Oct 11 20:09:31.492686 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2664/5295] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:09:31 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:09:32.269092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96373650-0f30-4b9c-9313-141fbe1a6608 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:32.285561 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-96373650-0f30-4b9c-9313-141fbe1a6608 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1692 microversion: 2.1 time: 1.012088 Oct 11 20:09:32.287737 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2632/5296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:31 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1692 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:32.497259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cf58369c-a85c-4f28-b4da-940e00637985 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:32.500097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cf58369c-a85c-4f28-b4da-940e00637985 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:32.513948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf58369c-a85c-4f28-b4da-940e00637985 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:32.519040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf58369c-a85c-4f28-b4da-940e00637985 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:32.519629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf58369c-a85c-4f28-b4da-940e00637985 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:32.520499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf58369c-a85c-4f28-b4da-940e00637985 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:32.521039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf58369c-a85c-4f28-b4da-940e00637985 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:32.521561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf58369c-a85c-4f28-b4da-940e00637985 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:32.588390 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cf58369c-a85c-4f28-b4da-940e00637985 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094979 Oct 11 20:09:32.594544 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2665/5297] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:09:32 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:09:32.714782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1f2f8763-eb0b-4546-b282-eeb6080c23d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:32.715632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f2f8763-eb0b-4546-b282-eeb6080c23d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:32.727294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2f8763-eb0b-4546-b282-eeb6080c23d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:32.728273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2f8763-eb0b-4546-b282-eeb6080c23d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:32.730905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2f8763-eb0b-4546-b282-eeb6080c23d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:32.731874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2f8763-eb0b-4546-b282-eeb6080c23d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:32.732693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2f8763-eb0b-4546-b282-eeb6080c23d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:32.734635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f2f8763-eb0b-4546-b282-eeb6080c23d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:32.803166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f2f8763-eb0b-4546-b282-eeb6080c23d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:09:33.071590 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1f2f8763-eb0b-4546-b282-eeb6080c23d7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 204 len: 0 microversion: 2.1 time: 0.361973 Oct 11 20:09:33.072560 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2633/5298] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:09:32 2022] DELETE /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:09:33.083684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ea51d78-99bd-4795-928c-fb2d2ef55ec6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:33.084973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ea51d78-99bd-4795-928c-fb2d2ef55ec6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:33.091991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ea51d78-99bd-4795-928c-fb2d2ef55ec6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:33.092743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ea51d78-99bd-4795-928c-fb2d2ef55ec6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:33.093448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ea51d78-99bd-4795-928c-fb2d2ef55ec6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:33.095023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ea51d78-99bd-4795-928c-fb2d2ef55ec6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:33.095704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ea51d78-99bd-4795-928c-fb2d2ef55ec6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:33.097083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ea51d78-99bd-4795-928c-fb2d2ef55ec6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:33.328722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-073e3704-f6d4-48ee-9285-e456fc550ba6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:33.333396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-073e3704-f6d4-48ee-9285-e456fc550ba6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:33.365650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-073e3704-f6d4-48ee-9285-e456fc550ba6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:33.366248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-073e3704-f6d4-48ee-9285-e456fc550ba6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:33.371262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-073e3704-f6d4-48ee-9285-e456fc550ba6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:33.372097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-073e3704-f6d4-48ee-9285-e456fc550ba6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:33.372600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-073e3704-f6d4-48ee-9285-e456fc550ba6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:33.376416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-073e3704-f6d4-48ee-9285-e456fc550ba6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:33.845365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7ea51d78-99bd-4795-928c-fb2d2ef55ec6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:33.860558 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ea51d78-99bd-4795-928c-fb2d2ef55ec6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1681 microversion: 2.1 time: 0.782951 Oct 11 20:09:33.861136 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2666/5299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:33 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1681 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:34.246883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-073e3704-f6d4-48ee-9285-e456fc550ba6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:34.255029 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-073e3704-f6d4-48ee-9285-e456fc550ba6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1692 microversion: 2.1 time: 0.942660 Oct 11 20:09:34.269196 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2634/5300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:33 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1692 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:34.899432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-746102a8-4b7c-442b-9e81-d5dfba692ea3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:34.900205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-746102a8-4b7c-442b-9e81-d5dfba692ea3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:34.928725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746102a8-4b7c-442b-9e81-d5dfba692ea3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:34.929883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746102a8-4b7c-442b-9e81-d5dfba692ea3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:34.934372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746102a8-4b7c-442b-9e81-d5dfba692ea3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:34.939388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746102a8-4b7c-442b-9e81-d5dfba692ea3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:34.940354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746102a8-4b7c-442b-9e81-d5dfba692ea3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:34.941078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746102a8-4b7c-442b-9e81-d5dfba692ea3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:35.283228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-515f3b01-c10b-48f8-8a87-20cf594cd003 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:35.284520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-515f3b01-c10b-48f8-8a87-20cf594cd003 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:35.313645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515f3b01-c10b-48f8-8a87-20cf594cd003 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:35.331953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515f3b01-c10b-48f8-8a87-20cf594cd003 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:35.334068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515f3b01-c10b-48f8-8a87-20cf594cd003 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:35.335563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515f3b01-c10b-48f8-8a87-20cf594cd003 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:35.337258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515f3b01-c10b-48f8-8a87-20cf594cd003 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:35.343686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515f3b01-c10b-48f8-8a87-20cf594cd003 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:37.161842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-746102a8-4b7c-442b-9e81-d5dfba692ea3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:37.176835 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-746102a8-4b7c-442b-9e81-d5dfba692ea3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1681 microversion: 2.1 time: 2.289127 Oct 11 20:09:37.197970 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2667/5301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:34 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1681 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:37.213653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-515f3b01-c10b-48f8-8a87-20cf594cd003 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:37.228213 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-515f3b01-c10b-48f8-8a87-20cf594cd003 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1692 microversion: 2.1 time: 1.949383 Oct 11 20:09:37.229135 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2635/5302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:35 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1692 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:09:38.202509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b0ea27d4-d7c6-4aa1-a87e-8b78e67673a5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:38.203203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b0ea27d4-d7c6-4aa1-a87e-8b78e67673a5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:38.219720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0ea27d4-d7c6-4aa1-a87e-8b78e67673a5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:38.222000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0ea27d4-d7c6-4aa1-a87e-8b78e67673a5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:38.223213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0ea27d4-d7c6-4aa1-a87e-8b78e67673a5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:38.224965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0ea27d4-d7c6-4aa1-a87e-8b78e67673a5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:38.227412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0ea27d4-d7c6-4aa1-a87e-8b78e67673a5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:38.228043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0ea27d4-d7c6-4aa1-a87e-8b78e67673a5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:38.253798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-207d7dbe-62ff-475b-9a41-605c1b108ce6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:38.255200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-207d7dbe-62ff-475b-9a41-605c1b108ce6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:38.277050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-207d7dbe-62ff-475b-9a41-605c1b108ce6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:38.282985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-207d7dbe-62ff-475b-9a41-605c1b108ce6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:38.303393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-207d7dbe-62ff-475b-9a41-605c1b108ce6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:38.307900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-207d7dbe-62ff-475b-9a41-605c1b108ce6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:38.308472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-207d7dbe-62ff-475b-9a41-605c1b108ce6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:38.308938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-207d7dbe-62ff-475b-9a41-605c1b108ce6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:38.479409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b0ea27d4-d7c6-4aa1-a87e-8b78e67673a5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:38.502589 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b0ea27d4-d7c6-4aa1-a87e-8b78e67673a5 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1614 microversion: 2.1 time: 0.304411 Oct 11 20:09:38.514683 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2668/5303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:38 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1614 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:39.480328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d5b1c67d-72d9-4ead-9285-8efd66367235 req-56db5dce-3916-40b1-aa95-b60527ca6ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c", "name": "network-vif-deleted", "tag": "7a6ee646-45ba-413e-bbb5-3801ce477302"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:39.532320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d5b1c67d-72d9-4ead-9285-8efd66367235 req-56db5dce-3916-40b1-aa95-b60527ca6ae6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:39.542079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d5b1c67d-72d9-4ead-9285-8efd66367235 req-56db5dce-3916-40b1-aa95-b60527ca6ae6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:39.546677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d5b1c67d-72d9-4ead-9285-8efd66367235 req-56db5dce-3916-40b1-aa95-b60527ca6ae6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:39.565416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-207d7dbe-62ff-475b-9a41-605c1b108ce6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:39.574221 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-207d7dbe-62ff-475b-9a41-605c1b108ce6 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1682 microversion: 2.1 time: 1.325557 Oct 11 20:09:39.589054 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2636/5304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:38 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1682 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:39.599540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:39.599866 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d5b1c67d-72d9-4ead-9285-8efd66367235 req-56db5dce-3916-40b1-aa95-b60527ca6ae6 service nova] Creating event network-vif-deleted:7a6ee646-45ba-413e-bbb5-3801ce477302 for instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c on n-h1-860864-3 Oct 11 20:09:39.604592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:39.618854 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d5b1c67d-72d9-4ead-9285-8efd66367235 req-56db5dce-3916-40b1-aa95-b60527ca6ae6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145552 Oct 11 20:09:39.622163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:39.624730 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2669/5305] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 11 20:09:39.633955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:39.634809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:39.636634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:39.637503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:39.639498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:39.655038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-88c54a76-296b-46cc-bba5-9b2173493633 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:39.657314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-88c54a76-296b-46cc-bba5-9b2173493633 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:39.690842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88c54a76-296b-46cc-bba5-9b2173493633 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:39.692055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88c54a76-296b-46cc-bba5-9b2173493633 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:39.693978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88c54a76-296b-46cc-bba5-9b2173493633 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:39.696356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88c54a76-296b-46cc-bba5-9b2173493633 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:39.697646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88c54a76-296b-46cc-bba5-9b2173493633 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:39.698309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88c54a76-296b-46cc-bba5-9b2173493633 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:39.768214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:39.768718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:39.769172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:39.769638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lazy-loading 'fault' on Instance uuid 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:09:40.018144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:40.041149 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b74a7f26-a863-4b0d-9b73-592935c82a1b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 200 len: 1330 microversion: 2.1 time: 0.445970 Oct 11 20:09:40.067910 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2637/5306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:39 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 1330 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:41.071421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:41.073557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:41.090333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:41.094492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:41.095042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:41.096336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:41.096815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:41.099970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:41.108408 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-88c54a76-296b-46cc-bba5-9b2173493633 tempest-TestNetworkAdvancedServerOps-1403145486 tempest-TestNetworkAdvancedServerOps-1403145486-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1833 microversion: 2.1 time: 1.480401 Oct 11 20:09:41.110845 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2670/5307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:39 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1833 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:41.137954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-39b3ea21-7d89-4cdb-8c1a-bcee4db24acb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:41.138920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-39b3ea21-7d89-4cdb-8c1a-bcee4db24acb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:41.148565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39b3ea21-7d89-4cdb-8c1a-bcee4db24acb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:41.151626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39b3ea21-7d89-4cdb-8c1a-bcee4db24acb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:41.152239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39b3ea21-7d89-4cdb-8c1a-bcee4db24acb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:41.160328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39b3ea21-7d89-4cdb-8c1a-bcee4db24acb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:41.161190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39b3ea21-7d89-4cdb-8c1a-bcee4db24acb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:41.161826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-39b3ea21-7d89-4cdb-8c1a-bcee4db24acb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:41.162245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:09:41.166049 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c HTTP/1.1 Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c'} Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:09:41.181686 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:09:41.187608 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:09:41.187608 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:09:41.187608 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:09:41.187608 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:09:41.187608 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:09:41.187608 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:09:41.187608 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:09:41.204874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:09:41.217566 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3652bf59-b96d-4be9-afc3-f8a2a7332a63 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 404 len: 111 microversion: 2.1 time: 0.151432 Oct 11 20:09:41.229480 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2638/5308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:41 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:09:41.235994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-64501b58-2827-4443-bea4-9fba5873f0e0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '.version_select at 0x7f83cc1020d0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:41.264056 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-64501b58-2827-4443-bea4-9fba5873f0e0 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-284920473" status: 202 len: 0 microversion: 2.1 time: 0.032430 Oct 11 20:09:41.264827 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2639/5309] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 20:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-284920473 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:09:41.783139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-39b3ea21-7d89-4cdb-8c1a-bcee4db24acb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:41.807244 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-39b3ea21-7d89-4cdb-8c1a-bcee4db24acb tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1682 microversion: 2.1 time: 0.672881 Oct 11 20:09:41.823527 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2671/5310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:41 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1682 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:09:41.998810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11828f72-d5c4-4f23-8645-5d9c2ddf0623 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:42.000232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-11828f72-d5c4-4f23-8645-5d9c2ddf0623 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:42.017817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11828f72-d5c4-4f23-8645-5d9c2ddf0623 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:42.018731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11828f72-d5c4-4f23-8645-5d9c2ddf0623 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:42.020949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11828f72-d5c4-4f23-8645-5d9c2ddf0623 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:42.021895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11828f72-d5c4-4f23-8645-5d9c2ddf0623 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:42.024165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11828f72-d5c4-4f23-8645-5d9c2ddf0623 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:42.025068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11828f72-d5c4-4f23-8645-5d9c2ddf0623 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:42.142769 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11828f72-d5c4-4f23-8645-5d9c2ddf0623 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3/action" status: 200 len: 38592 microversion: 2.1 time: 0.148452 Oct 11 20:09:42.151571 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2640/5311] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:09:41 2022] POST /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3/action => generated 38592 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:09:44.277319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f4358caa-ec08-4ff6-afed-d9997f7e307e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: .version_select at 0x7f83c724d8b0>, body: {"keypair": {"name": "tempest-keypair-1571473760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWIvOZ1K3dGfPHt1y165YNAYA21h/lQFrpGfycdKVPfXeNCebVS3Djnyt3pPbfyLCsMfk+UTt7AJSaziFMeKsqjKDGArKY+LuUIcXj8YT0ltDlJwPiAIJ9RgZDyyS0LTA=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:44.303240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f4358caa-ec08-4ff6-afed-d9997f7e307e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:09:44.314785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f4358caa-ec08-4ff6-afed-d9997f7e307e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for user f4202e77bb27447ba5363091634d9731 and project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:09:44.368650 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f4358caa-ec08-4ff6-afed-d9997f7e307e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101140 Oct 11 20:09:44.369745 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2672/5312] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:09:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:45.649352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4129f1fd-b0ae-4ecf-b137-9c7c50f51351 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:45.650060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4129f1fd-b0ae-4ecf-b137-9c7c50f51351 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:45.665364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:09:45.676381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4129f1fd-b0ae-4ecf-b137-9c7c50f51351 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:45.678100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4129f1fd-b0ae-4ecf-b137-9c7c50f51351 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:45.678597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4129f1fd-b0ae-4ecf-b137-9c7c50f51351 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:45.681926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4129f1fd-b0ae-4ecf-b137-9c7c50f51351 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:45.684751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4129f1fd-b0ae-4ecf-b137-9c7c50f51351 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:45.685238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4129f1fd-b0ae-4ecf-b137-9c7c50f51351 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:45.753015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4129f1fd-b0ae-4ecf-b137-9c7c50f51351 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:09:45.950330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-cda282fa-6cbc-4865-bc02-4b1e79a28c87 req-d1a45931-6209-4609-9fa2-bb4174e407c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f7286d-3c5c-4f68-8e00-d6bacf31e6c3", "tag": "a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:45.973646 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4129f1fd-b0ae-4ecf-b137-9c7c50f51351 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 204 len: 0 microversion: 2.1 time: 0.328437 Oct 11 20:09:45.974857 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2641/5313] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:09:45 2022] DELETE /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:09:45.982272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cda282fa-6cbc-4865-bc02-4b1e79a28c87 req-d1a45931-6209-4609-9fa2-bb4174e407c9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:45.983513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cda282fa-6cbc-4865-bc02-4b1e79a28c87 req-d1a45931-6209-4609-9fa2-bb4174e407c9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:45.984549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cda282fa-6cbc-4865-bc02-4b1e79a28c87 req-d1a45931-6209-4609-9fa2-bb4174e407c9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:45.995878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-962d1881-787c-497a-b024-e616477403f4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:45.996625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-962d1881-787c-497a-b024-e616477403f4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:46.009841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-962d1881-787c-497a-b024-e616477403f4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:46.010342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-962d1881-787c-497a-b024-e616477403f4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:46.011669 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-cda282fa-6cbc-4865-bc02-4b1e79a28c87 req-d1a45931-6209-4609-9fa2-bb4174e407c9 service nova] Creating event network-changed:a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4 for instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 on n-h1-860864-3 Oct 11 20:09:46.015126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-962d1881-787c-497a-b024-e616477403f4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:46.016084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-962d1881-787c-497a-b024-e616477403f4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:46.016568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-962d1881-787c-497a-b024-e616477403f4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:46.017792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-962d1881-787c-497a-b024-e616477403f4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:46.025913 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-cda282fa-6cbc-4865-bc02-4b1e79a28c87 req-d1a45931-6209-4609-9fa2-bb4174e407c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344372 Oct 11 20:09:46.026951 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2673/5314] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:47.258455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-962d1881-787c-497a-b024-e616477403f4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:47.271192 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-962d1881-787c-497a-b024-e616477403f4 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1688 microversion: 2.1 time: 1.290406 Oct 11 20:09:47.273373 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2642/5315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:45 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1688 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:48.315699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c5adfb4c-da24-48b4-aaba-6a830a7ba225 req-1f5600ab-d10e-4a31-9384-22b39bee2883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f7286d-3c5c-4f68-8e00-d6bacf31e6c3", "name": "network-vif-deleted", "tag": "a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:48.317208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c66826f-40a6-40ab-8a51-8db362a4d7c1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:48.319174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c66826f-40a6-40ab-8a51-8db362a4d7c1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:48.343793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c5adfb4c-da24-48b4-aaba-6a830a7ba225 req-1f5600ab-d10e-4a31-9384-22b39bee2883 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:48.345394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c5adfb4c-da24-48b4-aaba-6a830a7ba225 req-1f5600ab-d10e-4a31-9384-22b39bee2883 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:48.346116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c5adfb4c-da24-48b4-aaba-6a830a7ba225 req-1f5600ab-d10e-4a31-9384-22b39bee2883 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:48.354289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c66826f-40a6-40ab-8a51-8db362a4d7c1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:48.355148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c66826f-40a6-40ab-8a51-8db362a4d7c1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:48.355733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c66826f-40a6-40ab-8a51-8db362a4d7c1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:48.356641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c66826f-40a6-40ab-8a51-8db362a4d7c1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:48.357397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c66826f-40a6-40ab-8a51-8db362a4d7c1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:48.358053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c66826f-40a6-40ab-8a51-8db362a4d7c1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:48.384877 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c5adfb4c-da24-48b4-aaba-6a830a7ba225 req-1f5600ab-d10e-4a31-9384-22b39bee2883 service nova] Creating event network-vif-deleted:a6a99daa-a3ca-4f31-883a-69fdd4fbc2b4 for instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 on n-h1-860864-3 Oct 11 20:09:48.393240 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c5adfb4c-da24-48b4-aaba-6a830a7ba225 req-1f5600ab-d10e-4a31-9384-22b39bee2883 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081993 Oct 11 20:09:48.396062 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2643/5316] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:48.539841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c66826f-40a6-40ab-8a51-8db362a4d7c1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:48.559943 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c66826f-40a6-40ab-8a51-8db362a4d7c1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 200 len: 1351 microversion: 2.1 time: 0.259541 Oct 11 20:09:48.560530 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2674/5317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:48 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 1351 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:49.186120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-688959760", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3044e01-188f-474d-8296-ce2a6945a204"}], "security_groups": [{"name": "tempest-securitygroup--936217147"}], "key_name": "tempest-keypair-1571473760", "user_data": "}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:49.381144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] validate_networks() for [('e3044e01-188f-474d-8296-ce2a6945a204', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:09:49.583932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:49.585133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:49.602282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:49.603001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:49.603598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:49.604456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:49.605164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:49.605758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:49.635128 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] HTTP exception thrown: Instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 could not be found. Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Request method failure captured: Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 HTTP/1.1 Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcuuQjfIszkyOtJSECoXLkoDQN-z4e4y6WzgPHiOSPLqH5SV-HvPoQdiMi_GwUDM2EltrUPWVnUG7Mw5CMaCpk0b-jW44fhL6WJJqofKREBBrNQ7WBjPWizW0ivaOVl1mT2-eDn57Y1mQoC_gVSHEDqQtnZgH9UL0JndxPnm8zhH4eU Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: abba65df7ef6403db3d5b466eb12fb94 Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abba65df7ef6403db3d5b466eb12fb94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abba65df7ef6403db3d5b466eb12fb94", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abba65df7ef6403db3d5b466eb12fb94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abba65df7ef6403db3d5b466eb12fb94"}]}] Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: abba65df7ef6403db3d5b466eb12fb94 Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestNetworkAdvancedServerOps-97175932-project Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: c3eaa8c79a0645fd93e6e3398426237f Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestNetworkAdvancedServerOps-97175932-project Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 could not be found. Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '32f7286d-3c5c-4f68-8e00-d6bacf31e6c3'} Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 could not be found. Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 could not be found. Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:09:49.637368 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:09:49.641168 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:09:49.641168 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:09:49.641168 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:09:49.641168 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:09:49.641168 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:09:49.641168 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:09:49.641168 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 could not be found. Oct 11 20:09:49.641168 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:09:49.642911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Returning 404 to user: Instance 32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:09:49.654011 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5ff0723-f603-4ec8-b8a8-cbfde14b5925 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3" status: 404 len: 111 microversion: 2.1 time: 0.074321 Oct 11 20:09:49.654860 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2675/5318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:49 2022] GET /compute/v2.1/servers/32f7286d-3c5c-4f68-8e00-d6bacf31e6c3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 20:09:50.641072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:09:50.641633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:09:50.641966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:09:50.642955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:09:50.643374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:09:50.662641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:50.663563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:50.664264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:50.664939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:50.665710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:50.666277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:50.717236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:09:50.724078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Getting quotas for user f4202e77bb27447ba5363091634d9731 and project f9aac6d81fae4d24aa3d0a7815f58e08. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:09:50.755859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:09:50.763233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:09:50.920970 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e2dcf2a8-f3c1-4259-bc17-9d325135f1b3 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.740314 Oct 11 20:09:50.929142 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2644/5319] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:09:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:09:50.934001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e65d7688-7661-478f-b50a-deddd49db202 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:50.934668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e65d7688-7661-478f-b50a-deddd49db202 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:51.045908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e65d7688-7661-478f-b50a-deddd49db202 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:51.090519 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e65d7688-7661-478f-b50a-deddd49db202 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1241 microversion: 2.1 time: 0.160321 Oct 11 20:09:51.091825 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2676/5320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:50 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1241 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:52.140611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c1bc16cd-db51-451a-ae49-d4f70bc0a49c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:52.141515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c1bc16cd-db51-451a-ae49-d4f70bc0a49c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:52.170805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1bc16cd-db51-451a-ae49-d4f70bc0a49c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:52.178246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1bc16cd-db51-451a-ae49-d4f70bc0a49c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:52.179406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1bc16cd-db51-451a-ae49-d4f70bc0a49c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:52.180535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1bc16cd-db51-451a-ae49-d4f70bc0a49c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:52.181296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1bc16cd-db51-451a-ae49-d4f70bc0a49c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:52.182157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1bc16cd-db51-451a-ae49-d4f70bc0a49c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:52.429289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c1bc16cd-db51-451a-ae49-d4f70bc0a49c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:52.484897 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c1bc16cd-db51-451a-ae49-d4f70bc0a49c tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1237 microversion: 2.1 time: 0.374211 Oct 11 20:09:52.489903 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2645/5321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:52 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1237 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:53.525178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78ddcd33-fbc3-4adb-959c-74229bba81fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:53.525844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78ddcd33-fbc3-4adb-959c-74229bba81fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:53.540521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ddcd33-fbc3-4adb-959c-74229bba81fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:53.542322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ddcd33-fbc3-4adb-959c-74229bba81fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:53.542322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ddcd33-fbc3-4adb-959c-74229bba81fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:53.546016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ddcd33-fbc3-4adb-959c-74229bba81fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:53.546785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ddcd33-fbc3-4adb-959c-74229bba81fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:53.548014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ddcd33-fbc3-4adb-959c-74229bba81fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:53.682186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78ddcd33-fbc3-4adb-959c-74229bba81fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:53.695742 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78ddcd33-fbc3-4adb-959c-74229bba81fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1299 microversion: 2.1 time: 0.175102 Oct 11 20:09:53.696251 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2677/5322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:53 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:54.731050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-60075ee5-6bc2-4881-974f-ba0b3148ca57 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:54.732829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-60075ee5-6bc2-4881-974f-ba0b3148ca57 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:54.781237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60075ee5-6bc2-4881-974f-ba0b3148ca57 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:54.781906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60075ee5-6bc2-4881-974f-ba0b3148ca57 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:54.783622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60075ee5-6bc2-4881-974f-ba0b3148ca57 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:54.786386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60075ee5-6bc2-4881-974f-ba0b3148ca57 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:54.787617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60075ee5-6bc2-4881-974f-ba0b3148ca57 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:54.788770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60075ee5-6bc2-4881-974f-ba0b3148ca57 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:54.971395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-60075ee5-6bc2-4881-974f-ba0b3148ca57 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:54.998023 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-60075ee5-6bc2-4881-974f-ba0b3148ca57 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1299 microversion: 2.1 time: 0.275812 Oct 11 20:09:55.013066 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2646/5323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:54 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1299 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:56.025511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c0edcb46-add9-4172-a9f2-a346fe862f32 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:56.027472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c0edcb46-add9-4172-a9f2-a346fe862f32 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:56.043902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0edcb46-add9-4172-a9f2-a346fe862f32 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:56.044416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0edcb46-add9-4172-a9f2-a346fe862f32 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:56.044857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0edcb46-add9-4172-a9f2-a346fe862f32 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:56.045574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0edcb46-add9-4172-a9f2-a346fe862f32 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:56.046032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0edcb46-add9-4172-a9f2-a346fe862f32 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:56.046450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0edcb46-add9-4172-a9f2-a346fe862f32 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:56.557254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c0edcb46-add9-4172-a9f2-a346fe862f32 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:56.567048 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c0edcb46-add9-4172-a9f2-a346fe862f32 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1366 microversion: 2.1 time: 0.545614 Oct 11 20:09:56.567641 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2678/5324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:56 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:57.591537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11a86042-b0f9-47f6-95d8-32e7274e7f3e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:57.592796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-11a86042-b0f9-47f6-95d8-32e7274e7f3e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:57.603897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a86042-b0f9-47f6-95d8-32e7274e7f3e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:57.609711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a86042-b0f9-47f6-95d8-32e7274e7f3e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:57.610984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a86042-b0f9-47f6-95d8-32e7274e7f3e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:57.611936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a86042-b0f9-47f6-95d8-32e7274e7f3e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:57.612549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a86042-b0f9-47f6-95d8-32e7274e7f3e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:57.614467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a86042-b0f9-47f6-95d8-32e7274e7f3e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:58.093258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11a86042-b0f9-47f6-95d8-32e7274e7f3e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:09:58.109022 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11a86042-b0f9-47f6-95d8-32e7274e7f3e tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1366 microversion: 2.1 time: 0.518574 Oct 11 20:09:58.110016 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2647/5325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:57 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1366 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:09:58.683997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8bac984b-9b51-4c7d-afb2-69c2b8a0c458 req-c4911127-f1c0-4ecd-97fb-67c93a9ddae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d898006-3538-4acc-ba7f-8cb528ba0159", "tag": "6c3c26d3-ee35-4786-a372-d0d775701cb9"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:09:58.713399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8bac984b-9b51-4c7d-afb2-69c2b8a0c458 req-c4911127-f1c0-4ecd-97fb-67c93a9ddae1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:58.713924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8bac984b-9b51-4c7d-afb2-69c2b8a0c458 req-c4911127-f1c0-4ecd-97fb-67c93a9ddae1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:58.714366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8bac984b-9b51-4c7d-afb2-69c2b8a0c458 req-c4911127-f1c0-4ecd-97fb-67c93a9ddae1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:58.755925 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8bac984b-9b51-4c7d-afb2-69c2b8a0c458 req-c4911127-f1c0-4ecd-97fb-67c93a9ddae1 service nova] Creating event network-changed:6c3c26d3-ee35-4786-a372-d0d775701cb9 for instance 5d898006-3538-4acc-ba7f-8cb528ba0159 on n-h1-860864-3 Oct 11 20:09:58.765538 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8bac984b-9b51-4c7d-afb2-69c2b8a0c458 req-c4911127-f1c0-4ecd-97fb-67c93a9ddae1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085936 Oct 11 20:09:58.765725 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2679/5326] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:09:59.142931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-580303af-eef5-494a-9ab2-b00913cc2cb6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:09:59.144228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-580303af-eef5-494a-9ab2-b00913cc2cb6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:09:59.174998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580303af-eef5-494a-9ab2-b00913cc2cb6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:59.181227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580303af-eef5-494a-9ab2-b00913cc2cb6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:59.182114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580303af-eef5-494a-9ab2-b00913cc2cb6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:09:59.183359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580303af-eef5-494a-9ab2-b00913cc2cb6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:09:59.183982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580303af-eef5-494a-9ab2-b00913cc2cb6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:09:59.184725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-580303af-eef5-494a-9ab2-b00913cc2cb6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:00.373770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-580303af-eef5-494a-9ab2-b00913cc2cb6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:00.393702 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-580303af-eef5-494a-9ab2-b00913cc2cb6 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1366 microversion: 2.1 time: 1.263721 Oct 11 20:10:00.398611 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2648/5327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:09:59 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1366 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:01.125303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:01.130199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c295e0ca-dc59-42d5-af43-dc4289c1d0f3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '.version_select at 0x7f83c710d940>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:01.153825 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c295e0ca-dc59-42d5-af43-dc4289c1d0f3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-669027188" status: 202 len: 0 microversion: 2.1 time: 0.030020 Oct 11 20:10:01.155122 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2680/5328] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 11 20:10:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-669027188 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:10:01.194887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6ed77314-ca2d-4459-974f-d11c92b5eac3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'create', calling method: .version_select at 0x7f83cc102670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-495900351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmACpqCvo49/j0KtiiEAzAvgxWtY1w5Dsb2K6Ddtdac/yKjBEL9ZbciwLBKR/Uc7xVYt5vQReaZq2yyZPQKMPNE7YpNJe8oh9sQTWBEQu3b+YUaIW9b6R5zfaTsrfSLVA=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:01.218001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:01.222303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:01.251789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6ed77314-ca2d-4459-974f-d11c92b5eac3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for project abba65df7ef6403db3d5b466eb12fb94. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:10:01.264960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6ed77314-ca2d-4459-974f-d11c92b5eac3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for user c3eaa8c79a0645fd93e6e3398426237f and project abba65df7ef6403db3d5b466eb12fb94. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:10:01.352236 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6ed77314-ca2d-4459-974f-d11c92b5eac3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.159149 Oct 11 20:10:01.359192 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2649/5329] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:10:01 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:10:01.420093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d624a143-cb61-48d8-8039-ee7d1167d285 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:01.420990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d624a143-cb61-48d8-8039-ee7d1167d285 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:01.424638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:01.440303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d624a143-cb61-48d8-8039-ee7d1167d285 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:01.440913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d624a143-cb61-48d8-8039-ee7d1167d285 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:01.441363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d624a143-cb61-48d8-8039-ee7d1167d285 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:01.442139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d624a143-cb61-48d8-8039-ee7d1167d285 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:01.442671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d624a143-cb61-48d8-8039-ee7d1167d285 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:01.443115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d624a143-cb61-48d8-8039-ee7d1167d285 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:01.473658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=73 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:01.928454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d624a143-cb61-48d8-8039-ee7d1167d285 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:01.938612 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d624a143-cb61-48d8-8039-ee7d1167d285 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1366 microversion: 2.1 time: 0.522657 Oct 11 20:10:01.940208 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2681/5330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:01 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1366 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:02.971586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-61da13e5-7ce4-4c67-95c8-1e7dfed2c6f2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:02.972323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-61da13e5-7ce4-4c67-95c8-1e7dfed2c6f2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:03.019697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61da13e5-7ce4-4c67-95c8-1e7dfed2c6f2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:03.019697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61da13e5-7ce4-4c67-95c8-1e7dfed2c6f2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:03.024820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61da13e5-7ce4-4c67-95c8-1e7dfed2c6f2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:03.029336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61da13e5-7ce4-4c67-95c8-1e7dfed2c6f2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:03.029854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61da13e5-7ce4-4c67-95c8-1e7dfed2c6f2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:03.036134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61da13e5-7ce4-4c67-95c8-1e7dfed2c6f2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:03.850085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-61da13e5-7ce4-4c67-95c8-1e7dfed2c6f2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:03.870047 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-61da13e5-7ce4-4c67-95c8-1e7dfed2c6f2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1366 microversion: 2.1 time: 0.899483 Oct 11 20:10:03.875350 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2650/5331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:02 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1366 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:04.900921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9f3c6eda-abef-42f8-be76-239f4ff31724 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:04.901600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9f3c6eda-abef-42f8-be76-239f4ff31724 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:04.932088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f3c6eda-abef-42f8-be76-239f4ff31724 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:04.932600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f3c6eda-abef-42f8-be76-239f4ff31724 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:04.933030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f3c6eda-abef-42f8-be76-239f4ff31724 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:04.933741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f3c6eda-abef-42f8-be76-239f4ff31724 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:04.934194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f3c6eda-abef-42f8-be76-239f4ff31724 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:04.934640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f3c6eda-abef-42f8-be76-239f4ff31724 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:04.978410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-d928d7a2-b7bc-4ec6-a789-38afbaf384d7 req-6fcc625b-fc7d-481d-8251-2591d03bbeb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d898006-3538-4acc-ba7f-8cb528ba0159", "name": "network-vif-plugged", "status": "completed", "tag": "6c3c26d3-ee35-4786-a372-d0d775701cb9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:05.022747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d928d7a2-b7bc-4ec6-a789-38afbaf384d7 req-6fcc625b-fc7d-481d-8251-2591d03bbeb7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:05.025496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d928d7a2-b7bc-4ec6-a789-38afbaf384d7 req-6fcc625b-fc7d-481d-8251-2591d03bbeb7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:05.029268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d928d7a2-b7bc-4ec6-a789-38afbaf384d7 req-6fcc625b-fc7d-481d-8251-2591d03bbeb7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:05.068657 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-d928d7a2-b7bc-4ec6-a789-38afbaf384d7 req-6fcc625b-fc7d-481d-8251-2591d03bbeb7 service nova] Creating event network-vif-plugged:6c3c26d3-ee35-4786-a372-d0d775701cb9 for instance 5d898006-3538-4acc-ba7f-8cb528ba0159 on n-h1-860864-3 Oct 11 20:10:05.085014 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-d928d7a2-b7bc-4ec6-a789-38afbaf384d7 req-6fcc625b-fc7d-481d-8251-2591d03bbeb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110094 Oct 11 20:10:05.090730 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2651/5332] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:05.519343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9f3c6eda-abef-42f8-be76-239f4ff31724 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:05.533604 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9f3c6eda-abef-42f8-be76-239f4ff31724 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1366 microversion: 2.1 time: 0.637873 Oct 11 20:10:05.536246 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2682/5333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:04 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1366 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:06.558707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51bde338-81f3-43f8-aea3-65893b8ecd7f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:06.559418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51bde338-81f3-43f8-aea3-65893b8ecd7f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:06.575661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bde338-81f3-43f8-aea3-65893b8ecd7f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:06.581314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bde338-81f3-43f8-aea3-65893b8ecd7f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:06.582049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bde338-81f3-43f8-aea3-65893b8ecd7f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:06.586026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bde338-81f3-43f8-aea3-65893b8ecd7f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:06.587569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bde338-81f3-43f8-aea3-65893b8ecd7f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:06.588210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bde338-81f3-43f8-aea3-65893b8ecd7f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:06.968323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51bde338-81f3-43f8-aea3-65893b8ecd7f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:06.978708 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51bde338-81f3-43f8-aea3-65893b8ecd7f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1556 microversion: 2.1 time: 0.424948 Oct 11 20:10:06.995217 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2652/5334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:06 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1556 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:07.021053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b535b372-4120-4147-bdba-e32fb089e59f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:07.021603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b535b372-4120-4147-bdba-e32fb089e59f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:07.034147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b535b372-4120-4147-bdba-e32fb089e59f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:07.034701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b535b372-4120-4147-bdba-e32fb089e59f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:07.035141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b535b372-4120-4147-bdba-e32fb089e59f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:07.035852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b535b372-4120-4147-bdba-e32fb089e59f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:07.036306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b535b372-4120-4147-bdba-e32fb089e59f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:07.036734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b535b372-4120-4147-bdba-e32fb089e59f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:07.326555 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b535b372-4120-4147-bdba-e32fb089e59f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.309612 Oct 11 20:10:07.336717 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2683/5335] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:10:07 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-interface => generated 284 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:11.566964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e55abbb0-429f-4bd2-8038-25e6758a7f83 req-4787674c-a823-42a2-a627-ee43fa0feade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d898006-3538-4acc-ba7f-8cb528ba0159", "tag": "6c3c26d3-ee35-4786-a372-d0d775701cb9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:11.580907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:11.591248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e55abbb0-429f-4bd2-8038-25e6758a7f83 req-4787674c-a823-42a2-a627-ee43fa0feade service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:11.591713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e55abbb0-429f-4bd2-8038-25e6758a7f83 req-4787674c-a823-42a2-a627-ee43fa0feade service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:11.592146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e55abbb0-429f-4bd2-8038-25e6758a7f83 req-4787674c-a823-42a2-a627-ee43fa0feade service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:11.604013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:11.625102 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e55abbb0-429f-4bd2-8038-25e6758a7f83 req-4787674c-a823-42a2-a627-ee43fa0feade service nova] Creating event network-changed:6c3c26d3-ee35-4786-a372-d0d775701cb9 for instance 5d898006-3538-4acc-ba7f-8cb528ba0159 on n-h1-860864-3 Oct 11 20:10:11.638107 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e55abbb0-429f-4bd2-8038-25e6758a7f83 req-4787674c-a823-42a2-a627-ee43fa0feade service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076023 Oct 11 20:10:11.639169 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2653/5336] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:16.485523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f366e014-6e34-4e9f-9962-573c9126c2e4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:16.487218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f366e014-6e34-4e9f-9962-573c9126c2e4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:16.496024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f366e014-6e34-4e9f-9962-573c9126c2e4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:16.499600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f366e014-6e34-4e9f-9962-573c9126c2e4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:16.500983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f366e014-6e34-4e9f-9962-573c9126c2e4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:16.504815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f366e014-6e34-4e9f-9962-573c9126c2e4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:16.505509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f366e014-6e34-4e9f-9962-573c9126c2e4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:16.506103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f366e014-6e34-4e9f-9962-573c9126c2e4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:16.571046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f366e014-6e34-4e9f-9962-573c9126c2e4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:10:16.784718 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f366e014-6e34-4e9f-9962-573c9126c2e4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 204 len: 0 microversion: 2.32 time: 0.583088 Oct 11 20:10:16.785470 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2684/5337] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:10:16 2022] DELETE /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:10:16.796433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:16.797412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:16.801692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:16.822493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:16.826374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:16.827098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:16.829032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:16.829726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:16.830640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:18.025965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-363936461", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "1cb89ee8-c58e-49f0-9c68-737e09902461"}], "key_name": "tempest-TestNetworkAdvancedServerOps-495900351", "security_groups": [{"name": "tempest-secgroup-smoke-483011899"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:18.184012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:18.205790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:18.215435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:18.222114 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-be386784-7cc7-435b-800c-e9237c878980 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2957 microversion: 2.32 time: 1.430812 Oct 11 20:10:18.223061 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2654/5338] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:16 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2957 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:18.361401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] validate_networks() for [('1cb89ee8-c58e-49f0-9c68-737e09902461', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:10:19.255211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:19.255919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:19.277418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:19.278224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:19.285568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:19.289290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:19.293083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:19.293632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:20.145031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:10:20.145788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:10:20.146385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:10:20.147414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:10:20.147914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:10:20.180220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:20.182208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:20.183738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:20.186073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:20.190319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:20.190814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:20.207840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:20.244119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for project abba65df7ef6403db3d5b466eb12fb94. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:10:20.251142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Getting quotas for user c3eaa8c79a0645fd93e6e3398426237f and project abba65df7ef6403db3d5b466eb12fb94. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:10:20.252015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:20.259908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:20.268995 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b88584d9-d8b1-4fc9-b0b0-c0f97f489c69 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2957 microversion: 2.32 time: 1.012012 Oct 11 20:10:20.270162 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2655/5339] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:19 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2957 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:10:20.288604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:10:20.291355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:10:20.314161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1286341524", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "aa23d8b3-2392-4585-9d37-afb0e5f3aa95"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:20.393502 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-59c07608-8056-4ffc-b807-c6ed6f2f2344 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.370737 Oct 11 20:10:20.412340 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2685/5340] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:10:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:10:20.439639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-90136c4a-d5aa-4bd9-8f49-72ae39fd4ada tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:20.440702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-90136c4a-d5aa-4bd9-8f49-72ae39fd4ada tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:20.493083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] validate_networks() for [('aa23d8b3-2392-4585-9d37-afb0e5f3aa95', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:10:21.427955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-90136c4a-d5aa-4bd9-8f49-72ae39fd4ada tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:21.435212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-90136c4a-d5aa-4bd9-8f49-72ae39fd4ada tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1265 microversion: 2.1 time: 1.012205 Oct 11 20:10:21.435802 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2686/5341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:20 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1265 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:10:21.469604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:21.471787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:21.488484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:21.489239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:21.489474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:21.492569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:21.497839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:21.498648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:22.399955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:22.418799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:22.426479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:22.431757 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-44ca84a3-23b6-4c16-ac35-292801bf84c5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2957 microversion: 2.32 time: 0.975672 Oct 11 20:10:22.435613 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2687/5342] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:21 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2957 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:22.463463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2e7dc6e-bea0-4df4-9ded-fbd8717ae30f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:22.464194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2e7dc6e-bea0-4df4-9ded-fbd8717ae30f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:22.475034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7dc6e-bea0-4df4-9ded-fbd8717ae30f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:22.478304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7dc6e-bea0-4df4-9ded-fbd8717ae30f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:22.478915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7dc6e-bea0-4df4-9ded-fbd8717ae30f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:22.479943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7dc6e-bea0-4df4-9ded-fbd8717ae30f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:22.481054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7dc6e-bea0-4df4-9ded-fbd8717ae30f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:22.482191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7dc6e-bea0-4df4-9ded-fbd8717ae30f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:22.767179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a2e7dc6e-bea0-4df4-9ded-fbd8717ae30f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:22.778034 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2e7dc6e-bea0-4df4-9ded-fbd8717ae30f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1335 microversion: 2.1 time: 0.319094 Oct 11 20:10:22.780626 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2688/5343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:22 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1335 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:22.799816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-482b5bf0-3c28-44a9-a1a2-a5ca9990e1d6 req-b5e817a7-0d9c-4871-b95a-8bd57c2eeead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-unplugged", "status": "completed", "tag": "2b9dfd70-7039-45c5-860c-01d7197e52b8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:22.844339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-482b5bf0-3c28-44a9-a1a2-a5ca9990e1d6 req-b5e817a7-0d9c-4871-b95a-8bd57c2eeead service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:22.847068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-482b5bf0-3c28-44a9-a1a2-a5ca9990e1d6 req-b5e817a7-0d9c-4871-b95a-8bd57c2eeead service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:22.847857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-482b5bf0-3c28-44a9-a1a2-a5ca9990e1d6 req-b5e817a7-0d9c-4871-b95a-8bd57c2eeead service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:22.866807 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-482b5bf0-3c28-44a9-a1a2-a5ca9990e1d6 req-b5e817a7-0d9c-4871-b95a-8bd57c2eeead service nova] Creating event network-vif-unplugged:2b9dfd70-7039-45c5-860c-01d7197e52b8 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:22.875010 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-482b5bf0-3c28-44a9-a1a2-a5ca9990e1d6 req-b5e817a7-0d9c-4871-b95a-8bd57c2eeead service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091673 Oct 11 20:10:22.876541 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2689/5344] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:23.479018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:23.480058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:23.498325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:23.498908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:23.500498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:23.501424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:23.502001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:23.502537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:23.677777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:10:23.678269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:10:23.679947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:10:23.680482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:10:23.680912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:10:23.714059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:23.716473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:23.717943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:23.719968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:23.721780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:23.723406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:23.770359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Getting quotas for project e558d5e4dc724afeb11be4338b8b5f32. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:10:23.790988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Getting quotas for user 18f1c791bcfe4111908938368c85db30 and project e558d5e4dc724afeb11be4338b8b5f32. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:10:23.838797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:10:23.850741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:10:24.018679 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b225a8eb-5421-4228-8ce2-511b11973d12 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.742656 Oct 11 20:10:24.021550 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2656/5345] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:10:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:10:24.042950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a20004cb-7878-45cb-8c90-aafec3cef452 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:24.043600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a20004cb-7878-45cb-8c90-aafec3cef452 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:24.134059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a20004cb-7878-45cb-8c90-aafec3cef452 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:24.140221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a20004cb-7878-45cb-8c90-aafec3cef452 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:24.145453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a20004cb-7878-45cb-8c90-aafec3cef452 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:24.159838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a20004cb-7878-45cb-8c90-aafec3cef452 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:24.160604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a20004cb-7878-45cb-8c90-aafec3cef452 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:24.166180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a20004cb-7878-45cb-8c90-aafec3cef452 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:24.693161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:24.739289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:24.751746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:24.756356 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c60ca143-83ea-4237-8466-1e73774892f5 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2936 microversion: 2.32 time: 1.291992 Oct 11 20:10:24.757154 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2690/5346] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:23 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2936 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:24.803234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4e714ad0-f4c2-4b6b-b8e7-338d2f069a1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:24.806302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4e714ad0-f4c2-4b6b-b8e7-338d2f069a1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:25.049412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a20004cb-7878-45cb-8c90-aafec3cef452 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:25.059104 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a20004cb-7878-45cb-8c90-aafec3cef452 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1390 microversion: 2.1 time: 1.036486 Oct 11 20:10:25.066383 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2657/5347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:24 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1390 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:25.074007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-15075bf6-ff26-4ae7-be02-4530d1a1e043 req-d5809942-5898-4af3-a3cc-01c154253da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-unplugged", "status": "completed", "tag": "d27720b2-53eb-4849-ad71-71c85b3b9502"}, {"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-unplugged", "status": "completed", "tag": "44a07f61-efb7-4155-a25a-5ce814a621c5"}, {"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-unplugged", "status": "completed", "tag": "c43aaecd-6f25-402d-af31-5703ca8f952b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:25.118240 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-15075bf6-ff26-4ae7-be02-4530d1a1e043 req-d5809942-5898-4af3-a3cc-01c154253da3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:25.121799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-15075bf6-ff26-4ae7-be02-4530d1a1e043 req-d5809942-5898-4af3-a3cc-01c154253da3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:25.122272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-15075bf6-ff26-4ae7-be02-4530d1a1e043 req-d5809942-5898-4af3-a3cc-01c154253da3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:25.172944 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-15075bf6-ff26-4ae7-be02-4530d1a1e043 req-d5809942-5898-4af3-a3cc-01c154253da3 service nova] Creating event network-vif-unplugged:d27720b2-53eb-4849-ad71-71c85b3b9502 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:25.173791 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-15075bf6-ff26-4ae7-be02-4530d1a1e043 req-d5809942-5898-4af3-a3cc-01c154253da3 service nova] Creating event network-vif-unplugged:44a07f61-efb7-4155-a25a-5ce814a621c5 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:25.174497 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-15075bf6-ff26-4ae7-be02-4530d1a1e043 req-d5809942-5898-4af3-a3cc-01c154253da3 service nova] Creating event network-vif-unplugged:c43aaecd-6f25-402d-af31-5703ca8f952b for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:25.186337 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-15075bf6-ff26-4ae7-be02-4530d1a1e043 req-d5809942-5898-4af3-a3cc-01c154253da3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.117885 Oct 11 20:10:25.190902 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2658/5348] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:25.240152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4e714ad0-f4c2-4b6b-b8e7-338d2f069a1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:25.253376 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4e714ad0-f4c2-4b6b-b8e7-338d2f069a1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1214 microversion: 2.1 time: 0.492858 Oct 11 20:10:25.257929 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2691/5349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:24 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1214 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:25.652048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-475d34c2-c1fb-4f38-9903-cbe1890655a9 req-3a778a8b-58b1-45c7-af95-0cc99cb54cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af77a9b-8b33-40fb-8ba8-6e8989653ec8", "tag": "5be60d4e-03fc-4532-a2dc-220e29167248"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:25.673395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-475d34c2-c1fb-4f38-9903-cbe1890655a9 req-3a778a8b-58b1-45c7-af95-0cc99cb54cf3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:25.674155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-475d34c2-c1fb-4f38-9903-cbe1890655a9 req-3a778a8b-58b1-45c7-af95-0cc99cb54cf3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:25.674774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-475d34c2-c1fb-4f38-9903-cbe1890655a9 req-3a778a8b-58b1-45c7-af95-0cc99cb54cf3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:25.691547 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-475d34c2-c1fb-4f38-9903-cbe1890655a9 req-3a778a8b-58b1-45c7-af95-0cc99cb54cf3 service nova] Creating event network-changed:5be60d4e-03fc-4532-a2dc-220e29167248 for instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 on n-h2-860864-3 Oct 11 20:10:25.698323 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-475d34c2-c1fb-4f38-9903-cbe1890655a9 req-3a778a8b-58b1-45c7-af95-0cc99cb54cf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061678 Oct 11 20:10:25.699666 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2659/5350] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:25.797193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:25.798519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:25.809761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:25.811401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:25.812623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:25.814835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:25.815804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:25.816496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:26.106724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f8525e63-689a-41b2-90f1-87507780d585 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:26.110451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f8525e63-689a-41b2-90f1-87507780d585 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:26.131420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8525e63-689a-41b2-90f1-87507780d585 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:26.132297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8525e63-689a-41b2-90f1-87507780d585 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:26.132985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8525e63-689a-41b2-90f1-87507780d585 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:26.134135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8525e63-689a-41b2-90f1-87507780d585 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:26.134885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8525e63-689a-41b2-90f1-87507780d585 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:26.136380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8525e63-689a-41b2-90f1-87507780d585 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:26.934917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:26.954640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:26.957441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:26.959018 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-44d4355e-6a2c-4a27-a43e-fbd883cb5ee7 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2936 microversion: 2.32 time: 1.166191 Oct 11 20:10:26.960091 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2692/5351] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:25 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2936 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:26.970121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f8525e63-689a-41b2-90f1-87507780d585 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:26.972399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cf323fdb-b8c4-44f6-91a1-9e062e8b3ff7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:26.974486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cf323fdb-b8c4-44f6-91a1-9e062e8b3ff7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:26.987466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf323fdb-b8c4-44f6-91a1-9e062e8b3ff7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:26.988188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf323fdb-b8c4-44f6-91a1-9e062e8b3ff7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:26.988813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf323fdb-b8c4-44f6-91a1-9e062e8b3ff7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:26.990896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf323fdb-b8c4-44f6-91a1-9e062e8b3ff7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:26.991098 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f8525e63-689a-41b2-90f1-87507780d585 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1390 microversion: 2.1 time: 0.888324 Oct 11 20:10:26.991715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf323fdb-b8c4-44f6-91a1-9e062e8b3ff7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:26.991978 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2660/5352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:26 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1390 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:10:26.992469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf323fdb-b8c4-44f6-91a1-9e062e8b3ff7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:27.086892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cf323fdb-b8c4-44f6-91a1-9e062e8b3ff7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:27.113366 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cf323fdb-b8c4-44f6-91a1-9e062e8b3ff7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1272 microversion: 2.1 time: 0.150368 Oct 11 20:10:27.114198 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2693/5353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:26 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:27.382001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-6cf2e431-9961-4246-9076-87e7a752becd req-59461985-252e-43e2-a0e8-e5d0762ad81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-unplugged", "status": "completed", "tag": "ac77e5e9-a5ab-4a34-b656-059e80fc5465"}, {"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-unplugged", "status": "completed", "tag": "6f0763b2-25ba-4ba9-b513-99fb41f73411"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:27.403766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6cf2e431-9961-4246-9076-87e7a752becd req-59461985-252e-43e2-a0e8-e5d0762ad81c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:27.404581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6cf2e431-9961-4246-9076-87e7a752becd req-59461985-252e-43e2-a0e8-e5d0762ad81c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:27.405262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6cf2e431-9961-4246-9076-87e7a752becd req-59461985-252e-43e2-a0e8-e5d0762ad81c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:27.429558 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6cf2e431-9961-4246-9076-87e7a752becd req-59461985-252e-43e2-a0e8-e5d0762ad81c service nova] Creating event network-vif-unplugged:ac77e5e9-a5ab-4a34-b656-059e80fc5465 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:27.431640 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6cf2e431-9961-4246-9076-87e7a752becd req-59461985-252e-43e2-a0e8-e5d0762ad81c service nova] Creating event network-vif-unplugged:6f0763b2-25ba-4ba9-b513-99fb41f73411 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:27.445456 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-6cf2e431-9961-4246-9076-87e7a752becd req-59461985-252e-43e2-a0e8-e5d0762ad81c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.067296 Oct 11 20:10:27.446353 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2661/5354] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:27.997551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:28.001152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:28.013361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:28.014193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:28.015706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:28.017444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:28.018277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:28.018941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:28.023094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c409749d-dedd-45ed-8449-a121733cc6e3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:28.023600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c409749d-dedd-45ed-8449-a121733cc6e3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:28.042417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c409749d-dedd-45ed-8449-a121733cc6e3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:28.043235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c409749d-dedd-45ed-8449-a121733cc6e3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:28.043832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c409749d-dedd-45ed-8449-a121733cc6e3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:28.044713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c409749d-dedd-45ed-8449-a121733cc6e3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:28.045310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c409749d-dedd-45ed-8449-a121733cc6e3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:28.045885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c409749d-dedd-45ed-8449-a121733cc6e3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:28.620305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:28.635745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:28.637343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:28.638938 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-673f2e49-0d0c-4cae-831a-6cf62a617fda tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2915 microversion: 2.32 time: 0.649090 Oct 11 20:10:28.654427 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2694/5355] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:27 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2915 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:28.654427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-098f6aa4-6fe9-43b5-a4f0-391e8e98e150 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:28.654427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-098f6aa4-6fe9-43b5-a4f0-391e8e98e150 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:28.667501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-098f6aa4-6fe9-43b5-a4f0-391e8e98e150 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:28.668253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-098f6aa4-6fe9-43b5-a4f0-391e8e98e150 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:28.668946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-098f6aa4-6fe9-43b5-a4f0-391e8e98e150 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:28.669996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-098f6aa4-6fe9-43b5-a4f0-391e8e98e150 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:28.670630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c409749d-dedd-45ed-8449-a121733cc6e3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:28.671415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-098f6aa4-6fe9-43b5-a4f0-391e8e98e150 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:28.672389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-098f6aa4-6fe9-43b5-a4f0-391e8e98e150 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:28.683852 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c409749d-dedd-45ed-8449-a121733cc6e3 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1390 microversion: 2.1 time: 0.665987 Oct 11 20:10:28.700717 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2662/5356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:28 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1390 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:10:29.519507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-3b1c394f-ede4-4fab-9d6e-15b5c681dc2e req-40c15183-0425-44d0-ba8d-902d43aecacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-deleted", "tag": "d27720b2-53eb-4849-ad71-71c85b3b9502"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:29.553714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3b1c394f-ede4-4fab-9d6e-15b5c681dc2e req-40c15183-0425-44d0-ba8d-902d43aecacc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:29.554201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3b1c394f-ede4-4fab-9d6e-15b5c681dc2e req-40c15183-0425-44d0-ba8d-902d43aecacc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:29.558786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3b1c394f-ede4-4fab-9d6e-15b5c681dc2e req-40c15183-0425-44d0-ba8d-902d43aecacc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:29.596589 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-3b1c394f-ede4-4fab-9d6e-15b5c681dc2e req-40c15183-0425-44d0-ba8d-902d43aecacc service nova] Creating event network-vif-deleted:d27720b2-53eb-4849-ad71-71c85b3b9502 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:29.618848 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-3b1c394f-ede4-4fab-9d6e-15b5c681dc2e req-40c15183-0425-44d0-ba8d-902d43aecacc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103463 Oct 11 20:10:29.620005 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2663/5357] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:29.646267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-098f6aa4-6fe9-43b5-a4f0-391e8e98e150 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:29.660862 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-098f6aa4-6fe9-43b5-a4f0-391e8e98e150 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1314 microversion: 2.1 time: 1.018240 Oct 11 20:10:29.675346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:29.676786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:29.681567 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2695/5358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:28 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1314 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:29.690566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:29.692765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:29.693397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:29.694799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:29.695519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:29.697831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:29.718888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c890030a-3a0a-40dc-8736-5919098867bd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:29.719825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c890030a-3a0a-40dc-8736-5919098867bd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:29.729340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c890030a-3a0a-40dc-8736-5919098867bd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:29.735369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c890030a-3a0a-40dc-8736-5919098867bd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:29.736081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c890030a-3a0a-40dc-8736-5919098867bd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:29.737031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c890030a-3a0a-40dc-8736-5919098867bd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:29.737656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c890030a-3a0a-40dc-8736-5919098867bd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:29.738245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c890030a-3a0a-40dc-8736-5919098867bd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:30.219523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:30.260476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:30.270378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:30.276156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:30.287565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c890030a-3a0a-40dc-8736-5919098867bd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:30.299637 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c890030a-3a0a-40dc-8736-5919098867bd tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1390 microversion: 2.1 time: 0.585293 Oct 11 20:10:30.300236 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2696/5359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:29 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1390 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:30.300483 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d74c2343-ce04-46c3-8bf6-08d016c66187 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2754 microversion: 2.32 time: 0.629048 Oct 11 20:10:30.323368 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2664/5360] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:29 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2754 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:30.338592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4aa3ff24-2a4f-4553-be39-7e03b3ee131e req-e0441225-50dc-4973-b4dd-211dd7c64d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8595de7d-b220-40d5-9971-35e441f80bb6", "tag": "60586701-239c-4594-8f71-3c93b5e88b60"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:30.361709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4aa3ff24-2a4f-4553-be39-7e03b3ee131e req-e0441225-50dc-4973-b4dd-211dd7c64d18 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:30.362956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4aa3ff24-2a4f-4553-be39-7e03b3ee131e req-e0441225-50dc-4973-b4dd-211dd7c64d18 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:30.363984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4aa3ff24-2a4f-4553-be39-7e03b3ee131e req-e0441225-50dc-4973-b4dd-211dd7c64d18 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:30.382605 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4aa3ff24-2a4f-4553-be39-7e03b3ee131e req-e0441225-50dc-4973-b4dd-211dd7c64d18 service nova] Creating event network-changed:60586701-239c-4594-8f71-3c93b5e88b60 for instance 8595de7d-b220-40d5-9971-35e441f80bb6 on n-h1-860864-3 Oct 11 20:10:30.391614 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4aa3ff24-2a4f-4553-be39-7e03b3ee131e req-e0441225-50dc-4973-b4dd-211dd7c64d18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065791 Oct 11 20:10:30.393781 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2697/5361] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:30.419751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-029d615c-f6ac-472d-a8c6-b275e988cda0 req-7db56b76-975c-437e-be46-ed967e75c344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af77a9b-8b33-40fb-8ba8-6e8989653ec8", "name": "network-vif-plugged", "status": "completed", "tag": "5be60d4e-03fc-4532-a2dc-220e29167248"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:30.442413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-029d615c-f6ac-472d-a8c6-b275e988cda0 req-7db56b76-975c-437e-be46-ed967e75c344 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:30.444495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-029d615c-f6ac-472d-a8c6-b275e988cda0 req-7db56b76-975c-437e-be46-ed967e75c344 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:30.446393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-029d615c-f6ac-472d-a8c6-b275e988cda0 req-7db56b76-975c-437e-be46-ed967e75c344 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:30.483454 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-029d615c-f6ac-472d-a8c6-b275e988cda0 req-7db56b76-975c-437e-be46-ed967e75c344 service nova] Creating event network-vif-plugged:5be60d4e-03fc-4532-a2dc-220e29167248 for instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 on n-h2-860864-3 Oct 11 20:10:30.491329 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-029d615c-f6ac-472d-a8c6-b275e988cda0 req-7db56b76-975c-437e-be46-ed967e75c344 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082886 Oct 11 20:10:30.492302 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2665/5362] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:30.689733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f468aba3-09f1-47cf-b9a0-a8c25bdc77a5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:30.690440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f468aba3-09f1-47cf-b9a0-a8c25bdc77a5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:30.703212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f468aba3-09f1-47cf-b9a0-a8c25bdc77a5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:30.703720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f468aba3-09f1-47cf-b9a0-a8c25bdc77a5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:30.704245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f468aba3-09f1-47cf-b9a0-a8c25bdc77a5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:30.705001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f468aba3-09f1-47cf-b9a0-a8c25bdc77a5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:30.705899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f468aba3-09f1-47cf-b9a0-a8c25bdc77a5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:30.706487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f468aba3-09f1-47cf-b9a0-a8c25bdc77a5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:31.072165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f468aba3-09f1-47cf-b9a0-a8c25bdc77a5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:31.087406 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f468aba3-09f1-47cf-b9a0-a8c25bdc77a5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1314 microversion: 2.1 time: 0.402256 Oct 11 20:10:31.089853 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2698/5363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:30 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:10:31.333662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-68617e6f-4599-48f1-adb0-fb57cc754187 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:31.340005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-68617e6f-4599-48f1-adb0-fb57cc754187 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:31.344718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:31.345643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:31.373026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:31.374467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:31.376131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68617e6f-4599-48f1-adb0-fb57cc754187 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:31.376280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:31.376909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:31.377598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:31.378875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68617e6f-4599-48f1-adb0-fb57cc754187 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:31.379986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:31.382750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68617e6f-4599-48f1-adb0-fb57cc754187 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:31.387164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68617e6f-4599-48f1-adb0-fb57cc754187 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:31.388607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68617e6f-4599-48f1-adb0-fb57cc754187 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:31.391982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68617e6f-4599-48f1-adb0-fb57cc754187 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:31.895511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:31.897814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:31.915995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:31.918417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68617e6f-4599-48f1-adb0-fb57cc754187 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:31.930793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:31.932897 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-68617e6f-4599-48f1-adb0-fb57cc754187 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1390 microversion: 2.1 time: 0.611692 Oct 11 20:10:31.934864 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2666/5364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:31 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1390 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:31.935422 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-944494f4-1584-4061-a157-764a8e020092 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2707 microversion: 2.32 time: 0.592374 Oct 11 20:10:31.940115 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2699/5365] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:31 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2707 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:10:31.951229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e696ba05-b17e-44d2-82ab-22e9c100d3ac req-84871421-fdd8-48d0-94db-1ce0946d3abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-deleted", "tag": "2b9dfd70-7039-45c5-860c-01d7197e52b8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:31.967726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e696ba05-b17e-44d2-82ab-22e9c100d3ac req-84871421-fdd8-48d0-94db-1ce0946d3abe service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:31.968315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e696ba05-b17e-44d2-82ab-22e9c100d3ac req-84871421-fdd8-48d0-94db-1ce0946d3abe service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:31.968846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e696ba05-b17e-44d2-82ab-22e9c100d3ac req-84871421-fdd8-48d0-94db-1ce0946d3abe service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:31.983363 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e696ba05-b17e-44d2-82ab-22e9c100d3ac req-84871421-fdd8-48d0-94db-1ce0946d3abe service nova] Creating event network-vif-deleted:2b9dfd70-7039-45c5-860c-01d7197e52b8 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:31.993642 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e696ba05-b17e-44d2-82ab-22e9c100d3ac req-84871421-fdd8-48d0-94db-1ce0946d3abe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055374 Oct 11 20:10:31.994817 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2667/5366] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:32.134181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a25a3f0-5839-4461-9bf2-16755b6498bb tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:32.142065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0a25a3f0-5839-4461-9bf2-16755b6498bb tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:32.148829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:32.166989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a25a3f0-5839-4461-9bf2-16755b6498bb tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:32.169033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a25a3f0-5839-4461-9bf2-16755b6498bb tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:32.169585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a25a3f0-5839-4461-9bf2-16755b6498bb tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:32.173092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a25a3f0-5839-4461-9bf2-16755b6498bb tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:32.175073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a25a3f0-5839-4461-9bf2-16755b6498bb tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:32.178830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a25a3f0-5839-4461-9bf2-16755b6498bb tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:32.651639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0a25a3f0-5839-4461-9bf2-16755b6498bb tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:32.667212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a25a3f0-5839-4461-9bf2-16755b6498bb tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1314 microversion: 2.1 time: 0.557913 Oct 11 20:10:32.669467 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2700/5367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:32 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:32.966068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fb4a36eb-b387-4c6a-b7b1-c957601a4475 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:32.967557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fb4a36eb-b387-4c6a-b7b1-c957601a4475 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:32.967692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:32.968517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:32.977596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4a36eb-b387-4c6a-b7b1-c957601a4475 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:32.979274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:32.979831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:32.980279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:32.981007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:32.981466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:32.981893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:32.985445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4a36eb-b387-4c6a-b7b1-c957601a4475 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:32.987298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4a36eb-b387-4c6a-b7b1-c957601a4475 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:32.988305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4a36eb-b387-4c6a-b7b1-c957601a4475 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:32.989306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4a36eb-b387-4c6a-b7b1-c957601a4475 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:32.990076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fb4a36eb-b387-4c6a-b7b1-c957601a4475 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:33.562211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fb4a36eb-b387-4c6a-b7b1-c957601a4475 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:33.574885 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fb4a36eb-b387-4c6a-b7b1-c957601a4475 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1562 microversion: 2.1 time: 0.618553 Oct 11 20:10:33.575495 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2668/5368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:32 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1562 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:33.598230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae267c3a-614c-4da6-962c-731e4b01f58c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:33.599128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae267c3a-614c-4da6-962c-731e4b01f58c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:33.606294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae267c3a-614c-4da6-962c-731e4b01f58c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:33.607146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae267c3a-614c-4da6-962c-731e4b01f58c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:33.607767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae267c3a-614c-4da6-962c-731e4b01f58c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:33.609362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae267c3a-614c-4da6-962c-731e4b01f58c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:33.610019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:33.610371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae267c3a-614c-4da6-962c-731e4b01f58c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:33.610987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae267c3a-614c-4da6-962c-731e4b01f58c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:33.644114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:33.652042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:33.654985 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-32499d98-ec3d-4eda-a463-b4f20e702689 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2455 microversion: 2.32 time: 0.691452 Oct 11 20:10:33.656951 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2701/5369] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:32 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2455 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:10:33.697570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ad22059-0264-4a21-a4b5-1ab5d1d65aae tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:33.698306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1ad22059-0264-4a21-a4b5-1ab5d1d65aae tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:33.709426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ad22059-0264-4a21-a4b5-1ab5d1d65aae tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:33.710634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ad22059-0264-4a21-a4b5-1ab5d1d65aae tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:33.711239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ad22059-0264-4a21-a4b5-1ab5d1d65aae tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:33.712234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ad22059-0264-4a21-a4b5-1ab5d1d65aae tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:33.712879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ad22059-0264-4a21-a4b5-1ab5d1d65aae tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:33.713504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ad22059-0264-4a21-a4b5-1ab5d1d65aae tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:33.752649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:33.820721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:34.359021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ae267c3a-614c-4da6-962c-731e4b01f58c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:34.370631 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ae267c3a-614c-4da6-962c-731e4b01f58c tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1562 microversion: 2.1 time: 0.776078 Oct 11 20:10:34.382617 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2669/5370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:33 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1562 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:10:34.394269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c1959a21-2289-4202-8df3-c8499f5cd303 req-4dd2607d-417f-45f4-b9c9-069a3943c058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-deleted", "tag": "ac77e5e9-a5ab-4a34-b656-059e80fc5465"}, {"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-deleted", "tag": "44a07f61-efb7-4155-a25a-5ce814a621c5"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:34.404639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1ad22059-0264-4a21-a4b5-1ab5d1d65aae tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:34.418717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c1959a21-2289-4202-8df3-c8499f5cd303 req-4dd2607d-417f-45f4-b9c9-069a3943c058 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:34.419997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c1959a21-2289-4202-8df3-c8499f5cd303 req-4dd2607d-417f-45f4-b9c9-069a3943c058 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:34.423612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c1959a21-2289-4202-8df3-c8499f5cd303 req-4dd2607d-417f-45f4-b9c9-069a3943c058 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:34.423775 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1ad22059-0264-4a21-a4b5-1ab5d1d65aae tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1314 microversion: 2.1 time: 0.729893 Oct 11 20:10:34.424264 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2702/5371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:33 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:34.446753 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c1959a21-2289-4202-8df3-c8499f5cd303 req-4dd2607d-417f-45f4-b9c9-069a3943c058 service nova] Creating event network-vif-deleted:ac77e5e9-a5ab-4a34-b656-059e80fc5465 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:34.447493 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c1959a21-2289-4202-8df3-c8499f5cd303 req-4dd2607d-417f-45f4-b9c9-069a3943c058 service nova] Creating event network-vif-deleted:44a07f61-efb7-4155-a25a-5ce814a621c5 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:34.457400 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c1959a21-2289-4202-8df3-c8499f5cd303 req-4dd2607d-417f-45f4-b9c9-069a3943c058 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073107 Oct 11 20:10:34.459745 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2670/5372] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:34.686417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:34.687572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:34.705599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:34.705599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:34.705599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:34.705599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:34.705599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:34.705599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:35.010876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e0d4ad22-b451-4648-9a40-161e193c30e1 req-2212ee2e-ab17-4cdd-af24-9caedf268f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8595de7d-b220-40d5-9971-35e441f80bb6", "name": "network-vif-plugged", "status": "completed", "tag": "60586701-239c-4594-8f71-3c93b5e88b60"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:35.032131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e0d4ad22-b451-4648-9a40-161e193c30e1 req-2212ee2e-ab17-4cdd-af24-9caedf268f21 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:35.033010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e0d4ad22-b451-4648-9a40-161e193c30e1 req-2212ee2e-ab17-4cdd-af24-9caedf268f21 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:35.033648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e0d4ad22-b451-4648-9a40-161e193c30e1 req-2212ee2e-ab17-4cdd-af24-9caedf268f21 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:35.062840 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e0d4ad22-b451-4648-9a40-161e193c30e1 req-2212ee2e-ab17-4cdd-af24-9caedf268f21 service nova] Creating event network-vif-plugged:60586701-239c-4594-8f71-3c93b5e88b60 for instance 8595de7d-b220-40d5-9971-35e441f80bb6 on n-h1-860864-3 Oct 11 20:10:35.078674 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e0d4ad22-b451-4648-9a40-161e193c30e1 req-2212ee2e-ab17-4cdd-af24-9caedf268f21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065906 Oct 11 20:10:35.080097 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2671/5373] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:35.247836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=10 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:35.290695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:35.306906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:35.309408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:35.314303 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1de3dc3d-9722-468d-a0e4-1edcb47aefdd tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 2159 microversion: 2.32 time: 0.632902 Oct 11 20:10:35.334333 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2703/5374] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:34 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 2159 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:35.447398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d91c3a63-82e5-47a8-91b7-1be6c7b9a431 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:35.448861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d91c3a63-82e5-47a8-91b7-1be6c7b9a431 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:35.455443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91c3a63-82e5-47a8-91b7-1be6c7b9a431 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:35.456154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91c3a63-82e5-47a8-91b7-1be6c7b9a431 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:35.456779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91c3a63-82e5-47a8-91b7-1be6c7b9a431 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:35.457633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91c3a63-82e5-47a8-91b7-1be6c7b9a431 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:35.458378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91c3a63-82e5-47a8-91b7-1be6c7b9a431 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:35.458979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d91c3a63-82e5-47a8-91b7-1be6c7b9a431 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:35.877936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d91c3a63-82e5-47a8-91b7-1be6c7b9a431 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:35.891679 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d91c3a63-82e5-47a8-91b7-1be6c7b9a431 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1314 microversion: 2.1 time: 0.447907 Oct 11 20:10:35.892300 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2672/5375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:35 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:36.351286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:36.352690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:36.363035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:36.377545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:36.379138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:36.381976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:36.382967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:36.383621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:36.488925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7156ede8-4e59-44d4-a17b-14223caa9445 req-827e7ff1-02de-4d8d-bf19-95624de451bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69977b40-6339-45a2-8389-a8eb35391387", "name": "network-vif-deleted", "tag": "6f0763b2-25ba-4ba9-b513-99fb41f73411"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:36.507847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7156ede8-4e59-44d4-a17b-14223caa9445 req-827e7ff1-02de-4d8d-bf19-95624de451bc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:36.508685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7156ede8-4e59-44d4-a17b-14223caa9445 req-827e7ff1-02de-4d8d-bf19-95624de451bc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:36.510447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7156ede8-4e59-44d4-a17b-14223caa9445 req-827e7ff1-02de-4d8d-bf19-95624de451bc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:36.540653 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7156ede8-4e59-44d4-a17b-14223caa9445 req-827e7ff1-02de-4d8d-bf19-95624de451bc service nova] Creating event network-vif-deleted:6f0763b2-25ba-4ba9-b513-99fb41f73411 for instance 69977b40-6339-45a2-8389-a8eb35391387 on n-h2-860864-3 Oct 11 20:10:36.556629 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7156ede8-4e59-44d4-a17b-14223caa9445 req-827e7ff1-02de-4d8d-bf19-95624de451bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071310 Oct 11 20:10:36.557781 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2673/5376] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:10:36.576754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:36.593543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:36.595287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:36.603739 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e50cc57c-8d43-4fcc-b0e0-d8e7f816a2f9 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.256723 Oct 11 20:10:36.604248 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2704/5377] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:36 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:36.921868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-316e42e5-dd8f-423a-9ce0-06ad11e92166 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:36.922693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-316e42e5-dd8f-423a-9ce0-06ad11e92166 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:36.936832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-316e42e5-dd8f-423a-9ce0-06ad11e92166 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:36.939509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-316e42e5-dd8f-423a-9ce0-06ad11e92166 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:36.939969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-316e42e5-dd8f-423a-9ce0-06ad11e92166 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:36.940708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-316e42e5-dd8f-423a-9ce0-06ad11e92166 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:36.941177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-316e42e5-dd8f-423a-9ce0-06ad11e92166 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:36.941605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-316e42e5-dd8f-423a-9ce0-06ad11e92166 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:37.449957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-316e42e5-dd8f-423a-9ce0-06ad11e92166 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:37.467409 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-316e42e5-dd8f-423a-9ce0-06ad11e92166 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1499 microversion: 2.1 time: 0.547301 Oct 11 20:10:37.490180 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2674/5378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:36 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1499 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:37.632663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:37.634863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:37.662843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:37.663350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:37.663802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:37.671731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:37.672291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:37.672746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:37.841635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:37.885658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:37.890865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:37.892128 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e526ebbf-4713-4e7c-b2a8-776204e011c1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.264297 Oct 11 20:10:37.896428 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2705/5379] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:37 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:38.399972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5bf12cc3-1384-406f-9ade-8367423fff39 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:38.400611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5bf12cc3-1384-406f-9ade-8367423fff39 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:38.410791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bf12cc3-1384-406f-9ade-8367423fff39 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:38.412342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bf12cc3-1384-406f-9ade-8367423fff39 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:38.413082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bf12cc3-1384-406f-9ade-8367423fff39 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:38.415319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bf12cc3-1384-406f-9ade-8367423fff39 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:38.417142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bf12cc3-1384-406f-9ade-8367423fff39 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:38.419226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bf12cc3-1384-406f-9ade-8367423fff39 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:38.501459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5bf12cc3-1384-406f-9ade-8367423fff39 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:10:38.634159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:38.687775 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5bf12cc3-1384-406f-9ade-8367423fff39 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 204 len: 0 microversion: 2.1 time: 0.292765 Oct 11 20:10:38.689406 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2675/5380] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:10:38 2022] DELETE /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:10:38.699308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9300cfea-a429-4cce-8042-4f22e30f67d5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:38.699940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9300cfea-a429-4cce-8042-4f22e30f67d5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:38.708117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9300cfea-a429-4cce-8042-4f22e30f67d5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:38.708606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9300cfea-a429-4cce-8042-4f22e30f67d5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:38.712169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9300cfea-a429-4cce-8042-4f22e30f67d5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:38.713792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9300cfea-a429-4cce-8042-4f22e30f67d5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:38.714268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9300cfea-a429-4cce-8042-4f22e30f67d5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:38.714734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9300cfea-a429-4cce-8042-4f22e30f67d5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:38.925660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:38.926721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:38.977219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:38.980953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:38.984222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:38.987477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:38.990258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:38.993860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:39.191641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9300cfea-a429-4cce-8042-4f22e30f67d5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:39.209270 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9300cfea-a429-4cce-8042-4f22e30f67d5 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1505 microversion: 2.1 time: 0.510713 Oct 11 20:10:39.210164 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2706/5381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:38 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:39.273541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:39.294226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:39.298478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:39.306923 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cb07868e-5a2d-45fd-89bd-ffa5ece23458 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.389042 Oct 11 20:10:39.307892 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2676/5382] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:38 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:10:40.243872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5f703f9-9979-40fa-a27c-f120b61dc14e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:40.244540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b5f703f9-9979-40fa-a27c-f120b61dc14e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:40.260561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5f703f9-9979-40fa-a27c-f120b61dc14e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:40.264814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5f703f9-9979-40fa-a27c-f120b61dc14e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:40.266294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5f703f9-9979-40fa-a27c-f120b61dc14e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:40.275260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5f703f9-9979-40fa-a27c-f120b61dc14e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:40.276302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5f703f9-9979-40fa-a27c-f120b61dc14e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:40.276952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5f703f9-9979-40fa-a27c-f120b61dc14e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:40.334789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:40.335680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:40.348823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:40.349425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:40.350188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:40.352479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:40.353660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:40.354385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:40.755188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:40.768720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:40.771179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:40.772754 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-94075d50-6bce-443f-8310-d898cb575231 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.442767 Oct 11 20:10:40.791680 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2677/5383] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:40 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:40.856056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f199fb47-df1a-4413-82e4-76797d34a4fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:40.856725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f199fb47-df1a-4413-82e4-76797d34a4fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:40.869319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f199fb47-df1a-4413-82e4-76797d34a4fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:40.870218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f199fb47-df1a-4413-82e4-76797d34a4fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:40.870884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f199fb47-df1a-4413-82e4-76797d34a4fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:40.871819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f199fb47-df1a-4413-82e4-76797d34a4fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:40.872471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f199fb47-df1a-4413-82e4-76797d34a4fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:40.873093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f199fb47-df1a-4413-82e4-76797d34a4fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:40.921400 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f199fb47-df1a-4413-82e4-76797d34a4fc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/ips" status: 200 len: 149 microversion: 2.1 time: 0.068790 Oct 11 20:10:40.928759 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2678/5384] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:10:40 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/ips => generated 149 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:10:40.989364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b5f703f9-9979-40fa-a27c-f120b61dc14e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:40.997275 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b5f703f9-9979-40fa-a27c-f120b61dc14e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1505 microversion: 2.1 time: 0.759289 Oct 11 20:10:41.002471 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2707/5385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:40 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1505 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:41.616484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6e635111-a0fd-4ec2-9764-79cf60813cc9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:41.617127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6e635111-a0fd-4ec2-9764-79cf60813cc9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:41.620482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-e9e35991-6220-4162-9847-b07591b4ebca req-2c5884b3-19c4-430f-ae39-607d618697bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af77a9b-8b33-40fb-8ba8-6e8989653ec8", "tag": "5be60d4e-03fc-4532-a2dc-220e29167248"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:41.648463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e635111-a0fd-4ec2-9764-79cf60813cc9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:41.649012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e635111-a0fd-4ec2-9764-79cf60813cc9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:41.649469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e635111-a0fd-4ec2-9764-79cf60813cc9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:41.658827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e635111-a0fd-4ec2-9764-79cf60813cc9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:41.659353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e635111-a0fd-4ec2-9764-79cf60813cc9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:41.661189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e9e35991-6220-4162-9847-b07591b4ebca req-2c5884b3-19c4-430f-ae39-607d618697bd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:41.662946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e9e35991-6220-4162-9847-b07591b4ebca req-2c5884b3-19c4-430f-ae39-607d618697bd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:41.663675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e635111-a0fd-4ec2-9764-79cf60813cc9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:41.664259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e9e35991-6220-4162-9847-b07591b4ebca req-2c5884b3-19c4-430f-ae39-607d618697bd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:41.702453 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-e9e35991-6220-4162-9847-b07591b4ebca req-2c5884b3-19c4-430f-ae39-607d618697bd service nova] Creating event network-changed:5be60d4e-03fc-4532-a2dc-220e29167248 for instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 on n-h2-860864-3 Oct 11 20:10:41.717037 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-e9e35991-6220-4162-9847-b07591b4ebca req-2c5884b3-19c4-430f-ae39-607d618697bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100307 Oct 11 20:10:41.719014 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2708/5386] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:10:41.804276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:41.805127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:41.819552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:41.827473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:41.830727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:41.832823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:41.838105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:41.841543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:42.112107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:42.151821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:42.167203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:42.176225 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-120b6216-5bd4-4fd2-a718-fc2905684b9b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.376143 Oct 11 20:10:42.183296 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2709/5387] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:41 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:10:42.206391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8f1f5fbe-46af-445f-9062-eadf6cde161f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:42.206943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8f1f5fbe-46af-445f-9062-eadf6cde161f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:42.256777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1f5fbe-46af-445f-9062-eadf6cde161f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:42.257305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1f5fbe-46af-445f-9062-eadf6cde161f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:42.259332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1f5fbe-46af-445f-9062-eadf6cde161f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:42.262376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1f5fbe-46af-445f-9062-eadf6cde161f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:42.273361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1f5fbe-46af-445f-9062-eadf6cde161f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:42.275314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1f5fbe-46af-445f-9062-eadf6cde161f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:42.376805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6e635111-a0fd-4ec2-9764-79cf60813cc9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:42.387900 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6e635111-a0fd-4ec2-9764-79cf60813cc9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1562 microversion: 2.1 time: 0.776319 Oct 11 20:10:42.393232 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2679/5388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:41 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1562 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:42.722794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8f1f5fbe-46af-445f-9062-eadf6cde161f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:42.751780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5201e6f7-b929-490b-906a-e55f2663c831 req-3f790238-5b05-487a-a953-51e9e9ef4a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8595de7d-b220-40d5-9971-35e441f80bb6", "name": "network-vif-deleted", "tag": "60586701-239c-4594-8f71-3c93b5e88b60"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:42.757207 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8f1f5fbe-46af-445f-9062-eadf6cde161f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 200 len: 1463 microversion: 2.1 time: 0.571576 Oct 11 20:10:42.760787 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2710/5389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:42 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 1463 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:42.799919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5201e6f7-b929-490b-906a-e55f2663c831 req-3f790238-5b05-487a-a953-51e9e9ef4a91 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:42.800421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5201e6f7-b929-490b-906a-e55f2663c831 req-3f790238-5b05-487a-a953-51e9e9ef4a91 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:42.800974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5201e6f7-b929-490b-906a-e55f2663c831 req-3f790238-5b05-487a-a953-51e9e9ef4a91 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:42.886674 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5201e6f7-b929-490b-906a-e55f2663c831 req-3f790238-5b05-487a-a953-51e9e9ef4a91 service nova] Creating event network-vif-deleted:60586701-239c-4594-8f71-3c93b5e88b60 for instance 8595de7d-b220-40d5-9971-35e441f80bb6 on n-h1-860864-3 Oct 11 20:10:42.915484 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5201e6f7-b929-490b-906a-e55f2663c831 req-3f790238-5b05-487a-a953-51e9e9ef4a91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168839 Oct 11 20:10:42.917818 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2680/5390] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:10:43.208759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:43.211227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:43.222855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:43.224853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:43.227032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:43.227946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:43.229787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:43.230381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:43.542190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:43.560283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:43.564724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:43.568223 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a4506740-9d4d-4295-bd2f-43eaefbba2eb tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.363947 Oct 11 20:10:43.570092 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2711/5391] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:43 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:43.792230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:43.793116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 8595de7d-b220-40d5-9971-35e441f80bb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:43.832566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:43.842779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:43.849675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:43.852619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:43.853815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:43.854832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:43.907254 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] HTTP exception thrown: Instance 8595de7d-b220-40d5-9971-35e441f80bb6 could not be found. Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Request method failure captured: Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 HTTP/1.1 Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc2oaE47wLntIb7miovCAFG89iwCx1fTuRCxcbmSqQpPxKUv6vgtndX5XCFt9J4DqhTulyxsvghQVE4UqZ7z8Cck5_qYdE1EU_aJ-sT7GLQZdZzERkAiifyorffytyGsNSQfiyYnw4oJHQFnTHYYYAPFdBvFiCmmSPf0O9cBSJcnOtA Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: e558d5e4dc724afeb11be4338b8b5f32 Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesActionsTest-1039039908 Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e558d5e4dc724afeb11be4338b8b5f32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e558d5e4dc724afeb11be4338b8b5f32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e558d5e4dc724afeb11be4338b8b5f32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e558d5e4dc724afeb11be4338b8b5f32"}]}] Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesActionsTest-1039039908 Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: e558d5e4dc724afeb11be4338b8b5f32 Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesActionsTest-1039039908 Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesActionsTest-1039039908-project Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 18f1c791bcfe4111908938368c85db30 Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesActionsTest-1039039908-project Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 8595de7d-b220-40d5-9971-35e441f80bb6 could not be found. Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '8595de7d-b220-40d5-9971-35e441f80bb6'} Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8595de7d-b220-40d5-9971-35e441f80bb6 could not be found. Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8595de7d-b220-40d5-9971-35e441f80bb6 could not be found. Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:10:43.928366 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:10:43.933000 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:10:43.933000 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:10:43.933000 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:10:43.933000 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:10:43.933000 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:10:43.933000 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8595de7d-b220-40d5-9971-35e441f80bb6 could not be found. Oct 11 20:10:43.933000 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:10:43.936287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Returning 404 to user: Instance 8595de7d-b220-40d5-9971-35e441f80bb6 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:10:43.948026 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1cb854b8-79fe-492f-b077-093ac462b8bd tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6" status: 404 len: 111 microversion: 2.1 time: 0.160290 Oct 11 20:10:43.949821 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2681/5392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:43 2022] GET /compute/v2.1/servers/8595de7d-b220-40d5-9971-35e441f80bb6 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:10:44.304413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-694194162", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "aa23d8b3-2392-4585-9d37-afb0e5f3aa95"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:44.403988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] validate_networks() for [('aa23d8b3-2392-4585-9d37-afb0e5f3aa95', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:10:44.598038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:44.599448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:44.611025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:44.618580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:44.619236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:44.620082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:44.620660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:44.621170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:44.728212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:44.741697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:44.745320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:44.750422 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-12a3d732-438d-4f11-8a2e-5e0ebb5cd02b tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.155740 Oct 11 20:10:44.751670 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2682/5393] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:44 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:10:45.111106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:10:45.111776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:10:45.112409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:10:45.113129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:10:45.113966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:10:45.116760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5404ccb5-8804-409b-a1f3-bdab6afb4924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f17b712-a4b9-457e-9486-208651a2096d"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:45.120126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5404ccb5-8804-409b-a1f3-bdab6afb4924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:45.126659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:45.128191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:45.128783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:45.129693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:45.130489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:45.131121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:45.136181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5404ccb5-8804-409b-a1f3-bdab6afb4924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:45.137182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5404ccb5-8804-409b-a1f3-bdab6afb4924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:45.138552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5404ccb5-8804-409b-a1f3-bdab6afb4924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:45.139752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5404ccb5-8804-409b-a1f3-bdab6afb4924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:45.144224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5404ccb5-8804-409b-a1f3-bdab6afb4924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:45.145564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5404ccb5-8804-409b-a1f3-bdab6afb4924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:45.153257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Getting quotas for project e558d5e4dc724afeb11be4338b8b5f32. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:10:45.160299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Getting quotas for user 18f1c791bcfe4111908938368c85db30 and project e558d5e4dc724afeb11be4338b8b5f32. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:10:45.175734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:10:45.179005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:10:45.238309 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5b2de80-42dc-4215-8d74-f6d18396d2ee tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937810 Oct 11 20:10:45.246882 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2712/5394] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:10:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:10:45.260001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e8650736-5d1b-4832-b99c-3fe4f66a5424 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:45.261377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e8650736-5d1b-4832-b99c-3fe4f66a5424 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:45.537880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e8650736-5d1b-4832-b99c-3fe4f66a5424 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:45.549864 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e8650736-5d1b-4832-b99c-3fe4f66a5424 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1213 microversion: 2.1 time: 0.300238 Oct 11 20:10:45.552452 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2713/5395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:45 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1213 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:45.780966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:45.781926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:45.795077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:45.797088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:45.797867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:45.801612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:45.803817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:45.804436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:45.983932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:46.004018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:46.011329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:46.015688 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6beb887b-90c1-4dac-b55b-1e3d68858e81 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.236859 Oct 11 20:10:46.020691 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2714/5396] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:45 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:46.121080 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5404ccb5-8804-409b-a1f3-bdab6afb4924 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "POST /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.007843 Oct 11 20:10:46.134836 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2683/5397] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:10:45 2022] POST /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 194 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:46.582150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a93e42d-acc1-4656-9ab2-a9ed20e28d38 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:46.584018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a93e42d-acc1-4656-9ab2-a9ed20e28d38 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:46.608894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93e42d-acc1-4656-9ab2-a9ed20e28d38 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:46.609711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93e42d-acc1-4656-9ab2-a9ed20e28d38 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:46.610354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93e42d-acc1-4656-9ab2-a9ed20e28d38 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:46.613301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93e42d-acc1-4656-9ab2-a9ed20e28d38 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:46.613867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93e42d-acc1-4656-9ab2-a9ed20e28d38 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:46.614381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a93e42d-acc1-4656-9ab2-a9ed20e28d38 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:46.784150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a93e42d-acc1-4656-9ab2-a9ed20e28d38 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:46.796336 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a93e42d-acc1-4656-9ab2-a9ed20e28d38 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1209 microversion: 2.1 time: 0.225270 Oct 11 20:10:46.797905 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2715/5398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:46 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1209 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:47.051902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:47.052537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:47.070960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:47.081494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:47.082216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:47.082849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:47.083828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:47.085668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:47.086280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:47.332536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:47.363146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:47.368704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:47.374808 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cdef01d7-2aee-48b0-96fe-e53bd53f0ec8 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.329041 Oct 11 20:10:47.375178 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2684/5399] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:47 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:10:47.827141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6a46eef-2512-4d75-9557-8083807c308b tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:47.828437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b6a46eef-2512-4d75-9557-8083807c308b tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:47.845544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6a46eef-2512-4d75-9557-8083807c308b tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:47.846096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6a46eef-2512-4d75-9557-8083807c308b tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:47.846568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6a46eef-2512-4d75-9557-8083807c308b tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:47.847321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6a46eef-2512-4d75-9557-8083807c308b tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:47.847868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6a46eef-2512-4d75-9557-8083807c308b tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:47.848212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6a46eef-2512-4d75-9557-8083807c308b tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:48.059523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b6a46eef-2512-4d75-9557-8083807c308b tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:48.075169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b6a46eef-2512-4d75-9557-8083807c308b tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1271 microversion: 2.1 time: 0.254548 Oct 11 20:10:48.075786 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2716/5400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:47 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:48.409204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:48.409764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:48.456839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:48.458396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:48.459224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:48.460112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:48.465721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:48.469382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:48.600102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:48.610913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:48.612702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:48.614253 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2fe77fe6-89e5-4156-9dee-fb9809cc2325 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.213952 Oct 11 20:10:48.615399 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2685/5401] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:48 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:49.100584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2e7531ba-2aea-402a-8be8-0e3bbe0eb4c0 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:49.101832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2e7531ba-2aea-402a-8be8-0e3bbe0eb4c0 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:49.112048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e7531ba-2aea-402a-8be8-0e3bbe0eb4c0 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:49.113345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e7531ba-2aea-402a-8be8-0e3bbe0eb4c0 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:49.113954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e7531ba-2aea-402a-8be8-0e3bbe0eb4c0 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:49.116038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e7531ba-2aea-402a-8be8-0e3bbe0eb4c0 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:49.116690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e7531ba-2aea-402a-8be8-0e3bbe0eb4c0 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:49.117635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e7531ba-2aea-402a-8be8-0e3bbe0eb4c0 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:49.301391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2e7531ba-2aea-402a-8be8-0e3bbe0eb4c0 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:49.316883 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2e7531ba-2aea-402a-8be8-0e3bbe0eb4c0 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1313 microversion: 2.1 time: 0.220749 Oct 11 20:10:49.318610 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2717/5402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:49 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:49.648756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:49.650058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:49.665927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:49.666764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:49.667734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:49.669387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:49.670218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:49.671418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:49.827444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:49.840885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:49.844313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:49.851987 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-706dcb08-e5ef-486c-a5c0-3ff54622d5c6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.213071 Oct 11 20:10:49.857163 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2686/5403] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:49 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:50.340886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6d6522f-be80-4d45-9c78-e96ba4978162 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:50.341495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b6d6522f-be80-4d45-9c78-e96ba4978162 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:50.354781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d6522f-be80-4d45-9c78-e96ba4978162 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:50.355794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d6522f-be80-4d45-9c78-e96ba4978162 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:50.356836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d6522f-be80-4d45-9c78-e96ba4978162 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:50.359173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d6522f-be80-4d45-9c78-e96ba4978162 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:50.360173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d6522f-be80-4d45-9c78-e96ba4978162 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:50.362934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6d6522f-be80-4d45-9c78-e96ba4978162 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:50.654092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b6d6522f-be80-4d45-9c78-e96ba4978162 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:50.658446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:50.675030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b6d6522f-be80-4d45-9c78-e96ba4978162 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1313 microversion: 2.1 time: 0.337972 Oct 11 20:10:50.681415 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2718/5404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:50 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:50.682927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-bf9542f0-4415-475e-bdb4-8cf13e75b5a4 req-100d7492-bba7-437d-9b05-4b98e67e1444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7502b593-7de6-4b8f-80e0-a34bff7e50f1", "tag": "70fb6216-dafa-43e6-9451-272ed36afcd6"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:50.703355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bf9542f0-4415-475e-bdb4-8cf13e75b5a4 req-100d7492-bba7-437d-9b05-4b98e67e1444 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:50.707736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bf9542f0-4415-475e-bdb4-8cf13e75b5a4 req-100d7492-bba7-437d-9b05-4b98e67e1444 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:50.708297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bf9542f0-4415-475e-bdb4-8cf13e75b5a4 req-100d7492-bba7-437d-9b05-4b98e67e1444 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:50.725460 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-bf9542f0-4415-475e-bdb4-8cf13e75b5a4 req-100d7492-bba7-437d-9b05-4b98e67e1444 service nova] Creating event network-changed:70fb6216-dafa-43e6-9451-272ed36afcd6 for instance 7502b593-7de6-4b8f-80e0-a34bff7e50f1 on n-h1-860864-3 Oct 11 20:10:50.755447 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-bf9542f0-4415-475e-bdb4-8cf13e75b5a4 req-100d7492-bba7-437d-9b05-4b98e67e1444 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076255 Oct 11 20:10:50.756558 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2687/5405] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:50.886096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:50.887242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:50.903523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:50.904063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:50.904736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:50.907646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:50.908133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:50.910837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:51.164656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:51.177828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:51.179763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:51.184033 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa8e0f63-3c5c-4f38-93ed-f2f085047014 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.308755 Oct 11 20:10:51.187711 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2719/5406] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:50 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:10:51.699704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d0fadd8d-6c06-43a8-8974-226732b6b32c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:51.702448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d0fadd8d-6c06-43a8-8974-226732b6b32c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:51.720379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0fadd8d-6c06-43a8-8974-226732b6b32c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:51.721120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0fadd8d-6c06-43a8-8974-226732b6b32c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:51.721750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0fadd8d-6c06-43a8-8974-226732b6b32c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:51.722943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0fadd8d-6c06-43a8-8974-226732b6b32c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:51.723826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0fadd8d-6c06-43a8-8974-226732b6b32c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:51.724424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0fadd8d-6c06-43a8-8974-226732b6b32c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:52.038515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d0fadd8d-6c06-43a8-8974-226732b6b32c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:52.052825 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d0fadd8d-6c06-43a8-8974-226732b6b32c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1313 microversion: 2.1 time: 0.358510 Oct 11 20:10:52.056615 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2688/5407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:51 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:52.217050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:52.217783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:52.243821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:52.244369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:52.248224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:52.249031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:52.249712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:52.250171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:52.383701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:52.405496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:52.407053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:52.408305 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ec0a470e-5fc2-4872-a639-8db4bc5a74d2 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.195320 Oct 11 20:10:52.414418 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2720/5408] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:52 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:53.080540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b91f49f-5b26-4a2d-8adb-bb0d1da29a9c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:53.082455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b91f49f-5b26-4a2d-8adb-bb0d1da29a9c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:53.110483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b91f49f-5b26-4a2d-8adb-bb0d1da29a9c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:53.111015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b91f49f-5b26-4a2d-8adb-bb0d1da29a9c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:53.111456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b91f49f-5b26-4a2d-8adb-bb0d1da29a9c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:53.113097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b91f49f-5b26-4a2d-8adb-bb0d1da29a9c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:53.118061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b91f49f-5b26-4a2d-8adb-bb0d1da29a9c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:53.119104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b91f49f-5b26-4a2d-8adb-bb0d1da29a9c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:53.447448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:53.448584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:53.471960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b91f49f-5b26-4a2d-8adb-bb0d1da29a9c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:53.496626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:53.497165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:53.497281 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b91f49f-5b26-4a2d-8adb-bb0d1da29a9c tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1313 microversion: 2.1 time: 0.422223 Oct 11 20:10:53.511695 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2689/5409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:53 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:53.512205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:53.512205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:53.512205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:53.512205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:53.605286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:53.633009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:53.634586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:53.636083 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d4cbde66-5e64-4056-a519-ff60710801d1 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.198209 Oct 11 20:10:53.637210 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2721/5410] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:53 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:10:54.526046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f3ecf79f-4499-43ca-87d8-354f09aa8481 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:54.526870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f3ecf79f-4499-43ca-87d8-354f09aa8481 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:54.542177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ecf79f-4499-43ca-87d8-354f09aa8481 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:54.544526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ecf79f-4499-43ca-87d8-354f09aa8481 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:54.545087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ecf79f-4499-43ca-87d8-354f09aa8481 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:54.545842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ecf79f-4499-43ca-87d8-354f09aa8481 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:54.546329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ecf79f-4499-43ca-87d8-354f09aa8481 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:54.550138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3ecf79f-4499-43ca-87d8-354f09aa8481 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:54.667073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:54.667702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:54.681444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:54.682064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:54.682515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:54.684318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:54.686462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:54.687652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:54.846969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:54.864215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:54.866832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:54.871549 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4cb5989e-f6bb-4a15-aaec-90461d3fa00c tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.209755 Oct 11 20:10:54.872161 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2722/5411] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:54 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:55.065038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f3ecf79f-4499-43ca-87d8-354f09aa8481 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:55.081211 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f3ecf79f-4499-43ca-87d8-354f09aa8481 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1313 microversion: 2.1 time: 0.559899 Oct 11 20:10:55.096494 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2690/5412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:54 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:55.899228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:55.900554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:55.902743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:55.903635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:55.919271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:55.920304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:55.926479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:55.927456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:55.928100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:55.928704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:56.105680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:56.113724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8fb05cf3-8012-438b-b171-e867650825b4 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:56.114950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8fb05cf3-8012-438b-b171-e867650825b4 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:56.137827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:56.143410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fb05cf3-8012-438b-b171-e867650825b4 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:56.143918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fb05cf3-8012-438b-b171-e867650825b4 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:56.144731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:56.146001 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-22dd3e3b-b416-4753-b82d-2d3ad8495488 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.251152 Oct 11 20:10:56.147162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fb05cf3-8012-438b-b171-e867650825b4 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:56.148545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fb05cf3-8012-438b-b171-e867650825b4 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:56.148942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fb05cf3-8012-438b-b171-e867650825b4 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:56.149380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fb05cf3-8012-438b-b171-e867650825b4 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:56.150868 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2723/5413] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:55 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:56.433186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8fb05cf3-8012-438b-b171-e867650825b4 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:56.449650 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8fb05cf3-8012-438b-b171-e867650825b4 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1313 microversion: 2.1 time: 0.348646 Oct 11 20:10:56.451097 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2691/5414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:56 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:57.179613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:57.181788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:57.193347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:57.194105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:57.201382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:57.202271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:57.203362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:57.203921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:57.315571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:57.328257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:57.330055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:57.334125 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f715d313-7874-48ac-833e-c1635a50eb10 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.160425 Oct 11 20:10:57.337576 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2724/5415] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:57 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:57.474353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e698d75e-a940-45cc-abbd-bc6c8ea3d504 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:57.475662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e698d75e-a940-45cc-abbd-bc6c8ea3d504 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:57.485069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e698d75e-a940-45cc-abbd-bc6c8ea3d504 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:57.486018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e698d75e-a940-45cc-abbd-bc6c8ea3d504 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:57.486749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e698d75e-a940-45cc-abbd-bc6c8ea3d504 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:57.487875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e698d75e-a940-45cc-abbd-bc6c8ea3d504 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:57.495017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e698d75e-a940-45cc-abbd-bc6c8ea3d504 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:57.495802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e698d75e-a940-45cc-abbd-bc6c8ea3d504 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:57.658631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-330107fe-68b3-41df-9576-3b758cc7bc97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:57.661598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-330107fe-68b3-41df-9576-3b758cc7bc97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:57.686483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330107fe-68b3-41df-9576-3b758cc7bc97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:57.687397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330107fe-68b3-41df-9576-3b758cc7bc97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:57.688330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330107fe-68b3-41df-9576-3b758cc7bc97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:57.690451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330107fe-68b3-41df-9576-3b758cc7bc97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:57.691258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330107fe-68b3-41df-9576-3b758cc7bc97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:57.692017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-330107fe-68b3-41df-9576-3b758cc7bc97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:57.790445 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-330107fe-68b3-41df-9576-3b758cc7bc97 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8/action" status: 200 len: 24565 microversion: 2.1 time: 0.136723 Oct 11 20:10:57.791861 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2725/5416] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:10:57 2022] POST /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8/action => generated 24565 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:10:57.910389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e698d75e-a940-45cc-abbd-bc6c8ea3d504 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:57.919506 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e698d75e-a940-45cc-abbd-bc6c8ea3d504 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1313 microversion: 2.1 time: 0.449957 Oct 11 20:10:57.934255 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2692/5417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:57 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:58.364836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:58.365590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:58.385354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:58.386689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:58.387413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:58.388177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:58.389969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:58.391292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:58.512429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:58.529516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:58.531660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:58.533736 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4ae5f594-d18d-4d94-8bd2-e5fbd38295a6 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.174912 Oct 11 20:10:58.538889 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2726/5418] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:58 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:10:58.947961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cefe888e-aa24-496d-aa98-4283e73c9cc7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:58.948731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cefe888e-aa24-496d-aa98-4283e73c9cc7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:58.961285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefe888e-aa24-496d-aa98-4283e73c9cc7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:58.963655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefe888e-aa24-496d-aa98-4283e73c9cc7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:58.964218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefe888e-aa24-496d-aa98-4283e73c9cc7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:58.969888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefe888e-aa24-496d-aa98-4283e73c9cc7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:58.971151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefe888e-aa24-496d-aa98-4283e73c9cc7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:58.972319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cefe888e-aa24-496d-aa98-4283e73c9cc7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:58.979186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:10:59.140477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fd3af725-1094-4ca1-adf2-50c67240cafb req-281a1929-aedb-4a91-ac91-743ecb4fa4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502b593-7de6-4b8f-80e0-a34bff7e50f1", "name": "network-vif-plugged", "status": "completed", "tag": "70fb6216-dafa-43e6-9451-272ed36afcd6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:10:59.158824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fd3af725-1094-4ca1-adf2-50c67240cafb req-281a1929-aedb-4a91-ac91-743ecb4fa4b0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:59.159668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fd3af725-1094-4ca1-adf2-50c67240cafb req-281a1929-aedb-4a91-ac91-743ecb4fa4b0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:59.160367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fd3af725-1094-4ca1-adf2-50c67240cafb req-281a1929-aedb-4a91-ac91-743ecb4fa4b0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:59.175262 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fd3af725-1094-4ca1-adf2-50c67240cafb req-281a1929-aedb-4a91-ac91-743ecb4fa4b0 service nova] Creating event network-vif-plugged:70fb6216-dafa-43e6-9451-272ed36afcd6 for instance 7502b593-7de6-4b8f-80e0-a34bff7e50f1 on n-h1-860864-3 Oct 11 20:10:59.181548 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fd3af725-1094-4ca1-adf2-50c67240cafb req-281a1929-aedb-4a91-ac91-743ecb4fa4b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047236 Oct 11 20:10:59.182211 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2727/5419] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:10:59.242360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cefe888e-aa24-496d-aa98-4283e73c9cc7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:59.254710 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cefe888e-aa24-496d-aa98-4283e73c9cc7 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1313 microversion: 2.1 time: 0.310973 Oct 11 20:10:59.255427 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2693/5420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:10:58 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:10:59.562453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:10:59.563470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:10:59.577371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:59.577881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:59.578333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:59.579102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:10:59.579552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:10:59.580000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:10:59.799730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:59.818009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:59.819932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:10:59.821279 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6cfb488d-5dd6-4101-90d0-d262ea2e656a tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1605 microversion: 2.32 time: 0.265225 Oct 11 20:10:59.835618 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2728/5421] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:10:59 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1605 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:11:00.278660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1c2e0726-826b-4954-8f04-d8da0b7e9109 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:00.280474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1c2e0726-826b-4954-8f04-d8da0b7e9109 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:00.295597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c2e0726-826b-4954-8f04-d8da0b7e9109 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:00.299749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c2e0726-826b-4954-8f04-d8da0b7e9109 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:00.300490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c2e0726-826b-4954-8f04-d8da0b7e9109 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:00.301436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c2e0726-826b-4954-8f04-d8da0b7e9109 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:00.305787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c2e0726-826b-4954-8f04-d8da0b7e9109 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:00.306648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c2e0726-826b-4954-8f04-d8da0b7e9109 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:00.740890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1c2e0726-826b-4954-8f04-d8da0b7e9109 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:00.755147 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1c2e0726-826b-4954-8f04-d8da0b7e9109 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1313 microversion: 2.1 time: 0.480176 Oct 11 20:11:00.769874 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2694/5422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:00 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:00.851299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:00.851915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:00.863518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:00.864212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:00.864482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:00.866326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:00.866781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:00.867216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:00.961026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:00.962692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:00.964299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:00.965460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lazy-loading 'fault' on Instance uuid 69977b40-6339-45a2-8389-a8eb35391387 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:11:01.217158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:01.256397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:01.258572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e46a1f1cb2445588c04964d140825f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e99631a5809b4f3ab73232f4940a6722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:01.308786 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1080f0f9-bff8-4267-8f4b-72e680def9fc tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 200 len: 1610 microversion: 2.32 time: 0.461534 Oct 11 20:11:01.319268 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2729/5423] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:11:00 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 1610 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:11:01.795660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0c4dab63-e227-4dab-b22c-2a14074f924e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:01.797257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0c4dab63-e227-4dab-b22c-2a14074f924e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:01.817454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4dab63-e227-4dab-b22c-2a14074f924e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:01.818576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4dab63-e227-4dab-b22c-2a14074f924e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:01.821977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4dab63-e227-4dab-b22c-2a14074f924e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:01.826009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4dab63-e227-4dab-b22c-2a14074f924e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:01.828782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4dab63-e227-4dab-b22c-2a14074f924e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:01.829995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c4dab63-e227-4dab-b22c-2a14074f924e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:02.327099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0c4dab63-e227-4dab-b22c-2a14074f924e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:02.341095 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0c4dab63-e227-4dab-b22c-2a14074f924e tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1497 microversion: 2.1 time: 0.550040 Oct 11 20:11:02.346409 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2695/5424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:01 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1497 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:02.356295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:02.357981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:02.361872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:11:02.381650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:02.383689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:02.384369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:02.388654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:02.389395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:02.390022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:02.429860 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] HTTP exception thrown: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Request method failure captured: Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 HTTP/1.1 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcwv0DpXxJ3LA6x9I4gg2yyl3yS5427ji0o91A7ezT5y1cwkKk64B1YVB8RAab5UsSHwR8e3xTJBFwqVQicaHEK3H0WDnmniz3ZxFnGLIP2w5IKHj5rvBarmd09W6ZZsrYkfU8credi-Bywnb8D4rqkPaCRNjW8p3aRnTVxkQMnyX70 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: e99631a5809b4f3ab73232f4940a6722 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TaggedBootDevicesTest-1002301992 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e99631a5809b4f3ab73232f4940a6722"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e99631a5809b4f3ab73232f4940a6722", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e99631a5809b4f3ab73232f4940a6722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e99631a5809b4f3ab73232f4940a6722"}]}] Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TaggedBootDevicesTest-1002301992 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: e99631a5809b4f3ab73232f4940a6722 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1002301992 Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TaggedBootDevicesTest-1002301992-project Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 09e46a1f1cb2445588c04964d140825f Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TaggedBootDevicesTest-1002301992-project Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '69977b40-6339-45a2-8389-a8eb35391387'} Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:02.438101 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:02.443231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:02.443231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:02.443231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:02.443231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:02.443231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:02.443231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:02.443231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:02.443231 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:02.444947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Returning 404 to user: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:02.446223 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-03b5e400-5b4d-4be5-8b0f-c61061b7eeed tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 404 len: 111 microversion: 2.32 time: 0.094421 Oct 11 20:11:02.451330 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2730/5425] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:11:02 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:11:02.457999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93a33f35-e014-465d-8c3b-80f95baf09f4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '.version_select at 0x7f83d069faf0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:02.506237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93a33f35-e014-465d-8c3b-80f95baf09f4 tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029063671" status: 204 len: 0 microversion: 2.32 time: 0.053743 Oct 11 20:11:02.512173 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2696/5426] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 11 20:11:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029063671 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:11:03.485198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-59515f9c-e6f6-441f-91d8-a905d4c49a5f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:03.486296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59515f9c-e6f6-441f-91d8-a905d4c49a5f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:03.499607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59515f9c-e6f6-441f-91d8-a905d4c49a5f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:03.501588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59515f9c-e6f6-441f-91d8-a905d4c49a5f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:03.502084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59515f9c-e6f6-441f-91d8-a905d4c49a5f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:03.504290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59515f9c-e6f6-441f-91d8-a905d4c49a5f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:03.506316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59515f9c-e6f6-441f-91d8-a905d4c49a5f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:03.506978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59515f9c-e6f6-441f-91d8-a905d4c49a5f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:03.555598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59515f9c-e6f6-441f-91d8-a905d4c49a5f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:11:03.811945 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-59515f9c-e6f6-441f-91d8-a905d4c49a5f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 204 len: 0 microversion: 2.1 time: 0.331754 Oct 11 20:11:03.812876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2731/5427] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:11:03 2022] DELETE /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:11:03.824723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec8d387f-0846-4b6d-abbe-68f680899c1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:03.825388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ec8d387f-0846-4b6d-abbe-68f680899c1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:03.854259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec8d387f-0846-4b6d-abbe-68f680899c1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:03.861074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec8d387f-0846-4b6d-abbe-68f680899c1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:03.861788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec8d387f-0846-4b6d-abbe-68f680899c1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:03.880790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec8d387f-0846-4b6d-abbe-68f680899c1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:03.881656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec8d387f-0846-4b6d-abbe-68f680899c1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:03.885462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec8d387f-0846-4b6d-abbe-68f680899c1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:04.207530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:11:04.211021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:04.223601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:04.224391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:04.225009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:04.225892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:04.226505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:04.227105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:04.324883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:11:04.326386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:11:04.327318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:11:04.327927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:11:04.328500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:11:04.414418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:04.422009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:04.422705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:04.423290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:04.424154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:04.424753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:04.425333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:04.503604 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-387ca1d9-cbec-4180-bb9a-2ba3609eb932 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8/action" status: 202 len: 1136 microversion: 2.1 time: 0.300960 Oct 11 20:11:04.514516 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2732/5428] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:11:04 2022] POST /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8/action => generated 1136 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 20:11:04.528114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4b9a9c7e-ef27-442d-abe3-a3d24779d803 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:04.530928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4b9a9c7e-ef27-442d-abe3-a3d24779d803 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:04.544582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c7e-ef27-442d-abe3-a3d24779d803 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:04.545436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c7e-ef27-442d-abe3-a3d24779d803 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:04.546139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c7e-ef27-442d-abe3-a3d24779d803 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:04.547107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c7e-ef27-442d-abe3-a3d24779d803 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:04.548179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c7e-ef27-442d-abe3-a3d24779d803 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:04.548763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c7e-ef27-442d-abe3-a3d24779d803 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:04.611729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:11:04.912666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec8d387f-0846-4b6d-abbe-68f680899c1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:04.928789 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ec8d387f-0846-4b6d-abbe-68f680899c1d tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1503 microversion: 2.1 time: 1.108975 Oct 11 20:11:04.929922 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2697/5429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:03 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1503 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:11:05.230661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4b9a9c7e-ef27-442d-abe3-a3d24779d803 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:05.238780 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4b9a9c7e-ef27-442d-abe3-a3d24779d803 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1689 microversion: 2.1 time: 0.718769 Oct 11 20:11:05.247849 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2733/5430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:04 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1689 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:11:05.957997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-41f66a0d-d5e4-4d80-a59b-2eeaa3ef0d78 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:05.963338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-41f66a0d-d5e4-4d80-a59b-2eeaa3ef0d78 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:05.981762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41f66a0d-d5e4-4d80-a59b-2eeaa3ef0d78 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:05.982773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41f66a0d-d5e4-4d80-a59b-2eeaa3ef0d78 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:05.983435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41f66a0d-d5e4-4d80-a59b-2eeaa3ef0d78 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:05.984336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41f66a0d-d5e4-4d80-a59b-2eeaa3ef0d78 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:05.984991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41f66a0d-d5e4-4d80-a59b-2eeaa3ef0d78 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:05.985655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-41f66a0d-d5e4-4d80-a59b-2eeaa3ef0d78 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:06.272056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0c419ed9-adcd-4469-a7c2-eef316a38d3a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:06.272823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0c419ed9-adcd-4469-a7c2-eef316a38d3a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:06.295071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c419ed9-adcd-4469-a7c2-eef316a38d3a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:06.297780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c419ed9-adcd-4469-a7c2-eef316a38d3a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:06.300392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c419ed9-adcd-4469-a7c2-eef316a38d3a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:06.308063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c419ed9-adcd-4469-a7c2-eef316a38d3a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:06.308755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c419ed9-adcd-4469-a7c2-eef316a38d3a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:06.320426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-41f66a0d-d5e4-4d80-a59b-2eeaa3ef0d78 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f1c791bcfe4111908938368c85db30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558d5e4dc724afeb11be4338b8b5f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:06.334261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0c419ed9-adcd-4469-a7c2-eef316a38d3a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:06.339205 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-41f66a0d-d5e4-4d80-a59b-2eeaa3ef0d78 tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 200 len: 1461 microversion: 2.1 time: 0.384991 Oct 11 20:11:06.354554 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2698/5431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:05 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 1461 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:06.377073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f343a7bc-3c05-457b-80f0-136f8e6b1d65 req-ffe92eeb-84ac-44d4-b095-b057aad1e60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502b593-7de6-4b8f-80e0-a34bff7e50f1", "name": "network-vif-deleted", "tag": "70fb6216-dafa-43e6-9451-272ed36afcd6"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:11:06.413903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f343a7bc-3c05-457b-80f0-136f8e6b1d65 req-ffe92eeb-84ac-44d4-b095-b057aad1e60e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:06.414702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f343a7bc-3c05-457b-80f0-136f8e6b1d65 req-ffe92eeb-84ac-44d4-b095-b057aad1e60e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:06.415408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f343a7bc-3c05-457b-80f0-136f8e6b1d65 req-ffe92eeb-84ac-44d4-b095-b057aad1e60e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:06.445273 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f343a7bc-3c05-457b-80f0-136f8e6b1d65 req-ffe92eeb-84ac-44d4-b095-b057aad1e60e service nova] Creating event network-vif-deleted:70fb6216-dafa-43e6-9451-272ed36afcd6 for instance 7502b593-7de6-4b8f-80e0-a34bff7e50f1 on n-h1-860864-3 Oct 11 20:11:06.452514 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f343a7bc-3c05-457b-80f0-136f8e6b1d65 req-ffe92eeb-84ac-44d4-b095-b057aad1e60e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097450 Oct 11 20:11:06.453359 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2699/5432] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:07.021081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0c419ed9-adcd-4469-a7c2-eef316a38d3a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:07.034592 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0c419ed9-adcd-4469-a7c2-eef316a38d3a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1689 microversion: 2.1 time: 0.766523 Oct 11 20:11:07.035747 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2734/5433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:06 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1689 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:07.369343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:07.370066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] [instance: 7502b593-7de6-4b8f-80e0-a34bff7e50f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:07.381839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:07.386615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:07.387450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:07.390150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:07.390924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:07.394644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:07.433011 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] HTTP exception thrown: Instance 7502b593-7de6-4b8f-80e0-a34bff7e50f1 could not be found. Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Request method failure captured: Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 HTTP/1.1 Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc2oaE47wLntIb7miovCAFG89iwCx1fTuRCxcbmSqQpPxKUv6vgtndX5XCFt9J4DqhTulyxsvghQVE4UqZ7z8Cck5_qYdE1EU_aJ-sT7GLQZdZzERkAiifyorffytyGsNSQfiyYnw4oJHQFnTHYYYAPFdBvFiCmmSPf0O9cBSJcnOtA Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: e558d5e4dc724afeb11be4338b8b5f32 Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesActionsTest-1039039908 Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e558d5e4dc724afeb11be4338b8b5f32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e558d5e4dc724afeb11be4338b8b5f32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e558d5e4dc724afeb11be4338b8b5f32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e558d5e4dc724afeb11be4338b8b5f32"}]}] Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesActionsTest-1039039908 Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: e558d5e4dc724afeb11be4338b8b5f32 Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesActionsTest-1039039908 Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesActionsTest-1039039908-project Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 18f1c791bcfe4111908938368c85db30 Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesActionsTest-1039039908-project Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 7502b593-7de6-4b8f-80e0-a34bff7e50f1 could not be found. Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '7502b593-7de6-4b8f-80e0-a34bff7e50f1'} Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502b593-7de6-4b8f-80e0-a34bff7e50f1 could not be found. Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502b593-7de6-4b8f-80e0-a34bff7e50f1 could not be found. Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:07.435139 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:07.439928 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:07.439928 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:07.439928 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:07.439928 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:07.439928 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:07.439928 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502b593-7de6-4b8f-80e0-a34bff7e50f1 could not be found. Oct 11 20:11:07.439928 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:07.441387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] Returning 404 to user: Instance 7502b593-7de6-4b8f-80e0-a34bff7e50f1 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:07.442430 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ff474687-1859-4538-b84c-c173be6a788f tempest-VolumesActionsTest-1039039908 tempest-VolumesActionsTest-1039039908-project] 10.222.0.27 "GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1" status: 404 len: 111 microversion: 2.1 time: 0.077759 Oct 11 20:11:07.449184 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2700/5434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:07 2022] GET /compute/v2.1/servers/7502b593-7de6-4b8f-80e0-a34bff7e50f1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:11:08.064964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-83e5032c-6329-43b7-a500-d3df9a64ada2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:08.065818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-83e5032c-6329-43b7-a500-d3df9a64ada2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:08.078162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83e5032c-6329-43b7-a500-d3df9a64ada2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:08.085073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83e5032c-6329-43b7-a500-d3df9a64ada2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:08.085857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83e5032c-6329-43b7-a500-d3df9a64ada2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:08.086639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83e5032c-6329-43b7-a500-d3df9a64ada2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:08.087948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83e5032c-6329-43b7-a500-d3df9a64ada2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:08.088380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83e5032c-6329-43b7-a500-d3df9a64ada2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:08.975089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-83e5032c-6329-43b7-a500-d3df9a64ada2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:08.988025 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-83e5032c-6329-43b7-a500-d3df9a64ada2 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1689 microversion: 2.1 time: 0.925837 Oct 11 20:11:08.990513 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2735/5435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:08 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1689 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:10.019972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-13101320-1d4f-4c6e-b1c0-ad0d2829b9d9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:10.021207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-13101320-1d4f-4c6e-b1c0-ad0d2829b9d9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:10.029330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13101320-1d4f-4c6e-b1c0-ad0d2829b9d9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:10.040158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13101320-1d4f-4c6e-b1c0-ad0d2829b9d9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:10.045730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13101320-1d4f-4c6e-b1c0-ad0d2829b9d9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:10.046766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13101320-1d4f-4c6e-b1c0-ad0d2829b9d9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:10.050774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13101320-1d4f-4c6e-b1c0-ad0d2829b9d9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:10.054333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-13101320-1d4f-4c6e-b1c0-ad0d2829b9d9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:10.162565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2bcbaec-8c1e-449c-b325-6e80ac1466ef tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:10.164249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2bcbaec-8c1e-449c-b325-6e80ac1466ef tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:10.180198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2bcbaec-8c1e-449c-b325-6e80ac1466ef tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:10.186618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2bcbaec-8c1e-449c-b325-6e80ac1466ef tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:10.192817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2bcbaec-8c1e-449c-b325-6e80ac1466ef tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:10.197022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2bcbaec-8c1e-449c-b325-6e80ac1466ef tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:10.197743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2bcbaec-8c1e-449c-b325-6e80ac1466ef tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:10.199925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2bcbaec-8c1e-449c-b325-6e80ac1466ef tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:10.390188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-a2bcbaec-8c1e-449c-b325-6e80ac1466ef tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lazy-loading 'services' on Instance uuid 5d898006-3538-4acc-ba7f-8cb528ba0159 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:11:10.509873 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2bcbaec-8c1e-449c-b325-6e80ac1466ef tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments/5f17b712-a4b9-457e-9486-208651a2096d" status: 202 len: 0 microversion: 2.1 time: 0.351263 Oct 11 20:11:10.510968 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2736/5436] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:11:10 2022] DELETE /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments/5f17b712-a4b9-457e-9486-208651a2096d => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:11:10.526900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f23aa0a-6315-41fb-8086-a4063184ee86 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:10.538658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0f23aa0a-6315-41fb-8086-a4063184ee86 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:10.597887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f23aa0a-6315-41fb-8086-a4063184ee86 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:10.610382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f23aa0a-6315-41fb-8086-a4063184ee86 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:10.611323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f23aa0a-6315-41fb-8086-a4063184ee86 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:10.614160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f23aa0a-6315-41fb-8086-a4063184ee86 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:10.615061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f23aa0a-6315-41fb-8086-a4063184ee86 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:10.615725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f23aa0a-6315-41fb-8086-a4063184ee86 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:10.686379 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f23aa0a-6315-41fb-8086-a4063184ee86 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167810 Oct 11 20:11:10.693062 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2737/5437] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:10 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:11:11.699832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70925ff3-a996-4e0d-90f8-812a93eebafc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:11.703170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-70925ff3-a996-4e0d-90f8-812a93eebafc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:11.728289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70925ff3-a996-4e0d-90f8-812a93eebafc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:11.737099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70925ff3-a996-4e0d-90f8-812a93eebafc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:11.737599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70925ff3-a996-4e0d-90f8-812a93eebafc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:11.738372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70925ff3-a996-4e0d-90f8-812a93eebafc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:11.744453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70925ff3-a996-4e0d-90f8-812a93eebafc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:11.744955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70925ff3-a996-4e0d-90f8-812a93eebafc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:11.773359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-13101320-1d4f-4c6e-b1c0-ad0d2829b9d9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:11.786825 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-13101320-1d4f-4c6e-b1c0-ad0d2829b9d9 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1689 microversion: 2.1 time: 1.769899 Oct 11 20:11:11.798550 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2701/5438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:10 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1689 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:11.862507 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-70925ff3-a996-4e0d-90f8-812a93eebafc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167011 Oct 11 20:11:11.863134 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2738/5439] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:11 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:11:12.813645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc168914-9f91-4e25-b6a0-0586f3d4f27a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:12.814389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc168914-9f91-4e25-b6a0-0586f3d4f27a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:12.837915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc168914-9f91-4e25-b6a0-0586f3d4f27a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:12.846485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc168914-9f91-4e25-b6a0-0586f3d4f27a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:12.847084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc168914-9f91-4e25-b6a0-0586f3d4f27a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:12.852817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc168914-9f91-4e25-b6a0-0586f3d4f27a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:12.853427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc168914-9f91-4e25-b6a0-0586f3d4f27a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:12.859470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc168914-9f91-4e25-b6a0-0586f3d4f27a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:12.876293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7cfff35-2a49-47ae-b351-164032422a18 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:12.879751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c7cfff35-2a49-47ae-b351-164032422a18 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:12.916742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7cfff35-2a49-47ae-b351-164032422a18 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:12.925564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7cfff35-2a49-47ae-b351-164032422a18 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:12.926074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7cfff35-2a49-47ae-b351-164032422a18 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:12.932592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7cfff35-2a49-47ae-b351-164032422a18 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:12.938252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7cfff35-2a49-47ae-b351-164032422a18 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:12.944748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7cfff35-2a49-47ae-b351-164032422a18 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:13.159886 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c7cfff35-2a49-47ae-b351-164032422a18 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.288985 Oct 11 20:11:13.167876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2739/5440] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:12 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:13.479571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fc168914-9f91-4e25-b6a0-0586f3d4f27a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:13.493631 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc168914-9f91-4e25-b6a0-0586f3d4f27a tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1689 microversion: 2.1 time: 0.684702 Oct 11 20:11:13.498753 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2702/5441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:12 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1689 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:14.175772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1d701bae-694e-42aa-993b-644997482885 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:14.178387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1d701bae-694e-42aa-993b-644997482885 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:14.206297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d701bae-694e-42aa-993b-644997482885 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:14.209538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d701bae-694e-42aa-993b-644997482885 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:14.210492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d701bae-694e-42aa-993b-644997482885 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:14.211423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d701bae-694e-42aa-993b-644997482885 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:14.217308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d701bae-694e-42aa-993b-644997482885 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:14.219080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d701bae-694e-42aa-993b-644997482885 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:14.306655 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1d701bae-694e-42aa-993b-644997482885 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132598 Oct 11 20:11:14.308214 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2740/5442] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:14 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:14.521627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7422cc72-2160-42b0-adae-35c4b03cc2da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:14.522254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7422cc72-2160-42b0-adae-35c4b03cc2da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:14.540514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7422cc72-2160-42b0-adae-35c4b03cc2da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:14.541046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7422cc72-2160-42b0-adae-35c4b03cc2da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:14.541466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7422cc72-2160-42b0-adae-35c4b03cc2da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:14.542200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7422cc72-2160-42b0-adae-35c4b03cc2da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:14.542696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7422cc72-2160-42b0-adae-35c4b03cc2da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:14.543118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7422cc72-2160-42b0-adae-35c4b03cc2da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:15.123436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:15.124181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:15.139980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:15.140484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:15.140923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:15.141646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:15.142104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:15.145632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:15.219428 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] HTTP exception thrown: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Request method failure captured: Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 HTTP/1.1 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcwv0DpXxJ3LA6x9I4gg2yyl3yS5427ji0o91A7ezT5y1cwkKk64B1YVB8RAab5UsSHwR8e3xTJBFwqVQicaHEK3H0WDnmniz3ZxFnGLIP2w5IKHj5rvBarmd09W6ZZsrYkfU8credi-Bywnb8D4rqkPaCRNjW8p3aRnTVxkQMnyX70 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: e99631a5809b4f3ab73232f4940a6722 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TaggedBootDevicesTest-1002301992 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e99631a5809b4f3ab73232f4940a6722"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e99631a5809b4f3ab73232f4940a6722", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e99631a5809b4f3ab73232f4940a6722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e99631a5809b4f3ab73232f4940a6722"}]}] Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TaggedBootDevicesTest-1002301992 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: e99631a5809b4f3ab73232f4940a6722 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1002301992 Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TaggedBootDevicesTest-1002301992-project Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 09e46a1f1cb2445588c04964d140825f Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TaggedBootDevicesTest-1002301992-project Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '69977b40-6339-45a2-8389-a8eb35391387'} Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:15.221366 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Returning 404 to user: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:15.225059 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e4d2d5f-7f34-4079-983a-0e6cae4c16fe tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 404 len: 111 microversion: 2.32 time: 0.103846 Oct 11 20:11:15.228424 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2741/5443] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:11:15 2022] DELETE /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:11:15.233625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:15.264544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] [instance: 69977b40-6339-45a2-8389-a8eb35391387] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:15.288031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:15.288568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:15.289006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:15.289824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:15.302962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:15.303422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:15.365674 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] HTTP exception thrown: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Request method failure captured: Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 HTTP/1.1 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcwv0DpXxJ3LA6x9I4gg2yyl3yS5427ji0o91A7ezT5y1cwkKk64B1YVB8RAab5UsSHwR8e3xTJBFwqVQicaHEK3H0WDnmniz3ZxFnGLIP2w5IKHj5rvBarmd09W6ZZsrYkfU8credi-Bywnb8D4rqkPaCRNjW8p3aRnTVxkQMnyX70 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: e99631a5809b4f3ab73232f4940a6722 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TaggedBootDevicesTest-1002301992 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e99631a5809b4f3ab73232f4940a6722"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e99631a5809b4f3ab73232f4940a6722", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e99631a5809b4f3ab73232f4940a6722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e99631a5809b4f3ab73232f4940a6722"}]}] Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TaggedBootDevicesTest-1002301992 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: e99631a5809b4f3ab73232f4940a6722 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1002301992 Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TaggedBootDevicesTest-1002301992-project Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 09e46a1f1cb2445588c04964d140825f Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TaggedBootDevicesTest-1002301992-project Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '69977b40-6339-45a2-8389-a8eb35391387'} Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:15.369988 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:15.374355 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:15.374355 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:15.374355 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:15.374355 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:15.374355 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:15.374355 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:15.374355 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. Oct 11 20:11:15.374355 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:15.387070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] Returning 404 to user: Instance 69977b40-6339-45a2-8389-a8eb35391387 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:15.388893 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-caf6cff0-37b1-4b5a-8561-38313edaa61e tempest-TaggedBootDevicesTest-1002301992 tempest-TaggedBootDevicesTest-1002301992-project] 10.222.0.27 "GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387" status: 404 len: 111 microversion: 2.32 time: 0.159250 Oct 11 20:11:15.418122 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2742/5444] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:11:15 2022] GET /compute/v2.1/servers/69977b40-6339-45a2-8389-a8eb35391387 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:11:15.446710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9290ad5b-cfc4-4b86-a9eb-eb0e22750fa9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:15.456059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9290ad5b-cfc4-4b86-a9eb-eb0e22750fa9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:15.483236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9290ad5b-cfc4-4b86-a9eb-eb0e22750fa9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:15.483750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9290ad5b-cfc4-4b86-a9eb-eb0e22750fa9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:15.484187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9290ad5b-cfc4-4b86-a9eb-eb0e22750fa9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:15.494756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9290ad5b-cfc4-4b86-a9eb-eb0e22750fa9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:15.495265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9290ad5b-cfc4-4b86-a9eb-eb0e22750fa9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:15.502121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9290ad5b-cfc4-4b86-a9eb-eb0e22750fa9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:15.675487 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9290ad5b-cfc4-4b86-a9eb-eb0e22750fa9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247979 Oct 11 20:11:15.675487 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2743/5445] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:15 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:15.961456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7422cc72-2160-42b0-adae-35c4b03cc2da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:15.979504 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7422cc72-2160-42b0-adae-35c4b03cc2da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1689 microversion: 2.1 time: 1.460311 Oct 11 20:11:15.982867 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2703/5446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:14 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1689 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:16.688170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b1e53960-1330-4480-81f6-8ca1ff50b3a7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:16.690949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b1e53960-1330-4480-81f6-8ca1ff50b3a7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:16.704184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1e53960-1330-4480-81f6-8ca1ff50b3a7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:16.708990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1e53960-1330-4480-81f6-8ca1ff50b3a7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:16.710817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1e53960-1330-4480-81f6-8ca1ff50b3a7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:16.715171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1e53960-1330-4480-81f6-8ca1ff50b3a7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:16.724633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1e53960-1330-4480-81f6-8ca1ff50b3a7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:16.732648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1e53960-1330-4480-81f6-8ca1ff50b3a7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:16.818393 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b1e53960-1330-4480-81f6-8ca1ff50b3a7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135224 Oct 11 20:11:16.819587 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2744/5447] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:16 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:17.005908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4ad26b52-c981-4cec-8226-669277cd29da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:17.006406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ad26b52-c981-4cec-8226-669277cd29da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:17.026724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ad26b52-c981-4cec-8226-669277cd29da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:17.027112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ad26b52-c981-4cec-8226-669277cd29da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:17.031148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ad26b52-c981-4cec-8226-669277cd29da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:17.031960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ad26b52-c981-4cec-8226-669277cd29da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:17.032443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ad26b52-c981-4cec-8226-669277cd29da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:17.032877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ad26b52-c981-4cec-8226-669277cd29da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:17.840133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e088286b-03ec-4d51-b693-622495dc3adc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:17.860591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e088286b-03ec-4d51-b693-622495dc3adc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:17.887911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e088286b-03ec-4d51-b693-622495dc3adc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:17.889472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e088286b-03ec-4d51-b693-622495dc3adc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:17.893189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e088286b-03ec-4d51-b693-622495dc3adc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:17.901764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e088286b-03ec-4d51-b693-622495dc3adc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:17.904085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e088286b-03ec-4d51-b693-622495dc3adc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:17.904729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e088286b-03ec-4d51-b693-622495dc3adc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:18.032350 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e088286b-03ec-4d51-b693-622495dc3adc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204536 Oct 11 20:11:18.038153 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2745/5448] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:17 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:18.178331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ad26b52-c981-4cec-8226-669277cd29da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:18.197882 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4ad26b52-c981-4cec-8226-669277cd29da tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1695 microversion: 2.1 time: 1.190871 Oct 11 20:11:18.220462 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2704/5449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:17 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1695 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:19.048041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-36249590-e2da-4c12-a7ad-c5bca72c48ea tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:19.053761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-36249590-e2da-4c12-a7ad-c5bca72c48ea tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:19.083750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36249590-e2da-4c12-a7ad-c5bca72c48ea tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:19.084802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36249590-e2da-4c12-a7ad-c5bca72c48ea tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:19.086516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36249590-e2da-4c12-a7ad-c5bca72c48ea tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:19.092311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36249590-e2da-4c12-a7ad-c5bca72c48ea tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:19.093637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36249590-e2da-4c12-a7ad-c5bca72c48ea tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:19.094680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36249590-e2da-4c12-a7ad-c5bca72c48ea tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:19.224183 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-36249590-e2da-4c12-a7ad-c5bca72c48ea tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182697 Oct 11 20:11:19.228521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0313ee95-4ab0-45d8-8513-8274c013f354 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:19.228521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0313ee95-4ab0-45d8-8513-8274c013f354 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:19.230781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:11:19.232284 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2746/5450] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:19 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:19.249334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0313ee95-4ab0-45d8-8513-8274c013f354 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:19.256026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0313ee95-4ab0-45d8-8513-8274c013f354 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:19.257938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0313ee95-4ab0-45d8-8513-8274c013f354 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:19.260707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0313ee95-4ab0-45d8-8513-8274c013f354 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:19.267925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0313ee95-4ab0-45d8-8513-8274c013f354 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:19.268576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0313ee95-4ab0-45d8-8513-8274c013f354 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:19.849551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0313ee95-4ab0-45d8-8513-8274c013f354 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:19.865053 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0313ee95-4ab0-45d8-8513-8274c013f354 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1695 microversion: 2.1 time: 0.641899 Oct 11 20:11:19.866052 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2705/5451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:19 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1695 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:20.259095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc5e2591-335d-47d9-bd5a-d1ff0a56280f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:20.267028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc5e2591-335d-47d9-bd5a-d1ff0a56280f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:20.293943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5e2591-335d-47d9-bd5a-d1ff0a56280f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:20.295359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5e2591-335d-47d9-bd5a-d1ff0a56280f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:20.297252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5e2591-335d-47d9-bd5a-d1ff0a56280f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:20.299521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5e2591-335d-47d9-bd5a-d1ff0a56280f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:20.300586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5e2591-335d-47d9-bd5a-d1ff0a56280f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:20.301598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc5e2591-335d-47d9-bd5a-d1ff0a56280f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:20.347653 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc5e2591-335d-47d9-bd5a-d1ff0a56280f tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113800 Oct 11 20:11:20.353241 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2747/5452] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:20 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:20.891319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06329e70-5931-4bf3-afff-447c16eb6751 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:20.892131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-06329e70-5931-4bf3-afff-447c16eb6751 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:20.905517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06329e70-5931-4bf3-afff-447c16eb6751 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:20.910330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06329e70-5931-4bf3-afff-447c16eb6751 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:20.911033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06329e70-5931-4bf3-afff-447c16eb6751 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:20.913719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06329e70-5931-4bf3-afff-447c16eb6751 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:20.914472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06329e70-5931-4bf3-afff-447c16eb6751 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:20.915328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06329e70-5931-4bf3-afff-447c16eb6751 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:21.369046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a1a44979-ccc1-4a2b-903d-d7d616533bf9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:21.372001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a1a44979-ccc1-4a2b-903d-d7d616533bf9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:21.398099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1a44979-ccc1-4a2b-903d-d7d616533bf9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:21.398640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1a44979-ccc1-4a2b-903d-d7d616533bf9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:21.401733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1a44979-ccc1-4a2b-903d-d7d616533bf9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:21.408192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1a44979-ccc1-4a2b-903d-d7d616533bf9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:21.411092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1a44979-ccc1-4a2b-903d-d7d616533bf9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:21.413380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1a44979-ccc1-4a2b-903d-d7d616533bf9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:21.578864 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a1a44979-ccc1-4a2b-903d-d7d616533bf9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211732 Oct 11 20:11:21.578864 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2748/5453] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:21 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:21.656725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-06329e70-5931-4bf3-afff-447c16eb6751 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:21.691211 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-06329e70-5931-4bf3-afff-447c16eb6751 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1680 microversion: 2.1 time: 0.801234 Oct 11 20:11:21.693180 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2706/5454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:20 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1680 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:22.582752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0faff0f9-4a7f-4be6-9cc9-dc114e4b9573 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:22.585831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0faff0f9-4a7f-4be6-9cc9-dc114e4b9573 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:22.607485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0faff0f9-4a7f-4be6-9cc9-dc114e4b9573 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:22.608492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0faff0f9-4a7f-4be6-9cc9-dc114e4b9573 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:22.609590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0faff0f9-4a7f-4be6-9cc9-dc114e4b9573 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:22.610488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0faff0f9-4a7f-4be6-9cc9-dc114e4b9573 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:22.611132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0faff0f9-4a7f-4be6-9cc9-dc114e4b9573 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:22.613333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0faff0f9-4a7f-4be6-9cc9-dc114e4b9573 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:22.717704 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0faff0f9-4a7f-4be6-9cc9-dc114e4b9573 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137662 Oct 11 20:11:22.720177 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2749/5455] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:22 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:23.372089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-80148961-af31-468d-aa3e-a08d8f4b9d2c req-59895369-4198-4196-9b0f-581362a0f5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af77a9b-8b33-40fb-8ba8-6e8989653ec8", "name": "network-vif-plugged", "status": "completed", "tag": "5be60d4e-03fc-4532-a2dc-220e29167248"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:11:23.420944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-80148961-af31-468d-aa3e-a08d8f4b9d2c req-59895369-4198-4196-9b0f-581362a0f5c2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:23.422688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-80148961-af31-468d-aa3e-a08d8f4b9d2c req-59895369-4198-4196-9b0f-581362a0f5c2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:23.424346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-80148961-af31-468d-aa3e-a08d8f4b9d2c req-59895369-4198-4196-9b0f-581362a0f5c2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:23.454500 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-80148961-af31-468d-aa3e-a08d8f4b9d2c req-59895369-4198-4196-9b0f-581362a0f5c2 service nova] Creating event network-vif-plugged:5be60d4e-03fc-4532-a2dc-220e29167248 for instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 on n-h2-860864-3 Oct 11 20:11:23.466782 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-80148961-af31-468d-aa3e-a08d8f4b9d2c req-59895369-4198-4196-9b0f-581362a0f5c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099066 Oct 11 20:11:23.472707 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2707/5456] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:23.732759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-741e3283-270b-4ce2-bc67-e414c34ea4ee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:23.735675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-741e3283-270b-4ce2-bc67-e414c34ea4ee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:23.781697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-741e3283-270b-4ce2-bc67-e414c34ea4ee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:23.783656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-741e3283-270b-4ce2-bc67-e414c34ea4ee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:23.785955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-741e3283-270b-4ce2-bc67-e414c34ea4ee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:23.794172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-741e3283-270b-4ce2-bc67-e414c34ea4ee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:23.797216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-741e3283-270b-4ce2-bc67-e414c34ea4ee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:23.807860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-741e3283-270b-4ce2-bc67-e414c34ea4ee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:23.955924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:11:24.006163 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-741e3283-270b-4ce2-bc67-e414c34ea4ee tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.277612 Oct 11 20:11:24.013585 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2750/5457] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:11:23 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159/os-volume_attachments => generated 25 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:11:24.195031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cdf6df7b-1608-4f8f-a5fd-24a23892e0dc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:24.195731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cdf6df7b-1608-4f8f-a5fd-24a23892e0dc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:24.212936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdf6df7b-1608-4f8f-a5fd-24a23892e0dc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:24.214673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdf6df7b-1608-4f8f-a5fd-24a23892e0dc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:24.220323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdf6df7b-1608-4f8f-a5fd-24a23892e0dc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:24.223001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdf6df7b-1608-4f8f-a5fd-24a23892e0dc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:24.223740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdf6df7b-1608-4f8f-a5fd-24a23892e0dc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:24.227420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdf6df7b-1608-4f8f-a5fd-24a23892e0dc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:24.332796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cdf6df7b-1608-4f8f-a5fd-24a23892e0dc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:11:24.656910 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cdf6df7b-1608-4f8f-a5fd-24a23892e0dc tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 204 len: 0 microversion: 2.1 time: 0.466425 Oct 11 20:11:24.660873 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2708/5458] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:11:24 2022] DELETE /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:11:24.666141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93a2f2f7-85a8-4e1c-aade-3da6222439a9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:24.667147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-93a2f2f7-85a8-4e1c-aade-3da6222439a9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:24.686349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f7-85a8-4e1c-aade-3da6222439a9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:24.691034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f7-85a8-4e1c-aade-3da6222439a9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:24.691594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f7-85a8-4e1c-aade-3da6222439a9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:24.692888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f7-85a8-4e1c-aade-3da6222439a9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:24.700265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f7-85a8-4e1c-aade-3da6222439a9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:24.705665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f7-85a8-4e1c-aade-3da6222439a9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:25.339073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-93a2f2f7-85a8-4e1c-aade-3da6222439a9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:25.349464 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-93a2f2f7-85a8-4e1c-aade-3da6222439a9 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1680 microversion: 2.1 time: 0.687126 Oct 11 20:11:25.353130 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2751/5459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:24 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1680 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:11:26.386023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc949273-7620-47b4-bf7c-338a4d82a714 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:26.386972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc949273-7620-47b4-bf7c-338a4d82a714 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:26.443949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc949273-7620-47b4-bf7c-338a4d82a714 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:26.446440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc949273-7620-47b4-bf7c-338a4d82a714 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:26.451420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc949273-7620-47b4-bf7c-338a4d82a714 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:26.452262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc949273-7620-47b4-bf7c-338a4d82a714 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:26.452832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc949273-7620-47b4-bf7c-338a4d82a714 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:26.453277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc949273-7620-47b4-bf7c-338a4d82a714 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:28.263790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fc949273-7620-47b4-bf7c-338a4d82a714 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:28.273512 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc949273-7620-47b4-bf7c-338a4d82a714 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1680 microversion: 2.1 time: 1.898627 Oct 11 20:11:28.280543 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2709/5460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:26 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1680 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:29.307704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7d99374c-c191-4449-874a-1c0fac6010db tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:29.309456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d99374c-c191-4449-874a-1c0fac6010db tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:29.344325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d99374c-c191-4449-874a-1c0fac6010db tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:29.357915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d99374c-c191-4449-874a-1c0fac6010db tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:29.359175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d99374c-c191-4449-874a-1c0fac6010db tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:29.361434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d99374c-c191-4449-874a-1c0fac6010db tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:29.362040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d99374c-c191-4449-874a-1c0fac6010db tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:29.364748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d99374c-c191-4449-874a-1c0fac6010db tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:29.721976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7d99374c-c191-4449-874a-1c0fac6010db tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:29.736885 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7d99374c-c191-4449-874a-1c0fac6010db tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1613 microversion: 2.1 time: 0.432793 Oct 11 20:11:29.760671 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2752/5461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:29 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1613 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:30.337227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-48837aea-e12b-478c-a7de-54ac0ab68e18 req-3742bd9e-5600-40ab-8294-a4a6f02209bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d898006-3538-4acc-ba7f-8cb528ba0159", "name": "network-vif-deleted", "tag": "6c3c26d3-ee35-4786-a372-d0d775701cb9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:11:30.369500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-48837aea-e12b-478c-a7de-54ac0ab68e18 req-3742bd9e-5600-40ab-8294-a4a6f02209bf service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:30.379395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-48837aea-e12b-478c-a7de-54ac0ab68e18 req-3742bd9e-5600-40ab-8294-a4a6f02209bf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:30.380325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-48837aea-e12b-478c-a7de-54ac0ab68e18 req-3742bd9e-5600-40ab-8294-a4a6f02209bf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:30.399327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:11:30.438885 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-48837aea-e12b-478c-a7de-54ac0ab68e18 req-3742bd9e-5600-40ab-8294-a4a6f02209bf service nova] Creating event network-vif-deleted:6c3c26d3-ee35-4786-a372-d0d775701cb9 for instance 5d898006-3538-4acc-ba7f-8cb528ba0159 on n-h1-860864-3 Oct 11 20:11:30.468574 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-48837aea-e12b-478c-a7de-54ac0ab68e18 req-3742bd9e-5600-40ab-8294-a4a6f02209bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135194 Oct 11 20:11:30.489210 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2710/5462] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:11:30.774366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:30.775823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:30.790997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:30.809742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:30.813741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:30.814704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:30.816815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:30.819621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:30.941192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:30.941919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:30.942977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:30.943590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lazy-loading 'fault' on Instance uuid 5d898006-3538-4acc-ba7f-8cb528ba0159 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:11:31.209236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4202e77bb27447ba5363091634d9731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aac6d81fae4d24aa3d0a7815f58e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:31.220048 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-16d9a7c8-e6cd-45ca-acd4-6262cc522fcd tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 200 len: 1331 microversion: 2.1 time: 0.449456 Oct 11 20:11:31.233958 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2753/5463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:30 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 1331 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:32.248672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:32.249395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:32.323685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:32.325280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:32.325696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:32.338635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:32.346456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:32.347350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:32.412341 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 HTTP/1.1 Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '5d898006-3538-4acc-ba7f-8cb528ba0159'} Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:32.419339 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:32.423348 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:32.423348 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:32.423348 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:32.423348 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:32.423348 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:32.423348 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:32.423348 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:32.429130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:32.436688 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c579576f-2381-48e9-b1d5-965eeaf1916b tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 404 len: 111 microversion: 2.1 time: 0.195398 Oct 11 20:11:32.439114 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2711/5464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:32 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:11:32.449262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9bd15233-5b9d-4118-ae66-86cb5bedd269 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '.version_select at 0x7f83c724d280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:32.471414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:11:32.526412 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9bd15233-5b9d-4118-ae66-86cb5bedd269 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571473760" status: 202 len: 0 microversion: 2.1 time: 0.075620 Oct 11 20:11:32.528449 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2754/5465] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 20:11:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571473760 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:11:42.074645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:42.075213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:42.095143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:42.100724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:42.116275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:42.127621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:42.128121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:42.128555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:42.217292 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 HTTP/1.1 Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '5d898006-3538-4acc-ba7f-8cb528ba0159'} Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:42.222068 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:42.225684 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:42.231394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:42.235507 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-036b24bc-0317-4d45-9745-02db87d119b7 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 404 len: 111 microversion: 2.1 time: 0.164592 Oct 11 20:11:42.236657 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2712/5466] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:11:42 2022] DELETE /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:11:42.242134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=23 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:11:42.247955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:42.248582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 5d898006-3538-4acc-ba7f-8cb528ba0159] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:42.275389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:42.275902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:42.276343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:42.277819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:42.278296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:42.278761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:42.349552 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 HTTP/1.1 Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '5d898006-3538-4acc-ba7f-8cb528ba0159'} Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:42.360880 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:42.365337 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:42.365337 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:42.365337 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:42.365337 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:42.365337 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:42.365337 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. Oct 11 20:11:42.365337 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:42.365337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance 5d898006-3538-4acc-ba7f-8cb528ba0159 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:42.365337 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-36116c19-de6b-46e1-b746-4597c0099333 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159" status: 404 len: 111 microversion: 2.1 time: 0.121873 Oct 11 20:11:42.379854 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2755/5467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:42 2022] GET /compute/v2.1/servers/5d898006-3538-4acc-ba7f-8cb528ba0159 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:11:44.437014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-013e3214-fa25-4eed-adc4-5603499de062 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:11:44.445979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-013e3214-fa25-4eed-adc4-5603499de062 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:44.478687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013e3214-fa25-4eed-adc4-5603499de062 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:44.478994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013e3214-fa25-4eed-adc4-5603499de062 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:44.479387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013e3214-fa25-4eed-adc4-5603499de062 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:44.480308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013e3214-fa25-4eed-adc4-5603499de062 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:44.480791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013e3214-fa25-4eed-adc4-5603499de062 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:44.496934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-013e3214-fa25-4eed-adc4-5603499de062 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:44.644614 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-013e3214-fa25-4eed-adc4-5603499de062 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "POST /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8/action" status: 200 len: 24567 microversion: 2.1 time: 0.213186 Oct 11 20:11:44.645655 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2713/5468] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:11:44 2022] POST /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8/action => generated 24567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:11:49.294262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:49.296057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:49.309009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:49.310106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:49.310788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:49.312051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:49.312738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:49.313337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:49.414968 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c HTTP/1.1 Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c'} Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:49.428092 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:49.432629 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-806205a1-3e94-4abf-ae06-cead0447b86d tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 404 len: 111 microversion: 2.1 time: 0.144186 Oct 11 20:11:49.435892 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2756/5469] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:11:49 2022] DELETE /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:11:49.444307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:49.445028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:49.456732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:11:49.458394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:49.458916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:49.459361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:49.460076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:49.460664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:49.461092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:49.503697 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c HTTP/1.1 Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c'} Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:49.505405 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.513209 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.513209 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:49.513209 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:49.513209 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:49.513209 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:49.513209 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. Oct 11 20:11:49.513209 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.513209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance 8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:49.513209 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b10d0d0d-4890-4c6b-9a70-2802da7a9362 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c" status: 404 len: 111 microversion: 2.1 time: 0.066832 Oct 11 20:11:49.513209 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2714/5470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:49 2022] GET /compute/v2.1/servers/8e22bcd8-f0fd-4d4c-80ad-60d43e4fd56c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:11:49.515526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:49.516014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:49.534373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:49.534938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:49.535375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:49.536086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:49.536544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:49.536974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:49.562060 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe HTTP/1.1 Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ecc1cee7-9aca-468a-9d10-9f985b7adcbe'} Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:49.563689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a33ccaf3-0e59-47ea-ae4c-2fda3e273719 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 404 len: 111 microversion: 2.1 time: 0.053420 Oct 11 20:11:49.568080 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2757/5471] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:11:49 2022] DELETE /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:11:49.575036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:49.575662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ecc1cee7-9aca-468a-9d10-9f985b7adcbe] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:49.589549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:49.590103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:49.590697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:49.591281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:49.591740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:49.592185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:49.628033 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe HTTP/1.1 Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ecc1cee7-9aca-468a-9d10-9f985b7adcbe'} Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:49.634720 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.639827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:49.639827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:49.639827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:49.639827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:49.639827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:49.639827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. Oct 11 20:11:49.639827 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:49.641199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance ecc1cee7-9aca-468a-9d10-9f985b7adcbe could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:49.642232 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-34c58d54-36be-412a-9dba-f2d063d16529 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe" status: 404 len: 111 microversion: 2.1 time: 0.072198 Oct 11 20:11:49.643177 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2715/5472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:49 2022] GET /compute/v2.1/servers/ecc1cee7-9aca-468a-9d10-9f985b7adcbe => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:11:55.958653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-83dcd55d-7c7a-47ce-96b4-017ccce86971 req-6a91e4f2-d204-4058-9af8-9fc69bd7ec4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af77a9b-8b33-40fb-8ba8-6e8989653ec8", "tag": "5be60d4e-03fc-4532-a2dc-220e29167248"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:11:56.005715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-83dcd55d-7c7a-47ce-96b4-017ccce86971 req-6a91e4f2-d204-4058-9af8-9fc69bd7ec4c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:56.009271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-83dcd55d-7c7a-47ce-96b4-017ccce86971 req-6a91e4f2-d204-4058-9af8-9fc69bd7ec4c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:56.014134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-83dcd55d-7c7a-47ce-96b4-017ccce86971 req-6a91e4f2-d204-4058-9af8-9fc69bd7ec4c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:56.080342 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-83dcd55d-7c7a-47ce-96b4-017ccce86971 req-6a91e4f2-d204-4058-9af8-9fc69bd7ec4c service nova] Creating event network-changed:5be60d4e-03fc-4532-a2dc-220e29167248 for instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 on n-h2-860864-3 Oct 11 20:11:56.115383 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-83dcd55d-7c7a-47ce-96b4-017ccce86971 req-6a91e4f2-d204-4058-9af8-9fc69bd7ec4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167583 Oct 11 20:11:56.124280 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2716/5473] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 11 20:11:56.433233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f740c815-2675-41ed-9bdd-6cf9851cbae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:56.434718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f740c815-2675-41ed-9bdd-6cf9851cbae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:56.444395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f740c815-2675-41ed-9bdd-6cf9851cbae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:56.445135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f740c815-2675-41ed-9bdd-6cf9851cbae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:56.445756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f740c815-2675-41ed-9bdd-6cf9851cbae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:56.446987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f740c815-2675-41ed-9bdd-6cf9851cbae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:56.448049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f740c815-2675-41ed-9bdd-6cf9851cbae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:56.448727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f740c815-2675-41ed-9bdd-6cf9851cbae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:56.485819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f740c815-2675-41ed-9bdd-6cf9851cbae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:11:56.525082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:56.527187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:56.551621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:56.552901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:56.558262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:56.560386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:56.564465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:56.565159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:56.641518 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 HTTP/1.1 Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ef13443d-3c56-4ec8-b242-fc39fa2f1a16'} Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:56.646567 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:11:56.650600 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:56.657529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:56.660286 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bace5297-9514-4248-ba15-156332c0fdab tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 404 len: 111 microversion: 2.1 time: 0.139465 Oct 11 20:11:56.665370 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2717/5474] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:11:56 2022] DELETE /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 20:11:56.685297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:56.687698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] [instance: ef13443d-3c56-4ec8-b242-fc39fa2f1a16] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:56.701923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:56.702772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:56.709409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:56.711423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:56.715017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:56.715692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:56.773124 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] HTTP exception thrown: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:11:56.780918 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f740c815-2675-41ed-9bdd-6cf9851cbae1 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 204 len: 0 microversion: 2.1 time: 0.873087 Oct 11 20:11:56.781794 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2758/5475] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:11:55 2022] DELETE /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 0 bytes in 875 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Request method failure captured: Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 HTTP/1.1 Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRcxrq5dXAMuwlTxM99M9jk9IM5Bxbodh-J6T_ZBQGYY5A3Sxc4Tuqnx6k6wMsF7Sle3kJRNpdpuVa9Uc80b978k1ZDVendOo-V_7pgfDK0rpLOONKteyX5zQZS1pReK95KAzEyJZz7Trea2o5Jwjd4h7YMy2fy1QNxesU4oUQSdc6CQ Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9aac6d81fae4d24aa3d0a7815f58e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9aac6d81fae4d24aa3d0a7815f58e08"}]}] Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f9aac6d81fae4d24aa3d0a7815f58e08 Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-368436527 Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f4202e77bb27447ba5363091634d9731 Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-AttachVolumeNegativeTest-368436527-project Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ef13443d-3c56-4ec8-b242-fc39fa2f1a16'} Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:11:56.782505 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:56.786292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:11:56.786292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:11:56.786292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:11:56.786292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:11:56.786292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:11:56.786292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. Oct 11 20:11:56.786292 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:11:56.791529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] Returning 404 to user: Instance ef13443d-3c56-4ec8-b242-fc39fa2f1a16 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:11:56.793740 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e5d8610d-7751-405c-9bb9-198b2637e6e2 tempest-AttachVolumeNegativeTest-368436527 tempest-AttachVolumeNegativeTest-368436527-project] 10.222.0.27 "GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16" status: 404 len: 111 microversion: 2.1 time: 0.124703 Oct 11 20:11:56.795820 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2718/5476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:56 2022] GET /compute/v2.1/servers/ef13443d-3c56-4ec8-b242-fc39fa2f1a16 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:11:56.798804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a5648c1b-c51e-4a4f-9768-bb2edf6af41f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:56.799772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a5648c1b-c51e-4a4f-9768-bb2edf6af41f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:56.809419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5648c1b-c51e-4a4f-9768-bb2edf6af41f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:56.810265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5648c1b-c51e-4a4f-9768-bb2edf6af41f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:56.810963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5648c1b-c51e-4a4f-9768-bb2edf6af41f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:56.812153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5648c1b-c51e-4a4f-9768-bb2edf6af41f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:56.812816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5648c1b-c51e-4a4f-9768-bb2edf6af41f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:56.813426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5648c1b-c51e-4a4f-9768-bb2edf6af41f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:57.727855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a5648c1b-c51e-4a4f-9768-bb2edf6af41f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:57.747468 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a5648c1b-c51e-4a4f-9768-bb2edf6af41f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1686 microversion: 2.1 time: 0.958086 Oct 11 20:11:57.748619 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2759/5477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:56 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1686 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:58.773078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-879db688-f142-4562-888f-a5f0538ed06f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:11:58.773903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-879db688-f142-4562-888f-a5f0538ed06f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:11:58.803250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-879db688-f142-4562-888f-a5f0538ed06f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:58.806484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-879db688-f142-4562-888f-a5f0538ed06f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:58.807624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-879db688-f142-4562-888f-a5f0538ed06f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:58.812651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-879db688-f142-4562-888f-a5f0538ed06f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:58.819082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-879db688-f142-4562-888f-a5f0538ed06f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:58.820185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-879db688-f142-4562-888f-a5f0538ed06f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:59.366151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-879db688-f142-4562-888f-a5f0538ed06f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:11:59.383809 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-879db688-f142-4562-888f-a5f0538ed06f tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1619 microversion: 2.1 time: 0.615160 Oct 11 20:11:59.388414 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2719/5478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:11:58 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1619 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:11:59.680640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-325d60f4-e7d1-43b7-b906-d19d7307a814 req-3c2e57c8-3323-4e61-a768-be7a5b111df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af77a9b-8b33-40fb-8ba8-6e8989653ec8", "name": "network-vif-deleted", "tag": "5be60d4e-03fc-4532-a2dc-220e29167248"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:11:59.703725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-325d60f4-e7d1-43b7-b906-d19d7307a814 req-3c2e57c8-3323-4e61-a768-be7a5b111df6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:11:59.704530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-325d60f4-e7d1-43b7-b906-d19d7307a814 req-3c2e57c8-3323-4e61-a768-be7a5b111df6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:11:59.705233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-325d60f4-e7d1-43b7-b906-d19d7307a814 req-3c2e57c8-3323-4e61-a768-be7a5b111df6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:11:59.742937 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-325d60f4-e7d1-43b7-b906-d19d7307a814 req-3c2e57c8-3323-4e61-a768-be7a5b111df6 service nova] Creating event network-vif-deleted:5be60d4e-03fc-4532-a2dc-220e29167248 for instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 on n-h2-860864-3 Oct 11 20:11:59.769815 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-325d60f4-e7d1-43b7-b906-d19d7307a814 req-3c2e57c8-3323-4e61-a768-be7a5b111df6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093567 Oct 11 20:11:59.772964 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2760/5479] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:12:00.408617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:12:00.409477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:12:00.433243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:12:00.457073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:12:00.462243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:12:00.465339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:12:00.468295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:12:00.475346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:12:00.520763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:12:00.521645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:12:00.522327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:12:00.523108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lazy-loading 'fault' on Instance uuid 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:12:00.594326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3eaa8c79a0645fd93e6e3398426237f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abba65df7ef6403db3d5b466eb12fb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:12:00.631838 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-934e3ea4-0942-4a05-ba4d-445df1966846 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 200 len: 1355 microversion: 2.1 time: 0.227395 Oct 11 20:12:00.639020 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2720/5480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:12:00 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 1355 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:12:01.661841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:12:01.662744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] [instance: 9af77a9b-8b33-40fb-8ba8-6e8989653ec8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:12:01.682896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:12:01.684163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:12:01.685765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:12:01.686954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:12:01.693007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:12:01.696027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:12:01.736456 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] HTTP exception thrown: Instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 could not be found. Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Request method failure captured: Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 HTTP/1.1 Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRcuuQjfIszkyOtJSECoXLkoDQN-z4e4y6WzgPHiOSPLqH5SV-HvPoQdiMi_GwUDM2EltrUPWVnUG7Mw5CMaCpk0b-jW44fhL6WJJqofKREBBrNQ7WBjPWizW0ivaOVl1mT2-eDn57Y1mQoC_gVSHEDqQtnZgH9UL0JndxPnm8zhH4eU Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: abba65df7ef6403db3d5b466eb12fb94 Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abba65df7ef6403db3d5b466eb12fb94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abba65df7ef6403db3d5b466eb12fb94", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abba65df7ef6403db3d5b466eb12fb94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abba65df7ef6403db3d5b466eb12fb94"}]}] Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: abba65df7ef6403db3d5b466eb12fb94 Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-97175932 Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestNetworkAdvancedServerOps-97175932-project Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: c3eaa8c79a0645fd93e6e3398426237f Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestNetworkAdvancedServerOps-97175932-project Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 could not be found. Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '9af77a9b-8b33-40fb-8ba8-6e8989653ec8'} Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 could not be found. Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 could not be found. Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:12:01.738484 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:12:01.743079 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:12:01.743079 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:12:01.743079 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:12:01.743079 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:12:01.743079 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:12:01.743079 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:12:01.743079 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 could not be found. Oct 11 20:12:01.743079 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:12:01.747473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Returning 404 to user: Instance 9af77a9b-8b33-40fb-8ba8-6e8989653ec8 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:12:01.751077 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-54d39053-15b2-4952-bba9-ac682e3ebe83 tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8" status: 404 len: 111 microversion: 2.1 time: 0.093434 Oct 11 20:12:01.756416 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2761/5481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:12:01 2022] GET /compute/v2.1/servers/9af77a9b-8b33-40fb-8ba8-6e8989653ec8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:12:13.287534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f2b6ece6-8192-4d3d-b4d7-8687563fe12e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] Calling method '.version_select at 0x7f83c7246790>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:12:13.293892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=15 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:12:13.306913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=33 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:12:13.337944 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f2b6ece6-8192-4d3d-b4d7-8687563fe12e tempest-TestNetworkAdvancedServerOps-97175932 tempest-TestNetworkAdvancedServerOps-97175932-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-495900351" status: 202 len: 0 microversion: 2.1 time: 0.053958 Oct 11 20:12:13.338863 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2721/5482] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 11 20:12:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-495900351 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:12:21.611300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:12:21.615485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:12:22.121451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-270692d0-442d-4cc6-9f90-0b8659d7d2ff tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Action: 'create', calling method: .version_select at 0x7f83cc33b4c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2120499800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQYOnKMpGJ9NPXYzUGpk/s7YqoVMb04vhkgzJBPeY3v5mfbwBspX3Ttp0nRl5eYtl315yo6ZCw3+0RqJ9Hpz7fGxRgEQNH3y7VWMWkFFqDq/cq+oaPxSKT2jf1macxkJQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:12:22.155955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-270692d0-442d-4cc6-9f90-0b8659d7d2ff tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Getting quotas for project d335c8cd2fcd4d9d8dcb2265be41dd39. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:12:22.161801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-270692d0-442d-4cc6-9f90-0b8659d7d2ff tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Getting quotas for user fd7806855dac40768b11242a4e00d9e9 and project d335c8cd2fcd4d9d8dcb2265be41dd39. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:12:22.233080 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-270692d0-442d-4cc6-9f90-0b8659d7d2ff tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.639027 Oct 11 20:12:22.242723 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2762/5483] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:12:21 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:12:52.978637 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 11 20:12:52.979684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:12:53.003118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-731009624-access_point-1029082137", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "2f538101-8b8e-495e-aead-81e0841485d0"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2120499800", "security_groups": [{"name": "tempest-secgroup_access--1238754308"}, {"name": "tempest-secgroup_general--902488933"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:12:54.901973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] validate_networks() for [('2f538101-8b8e-495e-aead-81e0841485d0', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:12:57.705472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:12:57.706082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:12:57.706372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:12:57.706950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:12:57.707381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:12:57.724199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:12:57.724698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:12:57.725266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:12:57.726831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:12:57.733654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:12:57.734140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:12:57.788707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Getting quotas for project d335c8cd2fcd4d9d8dcb2265be41dd39. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:12:57.806021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Getting quotas for user fd7806855dac40768b11242a4e00d9e9 and project d335c8cd2fcd4d9d8dcb2265be41dd39. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:12:57.843964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:12:57.846238 n-d-860864-3 devstack@n-api.service[126955]: WARNING nova.utils [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-731009624-access_point-1029082137 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-731009624-acc Oct 11 20:12:57.847041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:12:58.015332 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-239763f2-f659-4711-a5d5-bb7b81d38928 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 5.039714 Oct 11 20:12:58.026375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:12:58.028477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:12:58.028722 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2722/5484] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:12:52 2022] POST /compute/v2.1/servers => generated 457 bytes in 5053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:12:58.034675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a8220c9d-b738-4649-ac1f-6d6cfc0eaf20 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:12:58.035750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a8220c9d-b738-4649-ac1f-6d6cfc0eaf20 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:12:59.164920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a8220c9d-b738-4649-ac1f-6d6cfc0eaf20 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:12:59.177784 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a8220c9d-b738-4649-ac1f-6d6cfc0eaf20 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1294 microversion: 2.1 time: 1.153727 Oct 11 20:12:59.181304 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2763/5485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:12:58 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1294 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:00.223504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-83f58aa2-9b78-4726-80c4-1d5ed153b631 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:00.224146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-83f58aa2-9b78-4726-80c4-1d5ed153b631 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:00.263348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83f58aa2-9b78-4726-80c4-1d5ed153b631 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:00.264247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83f58aa2-9b78-4726-80c4-1d5ed153b631 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:00.264841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83f58aa2-9b78-4726-80c4-1d5ed153b631 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:00.275460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-34e9a8be-e4b6-4a42-bca3-2f485c85c830 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-713086254", "availability_zone": "foo_zone"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:00.281051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.aggregate [None req-34e9a8be-e4b6-4a42-bca3-2f485c85c830 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Generated uuid 2a4f3595-0b04-4a06-a01e-8e7f92f2182f for aggregate {{(pid=126955) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 20:13:00.281341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83f58aa2-9b78-4726-80c4-1d5ed153b631 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:00.281932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83f58aa2-9b78-4726-80c4-1d5ed153b631 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:00.282389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83f58aa2-9b78-4726-80c4-1d5ed153b631 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:00.415218 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-34e9a8be-e4b6-4a42-bca3-2f485c85c830 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.264014 Oct 11 20:13:00.419208 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2723/5486] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 11 20:12:59 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:13:00.431721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2aa11522-34ef-4520-a582-5983cea268dc tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:00.533106 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2aa11522-34ef-4520-a582-5983cea268dc tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.109006 Oct 11 20:13:00.543172 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2724/5487] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 20:13:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:13:00.564561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93dded7b-4ed3-40c9-9fb5-7d74608ed206 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:00.568840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93dded7b-4ed3-40c9-9fb5-7d74608ed206 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:00.583431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93dded7b-4ed3-40c9-9fb5-7d74608ed206 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:00.583907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93dded7b-4ed3-40c9-9fb5-7d74608ed206 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:00.587661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93dded7b-4ed3-40c9-9fb5-7d74608ed206 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:00.588151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93dded7b-4ed3-40c9-9fb5-7d74608ed206 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:00.588592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93dded7b-4ed3-40c9-9fb5-7d74608ed206 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:00.688971 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93dded7b-4ed3-40c9-9fb5-7d74608ed206 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.144591 Oct 11 20:13:00.696403 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2725/5488] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 11 20:13:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:13:00.718075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a906f06d-c8db-4907-8566-d775b30a9049 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:00.737118 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a906f06d-c8db-4907-8566-d775b30a9049 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.032866 Oct 11 20:13:00.740744 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2726/5489] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 11 20:13:00 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:13:00.753922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-741d66bc-d271-4de1-8080-3585a2de204f tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:00.787544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-83f58aa2-9b78-4726-80c4-1d5ed153b631 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:00.804855 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-83f58aa2-9b78-4726-80c4-1d5ed153b631 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1346 microversion: 2.1 time: 0.599127 Oct 11 20:13:00.826747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741d66bc-d271-4de1-8080-3585a2de204f tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:00.828134 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2764/5490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:00 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1346 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:13:00.831163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741d66bc-d271-4de1-8080-3585a2de204f tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:00.833351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-741d66bc-d271-4de1-8080-3585a2de204f tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:01.745216 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-741d66bc-d271-4de1-8080-3585a2de204f tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.997236 Oct 11 20:13:01.748092 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2727/5491] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 20:13:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:13:01.757661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fb5745a5-f185-4e66-8dab-2532eb0246b4 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:01.774392 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fb5745a5-f185-4e66-8dab-2532eb0246b4 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.020746 Oct 11 20:13:01.780516 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2765/5492] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 20:13:01 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:13:01.787451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-091317b9-d8d4-4cdf-930a-a1752a348906 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1174208726", "availability_zone": "foo_zone"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:01.868127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-84f86ad0-d8fc-48f6-aba6-8ebe53b371dd tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:01.869118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-84f86ad0-d8fc-48f6-aba6-8ebe53b371dd tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:01.898159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84f86ad0-d8fc-48f6-aba6-8ebe53b371dd tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:01.898720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84f86ad0-d8fc-48f6-aba6-8ebe53b371dd tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:01.902736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84f86ad0-d8fc-48f6-aba6-8ebe53b371dd tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:01.904835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84f86ad0-d8fc-48f6-aba6-8ebe53b371dd tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:01.906262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84f86ad0-d8fc-48f6-aba6-8ebe53b371dd tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:01.906723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84f86ad0-d8fc-48f6-aba6-8ebe53b371dd tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:01.929134 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-091317b9-d8d4-4cdf-930a-a1752a348906 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.145096 Oct 11 20:13:01.940582 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2728/5493] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 11 20:13:01 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:13:01.963719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5271f14a-e535-4a21-bba2-7433ea592f9c tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:02.040672 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5271f14a-e535-4a21-bba2-7433ea592f9c tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.098828 Oct 11 20:13:02.049413 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2729/5494] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 20:13:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:13:02.062809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dbb3fc92-7efe-477e-bdb5-47b708e7af86 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:02.092012 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dbb3fc92-7efe-477e-bdb5-47b708e7af86 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.040985 Oct 11 20:13:02.097603 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2730/5495] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 11 20:13:02 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:13:02.120885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2f38873-3d05-4506-9252-a912152ddf9a tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860864-3"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:02.159487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-84f86ad0-d8fc-48f6-aba6-8ebe53b371dd tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:02.161260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2f38873-3d05-4506-9252-a912152ddf9a tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:02.163867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2f38873-3d05-4506-9252-a912152ddf9a tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:02.167641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2f38873-3d05-4506-9252-a912152ddf9a tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:02.171931 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-84f86ad0-d8fc-48f6-aba6-8ebe53b371dd tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1356 microversion: 2.1 time: 0.321932 Oct 11 20:13:02.174335 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2766/5496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:01 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1356 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:13:02.453117 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a2f38873-3d05-4506-9252-a912152ddf9a tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.344862 Oct 11 20:13:02.458347 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2731/5497] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 11 20:13:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:13:02.472735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-44a97dfd-4c23-41a4-8751-c9671e293b12 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:02.551410 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-44a97dfd-4c23-41a4-8751-c9671e293b12 tempest-TestAggregatesBasicOps-386283365 tempest-TestAggregatesBasicOps-386283365-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.084427 Oct 11 20:13:02.558822 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2767/5498] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 11 20:13:02 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 20:13:03.203886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dfb56020-6d82-4245-9bd6-2aab39cb9888 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:03.204753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dfb56020-6d82-4245-9bd6-2aab39cb9888 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:03.230113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfb56020-6d82-4245-9bd6-2aab39cb9888 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:03.245400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfb56020-6d82-4245-9bd6-2aab39cb9888 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:03.247289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfb56020-6d82-4245-9bd6-2aab39cb9888 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:03.248069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfb56020-6d82-4245-9bd6-2aab39cb9888 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:03.251224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfb56020-6d82-4245-9bd6-2aab39cb9888 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:03.251911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dfb56020-6d82-4245-9bd6-2aab39cb9888 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:03.866699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dfb56020-6d82-4245-9bd6-2aab39cb9888 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:03.885609 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dfb56020-6d82-4245-9bd6-2aab39cb9888 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1352 microversion: 2.1 time: 0.690293 Oct 11 20:13:03.886486 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2732/5499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:03 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1352 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:04.910496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6b0bb1bf-092b-41dd-b330-79820254d4f1 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:04.911151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6b0bb1bf-092b-41dd-b330-79820254d4f1 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:04.940065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b0bb1bf-092b-41dd-b330-79820254d4f1 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:04.941124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b0bb1bf-092b-41dd-b330-79820254d4f1 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:04.942989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b0bb1bf-092b-41dd-b330-79820254d4f1 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:04.945415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b0bb1bf-092b-41dd-b330-79820254d4f1 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:04.946073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b0bb1bf-092b-41dd-b330-79820254d4f1 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:04.948355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6b0bb1bf-092b-41dd-b330-79820254d4f1 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:05.820412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6b0bb1bf-092b-41dd-b330-79820254d4f1 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:05.830739 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6b0bb1bf-092b-41dd-b330-79820254d4f1 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1471 microversion: 2.1 time: 0.925294 Oct 11 20:13:05.835878 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2768/5500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:04 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1471 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:06.858385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0cf6b22f-b4fb-4370-9494-f3c9534db0c3 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:06.864475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0cf6b22f-b4fb-4370-9494-f3c9534db0c3 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:06.891550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cf6b22f-b4fb-4370-9494-f3c9534db0c3 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:06.892058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cf6b22f-b4fb-4370-9494-f3c9534db0c3 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:06.894319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cf6b22f-b4fb-4370-9494-f3c9534db0c3 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:06.895272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cf6b22f-b4fb-4370-9494-f3c9534db0c3 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:06.898843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cf6b22f-b4fb-4370-9494-f3c9534db0c3 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:06.904581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0cf6b22f-b4fb-4370-9494-f3c9534db0c3 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:07.826067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:13:07.840012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0cf6b22f-b4fb-4370-9494-f3c9534db0c3 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:07.856579 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0cf6b22f-b4fb-4370-9494-f3c9534db0c3 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1471 microversion: 2.1 time: 1.001619 Oct 11 20:13:07.872161 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2733/5501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:06 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1471 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:08.882498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa3a4fcf-4de1-413a-baec-b7e9b2e0f20b tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:08.883825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa3a4fcf-4de1-413a-baec-b7e9b2e0f20b tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:08.901781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3a4fcf-4de1-413a-baec-b7e9b2e0f20b tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:08.903607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3a4fcf-4de1-413a-baec-b7e9b2e0f20b tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:08.904292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3a4fcf-4de1-413a-baec-b7e9b2e0f20b tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:08.906584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3a4fcf-4de1-413a-baec-b7e9b2e0f20b tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:08.918098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3a4fcf-4de1-413a-baec-b7e9b2e0f20b tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:08.918846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa3a4fcf-4de1-413a-baec-b7e9b2e0f20b tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:09.176122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:13:09.671840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa3a4fcf-4de1-413a-baec-b7e9b2e0f20b tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:09.686445 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa3a4fcf-4de1-413a-baec-b7e9b2e0f20b tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1471 microversion: 2.1 time: 0.808468 Oct 11 20:13:09.692038 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2769/5502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:08 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1471 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:10.720594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-00bba3e9-20c0-44e4-b78a-5cbd41c520fc tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:10.726514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-00bba3e9-20c0-44e4-b78a-5cbd41c520fc tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:10.734354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:13:10.756892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00bba3e9-20c0-44e4-b78a-5cbd41c520fc tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:10.758817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00bba3e9-20c0-44e4-b78a-5cbd41c520fc tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:10.762504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00bba3e9-20c0-44e4-b78a-5cbd41c520fc tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:10.765331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00bba3e9-20c0-44e4-b78a-5cbd41c520fc tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:10.766048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00bba3e9-20c0-44e4-b78a-5cbd41c520fc tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:10.769726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00bba3e9-20c0-44e4-b78a-5cbd41c520fc tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:11.173940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a7ac3d90-285c-4c49-a36c-ac730e36195b req-faa651d2-e458-4ea3-b6bf-8dedab865cbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdad379c-bbeb-4e3b-ab9f-d28e863f61a2", "tag": "fc491508-ca2a-4bac-be08-e36f5110737a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:11.216586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a7ac3d90-285c-4c49-a36c-ac730e36195b req-faa651d2-e458-4ea3-b6bf-8dedab865cbf service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:11.217373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a7ac3d90-285c-4c49-a36c-ac730e36195b req-faa651d2-e458-4ea3-b6bf-8dedab865cbf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:11.217978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a7ac3d90-285c-4c49-a36c-ac730e36195b req-faa651d2-e458-4ea3-b6bf-8dedab865cbf service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:11.248916 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a7ac3d90-285c-4c49-a36c-ac730e36195b req-faa651d2-e458-4ea3-b6bf-8dedab865cbf service nova] Creating event network-changed:fc491508-ca2a-4bac-be08-e36f5110737a for instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 on n-h1-860864-3 Oct 11 20:13:11.262342 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a7ac3d90-285c-4c49-a36c-ac730e36195b req-faa651d2-e458-4ea3-b6bf-8dedab865cbf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092044 Oct 11 20:13:11.277099 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2770/5503] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:13:11.297903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-00bba3e9-20c0-44e4-b78a-5cbd41c520fc tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:11.327626 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-00bba3e9-20c0-44e4-b78a-5cbd41c520fc tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1471 microversion: 2.1 time: 0.612312 Oct 11 20:13:11.328295 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2734/5504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:10 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1471 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:12.367563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-00c7ef08-6131-4d44-b87b-c1d3ed7d3e5d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:12.368407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-00c7ef08-6131-4d44-b87b-c1d3ed7d3e5d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:12.387988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c7ef08-6131-4d44-b87b-c1d3ed7d3e5d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:12.388495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c7ef08-6131-4d44-b87b-c1d3ed7d3e5d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:12.388932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c7ef08-6131-4d44-b87b-c1d3ed7d3e5d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:12.403293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c7ef08-6131-4d44-b87b-c1d3ed7d3e5d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:12.404002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c7ef08-6131-4d44-b87b-c1d3ed7d3e5d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:12.404593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00c7ef08-6131-4d44-b87b-c1d3ed7d3e5d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:13.035698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-00c7ef08-6131-4d44-b87b-c1d3ed7d3e5d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:13.050904 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-00c7ef08-6131-4d44-b87b-c1d3ed7d3e5d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1471 microversion: 2.1 time: 0.688657 Oct 11 20:13:13.061652 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2771/5505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:12 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1471 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:14.075234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5a5a1b9-5228-45f4-b913-5025ba155283 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:14.076435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c5a5a1b9-5228-45f4-b913-5025ba155283 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:14.097728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5a5a1b9-5228-45f4-b913-5025ba155283 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:14.098251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5a5a1b9-5228-45f4-b913-5025ba155283 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:14.098768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5a5a1b9-5228-45f4-b913-5025ba155283 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:14.109155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5a5a1b9-5228-45f4-b913-5025ba155283 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:14.109719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5a5a1b9-5228-45f4-b913-5025ba155283 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:14.114207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5a5a1b9-5228-45f4-b913-5025ba155283 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:15.094569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c5a5a1b9-5228-45f4-b913-5025ba155283 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:15.108800 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c5a5a1b9-5228-45f4-b913-5025ba155283 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1471 microversion: 2.1 time: 1.037370 Oct 11 20:13:15.114035 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2735/5506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:14 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1471 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:13:16.135600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bc119f9b-39af-4dbb-882f-75f31b637ea6 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:16.136708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bc119f9b-39af-4dbb-882f-75f31b637ea6 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:16.155064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc119f9b-39af-4dbb-882f-75f31b637ea6 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:16.155951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc119f9b-39af-4dbb-882f-75f31b637ea6 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:16.156646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc119f9b-39af-4dbb-882f-75f31b637ea6 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:16.157560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc119f9b-39af-4dbb-882f-75f31b637ea6 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:16.158175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc119f9b-39af-4dbb-882f-75f31b637ea6 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:16.158795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bc119f9b-39af-4dbb-882f-75f31b637ea6 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:16.770653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bc119f9b-39af-4dbb-882f-75f31b637ea6 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:16.781261 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bc119f9b-39af-4dbb-882f-75f31b637ea6 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1471 microversion: 2.1 time: 0.651665 Oct 11 20:13:16.781862 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2772/5507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:16 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1471 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:17.812989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-718437d3-a5be-40b5-a6bc-bbf81ce7d937 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:17.814148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-718437d3-a5be-40b5-a6bc-bbf81ce7d937 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:17.834513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718437d3-a5be-40b5-a6bc-bbf81ce7d937 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:17.836158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718437d3-a5be-40b5-a6bc-bbf81ce7d937 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:17.837934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718437d3-a5be-40b5-a6bc-bbf81ce7d937 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:17.839464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718437d3-a5be-40b5-a6bc-bbf81ce7d937 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:17.840934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718437d3-a5be-40b5-a6bc-bbf81ce7d937 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:17.843913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-718437d3-a5be-40b5-a6bc-bbf81ce7d937 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:18.379534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-718437d3-a5be-40b5-a6bc-bbf81ce7d937 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:18.413572 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-718437d3-a5be-40b5-a6bc-bbf81ce7d937 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1471 microversion: 2.1 time: 0.589607 Oct 11 20:13:18.418557 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2736/5508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:17 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1471 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:19.136642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d4896114-9d66-4d34-a3b8-6f083e2027d1 req-1a62b943-864d-44da-80f1-4752f976d1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdad379c-bbeb-4e3b-ab9f-d28e863f61a2", "name": "network-vif-plugged", "status": "completed", "tag": "fc491508-ca2a-4bac-be08-e36f5110737a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:19.165216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d4896114-9d66-4d34-a3b8-6f083e2027d1 req-1a62b943-864d-44da-80f1-4752f976d1ce service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:19.166058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d4896114-9d66-4d34-a3b8-6f083e2027d1 req-1a62b943-864d-44da-80f1-4752f976d1ce service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:19.171046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d4896114-9d66-4d34-a3b8-6f083e2027d1 req-1a62b943-864d-44da-80f1-4752f976d1ce service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:19.211063 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d4896114-9d66-4d34-a3b8-6f083e2027d1 req-1a62b943-864d-44da-80f1-4752f976d1ce service nova] Creating event network-vif-plugged:fc491508-ca2a-4bac-be08-e36f5110737a for instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 on n-h1-860864-3 Oct 11 20:13:19.226089 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d4896114-9d66-4d34-a3b8-6f083e2027d1 req-1a62b943-864d-44da-80f1-4752f976d1ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094890 Oct 11 20:13:19.226374 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2773/5509] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:13:19.441210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1e66ee80-b2b5-457d-b582-19b5e5e1b54c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:19.441704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1e66ee80-b2b5-457d-b582-19b5e5e1b54c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:19.456818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e66ee80-b2b5-457d-b582-19b5e5e1b54c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:19.457504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e66ee80-b2b5-457d-b582-19b5e5e1b54c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:19.457954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e66ee80-b2b5-457d-b582-19b5e5e1b54c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:19.463881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e66ee80-b2b5-457d-b582-19b5e5e1b54c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:19.464608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e66ee80-b2b5-457d-b582-19b5e5e1b54c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:19.465766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e66ee80-b2b5-457d-b582-19b5e5e1b54c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:20.837777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e66ee80-b2b5-457d-b582-19b5e5e1b54c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:20.866590 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1e66ee80-b2b5-457d-b582-19b5e5e1b54c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1471 microversion: 2.1 time: 1.415757 Oct 11 20:13:20.867271 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2737/5510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:19 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1471 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:21.917946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9554ab55-dbcd-4857-b237-9a80320a30c7 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:21.919344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9554ab55-dbcd-4857-b237-9a80320a30c7 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:21.947009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9554ab55-dbcd-4857-b237-9a80320a30c7 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:21.949701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9554ab55-dbcd-4857-b237-9a80320a30c7 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:21.952243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9554ab55-dbcd-4857-b237-9a80320a30c7 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:21.957985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9554ab55-dbcd-4857-b237-9a80320a30c7 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:21.961889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9554ab55-dbcd-4857-b237-9a80320a30c7 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:21.962959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9554ab55-dbcd-4857-b237-9a80320a30c7 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:22.313278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9554ab55-dbcd-4857-b237-9a80320a30c7 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:22.327499 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9554ab55-dbcd-4857-b237-9a80320a30c7 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1643 microversion: 2.1 time: 0.437895 Oct 11 20:13:22.349749 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2774/5511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:21 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1643 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:22.357573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e6f96b6e-1199-44e8-81a7-d6a50818da76 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:22.358256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e6f96b6e-1199-44e8-81a7-d6a50818da76 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:22.388963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6f96b6e-1199-44e8-81a7-d6a50818da76 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:22.389772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6f96b6e-1199-44e8-81a7-d6a50818da76 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:22.391833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6f96b6e-1199-44e8-81a7-d6a50818da76 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:22.392700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6f96b6e-1199-44e8-81a7-d6a50818da76 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:22.395329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6f96b6e-1199-44e8-81a7-d6a50818da76 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:22.396028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6f96b6e-1199-44e8-81a7-d6a50818da76 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:22.783955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e6f96b6e-1199-44e8-81a7-d6a50818da76 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:13:22.802849 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e6f96b6e-1199-44e8-81a7-d6a50818da76 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1643 microversion: 2.1 time: 0.449278 Oct 11 20:13:22.804146 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2738/5512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:22 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1643 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:13:22.839210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3f2a5d4d-f4c2-4df9-b375-4af62808e0de tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:13:22.839871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3f2a5d4d-f4c2-4df9-b375-4af62808e0de tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:13:22.860815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f2a5d4d-f4c2-4df9-b375-4af62808e0de tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:22.861510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f2a5d4d-f4c2-4df9-b375-4af62808e0de tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:22.862075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f2a5d4d-f4c2-4df9-b375-4af62808e0de tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:22.863071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f2a5d4d-f4c2-4df9-b375-4af62808e0de tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:22.864511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f2a5d4d-f4c2-4df9-b375-4af62808e0de tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:22.882491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f2a5d4d-f4c2-4df9-b375-4af62808e0de tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:23.961695 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3f2a5d4d-f4c2-4df9-b375-4af62808e0de tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1794 microversion: 2.1 time: 1.135430 Oct 11 20:13:23.962284 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2775/5513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:13:22 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1794 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:13:32.363751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:13:32.733125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b61e80a6-c0cd-4b09-a3aa-d2722d8053ad req-ea152172-47db-4838-afd1-ca0c1d2b4d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdad379c-bbeb-4e3b-ab9f-d28e863f61a2", "tag": "fc491508-ca2a-4bac-be08-e36f5110737a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:32.751832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b61e80a6-c0cd-4b09-a3aa-d2722d8053ad req-ea152172-47db-4838-afd1-ca0c1d2b4d0f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:13:32.752319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b61e80a6-c0cd-4b09-a3aa-d2722d8053ad req-ea152172-47db-4838-afd1-ca0c1d2b4d0f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:13:32.752752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b61e80a6-c0cd-4b09-a3aa-d2722d8053ad req-ea152172-47db-4838-afd1-ca0c1d2b4d0f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:13:32.760863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=55 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:13:32.779693 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b61e80a6-c0cd-4b09-a3aa-d2722d8053ad req-ea152172-47db-4838-afd1-ca0c1d2b4d0f service nova] Creating event network-changed:fc491508-ca2a-4bac-be08-e36f5110737a for instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 on n-h1-860864-3 Oct 11 20:13:32.785360 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b61e80a6-c0cd-4b09-a3aa-d2722d8053ad req-ea152172-47db-4838-afd1-ca0c1d2b4d0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.559481 Oct 11 20:13:32.787171 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2739/5514] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:13:50.967027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-df35b8fd-a04b-4f91-9515-0f2e57b42f0e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Action: 'create', calling method: .version_select at 0x7f83d0835790>, body: {"keypair": {"name": "tempest-keypair-707565461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6LfUwV0tKehJpCoz1x2m4MEH2bHCiAbEzw9Ftv4ZWLttqcCymUTpx5x9f6WTFttJVEbaDbhiN0jW/LmkKcyceQUvP/WFc54RNJTQzsp6e1Z9B3g5Pv8pTBGTrdPtYLaw=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:50.994419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:13:50.996063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=52 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:13:51.027112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-df35b8fd-a04b-4f91-9515-0f2e57b42f0e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Getting quotas for project f578e847eaa0405b8c48f4ea3376fddb. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:13:51.052595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-df35b8fd-a04b-4f91-9515-0f2e57b42f0e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Getting quotas for user 0306ac1c267f43f29c900c5be79d6632 and project f578e847eaa0405b8c48f4ea3376fddb. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:13:51.124954 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-df35b8fd-a04b-4f91-9515-0f2e57b42f0e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.164210 Oct 11 20:13:51.125997 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2776/5515] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 11 20:13:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 20:13:55.017119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:13:55.017945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:13:55.023444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2115062074", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "96a56304-5e5a-4fd4-b75d-9bfc695ca0c5"}, {"port": "96aca859-3df9-41c7-b0cd-69c7066a479e", "tag": "port-1"}, {"port": "515311c4-0873-40ab-bfc7-a6fded0e43a1", "tag": "port-2"}, {"uuid": "7cfb6e76-621c-410e-846b-c7be60ae8e27", "tag": "net-1"}, {"uuid": "7cfb6e76-621c-410e-846b-c7be60ae8e27"}, {"uuid": "26aa455d-c569-4860-a0bc-79e563e99d6a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "26aa455d-c569-4860-a0bc-79e563e99d6a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "de58bbfb-ee36-4531-9963-078c06cda1f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "759dcd0a-8bd3-4e56-994d-71e6778171ea", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "94aa4e49-340b-4a61-9e8d-419cbfd3a7c1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1367008926"}], "key_name": "tempest-keypair-707565461", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:13:55.388950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] validate_networks() for [('96a56304-5e5a-4fd4-b75d-9bfc695ca0c5', None, None, None, None, None), (None, None, '96aca859-3df9-41c7-b0cd-69c7066a479e', None, None, None), (None, None, '515311c4-0873-40ab-bfc7-a6fded0e43a1', None, None, None), ('7cfb6e76-621c-410e-846b-c7be60ae8e27', None, None, None, None, None), ('7cfb6e76-621c-410e-846b-c7be60ae8e27', None, None, None, None, None), ('26aa455d-c569-4860-a0bc-79e563e99d6a', '10.2.2.100', None, None, None, None), ('26aa455d-c569-4860-a0bc-79e563e99d6a', '10.2.2.200', None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:14:02.228307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:14:02.229024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:14:02.229364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:14:02.229581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:14:02.229997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:14:02.252845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:02.253438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:02.253879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:02.254820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:02.255458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:02.256051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:02.321480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Getting quotas for project f578e847eaa0405b8c48f4ea3376fddb. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:14:02.340843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Getting quotas for user 0306ac1c267f43f29c900c5be79d6632 and project f578e847eaa0405b8c48f4ea3376fddb. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:14:02.663287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:14:02.666433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='de58bbfb-ee36-4531-9963-078c06cda1f9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='759dcd0a-8bd3-4e56-994d-71e6778171ea',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94aa4e49-340b-4a61-9e8d-419cbfd3a7c1',volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:14:03.325557 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-95cc4fad-b123-479e-a3a5-7ba91c7a4973 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.310484 Oct 11 20:14:03.329183 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2740/5516] 10.222.0.27 () {62 vars in 1189 bytes} [Tue Oct 11 20:13:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 8315 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 11 20:14:03.341876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7678211a-4520-42bb-b6e3-c62cd2c5768d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:03.343422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7678211a-4520-42bb-b6e3-c62cd2c5768d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:03.355126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:03.356268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:03.533892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7678211a-4520-42bb-b6e3-c62cd2c5768d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:03.551576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7678211a-4520-42bb-b6e3-c62cd2c5768d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:03.556515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7678211a-4520-42bb-b6e3-c62cd2c5768d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:03.559352 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7678211a-4520-42bb-b6e3-c62cd2c5768d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1285 microversion: 2.42 time: 0.222440 Oct 11 20:14:03.562366 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2777/5517] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:03 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:04.593196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d55f09d5-59ab-4fef-ad38-4655a37616f5 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:04.593824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d55f09d5-59ab-4fef-ad38-4655a37616f5 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:04.688859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d55f09d5-59ab-4fef-ad38-4655a37616f5 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:04.726202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d55f09d5-59ab-4fef-ad38-4655a37616f5 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:04.728128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d55f09d5-59ab-4fef-ad38-4655a37616f5 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:04.734146 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d55f09d5-59ab-4fef-ad38-4655a37616f5 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1285 microversion: 2.42 time: 0.146048 Oct 11 20:14:04.738136 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2741/5518] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:04 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:05.770559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:05.771236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:05.786164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:05.787094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:05.789246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:05.790657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:05.792800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:05.795770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:06.170836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:06.170836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:06.170836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:06.186060 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1a3be648-897d-4e35-9180-2cfdcd58a014 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1575 microversion: 2.42 time: 0.412372 Oct 11 20:14:06.186060 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2778/5519] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:05 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1575 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:07.212233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:07.212856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:07.232320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:07.233213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:07.233880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:07.234825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:07.235482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:07.236276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:07.949830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:07.963523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:07.965739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:07.967299 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c1180f8b-ea35-4b83-ab35-18d10b23420b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1593 microversion: 2.42 time: 0.759058 Oct 11 20:14:07.969255 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2742/5520] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:07 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1593 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:08.999614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:09.001545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:09.016381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:09.019306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:09.019953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:09.020703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:09.021233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:09.022195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:09.697091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:09.747062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:09.753817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:09.760780 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f378b68e-038d-4c3a-ae2c-1b205a3cd6e1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1593 microversion: 2.42 time: 0.765231 Oct 11 20:14:09.762065 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2779/5521] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:08 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1593 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:10.796053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:10.797488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:10.808537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:10.809310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:10.809917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:10.810819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:10.818882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:10.819586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:11.551190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:11.561610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:11.572367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:11.574108 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-06a83f85-60dc-40ad-b4c3-5edb77bafc57 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1661 microversion: 2.42 time: 0.782006 Oct 11 20:14:11.575256 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2743/5522] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:10 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1661 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:12.605553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:12.605987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:12.619099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:12.623421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:12.623879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:12.624665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:12.625136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:12.625563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:13.204679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:13.225810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:13.234742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:13.239643 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6df917e0-48b6-479d-9039-e316ddc47b83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1661 microversion: 2.42 time: 0.635343 Oct 11 20:14:13.242839 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2780/5523] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:12 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1661 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:14.272142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:14.272798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:14.310021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:14.312863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:14.313373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:14.313821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:14.314750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:14.315549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:14.316141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:14.694079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:14.829349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:14.839498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:14.851776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:14.853421 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b7672706-4407-4765-a4da-590b30ba551d tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1661 microversion: 2.42 time: 0.585957 Oct 11 20:14:14.854673 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2744/5524] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:14 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1661 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:15.885200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:15.885831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:15.889296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:15.904739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:15.905306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:15.908759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:15.909534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:15.912446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:15.913115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:16.696222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:16.718650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:16.726688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:16.728648 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cede809c-3619-4969-b050-3e7aaf32df64 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1708 microversion: 2.42 time: 0.847815 Oct 11 20:14:16.729263 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2781/5525] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:15 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1708 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:16.845558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1389895556", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "84783fff-0e95-42db-a72a-5dc5b4adfa2a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2120499800", "security_groups": []}, "os:scheduler_hints": {"different_host": ["bdad379c-bbeb-4e3b-ab9f-d28e863f61a2"]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:14:16.921126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] validate_networks() for [('84783fff-0e95-42db-a72a-5dc5b4adfa2a', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:14:17.762573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:17.763769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:17.782089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:17.782818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:17.788671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:17.791365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:17.791865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:17.792311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:18.135533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:14:18.136133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:14:18.136424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:14:18.137273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:14:18.137851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:14:18.163530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:18.165113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:18.165764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:18.166741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:18.167367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:18.167959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:18.220413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Getting quotas for project d335c8cd2fcd4d9d8dcb2265be41dd39. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:14:18.234503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Getting quotas for user fd7806855dac40768b11242a4e00d9e9 and project d335c8cd2fcd4d9d8dcb2265be41dd39. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:14:18.261223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:14:18.263651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:14:18.380698 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ab40aa2f-fa6d-4162-ab89-4175d208c071 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.536596 Oct 11 20:14:18.382200 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2745/5526] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:14:16 2022] POST /compute/v2.1/servers => generated 361 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:14:18.395351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bacae254-3f26-43e6-bcb4-b3a7e64bb963 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:18.396392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bacae254-3f26-43e6-bcb4-b3a7e64bb963 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:18.654782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bacae254-3f26-43e6-bcb4-b3a7e64bb963 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:18.684210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:18.691741 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bacae254-3f26-43e6-bcb4-b3a7e64bb963 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1242 microversion: 2.1 time: 0.293934 Oct 11 20:14:18.694130 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2746/5527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:18 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1242 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:18.700672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:18.704232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:18.707522 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f08dc32b-fb0b-471a-b083-244be0308a61 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1708 microversion: 2.42 time: 0.949672 Oct 11 20:14:18.720681 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2782/5528] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:17 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1708 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:14:19.719012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cecdec1c-b06a-48b2-a7e9-a8e49eabb295 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:19.720278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cecdec1c-b06a-48b2-a7e9-a8e49eabb295 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:19.740007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:19.740686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:19.766104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cecdec1c-b06a-48b2-a7e9-a8e49eabb295 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:19.767533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cecdec1c-b06a-48b2-a7e9-a8e49eabb295 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:19.770286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:19.770950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:19.771775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cecdec1c-b06a-48b2-a7e9-a8e49eabb295 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:19.774514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cecdec1c-b06a-48b2-a7e9-a8e49eabb295 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:19.775169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:19.778141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:19.779808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:19.781334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:19.781480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cecdec1c-b06a-48b2-a7e9-a8e49eabb295 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:19.784883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cecdec1c-b06a-48b2-a7e9-a8e49eabb295 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:20.191009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cecdec1c-b06a-48b2-a7e9-a8e49eabb295 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:20.199717 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cecdec1c-b06a-48b2-a7e9-a8e49eabb295 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1238 microversion: 2.1 time: 0.484669 Oct 11 20:14:20.203211 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2747/5529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:19 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1238 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:20.869445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:20.892778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:20.904822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:20.908846 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7f4c8cea-1fdc-4e87-a611-042a721f7dc4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1755 microversion: 2.42 time: 1.172727 Oct 11 20:14:20.914582 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2783/5530] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:19 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1755 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:14:21.227965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-127a9aef-5c38-4400-8277-0491aea5b430 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:21.228782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-127a9aef-5c38-4400-8277-0491aea5b430 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:21.247027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-127a9aef-5c38-4400-8277-0491aea5b430 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:21.247999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-127a9aef-5c38-4400-8277-0491aea5b430 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:21.248147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-127a9aef-5c38-4400-8277-0491aea5b430 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:21.248817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-127a9aef-5c38-4400-8277-0491aea5b430 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:21.259792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-127a9aef-5c38-4400-8277-0491aea5b430 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:21.260522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-127a9aef-5c38-4400-8277-0491aea5b430 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:21.498470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-127a9aef-5c38-4400-8277-0491aea5b430 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:21.509390 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-127a9aef-5c38-4400-8277-0491aea5b430 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1300 microversion: 2.1 time: 0.286527 Oct 11 20:14:21.513677 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2748/5531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:21 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1300 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:21.946182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:21.947009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:21.970009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:21.971926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:21.973348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:21.974371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:21.976174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:21.977522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:22.535906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a68def1-197d-47a7-856e-b43801605f93 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:22.536535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a68def1-197d-47a7-856e-b43801605f93 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:22.552527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a68def1-197d-47a7-856e-b43801605f93 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:22.553055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a68def1-197d-47a7-856e-b43801605f93 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:22.553505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a68def1-197d-47a7-856e-b43801605f93 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:22.559843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a68def1-197d-47a7-856e-b43801605f93 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:22.564924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a68def1-197d-47a7-856e-b43801605f93 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:22.565744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a68def1-197d-47a7-856e-b43801605f93 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:23.559547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:23.585968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:23.588044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4a68def1-197d-47a7-856e-b43801605f93 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:23.593514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:23.597078 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a68def1-197d-47a7-856e-b43801605f93 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1300 microversion: 2.1 time: 1.065742 Oct 11 20:14:23.611951 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-54e1b293-91c4-42fd-a983-beba766db1e6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1755 microversion: 2.42 time: 1.662116 Oct 11 20:14:23.611951 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2784/5532] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:21 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1755 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:23.617935 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2749/5533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:22 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1300 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:24.618963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-15ec864f-9fa1-43e8-911f-b8c89f1012e8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:24.620299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-15ec864f-9fa1-43e8-911f-b8c89f1012e8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:24.629563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:24.630130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:24.648139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15ec864f-9fa1-43e8-911f-b8c89f1012e8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:24.653095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:24.653607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:24.654056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:24.655279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15ec864f-9fa1-43e8-911f-b8c89f1012e8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:24.655800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15ec864f-9fa1-43e8-911f-b8c89f1012e8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:24.656542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15ec864f-9fa1-43e8-911f-b8c89f1012e8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:24.657010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15ec864f-9fa1-43e8-911f-b8c89f1012e8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:24.657445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-15ec864f-9fa1-43e8-911f-b8c89f1012e8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:24.663272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:24.664092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:24.664780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:25.572731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-15ec864f-9fa1-43e8-911f-b8c89f1012e8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:25.583092 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-15ec864f-9fa1-43e8-911f-b8c89f1012e8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1300 microversion: 2.1 time: 0.968114 Oct 11 20:14:25.583697 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2785/5534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:24 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1300 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:25.808576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:25.827556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=45 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:25.837015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:25.843819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:25.845278 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ed2c5088-3b59-4e96-a685-f4ee6ea81e09 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1802 microversion: 2.42 time: 1.221434 Oct 11 20:14:25.848737 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2750/5535] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:24 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1802 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:14:26.259070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c6374020-e752-4253-9495-9ac83dbc19c8 req-dc14c96d-5d3f-4069-9291-01d4aa61f82c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44440d4-c481-4512-bcc2-557983981de8", "tag": "67bf6bc9-0aa0-4b20-aa2f-fda2f686d16e"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:14:26.297139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c6374020-e752-4253-9495-9ac83dbc19c8 req-dc14c96d-5d3f-4069-9291-01d4aa61f82c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:26.299232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c6374020-e752-4253-9495-9ac83dbc19c8 req-dc14c96d-5d3f-4069-9291-01d4aa61f82c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:26.301794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c6374020-e752-4253-9495-9ac83dbc19c8 req-dc14c96d-5d3f-4069-9291-01d4aa61f82c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:26.319208 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c6374020-e752-4253-9495-9ac83dbc19c8 req-dc14c96d-5d3f-4069-9291-01d4aa61f82c service nova] Creating event network-changed:67bf6bc9-0aa0-4b20-aa2f-fda2f686d16e for instance c44440d4-c481-4512-bcc2-557983981de8 on n-h2-860864-3 Oct 11 20:14:26.328958 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c6374020-e752-4253-9495-9ac83dbc19c8 req-dc14c96d-5d3f-4069-9291-01d4aa61f82c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073682 Oct 11 20:14:26.332413 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2786/5536] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:14:26.607710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-798629f7-0ed2-4acf-bbb6-4c723a890776 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:26.608049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-798629f7-0ed2-4acf-bbb6-4c723a890776 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:26.621603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:26.624397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-798629f7-0ed2-4acf-bbb6-4c723a890776 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:26.624901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-798629f7-0ed2-4acf-bbb6-4c723a890776 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:26.625347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-798629f7-0ed2-4acf-bbb6-4c723a890776 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:26.626076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-798629f7-0ed2-4acf-bbb6-4c723a890776 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:26.637166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-798629f7-0ed2-4acf-bbb6-4c723a890776 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:26.637636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-798629f7-0ed2-4acf-bbb6-4c723a890776 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:26.877842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:26.878570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:26.907200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:26.910473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:26.912248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:26.913454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:26.914172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:26.914899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:26.931620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-798629f7-0ed2-4acf-bbb6-4c723a890776 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:26.946078 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-798629f7-0ed2-4acf-bbb6-4c723a890776 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1300 microversion: 2.1 time: 0.342966 Oct 11 20:14:26.950298 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2751/5537] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:26 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1300 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:27.500235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:27.542377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:27.543873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:27.545069 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9f79e277-d93d-449a-9d0b-6c490870b767 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1802 microversion: 2.42 time: 0.673818 Oct 11 20:14:27.549880 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2787/5538] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:26 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1802 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:27.975042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b014170f-229f-435c-9918-8b8e2fe19462 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:27.976513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b014170f-229f-435c-9918-8b8e2fe19462 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:27.988728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b014170f-229f-435c-9918-8b8e2fe19462 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:27.990348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b014170f-229f-435c-9918-8b8e2fe19462 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:27.993050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b014170f-229f-435c-9918-8b8e2fe19462 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:27.993852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b014170f-229f-435c-9918-8b8e2fe19462 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:27.994499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b014170f-229f-435c-9918-8b8e2fe19462 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:27.996002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b014170f-229f-435c-9918-8b8e2fe19462 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:28.150199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b014170f-229f-435c-9918-8b8e2fe19462 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:28.162749 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b014170f-229f-435c-9918-8b8e2fe19462 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1300 microversion: 2.1 time: 0.190691 Oct 11 20:14:28.163350 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2752/5539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:27 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1300 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:28.573323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:28.574605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:28.590848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:28.591630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:28.593754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:28.594563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:28.597756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:28.598475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:29.186153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e348615-7d7d-4ee2-a134-e2359554947d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:29.186794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9e348615-7d7d-4ee2-a134-e2359554947d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:29.188872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:29.190341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:29.217607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e348615-7d7d-4ee2-a134-e2359554947d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:29.219718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e348615-7d7d-4ee2-a134-e2359554947d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:29.227276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e348615-7d7d-4ee2-a134-e2359554947d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:29.230399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e348615-7d7d-4ee2-a134-e2359554947d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:29.231145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e348615-7d7d-4ee2-a134-e2359554947d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:29.231895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e348615-7d7d-4ee2-a134-e2359554947d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:29.742734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:29.765035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:29.771272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:29.785894 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4d2c5825-032c-43f1-8490-0cb1d054e785 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1849 microversion: 2.42 time: 1.204849 Oct 11 20:14:29.788952 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2788/5540] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:28 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1849 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:29.795147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9e348615-7d7d-4ee2-a134-e2359554947d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:29.804006 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9e348615-7d7d-4ee2-a134-e2359554947d tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1300 microversion: 2.1 time: 0.622587 Oct 11 20:14:29.818040 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2753/5541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:29 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1300 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:14:30.149627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-37cd0021-a126-421c-8ad1-b1b2f98f2534 req-4f5baa24-5778-4477-8c63-0780ad642896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "tag": "3049eb54-be5a-4d03-bf78-e039710b3c76"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:14:30.172202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-37cd0021-a126-421c-8ad1-b1b2f98f2534 req-4f5baa24-5778-4477-8c63-0780ad642896 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:30.175527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-37cd0021-a126-421c-8ad1-b1b2f98f2534 req-4f5baa24-5778-4477-8c63-0780ad642896 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:30.178975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-37cd0021-a126-421c-8ad1-b1b2f98f2534 req-4f5baa24-5778-4477-8c63-0780ad642896 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:30.210699 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-37cd0021-a126-421c-8ad1-b1b2f98f2534 req-4f5baa24-5778-4477-8c63-0780ad642896 service nova] Creating event network-changed:3049eb54-be5a-4d03-bf78-e039710b3c76 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:14:30.219384 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-37cd0021-a126-421c-8ad1-b1b2f98f2534 req-4f5baa24-5778-4477-8c63-0780ad642896 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081934 Oct 11 20:14:30.220008 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2789/5542] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:14:30.815187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:30.815862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:30.828526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:30.831995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:30.833814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:30.835278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:30.837075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:30.839160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:30.839464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8130914e-233f-43bf-9dd8-329af0931032 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:30.840396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8130914e-233f-43bf-9dd8-329af0931032 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:30.863103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8130914e-233f-43bf-9dd8-329af0931032 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:30.866311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8130914e-233f-43bf-9dd8-329af0931032 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:30.867156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8130914e-233f-43bf-9dd8-329af0931032 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:30.871110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8130914e-233f-43bf-9dd8-329af0931032 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:30.871637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8130914e-233f-43bf-9dd8-329af0931032 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:30.872088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8130914e-233f-43bf-9dd8-329af0931032 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:31.749037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8130914e-233f-43bf-9dd8-329af0931032 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:31.761295 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8130914e-233f-43bf-9dd8-329af0931032 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1300 microversion: 2.1 time: 0.928327 Oct 11 20:14:31.771324 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2790/5543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:30 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1300 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:32.286250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a25c2a73-ba78-40ca-aa79-2e63d5a5977a req-683e9c52-a7e0-4446-ac4e-e184e68c59e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "tag": "96aca859-3df9-41c7-b0cd-69c7066a479e"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:14:32.310669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a25c2a73-ba78-40ca-aa79-2e63d5a5977a req-683e9c52-a7e0-4446-ac4e-e184e68c59e1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:32.311223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a25c2a73-ba78-40ca-aa79-2e63d5a5977a req-683e9c52-a7e0-4446-ac4e-e184e68c59e1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:32.311776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a25c2a73-ba78-40ca-aa79-2e63d5a5977a req-683e9c52-a7e0-4446-ac4e-e184e68c59e1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:32.339802 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a25c2a73-ba78-40ca-aa79-2e63d5a5977a req-683e9c52-a7e0-4446-ac4e-e184e68c59e1 service nova] Creating event network-changed:96aca859-3df9-41c7-b0cd-69c7066a479e for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:14:32.358243 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a25c2a73-ba78-40ca-aa79-2e63d5a5977a req-683e9c52-a7e0-4446-ac4e-e184e68c59e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075611 Oct 11 20:14:32.358652 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2791/5544] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:14:32.667247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:32.705657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:32.715231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:32.722647 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5204e667-33f8-4a7b-a676-5a3e8a889638 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1870 microversion: 2.42 time: 1.908340 Oct 11 20:14:32.723675 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2754/5545] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:30 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1870 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:32.797861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9d852932-e1d1-47ab-a4d9-7a643d0445c8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:32.797861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9d852932-e1d1-47ab-a4d9-7a643d0445c8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:32.810094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d852932-e1d1-47ab-a4d9-7a643d0445c8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:32.810631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d852932-e1d1-47ab-a4d9-7a643d0445c8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:32.811083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d852932-e1d1-47ab-a4d9-7a643d0445c8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:32.813054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d852932-e1d1-47ab-a4d9-7a643d0445c8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:32.818659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d852932-e1d1-47ab-a4d9-7a643d0445c8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:32.819270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9d852932-e1d1-47ab-a4d9-7a643d0445c8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:33.007157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9d852932-e1d1-47ab-a4d9-7a643d0445c8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:33.018015 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9d852932-e1d1-47ab-a4d9-7a643d0445c8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1300 microversion: 2.1 time: 0.225852 Oct 11 20:14:33.021501 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2792/5546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:32 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1300 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:33.586341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-9a1a8f21-2610-43ef-8bfd-cb9f6e50d76c req-e8cc5013-4068-46e7-b9ed-341358fae531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44440d4-c481-4512-bcc2-557983981de8", "name": "network-vif-plugged", "status": "completed", "tag": "67bf6bc9-0aa0-4b20-aa2f-fda2f686d16e"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:14:33.609589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9a1a8f21-2610-43ef-8bfd-cb9f6e50d76c req-e8cc5013-4068-46e7-b9ed-341358fae531 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:33.610080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9a1a8f21-2610-43ef-8bfd-cb9f6e50d76c req-e8cc5013-4068-46e7-b9ed-341358fae531 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:33.610587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9a1a8f21-2610-43ef-8bfd-cb9f6e50d76c req-e8cc5013-4068-46e7-b9ed-341358fae531 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:33.635796 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-9a1a8f21-2610-43ef-8bfd-cb9f6e50d76c req-e8cc5013-4068-46e7-b9ed-341358fae531 service nova] Creating event network-vif-plugged:67bf6bc9-0aa0-4b20-aa2f-fda2f686d16e for instance c44440d4-c481-4512-bcc2-557983981de8 on n-h2-860864-3 Oct 11 20:14:33.651164 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-9a1a8f21-2610-43ef-8bfd-cb9f6e50d76c req-e8cc5013-4068-46e7-b9ed-341358fae531 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.378325 Oct 11 20:14:33.651956 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2755/5547] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:14:33.752713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:33.754202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:33.757466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=35 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:33.773975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:33.774718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:33.775281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:33.776116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:33.779406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:33.780729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:33.792047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=79 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:34.045822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-037fbf52-56a9-4f6d-8b99-2c3703a521ed tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:34.046501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-037fbf52-56a9-4f6d-8b99-2c3703a521ed tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:34.066825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-037fbf52-56a9-4f6d-8b99-2c3703a521ed tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:34.067639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-037fbf52-56a9-4f6d-8b99-2c3703a521ed tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:34.068154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-037fbf52-56a9-4f6d-8b99-2c3703a521ed tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:34.068940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-037fbf52-56a9-4f6d-8b99-2c3703a521ed tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:34.069470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-037fbf52-56a9-4f6d-8b99-2c3703a521ed tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:34.069966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-037fbf52-56a9-4f6d-8b99-2c3703a521ed tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:34.680857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-037fbf52-56a9-4f6d-8b99-2c3703a521ed tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:34.710314 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-037fbf52-56a9-4f6d-8b99-2c3703a521ed tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1300 microversion: 2.1 time: 0.664858 Oct 11 20:14:34.711108 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2756/5548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:34 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1300 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:14:34.719597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-2ff0887d-c2ce-481b-9b7f-e8965aae1ee5 req-04e5c3a8-bdf8-41a6-b5a3-9a817f17e0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "tag": "515311c4-0873-40ab-bfc7-a6fded0e43a1"}, {"name": "network-changed", "server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "tag": "89c7d311-868d-471c-b3ab-790ad9c4f18b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:14:34.744237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2ff0887d-c2ce-481b-9b7f-e8965aae1ee5 req-04e5c3a8-bdf8-41a6-b5a3-9a817f17e0f2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:34.744879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2ff0887d-c2ce-481b-9b7f-e8965aae1ee5 req-04e5c3a8-bdf8-41a6-b5a3-9a817f17e0f2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:34.745415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2ff0887d-c2ce-481b-9b7f-e8965aae1ee5 req-04e5c3a8-bdf8-41a6-b5a3-9a817f17e0f2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:34.766052 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2ff0887d-c2ce-481b-9b7f-e8965aae1ee5 req-04e5c3a8-bdf8-41a6-b5a3-9a817f17e0f2 service nova] Creating event network-changed:515311c4-0873-40ab-bfc7-a6fded0e43a1 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:14:34.770802 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2ff0887d-c2ce-481b-9b7f-e8965aae1ee5 req-04e5c3a8-bdf8-41a6-b5a3-9a817f17e0f2 service nova] Creating event network-changed:89c7d311-868d-471c-b3ab-790ad9c4f18b for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:14:34.787719 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-2ff0887d-c2ce-481b-9b7f-e8965aae1ee5 req-04e5c3a8-bdf8-41a6-b5a3-9a817f17e0f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075148 Oct 11 20:14:34.788738 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2757/5549] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:14:35.209139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:35.228592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:35.233123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:35.236483 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-88b060d9-cba0-449f-89ef-07223ef96d1f tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1891 microversion: 2.42 time: 1.489187 Oct 11 20:14:35.264609 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2793/5550] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:33 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1891 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:35.743566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3add5bf8-02da-4804-b725-014c9138f686 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:35.744862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3add5bf8-02da-4804-b725-014c9138f686 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:35.757133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3add5bf8-02da-4804-b725-014c9138f686 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:35.757631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3add5bf8-02da-4804-b725-014c9138f686 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:35.758069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3add5bf8-02da-4804-b725-014c9138f686 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:35.758798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3add5bf8-02da-4804-b725-014c9138f686 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:35.763135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3add5bf8-02da-4804-b725-014c9138f686 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:35.768822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3add5bf8-02da-4804-b725-014c9138f686 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:36.103632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3add5bf8-02da-4804-b725-014c9138f686 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:36.120387 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3add5bf8-02da-4804-b725-014c9138f686 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1473 microversion: 2.1 time: 0.378565 Oct 11 20:14:36.121745 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2758/5551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:35 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1473 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:14:36.146603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-725e8e4a-2b0d-444f-8e8f-7537c0c889f8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:36.147226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-725e8e4a-2b0d-444f-8e8f-7537c0c889f8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:36.158598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725e8e4a-2b0d-444f-8e8f-7537c0c889f8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:36.158598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725e8e4a-2b0d-444f-8e8f-7537c0c889f8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:36.162654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725e8e4a-2b0d-444f-8e8f-7537c0c889f8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:36.163429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725e8e4a-2b0d-444f-8e8f-7537c0c889f8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:36.163915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725e8e4a-2b0d-444f-8e8f-7537c0c889f8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:36.164352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-725e8e4a-2b0d-444f-8e8f-7537c0c889f8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:36.267515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:36.268151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:36.284544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:36.285048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:36.285496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:36.286215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:36.286969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:36.287405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:36.455173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-725e8e4a-2b0d-444f-8e8f-7537c0c889f8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:36.467494 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-725e8e4a-2b0d-444f-8e8f-7537c0c889f8 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1473 microversion: 2.1 time: 0.325448 Oct 11 20:14:36.474096 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2794/5552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:36 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1473 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:36.499752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fed24380-7c43-456a-9574-abd9aac29fad tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:36.500653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fed24380-7c43-456a-9574-abd9aac29fad tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:36.514485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed24380-7c43-456a-9574-abd9aac29fad tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:36.527319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed24380-7c43-456a-9574-abd9aac29fad tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:36.528031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed24380-7c43-456a-9574-abd9aac29fad tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:36.528944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed24380-7c43-456a-9574-abd9aac29fad tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:36.529555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed24380-7c43-456a-9574-abd9aac29fad tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:36.530255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fed24380-7c43-456a-9574-abd9aac29fad tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:37.087038 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fed24380-7c43-456a-9574-abd9aac29fad tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1624 microversion: 2.1 time: 0.590783 Oct 11 20:14:37.110924 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2795/5553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:36 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1624 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:14:37.117304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6f58126f-67ed-44ef-9660-e54e4ee4da0e req-bb85155c-55bf-4930-afd3-d0f548fee291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "tag": "bcc573b0-7773-43d4-80f8-db9c1536ab91"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:14:37.130096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6f58126f-67ed-44ef-9660-e54e4ee4da0e req-bb85155c-55bf-4930-afd3-d0f548fee291 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:37.131086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6f58126f-67ed-44ef-9660-e54e4ee4da0e req-bb85155c-55bf-4930-afd3-d0f548fee291 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:37.131678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6f58126f-67ed-44ef-9660-e54e4ee4da0e req-bb85155c-55bf-4930-afd3-d0f548fee291 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:37.147655 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6f58126f-67ed-44ef-9660-e54e4ee4da0e req-bb85155c-55bf-4930-afd3-d0f548fee291 service nova] Creating event network-changed:bcc573b0-7773-43d4-80f8-db9c1536ab91 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:14:37.153844 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6f58126f-67ed-44ef-9660-e54e4ee4da0e req-bb85155c-55bf-4930-afd3-d0f548fee291 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040664 Oct 11 20:14:37.155504 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2796/5554] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:14:37.161724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0600f794-8e15-4838-834b-8d95c7a037ec tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:37.163029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0600f794-8e15-4838-834b-8d95c7a037ec tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:37.172104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0600f794-8e15-4838-834b-8d95c7a037ec tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:37.174601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0600f794-8e15-4838-834b-8d95c7a037ec tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:37.179311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0600f794-8e15-4838-834b-8d95c7a037ec tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:37.180088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0600f794-8e15-4838-834b-8d95c7a037ec tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:37.180570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0600f794-8e15-4838-834b-8d95c7a037ec tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:37.180999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0600f794-8e15-4838-834b-8d95c7a037ec tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:38.165359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:38.193875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:38.201099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:38.204912 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c23a65b-31f4-435b-9c2f-93cfe518d7de tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1891 microversion: 2.42 time: 1.940869 Oct 11 20:14:38.206133 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2759/5555] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:36 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1891 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:14:38.490546 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0600f794-8e15-4838-834b-8d95c7a037ec tempest-TestSecurityGroupsBasicOps-1078544597 tempest-TestSecurityGroupsBasicOps-1078544597-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1913 microversion: 2.1 time: 1.333492 Oct 11 20:14:38.491809 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2797/5556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:37 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1913 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:38.948995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bcf986c7-e157-4882-9f9d-323fd922401a tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:38.951677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bcf986c7-e157-4882-9f9d-323fd922401a tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:38.974144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcf986c7-e157-4882-9f9d-323fd922401a tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:38.975592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcf986c7-e157-4882-9f9d-323fd922401a tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:38.976983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcf986c7-e157-4882-9f9d-323fd922401a tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:38.978101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcf986c7-e157-4882-9f9d-323fd922401a tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:38.978844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcf986c7-e157-4882-9f9d-323fd922401a tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:38.979477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcf986c7-e157-4882-9f9d-323fd922401a tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:39.067246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bcf986c7-e157-4882-9f9d-323fd922401a tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:14:39.203659 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bcf986c7-e157-4882-9f9d-323fd922401a tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 204 len: 0 microversion: 2.1 time: 0.260804 Oct 11 20:14:39.208304 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2760/5557] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:14:38 2022] DELETE /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:14:39.218725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ceebc602-fd82-44b8-8535-8390f309f0bb tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:39.220827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ceebc602-fd82-44b8-8535-8390f309f0bb tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:39.233144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:39.234747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:39.238820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceebc602-fd82-44b8-8535-8390f309f0bb tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:39.239712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceebc602-fd82-44b8-8535-8390f309f0bb tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:39.240491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceebc602-fd82-44b8-8535-8390f309f0bb tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:39.241911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceebc602-fd82-44b8-8535-8390f309f0bb tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:39.244252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceebc602-fd82-44b8-8535-8390f309f0bb tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:39.245078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ceebc602-fd82-44b8-8535-8390f309f0bb tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:39.247343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:39.247848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:39.248297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:39.249015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:39.249528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:39.249962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:39.600804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ceebc602-fd82-44b8-8535-8390f309f0bb tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:39.609072 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ceebc602-fd82-44b8-8535-8390f309f0bb tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1479 microversion: 2.1 time: 0.395657 Oct 11 20:14:39.610049 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2798/5558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:39 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1479 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:39.615793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8ba0c757-fe00-4477-ad16-6e2775b77b48 req-0a24e94d-8d52-4124-8f6e-9ac602b3f25c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "tag": "82aef3af-bfa0-4f8a-9748-67aa8aab74d2"}, {"name": "network-changed", "server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "tag": "d2f6808c-75df-4965-85ee-a6025736b3e5"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:14:39.625523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ba0c757-fe00-4477-ad16-6e2775b77b48 req-0a24e94d-8d52-4124-8f6e-9ac602b3f25c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:39.626928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ba0c757-fe00-4477-ad16-6e2775b77b48 req-0a24e94d-8d52-4124-8f6e-9ac602b3f25c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:39.627638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ba0c757-fe00-4477-ad16-6e2775b77b48 req-0a24e94d-8d52-4124-8f6e-9ac602b3f25c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:39.638839 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8ba0c757-fe00-4477-ad16-6e2775b77b48 req-0a24e94d-8d52-4124-8f6e-9ac602b3f25c service nova] Creating event network-changed:82aef3af-bfa0-4f8a-9748-67aa8aab74d2 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:14:39.639352 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8ba0c757-fe00-4477-ad16-6e2775b77b48 req-0a24e94d-8d52-4124-8f6e-9ac602b3f25c service nova] Creating event network-changed:d2f6808c-75df-4965-85ee-a6025736b3e5 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:14:39.644770 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8ba0c757-fe00-4477-ad16-6e2775b77b48 req-0a24e94d-8d52-4124-8f6e-9ac602b3f25c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033149 Oct 11 20:14:39.645379 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2799/5559] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:14:39.800780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:39.811243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:39.812867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:39.814347 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5bb71dd3-30a1-4abd-b08e-f09c8da7fb25 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1891 microversion: 2.42 time: 0.586284 Oct 11 20:14:39.814948 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2761/5560] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:39 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1891 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:14:40.643666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b5c1ee4c-5746-4236-8ae8-2ec6837012ef tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:40.644442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b5c1ee4c-5746-4236-8ae8-2ec6837012ef tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:40.654062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5c1ee4c-5746-4236-8ae8-2ec6837012ef tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:40.658899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5c1ee4c-5746-4236-8ae8-2ec6837012ef tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:40.659504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5c1ee4c-5746-4236-8ae8-2ec6837012ef tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:40.660330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5c1ee4c-5746-4236-8ae8-2ec6837012ef tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:40.660900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5c1ee4c-5746-4236-8ae8-2ec6837012ef tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:40.670979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b5c1ee4c-5746-4236-8ae8-2ec6837012ef tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:40.840753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:40.841357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:40.857136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:40.857648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:40.858068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:40.859115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:40.859726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:40.860458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:40.871735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b5c1ee4c-5746-4236-8ae8-2ec6837012ef tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:40.880530 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b5c1ee4c-5746-4236-8ae8-2ec6837012ef tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1479 microversion: 2.1 time: 0.242835 Oct 11 20:14:40.891216 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2800/5561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:40 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1479 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:41.667465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6b9fc60c-3a43-49c6-812f-73215413a605 req-8b3ae48c-ec41-4527-84b8-b8d1a7baa80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44440d4-c481-4512-bcc2-557983981de8", "name": "network-vif-deleted", "tag": "67bf6bc9-0aa0-4b20-aa2f-fda2f686d16e"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:14:41.681654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6b9fc60c-3a43-49c6-812f-73215413a605 req-8b3ae48c-ec41-4527-84b8-b8d1a7baa80f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:41.682953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6b9fc60c-3a43-49c6-812f-73215413a605 req-8b3ae48c-ec41-4527-84b8-b8d1a7baa80f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:41.683700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6b9fc60c-3a43-49c6-812f-73215413a605 req-8b3ae48c-ec41-4527-84b8-b8d1a7baa80f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:41.704613 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6b9fc60c-3a43-49c6-812f-73215413a605 req-8b3ae48c-ec41-4527-84b8-b8d1a7baa80f service nova] Creating event network-vif-deleted:67bf6bc9-0aa0-4b20-aa2f-fda2f686d16e for instance c44440d4-c481-4512-bcc2-557983981de8 on n-h2-860864-3 Oct 11 20:14:41.712893 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6b9fc60c-3a43-49c6-812f-73215413a605 req-8b3ae48c-ec41-4527-84b8-b8d1a7baa80f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048858 Oct 11 20:14:41.715097 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2801/5562] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:14:41.900306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:41.917341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:41.920001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:41.920706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:41.922052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:41.930954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:41.931517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:41.933776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:41.934719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:41.935339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:41.935948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:41.944972 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-98ab5203-1c64-4ad7-9959-42b168441401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1891 microversion: 2.42 time: 1.101162 Oct 11 20:14:41.945945 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2762/5563] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:40 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1891 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:14:41.970218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:41.971022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:41.971622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:41.972260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lazy-loading 'fault' on Instance uuid c44440d4-c481-4512-bcc2-557983981de8 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:14:42.182830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:42.197712 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fbee6484-db4f-4d95-afc0-405672036712 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 200 len: 1332 microversion: 2.1 time: 0.281924 Oct 11 20:14:42.212735 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2802/5564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:41 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 1332 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:14:42.975015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:42.975643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:43.002403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:43.002735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:43.003187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:43.004106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:43.004357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:43.004791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:43.225925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:43.226608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: c44440d4-c481-4512-bcc2-557983981de8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:43.248288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:43.248803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:43.249118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:43.255595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:43.256264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:43.259406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:43.304915 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] HTTP exception thrown: Instance c44440d4-c481-4512-bcc2-557983981de8 could not be found. Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Request method failure captured: Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 HTTP/1.1 Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRc4iCkgaHBz7YZ-yit9bKd0MUt_fcqwPQkjLBJYO0zoAjjxjFmbPwlgoiAaDrqgeSi5GIgX8ZZ3LEHkXsVxAOGRMRzprtPl2gSD7qW6xkCapNGy5EXSWG8ZPM-JqWKrVFBfA8mLs3qAc5QNfh2-R0vaYBn8ovxU_JuQs4RQdzmNQxWY Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: d335c8cd2fcd4d9d8dcb2265be41dd39 Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-731009624 Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d335c8cd2fcd4d9d8dcb2265be41dd39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d335c8cd2fcd4d9d8dcb2265be41dd39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d335c8cd2fcd4d9d8dcb2265be41dd39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d335c8cd2fcd4d9d8dcb2265be41dd39"}]}] Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestSecurityGroupsBasicOps-731009624 Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: d335c8cd2fcd4d9d8dcb2265be41dd39 Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-731009624 Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestSecurityGroupsBasicOps-731009624-project Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: fd7806855dac40768b11242a4e00d9e9 Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestSecurityGroupsBasicOps-731009624-project Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance c44440d4-c481-4512-bcc2-557983981de8 could not be found. Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'c44440d4-c481-4512-bcc2-557983981de8'} Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44440d4-c481-4512-bcc2-557983981de8 could not be found. Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44440d4-c481-4512-bcc2-557983981de8 could not be found. Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:14:43.307376 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:14:43.311658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:14:43.311658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:14:43.311658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:14:43.311658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:14:43.311658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:14:43.311658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44440d4-c481-4512-bcc2-557983981de8 could not be found. Oct 11 20:14:43.311658 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:14:43.314133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Returning 404 to user: Instance c44440d4-c481-4512-bcc2-557983981de8 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:14:43.315334 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3efcdd17-16a4-40e2-bb89-24cbdf4fa461 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8" status: 404 len: 111 microversion: 2.1 time: 0.093933 Oct 11 20:14:43.319893 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2803/5565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:43 2022] GET /compute/v2.1/servers/c44440d4-c481-4512-bcc2-557983981de8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:14:43.645264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:43.665233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:43.670856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:43.673471 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1cb15142-f863-4091-98f0-29c2ab4c01a8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1891 microversion: 2.42 time: 0.701907 Oct 11 20:14:43.687466 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2763/5566] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:42 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1891 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:44.715362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:44.716924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:44.735204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:44.737196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:44.738198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:44.740703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:44.743239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:44.743938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:45.630368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:45.649292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:45.656025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:45.657287 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-61e6bcaa-f1dc-444f-bea3-a5b179d3be08 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1891 microversion: 2.42 time: 0.951333 Oct 11 20:14:45.657857 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2804/5567] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:44 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1891 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:46.697625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:46.704651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:46.728186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:46.728704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:46.736447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:46.739011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:46.742917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:46.743603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:48.369609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:48.393419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:48.401906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:48.404058 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8c604e5-e8f3-412b-90c9-872871c414ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 1.718984 Oct 11 20:14:48.410800 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2764/5568] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:46 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:49.441207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:49.442018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:49.460883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:49.461416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:49.463614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:49.464353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:49.464823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:49.465253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:50.530147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:50.549666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:50.554756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:50.558138 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-340823f9-4f1a-4ede-ace8-5c7ea64bc1a4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 1.121756 Oct 11 20:14:50.558835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2805/5569] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:49 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:51.588415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:51.589748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:51.607360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:51.608187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:51.608814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:51.609923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:51.610846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:51.619348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:52.254699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:52.267886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:52.300417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:52.302472 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bb453b1c-9e6c-4c00-91b9-afb78d7d9f43 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.717975 Oct 11 20:14:52.308163 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2765/5570] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:51 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:53.339587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:53.340190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:53.353163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:53.353865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:53.357412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:53.358558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:53.359192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:53.366425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:54.611017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:54.628599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:54.630068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:54.644008 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2e74cd60-c7a8-45d7-81fe-50b268b319e2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 1.308074 Oct 11 20:14:54.654571 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2806/5571] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:53 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:55.675356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:55.677319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:55.694141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:55.695491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:55.696178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:55.697468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:55.700652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:55.702316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:56.061381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f86ff237-8e2b-4baf-8e18-ba7b955c2ff9 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:56.061381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f86ff237-8e2b-4baf-8e18-ba7b955c2ff9 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:56.076221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f86ff237-8e2b-4baf-8e18-ba7b955c2ff9 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:56.082508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f86ff237-8e2b-4baf-8e18-ba7b955c2ff9 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:56.082978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f86ff237-8e2b-4baf-8e18-ba7b955c2ff9 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:56.085613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f86ff237-8e2b-4baf-8e18-ba7b955c2ff9 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:56.086217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f86ff237-8e2b-4baf-8e18-ba7b955c2ff9 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:56.087406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f86ff237-8e2b-4baf-8e18-ba7b955c2ff9 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:56.144319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f86ff237-8e2b-4baf-8e18-ba7b955c2ff9 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:14:56.381131 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f86ff237-8e2b-4baf-8e18-ba7b955c2ff9 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 204 len: 0 microversion: 2.1 time: 0.331515 Oct 11 20:14:56.381964 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2807/5572] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:14:56 2022] DELETE /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:14:56.761053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:56.763555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:56.778359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:56.779852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:56.805779 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4ac82fa4-f873-4643-9bba-1119be7410d3 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 1.136920 Oct 11 20:14:56.808817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1d7582cc-83c9-4ca5-a02d-22a4ca44d168 req-159a2ee9-ceff-4ae1-8fbd-7368d7986c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdad379c-bbeb-4e3b-ab9f-d28e863f61a2", "tag": "fc491508-ca2a-4bac-be08-e36f5110737a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:14:56.815347 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2766/5573] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:55 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:56.825884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-00fa5902-7eac-4e7f-a3d6-f83a3316a1d2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:56.826509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-00fa5902-7eac-4e7f-a3d6-f83a3316a1d2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:56.828634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:14:56.847739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1d7582cc-83c9-4ca5-a02d-22a4ca44d168 req-159a2ee9-ceff-4ae1-8fbd-7368d7986c3d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:56.851831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1d7582cc-83c9-4ca5-a02d-22a4ca44d168 req-159a2ee9-ceff-4ae1-8fbd-7368d7986c3d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:56.852507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1d7582cc-83c9-4ca5-a02d-22a4ca44d168 req-159a2ee9-ceff-4ae1-8fbd-7368d7986c3d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:56.864432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00fa5902-7eac-4e7f-a3d6-f83a3316a1d2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:56.866959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00fa5902-7eac-4e7f-a3d6-f83a3316a1d2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:56.867430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00fa5902-7eac-4e7f-a3d6-f83a3316a1d2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:56.868151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00fa5902-7eac-4e7f-a3d6-f83a3316a1d2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:56.869996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00fa5902-7eac-4e7f-a3d6-f83a3316a1d2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:56.870445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-00fa5902-7eac-4e7f-a3d6-f83a3316a1d2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:56.911736 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1d7582cc-83c9-4ca5-a02d-22a4ca44d168 req-159a2ee9-ceff-4ae1-8fbd-7368d7986c3d service nova] Creating event network-changed:fc491508-ca2a-4bac-be08-e36f5110737a for instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 on n-h1-860864-3 Oct 11 20:14:56.943030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1d7582cc-83c9-4ca5-a02d-22a4ca44d168 req-159a2ee9-ceff-4ae1-8fbd-7368d7986c3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.557648 Oct 11 20:14:56.947506 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2808/5574] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:14:57.583940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-00fa5902-7eac-4e7f-a3d6-f83a3316a1d2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:57.600328 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-00fa5902-7eac-4e7f-a3d6-f83a3316a1d2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1768 microversion: 2.1 time: 0.782117 Oct 11 20:14:57.601173 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2767/5575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:56 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1768 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:14:57.844511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:57.846152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:57.882129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:57.884510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:57.887346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:57.889381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:57.895864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:57.899079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:58.626295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-515b4036-4e5d-4ee1-a583-fd71d9ac3c4c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:58.627618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-515b4036-4e5d-4ee1-a583-fd71d9ac3c4c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:58.649277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515b4036-4e5d-4ee1-a583-fd71d9ac3c4c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:58.654882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515b4036-4e5d-4ee1-a583-fd71d9ac3c4c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:58.655559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515b4036-4e5d-4ee1-a583-fd71d9ac3c4c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:58.656604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515b4036-4e5d-4ee1-a583-fd71d9ac3c4c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:58.657320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515b4036-4e5d-4ee1-a583-fd71d9ac3c4c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:58.657965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-515b4036-4e5d-4ee1-a583-fd71d9ac3c4c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:58.717569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:58.738239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:58.741130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:58.743702 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a145df9c-4cc1-45a6-b485-f99f617d40bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.904073 Oct 11 20:14:58.752180 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2809/5576] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:57 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:14:59.401615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-515b4036-4e5d-4ee1-a583-fd71d9ac3c4c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:14:59.415514 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-515b4036-4e5d-4ee1-a583-fd71d9ac3c4c tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1768 microversion: 2.1 time: 0.792017 Oct 11 20:14:59.417497 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2768/5577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:14:58 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1768 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:14:59.771333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:14:59.772976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:14:59.808039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:59.811594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:59.814475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:59.819476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:14:59.820989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:14:59.823745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:14:59.947911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-480788bd-4be3-4da0-bb05-ddf4365d072c req-ed447457-d687-4790-83c2-b6e38790381f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdad379c-bbeb-4e3b-ab9f-d28e863f61a2", "name": "network-vif-deleted", "tag": "fc491508-ca2a-4bac-be08-e36f5110737a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:15:00.011269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-480788bd-4be3-4da0-bb05-ddf4365d072c req-ed447457-d687-4790-83c2-b6e38790381f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:00.014083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-480788bd-4be3-4da0-bb05-ddf4365d072c req-ed447457-d687-4790-83c2-b6e38790381f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:00.016417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-480788bd-4be3-4da0-bb05-ddf4365d072c req-ed447457-d687-4790-83c2-b6e38790381f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:00.066804 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-480788bd-4be3-4da0-bb05-ddf4365d072c req-ed447457-d687-4790-83c2-b6e38790381f service nova] Creating event network-vif-deleted:fc491508-ca2a-4bac-be08-e36f5110737a for instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 on n-h1-860864-3 Oct 11 20:15:00.084688 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-480788bd-4be3-4da0-bb05-ddf4365d072c req-ed447457-d687-4790-83c2-b6e38790381f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158182 Oct 11 20:15:00.089459 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2769/5578] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:15:00.376469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:00.386626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:00.396237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:00.397657 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f15edb3-9f3c-4ead-b6a2-f2d04137c63a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.631101 Oct 11 20:15:00.401583 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2810/5579] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:14:59 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:00.440865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:00.441588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:00.457732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:00.458246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:00.458733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:00.475137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:00.475843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:00.483590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:00.586497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:00.592087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:00.592797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:00.593486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lazy-loading 'fault' on Instance uuid bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:15:00.700420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd7806855dac40768b11242a4e00d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c8cd2fcd4d9d8dcb2265be41dd39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:00.716857 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-808f6d39-7567-4713-a969-34573025b9c4 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 200 len: 1384 microversion: 2.1 time: 0.281106 Oct 11 20:15:00.719320 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2770/5580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:15:00 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 1384 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:15:01.432204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:01.433615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:01.448977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:01.450733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:01.453395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:01.455995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:01.457872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:01.463086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:01.478628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:15:01.745867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:01.747237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [instance: bdad379c-bbeb-4e3b-ab9f-d28e863f61a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:01.762162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:01.762709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:01.763165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:01.769897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:01.770420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:01.770895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:01.801179 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] HTTP exception thrown: Instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 could not be found. Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Request method failure captured: Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 HTTP/1.1 Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc4iCkgaHBz7YZ-yit9bKd0MUt_fcqwPQkjLBJYO0zoAjjxjFmbPwlgoiAaDrqgeSi5GIgX8ZZ3LEHkXsVxAOGRMRzprtPl2gSD7qW6xkCapNGy5EXSWG8ZPM-JqWKrVFBfA8mLs3qAc5QNfh2-R0vaYBn8ovxU_JuQs4RQdzmNQxWY Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: d335c8cd2fcd4d9d8dcb2265be41dd39 Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-731009624 Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d335c8cd2fcd4d9d8dcb2265be41dd39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d335c8cd2fcd4d9d8dcb2265be41dd39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d335c8cd2fcd4d9d8dcb2265be41dd39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d335c8cd2fcd4d9d8dcb2265be41dd39"}]}] Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestSecurityGroupsBasicOps-731009624 Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: d335c8cd2fcd4d9d8dcb2265be41dd39 Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-731009624 Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestSecurityGroupsBasicOps-731009624-project Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: fd7806855dac40768b11242a4e00d9e9 Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestSecurityGroupsBasicOps-731009624-project Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 could not be found. Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'bdad379c-bbeb-4e3b-ab9f-d28e863f61a2'} Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 could not be found. Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 could not be found. Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:15:01.806041 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:15:01.812126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:15:01.812126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:15:01.812126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:15:01.812126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:15:01.812126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:15:01.812126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 could not be found. Oct 11 20:15:01.812126 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:15:01.812126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Returning 404 to user: Instance bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:15:01.815071 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e6d52e0b-acf1-4fde-a78a-4680bd54bec2 tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2" status: 404 len: 111 microversion: 2.1 time: 0.073169 Oct 11 20:15:01.815836 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2771/5581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:15:01 2022] GET /compute/v2.1/servers/bdad379c-bbeb-4e3b-ab9f-d28e863f61a2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 20:15:01.973663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:01.992265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:01.996993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:02.002821 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c9a7150-eece-40bc-8505-16ef5cafb971 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.575151 Oct 11 20:15:02.019958 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2811/5582] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:01 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:03.038181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:03.040056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:03.061599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:03.062176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:03.062669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:03.063388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:03.063852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:03.064289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:04.042675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:04.053704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:04.055856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:04.057513 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c7c79ab7-ef56-4987-ada3-224440bfddaf tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 1.025624 Oct 11 20:15:04.075317 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2772/5583] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:03 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:05.086298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:05.087215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:05.099270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:15:05.115025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:05.118568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:05.121116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:05.123383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:05.124001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:05.127472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:05.789241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:05.810490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:05.828947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:05.833172 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-45623ff9-1dbe-42b1-8ff8-3c896bad9870 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.752446 Oct 11 20:15:05.836598 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2812/5584] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:05 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:06.860866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:06.861491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:06.884017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:06.885748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:06.888673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:06.889466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:06.890606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:06.891203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:07.531998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:07.557053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:07.560151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:07.564449 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0f5d563f-f330-4f2e-a90b-f92e833ee9fa tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.708260 Oct 11 20:15:07.578390 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2773/5585] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:06 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:08.595578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:08.596813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:08.613908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:08.614417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:08.617243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:08.627641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:08.628461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:08.629074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:09.115817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:09.133832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:09.146380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:09.147650 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1519d189-d752-401c-ae98-e67984985841 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.556535 Oct 11 20:15:09.148221 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2813/5586] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:08 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:10.179294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:10.179920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:10.196136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:10.196673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:10.197120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:10.200739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:10.201495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:10.201943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:10.814987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:10.824850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:10.826307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:10.836748 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dab93b27-84c4-4574-a30a-75745792ef02 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.658927 Oct 11 20:15:10.855865 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2774/5587] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:10 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:11.869135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:11.871160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:11.908146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:11.913362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:11.920230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:11.921919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:11.922573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:11.923398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:12.542081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:12.562766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:12.568075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:12.571876 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0254e08f-b670-481f-8249-fe3e24197717 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.705190 Oct 11 20:15:12.574029 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2814/5588] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:11 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:13.464260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d89ce312-a05b-45fc-9418-ca48586beecf tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] Calling method '.version_select at 0x7f83d069fca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:13.470891 n-d-860864-3 devstack@n-api.service[126955]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d89ce312-a05b-45fc-9418-ca48586beecf tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [e1595a03-249e-4b48-938b-c0c14ea766fe] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 20:15:13.616608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:13.620788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:13.652788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:13.653727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:13.654349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:13.663429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:13.663677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:13.667227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:14.268153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:14.285353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:14.293162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:14.296762 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ef519267-390c-4edf-b60c-7447edff07bb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.697571 Oct 11 20:15:14.299741 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2815/5589] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:13 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:14.487010 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [None req-d89ce312-a05b-45fc-9418-ca48586beecf tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] [e1595a03-249e-4b48-938b-c0c14ea766fe] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 50332. Oct 11 20:15:14.525046 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d89ce312-a05b-45fc-9418-ca48586beecf tempest-TestSecurityGroupsBasicOps-731009624 tempest-TestSecurityGroupsBasicOps-731009624-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2120499800" status: 202 len: 0 microversion: 2.1 time: 1.064376 Oct 11 20:15:14.541181 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2775/5590] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 11 20:15:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2120499800 => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:15:15.330072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:15.330072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:15.340530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:15.343114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:15.343762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:15.347303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:15.349936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:15.350633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:15.691898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:15.704920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:15.706377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:15.707578 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-455c9d7a-e5f2-4362-9395-948572fe1d83 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.384751 Oct 11 20:15:15.708369 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2816/5591] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:15 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:16.739954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:16.741549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:16.756205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:16.757105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:16.758600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:16.761376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:16.762102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:16.764985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:17.189720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:17.205099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:17.210405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:17.211661 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11690a4a-5859-4116-8ebc-5b6ba6c2c641 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.477351 Oct 11 20:15:17.212551 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2776/5592] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:16 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:18.240332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:18.241008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:18.260053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:18.260514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:18.260955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:18.263099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:18.263430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:18.263939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:18.736373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:18.750790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:18.757308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:18.758856 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b3515fa-77b8-4d86-815f-d176fbe86332 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.523367 Oct 11 20:15:18.759910 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2817/5593] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:18 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:19.794068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:19.794808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:19.808134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:19.815031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:19.818621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:19.827545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:19.828042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:19.828481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:20.432331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:20.450235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:20.455263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:20.460012 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0466de16-435c-4299-9fb4-2c3663c4dffb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.672791 Oct 11 20:15:20.462151 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2777/5594] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:19 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:21.490116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:21.490866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:21.509904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:21.510403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:21.510864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:21.511572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:21.512026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:21.512448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:22.361394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:22.376272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:22.378125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:22.380181 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-888bfa07-7f73-4463-8e8e-ab650a890f51 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.893891 Oct 11 20:15:22.395575 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2818/5595] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:21 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:23.409861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:23.410468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:23.432303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:23.432724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:23.433322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:23.434817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:23.435283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:23.435974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:24.081486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:24.124256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:24.129147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:24.133890 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-238820dd-042b-4acb-89a9-d6c6a0620dca tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.726624 Oct 11 20:15:24.137683 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2778/5596] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:23 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:25.171565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:25.172400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:25.191651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:25.194867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:25.198706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:25.201922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:25.205101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:25.206318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:25.878003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-707bd6f1-8fa8-4670-baf7-2a6d33ff41d7 req-946a76be-4491-407c-b954-24de98381df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-plugged", "status": "completed", "tag": "82aef3af-bfa0-4f8a-9748-67aa8aab74d2"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:15:25.909640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-707bd6f1-8fa8-4670-baf7-2a6d33ff41d7 req-946a76be-4491-407c-b954-24de98381df6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:25.910135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-707bd6f1-8fa8-4670-baf7-2a6d33ff41d7 req-946a76be-4491-407c-b954-24de98381df6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:25.910611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-707bd6f1-8fa8-4670-baf7-2a6d33ff41d7 req-946a76be-4491-407c-b954-24de98381df6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:25.929141 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-707bd6f1-8fa8-4670-baf7-2a6d33ff41d7 req-946a76be-4491-407c-b954-24de98381df6 service nova] Creating event network-vif-plugged:82aef3af-bfa0-4f8a-9748-67aa8aab74d2 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:15:25.946223 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-707bd6f1-8fa8-4670-baf7-2a6d33ff41d7 req-946a76be-4491-407c-b954-24de98381df6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074120 Oct 11 20:15:25.946937 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2779/5597] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:15:26.296841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:26.314378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:26.324282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:26.333212 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5eaf4dc9-8333-46e3-a193-128430b90670 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 1.166899 Oct 11 20:15:26.335848 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2819/5598] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:25 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:27.366196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:27.367415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:27.396077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:15:27.404879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:27.405952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:27.406424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:27.411900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:27.412406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:27.412859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:27.439492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=64 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:15:28.083240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c774774c-58e9-459b-b069-a57254078d29 req-305c6f05-b530-457a-a5a2-7d7110763bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-plugged", "status": "completed", "tag": "515311c4-0873-40ab-bfc7-a6fded0e43a1"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:15:28.096951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c774774c-58e9-459b-b069-a57254078d29 req-305c6f05-b530-457a-a5a2-7d7110763bba service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:28.098345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c774774c-58e9-459b-b069-a57254078d29 req-305c6f05-b530-457a-a5a2-7d7110763bba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:28.099825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c774774c-58e9-459b-b069-a57254078d29 req-305c6f05-b530-457a-a5a2-7d7110763bba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:28.123764 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c774774c-58e9-459b-b069-a57254078d29 req-305c6f05-b530-457a-a5a2-7d7110763bba service nova] Creating event network-vif-plugged:515311c4-0873-40ab-bfc7-a6fded0e43a1 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:15:28.134106 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c774774c-58e9-459b-b069-a57254078d29 req-305c6f05-b530-457a-a5a2-7d7110763bba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067336 Oct 11 20:15:28.135995 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2820/5599] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:15:28.173217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:28.207615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:28.208964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:28.210172 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-12cbb1b2-2516-415b-bd89-7b1bd35e0c13 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.852299 Oct 11 20:15:28.210787 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2780/5600] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:27 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:29.248105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:29.248631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:29.263456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:29.267160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:29.268097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:29.269852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:29.271694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:29.273096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:30.208379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8104fd32-5fce-4ae6-9c19-762c2b700d04 req-c1ac2a40-e86d-433a-bdfa-a185da5a3b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-plugged", "status": "completed", "tag": "d2f6808c-75df-4965-85ee-a6025736b3e5"}, {"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-plugged", "status": "completed", "tag": "96aca859-3df9-41c7-b0cd-69c7066a479e"}, {"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-plugged", "status": "completed", "tag": "89c7d311-868d-471c-b3ab-790ad9c4f18b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:15:30.227991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8104fd32-5fce-4ae6-9c19-762c2b700d04 req-c1ac2a40-e86d-433a-bdfa-a185da5a3b65 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:30.233163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8104fd32-5fce-4ae6-9c19-762c2b700d04 req-c1ac2a40-e86d-433a-bdfa-a185da5a3b65 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:30.233914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8104fd32-5fce-4ae6-9c19-762c2b700d04 req-c1ac2a40-e86d-433a-bdfa-a185da5a3b65 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:30.268321 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8104fd32-5fce-4ae6-9c19-762c2b700d04 req-c1ac2a40-e86d-433a-bdfa-a185da5a3b65 service nova] Creating event network-vif-plugged:d2f6808c-75df-4965-85ee-a6025736b3e5 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:15:30.271272 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8104fd32-5fce-4ae6-9c19-762c2b700d04 req-c1ac2a40-e86d-433a-bdfa-a185da5a3b65 service nova] Creating event network-vif-plugged:96aca859-3df9-41c7-b0cd-69c7066a479e for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:15:30.272005 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8104fd32-5fce-4ae6-9c19-762c2b700d04 req-c1ac2a40-e86d-433a-bdfa-a185da5a3b65 service nova] Creating event network-vif-plugged:89c7d311-868d-471c-b3ab-790ad9c4f18b for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:15:30.281014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:30.285596 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8104fd32-5fce-4ae6-9c19-762c2b700d04 req-c1ac2a40-e86d-433a-bdfa-a185da5a3b65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.082423 Oct 11 20:15:30.288492 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2781/5601] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:15:30.313574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:30.315912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:30.317252 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78ad5d13-fbd8-4155-b207-36c235e939ee tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 1.076282 Oct 11 20:15:30.318273 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2821/5602] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:29 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:31.369541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:31.372482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:31.390155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:31.392293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:31.392822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:31.395159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:31.397506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:31.398038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:32.343516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:32.358721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:32.360448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:32.361669 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-678c1796-ddba-4506-85f4-4fc3581c2a22 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.999939 Oct 11 20:15:32.366851 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2782/5603] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:31 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:32.470574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-54757e26-f637-4bb6-828b-73ea9fc11fcb req-f26e2d48-45a6-44de-a32f-022824386dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-plugged", "status": "completed", "tag": "bcc573b0-7773-43d4-80f8-db9c1536ab91"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:15:32.505775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54757e26-f637-4bb6-828b-73ea9fc11fcb req-f26e2d48-45a6-44de-a32f-022824386dca service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:32.508163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54757e26-f637-4bb6-828b-73ea9fc11fcb req-f26e2d48-45a6-44de-a32f-022824386dca service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:32.508826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54757e26-f637-4bb6-828b-73ea9fc11fcb req-f26e2d48-45a6-44de-a32f-022824386dca service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:32.567624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=62 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:15:32.570975 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-54757e26-f637-4bb6-828b-73ea9fc11fcb req-f26e2d48-45a6-44de-a32f-022824386dca service nova] Creating event network-vif-plugged:bcc573b0-7773-43d4-80f8-db9c1536ab91 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:15:32.579760 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-54757e26-f637-4bb6-828b-73ea9fc11fcb req-f26e2d48-45a6-44de-a32f-022824386dca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114949 Oct 11 20:15:32.580615 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2822/5604] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:15:33.390158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:33.391461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:33.399518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:33.400403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:33.401128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:33.440448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:33.442803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:33.445382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:34.219816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:34.263492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:34.272459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:34.278463 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c56ec11b-6aef-4497-aff0-52753fc8d4e4 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.892140 Oct 11 20:15:34.283043 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2783/5605] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:33 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:34.614727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-eef1a0db-0635-4430-83db-530b03e941aa req-630cfc19-d356-4c1b-8fa5-ee024618c133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-plugged", "status": "completed", "tag": "3049eb54-be5a-4d03-bf78-e039710b3c76"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:15:34.634435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-eef1a0db-0635-4430-83db-530b03e941aa req-630cfc19-d356-4c1b-8fa5-ee024618c133 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:34.634968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-eef1a0db-0635-4430-83db-530b03e941aa req-630cfc19-d356-4c1b-8fa5-ee024618c133 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:34.635410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-eef1a0db-0635-4430-83db-530b03e941aa req-630cfc19-d356-4c1b-8fa5-ee024618c133 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:34.689736 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-eef1a0db-0635-4430-83db-530b03e941aa req-630cfc19-d356-4c1b-8fa5-ee024618c133 service nova] Creating event network-vif-plugged:3049eb54-be5a-4d03-bf78-e039710b3c76 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:15:34.698176 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-eef1a0db-0635-4430-83db-530b03e941aa req-630cfc19-d356-4c1b-8fa5-ee024618c133 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091529 Oct 11 20:15:34.705797 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2823/5606] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:15:35.314269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:35.314907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:35.338979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:35.339711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:35.345080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:35.347279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:35.349714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:35.359719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:36.118966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:36.129135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:36.140706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:36.141886 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2d24d2d2-0a1e-4269-87ff-26fc7ea8d9f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.832498 Oct 11 20:15:36.142863 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2784/5607] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:35 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:37.171999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:37.172707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:37.191575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=24 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:15:37.197522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:37.198295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:37.204822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:37.208304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:37.209137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:37.209617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:37.681784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:37.722355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:37.728377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:37.734594 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b09b64a5-0d45-4815-a274-8a30f0a99455 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1879 microversion: 2.42 time: 0.567077 Oct 11 20:15:37.735203 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2824/5608] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:37 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1879 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:38.764325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:38.764846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:38.786173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:38.786945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:38.787630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:38.788794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:38.789586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:38.790464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:39.461793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:39.512038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:39.520052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:15:39.527745 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-20bdf68b-b39f-4157-bf33-78d028833483 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 2835 microversion: 2.42 time: 0.770605 Oct 11 20:15:39.528355 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2785/5609] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:15:38 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 2835 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:39.562720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-04ddf565-2973-49ef-b5c6-d87ac91dc0a7 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:15:39.563454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-04ddf565-2973-49ef-b5c6-d87ac91dc0a7 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:15:39.589522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04ddf565-2973-49ef-b5c6-d87ac91dc0a7 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:39.590067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04ddf565-2973-49ef-b5c6-d87ac91dc0a7 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:39.595234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04ddf565-2973-49ef-b5c6-d87ac91dc0a7 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:39.598711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04ddf565-2973-49ef-b5c6-d87ac91dc0a7 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:39.600338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04ddf565-2973-49ef-b5c6-d87ac91dc0a7 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:39.600799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04ddf565-2973-49ef-b5c6-d87ac91dc0a7 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:40.106572 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-04ddf565-2973-49ef-b5c6-d87ac91dc0a7 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.548994 Oct 11 20:15:40.107972 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2825/5610] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 11 20:15:39 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821/os-interface => generated 1829 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:15:44.801637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-37a9b325-2d55-4989-a2de-a3244acdef35 req-3a567006-3cd5-45ca-b499-8466ff1c0988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "tag": "3049eb54-be5a-4d03-bf78-e039710b3c76"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:15:44.849264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-37a9b325-2d55-4989-a2de-a3244acdef35 req-3a567006-3cd5-45ca-b499-8466ff1c0988 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:15:44.849801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-37a9b325-2d55-4989-a2de-a3244acdef35 req-3a567006-3cd5-45ca-b499-8466ff1c0988 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:15:44.850195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-37a9b325-2d55-4989-a2de-a3244acdef35 req-3a567006-3cd5-45ca-b499-8466ff1c0988 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:15:44.955144 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-37a9b325-2d55-4989-a2de-a3244acdef35 req-3a567006-3cd5-45ca-b499-8466ff1c0988 service nova] Creating event network-changed:3049eb54-be5a-4d03-bf78-e039710b3c76 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:15:44.968997 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-37a9b325-2d55-4989-a2de-a3244acdef35 req-3a567006-3cd5-45ca-b499-8466ff1c0988 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199418 Oct 11 20:15:44.971474 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2786/5611] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:16:27.107869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:27.108491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:27.119700 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:16:27.120031 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:16:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 (ip 10.222.0.27) !!! Oct 11 20:16:27.126917 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:16:27.127147 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:16:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 (ip 10.222.0.27) !!! Oct 11 20:16:27.132379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:27.137412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=13 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:27.191704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:27.193966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:27.198808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:27.201163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:27.202935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:27.205071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:27.872716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:27.892182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:27.893541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:27.894992 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-82c65206-6ae0-472e-bd74-cc42c021689b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 2954 microversion: 2.42 time: 0.792527 Oct 11 20:16:27.908537 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2826/5612] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:16:27 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 2954 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:16:27.929029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=13 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:27.931248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=33 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:27.941894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-04ff6d06-dc3c-4a0b-9a9c-b8c05c1d0606 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:27.942802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-04ff6d06-dc3c-4a0b-9a9c-b8c05c1d0606 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:27.952608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04ff6d06-dc3c-4a0b-9a9c-b8c05c1d0606 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:27.953626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04ff6d06-dc3c-4a0b-9a9c-b8c05c1d0606 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:27.954325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04ff6d06-dc3c-4a0b-9a9c-b8c05c1d0606 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:27.955483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04ff6d06-dc3c-4a0b-9a9c-b8c05c1d0606 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:27.956453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04ff6d06-dc3c-4a0b-9a9c-b8c05c1d0606 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:27.957127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04ff6d06-dc3c-4a0b-9a9c-b8c05c1d0606 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:28.155951 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-04ff6d06-dc3c-4a0b-9a9c-b8c05c1d0606 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.227864 Oct 11 20:16:28.157517 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2787/5613] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 11 20:16:27 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821/os-interface => generated 1829 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:16:40.863100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:40.863838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:41.044151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1775524643", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "ffa9ddae-2ffe-4ac8-94d3-718ffddffb16"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:16:41.157743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] validate_networks() for [('ffa9ddae-2ffe-4ac8-94d3-718ffddffb16', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:16:41.915582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:16:41.916191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:16:41.916644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:16:41.917068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:16:41.917494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:16:41.930575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:41.931827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:41.932473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:41.933401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:41.934040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:41.934875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:41.954927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Getting quotas for project 4b2eef666a774efea72d675ef50bb0f7. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:16:41.961073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Getting quotas for user 58ca7148c63445d392bf113a8417d7ba and project 4b2eef666a774efea72d675ef50bb0f7. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:16:41.975697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:16:41.979242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:16:42.063678 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8497c430-eeb8-45ae-82f6-44381e25f946 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206444 Oct 11 20:16:42.067592 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2827/5614] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:16:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:16:42.077345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:42.078085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:42.082770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-29a4a9d2-2e80-4628-9db0-8cdcd49bea8a tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:42.083593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-29a4a9d2-2e80-4628-9db0-8cdcd49bea8a tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:42.203605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-29a4a9d2-2e80-4628-9db0-8cdcd49bea8a tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:42.211860 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-29a4a9d2-2e80-4628-9db0-8cdcd49bea8a tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1214 microversion: 2.1 time: 0.136444 Oct 11 20:16:42.213444 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2788/5615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:42 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:16:43.239978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2feb6366-4a94-4c42-be07-c14e4de12924 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:43.240555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2feb6366-4a94-4c42-be07-c14e4de12924 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:43.343745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2feb6366-4a94-4c42-be07-c14e4de12924 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:43.354009 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2feb6366-4a94-4c42-be07-c14e4de12924 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1214 microversion: 2.1 time: 0.118293 Oct 11 20:16:43.354706 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2828/5616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:43 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:16:44.381236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5ac932fd-173a-4aed-9472-bff244e41bdf tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:44.381839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5ac932fd-173a-4aed-9472-bff244e41bdf tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:44.402962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac932fd-173a-4aed-9472-bff244e41bdf tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:44.404291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac932fd-173a-4aed-9472-bff244e41bdf tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:44.404987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac932fd-173a-4aed-9472-bff244e41bdf tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:44.405916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac932fd-173a-4aed-9472-bff244e41bdf tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:44.406699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac932fd-173a-4aed-9472-bff244e41bdf tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:44.407420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac932fd-173a-4aed-9472-bff244e41bdf tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:44.628191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5ac932fd-173a-4aed-9472-bff244e41bdf tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:44.640522 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5ac932fd-173a-4aed-9472-bff244e41bdf tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1266 microversion: 2.1 time: 0.263519 Oct 11 20:16:44.641210 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2789/5617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:44 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:16:45.670490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-992164df-5870-4929-8095-a8dba13b4495 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:45.671593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-992164df-5870-4929-8095-a8dba13b4495 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:45.692560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-992164df-5870-4929-8095-a8dba13b4495 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:45.693458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-992164df-5870-4929-8095-a8dba13b4495 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:45.694109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-992164df-5870-4929-8095-a8dba13b4495 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:45.695623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-992164df-5870-4929-8095-a8dba13b4495 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:45.696280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-992164df-5870-4929-8095-a8dba13b4495 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:45.700256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-992164df-5870-4929-8095-a8dba13b4495 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:45.937606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-992164df-5870-4929-8095-a8dba13b4495 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:45.945762 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-992164df-5870-4929-8095-a8dba13b4495 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1272 microversion: 2.1 time: 0.281074 Oct 11 20:16:45.963517 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2829/5618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:45 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:16:46.989348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9ab5d92a-da65-48af-96bd-716261a97de3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:46.989960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9ab5d92a-da65-48af-96bd-716261a97de3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:47.015457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ab5d92a-da65-48af-96bd-716261a97de3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:47.020237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ab5d92a-da65-48af-96bd-716261a97de3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:47.026468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ab5d92a-da65-48af-96bd-716261a97de3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:47.027462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ab5d92a-da65-48af-96bd-716261a97de3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:47.053015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ab5d92a-da65-48af-96bd-716261a97de3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:47.059274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ab5d92a-da65-48af-96bd-716261a97de3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:47.466027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9ab5d92a-da65-48af-96bd-716261a97de3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:47.474249 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9ab5d92a-da65-48af-96bd-716261a97de3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1314 microversion: 2.1 time: 0.489090 Oct 11 20:16:47.478539 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2790/5619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:46 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:16:48.228903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1b4340d1-073e-425e-80e4-a62ffd5eda77 req-0bf22064-48c3-42ef-89d4-f682589eb067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad123342-1bc3-4f98-aa4e-c526fc10d64f", "tag": "7c5145b3-25c0-454d-82ae-03544748b857"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:16:48.295610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1b4340d1-073e-425e-80e4-a62ffd5eda77 req-0bf22064-48c3-42ef-89d4-f682589eb067 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:48.305291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1b4340d1-073e-425e-80e4-a62ffd5eda77 req-0bf22064-48c3-42ef-89d4-f682589eb067 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:48.308491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1b4340d1-073e-425e-80e4-a62ffd5eda77 req-0bf22064-48c3-42ef-89d4-f682589eb067 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:48.376496 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1b4340d1-073e-425e-80e4-a62ffd5eda77 req-0bf22064-48c3-42ef-89d4-f682589eb067 service nova] Creating event network-changed:7c5145b3-25c0-454d-82ae-03544748b857 for instance ad123342-1bc3-4f98-aa4e-c526fc10d64f on n-h1-860864-3 Oct 11 20:16:48.396310 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1b4340d1-073e-425e-80e4-a62ffd5eda77 req-0bf22064-48c3-42ef-89d4-f682589eb067 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171625 Oct 11 20:16:48.397355 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2830/5620] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:16:48.507833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f73df8b7-775c-485b-9feb-e9342e55c0c3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:48.508385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f73df8b7-775c-485b-9feb-e9342e55c0c3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:48.532627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73df8b7-775c-485b-9feb-e9342e55c0c3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:48.533331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73df8b7-775c-485b-9feb-e9342e55c0c3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:48.534146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73df8b7-775c-485b-9feb-e9342e55c0c3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:48.535133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73df8b7-775c-485b-9feb-e9342e55c0c3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:48.535750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73df8b7-775c-485b-9feb-e9342e55c0c3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:48.536341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f73df8b7-775c-485b-9feb-e9342e55c0c3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:49.245282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f73df8b7-775c-485b-9feb-e9342e55c0c3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:49.264619 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f73df8b7-775c-485b-9feb-e9342e55c0c3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1314 microversion: 2.1 time: 0.761647 Oct 11 20:16:49.271329 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2791/5621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:48 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:16:50.301557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a0111324-8832-4179-a1a0-d017983a3656 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:50.304070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a0111324-8832-4179-a1a0-d017983a3656 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:50.326893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0111324-8832-4179-a1a0-d017983a3656 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:50.330451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0111324-8832-4179-a1a0-d017983a3656 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:50.331113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0111324-8832-4179-a1a0-d017983a3656 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:50.332009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0111324-8832-4179-a1a0-d017983a3656 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:50.338648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0111324-8832-4179-a1a0-d017983a3656 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:50.339362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a0111324-8832-4179-a1a0-d017983a3656 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:51.093378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a0111324-8832-4179-a1a0-d017983a3656 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:51.104152 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a0111324-8832-4179-a1a0-d017983a3656 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1314 microversion: 2.1 time: 0.811529 Oct 11 20:16:51.122226 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2831/5622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:50 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:16:52.133116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9164e11-7834-40bb-9982-0b72973e5433 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:52.133877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f9164e11-7834-40bb-9982-0b72973e5433 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:52.141843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9164e11-7834-40bb-9982-0b72973e5433 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:52.153954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9164e11-7834-40bb-9982-0b72973e5433 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:52.155988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9164e11-7834-40bb-9982-0b72973e5433 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:52.159435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9164e11-7834-40bb-9982-0b72973e5433 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:52.160114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9164e11-7834-40bb-9982-0b72973e5433 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:52.160727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9164e11-7834-40bb-9982-0b72973e5433 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:52.214885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:52.479839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f9164e11-7834-40bb-9982-0b72973e5433 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:52.496002 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9164e11-7834-40bb-9982-0b72973e5433 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1314 microversion: 2.1 time: 0.366612 Oct 11 20:16:52.511231 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2792/5623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:52 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:16:53.529550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b51a45fc-4e2f-453b-a61e-098ed7c113f1 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:53.530268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b51a45fc-4e2f-453b-a61e-098ed7c113f1 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:53.533308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:53.534219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:16:53.557169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51a45fc-4e2f-453b-a61e-098ed7c113f1 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:53.564221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51a45fc-4e2f-453b-a61e-098ed7c113f1 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:53.564916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51a45fc-4e2f-453b-a61e-098ed7c113f1 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:53.565831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51a45fc-4e2f-453b-a61e-098ed7c113f1 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:53.566486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51a45fc-4e2f-453b-a61e-098ed7c113f1 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:53.575227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51a45fc-4e2f-453b-a61e-098ed7c113f1 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:53.923436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b51a45fc-4e2f-453b-a61e-098ed7c113f1 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:53.936524 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b51a45fc-4e2f-453b-a61e-098ed7c113f1 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1314 microversion: 2.1 time: 0.410850 Oct 11 20:16:53.938082 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2832/5624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:53 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:16:54.681510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-31c38ea8-2546-467a-8cfa-7c584699385d req-a6230933-78b5-4ec7-b3f3-05a8e7f20de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad123342-1bc3-4f98-aa4e-c526fc10d64f", "name": "network-vif-plugged", "status": "completed", "tag": "7c5145b3-25c0-454d-82ae-03544748b857"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:16:54.710167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-31c38ea8-2546-467a-8cfa-7c584699385d req-a6230933-78b5-4ec7-b3f3-05a8e7f20de7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:54.713543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-31c38ea8-2546-467a-8cfa-7c584699385d req-a6230933-78b5-4ec7-b3f3-05a8e7f20de7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:54.714342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-31c38ea8-2546-467a-8cfa-7c584699385d req-a6230933-78b5-4ec7-b3f3-05a8e7f20de7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:54.741719 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-31c38ea8-2546-467a-8cfa-7c584699385d req-a6230933-78b5-4ec7-b3f3-05a8e7f20de7 service nova] Creating event network-vif-plugged:7c5145b3-25c0-454d-82ae-03544748b857 for instance ad123342-1bc3-4f98-aa4e-c526fc10d64f on n-h1-860864-3 Oct 11 20:16:54.752957 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-31c38ea8-2546-467a-8cfa-7c584699385d req-a6230933-78b5-4ec7-b3f3-05a8e7f20de7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078453 Oct 11 20:16:54.758299 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2793/5625] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:16:54.965132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c857dcec-3f03-4326-81ed-b2c717f93b16 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:54.965767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c857dcec-3f03-4326-81ed-b2c717f93b16 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:54.982311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c857dcec-3f03-4326-81ed-b2c717f93b16 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:54.982842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c857dcec-3f03-4326-81ed-b2c717f93b16 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:54.983286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c857dcec-3f03-4326-81ed-b2c717f93b16 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:54.984016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c857dcec-3f03-4326-81ed-b2c717f93b16 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:54.984484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c857dcec-3f03-4326-81ed-b2c717f93b16 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:54.984918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c857dcec-3f03-4326-81ed-b2c717f93b16 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:55.378166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c857dcec-3f03-4326-81ed-b2c717f93b16 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:55.389222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c857dcec-3f03-4326-81ed-b2c717f93b16 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1314 microversion: 2.1 time: 0.428859 Oct 11 20:16:55.401426 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2833/5626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:54 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:16:56.426685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d4b78db5-dcc6-47d3-94ec-49bad7dbbfec tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:16:56.427407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d4b78db5-dcc6-47d3-94ec-49bad7dbbfec tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:16:56.440185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4b78db5-dcc6-47d3-94ec-49bad7dbbfec tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:56.440698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4b78db5-dcc6-47d3-94ec-49bad7dbbfec tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:56.441145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4b78db5-dcc6-47d3-94ec-49bad7dbbfec tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:56.444615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4b78db5-dcc6-47d3-94ec-49bad7dbbfec tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:16:56.445086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4b78db5-dcc6-47d3-94ec-49bad7dbbfec tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:16:56.445529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4b78db5-dcc6-47d3-94ec-49bad7dbbfec tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:16:57.001432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d4b78db5-dcc6-47d3-94ec-49bad7dbbfec tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:16:57.018828 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d4b78db5-dcc6-47d3-94ec-49bad7dbbfec tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1499 microversion: 2.1 time: 0.597980 Oct 11 20:16:57.019276 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2794/5627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:16:56 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1499 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:01.513758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a02d1fbb-3391-4b05-b88b-6d73f5061673 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:01.514337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a02d1fbb-3391-4b05-b88b-6d73f5061673 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:01.527791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a02d1fbb-3391-4b05-b88b-6d73f5061673 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:01.528295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a02d1fbb-3391-4b05-b88b-6d73f5061673 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:01.528739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a02d1fbb-3391-4b05-b88b-6d73f5061673 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:01.531656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a02d1fbb-3391-4b05-b88b-6d73f5061673 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:01.534462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a02d1fbb-3391-4b05-b88b-6d73f5061673 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:01.536576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a02d1fbb-3391-4b05-b88b-6d73f5061673 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:01.592463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a02d1fbb-3391-4b05-b88b-6d73f5061673 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:17:01.759156 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a02d1fbb-3391-4b05-b88b-6d73f5061673 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 204 len: 0 microversion: 2.1 time: 0.249895 Oct 11 20:17:01.762569 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2834/5628] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:17:01 2022] DELETE /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:17:01.770695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc41268c-ef51-4da0-a9dd-69ef971df59d tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:01.772388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc41268c-ef51-4da0-a9dd-69ef971df59d tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:01.781501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc41268c-ef51-4da0-a9dd-69ef971df59d tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:01.782252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc41268c-ef51-4da0-a9dd-69ef971df59d tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:01.782892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc41268c-ef51-4da0-a9dd-69ef971df59d tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:01.783776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc41268c-ef51-4da0-a9dd-69ef971df59d tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:01.784433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc41268c-ef51-4da0-a9dd-69ef971df59d tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:01.785036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc41268c-ef51-4da0-a9dd-69ef971df59d tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:02.045559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fc41268c-ef51-4da0-a9dd-69ef971df59d tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:02.068487 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc41268c-ef51-4da0-a9dd-69ef971df59d tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1505 microversion: 2.1 time: 0.303896 Oct 11 20:17:02.069116 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2795/5629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:01 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:17:03.103848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-12675c06-d70a-492f-aba6-dda353e03afe tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:03.105443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-12675c06-d70a-492f-aba6-dda353e03afe tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:03.114636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12675c06-d70a-492f-aba6-dda353e03afe tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:03.115661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12675c06-d70a-492f-aba6-dda353e03afe tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:03.116358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12675c06-d70a-492f-aba6-dda353e03afe tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:03.117331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12675c06-d70a-492f-aba6-dda353e03afe tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:03.119241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12675c06-d70a-492f-aba6-dda353e03afe tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:03.121825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-12675c06-d70a-492f-aba6-dda353e03afe tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:03.464475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-12675c06-d70a-492f-aba6-dda353e03afe tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:03.490581 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-12675c06-d70a-492f-aba6-dda353e03afe tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1505 microversion: 2.1 time: 0.393786 Oct 11 20:17:03.492978 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2835/5630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:03 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:04.109672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f138f5f6-2d17-4b92-83a9-995d6561ef2d req-90666464-8d86-4555-8a22-d8b9ad041f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad123342-1bc3-4f98-aa4e-c526fc10d64f", "name": "network-vif-deleted", "tag": "7c5145b3-25c0-454d-82ae-03544748b857"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:17:04.165119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f138f5f6-2d17-4b92-83a9-995d6561ef2d req-90666464-8d86-4555-8a22-d8b9ad041f09 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:04.168402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f138f5f6-2d17-4b92-83a9-995d6561ef2d req-90666464-8d86-4555-8a22-d8b9ad041f09 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:04.171409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f138f5f6-2d17-4b92-83a9-995d6561ef2d req-90666464-8d86-4555-8a22-d8b9ad041f09 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:04.188258 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f138f5f6-2d17-4b92-83a9-995d6561ef2d req-90666464-8d86-4555-8a22-d8b9ad041f09 service nova] Creating event network-vif-deleted:7c5145b3-25c0-454d-82ae-03544748b857 for instance ad123342-1bc3-4f98-aa4e-c526fc10d64f on n-h1-860864-3 Oct 11 20:17:04.193922 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f138f5f6-2d17-4b92-83a9-995d6561ef2d req-90666464-8d86-4555-8a22-d8b9ad041f09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089718 Oct 11 20:17:04.199397 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2796/5631] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:17:04.519361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:04.520620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:04.534372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:04.536543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:04.537178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:04.542139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:04.544257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:04.544881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:04.599299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:04.600106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:04.600801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:04.604182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lazy-loading 'fault' on Instance uuid ad123342-1bc3-4f98-aa4e-c526fc10d64f {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:17:04.705065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ca7148c63445d392bf113a8417d7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2eef666a774efea72d675ef50bb0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:04.730514 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-696ac546-d6e8-43f9-b4cd-6e913fcf3419 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 200 len: 1304 microversion: 2.1 time: 0.214946 Oct 11 20:17:04.732104 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2836/5632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:04 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 1304 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:05.759957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:05.761421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] [instance: ad123342-1bc3-4f98-aa4e-c526fc10d64f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:05.774267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:05.778272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:05.778940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:05.779865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:05.780495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:05.781273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:05.807395 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] HTTP exception thrown: Instance ad123342-1bc3-4f98-aa4e-c526fc10d64f could not be found. Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Request method failure captured: Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f HTTP/1.1 Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc8krcQLgmeqjH7Mi79Xotvu5IaMI7ZEnTwklWyI6UyTkZQBdgErsMNSaU9L2guhVTv_9q8lZ6htRxEAVxdhUwFVikZEFSLRUVaJNcW9hcGhsYiFW8p9HJH3kIjX9IhTMMDSDZku3vIMOCPMDACnYO8V8uY62doGsLgCi7M9psPCdjQ Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 4b2eef666a774efea72d675ef50bb0f7 Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesActionsTest-243057722 Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b2eef666a774efea72d675ef50bb0f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b2eef666a774efea72d675ef50bb0f7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b2eef666a774efea72d675ef50bb0f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b2eef666a774efea72d675ef50bb0f7"}]}] Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesActionsTest-243057722 Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 4b2eef666a774efea72d675ef50bb0f7 Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesActionsTest-243057722 Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesActionsTest-243057722-project Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 58ca7148c63445d392bf113a8417d7ba Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesActionsTest-243057722-project Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ad123342-1bc3-4f98-aa4e-c526fc10d64f could not be found. Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ad123342-1bc3-4f98-aa4e-c526fc10d64f'} Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad123342-1bc3-4f98-aa4e-c526fc10d64f could not be found. Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad123342-1bc3-4f98-aa4e-c526fc10d64f could not be found. Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:17:05.813997 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:17:05.820032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:17:05.820032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:17:05.820032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:17:05.820032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:17:05.820032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:17:05.820032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad123342-1bc3-4f98-aa4e-c526fc10d64f could not be found. Oct 11 20:17:05.820032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:17:05.822644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] Returning 404 to user: Instance ad123342-1bc3-4f98-aa4e-c526fc10d64f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:17:05.832244 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bb748ed5-7b6c-4931-9b48-3b45108fa5e3 tempest-VolumesActionsTest-243057722 tempest-VolumesActionsTest-243057722-project] 10.222.0.27 "GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f" status: 404 len: 111 microversion: 2.1 time: 0.077503 Oct 11 20:17:05.833098 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2797/5633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:05 2022] GET /compute/v2.1/servers/ad123342-1bc3-4f98-aa4e-c526fc10d64f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:17:24.769190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-243028912", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:17:24.779095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:24.784887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:24.877199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:17:25.721381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:17:25.721829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:17:25.722325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:17:25.722787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:17:25.723329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:17:25.753936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:25.754458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:25.754923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:25.755861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:25.756454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:25.757552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:25.815578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Getting quotas for project c7fc31b0d6ed409e9610c523b2c028a7. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:17:25.845688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Getting quotas for user f77a84122e1c4375888b4f6bc2ad30b2 and project c7fc31b0d6ed409e9610c523b2c028a7. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:17:25.895274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:17:25.905007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:17:26.041531 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5286b24d-be35-441c-8f30-24e090b8c08c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.276103 Oct 11 20:17:26.043857 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2837/5634] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:17:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:17:26.057768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a5cea7ae-abf4-4ec6-a1cf-5ffc7f5ed02e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:26.059139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a5cea7ae-abf4-4ec6-a1cf-5ffc7f5ed02e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:26.068202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=22 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:26.069127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=42 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:26.232418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a5cea7ae-abf4-4ec6-a1cf-5ffc7f5ed02e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:26.267287 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a5cea7ae-abf4-4ec6-a1cf-5ffc7f5ed02e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1213 microversion: 2.1 time: 0.195006 Oct 11 20:17:26.267976 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2798/5635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:26 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1213 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:27.297412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9889f8ce-db23-4268-b71a-a9fecd3a49ad tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:27.299709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9889f8ce-db23-4268-b71a-a9fecd3a49ad tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:27.316749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9889f8ce-db23-4268-b71a-a9fecd3a49ad tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:27.317648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9889f8ce-db23-4268-b71a-a9fecd3a49ad tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:27.318273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9889f8ce-db23-4268-b71a-a9fecd3a49ad tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:27.319182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9889f8ce-db23-4268-b71a-a9fecd3a49ad tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:27.319802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9889f8ce-db23-4268-b71a-a9fecd3a49ad tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:27.320412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9889f8ce-db23-4268-b71a-a9fecd3a49ad tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:27.420536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9889f8ce-db23-4268-b71a-a9fecd3a49ad tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:27.433069 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9889f8ce-db23-4268-b71a-a9fecd3a49ad tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1209 microversion: 2.1 time: 0.137919 Oct 11 20:17:27.448424 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2838/5636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:27 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1209 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:28.462415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6945be77-c933-46da-bd49-7233874b7aeb tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:28.463048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6945be77-c933-46da-bd49-7233874b7aeb tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:28.472937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6945be77-c933-46da-bd49-7233874b7aeb tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:28.473428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6945be77-c933-46da-bd49-7233874b7aeb tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:28.478427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6945be77-c933-46da-bd49-7233874b7aeb tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:28.479782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6945be77-c933-46da-bd49-7233874b7aeb tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:28.482880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6945be77-c933-46da-bd49-7233874b7aeb tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:28.483349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6945be77-c933-46da-bd49-7233874b7aeb tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:28.613453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6945be77-c933-46da-bd49-7233874b7aeb tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:28.642337 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6945be77-c933-46da-bd49-7233874b7aeb tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1271 microversion: 2.1 time: 0.182892 Oct 11 20:17:28.654873 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2799/5637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:28 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:29.675639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e4356f49-10bd-4bc4-a32e-ee42e364eae1 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:29.676267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e4356f49-10bd-4bc4-a32e-ee42e364eae1 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:29.696858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4356f49-10bd-4bc4-a32e-ee42e364eae1 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:29.698783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4356f49-10bd-4bc4-a32e-ee42e364eae1 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:29.700369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4356f49-10bd-4bc4-a32e-ee42e364eae1 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:29.702174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4356f49-10bd-4bc4-a32e-ee42e364eae1 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:29.703423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4356f49-10bd-4bc4-a32e-ee42e364eae1 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:29.705331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4356f49-10bd-4bc4-a32e-ee42e364eae1 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:30.107936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e4356f49-10bd-4bc4-a32e-ee42e364eae1 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:30.124018 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e4356f49-10bd-4bc4-a32e-ee42e364eae1 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1313 microversion: 2.1 time: 0.449601 Oct 11 20:17:30.126519 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2839/5638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:29 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:31.090474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f32e7a0d-99cb-494c-837c-a16bf90a9cb2 req-70469ffe-28d0-47a0-9e58-473d86c489fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "615dfb94-8115-4e76-a938-287caf7fdeb6", "tag": "ee54e4da-bc45-47b7-8ce0-3c78c925949f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:17:31.135356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f32e7a0d-99cb-494c-837c-a16bf90a9cb2 req-70469ffe-28d0-47a0-9e58-473d86c489fe service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:31.139118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f32e7a0d-99cb-494c-837c-a16bf90a9cb2 req-70469ffe-28d0-47a0-9e58-473d86c489fe service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:31.140475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f32e7a0d-99cb-494c-837c-a16bf90a9cb2 req-70469ffe-28d0-47a0-9e58-473d86c489fe service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:31.151201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9b47b066-0ac2-4386-977c-3a3e95a872a5 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:31.151921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9b47b066-0ac2-4386-977c-3a3e95a872a5 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:31.173716 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f32e7a0d-99cb-494c-837c-a16bf90a9cb2 req-70469ffe-28d0-47a0-9e58-473d86c489fe service nova] Creating event network-changed:ee54e4da-bc45-47b7-8ce0-3c78c925949f for instance 615dfb94-8115-4e76-a938-287caf7fdeb6 on n-h1-860864-3 Oct 11 20:17:31.176916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b47b066-0ac2-4386-977c-3a3e95a872a5 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:31.177898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b47b066-0ac2-4386-977c-3a3e95a872a5 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:31.178438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b47b066-0ac2-4386-977c-3a3e95a872a5 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:31.179304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b47b066-0ac2-4386-977c-3a3e95a872a5 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:31.179847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b47b066-0ac2-4386-977c-3a3e95a872a5 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:31.181877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9b47b066-0ac2-4386-977c-3a3e95a872a5 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:31.185690 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f32e7a0d-99cb-494c-837c-a16bf90a9cb2 req-70469ffe-28d0-47a0-9e58-473d86c489fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106646 Oct 11 20:17:31.189671 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2800/5639] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:17:31.482004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9b47b066-0ac2-4386-977c-3a3e95a872a5 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:31.496878 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9b47b066-0ac2-4386-977c-3a3e95a872a5 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1313 microversion: 2.1 time: 0.351703 Oct 11 20:17:31.498456 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2840/5640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:31 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:32.524740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ab5e3ac-0dab-41a8-8cfe-6b21dbf5cb3b tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:32.526403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7ab5e3ac-0dab-41a8-8cfe-6b21dbf5cb3b tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:32.536119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ab5e3ac-0dab-41a8-8cfe-6b21dbf5cb3b tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:32.536885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ab5e3ac-0dab-41a8-8cfe-6b21dbf5cb3b tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:32.537532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ab5e3ac-0dab-41a8-8cfe-6b21dbf5cb3b tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:32.539060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ab5e3ac-0dab-41a8-8cfe-6b21dbf5cb3b tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:32.539732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ab5e3ac-0dab-41a8-8cfe-6b21dbf5cb3b tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:32.540385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ab5e3ac-0dab-41a8-8cfe-6b21dbf5cb3b tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:32.728084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7ab5e3ac-0dab-41a8-8cfe-6b21dbf5cb3b tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:32.740132 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7ab5e3ac-0dab-41a8-8cfe-6b21dbf5cb3b tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1313 microversion: 2.1 time: 0.222126 Oct 11 20:17:32.741955 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2801/5641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:32 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:33.763669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba73cd4b-66ec-4690-86ee-e10ac99e5f20 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:33.766787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba73cd4b-66ec-4690-86ee-e10ac99e5f20 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:33.778143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba73cd4b-66ec-4690-86ee-e10ac99e5f20 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:33.778888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba73cd4b-66ec-4690-86ee-e10ac99e5f20 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:33.779505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba73cd4b-66ec-4690-86ee-e10ac99e5f20 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:33.783322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba73cd4b-66ec-4690-86ee-e10ac99e5f20 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:33.784145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba73cd4b-66ec-4690-86ee-e10ac99e5f20 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:33.784783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba73cd4b-66ec-4690-86ee-e10ac99e5f20 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:34.546508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba73cd4b-66ec-4690-86ee-e10ac99e5f20 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:34.564560 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba73cd4b-66ec-4690-86ee-e10ac99e5f20 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1313 microversion: 2.1 time: 0.804590 Oct 11 20:17:34.565165 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2841/5642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:33 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1313 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:35.593803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1c82782d-23ed-4fc1-bf5f-4892a89270af tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:35.595340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1c82782d-23ed-4fc1-bf5f-4892a89270af tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:35.603828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c82782d-23ed-4fc1-bf5f-4892a89270af tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:35.604564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c82782d-23ed-4fc1-bf5f-4892a89270af tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:35.605335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c82782d-23ed-4fc1-bf5f-4892a89270af tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:35.606494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c82782d-23ed-4fc1-bf5f-4892a89270af tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:35.607177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c82782d-23ed-4fc1-bf5f-4892a89270af tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:35.607800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1c82782d-23ed-4fc1-bf5f-4892a89270af tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:35.983513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1c82782d-23ed-4fc1-bf5f-4892a89270af tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:35.997054 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1c82782d-23ed-4fc1-bf5f-4892a89270af tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1313 microversion: 2.1 time: 0.408648 Oct 11 20:17:36.010739 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2802/5643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:35 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:36.692080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-643596d4-8050-4b87-90c3-51f81dbf855f req-ff4ae04c-dd4f-402b-be00-ff76e997a337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615dfb94-8115-4e76-a938-287caf7fdeb6", "name": "network-vif-plugged", "status": "completed", "tag": "ee54e4da-bc45-47b7-8ce0-3c78c925949f"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:17:36.707660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:36.708581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:36.742118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-643596d4-8050-4b87-90c3-51f81dbf855f req-ff4ae04c-dd4f-402b-be00-ff76e997a337 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:36.744009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-643596d4-8050-4b87-90c3-51f81dbf855f req-ff4ae04c-dd4f-402b-be00-ff76e997a337 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:36.746036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-643596d4-8050-4b87-90c3-51f81dbf855f req-ff4ae04c-dd4f-402b-be00-ff76e997a337 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:36.797562 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-643596d4-8050-4b87-90c3-51f81dbf855f req-ff4ae04c-dd4f-402b-be00-ff76e997a337 service nova] Creating event network-vif-plugged:ee54e4da-bc45-47b7-8ce0-3c78c925949f for instance 615dfb94-8115-4e76-a938-287caf7fdeb6 on n-h1-860864-3 Oct 11 20:17:36.813219 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-643596d4-8050-4b87-90c3-51f81dbf855f req-ff4ae04c-dd4f-402b-be00-ff76e997a337 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125103 Oct 11 20:17:36.817877 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2842/5644] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:17:37.024456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca355449-2be7-4d44-adf9-396cfd4f58f9 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:37.025649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca355449-2be7-4d44-adf9-396cfd4f58f9 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:37.038118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:37.041072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca355449-2be7-4d44-adf9-396cfd4f58f9 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:37.043077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca355449-2be7-4d44-adf9-396cfd4f58f9 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:37.045196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca355449-2be7-4d44-adf9-396cfd4f58f9 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:37.046179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca355449-2be7-4d44-adf9-396cfd4f58f9 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:37.046837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca355449-2be7-4d44-adf9-396cfd4f58f9 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:37.048753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca355449-2be7-4d44-adf9-396cfd4f58f9 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:37.563830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca355449-2be7-4d44-adf9-396cfd4f58f9 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:37.578357 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca355449-2be7-4d44-adf9-396cfd4f58f9 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1313 microversion: 2.1 time: 0.558586 Oct 11 20:17:37.579785 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2803/5645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:37 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:38.603747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a72174b-fb7a-479e-8300-41e8376d5d32 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:38.604672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7a72174b-fb7a-479e-8300-41e8376d5d32 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:38.621070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a72174b-fb7a-479e-8300-41e8376d5d32 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:38.624657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a72174b-fb7a-479e-8300-41e8376d5d32 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:38.625230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a72174b-fb7a-479e-8300-41e8376d5d32 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:38.626172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a72174b-fb7a-479e-8300-41e8376d5d32 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:38.626789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a72174b-fb7a-479e-8300-41e8376d5d32 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:38.628079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a72174b-fb7a-479e-8300-41e8376d5d32 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:39.019308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7a72174b-fb7a-479e-8300-41e8376d5d32 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:39.028777 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a72174b-fb7a-479e-8300-41e8376d5d32 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1463 microversion: 2.1 time: 0.431060 Oct 11 20:17:39.029993 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2843/5646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:38 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1463 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:17:39.054214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3fc814a8-b2a2-4587-9b67-a66d9506ad5c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "743b6bc9-1aab-4529-8d1e-2407e50eee5d", "device": "/dev/sdb"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:17:39.057305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3fc814a8-b2a2-4587-9b67-a66d9506ad5c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:39.076384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fc814a8-b2a2-4587-9b67-a66d9506ad5c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:39.076888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fc814a8-b2a2-4587-9b67-a66d9506ad5c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:39.077344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fc814a8-b2a2-4587-9b67-a66d9506ad5c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:39.078408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fc814a8-b2a2-4587-9b67-a66d9506ad5c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:39.078504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fc814a8-b2a2-4587-9b67-a66d9506ad5c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:39.078950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fc814a8-b2a2-4587-9b67-a66d9506ad5c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:39.541151 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3fc814a8-b2a2-4587-9b67-a66d9506ad5c tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "POST /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491157 Oct 11 20:17:39.555470 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2804/5647] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:17:39 2022] POST /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:17:42.951830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1680939561", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:17:43.030732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:17:43.293076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:17:43.293726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:17:43.294666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:17:43.295486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:17:43.296191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:17:43.311956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:43.312644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:43.313420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:43.314322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:43.315073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:43.315702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:43.346857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Getting quotas for project 95163e06437a453d8dfdb27582dc4c91. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:17:43.363336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Getting quotas for user ee74eec623fc46d2be130886591350b5 and project 95163e06437a453d8dfdb27582dc4c91. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:17:43.379300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:17:43.382286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:17:43.443460 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3d64d182-6a6b-45a7-ac74-cc45fdc34e08 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495040 Oct 11 20:17:43.444417 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2844/5648] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:17:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 20:17:43.457878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ab484346-85a5-4ebe-8abb-1d2d7fd3182d tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:43.459898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ab484346-85a5-4ebe-8abb-1d2d7fd3182d tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:43.561477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ab484346-85a5-4ebe-8abb-1d2d7fd3182d tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:43.575952 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ab484346-85a5-4ebe-8abb-1d2d7fd3182d tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1215 microversion: 2.1 time: 0.123086 Oct 11 20:17:43.577063 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2805/5649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:43 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:44.601498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e7865d91-ccd8-45c0-b2e8-2a7e186f6457 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:44.604466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e7865d91-ccd8-45c0-b2e8-2a7e186f6457 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:44.618488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7865d91-ccd8-45c0-b2e8-2a7e186f6457 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:44.619595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7865d91-ccd8-45c0-b2e8-2a7e186f6457 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:44.622280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7865d91-ccd8-45c0-b2e8-2a7e186f6457 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:44.623640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7865d91-ccd8-45c0-b2e8-2a7e186f6457 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:44.633472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7865d91-ccd8-45c0-b2e8-2a7e186f6457 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:44.634215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7865d91-ccd8-45c0-b2e8-2a7e186f6457 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:44.859744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e7865d91-ccd8-45c0-b2e8-2a7e186f6457 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:44.878652 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e7865d91-ccd8-45c0-b2e8-2a7e186f6457 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1267 microversion: 2.1 time: 0.278531 Oct 11 20:17:44.883045 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2845/5650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:44 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:45.908127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b2cf489e-f139-4231-aa77-6ee90ac223be tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:45.909301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b2cf489e-f139-4231-aa77-6ee90ac223be tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:45.924876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2cf489e-f139-4231-aa77-6ee90ac223be tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:45.925587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2cf489e-f139-4231-aa77-6ee90ac223be tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:45.926197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2cf489e-f139-4231-aa77-6ee90ac223be tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:45.927089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2cf489e-f139-4231-aa77-6ee90ac223be tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:45.929651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2cf489e-f139-4231-aa77-6ee90ac223be tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:45.930256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2cf489e-f139-4231-aa77-6ee90ac223be tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:46.099409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b2cf489e-f139-4231-aa77-6ee90ac223be tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:46.112642 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b2cf489e-f139-4231-aa77-6ee90ac223be tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1273 microversion: 2.1 time: 0.207899 Oct 11 20:17:46.129197 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2806/5651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:45 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:47.144403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-69128635-f7f6-4952-8079-16de238b5b93 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:47.145872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-69128635-f7f6-4952-8079-16de238b5b93 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:47.213031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69128635-f7f6-4952-8079-16de238b5b93 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:47.213671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69128635-f7f6-4952-8079-16de238b5b93 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:47.231291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69128635-f7f6-4952-8079-16de238b5b93 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:47.232019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69128635-f7f6-4952-8079-16de238b5b93 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:47.232521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69128635-f7f6-4952-8079-16de238b5b93 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:47.232978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69128635-f7f6-4952-8079-16de238b5b93 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:47.804884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-69128635-f7f6-4952-8079-16de238b5b93 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:47.821152 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-69128635-f7f6-4952-8079-16de238b5b93 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1315 microversion: 2.1 time: 0.685472 Oct 11 20:17:47.836335 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2846/5652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:47 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:48.321469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4714250a-c43d-4972-966f-30150d4b955b req-de6e6fc0-9220-4030-870b-188998c37e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2", "tag": "bf6e525b-4f30-450d-b152-d336befb9a1c"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:17:48.356410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4714250a-c43d-4972-966f-30150d4b955b req-de6e6fc0-9220-4030-870b-188998c37e17 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:48.356934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4714250a-c43d-4972-966f-30150d4b955b req-de6e6fc0-9220-4030-870b-188998c37e17 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:48.357371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4714250a-c43d-4972-966f-30150d4b955b req-de6e6fc0-9220-4030-870b-188998c37e17 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:48.408429 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4714250a-c43d-4972-966f-30150d4b955b req-de6e6fc0-9220-4030-870b-188998c37e17 service nova] Creating event network-changed:bf6e525b-4f30-450d-b152-d336befb9a1c for instance bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 on n-h2-860864-3 Oct 11 20:17:48.415651 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4714250a-c43d-4972-966f-30150d4b955b req-de6e6fc0-9220-4030-870b-188998c37e17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099749 Oct 11 20:17:48.424001 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2807/5653] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:17:48.844223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a7594a37-16bc-4dcb-8855-39d9d3feacbe tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:48.845025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a7594a37-16bc-4dcb-8855-39d9d3feacbe tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:48.856173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7594a37-16bc-4dcb-8855-39d9d3feacbe tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:48.857511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7594a37-16bc-4dcb-8855-39d9d3feacbe tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:48.868556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7594a37-16bc-4dcb-8855-39d9d3feacbe tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:48.869946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7594a37-16bc-4dcb-8855-39d9d3feacbe tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:48.870438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7594a37-16bc-4dcb-8855-39d9d3feacbe tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:48.871284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7594a37-16bc-4dcb-8855-39d9d3feacbe tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:49.059473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a7594a37-16bc-4dcb-8855-39d9d3feacbe tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:49.068703 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a7594a37-16bc-4dcb-8855-39d9d3feacbe tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1315 microversion: 2.1 time: 0.228014 Oct 11 20:17:49.070144 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2847/5654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:48 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:50.094488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8ae77bf1-7dfa-4dd4-9aa0-e6ea582e15fc tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:50.096323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8ae77bf1-7dfa-4dd4-9aa0-e6ea582e15fc tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:50.103047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae77bf1-7dfa-4dd4-9aa0-e6ea582e15fc tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:50.103763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae77bf1-7dfa-4dd4-9aa0-e6ea582e15fc tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:50.104364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae77bf1-7dfa-4dd4-9aa0-e6ea582e15fc tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:50.105232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae77bf1-7dfa-4dd4-9aa0-e6ea582e15fc tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:50.105837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae77bf1-7dfa-4dd4-9aa0-e6ea582e15fc tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:50.106272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae77bf1-7dfa-4dd4-9aa0-e6ea582e15fc tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:50.396666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8ae77bf1-7dfa-4dd4-9aa0-e6ea582e15fc tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:50.407354 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8ae77bf1-7dfa-4dd4-9aa0-e6ea582e15fc tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1315 microversion: 2.1 time: 0.318265 Oct 11 20:17:50.426627 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2808/5655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:50 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:51.434286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-04337c5b-6ad2-4330-baab-3000ae328182 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:51.434929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-04337c5b-6ad2-4330-baab-3000ae328182 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:51.442304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04337c5b-6ad2-4330-baab-3000ae328182 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:51.443216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04337c5b-6ad2-4330-baab-3000ae328182 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:51.443862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04337c5b-6ad2-4330-baab-3000ae328182 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:51.444760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04337c5b-6ad2-4330-baab-3000ae328182 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:51.445404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04337c5b-6ad2-4330-baab-3000ae328182 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:51.446020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04337c5b-6ad2-4330-baab-3000ae328182 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:51.601001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-04337c5b-6ad2-4330-baab-3000ae328182 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:51.622331 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-04337c5b-6ad2-4330-baab-3000ae328182 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1315 microversion: 2.1 time: 0.191952 Oct 11 20:17:51.623417 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2848/5656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:51 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:52.649039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ce0cfd32-3837-414f-a151-ac15100884e0 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:52.649670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ce0cfd32-3837-414f-a151-ac15100884e0 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:52.656343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0cfd32-3837-414f-a151-ac15100884e0 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:52.656841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0cfd32-3837-414f-a151-ac15100884e0 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:52.657286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0cfd32-3837-414f-a151-ac15100884e0 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:52.657994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0cfd32-3837-414f-a151-ac15100884e0 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:52.658454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0cfd32-3837-414f-a151-ac15100884e0 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:52.671177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce0cfd32-3837-414f-a151-ac15100884e0 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:52.980038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-0556afc7-4a5e-4a5a-ae05-730339e6cff1 req-cbbec03c-ab16-42bc-b64d-ac71b8e250f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2", "name": "network-vif-plugged", "status": "completed", "tag": "bf6e525b-4f30-450d-b152-d336befb9a1c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:17:53.008050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0556afc7-4a5e-4a5a-ae05-730339e6cff1 req-cbbec03c-ab16-42bc-b64d-ac71b8e250f2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:53.009742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0556afc7-4a5e-4a5a-ae05-730339e6cff1 req-cbbec03c-ab16-42bc-b64d-ac71b8e250f2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:53.010644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0556afc7-4a5e-4a5a-ae05-730339e6cff1 req-cbbec03c-ab16-42bc-b64d-ac71b8e250f2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:53.037424 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-0556afc7-4a5e-4a5a-ae05-730339e6cff1 req-cbbec03c-ab16-42bc-b64d-ac71b8e250f2 service nova] Creating event network-vif-plugged:bf6e525b-4f30-450d-b152-d336befb9a1c for instance bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 on n-h2-860864-3 Oct 11 20:17:53.047967 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-0556afc7-4a5e-4a5a-ae05-730339e6cff1 req-cbbec03c-ab16-42bc-b64d-ac71b8e250f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070948 Oct 11 20:17:53.052723 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2849/5657] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:17:53.318817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce0cfd32-3837-414f-a151-ac15100884e0 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:53.327276 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ce0cfd32-3837-414f-a151-ac15100884e0 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1315 microversion: 2.1 time: 0.684129 Oct 11 20:17:53.327864 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2809/5658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:52 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:54.353397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-13be2e1c-d781-41b1-9e77-532c55a31703 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:54.354179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-13be2e1c-d781-41b1-9e77-532c55a31703 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:54.357545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:54.358972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:54.366736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13be2e1c-d781-41b1-9e77-532c55a31703 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:54.367520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13be2e1c-d781-41b1-9e77-532c55a31703 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:54.368174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13be2e1c-d781-41b1-9e77-532c55a31703 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:54.369517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13be2e1c-d781-41b1-9e77-532c55a31703 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:54.370923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13be2e1c-d781-41b1-9e77-532c55a31703 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:54.371670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-13be2e1c-d781-41b1-9e77-532c55a31703 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:54.529290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-13be2e1c-d781-41b1-9e77-532c55a31703 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:54.538470 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-13be2e1c-d781-41b1-9e77-532c55a31703 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1464 microversion: 2.1 time: 0.190255 Oct 11 20:17:54.539955 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2850/5659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:54 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:54.588227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-88afc7e1-5235-4822-9f35-524fe6b8567b tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:54.589361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-88afc7e1-5235-4822-9f35-524fe6b8567b tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:54.595707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:54.598512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88afc7e1-5235-4822-9f35-524fe6b8567b tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:54.599887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88afc7e1-5235-4822-9f35-524fe6b8567b tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:54.600656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88afc7e1-5235-4822-9f35-524fe6b8567b tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:54.601572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88afc7e1-5235-4822-9f35-524fe6b8567b tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:54.602232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88afc7e1-5235-4822-9f35-524fe6b8567b tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:54.602894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88afc7e1-5235-4822-9f35-524fe6b8567b tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:54.629464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-88afc7e1-5235-4822-9f35-524fe6b8567b tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:17:54.772632 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-88afc7e1-5235-4822-9f35-524fe6b8567b tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 204 len: 0 microversion: 2.1 time: 0.186681 Oct 11 20:17:54.782303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ccd97849-7e25-4e2c-b4ef-e01d185f92e6 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:54.783280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ccd97849-7e25-4e2c-b4ef-e01d185f92e6 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:54.790639 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2810/5660] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:17:54 2022] DELETE /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:17:54.792487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd97849-7e25-4e2c-b4ef-e01d185f92e6 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:54.793185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd97849-7e25-4e2c-b4ef-e01d185f92e6 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:54.793912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd97849-7e25-4e2c-b4ef-e01d185f92e6 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:54.794813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd97849-7e25-4e2c-b4ef-e01d185f92e6 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:54.795589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd97849-7e25-4e2c-b4ef-e01d185f92e6 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:54.796590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ccd97849-7e25-4e2c-b4ef-e01d185f92e6 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:54.827564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=71 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:55.014171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ccd97849-7e25-4e2c-b4ef-e01d185f92e6 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:55.030054 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ccd97849-7e25-4e2c-b4ef-e01d185f92e6 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1470 microversion: 2.1 time: 0.247286 Oct 11 20:17:55.042639 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2851/5661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:54 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:17:56.054702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca9c299e-31f3-4d77-a020-4dfb482c9631 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:56.055561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca9c299e-31f3-4d77-a020-4dfb482c9631 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:56.082296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9c299e-31f3-4d77-a020-4dfb482c9631 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:56.082872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9c299e-31f3-4d77-a020-4dfb482c9631 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:56.083996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9c299e-31f3-4d77-a020-4dfb482c9631 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:56.085095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9c299e-31f3-4d77-a020-4dfb482c9631 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:56.085838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9c299e-31f3-4d77-a020-4dfb482c9631 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:56.086481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9c299e-31f3-4d77-a020-4dfb482c9631 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:56.426729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca9c299e-31f3-4d77-a020-4dfb482c9631 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:56.430162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:56.439138 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca9c299e-31f3-4d77-a020-4dfb482c9631 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1470 microversion: 2.1 time: 0.391172 Oct 11 20:17:56.447198 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2811/5662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:56 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1470 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:57.137790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-bff3c3ba-d838-41d5-b415-7d68b844793d req-ca3bf49c-1d49-4f04-8a97-f6a510527d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2", "name": "network-vif-deleted", "tag": "bf6e525b-4f30-450d-b152-d336befb9a1c"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:17:57.180705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:57.182838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bff3c3ba-d838-41d5-b415-7d68b844793d req-ca3bf49c-1d49-4f04-8a97-f6a510527d0a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:57.183395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bff3c3ba-d838-41d5-b415-7d68b844793d req-ca3bf49c-1d49-4f04-8a97-f6a510527d0a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:57.183856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bff3c3ba-d838-41d5-b415-7d68b844793d req-ca3bf49c-1d49-4f04-8a97-f6a510527d0a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:57.197871 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bff3c3ba-d838-41d5-b415-7d68b844793d req-ca3bf49c-1d49-4f04-8a97-f6a510527d0a service nova] Creating event network-vif-deleted:bf6e525b-4f30-450d-b152-d336befb9a1c for instance bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 on n-h2-860864-3 Oct 11 20:17:57.204405 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-bff3c3ba-d838-41d5-b415-7d68b844793d req-ca3bf49c-1d49-4f04-8a97-f6a510527d0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070321 Oct 11 20:17:57.205210 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2852/5663] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:17:57.482311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:57.484076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:57.492236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:17:57.494432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:57.495555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:57.496224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:57.497203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:57.497867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:57.498558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:57.556770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:57.557525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:57.558348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:57.559032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lazy-loading 'fault' on Instance uuid bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:17:57.621940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee74eec623fc46d2be130886591350b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95163e06437a453d8dfdb27582dc4c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:17:57.631541 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3e186df7-629f-4559-9f15-d6b2def79542 tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 200 len: 1305 microversion: 2.1 time: 0.163803 Oct 11 20:17:57.636313 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2812/5664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:57 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 1305 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:17:58.664002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:17:58.665581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] [instance: bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:17:58.681455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:58.682562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:58.683687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:58.686017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:17:58.686639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:17:58.688554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:17:58.724126 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] HTTP exception thrown: Instance bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 could not be found. Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Request method failure captured: Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 HTTP/1.1 Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRc9kCdS_ZOWLR5LHh70LJfRx8vJ_14A9r37LCq5hJCuf49V7AhrzRMEHWYay4AQAZ9P7jBHeLfNLoCnQ64H8m_UD-gD_ZLUav4dZ6Bpoz2Jpt0izW5EZm80jZQVNcfF2i01fVeh3cKGMhx1PhhOd5iE43ZhUcODk5QyltOEKiey1sIc Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 95163e06437a453d8dfdb27582dc4c91 Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesNegativeTest-866801717 Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/95163e06437a453d8dfdb27582dc4c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_95163e06437a453d8dfdb27582dc4c91", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95163e06437a453d8dfdb27582dc4c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95163e06437a453d8dfdb27582dc4c91"}]}] Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesNegativeTest-866801717 Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 95163e06437a453d8dfdb27582dc4c91 Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesNegativeTest-866801717 Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesNegativeTest-866801717-project Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: ee74eec623fc46d2be130886591350b5 Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesNegativeTest-866801717-project Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 could not be found. Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2'} Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 could not be found. Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 could not be found. Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:17:58.727406 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:17:58.732217 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:17:58.732217 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:17:58.732217 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:17:58.732217 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:17:58.732217 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:17:58.732217 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 could not be found. Oct 11 20:17:58.732217 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:17:58.732217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] Returning 404 to user: Instance bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:17:58.732217 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2d82733b-51e5-45ff-a72d-16cf15a948dd tempest-VolumesNegativeTest-866801717 tempest-VolumesNegativeTest-866801717-project] 10.222.0.27 "GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2" status: 404 len: 111 microversion: 2.1 time: 0.071281 Oct 11 20:17:58.733755 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2853/5665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:17:58 2022] GET /compute/v2.1/servers/bc974a9a-c34e-48c7-9cf8-82d8ddabfbf2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:18:19.088288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:19.089025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=9 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:19.090548 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:18:19.091113 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 20:18:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 11 20:18:19.398826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1116367397", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "cebf547f-d499-47fe-ac41-c19e0565725c"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:19.473261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] validate_networks() for [('cebf547f-d499-47fe-ac41-c19e0565725c', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:18:20.188976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:18:20.190001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:18:20.190717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:18:20.191920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:18:20.192725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:18:20.203842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:20.204559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:20.207267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:20.208339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:20.209023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:20.209620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:20.242919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Getting quotas for project 13a8c358ad404718b667359e1864e289. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:18:20.255390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Getting quotas for user 8501be48ff8b4617b186777866d6fe26 and project 13a8c358ad404718b667359e1864e289. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:18:20.284393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:18:20.288737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:18:20.367600 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6f9a1aa5-84b8-4ca1-afe2-66a239c837de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.286638 Oct 11 20:18:20.381892 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2813/5666] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:18:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:18:20.388639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-def2ab04-3c47-4db6-880b-2a8bb18a9952 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:20.390106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-def2ab04-3c47-4db6-880b-2a8bb18a9952 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:20.406406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:20.407360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=7 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:21.160295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-def2ab04-3c47-4db6-880b-2a8bb18a9952 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:21.167920 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-def2ab04-3c47-4db6-880b-2a8bb18a9952 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1215 microversion: 2.1 time: 0.783489 Oct 11 20:18:21.169011 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2854/5667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:20 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1215 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:22.195266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-18725e5d-0ae8-47c0-9b26-e1f533f61a57 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:22.197077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-18725e5d-0ae8-47c0-9b26-e1f533f61a57 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:22.207950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18725e5d-0ae8-47c0-9b26-e1f533f61a57 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:22.208776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18725e5d-0ae8-47c0-9b26-e1f533f61a57 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:22.209542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18725e5d-0ae8-47c0-9b26-e1f533f61a57 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:22.210456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18725e5d-0ae8-47c0-9b26-e1f533f61a57 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:22.211274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18725e5d-0ae8-47c0-9b26-e1f533f61a57 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:22.212031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-18725e5d-0ae8-47c0-9b26-e1f533f61a57 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:22.378190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-18725e5d-0ae8-47c0-9b26-e1f533f61a57 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:22.388835 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-18725e5d-0ae8-47c0-9b26-e1f533f61a57 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1285 microversion: 2.1 time: 0.199816 Oct 11 20:18:22.391753 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2814/5668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:22 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:23.423997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dd4bec10-b3be-49cb-90d3-0755082f9cee tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:23.424628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dd4bec10-b3be-49cb-90d3-0755082f9cee tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:23.447799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd4bec10-b3be-49cb-90d3-0755082f9cee tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:23.448435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd4bec10-b3be-49cb-90d3-0755082f9cee tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:23.449217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd4bec10-b3be-49cb-90d3-0755082f9cee tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:23.450298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd4bec10-b3be-49cb-90d3-0755082f9cee tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:23.450998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd4bec10-b3be-49cb-90d3-0755082f9cee tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:23.451657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dd4bec10-b3be-49cb-90d3-0755082f9cee tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:23.907888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dd4bec10-b3be-49cb-90d3-0755082f9cee tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:23.922985 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dd4bec10-b3be-49cb-90d3-0755082f9cee tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1315 microversion: 2.1 time: 0.503150 Oct 11 20:18:23.923825 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2855/5669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:23 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:18:24.858566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ea9ae6b3-f28a-42d6-b4a2-df9c00d7a437 req-0a3b60bd-e29c-40e0-a304-8bc9beb74722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0912aa7d-d3ba-40e5-9936-73cb82175ac0", "tag": "9b21f27c-0708-49e8-a267-c55cba5dbca0"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:24.871329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ea9ae6b3-f28a-42d6-b4a2-df9c00d7a437 req-0a3b60bd-e29c-40e0-a304-8bc9beb74722 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:24.872072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ea9ae6b3-f28a-42d6-b4a2-df9c00d7a437 req-0a3b60bd-e29c-40e0-a304-8bc9beb74722 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:24.872948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ea9ae6b3-f28a-42d6-b4a2-df9c00d7a437 req-0a3b60bd-e29c-40e0-a304-8bc9beb74722 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:24.888254 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ea9ae6b3-f28a-42d6-b4a2-df9c00d7a437 req-0a3b60bd-e29c-40e0-a304-8bc9beb74722 service nova] Creating event network-changed:9b21f27c-0708-49e8-a267-c55cba5dbca0 for instance 0912aa7d-d3ba-40e5-9936-73cb82175ac0 on n-h2-860864-3 Oct 11 20:18:24.894492 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ea9ae6b3-f28a-42d6-b4a2-df9c00d7a437 req-0a3b60bd-e29c-40e0-a304-8bc9beb74722 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039284 Oct 11 20:18:24.895748 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2815/5670] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:18:24.952288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4e3ddaee-f1e9-4742-a3a8-a4ca1942d606 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:24.953613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4e3ddaee-f1e9-4742-a3a8-a4ca1942d606 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:24.976919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e3ddaee-f1e9-4742-a3a8-a4ca1942d606 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:24.977972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e3ddaee-f1e9-4742-a3a8-a4ca1942d606 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:24.979314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e3ddaee-f1e9-4742-a3a8-a4ca1942d606 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:24.982085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e3ddaee-f1e9-4742-a3a8-a4ca1942d606 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:24.983176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e3ddaee-f1e9-4742-a3a8-a4ca1942d606 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:24.985312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e3ddaee-f1e9-4742-a3a8-a4ca1942d606 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:25.263313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4e3ddaee-f1e9-4742-a3a8-a4ca1942d606 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:25.279314 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4e3ddaee-f1e9-4742-a3a8-a4ca1942d606 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1315 microversion: 2.1 time: 0.331471 Oct 11 20:18:25.280483 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2856/5671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:24 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:26.304511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a12b4cc-f1ab-4241-a9f2-9e412a9fe3de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:26.305379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a12b4cc-f1ab-4241-a9f2-9e412a9fe3de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:26.312645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a12b4cc-f1ab-4241-a9f2-9e412a9fe3de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:26.313270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a12b4cc-f1ab-4241-a9f2-9e412a9fe3de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:26.313815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a12b4cc-f1ab-4241-a9f2-9e412a9fe3de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:26.314644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a12b4cc-f1ab-4241-a9f2-9e412a9fe3de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:26.315206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a12b4cc-f1ab-4241-a9f2-9e412a9fe3de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:26.315874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a12b4cc-f1ab-4241-a9f2-9e412a9fe3de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:26.547035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4a12b4cc-f1ab-4241-a9f2-9e412a9fe3de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:26.557834 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a12b4cc-f1ab-4241-a9f2-9e412a9fe3de tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1315 microversion: 2.1 time: 0.257769 Oct 11 20:18:26.559721 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2816/5672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:26 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:27.581980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4511edf0-df1b-44cf-8836-3e64b2dc7b37 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:27.582507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4511edf0-df1b-44cf-8836-3e64b2dc7b37 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:27.592912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4511edf0-df1b-44cf-8836-3e64b2dc7b37 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:27.593525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4511edf0-df1b-44cf-8836-3e64b2dc7b37 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:27.594059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4511edf0-df1b-44cf-8836-3e64b2dc7b37 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:27.595131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4511edf0-df1b-44cf-8836-3e64b2dc7b37 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:27.595793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4511edf0-df1b-44cf-8836-3e64b2dc7b37 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:27.596408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4511edf0-df1b-44cf-8836-3e64b2dc7b37 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:27.789597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4511edf0-df1b-44cf-8836-3e64b2dc7b37 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:27.797934 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4511edf0-df1b-44cf-8836-3e64b2dc7b37 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1315 microversion: 2.1 time: 0.220566 Oct 11 20:18:27.798846 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2857/5673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:27 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:28.821744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-116ba0d8-c30a-4e04-a4fc-b6c3120ab07c tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:28.823237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-116ba0d8-c30a-4e04-a4fc-b6c3120ab07c tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:28.831637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116ba0d8-c30a-4e04-a4fc-b6c3120ab07c tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:28.832348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116ba0d8-c30a-4e04-a4fc-b6c3120ab07c tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:28.834852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116ba0d8-c30a-4e04-a4fc-b6c3120ab07c tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:28.835769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116ba0d8-c30a-4e04-a4fc-b6c3120ab07c tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:28.836404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116ba0d8-c30a-4e04-a4fc-b6c3120ab07c tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:28.837085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116ba0d8-c30a-4e04-a4fc-b6c3120ab07c tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:28.986489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2ce901b6-c3db-4e22-bf0c-23218cd8bf6a req-a32da89b-ddea-4802-a812-541f022b7838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0912aa7d-d3ba-40e5-9936-73cb82175ac0", "name": "network-vif-plugged", "status": "completed", "tag": "9b21f27c-0708-49e8-a267-c55cba5dbca0"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:29.014791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2ce901b6-c3db-4e22-bf0c-23218cd8bf6a req-a32da89b-ddea-4802-a812-541f022b7838 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:29.016348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2ce901b6-c3db-4e22-bf0c-23218cd8bf6a req-a32da89b-ddea-4802-a812-541f022b7838 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:29.017116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2ce901b6-c3db-4e22-bf0c-23218cd8bf6a req-a32da89b-ddea-4802-a812-541f022b7838 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:29.035503 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2ce901b6-c3db-4e22-bf0c-23218cd8bf6a req-a32da89b-ddea-4802-a812-541f022b7838 service nova] Creating event network-vif-plugged:9b21f27c-0708-49e8-a267-c55cba5dbca0 for instance 0912aa7d-d3ba-40e5-9936-73cb82175ac0 on n-h2-860864-3 Oct 11 20:18:29.042580 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2ce901b6-c3db-4e22-bf0c-23218cd8bf6a req-a32da89b-ddea-4802-a812-541f022b7838 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059866 Oct 11 20:18:29.044120 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2858/5674] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:18:29.070066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-116ba0d8-c30a-4e04-a4fc-b6c3120ab07c tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:29.087651 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-116ba0d8-c30a-4e04-a4fc-b6c3120ab07c tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1315 microversion: 2.1 time: 0.269485 Oct 11 20:18:29.088261 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2817/5675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:28 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:30.113665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-32fc5d5d-306a-4512-82a5-8a224ce9e77a tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:30.114376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-32fc5d5d-306a-4512-82a5-8a224ce9e77a tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:30.122401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32fc5d5d-306a-4512-82a5-8a224ce9e77a tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:30.122913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32fc5d5d-306a-4512-82a5-8a224ce9e77a tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:30.123353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32fc5d5d-306a-4512-82a5-8a224ce9e77a tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:30.124055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32fc5d5d-306a-4512-82a5-8a224ce9e77a tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:30.124514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32fc5d5d-306a-4512-82a5-8a224ce9e77a tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:30.124941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-32fc5d5d-306a-4512-82a5-8a224ce9e77a tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:30.307894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-32fc5d5d-306a-4512-82a5-8a224ce9e77a tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:30.317471 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-32fc5d5d-306a-4512-82a5-8a224ce9e77a tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1315 microversion: 2.1 time: 0.207795 Oct 11 20:18:30.318088 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2859/5676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:30 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:31.344058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a6b3bda1-bb5b-4516-867a-f8ff8c5b1f27 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:31.344670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a6b3bda1-bb5b-4516-867a-f8ff8c5b1f27 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:31.347381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:31.348059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:31.363915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b3bda1-bb5b-4516-867a-f8ff8c5b1f27 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:31.364523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b3bda1-bb5b-4516-867a-f8ff8c5b1f27 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:31.365177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b3bda1-bb5b-4516-867a-f8ff8c5b1f27 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:31.365958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b3bda1-bb5b-4516-867a-f8ff8c5b1f27 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:31.366504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b3bda1-bb5b-4516-867a-f8ff8c5b1f27 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:31.367023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a6b3bda1-bb5b-4516-867a-f8ff8c5b1f27 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:31.544990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a6b3bda1-bb5b-4516-867a-f8ff8c5b1f27 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:31.565283 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a6b3bda1-bb5b-4516-867a-f8ff8c5b1f27 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1502 microversion: 2.1 time: 0.225769 Oct 11 20:18:31.565968 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2818/5677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:31 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:31.588232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5868043c-dfe3-4ad4-bedf-57772ac6a138 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:31.589012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5868043c-dfe3-4ad4-bedf-57772ac6a138 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:31.595776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:31.597908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5868043c-dfe3-4ad4-bedf-57772ac6a138 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:31.599186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5868043c-dfe3-4ad4-bedf-57772ac6a138 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:31.599651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5868043c-dfe3-4ad4-bedf-57772ac6a138 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:31.600373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5868043c-dfe3-4ad4-bedf-57772ac6a138 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:31.601005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5868043c-dfe3-4ad4-bedf-57772ac6a138 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:31.601592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5868043c-dfe3-4ad4-bedf-57772ac6a138 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:31.796888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5868043c-dfe3-4ad4-bedf-57772ac6a138 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:31.808494 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5868043c-dfe3-4ad4-bedf-57772ac6a138 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1502 microversion: 2.1 time: 0.223993 Oct 11 20:18:31.809511 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2860/5678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:31 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:31.834187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-25720f90-78b5-4fb2-83da-dd0dead47a48 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:31.834770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-25720f90-78b5-4fb2-83da-dd0dead47a48 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:31.841930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25720f90-78b5-4fb2-83da-dd0dead47a48 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:31.842431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25720f90-78b5-4fb2-83da-dd0dead47a48 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:31.842964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25720f90-78b5-4fb2-83da-dd0dead47a48 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:31.844207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25720f90-78b5-4fb2-83da-dd0dead47a48 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:31.844670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25720f90-78b5-4fb2-83da-dd0dead47a48 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:31.847291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-25720f90-78b5-4fb2-83da-dd0dead47a48 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:31.889846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-25720f90-78b5-4fb2-83da-dd0dead47a48 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lazy-loading 'flavor' on Instance uuid 0912aa7d-d3ba-40e5-9936-73cb82175ac0 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:18:31.977668 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-25720f90-78b5-4fb2-83da-dd0dead47a48 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "POST /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0/action" status: 202 len: 0 microversion: 2.1 time: 0.147392 Oct 11 20:18:31.979782 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2819/5679] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:18:31 2022] POST /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:18:31.988766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-edb7f1c4-4a17-4a4b-904d-1ca00c8721b0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:31.989493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-edb7f1c4-4a17-4a4b-904d-1ca00c8721b0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:32.004352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edb7f1c4-4a17-4a4b-904d-1ca00c8721b0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:32.005247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edb7f1c4-4a17-4a4b-904d-1ca00c8721b0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:32.005703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edb7f1c4-4a17-4a4b-904d-1ca00c8721b0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:32.006814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edb7f1c4-4a17-4a4b-904d-1ca00c8721b0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:32.007286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edb7f1c4-4a17-4a4b-904d-1ca00c8721b0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:32.007723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-edb7f1c4-4a17-4a4b-904d-1ca00c8721b0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:32.203834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-edb7f1c4-4a17-4a4b-904d-1ca00c8721b0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:32.214949 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-edb7f1c4-4a17-4a4b-904d-1ca00c8721b0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1510 microversion: 2.1 time: 0.230599 Oct 11 20:18:32.215934 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2861/5680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:31 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:18:33.242911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f01c1180-2b2f-4692-b845-8628ec5b1ee5 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:33.243696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f01c1180-2b2f-4692-b845-8628ec5b1ee5 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:33.250841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f01c1180-2b2f-4692-b845-8628ec5b1ee5 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:33.251505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f01c1180-2b2f-4692-b845-8628ec5b1ee5 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:33.251941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f01c1180-2b2f-4692-b845-8628ec5b1ee5 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:33.252893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f01c1180-2b2f-4692-b845-8628ec5b1ee5 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:33.253505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f01c1180-2b2f-4692-b845-8628ec5b1ee5 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:33.254388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f01c1180-2b2f-4692-b845-8628ec5b1ee5 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:33.386504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c035621-bc03-4e02-b4ef-c5fe46d1b3fc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:33.386504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c035621-bc03-4e02-b4ef-c5fe46d1b3fc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:33.386504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c035621-bc03-4e02-b4ef-c5fe46d1b3fc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:33.386504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c035621-bc03-4e02-b4ef-c5fe46d1b3fc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:33.386504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c035621-bc03-4e02-b4ef-c5fe46d1b3fc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:33.386504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c035621-bc03-4e02-b4ef-c5fe46d1b3fc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:33.386504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c035621-bc03-4e02-b4ef-c5fe46d1b3fc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:33.386504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c035621-bc03-4e02-b4ef-c5fe46d1b3fc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:33.386504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c035621-bc03-4e02-b4ef-c5fe46d1b3fc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:18:33.496109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f01c1180-2b2f-4692-b845-8628ec5b1ee5 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:33.505957 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f01c1180-2b2f-4692-b845-8628ec5b1ee5 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1493 microversion: 2.1 time: 0.267248 Oct 11 20:18:33.507433 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2862/5681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:33 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1493 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:33.510182 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c035621-bc03-4e02-b4ef-c5fe46d1b3fc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 204 len: 0 microversion: 2.42 time: 0.371750 Oct 11 20:18:33.512614 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2820/5682] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:18:33 2022] DELETE /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:18:33.523797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:33.524440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:33.532264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5007acd-da1b-4d4d-b867-a4307b9c61ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:33.533039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e5007acd-da1b-4d4d-b867-a4307b9c61ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:33.538207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:33.538765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:33.539202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:33.540111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:33.540571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:33.541003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:33.543310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5007acd-da1b-4d4d-b867-a4307b9c61ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:33.544081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5007acd-da1b-4d4d-b867-a4307b9c61ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:33.544653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5007acd-da1b-4d4d-b867-a4307b9c61ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:33.550724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5007acd-da1b-4d4d-b867-a4307b9c61ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:33.551672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5007acd-da1b-4d4d-b867-a4307b9c61ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:33.552292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5007acd-da1b-4d4d-b867-a4307b9c61ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:33.660854 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e5007acd-da1b-4d4d-b867-a4307b9c61ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "POST /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0/action" status: 202 len: 0 microversion: 2.1 time: 0.133500 Oct 11 20:18:33.663989 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2821/5683] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:18:33 2022] POST /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 20:18:33.670037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4c6a1754-f74c-47b5-8720-5e67175b5ccc tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:33.670781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4c6a1754-f74c-47b5-8720-5e67175b5ccc tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:33.678423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c6a1754-f74c-47b5-8720-5e67175b5ccc tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:33.679100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c6a1754-f74c-47b5-8720-5e67175b5ccc tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:33.679983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c6a1754-f74c-47b5-8720-5e67175b5ccc tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:33.681108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c6a1754-f74c-47b5-8720-5e67175b5ccc tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:33.681725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c6a1754-f74c-47b5-8720-5e67175b5ccc tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:33.682159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c6a1754-f74c-47b5-8720-5e67175b5ccc tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:33.847188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:33.863791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:33.865791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:33.867371 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b4012cb2-7792-41e9-8624-b968520fcdcb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 2960 microversion: 2.42 time: 0.350597 Oct 11 20:18:33.867969 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2863/5684] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:33 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 2960 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:33.930823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4c6a1754-f74c-47b5-8720-5e67175b5ccc tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:33.945734 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4c6a1754-f74c-47b5-8720-5e67175b5ccc tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1499 microversion: 2.1 time: 0.279696 Oct 11 20:18:33.946819 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2822/5685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:33 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1499 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:34.915532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:34.916914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:34.928040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:34.928785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:34.936757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:34.937629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:34.938173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:34.938804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:34.974299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-efe43ab2-b9cb-43d1-9b57-451ff3c59aaf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:34.977112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-efe43ab2-b9cb-43d1-9b57-451ff3c59aaf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:34.987520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe43ab2-b9cb-43d1-9b57-451ff3c59aaf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:34.988707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe43ab2-b9cb-43d1-9b57-451ff3c59aaf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:34.989519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe43ab2-b9cb-43d1-9b57-451ff3c59aaf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:34.990637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe43ab2-b9cb-43d1-9b57-451ff3c59aaf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:34.991247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe43ab2-b9cb-43d1-9b57-451ff3c59aaf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:34.992293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efe43ab2-b9cb-43d1-9b57-451ff3c59aaf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:35.293774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-efe43ab2-b9cb-43d1-9b57-451ff3c59aaf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:35.302190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:35.312950 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-efe43ab2-b9cb-43d1-9b57-451ff3c59aaf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1499 microversion: 2.1 time: 0.341102 Oct 11 20:18:35.314755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:35.316682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:35.317025 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2823/5686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:34 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1499 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:18:35.335586 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8c510001-e6ea-4362-a23c-997ff16a8fba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 2960 microversion: 2.42 time: 0.425140 Oct 11 20:18:35.345071 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2864/5687] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:34 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 2960 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:36.342103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b8c24226-c898-48b5-b5cd-bb3c014edad0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:36.342777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b8c24226-c898-48b5-b5cd-bb3c014edad0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:36.355508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c24226-c898-48b5-b5cd-bb3c014edad0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:36.356018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c24226-c898-48b5-b5cd-bb3c014edad0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:36.356469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c24226-c898-48b5-b5cd-bb3c014edad0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:36.361035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c24226-c898-48b5-b5cd-bb3c014edad0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:36.361904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c24226-c898-48b5-b5cd-bb3c014edad0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:36.362939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8c24226-c898-48b5-b5cd-bb3c014edad0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:36.365958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:36.366630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:36.386881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:36.387392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:36.387848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:36.388574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:36.389038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:36.389474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:36.895725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b8c24226-c898-48b5-b5cd-bb3c014edad0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:36.912115 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b8c24226-c898-48b5-b5cd-bb3c014edad0 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1499 microversion: 2.1 time: 0.574772 Oct 11 20:18:36.919051 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2824/5688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:36 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1499 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:37.052991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:37.116701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:37.120117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:37.121442 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-472d6030-e545-48a4-a31d-59b52c67c293 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 2960 microversion: 2.42 time: 0.760452 Oct 11 20:18:37.122000 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2865/5689] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:36 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 2960 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:37.942044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-582d0a3c-e8e2-4cbd-8821-e434583b73f4 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:37.943459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-582d0a3c-e8e2-4cbd-8821-e434583b73f4 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:37.953393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-582d0a3c-e8e2-4cbd-8821-e434583b73f4 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:37.954163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-582d0a3c-e8e2-4cbd-8821-e434583b73f4 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:37.954962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-582d0a3c-e8e2-4cbd-8821-e434583b73f4 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:37.956581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-582d0a3c-e8e2-4cbd-8821-e434583b73f4 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:37.957251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-582d0a3c-e8e2-4cbd-8821-e434583b73f4 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:37.957892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-582d0a3c-e8e2-4cbd-8821-e434583b73f4 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:38.151760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:38.152588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:38.168002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:38.169225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:38.171046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:38.171985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:38.177043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:38.177812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:38.241338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-582d0a3c-e8e2-4cbd-8821-e434583b73f4 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:38.250692 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-582d0a3c-e8e2-4cbd-8821-e434583b73f4 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1499 microversion: 2.1 time: 0.312821 Oct 11 20:18:38.273380 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2825/5690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:37 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1499 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:38.481012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:38.500351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:38.502867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:38.504902 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-46368a42-a82c-42b2-8e01-cf174008cde2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 2918 microversion: 2.42 time: 0.357282 Oct 11 20:18:38.506157 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2866/5691] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:38 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 2918 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:38.954742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-2a0d50b7-d8cb-4644-bb35-7c0e8b406781 req-9ea6de8e-25c0-4c7c-9b87-ad67d5109de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-deleted", "tag": "89c7d311-868d-471c-b3ab-790ad9c4f18b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:38.992389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2a0d50b7-d8cb-4644-bb35-7c0e8b406781 req-9ea6de8e-25c0-4c7c-9b87-ad67d5109de9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:38.992899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-78e3a55c-6852-4752-8767-b6d909fc617b req-128fb728-dafd-4441-9a43-c1b335ab1e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-unplugged", "status": "completed", "tag": "d2f6808c-75df-4965-85ee-a6025736b3e5"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:38.993273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2a0d50b7-d8cb-4644-bb35-7c0e8b406781 req-9ea6de8e-25c0-4c7c-9b87-ad67d5109de9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:38.993872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2a0d50b7-d8cb-4644-bb35-7c0e8b406781 req-9ea6de8e-25c0-4c7c-9b87-ad67d5109de9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:39.012707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-78e3a55c-6852-4752-8767-b6d909fc617b req-128fb728-dafd-4441-9a43-c1b335ab1e1b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:39.013423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-78e3a55c-6852-4752-8767-b6d909fc617b req-128fb728-dafd-4441-9a43-c1b335ab1e1b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:39.014612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-78e3a55c-6852-4752-8767-b6d909fc617b req-128fb728-dafd-4441-9a43-c1b335ab1e1b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:39.034633 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2a0d50b7-d8cb-4644-bb35-7c0e8b406781 req-9ea6de8e-25c0-4c7c-9b87-ad67d5109de9 service nova] Creating event network-vif-deleted:89c7d311-868d-471c-b3ab-790ad9c4f18b for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:18:39.047329 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-78e3a55c-6852-4752-8767-b6d909fc617b req-128fb728-dafd-4441-9a43-c1b335ab1e1b service nova] Creating event network-vif-unplugged:d2f6808c-75df-4965-85ee-a6025736b3e5 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:18:39.048246 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-2a0d50b7-d8cb-4644-bb35-7c0e8b406781 req-9ea6de8e-25c0-4c7c-9b87-ad67d5109de9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099892 Oct 11 20:18:39.049827 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2826/5692] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:18:39.079076 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-78e3a55c-6852-4752-8767-b6d909fc617b req-128fb728-dafd-4441-9a43-c1b335ab1e1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091553 Oct 11 20:18:39.082384 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2867/5693] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:18:39.278617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f7e05578-6031-40e5-a009-421883f5ecd8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:39.279372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f7e05578-6031-40e5-a009-421883f5ecd8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:39.288230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7e05578-6031-40e5-a009-421883f5ecd8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:39.288745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7e05578-6031-40e5-a009-421883f5ecd8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:39.290169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7e05578-6031-40e5-a009-421883f5ecd8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:39.295738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7e05578-6031-40e5-a009-421883f5ecd8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:39.300291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7e05578-6031-40e5-a009-421883f5ecd8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:39.301266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7e05578-6031-40e5-a009-421883f5ecd8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:39.306431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:39.549836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:39.551883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:39.584628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:39.585126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:39.585569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:39.586298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:39.586783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:39.590791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:39.640100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f7e05578-6031-40e5-a009-421883f5ecd8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:39.650789 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f7e05578-6031-40e5-a009-421883f5ecd8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1502 microversion: 2.1 time: 0.376088 Oct 11 20:18:39.652034 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2827/5694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:39 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:39.674893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-102182d7-3fa2-4152-bdfd-093d790f6da3 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:39.675646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-102182d7-3fa2-4152-bdfd-093d790f6da3 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:39.682714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-102182d7-3fa2-4152-bdfd-093d790f6da3 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:39.683411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-102182d7-3fa2-4152-bdfd-093d790f6da3 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:39.684025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-102182d7-3fa2-4152-bdfd-093d790f6da3 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:39.684909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-102182d7-3fa2-4152-bdfd-093d790f6da3 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:39.686517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-102182d7-3fa2-4152-bdfd-093d790f6da3 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:39.687284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-102182d7-3fa2-4152-bdfd-093d790f6da3 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:39.721336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-102182d7-3fa2-4152-bdfd-093d790f6da3 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lazy-loading 'flavor' on Instance uuid 0912aa7d-d3ba-40e5-9936-73cb82175ac0 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:18:39.883886 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-102182d7-3fa2-4152-bdfd-093d790f6da3 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "POST /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0/action" status: 202 len: 0 microversion: 2.1 time: 0.213108 Oct 11 20:18:39.885545 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2828/5695] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:18:39 2022] POST /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:18:39.899398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c8da243-f326-4101-aada-1373edf8a1bf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:39.901588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c8da243-f326-4101-aada-1373edf8a1bf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:39.917051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8da243-f326-4101-aada-1373edf8a1bf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:39.918603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8da243-f326-4101-aada-1373edf8a1bf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:39.920308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8da243-f326-4101-aada-1373edf8a1bf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:39.921802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8da243-f326-4101-aada-1373edf8a1bf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:39.923491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8da243-f326-4101-aada-1373edf8a1bf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:39.923934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c8da243-f326-4101-aada-1373edf8a1bf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:39.939092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:39.970584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:39.972461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:39.976974 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f120ccae-1b2d-4874-9446-8fe5f94ea0ac tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 2757 microversion: 2.42 time: 0.444527 Oct 11 20:18:39.980138 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2868/5696] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:39 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 2757 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:40.254115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6c8da243-f326-4101-aada-1373edf8a1bf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:40.278390 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c8da243-f326-4101-aada-1373edf8a1bf tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1510 microversion: 2.1 time: 0.388384 Oct 11 20:18:40.290895 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2829/5697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:39 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:41.016206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:41.026809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:41.040757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:41.041646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:41.042323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:41.043298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:41.044097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:41.044798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:41.103288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c125e991-5f70-4af6-beaf-61b5d988167b req-9e71f5dc-ce7f-439d-b71b-674ca2275bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-unplugged", "status": "completed", "tag": "3049eb54-be5a-4d03-bf78-e039710b3c76"}, {"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-unplugged", "status": "completed", "tag": "82aef3af-bfa0-4f8a-9748-67aa8aab74d2"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:41.133967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c125e991-5f70-4af6-beaf-61b5d988167b req-9e71f5dc-ce7f-439d-b71b-674ca2275bd4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:41.138761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c125e991-5f70-4af6-beaf-61b5d988167b req-9e71f5dc-ce7f-439d-b71b-674ca2275bd4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:41.147003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c125e991-5f70-4af6-beaf-61b5d988167b req-9e71f5dc-ce7f-439d-b71b-674ca2275bd4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:41.195413 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c125e991-5f70-4af6-beaf-61b5d988167b req-9e71f5dc-ce7f-439d-b71b-674ca2275bd4 service nova] Creating event network-vif-unplugged:3049eb54-be5a-4d03-bf78-e039710b3c76 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:18:41.196344 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c125e991-5f70-4af6-beaf-61b5d988167b req-9e71f5dc-ce7f-439d-b71b-674ca2275bd4 service nova] Creating event network-vif-unplugged:82aef3af-bfa0-4f8a-9748-67aa8aab74d2 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:18:41.202655 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c125e991-5f70-4af6-beaf-61b5d988167b req-9e71f5dc-ce7f-439d-b71b-674ca2275bd4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.103211 Oct 11 20:18:41.208823 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2830/5698] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:18:41.227159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-d655ade3-fcf8-4994-876c-9e2a017c535f req-4fc862ff-6c29-445e-a517-d0e1fb0f31c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-deleted", "tag": "bcc573b0-7773-43d4-80f8-db9c1536ab91"}, {"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-deleted", "tag": "d2f6808c-75df-4965-85ee-a6025736b3e5"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:41.254476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d655ade3-fcf8-4994-876c-9e2a017c535f req-4fc862ff-6c29-445e-a517-d0e1fb0f31c8 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:41.255181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d655ade3-fcf8-4994-876c-9e2a017c535f req-4fc862ff-6c29-445e-a517-d0e1fb0f31c8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:41.255417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d655ade3-fcf8-4994-876c-9e2a017c535f req-4fc862ff-6c29-445e-a517-d0e1fb0f31c8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:41.275595 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-d655ade3-fcf8-4994-876c-9e2a017c535f req-4fc862ff-6c29-445e-a517-d0e1fb0f31c8 service nova] Creating event network-vif-deleted:bcc573b0-7773-43d4-80f8-db9c1536ab91 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:18:41.276367 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-d655ade3-fcf8-4994-876c-9e2a017c535f req-4fc862ff-6c29-445e-a517-d0e1fb0f31c8 service nova] Creating event network-vif-deleted:d2f6808c-75df-4965-85ee-a6025736b3e5 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:18:41.332452 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-d655ade3-fcf8-4994-876c-9e2a017c535f req-4fc862ff-6c29-445e-a517-d0e1fb0f31c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.117363 Oct 11 20:18:41.335969 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2831/5699] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:18:41.354373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a41c48e-db54-43ba-8ea8-a894c08b20f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:41.359331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a41c48e-db54-43ba-8ea8-a894c08b20f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:41.369059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41c48e-db54-43ba-8ea8-a894c08b20f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:41.369773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41c48e-db54-43ba-8ea8-a894c08b20f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:41.370687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41c48e-db54-43ba-8ea8-a894c08b20f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:41.371749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41c48e-db54-43ba-8ea8-a894c08b20f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:41.372526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41c48e-db54-43ba-8ea8-a894c08b20f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:41.373097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a41c48e-db54-43ba-8ea8-a894c08b20f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:41.384761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:41.404480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:41.411616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:41.415234 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e49c289d-4b4b-447a-a250-b527aa6414bc tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 2663 microversion: 2.42 time: 0.403521 Oct 11 20:18:41.416995 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2869/5700] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:41 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 2663 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:41.674828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4a41c48e-db54-43ba-8ea8-a894c08b20f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:41.685426 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a41c48e-db54-43ba-8ea8-a894c08b20f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1493 microversion: 2.1 time: 0.347685 Oct 11 20:18:41.686256 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2832/5701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:41 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1493 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:41.715747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c705be9-2f3e-4864-987a-286d71a79cba tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:41.716277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c705be9-2f3e-4864-987a-286d71a79cba tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:41.734884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c705be9-2f3e-4864-987a-286d71a79cba tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:41.736112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c705be9-2f3e-4864-987a-286d71a79cba tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:41.738122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c705be9-2f3e-4864-987a-286d71a79cba tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:41.740856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c705be9-2f3e-4864-987a-286d71a79cba tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:41.742505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c705be9-2f3e-4864-987a-286d71a79cba tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:41.743165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c705be9-2f3e-4864-987a-286d71a79cba tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:41.897169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c705be9-2f3e-4864-987a-286d71a79cba tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "POST /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0/action" status: 202 len: 0 microversion: 2.1 time: 0.186627 Oct 11 20:18:41.898186 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2870/5702] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:18:41 2022] POST /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:18:41.907919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3bb9b358-0f72-4a95-8e58-5b7a11f90c18 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:41.909083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3bb9b358-0f72-4a95-8e58-5b7a11f90c18 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:41.930137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bb9b358-0f72-4a95-8e58-5b7a11f90c18 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:41.930686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bb9b358-0f72-4a95-8e58-5b7a11f90c18 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:41.931117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bb9b358-0f72-4a95-8e58-5b7a11f90c18 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:41.931833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bb9b358-0f72-4a95-8e58-5b7a11f90c18 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:41.932284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bb9b358-0f72-4a95-8e58-5b7a11f90c18 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:41.932890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bb9b358-0f72-4a95-8e58-5b7a11f90c18 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:42.323133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3bb9b358-0f72-4a95-8e58-5b7a11f90c18 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:42.336177 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3bb9b358-0f72-4a95-8e58-5b7a11f90c18 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1499 microversion: 2.1 time: 0.432721 Oct 11 20:18:42.337061 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2833/5703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:41 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1499 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:42.451167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:42.452377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:42.464738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:42.465241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:42.465678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:42.466395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:42.469443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:42.469801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:42.791768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:42.805988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:42.814252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:42.822566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:42.823867 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1de06c7c-7330-4cac-bc0e-93f8f3880d3c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 2389 microversion: 2.42 time: 0.381463 Oct 11 20:18:42.848446 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2871/5704] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:42 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 2389 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:43.362610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-95deeb1a-00b9-4f33-9a04-f0ec5254d491 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:43.363244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-95deeb1a-00b9-4f33-9a04-f0ec5254d491 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:43.373558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95deeb1a-00b9-4f33-9a04-f0ec5254d491 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:43.374066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95deeb1a-00b9-4f33-9a04-f0ec5254d491 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:43.374509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95deeb1a-00b9-4f33-9a04-f0ec5254d491 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:43.375249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95deeb1a-00b9-4f33-9a04-f0ec5254d491 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:43.375712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95deeb1a-00b9-4f33-9a04-f0ec5254d491 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:43.376237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-95deeb1a-00b9-4f33-9a04-f0ec5254d491 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:43.389156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-97ca8e9b-7310-47cf-b864-f0a46caf4ff9 req-bdef8965-f6f8-4831-8af3-deb012121712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-deleted", "tag": "3049eb54-be5a-4d03-bf78-e039710b3c76"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:43.473216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-97ca8e9b-7310-47cf-b864-f0a46caf4ff9 req-bdef8965-f6f8-4831-8af3-deb012121712 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:43.482714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-97ca8e9b-7310-47cf-b864-f0a46caf4ff9 req-bdef8965-f6f8-4831-8af3-deb012121712 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:43.492211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-97ca8e9b-7310-47cf-b864-f0a46caf4ff9 req-bdef8965-f6f8-4831-8af3-deb012121712 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:43.554389 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-97ca8e9b-7310-47cf-b864-f0a46caf4ff9 req-bdef8965-f6f8-4831-8af3-deb012121712 service nova] Creating event network-vif-deleted:3049eb54-be5a-4d03-bf78-e039710b3c76 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:18:43.586331 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-97ca8e9b-7310-47cf-b864-f0a46caf4ff9 req-bdef8965-f6f8-4831-8af3-deb012121712 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201739 Oct 11 20:18:43.586900 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2872/5705] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:18:43.646813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-95deeb1a-00b9-4f33-9a04-f0ec5254d491 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:43.658974 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-95deeb1a-00b9-4f33-9a04-f0ec5254d491 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1499 microversion: 2.1 time: 0.300651 Oct 11 20:18:43.671369 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2834/5706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:43 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1499 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:43.856670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:43.863264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:43.893213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:43.894303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:43.894774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:43.895488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:43.895938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:43.897578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:44.021262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:44.041106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:44.042573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:44.052807 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1dbaca9f-2395-4531-89f7-8fe68432acf2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.201404 Oct 11 20:18:44.070502 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2873/5707] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:43 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:44.683931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bbfec7c6-f310-447d-be41-abedc21b3830 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:44.685489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bbfec7c6-f310-447d-be41-abedc21b3830 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:44.695815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfec7c6-f310-447d-be41-abedc21b3830 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:44.696670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfec7c6-f310-447d-be41-abedc21b3830 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:44.697329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfec7c6-f310-447d-be41-abedc21b3830 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:44.698732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfec7c6-f310-447d-be41-abedc21b3830 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:44.699404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfec7c6-f310-447d-be41-abedc21b3830 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:44.700515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbfec7c6-f310-447d-be41-abedc21b3830 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:44.962583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bbfec7c6-f310-447d-be41-abedc21b3830 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:44.976213 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bbfec7c6-f310-447d-be41-abedc21b3830 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1502 microversion: 2.1 time: 0.296217 Oct 11 20:18:44.992075 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2835/5708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:44 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1502 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:45.001403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-84006e9e-b650-4111-8acd-d21c587ac773 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:45.002007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-84006e9e-b650-4111-8acd-d21c587ac773 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:45.014033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84006e9e-b650-4111-8acd-d21c587ac773 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:45.014559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84006e9e-b650-4111-8acd-d21c587ac773 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:45.015017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84006e9e-b650-4111-8acd-d21c587ac773 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:45.018752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84006e9e-b650-4111-8acd-d21c587ac773 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:45.019387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84006e9e-b650-4111-8acd-d21c587ac773 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:45.019826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-84006e9e-b650-4111-8acd-d21c587ac773 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:45.085863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:45.095644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:45.102098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:45.102579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:45.103287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:45.104164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:45.104771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:45.105500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:45.125174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-84006e9e-b650-4111-8acd-d21c587ac773 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:18:45.267189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:45.285995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:45.288049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:45.288362 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-84006e9e-b650-4111-8acd-d21c587ac773 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 204 len: 0 microversion: 2.1 time: 0.290910 Oct 11 20:18:45.288970 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2874/5709] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:18:44 2022] DELETE /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:18:45.290601 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2b123017-14c9-412a-863a-6f0f8092a9f0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.209045 Oct 11 20:18:45.291461 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2836/5710] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:45 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:45.300228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93cf7f3c-e6dc-4aab-b41f-39937fd161ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:45.303218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-93cf7f3c-e6dc-4aab-b41f-39937fd161ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:45.317526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cf7f3c-e6dc-4aab-b41f-39937fd161ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:45.318171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cf7f3c-e6dc-4aab-b41f-39937fd161ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:45.318815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cf7f3c-e6dc-4aab-b41f-39937fd161ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:45.319839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cf7f3c-e6dc-4aab-b41f-39937fd161ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:45.320383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cf7f3c-e6dc-4aab-b41f-39937fd161ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:45.320920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cf7f3c-e6dc-4aab-b41f-39937fd161ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:45.528397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-93cf7f3c-e6dc-4aab-b41f-39937fd161ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:45.538133 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93cf7f3c-e6dc-4aab-b41f-39937fd161ac tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1508 microversion: 2.1 time: 0.243640 Oct 11 20:18:45.539300 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2837/5711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:45 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:45.639542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-19a3e36f-7b2e-48a6-badc-51a9c42e58cf req-4f7819da-e2d9-4d95-8d56-e2355235b73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9233e8-54dc-461f-909b-e01720ae7821", "name": "network-vif-deleted", "tag": "82aef3af-bfa0-4f8a-9748-67aa8aab74d2"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:45.656665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-19a3e36f-7b2e-48a6-badc-51a9c42e58cf req-4f7819da-e2d9-4d95-8d56-e2355235b73e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:45.656665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-19a3e36f-7b2e-48a6-badc-51a9c42e58cf req-4f7819da-e2d9-4d95-8d56-e2355235b73e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:45.656665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-19a3e36f-7b2e-48a6-badc-51a9c42e58cf req-4f7819da-e2d9-4d95-8d56-e2355235b73e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:45.672307 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-19a3e36f-7b2e-48a6-badc-51a9c42e58cf req-4f7819da-e2d9-4d95-8d56-e2355235b73e service nova] Creating event network-vif-deleted:82aef3af-bfa0-4f8a-9748-67aa8aab74d2 for instance ee9233e8-54dc-461f-909b-e01720ae7821 on n-h2-860864-3 Oct 11 20:18:45.683925 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-19a3e36f-7b2e-48a6-badc-51a9c42e58cf req-4f7819da-e2d9-4d95-8d56-e2355235b73e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050859 Oct 11 20:18:45.686982 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2875/5712] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:18:46.323221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:46.324443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:46.332762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:46.333255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:46.333695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:46.348463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:46.349163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:46.349755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:46.434933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:46.446064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:46.448154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:46.449341 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b7151964-ee78-4976-95cc-a9ce99614a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.130070 Oct 11 20:18:46.454662 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2838/5713] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:46 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:46.566796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-813a5ca8-9d40-4361-8814-58e80a002c28 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:46.568448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-813a5ca8-9d40-4361-8814-58e80a002c28 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:46.577243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-813a5ca8-9d40-4361-8814-58e80a002c28 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:46.579068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-813a5ca8-9d40-4361-8814-58e80a002c28 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:46.580695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-813a5ca8-9d40-4361-8814-58e80a002c28 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:46.582303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-813a5ca8-9d40-4361-8814-58e80a002c28 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:46.584857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-813a5ca8-9d40-4361-8814-58e80a002c28 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:46.585817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-813a5ca8-9d40-4361-8814-58e80a002c28 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:46.801859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-813a5ca8-9d40-4361-8814-58e80a002c28 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:46.810806 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-813a5ca8-9d40-4361-8814-58e80a002c28 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1508 microversion: 2.1 time: 0.251072 Oct 11 20:18:46.812763 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2876/5714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:46 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:18:47.481792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:47.488738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:47.503547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:47.505560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:47.506475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:47.507583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:47.510565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:47.512276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:47.613781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:47.625461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:47.627693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:47.629393 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a2547ff5-59c2-4c7e-a3e3-e3331eac47f8 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.155320 Oct 11 20:18:47.645036 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2839/5715] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:47 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:47.840052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e4d5f0a-6621-4e49-bfd0-87d0722b12f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:47.840665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e4d5f0a-6621-4e49-bfd0-87d0722b12f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:47.848828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d5f0a-6621-4e49-bfd0-87d0722b12f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:47.850149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d5f0a-6621-4e49-bfd0-87d0722b12f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:47.850770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d5f0a-6621-4e49-bfd0-87d0722b12f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:47.851748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d5f0a-6621-4e49-bfd0-87d0722b12f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:47.852591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d5f0a-6621-4e49-bfd0-87d0722b12f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:47.853152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4d5f0a-6621-4e49-bfd0-87d0722b12f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:47.893753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a7c1f430-13fd-47f1-b062-28aaf1ebc434 req-47ac9ea1-928e-4592-8d26-f1e38e196267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0912aa7d-d3ba-40e5-9936-73cb82175ac0", "name": "network-vif-deleted", "tag": "9b21f27c-0708-49e8-a267-c55cba5dbca0"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:18:47.932932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a7c1f430-13fd-47f1-b062-28aaf1ebc434 req-47ac9ea1-928e-4592-8d26-f1e38e196267 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:47.933473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a7c1f430-13fd-47f1-b062-28aaf1ebc434 req-47ac9ea1-928e-4592-8d26-f1e38e196267 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:47.935174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a7c1f430-13fd-47f1-b062-28aaf1ebc434 req-47ac9ea1-928e-4592-8d26-f1e38e196267 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:47.946711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e4d5f0a-6621-4e49-bfd0-87d0722b12f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501be48ff8b4617b186777866d6fe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a8c358ad404718b667359e1864e289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:47.955854 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a7c1f430-13fd-47f1-b062-28aaf1ebc434 req-47ac9ea1-928e-4592-8d26-f1e38e196267 service nova] Creating event network-vif-deleted:9b21f27c-0708-49e8-a267-c55cba5dbca0 for instance 0912aa7d-d3ba-40e5-9936-73cb82175ac0 on n-h2-860864-3 Oct 11 20:18:47.959122 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e4d5f0a-6621-4e49-bfd0-87d0722b12f8 tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 200 len: 1466 microversion: 2.1 time: 0.123544 Oct 11 20:18:47.960386 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2877/5716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:47 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 1466 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:18:48.011976 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a7c1f430-13fd-47f1-b062-28aaf1ebc434 req-47ac9ea1-928e-4592-8d26-f1e38e196267 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124800 Oct 11 20:18:48.018345 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2840/5717] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:18:48.659881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:48.660778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:48.670125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:48.671065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:48.671790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:48.673559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:48.674286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:48.674899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:48.762259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:48.781602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:48.783101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:48.800392 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eda08912-f2e4-4826-a624-016ade085401 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.130049 Oct 11 20:18:48.801985 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2878/5718] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:48 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:48.983647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:48.984345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] [instance: 0912aa7d-d3ba-40e5-9936-73cb82175ac0] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:49.002883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:49.003392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:49.003836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:49.004547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:49.005006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:49.005437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:49.036354 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] HTTP exception thrown: Instance 0912aa7d-d3ba-40e5-9936-73cb82175ac0 could not be found. Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Request method failure captured: Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 HTTP/1.1 Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc-JL8pV6oZwTmiN_oLoWBw_k1OXMYZQW69IAEYwFpWW324vWhFYGf4t4fiTw_m0oyTgKOzQLxBa1Z8B_ECvwKBNU8E0jus1Qyzi4Ld-Zoao5ICjjNM00qEkWpisTRiXG6TJC7tk_QNM2MMebFKNMYwBwG5eUfa8_9IUrK_KyeQt38c Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 13a8c358ad404718b667359e1864e289 Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestServerAdvancedOps-1327002203 Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/13a8c358ad404718b667359e1864e289"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_13a8c358ad404718b667359e1864e289", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13a8c358ad404718b667359e1864e289"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13a8c358ad404718b667359e1864e289"}]}] Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestServerAdvancedOps-1327002203 Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 13a8c358ad404718b667359e1864e289 Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestServerAdvancedOps-1327002203 Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestServerAdvancedOps-1327002203-project Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8501be48ff8b4617b186777866d6fe26 Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestServerAdvancedOps-1327002203-project Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 0912aa7d-d3ba-40e5-9936-73cb82175ac0 could not be found. Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '0912aa7d-d3ba-40e5-9936-73cb82175ac0'} Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0912aa7d-d3ba-40e5-9936-73cb82175ac0 could not be found. Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0912aa7d-d3ba-40e5-9936-73cb82175ac0 could not be found. Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:18:49.038080 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:18:49.043089 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:18:49.043089 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:18:49.043089 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:18:49.043089 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:18:49.043089 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:18:49.043089 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0912aa7d-d3ba-40e5-9936-73cb82175ac0 could not be found. Oct 11 20:18:49.043089 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:18:49.043089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] Returning 404 to user: Instance 0912aa7d-d3ba-40e5-9936-73cb82175ac0 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:18:49.043089 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c9f6400-6165-43e8-ba52-f336dc0d767f tempest-TestServerAdvancedOps-1327002203 tempest-TestServerAdvancedOps-1327002203-project] 10.222.0.27 "GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0" status: 404 len: 111 microversion: 2.1 time: 0.060184 Oct 11 20:18:49.043710 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2841/5719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:18:48 2022] GET /compute/v2.1/servers/0912aa7d-d3ba-40e5-9936-73cb82175ac0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:18:49.835203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:49.836191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:49.849503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:49.850306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:49.852088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:49.853673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:49.855319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:49.855753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:50.479484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:50.491952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:50.499272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:50.500544 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-937d271e-d23f-45ea-a99b-3f2092f78fbb tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.669622 Oct 11 20:18:50.501135 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2879/5720] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:49 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:18:51.530406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:51.531446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:51.536167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:51.545047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:51.545823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:51.545985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:51.546744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:51.547691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:51.548283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:51.663258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:51.682145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:51.683652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:51.684856 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-836641e9-21fb-44a5-b9ef-448a0bb9aca2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.158408 Oct 11 20:18:51.685422 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2842/5721] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:51 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:52.713763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:52.714387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:52.726939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:52.745006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:52.748745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:52.751773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:52.752934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:52.754323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:52.756797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:52.900181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:52.914567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:52.918214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:52.921070 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bd9e7009-82fb-4952-8459-f54a2492c937 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.212821 Oct 11 20:18:52.923284 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2880/5722] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:52 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:53.951264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:53.952478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:53.965952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:53.966813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:53.967753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:53.969883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:53.971098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:53.971941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:54.071908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:54.084469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:54.086244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:54.087651 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5509e0b9-da99-409a-810d-ad57c75bfea0 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.142242 Oct 11 20:18:54.088792 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2843/5723] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:53 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:55.124811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:55.125419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:55.134292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:55.135389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:55.135990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:55.136983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:55.137605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:55.138241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:55.216670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:55.231129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:55.232797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:55.234037 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3dbc34e3-e758-4c40-bf9f-802720e1f97a tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.113518 Oct 11 20:18:55.234967 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2881/5724] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:55 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:56.261843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:56.263342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:56.272002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:56.272882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:56.273675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:56.275250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:56.276506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:56.277194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:56.360095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:56.365153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:18:56.377712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:56.382473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:56.386957 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-483676cb-3812-4135-a1c1-fa8920f41f2e tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.129132 Oct 11 20:18:56.387647 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2844/5725] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:56 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:57.413973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:57.415280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:57.423077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:57.424031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:57.424708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:57.425903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:57.426676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:57.427318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:57.500538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:57.511872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:57.513473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:57.514709 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1e961ce9-7aec-4a5d-937b-48966c955a7c tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.104737 Oct 11 20:18:57.515613 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2882/5726] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:57 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:58.542784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:58.543405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:58.563540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:58.564180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:58.564637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:58.565344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:58.565807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:58.566235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:58.647921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:58.659810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:58.661401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:58.662967 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0a17dcc3-8f47-43ed-8b71-c53145f45fe6 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.124472 Oct 11 20:18:58.664281 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2845/5727] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:58 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:18:59.690167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:18:59.691158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:18:59.698386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:59.699011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:59.699749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:59.700589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:18:59.701131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:18:59.701550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:18:59.770094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:59.780547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:59.782199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:18:59.784063 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2eeaf928-f17c-4b24-a28d-fae1ffe0d85b tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.098593 Oct 11 20:18:59.789189 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2883/5728] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:18:59 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:19:00.812201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:00.812979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:00.820217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:00.820711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:00.821170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:00.821938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:00.822394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:00.822848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:00.895646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:00.907184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:00.909692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:00.911016 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21ec7332-acb3-48ce-ad48-066a0ccad3b2 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.103310 Oct 11 20:19:00.911844 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2846/5729] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:00 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:19:01.937370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:01.937993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:01.947018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:01.947519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:01.947967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:01.948694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:01.949168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:01.949582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:02.020583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:02.030449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:02.031978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0306ac1c267f43f29c900c5be79d6632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578e847eaa0405b8c48f4ea3376fddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:02.033462 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-49dc4764-b327-4799-ac15-9345ac878872 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 200 len: 1604 microversion: 2.42 time: 0.100067 Oct 11 20:19:02.034047 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2884/5730] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:01 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 1604 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:19:03.060725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:03.061439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:03.070027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:03.070558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:03.071105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:03.071997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:03.072602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:03.073175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:03.090813 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] HTTP exception thrown: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Request method failure captured: Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 HTTP/1.1 Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc40Vpx-QXzYvxpsovjemX4N-sQIrY4ZBysZoispPxFmHFyXgCGVNavkvnTs6Rdjb6IoP-XEHuX8KA5Wio7KEZ5WCcbomL8zXd5rZLP8OcB37GWxjKzVuyHgMT-Zrvl5thsY48bbm7xL6Goa52Ei5lLkdTwTR32UtqQygHLTK7tlvAA Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f578e847eaa0405b8c48f4ea3376fddb Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1163762618 Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f578e847eaa0405b8c48f4ea3376fddb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f578e847eaa0405b8c48f4ea3376fddb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f578e847eaa0405b8c48f4ea3376fddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f578e847eaa0405b8c48f4ea3376fddb"}]}] Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1163762618 Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f578e847eaa0405b8c48f4ea3376fddb Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1163762618 Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TaggedBootDevicesTest_v242-1163762618-project Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 0306ac1c267f43f29c900c5be79d6632 Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1163762618-project Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ee9233e8-54dc-461f-909b-e01720ae7821'} Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:03.092578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:19:03.097009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:03.097009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:03.097009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:19:03.097009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:19:03.097009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:19:03.097009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:19:03.097009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:03.097009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:03.097835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Returning 404 to user: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:19:03.098947 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-27c5b47f-afc2-4ecf-8dbd-a5e3ff64dda1 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 404 len: 111 microversion: 2.42 time: 0.042489 Oct 11 20:19:03.103084 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2847/5731] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:03 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:19:03.108362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-506ece86-408d-4414-b7a1-947df3675406 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '.version_select at 0x7f83d07305e0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:03.145188 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-506ece86-408d-4414-b7a1-947df3675406 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-707565461" status: 204 len: 0 microversion: 2.42 time: 0.040672 Oct 11 20:19:03.146055 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2885/5732] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Oct 11 20:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-707565461 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:19:06.784241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:06.784908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:06.791859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:06.792446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:06.792976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:06.793793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:06.794966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:06.795489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:06.811908 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] HTTP exception thrown: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Request method failure captured: Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 HTTP/1.1 Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc40Vpx-QXzYvxpsovjemX4N-sQIrY4ZBysZoispPxFmHFyXgCGVNavkvnTs6Rdjb6IoP-XEHuX8KA5Wio7KEZ5WCcbomL8zXd5rZLP8OcB37GWxjKzVuyHgMT-Zrvl5thsY48bbm7xL6Goa52Ei5lLkdTwTR32UtqQygHLTK7tlvAA Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: f578e847eaa0405b8c48f4ea3376fddb Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1163762618 Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f578e847eaa0405b8c48f4ea3376fddb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f578e847eaa0405b8c48f4ea3376fddb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f578e847eaa0405b8c48f4ea3376fddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f578e847eaa0405b8c48f4ea3376fddb"}]}] Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1163762618 Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: f578e847eaa0405b8c48f4ea3376fddb Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1163762618 Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TaggedBootDevicesTest_v242-1163762618-project Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 0306ac1c267f43f29c900c5be79d6632 Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1163762618-project Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ee9233e8-54dc-461f-909b-e01720ae7821'} Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:19:06.813738 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:06.817891 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:06.818677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Returning 404 to user: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:19:06.819638 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e59055cd-f85d-4d51-8dcf-5fd49589a3ba tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 404 len: 111 microversion: 2.42 time: 0.043859 Oct 11 20:19:06.820544 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2848/5733] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:19:06 2022] DELETE /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 20:19:06.829958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:06.830746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] [instance: ee9233e8-54dc-461f-909b-e01720ae7821] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:06.837753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:06.838381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:06.838949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:06.839756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:06.840324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:06.840861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:06.855037 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] HTTP exception thrown: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Request method failure captured: Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 HTTP/1.1 Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRc40Vpx-QXzYvxpsovjemX4N-sQIrY4ZBysZoispPxFmHFyXgCGVNavkvnTs6Rdjb6IoP-XEHuX8KA5Wio7KEZ5WCcbomL8zXd5rZLP8OcB37GWxjKzVuyHgMT-Zrvl5thsY48bbm7xL6Goa52Ei5lLkdTwTR32UtqQygHLTK7tlvAA Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: f578e847eaa0405b8c48f4ea3376fddb Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1163762618 Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f578e847eaa0405b8c48f4ea3376fddb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f578e847eaa0405b8c48f4ea3376fddb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f578e847eaa0405b8c48f4ea3376fddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f578e847eaa0405b8c48f4ea3376fddb"}]}] Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1163762618 Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: f578e847eaa0405b8c48f4ea3376fddb Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1163762618 Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TaggedBootDevicesTest_v242-1163762618-project Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 0306ac1c267f43f29c900c5be79d6632 Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1163762618-project Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'ee9233e8-54dc-461f-909b-e01720ae7821'} Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:19:06.856853 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:19:06.861650 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:19:06.861650 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:06.861650 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:19:06.861650 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:19:06.861650 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:19:06.861650 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:19:06.861650 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. Oct 11 20:19:06.861650 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:19:06.862168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] Returning 404 to user: Instance ee9233e8-54dc-461f-909b-e01720ae7821 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:19:06.863150 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6c840558-dd9a-4925-a45c-8c5bc5891856 tempest-TaggedBootDevicesTest_v242-1163762618 tempest-TaggedBootDevicesTest_v242-1163762618-project] 10.222.0.27 "GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821" status: 404 len: 111 microversion: 2.42 time: 0.038704 Oct 11 20:19:06.866960 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2886/5734] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:06 2022] GET /compute/v2.1/servers/ee9233e8-54dc-461f-909b-e01720ae7821 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:19:07.714682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-50fd0619-9ff1-4127-b107-53abf432fdea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Action: 'create', calling method: .version_select at 0x7f83c71dcee0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1606708251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ASHAx81JwtrJC5BqTb/xuHXk88nzmhbDTpgr+MYuAq/QLvN4b0vSuz0Eriv1ln8j0PK1tolQ52gGBfumHRVrLw+dPwb1TkhMw07QbuBSErR2/p7XsIXmR5EUISPWfxQ=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:07.730662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-50fd0619-9ff1-4127-b107-53abf432fdea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Getting quotas for project 28ab6a64bcb341089312117e408c02b7. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:19:07.737519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-50fd0619-9ff1-4127-b107-53abf432fdea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Getting quotas for user 62822a2d7276492181b8c3aa25c3b12a and project 28ab6a64bcb341089312117e408c02b7. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:19:07.768547 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-50fd0619-9ff1-4127-b107-53abf432fdea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057822 Oct 11 20:19:07.769342 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2849/5735] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:19:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:19:08.969513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1897257973", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e2a56705-2bd1-43ad-bb58-c7b39fe454ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1606708251", "security_groups": [{"name": "tempest-secgroup-smoke-706396381"}], "networks": [{"uuid": "432ec1cb-9805-4cbf-ade3-32df0f5fe957"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:09.116514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] validate_networks() for [('432ec1cb-9805-4cbf-ade3-32df0f5fe957', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:19:09.530703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:19:09.531135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:19:09.531619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:19:09.532561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:19:09.532980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:19:09.544943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:09.545441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:09.545883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:09.546645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:09.547283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:09.548010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:09.570888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Getting quotas for project 28ab6a64bcb341089312117e408c02b7. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:19:09.577089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Getting quotas for user 62822a2d7276492181b8c3aa25c3b12a and project 28ab6a64bcb341089312117e408c02b7. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:19:09.642786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:19:09.645337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e2a56705-2bd1-43ad-bb58-c7b39fe454ac',volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:19:09.797621 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1a572563-f31e-4081-a383-46eb061c8fb9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.833094 Oct 11 20:19:09.798937 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2887/5736] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:19:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:19:09.809825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-41132f6e-0e39-4a16-9167-bdd8e7ccf71b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:09.811752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-41132f6e-0e39-4a16-9167-bdd8e7ccf71b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:09.886338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-41132f6e-0e39-4a16-9167-bdd8e7ccf71b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:09.893836 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-41132f6e-0e39-4a16-9167-bdd8e7ccf71b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1099 microversion: 2.1 time: 0.087873 Oct 11 20:19:09.894631 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2850/5737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:09 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1099 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:10.926398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9529346a-fd2a-40fe-87d8-dd0ffda7563a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:10.927809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9529346a-fd2a-40fe-87d8-dd0ffda7563a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:10.941572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9529346a-fd2a-40fe-87d8-dd0ffda7563a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:10.942450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9529346a-fd2a-40fe-87d8-dd0ffda7563a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:10.943152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9529346a-fd2a-40fe-87d8-dd0ffda7563a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:10.944152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9529346a-fd2a-40fe-87d8-dd0ffda7563a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:10.944844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9529346a-fd2a-40fe-87d8-dd0ffda7563a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:10.945484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9529346a-fd2a-40fe-87d8-dd0ffda7563a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:11.036093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9529346a-fd2a-40fe-87d8-dd0ffda7563a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:11.048231 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9529346a-fd2a-40fe-87d8-dd0ffda7563a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1197 microversion: 2.1 time: 0.135307 Oct 11 20:19:11.049728 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2888/5738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:10 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:12.073267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ce090471-f7ce-4876-8880-006fed8e5d5a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:12.073896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ce090471-f7ce-4876-8880-006fed8e5d5a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:12.092433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce090471-f7ce-4876-8880-006fed8e5d5a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:12.092944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce090471-f7ce-4876-8880-006fed8e5d5a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:12.093385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce090471-f7ce-4876-8880-006fed8e5d5a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:12.094102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce090471-f7ce-4876-8880-006fed8e5d5a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:12.095369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce090471-f7ce-4876-8880-006fed8e5d5a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:12.099096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce090471-f7ce-4876-8880-006fed8e5d5a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:12.247227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce090471-f7ce-4876-8880-006fed8e5d5a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:12.279898 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ce090471-f7ce-4876-8880-006fed8e5d5a tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1215 microversion: 2.1 time: 0.211166 Oct 11 20:19:12.283501 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2851/5739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:12 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:13.309449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-587ccc0b-874b-40f1-992f-d8f4c89a5794 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:13.310088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-587ccc0b-874b-40f1-992f-d8f4c89a5794 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:13.324251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-587ccc0b-874b-40f1-992f-d8f4c89a5794 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:13.330734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-587ccc0b-874b-40f1-992f-d8f4c89a5794 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:13.331298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-587ccc0b-874b-40f1-992f-d8f4c89a5794 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:13.332059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-587ccc0b-874b-40f1-992f-d8f4c89a5794 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:13.332534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-587ccc0b-874b-40f1-992f-d8f4c89a5794 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:13.332980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-587ccc0b-874b-40f1-992f-d8f4c89a5794 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:13.826486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-587ccc0b-874b-40f1-992f-d8f4c89a5794 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:13.829317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:13.837730 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-587ccc0b-874b-40f1-992f-d8f4c89a5794 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1282 microversion: 2.1 time: 0.531998 Oct 11 20:19:13.838218 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2889/5740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:13 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1282 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:14.629130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-bfc46027-5bec-4a5b-bff1-56e3ab5fdc66 req-2c5f0f60-fb74-49bf-92b7-d02ffe8d6b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6514d0-68d1-4a81-aadf-c87a122d0531", "tag": "70e9f4bf-358b-49b4-a779-d87851017a93"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:14.646591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bfc46027-5bec-4a5b-bff1-56e3ab5fdc66 req-2c5f0f60-fb74-49bf-92b7-d02ffe8d6b36 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:14.647421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bfc46027-5bec-4a5b-bff1-56e3ab5fdc66 req-2c5f0f60-fb74-49bf-92b7-d02ffe8d6b36 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:14.648090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bfc46027-5bec-4a5b-bff1-56e3ab5fdc66 req-2c5f0f60-fb74-49bf-92b7-d02ffe8d6b36 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:14.664419 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-bfc46027-5bec-4a5b-bff1-56e3ab5fdc66 req-2c5f0f60-fb74-49bf-92b7-d02ffe8d6b36 service nova] Creating event network-changed:70e9f4bf-358b-49b4-a779-d87851017a93 for instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 on n-h2-860864-3 Oct 11 20:19:14.672018 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-bfc46027-5bec-4a5b-bff1-56e3ab5fdc66 req-2c5f0f60-fb74-49bf-92b7-d02ffe8d6b36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046572 Oct 11 20:19:14.673480 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2852/5741] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:19:14.862783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9a4e893a-3e75-4aa5-ab35-f656800abeea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:14.863553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9a4e893a-3e75-4aa5-ab35-f656800abeea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:14.881829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a4e893a-3e75-4aa5-ab35-f656800abeea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:14.884272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a4e893a-3e75-4aa5-ab35-f656800abeea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:14.884879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a4e893a-3e75-4aa5-ab35-f656800abeea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:14.887190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a4e893a-3e75-4aa5-ab35-f656800abeea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:14.889382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a4e893a-3e75-4aa5-ab35-f656800abeea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:14.890015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9a4e893a-3e75-4aa5-ab35-f656800abeea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:15.216848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9a4e893a-3e75-4aa5-ab35-f656800abeea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:15.230472 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9a4e893a-3e75-4aa5-ab35-f656800abeea tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1282 microversion: 2.1 time: 0.372505 Oct 11 20:19:15.243639 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2890/5742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:14 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1282 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:16.265143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-70c62729-db25-48b2-a0b2-a22cffaa683c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:16.265493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-70c62729-db25-48b2-a0b2-a22cffaa683c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:16.292355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70c62729-db25-48b2-a0b2-a22cffaa683c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:16.292355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70c62729-db25-48b2-a0b2-a22cffaa683c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:16.292829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70c62729-db25-48b2-a0b2-a22cffaa683c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:16.293865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70c62729-db25-48b2-a0b2-a22cffaa683c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:16.294330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70c62729-db25-48b2-a0b2-a22cffaa683c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:16.294788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-70c62729-db25-48b2-a0b2-a22cffaa683c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:16.461721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-70c62729-db25-48b2-a0b2-a22cffaa683c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:16.470885 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-70c62729-db25-48b2-a0b2-a22cffaa683c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1282 microversion: 2.1 time: 0.211447 Oct 11 20:19:16.471634 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2853/5743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:16 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:17.282355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e36c1321-e382-4036-adb9-d3a3eb8be685 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:17.282883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e36c1321-e382-4036-adb9-d3a3eb8be685 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:17.290078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e36c1321-e382-4036-adb9-d3a3eb8be685 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:17.290621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e36c1321-e382-4036-adb9-d3a3eb8be685 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:17.291034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e36c1321-e382-4036-adb9-d3a3eb8be685 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:17.291727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e36c1321-e382-4036-adb9-d3a3eb8be685 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:17.292247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e36c1321-e382-4036-adb9-d3a3eb8be685 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:17.292726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e36c1321-e382-4036-adb9-d3a3eb8be685 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:17.379140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-e36c1321-e382-4036-adb9-d3a3eb8be685 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lazy-loading 'services' on Instance uuid 615dfb94-8115-4e76-a938-287caf7fdeb6 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:19:17.453931 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e36c1321-e382-4036-adb9-d3a3eb8be685 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6/os-volume_attachments/743b6bc9-1aab-4529-8d1e-2407e50eee5d" status: 202 len: 0 microversion: 2.1 time: 0.175873 Oct 11 20:19:17.455126 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2891/5744] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:19:17 2022] DELETE /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6/os-volume_attachments/743b6bc9-1aab-4529-8d1e-2407e50eee5d => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:19:17.497886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-47598d0b-ed7f-4773-8133-f34d3fa1632c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:17.499342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-47598d0b-ed7f-4773-8133-f34d3fa1632c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:17.509087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47598d0b-ed7f-4773-8133-f34d3fa1632c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:17.509624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47598d0b-ed7f-4773-8133-f34d3fa1632c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:17.510065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47598d0b-ed7f-4773-8133-f34d3fa1632c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:17.510797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47598d0b-ed7f-4773-8133-f34d3fa1632c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:17.511254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47598d0b-ed7f-4773-8133-f34d3fa1632c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:17.511851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47598d0b-ed7f-4773-8133-f34d3fa1632c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:17.676170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-47598d0b-ed7f-4773-8133-f34d3fa1632c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:17.684758 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-47598d0b-ed7f-4773-8133-f34d3fa1632c tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1282 microversion: 2.1 time: 0.191312 Oct 11 20:19:17.685621 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2854/5745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:17 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:18.710496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c39fcd73-7e84-4d9f-869b-29ba5a4a9b2b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:18.711221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c39fcd73-7e84-4d9f-869b-29ba5a4a9b2b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:18.718458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c39fcd73-7e84-4d9f-869b-29ba5a4a9b2b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:18.719385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c39fcd73-7e84-4d9f-869b-29ba5a4a9b2b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:18.719832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c39fcd73-7e84-4d9f-869b-29ba5a4a9b2b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:18.720540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c39fcd73-7e84-4d9f-869b-29ba5a4a9b2b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:18.720995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c39fcd73-7e84-4d9f-869b-29ba5a4a9b2b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:18.721416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c39fcd73-7e84-4d9f-869b-29ba5a4a9b2b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:18.868384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c39fcd73-7e84-4d9f-869b-29ba5a4a9b2b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:18.876911 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c39fcd73-7e84-4d9f-869b-29ba5a4a9b2b tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1282 microversion: 2.1 time: 0.170624 Oct 11 20:19:18.877488 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2892/5746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:18 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:19.900635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c7519275-4519-47bf-b9cb-2d9f3eb323b3 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:19.901399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c7519275-4519-47bf-b9cb-2d9f3eb323b3 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:19.904864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:19.910911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7519275-4519-47bf-b9cb-2d9f3eb323b3 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:19.911529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7519275-4519-47bf-b9cb-2d9f3eb323b3 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:19.912173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7519275-4519-47bf-b9cb-2d9f3eb323b3 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:19.912952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7519275-4519-47bf-b9cb-2d9f3eb323b3 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:19.913527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7519275-4519-47bf-b9cb-2d9f3eb323b3 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:19.913963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7519275-4519-47bf-b9cb-2d9f3eb323b3 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:20.057861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c7519275-4519-47bf-b9cb-2d9f3eb323b3 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:20.066781 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c7519275-4519-47bf-b9cb-2d9f3eb323b3 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1282 microversion: 2.1 time: 0.170050 Oct 11 20:19:20.067950 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2855/5747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:19 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:21.092384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f2de6353-2b75-4108-93a2-1245954c04a9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:21.092999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f2de6353-2b75-4108-93a2-1245954c04a9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:21.095077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:21.095879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:21.102982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2de6353-2b75-4108-93a2-1245954c04a9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:21.103466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2de6353-2b75-4108-93a2-1245954c04a9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:21.103910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2de6353-2b75-4108-93a2-1245954c04a9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:21.104604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2de6353-2b75-4108-93a2-1245954c04a9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:21.105059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2de6353-2b75-4108-93a2-1245954c04a9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:21.105481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2de6353-2b75-4108-93a2-1245954c04a9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:21.243634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f2de6353-2b75-4108-93a2-1245954c04a9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:21.251988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f2de6353-2b75-4108-93a2-1245954c04a9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1282 microversion: 2.1 time: 0.163570 Oct 11 20:19:21.252568 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2893/5748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:21 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:22.274592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-40ac065a-c6dc-4a03-975c-9e9a018405bc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:22.275229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-40ac065a-c6dc-4a03-975c-9e9a018405bc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:22.277860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:22.283474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40ac065a-c6dc-4a03-975c-9e9a018405bc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:22.283956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40ac065a-c6dc-4a03-975c-9e9a018405bc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:22.284388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40ac065a-c6dc-4a03-975c-9e9a018405bc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:22.285071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40ac065a-c6dc-4a03-975c-9e9a018405bc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:22.285544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40ac065a-c6dc-4a03-975c-9e9a018405bc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:22.285963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40ac065a-c6dc-4a03-975c-9e9a018405bc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:22.427182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-40ac065a-c6dc-4a03-975c-9e9a018405bc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:22.435090 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-40ac065a-c6dc-4a03-975c-9e9a018405bc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1282 microversion: 2.1 time: 0.164441 Oct 11 20:19:22.435763 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2856/5749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:22 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:23.347758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8dcc5d50-c751-4e41-bd82-5d958f83f089 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:23.348398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8dcc5d50-c751-4e41-bd82-5d958f83f089 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:23.351251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:23.356401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dcc5d50-c751-4e41-bd82-5d958f83f089 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:23.357187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dcc5d50-c751-4e41-bd82-5d958f83f089 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:23.357320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dcc5d50-c751-4e41-bd82-5d958f83f089 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:23.358148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dcc5d50-c751-4e41-bd82-5d958f83f089 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:23.358630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dcc5d50-c751-4e41-bd82-5d958f83f089 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:23.359057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dcc5d50-c751-4e41-bd82-5d958f83f089 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:23.392332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8dcc5d50-c751-4e41-bd82-5d958f83f089 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:19:23.462464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f1236253-284c-41d1-b887-d5f5c3f55d84 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:23.464244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f1236253-284c-41d1-b887-d5f5c3f55d84 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:23.482059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f1236253-284c-41d1-b887-d5f5c3f55d84 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:23.483050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f1236253-284c-41d1-b887-d5f5c3f55d84 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:23.484298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f1236253-284c-41d1-b887-d5f5c3f55d84 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:23.485724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f1236253-284c-41d1-b887-d5f5c3f55d84 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:23.494749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f1236253-284c-41d1-b887-d5f5c3f55d84 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:23.498912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f1236253-284c-41d1-b887-d5f5c3f55d84 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:23.509020 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8dcc5d50-c751-4e41-bd82-5d958f83f089 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 204 len: 0 microversion: 2.1 time: 0.165720 Oct 11 20:19:23.510241 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2894/5750] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:19:23 2022] DELETE /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:19:23.519349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba383215-983f-4250-9e28-f268d5a78b0e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:23.520146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba383215-983f-4250-9e28-f268d5a78b0e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:23.527632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba383215-983f-4250-9e28-f268d5a78b0e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:23.528356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba383215-983f-4250-9e28-f268d5a78b0e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:23.529214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba383215-983f-4250-9e28-f268d5a78b0e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:23.529926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba383215-983f-4250-9e28-f268d5a78b0e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:23.530399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba383215-983f-4250-9e28-f268d5a78b0e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:23.530978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba383215-983f-4250-9e28-f268d5a78b0e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:23.728059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f1236253-284c-41d1-b887-d5f5c3f55d84 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:23.732274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba383215-983f-4250-9e28-f268d5a78b0e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:23.739632 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f1236253-284c-41d1-b887-d5f5c3f55d84 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1282 microversion: 2.1 time: 0.284000 Oct 11 20:19:23.740848 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2857/5751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:23 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1282 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:19:23.749630 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba383215-983f-4250-9e28-f268d5a78b0e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1469 microversion: 2.1 time: 0.235348 Oct 11 20:19:23.759632 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2895/5752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:23 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1469 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:24.762742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-640a314d-c52b-46af-aa21-bb0e8347ca82 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:24.764164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-640a314d-c52b-46af-aa21-bb0e8347ca82 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:24.772188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-640a314d-c52b-46af-aa21-bb0e8347ca82 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:24.773053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-640a314d-c52b-46af-aa21-bb0e8347ca82 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:24.773265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aeecfbb4-7461-4310-b956-f09d5e81f05e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:24.773834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-640a314d-c52b-46af-aa21-bb0e8347ca82 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:24.774812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aeecfbb4-7461-4310-b956-f09d5e81f05e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:24.774959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-640a314d-c52b-46af-aa21-bb0e8347ca82 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:24.775408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-640a314d-c52b-46af-aa21-bb0e8347ca82 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:24.775851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-640a314d-c52b-46af-aa21-bb0e8347ca82 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:24.783356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeecfbb4-7461-4310-b956-f09d5e81f05e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:24.785111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeecfbb4-7461-4310-b956-f09d5e81f05e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:24.785964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeecfbb4-7461-4310-b956-f09d5e81f05e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:24.787093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeecfbb4-7461-4310-b956-f09d5e81f05e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:24.787788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeecfbb4-7461-4310-b956-f09d5e81f05e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:24.788438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aeecfbb4-7461-4310-b956-f09d5e81f05e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:24.992024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aeecfbb4-7461-4310-b956-f09d5e81f05e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:25.004084 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aeecfbb4-7461-4310-b956-f09d5e81f05e tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1469 microversion: 2.1 time: 0.235063 Oct 11 20:19:25.019008 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2896/5753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:24 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:25.062566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-640a314d-c52b-46af-aa21-bb0e8347ca82 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:25.066496 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-640a314d-c52b-46af-aa21-bb0e8347ca82 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1282 microversion: 2.1 time: 0.307662 Oct 11 20:19:25.067105 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2858/5754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:24 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1282 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:25.585029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a6c47684-32f7-47be-a72c-9c2914353bfa req-30307583-2329-4902-9c91-b51e25a8dded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615dfb94-8115-4e76-a938-287caf7fdeb6", "name": "network-vif-deleted", "tag": "ee54e4da-bc45-47b7-8ce0-3c78c925949f"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:25.598836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a6c47684-32f7-47be-a72c-9c2914353bfa req-30307583-2329-4902-9c91-b51e25a8dded service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:25.599592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a6c47684-32f7-47be-a72c-9c2914353bfa req-30307583-2329-4902-9c91-b51e25a8dded service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:25.600188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a6c47684-32f7-47be-a72c-9c2914353bfa req-30307583-2329-4902-9c91-b51e25a8dded service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:25.619078 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a6c47684-32f7-47be-a72c-9c2914353bfa req-30307583-2329-4902-9c91-b51e25a8dded service nova] Creating event network-vif-deleted:ee54e4da-bc45-47b7-8ce0-3c78c925949f for instance 615dfb94-8115-4e76-a938-287caf7fdeb6 on n-h1-860864-3 Oct 11 20:19:25.624639 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a6c47684-32f7-47be-a72c-9c2914353bfa req-30307583-2329-4902-9c91-b51e25a8dded service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043576 Oct 11 20:19:25.626081 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2897/5755] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:19:26.028500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:26.029904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:26.038278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:26.039132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:26.039786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:26.040692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:26.041338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:26.041948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:26.076461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:26.077310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:26.078668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:26.079311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lazy-loading 'fault' on Instance uuid 615dfb94-8115-4e76-a938-287caf7fdeb6 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:19:26.093975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e87f8390-80b1-486d-b9ae-fdae7ea06bee tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:26.095303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e87f8390-80b1-486d-b9ae-fdae7ea06bee tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:26.116549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87f8390-80b1-486d-b9ae-fdae7ea06bee tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:26.119021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87f8390-80b1-486d-b9ae-fdae7ea06bee tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:26.119611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87f8390-80b1-486d-b9ae-fdae7ea06bee tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:26.121795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87f8390-80b1-486d-b9ae-fdae7ea06bee tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:26.123176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87f8390-80b1-486d-b9ae-fdae7ea06bee tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:26.123726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87f8390-80b1-486d-b9ae-fdae7ea06bee tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:26.138189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77a84122e1c4375888b4f6bc2ad30b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fc31b0d6ed409e9610c523b2c028a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:26.146177 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9fbf0ea-fea6-4642-8e6f-96583666f898 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 200 len: 1303 microversion: 2.1 time: 0.121458 Oct 11 20:19:26.147588 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2859/5756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:26 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:26.312356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e87f8390-80b1-486d-b9ae-fdae7ea06bee tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:26.321959 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e87f8390-80b1-486d-b9ae-fdae7ea06bee tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1270 microversion: 2.1 time: 0.234134 Oct 11 20:19:26.322652 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2898/5757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:26 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1270 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:19:27.172316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:27.172999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] [instance: 615dfb94-8115-4e76-a938-287caf7fdeb6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:27.180614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:27.181111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:27.181557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:27.182269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:27.182759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:27.183196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:27.197342 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] HTTP exception thrown: Instance 615dfb94-8115-4e76-a938-287caf7fdeb6 could not be found. Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Request method failure captured: Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 HTTP/1.1 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc9RdJe5tGHSUJ_Lr_aUKw3EbnMyQv2oq264oNZ-wpSgg5wdznSR8MxdTnKaW0oxSHpmdiLfWQMTk7Pn9EDx8UCZuA2Oa40hJI7BcWhwADqPnIiA3lRCVAL6MuN_7nB8sMkm4aV1cjh9nWtj7yEJBALTarZbVTwst0dZFntpHI0qQy4 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: c7fc31b0d6ed409e9610c523b2c028a7 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesBackupsTest-468988063 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7fc31b0d6ed409e9610c523b2c028a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7fc31b0d6ed409e9610c523b2c028a7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7fc31b0d6ed409e9610c523b2c028a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7fc31b0d6ed409e9610c523b2c028a7"}]}] Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesBackupsTest-468988063 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: c7fc31b0d6ed409e9610c523b2c028a7 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesBackupsTest-468988063 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesBackupsTest-468988063-project Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: f77a84122e1c4375888b4f6bc2ad30b2 Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesBackupsTest-468988063-project Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 615dfb94-8115-4e76-a938-287caf7fdeb6 could not be found. Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '615dfb94-8115-4e76-a938-287caf7fdeb6'} Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 615dfb94-8115-4e76-a938-287caf7fdeb6 could not be found. Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 615dfb94-8115-4e76-a938-287caf7fdeb6 could not be found. Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:19:27.199128 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:27.204655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:19:27.204655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:19:27.204655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:19:27.204655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:19:27.204655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:19:27.204655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 615dfb94-8115-4e76-a938-287caf7fdeb6 could not be found. Oct 11 20:19:27.204655 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:19:27.204655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] Returning 404 to user: Instance 615dfb94-8115-4e76-a938-287caf7fdeb6 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:19:27.204655 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c37ef01-a96f-45db-883e-c871da44d6c3 tempest-VolumesBackupsTest-468988063 tempest-VolumesBackupsTest-468988063-project] 10.222.0.27 "GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6" status: 404 len: 111 microversion: 2.1 time: 0.032800 Oct 11 20:19:27.204655 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2860/5758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:27 2022] GET /compute/v2.1/servers/615dfb94-8115-4e76-a938-287caf7fdeb6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:19:27.346022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9511259a-6658-476f-8fe0-c12b2cc5388e tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:27.346702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9511259a-6658-476f-8fe0-c12b2cc5388e tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:27.353602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9511259a-6658-476f-8fe0-c12b2cc5388e tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:27.354087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9511259a-6658-476f-8fe0-c12b2cc5388e tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:27.354555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9511259a-6658-476f-8fe0-c12b2cc5388e tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:27.355235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9511259a-6658-476f-8fe0-c12b2cc5388e tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:27.355682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9511259a-6658-476f-8fe0-c12b2cc5388e tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:27.356165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9511259a-6658-476f-8fe0-c12b2cc5388e tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:27.501879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9511259a-6658-476f-8fe0-c12b2cc5388e tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:27.510742 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9511259a-6658-476f-8fe0-c12b2cc5388e tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1270 microversion: 2.1 time: 0.169141 Oct 11 20:19:27.511440 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2899/5759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:27 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:28.533869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-35d45fea-cbc6-4f80-8841-2d6b365962ec tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:28.534495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35d45fea-cbc6-4f80-8841-2d6b365962ec tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:28.551908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d45fea-cbc6-4f80-8841-2d6b365962ec tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:28.553799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d45fea-cbc6-4f80-8841-2d6b365962ec tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:28.554415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d45fea-cbc6-4f80-8841-2d6b365962ec tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:28.555361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d45fea-cbc6-4f80-8841-2d6b365962ec tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:28.555964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d45fea-cbc6-4f80-8841-2d6b365962ec tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:28.556554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35d45fea-cbc6-4f80-8841-2d6b365962ec tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:28.844796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-35d45fea-cbc6-4f80-8841-2d6b365962ec tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:28.856439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=75 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:28.861690 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-35d45fea-cbc6-4f80-8841-2d6b365962ec tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1270 microversion: 2.1 time: 0.331712 Oct 11 20:19:28.862675 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2861/5760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:28 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1270 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:29.887365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d5ec658c-52d1-43fa-bf29-fbb631bd38b4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:29.887998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d5ec658c-52d1-43fa-bf29-fbb631bd38b4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:29.902918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ec658c-52d1-43fa-bf29-fbb631bd38b4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:29.903611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ec658c-52d1-43fa-bf29-fbb631bd38b4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:29.904288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ec658c-52d1-43fa-bf29-fbb631bd38b4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:29.904949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ec658c-52d1-43fa-bf29-fbb631bd38b4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:29.905382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ec658c-52d1-43fa-bf29-fbb631bd38b4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:29.906408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ec658c-52d1-43fa-bf29-fbb631bd38b4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:30.311825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d5ec658c-52d1-43fa-bf29-fbb631bd38b4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:30.326830 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d5ec658c-52d1-43fa-bf29-fbb631bd38b4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1270 microversion: 2.1 time: 0.441517 Oct 11 20:19:30.363404 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2900/5761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:29 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1270 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:31.366422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cdac3b9e-87c7-4729-a9b0-7057361c0ad2 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:31.367151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cdac3b9e-87c7-4729-a9b0-7057361c0ad2 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:31.388201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdac3b9e-87c7-4729-a9b0-7057361c0ad2 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:31.388715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdac3b9e-87c7-4729-a9b0-7057361c0ad2 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:31.389169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdac3b9e-87c7-4729-a9b0-7057361c0ad2 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:31.389915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdac3b9e-87c7-4729-a9b0-7057361c0ad2 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:31.390646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdac3b9e-87c7-4729-a9b0-7057361c0ad2 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:31.391238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdac3b9e-87c7-4729-a9b0-7057361c0ad2 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:31.626582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cdac3b9e-87c7-4729-a9b0-7057361c0ad2 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:31.636231 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cdac3b9e-87c7-4729-a9b0-7057361c0ad2 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1270 microversion: 2.1 time: 0.282458 Oct 11 20:19:31.637702 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2862/5762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:31 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1270 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:32.661614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dbf0d70a-deda-4b9b-a8ad-5365c05527bf tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:32.662661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dbf0d70a-deda-4b9b-a8ad-5365c05527bf tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:32.676120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbf0d70a-deda-4b9b-a8ad-5365c05527bf tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:32.677613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbf0d70a-deda-4b9b-a8ad-5365c05527bf tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:32.678623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbf0d70a-deda-4b9b-a8ad-5365c05527bf tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:32.682307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbf0d70a-deda-4b9b-a8ad-5365c05527bf tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:32.683089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbf0d70a-deda-4b9b-a8ad-5365c05527bf tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:32.684552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dbf0d70a-deda-4b9b-a8ad-5365c05527bf tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:33.033136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dbf0d70a-deda-4b9b-a8ad-5365c05527bf tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:33.042708 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dbf0d70a-deda-4b9b-a8ad-5365c05527bf tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1270 microversion: 2.1 time: 0.385157 Oct 11 20:19:33.048481 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2901/5763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:32 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1270 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:34.073906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e41db42d-101a-40c8-ac5c-8f3d4eb32623 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:34.075129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e41db42d-101a-40c8-ac5c-8f3d4eb32623 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:34.086952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e41db42d-101a-40c8-ac5c-8f3d4eb32623 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:34.087680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e41db42d-101a-40c8-ac5c-8f3d4eb32623 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:34.090364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e41db42d-101a-40c8-ac5c-8f3d4eb32623 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:34.091287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e41db42d-101a-40c8-ac5c-8f3d4eb32623 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:34.094932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e41db42d-101a-40c8-ac5c-8f3d4eb32623 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:34.096209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e41db42d-101a-40c8-ac5c-8f3d4eb32623 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:34.240302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-840072288", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "13d33a44-fe09-4837-b4fa-9dd17aef19f7"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:34.337679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] validate_networks() for [('13d33a44-fe09-4837-b4fa-9dd17aef19f7', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:19:34.487311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e41db42d-101a-40c8-ac5c-8f3d4eb32623 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:34.499754 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e41db42d-101a-40c8-ac5c-8f3d4eb32623 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1270 microversion: 2.1 time: 0.430202 Oct 11 20:19:34.500428 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2863/5764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:34 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1270 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:35.028474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:19:35.028911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:19:35.029394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:19:35.029811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:19:35.030265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:19:35.040987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:35.041761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:35.042389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:35.043280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:35.044035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:35.044635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:35.076913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Getting quotas for project a70d2e9b4f464eefac9d4c5ab51c47f2. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:19:35.085147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Getting quotas for user ae4ea8b90e6f480f8480dafec996bbcb and project a70d2e9b4f464eefac9d4c5ab51c47f2. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:19:35.099326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:19:35.102057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:19:35.161778 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-db8ae948-2be3-47ac-86ba-585bc10efa95 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926554 Oct 11 20:19:35.164034 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2902/5765] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:19:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:19:35.175639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b84a124-262c-4d8d-97bb-2664ab18578f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:35.176786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b84a124-262c-4d8d-97bb-2664ab18578f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:35.248249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b84a124-262c-4d8d-97bb-2664ab18578f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:35.260570 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b84a124-262c-4d8d-97bb-2664ab18578f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1218 microversion: 2.1 time: 0.089107 Oct 11 20:19:35.262349 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2864/5766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:35 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:35.512626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8ad83e28-9734-486e-9929-698e79af4e5c req-cb8eb137-41c2-4945-a6e4-9ab7327d648b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6514d0-68d1-4a81-aadf-c87a122d0531", "name": "network-vif-plugged", "status": "completed", "tag": "70e9f4bf-358b-49b4-a779-d87851017a93"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:35.524303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9e5b769-5e50-4bf9-8e0f-cdc497cbb807 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:35.524931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b9e5b769-5e50-4bf9-8e0f-cdc497cbb807 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:35.545270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e5b769-5e50-4bf9-8e0f-cdc497cbb807 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:35.545790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e5b769-5e50-4bf9-8e0f-cdc497cbb807 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:35.547376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e5b769-5e50-4bf9-8e0f-cdc497cbb807 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:35.548125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e5b769-5e50-4bf9-8e0f-cdc497cbb807 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:35.559805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e5b769-5e50-4bf9-8e0f-cdc497cbb807 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:35.560500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ad83e28-9734-486e-9929-698e79af4e5c req-cb8eb137-41c2-4945-a6e4-9ab7327d648b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:35.560739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9e5b769-5e50-4bf9-8e0f-cdc497cbb807 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:35.561108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ad83e28-9734-486e-9929-698e79af4e5c req-cb8eb137-41c2-4945-a6e4-9ab7327d648b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:35.561893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ad83e28-9734-486e-9929-698e79af4e5c req-cb8eb137-41c2-4945-a6e4-9ab7327d648b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:35.579070 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8ad83e28-9734-486e-9929-698e79af4e5c req-cb8eb137-41c2-4945-a6e4-9ab7327d648b service nova] Creating event network-vif-plugged:70e9f4bf-358b-49b4-a779-d87851017a93 for instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 on n-h2-860864-3 Oct 11 20:19:35.586230 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8ad83e28-9734-486e-9929-698e79af4e5c req-cb8eb137-41c2-4945-a6e4-9ab7327d648b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292684 Oct 11 20:19:35.591159 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2903/5767] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:19:35.990020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b9e5b769-5e50-4bf9-8e0f-cdc497cbb807 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:36.009828 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b9e5b769-5e50-4bf9-8e0f-cdc497cbb807 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1270 microversion: 2.1 time: 0.490252 Oct 11 20:19:36.013663 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2865/5768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:35 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1270 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:19:36.289118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2adea789-4b14-4af7-951d-42d45838f31e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:36.293621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2adea789-4b14-4af7-951d-42d45838f31e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:36.307828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2adea789-4b14-4af7-951d-42d45838f31e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:36.309451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2adea789-4b14-4af7-951d-42d45838f31e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:36.310108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2adea789-4b14-4af7-951d-42d45838f31e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:36.311093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2adea789-4b14-4af7-951d-42d45838f31e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:36.311959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2adea789-4b14-4af7-951d-42d45838f31e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:36.312707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2adea789-4b14-4af7-951d-42d45838f31e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:36.427968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2adea789-4b14-4af7-951d-42d45838f31e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:36.450939 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2adea789-4b14-4af7-951d-42d45838f31e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1270 microversion: 2.1 time: 0.167199 Oct 11 20:19:36.456246 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2904/5769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:36 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:37.041498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c1da0ad1-ebe0-48dd-95c2-aa3c2b9e36ef tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:37.043625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c1da0ad1-ebe0-48dd-95c2-aa3c2b9e36ef tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:37.066704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1da0ad1-ebe0-48dd-95c2-aa3c2b9e36ef tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:37.067223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1da0ad1-ebe0-48dd-95c2-aa3c2b9e36ef tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:37.067683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1da0ad1-ebe0-48dd-95c2-aa3c2b9e36ef tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:37.083267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1da0ad1-ebe0-48dd-95c2-aa3c2b9e36ef tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:37.084234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1da0ad1-ebe0-48dd-95c2-aa3c2b9e36ef tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:37.087619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1da0ad1-ebe0-48dd-95c2-aa3c2b9e36ef tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:37.389268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c1da0ad1-ebe0-48dd-95c2-aa3c2b9e36ef tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:37.401343 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c1da0ad1-ebe0-48dd-95c2-aa3c2b9e36ef tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1459 microversion: 2.1 time: 0.369944 Oct 11 20:19:37.402857 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2866/5770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:37 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1459 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:37.425537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4a35eeee-f90f-4344-999a-11bea62025fc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:37.426146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4a35eeee-f90f-4344-999a-11bea62025fc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:37.435082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a35eeee-f90f-4344-999a-11bea62025fc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:37.437142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a35eeee-f90f-4344-999a-11bea62025fc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:37.440102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a35eeee-f90f-4344-999a-11bea62025fc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:37.441708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a35eeee-f90f-4344-999a-11bea62025fc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:37.443045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a35eeee-f90f-4344-999a-11bea62025fc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:37.444988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4a35eeee-f90f-4344-999a-11bea62025fc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:37.478263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e58b47df-7048-499f-9df6-36ee4e9bec4c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:37.479393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e58b47df-7048-499f-9df6-36ee4e9bec4c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:37.497665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e58b47df-7048-499f-9df6-36ee4e9bec4c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:37.499995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e58b47df-7048-499f-9df6-36ee4e9bec4c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:37.505300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e58b47df-7048-499f-9df6-36ee4e9bec4c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:37.508487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e58b47df-7048-499f-9df6-36ee4e9bec4c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:37.510190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e58b47df-7048-499f-9df6-36ee4e9bec4c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:37.512391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e58b47df-7048-499f-9df6-36ee4e9bec4c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:37.867195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4a35eeee-f90f-4344-999a-11bea62025fc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:37.887614 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4a35eeee-f90f-4344-999a-11bea62025fc tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1459 microversion: 2.1 time: 0.466408 Oct 11 20:19:37.889691 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2905/5771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:37 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1459 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:37.930883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e58b47df-7048-499f-9df6-36ee4e9bec4c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:37.957079 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e58b47df-7048-499f-9df6-36ee4e9bec4c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1318 microversion: 2.1 time: 0.480280 Oct 11 20:19:37.974871 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2867/5772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:37 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:19:38.880188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-0437e0fa-f296-4e6f-9f6d-e302fd82e6a7 req-6acf12d8-3b2a-430b-b784-3a2d61b06789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41dd4d0-6814-4834-bbc6-aa66fff3942f", "tag": "4d92ea17-9c3c-44e6-8cae-6ef668d7db95"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:38.894690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0437e0fa-f296-4e6f-9f6d-e302fd82e6a7 req-6acf12d8-3b2a-430b-b784-3a2d61b06789 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:38.895577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0437e0fa-f296-4e6f-9f6d-e302fd82e6a7 req-6acf12d8-3b2a-430b-b784-3a2d61b06789 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:38.896309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0437e0fa-f296-4e6f-9f6d-e302fd82e6a7 req-6acf12d8-3b2a-430b-b784-3a2d61b06789 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:38.904695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:38.914839 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-0437e0fa-f296-4e6f-9f6d-e302fd82e6a7 req-6acf12d8-3b2a-430b-b784-3a2d61b06789 service nova] Creating event network-changed:4d92ea17-9c3c-44e6-8cae-6ef668d7db95 for instance a41dd4d0-6814-4834-bbc6-aa66fff3942f on n-h1-860864-3 Oct 11 20:19:38.920261 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-0437e0fa-f296-4e6f-9f6d-e302fd82e6a7 req-6acf12d8-3b2a-430b-b784-3a2d61b06789 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043827 Oct 11 20:19:38.922040 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2906/5773] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:19:38.981716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-80a64310-02fc-4365-99c7-5462b854d486 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:38.982348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-80a64310-02fc-4365-99c7-5462b854d486 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:38.995918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80a64310-02fc-4365-99c7-5462b854d486 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:38.996656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80a64310-02fc-4365-99c7-5462b854d486 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:38.997481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80a64310-02fc-4365-99c7-5462b854d486 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:38.998362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80a64310-02fc-4365-99c7-5462b854d486 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:38.998943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80a64310-02fc-4365-99c7-5462b854d486 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:39.003576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80a64310-02fc-4365-99c7-5462b854d486 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:39.283473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-80a64310-02fc-4365-99c7-5462b854d486 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:39.316248 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-80a64310-02fc-4365-99c7-5462b854d486 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1318 microversion: 2.1 time: 0.338802 Oct 11 20:19:39.318912 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2868/5774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:38 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:40.340781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-22ddc64a-346e-4e2f-b27e-14046aa111eb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:40.342213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-22ddc64a-346e-4e2f-b27e-14046aa111eb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:40.359691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22ddc64a-346e-4e2f-b27e-14046aa111eb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:40.362390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22ddc64a-346e-4e2f-b27e-14046aa111eb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:40.363859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22ddc64a-346e-4e2f-b27e-14046aa111eb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:40.364667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22ddc64a-346e-4e2f-b27e-14046aa111eb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:40.366333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22ddc64a-346e-4e2f-b27e-14046aa111eb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:40.367668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22ddc64a-346e-4e2f-b27e-14046aa111eb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:40.705993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-22ddc64a-346e-4e2f-b27e-14046aa111eb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:40.730653 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-22ddc64a-346e-4e2f-b27e-14046aa111eb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1318 microversion: 2.1 time: 0.391835 Oct 11 20:19:40.731300 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2907/5775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:40 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:41.607842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-697166b4-5e6f-4313-b8f2-14b155960a1c req-74f2a5f2-f19f-488b-8c24-0f95cc628da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6514d0-68d1-4a81-aadf-c87a122d0531", "tag": "70e9f4bf-358b-49b4-a779-d87851017a93"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:41.629785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-697166b4-5e6f-4313-b8f2-14b155960a1c req-74f2a5f2-f19f-488b-8c24-0f95cc628da5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:41.630275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-697166b4-5e6f-4313-b8f2-14b155960a1c req-74f2a5f2-f19f-488b-8c24-0f95cc628da5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:41.630739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-697166b4-5e6f-4313-b8f2-14b155960a1c req-74f2a5f2-f19f-488b-8c24-0f95cc628da5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:41.645052 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-697166b4-5e6f-4313-b8f2-14b155960a1c req-74f2a5f2-f19f-488b-8c24-0f95cc628da5 service nova] Creating event network-changed:70e9f4bf-358b-49b4-a779-d87851017a93 for instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 on n-h2-860864-3 Oct 11 20:19:41.654618 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-697166b4-5e6f-4313-b8f2-14b155960a1c req-74f2a5f2-f19f-488b-8c24-0f95cc628da5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.426214 Oct 11 20:19:41.656447 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2869/5776] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:19:41.754010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-05fe2d8f-7346-48e3-a656-2f84abd62cb5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:41.755256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-05fe2d8f-7346-48e3-a656-2f84abd62cb5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:41.765423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05fe2d8f-7346-48e3-a656-2f84abd62cb5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:41.766213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05fe2d8f-7346-48e3-a656-2f84abd62cb5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:41.767491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05fe2d8f-7346-48e3-a656-2f84abd62cb5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:41.768448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05fe2d8f-7346-48e3-a656-2f84abd62cb5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:41.769119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05fe2d8f-7346-48e3-a656-2f84abd62cb5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:41.769841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-05fe2d8f-7346-48e3-a656-2f84abd62cb5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:41.976881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-05fe2d8f-7346-48e3-a656-2f84abd62cb5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:41.985623 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-05fe2d8f-7346-48e3-a656-2f84abd62cb5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1318 microversion: 2.1 time: 0.235772 Oct 11 20:19:41.986216 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2908/5777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:41 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:43.009365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-73dadb4c-6a11-4c15-9221-1658870e0b0c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:43.010086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-73dadb4c-6a11-4c15-9221-1658870e0b0c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:43.018426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73dadb4c-6a11-4c15-9221-1658870e0b0c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:43.019461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73dadb4c-6a11-4c15-9221-1658870e0b0c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:43.027304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73dadb4c-6a11-4c15-9221-1658870e0b0c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:43.028557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73dadb4c-6a11-4c15-9221-1658870e0b0c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:43.029668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73dadb4c-6a11-4c15-9221-1658870e0b0c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:43.030426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-73dadb4c-6a11-4c15-9221-1658870e0b0c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:43.234455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-73dadb4c-6a11-4c15-9221-1658870e0b0c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:43.246291 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-73dadb4c-6a11-4c15-9221-1658870e0b0c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1318 microversion: 2.1 time: 0.240882 Oct 11 20:19:43.247935 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2870/5778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:43 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:43.468420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8cbc3263-bb9e-4ace-98a2-d059f59a5f0b req-5452342f-3fac-4bda-93da-cb7bf7315d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6514d0-68d1-4a81-aadf-c87a122d0531", "tag": "70e9f4bf-358b-49b4-a779-d87851017a93"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:43.491999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8cbc3263-bb9e-4ace-98a2-d059f59a5f0b req-5452342f-3fac-4bda-93da-cb7bf7315d7a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:43.492874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8cbc3263-bb9e-4ace-98a2-d059f59a5f0b req-5452342f-3fac-4bda-93da-cb7bf7315d7a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:43.493523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8cbc3263-bb9e-4ace-98a2-d059f59a5f0b req-5452342f-3fac-4bda-93da-cb7bf7315d7a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:43.526616 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8cbc3263-bb9e-4ace-98a2-d059f59a5f0b req-5452342f-3fac-4bda-93da-cb7bf7315d7a service nova] Creating event network-changed:70e9f4bf-358b-49b4-a779-d87851017a93 for instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 on n-h2-860864-3 Oct 11 20:19:43.537232 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8cbc3263-bb9e-4ace-98a2-d059f59a5f0b req-5452342f-3fac-4bda-93da-cb7bf7315d7a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071809 Oct 11 20:19:43.539350 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2909/5779] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:19:44.272998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-46a222fc-a3ed-49ad-b0aa-b1ea631c10d5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:44.274191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-46a222fc-a3ed-49ad-b0aa-b1ea631c10d5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:44.282708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46a222fc-a3ed-49ad-b0aa-b1ea631c10d5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:44.283438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46a222fc-a3ed-49ad-b0aa-b1ea631c10d5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:44.284663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46a222fc-a3ed-49ad-b0aa-b1ea631c10d5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:44.285563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46a222fc-a3ed-49ad-b0aa-b1ea631c10d5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:44.286484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46a222fc-a3ed-49ad-b0aa-b1ea631c10d5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:44.287285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-46a222fc-a3ed-49ad-b0aa-b1ea631c10d5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:44.528476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-46a222fc-a3ed-49ad-b0aa-b1ea631c10d5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:44.540131 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-46a222fc-a3ed-49ad-b0aa-b1ea631c10d5 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1318 microversion: 2.1 time: 0.272098 Oct 11 20:19:44.541202 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2871/5780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:44 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:45.418500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-0f688ad6-b7a3-45bf-a4c6-3e9a7aad978c req-e0eeb961-1126-40bc-a66d-9c1a56377ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41dd4d0-6814-4834-bbc6-aa66fff3942f", "name": "network-vif-plugged", "status": "completed", "tag": "4d92ea17-9c3c-44e6-8cae-6ef668d7db95"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:45.434188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:45.438768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:45.450011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0f688ad6-b7a3-45bf-a4c6-3e9a7aad978c req-e0eeb961-1126-40bc-a66d-9c1a56377ad6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:45.450900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0f688ad6-b7a3-45bf-a4c6-3e9a7aad978c req-e0eeb961-1126-40bc-a66d-9c1a56377ad6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:45.451633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0f688ad6-b7a3-45bf-a4c6-3e9a7aad978c req-e0eeb961-1126-40bc-a66d-9c1a56377ad6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:45.489855 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-0f688ad6-b7a3-45bf-a4c6-3e9a7aad978c req-e0eeb961-1126-40bc-a66d-9c1a56377ad6 service nova] Creating event network-vif-plugged:4d92ea17-9c3c-44e6-8cae-6ef668d7db95 for instance a41dd4d0-6814-4834-bbc6-aa66fff3942f on n-h1-860864-3 Oct 11 20:19:45.504136 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-0f688ad6-b7a3-45bf-a4c6-3e9a7aad978c req-e0eeb961-1126-40bc-a66d-9c1a56377ad6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093197 Oct 11 20:19:45.507334 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2910/5781] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:19:45.567851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-461bca19-72b4-4313-9f3d-7cb869615fce req-b0815046-8af5-48b5-b824-669a88512811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6514d0-68d1-4a81-aadf-c87a122d0531", "tag": "70e9f4bf-358b-49b4-a779-d87851017a93"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:45.582450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c848f40f-4395-4e6c-a3fd-2f7011df6309 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:45.585520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c848f40f-4395-4e6c-a3fd-2f7011df6309 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:45.593635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:45.599010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-461bca19-72b4-4313-9f3d-7cb869615fce req-b0815046-8af5-48b5-b824-669a88512811 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:45.600045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-461bca19-72b4-4313-9f3d-7cb869615fce req-b0815046-8af5-48b5-b824-669a88512811 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:45.600756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-461bca19-72b4-4313-9f3d-7cb869615fce req-b0815046-8af5-48b5-b824-669a88512811 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:45.614166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c848f40f-4395-4e6c-a3fd-2f7011df6309 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:45.615138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c848f40f-4395-4e6c-a3fd-2f7011df6309 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:45.616201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c848f40f-4395-4e6c-a3fd-2f7011df6309 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:45.617283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c848f40f-4395-4e6c-a3fd-2f7011df6309 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:45.617907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c848f40f-4395-4e6c-a3fd-2f7011df6309 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:45.618441 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-461bca19-72b4-4313-9f3d-7cb869615fce req-b0815046-8af5-48b5-b824-669a88512811 service nova] Creating event network-changed:70e9f4bf-358b-49b4-a779-d87851017a93 for instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 on n-h2-860864-3 Oct 11 20:19:45.618736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c848f40f-4395-4e6c-a3fd-2f7011df6309 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:45.625419 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-461bca19-72b4-4313-9f3d-7cb869615fce req-b0815046-8af5-48b5-b824-669a88512811 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064448 Oct 11 20:19:45.627181 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2911/5782] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:19:45.957634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c848f40f-4395-4e6c-a3fd-2f7011df6309 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:45.970700 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c848f40f-4395-4e6c-a3fd-2f7011df6309 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1318 microversion: 2.1 time: 0.409839 Oct 11 20:19:45.972125 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2872/5783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:45 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:46.996824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-343a548c-84dd-4634-8406-8d0fa66d6ac3 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:46.997569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-343a548c-84dd-4634-8406-8d0fa66d6ac3 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:47.014707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-343a548c-84dd-4634-8406-8d0fa66d6ac3 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:47.016718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-343a548c-84dd-4634-8406-8d0fa66d6ac3 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:47.023157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-343a548c-84dd-4634-8406-8d0fa66d6ac3 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:47.025073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-343a548c-84dd-4634-8406-8d0fa66d6ac3 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:47.026259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-343a548c-84dd-4634-8406-8d0fa66d6ac3 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:47.031968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-343a548c-84dd-4634-8406-8d0fa66d6ac3 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:47.348648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-343a548c-84dd-4634-8406-8d0fa66d6ac3 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:47.362208 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-343a548c-84dd-4634-8406-8d0fa66d6ac3 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1506 microversion: 2.1 time: 0.370864 Oct 11 20:19:47.362849 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2912/5784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:19:46 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:49.323380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-183486829", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "06025fda-f20d-4c12-980a-e481b0c34f93"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:49.396917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] validate_networks() for [('06025fda-f20d-4c12-980a-e481b0c34f93', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:19:49.857063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:19:49.857618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:19:49.858218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:19:49.858724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:19:49.859216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:19:49.869469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:49.869974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:49.870471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:49.871445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:49.872269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:49.872844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:49.893230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Getting quotas for project 6cb25bbf8fa04b6abc18725111add072. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:19:49.898681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Getting quotas for user d797e17e31144a6da6bf282a36486d38 and project 6cb25bbf8fa04b6abc18725111add072. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:19:49.911960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:19:49.914217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:19:49.962015 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11adee16-2c76-4dfb-a0f6-739b58183d2c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.826609 Oct 11 20:19:49.969200 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2873/5785] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 11 20:19:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 20:19:49.974817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8c862f0e-a92f-490b-aad7-4a1a6db4006f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:49.980815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8c862f0e-a92f-490b-aad7-4a1a6db4006f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:50.082575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c862f0e-a92f-490b-aad7-4a1a6db4006f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:50.090664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c862f0e-a92f-490b-aad7-4a1a6db4006f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:50.097263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c862f0e-a92f-490b-aad7-4a1a6db4006f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:50.099686 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8c862f0e-a92f-490b-aad7-4a1a6db4006f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1261 microversion: 2.26 time: 0.128842 Oct 11 20:19:50.110650 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2913/5786] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:49 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1261 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:19:51.128026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:51.129333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:51.136359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:51.136548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:51.136982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:51.139915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:51.140420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:51.140870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:51.225944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:51.272450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:51.275246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:51.276925 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-99a39f11-6519-4515-aedc-90cf0aac0d16 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1313 microversion: 2.26 time: 0.154609 Oct 11 20:19:51.278069 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2874/5787] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:51 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:19:52.305972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:52.307219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:52.325232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:52.331503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:52.332648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:52.340903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:52.347188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:52.347961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:52.593555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:52.603022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:52.606112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:52.608286 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e4c5afc-abb3-4608-8fac-2fe29973e168 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1361 microversion: 2.26 time: 0.305830 Oct 11 20:19:52.609085 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2914/5788] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:52 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:19:53.465791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b47918d0-2f78-41c8-aa9b-3736d6a482a2 req-076c2486-82ec-4451-b441-801ab7650cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "589aeec4-06af-409f-a8fa-fba299c704ba", "tag": "16b1522f-dcac-4492-a764-5f268440af03"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:53.502095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:53.519018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b47918d0-2f78-41c8-aa9b-3736d6a482a2 req-076c2486-82ec-4451-b441-801ab7650cd0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:53.522590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b47918d0-2f78-41c8-aa9b-3736d6a482a2 req-076c2486-82ec-4451-b441-801ab7650cd0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:53.524619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b47918d0-2f78-41c8-aa9b-3736d6a482a2 req-076c2486-82ec-4451-b441-801ab7650cd0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:53.550024 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b47918d0-2f78-41c8-aa9b-3736d6a482a2 req-076c2486-82ec-4451-b441-801ab7650cd0 service nova] Creating event network-changed:16b1522f-dcac-4492-a764-5f268440af03 for instance 589aeec4-06af-409f-a8fa-fba299c704ba on n-h2-860864-3 Oct 11 20:19:53.565889 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b47918d0-2f78-41c8-aa9b-3736d6a482a2 req-076c2486-82ec-4451-b441-801ab7650cd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105040 Oct 11 20:19:53.567889 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2875/5789] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:19:53.637815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:53.638465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:53.645338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:53.666141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:53.666676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:53.667127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:53.667854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:53.668318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:53.668748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:53.870883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:53.882487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:53.885175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:53.889631 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ca13362b-9c69-4592-87df-02ed6d575a79 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1361 microversion: 2.26 time: 0.257548 Oct 11 20:19:53.891061 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2915/5790] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:53 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:19:54.918132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:54.919274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:54.929864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:54.930619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:54.931085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:54.932100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:54.932779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:54.933509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:55.179956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:55.203487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:55.211636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:55.215615 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3645eac2-97a1-475a-9c38-7403b1c71224 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1361 microversion: 2.26 time: 0.302779 Oct 11 20:19:55.218828 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2876/5791] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:54 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:19:56.243676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:56.244299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:56.251360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:56.252443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:56.252443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:56.252988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:56.253550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:56.253976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:56.397363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:56.406643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:56.408557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:56.409744 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-510e700e-e352-4d6a-8122-20c23af28240 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1361 microversion: 2.26 time: 0.170194 Oct 11 20:19:56.410319 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2916/5792] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:56 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 20:19:57.332235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-3703a741-b855-4cd0-abd9-97f7fd498959 req-4bbd720a-5098-4845-a1cb-ed586747646d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589aeec4-06af-409f-a8fa-fba299c704ba", "name": "network-vif-plugged", "status": "completed", "tag": "16b1522f-dcac-4492-a764-5f268440af03"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:19:57.348862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3703a741-b855-4cd0-abd9-97f7fd498959 req-4bbd720a-5098-4845-a1cb-ed586747646d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:57.349732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3703a741-b855-4cd0-abd9-97f7fd498959 req-4bbd720a-5098-4845-a1cb-ed586747646d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:57.350388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3703a741-b855-4cd0-abd9-97f7fd498959 req-4bbd720a-5098-4845-a1cb-ed586747646d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:57.367672 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-3703a741-b855-4cd0-abd9-97f7fd498959 req-4bbd720a-5098-4845-a1cb-ed586747646d service nova] Creating event network-vif-plugged:16b1522f-dcac-4492-a764-5f268440af03 for instance 589aeec4-06af-409f-a8fa-fba299c704ba on n-h2-860864-3 Oct 11 20:19:57.373356 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-3703a741-b855-4cd0-abd9-97f7fd498959 req-4bbd720a-5098-4845-a1cb-ed586747646d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044637 Oct 11 20:19:57.374842 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2877/5793] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:19:57.438452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:57.439652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:57.449067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:57.449562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:57.450288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:57.451412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:57.451987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:57.452413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:57.609881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:57.624331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:57.625905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:57.627071 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f619be85-4f11-4f67-b9b0-1b4085175eef tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1361 microversion: 2.26 time: 0.193784 Oct 11 20:19:57.627651 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2917/5794] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:57 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:19:58.656585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:58.659660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:58.677579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:58.680523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:58.681338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:58.682485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:58.683111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:58.683555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:58.859280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:58.868912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:58.870429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:19:58.871662 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9e7be0ec-b6b4-466b-9d89-d7a93444e448 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1544 microversion: 2.26 time: 0.221816 Oct 11 20:19:58.872443 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2878/5795] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:19:58 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1544 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:19:58.899108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c710df70>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:58.909958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:58.910777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:58.911227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:58.911716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:58.918274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:58.919049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:58.919727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:58.920623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:58.921392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:58.922018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:58.952864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:58.953450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:58.953972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:58.968132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:58.968621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:58.969093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:58.999609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:19:59.045390 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a7000080-8635-45a3-ac41-ed584d3cf933 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-974567338" status: 201 len: 0 microversion: 2.26 time: 0.150288 Oct 11 20:19:59.046327 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2918/5796] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Oct 11 20:19:58 2022] PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-974567338 => generated 0 bytes in 152 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 11 20:19:59.058041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8d352b79-11dc-44ea-9ebb-a0475220419f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c703caf0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.071996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d352b79-11dc-44ea-9ebb-a0475220419f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.073671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d352b79-11dc-44ea-9ebb-a0475220419f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.083716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d352b79-11dc-44ea-9ebb-a0475220419f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.105284 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8d352b79-11dc-44ea-9ebb-a0475220419f tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-974567338" status: 204 len: 0 microversion: 2.26 time: 0.052842 Oct 11 20:19:59.106206 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2879/5797] 10.222.0.27 () {60 vars in 1358 bytes} [Tue Oct 11 20:19:59 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-974567338 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:19:59.116449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83d07a3820>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.126123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.126651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.127093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.127598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:59.134564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.135124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.135758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.136618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.137220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.137793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.167188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.167908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.168417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.186053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:19:59.203037 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8bab805d-e8a6-4ed0-9fbc-cd35d9c20b73 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 204 len: 0 microversion: 2.26 time: 0.092169 Oct 11 20:19:59.208761 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2919/5798] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Oct 11 20:19:59 2022] DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:19:59.217131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b2f14ffc-c984-4036-8651-5c2805c3e8b3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c72a7e50>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.227754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2f14ffc-c984-4036-8651-5c2805c3e8b3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.228245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2f14ffc-c984-4036-8651-5c2805c3e8b3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.228683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2f14ffc-c984-4036-8651-5c2805c3e8b3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.241589 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b2f14ffc-c984-4036-8651-5c2805c3e8b3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 200 len: 12 microversion: 2.26 time: 0.030860 Oct 11 20:19:59.247468 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2880/5799] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 11 20:19:59 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:19:59.257269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83cca18f70>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.273979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.274830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.275457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.276131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:59.287071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.287676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.288112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.289199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.289891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.292740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.323932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.324522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.325042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.342004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.343701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.343833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.370045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:19:59.389203 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5f4f2864-080d-45f5-bf1e-d8379b783088 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-807467646" status: 201 len: 0 microversion: 2.26 time: 0.139347 Oct 11 20:19:59.389963 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2920/5800] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Oct 11 20:19:59 2022] PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-807467646 => generated 0 bytes in 142 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 11 20:19:59.400186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5ba173d6-cf1c-4d84-bf33-a5f920374f90 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c703cf70>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.409857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ba173d6-cf1c-4d84-bf33-a5f920374f90 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.410348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ba173d6-cf1c-4d84-bf33-a5f920374f90 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.410866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ba173d6-cf1c-4d84-bf33-a5f920374f90 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.422748 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5ba173d6-cf1c-4d84-bf33-a5f920374f90 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 200 len: 35 microversion: 2.26 time: 0.026520 Oct 11 20:19:59.423384 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2881/5801] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 11 20:19:59 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 35 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:19:59.434515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83ccba8b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.444208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.444818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.445266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.445872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:59.453295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.453787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.454228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.454999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.455466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.455896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.480290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.480780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.481216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.499273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:59.510924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:19:59.528974 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-22c49c9b-289c-4814-be77-23e087b07d21 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-807467646" status: 204 len: 0 microversion: 2.26 time: 0.098664 Oct 11 20:19:59.534068 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2921/5802] 10.222.0.27 () {60 vars in 1361 bytes} [Tue Oct 11 20:19:59 2022] DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-807467646 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:19:59.540396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d3d6934e-8481-4015-baa5-d9773d1d9a3a tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c703c280>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.551755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3d6934e-8481-4015-baa5-d9773d1d9a3a tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.552339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3d6934e-8481-4015-baa5-d9773d1d9a3a tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.552995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d3d6934e-8481-4015-baa5-d9773d1d9a3a tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.564129 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d3d6934e-8481-4015-baa5-d9773d1d9a3a tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 200 len: 12 microversion: 2.26 time: 0.028523 Oct 11 20:19:59.564972 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2882/5803] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 11 20:19:59 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 12 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:19:59.575550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83cc2cd280>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.585790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.586571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.587018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.587498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:59.594244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.594754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.595191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.597034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.597559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.597988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.622310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.623464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.624018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.638176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:19:59.655566 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f95f514-e2d1-4885-a305-4bc539de2c46 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 204 len: 0 microversion: 2.26 time: 0.083712 Oct 11 20:19:59.659524 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2922/5804] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Oct 11 20:19:59 2022] DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:19:59.665212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c703c5e0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.676786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.677333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.677853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.678349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:59.684673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.685976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.688165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.688927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.689399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.689831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.719856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.720546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.720985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.730760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:59.735724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.736368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.736981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.765594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:19:59.784049 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c56e64b5-d48c-4c23-81e3-bf810d57f6a3 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-493721471" status: 201 len: 0 microversion: 2.26 time: 0.122325 Oct 11 20:19:59.789152 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2883/5805] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Oct 11 20:19:59 2022] PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-493721471 => generated 0 bytes in 124 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 11 20:19:59.794935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83ccc938b0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.808174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.808843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.809398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.810036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:59.817718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.818260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.818828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.819629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.820205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.820719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.849569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.850171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.850719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.860832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.861394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.861914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.885582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:19:59.902401 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3f066306-5fbf-49dd-897a-9def9f58fbcc tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-640325397" status: 201 len: 0 microversion: 2.26 time: 0.111830 Oct 11 20:19:59.903490 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2923/5806] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Oct 11 20:19:59 2022] PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-640325397 => generated 0 bytes in 114 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 11 20:19:59.910067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:59.910880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:19:59.915390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83cc102c10>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:19:59.925337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.927741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.927741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.927741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:19:59.933247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.933935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.934504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.936247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.936814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.937475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.962953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:19:59.963546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:19:59.963983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:19:59.978403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:19:59.994646 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5116d168-20be-4f23-a12f-fead0cf2b6c2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 204 len: 0 microversion: 2.26 time: 0.085115 Oct 11 20:19:59.995830 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2884/5807] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Oct 11 20:19:59 2022] DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 20:20:00.006358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e44fc26b-3762-462e-a47f-367c98a3aae4 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c73b0ca0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:00.017500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e44fc26b-3762-462e-a47f-367c98a3aae4 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.018511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e44fc26b-3762-462e-a47f-367c98a3aae4 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.019328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e44fc26b-3762-462e-a47f-367c98a3aae4 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.028983 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e44fc26b-3762-462e-a47f-367c98a3aae4 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 200 len: 12 microversion: 2.26 time: 0.027971 Oct 11 20:20:00.029753 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2924/5808] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 11 20:19:59 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:00.043090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c700de50>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:00.052221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.052629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.053127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.053595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:00.059617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.060293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.060741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.061596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.062055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.062485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.095350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.095972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.096480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.115380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:20:00.137088 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-345a5bdb-aad6-45cd-b709-d4c38b516636 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 204 len: 0 microversion: 2.26 time: 0.098584 Oct 11 20:20:00.137971 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2885/5809] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Oct 11 20:20:00 2022] DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:20:00.148046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c7444670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:00.151681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:20:00.161565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.162337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.163050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.163535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:00.169356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.170357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.170837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.171509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.171964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.172383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.200508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.201076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.201517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.211094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.211586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.212024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.239182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:20:00.259563 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae56f02f-aef7-4410-9316-f9b8c414ef29 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-1178095191" status: 201 len: 0 microversion: 2.26 time: 0.116296 Oct 11 20:20:00.260380 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2925/5810] 10.222.0.27 () {62 vars in 1380 bytes} [Tue Oct 11 20:20:00 2022] PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-1178095191 => generated 0 bytes in 118 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 11 20:20:00.270394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c7035ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:00.287517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.288368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.288891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.289453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:00.297263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.297883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.298710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.299486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.300045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.300545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.330016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.330659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.331184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.342886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.343409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.343844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.367557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:20:00.383697 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ba81984e-3c43-4832-a590-d8b759d622f0 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-2000873652" status: 201 len: 0 microversion: 2.26 time: 0.117299 Oct 11 20:20:00.384572 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2886/5811] 10.222.0.27 () {62 vars in 1380 bytes} [Tue Oct 11 20:20:00 2022] PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags/tempest-tag-2000873652 => generated 0 bytes in 119 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 11 20:20:00.395821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Action: 'update_all', calling method: .version_select at 0x7f83cc328f70>, body: {"tags": ["tempest-tag-449316431", "tempest-tag-1946862040"]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:20:00.406449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.406929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.407365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.407835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:00.414092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.414658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.415097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.415779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.416229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.416649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.443674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.444535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.445167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.468253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:20:00.490940 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-70ead3d0-5ae2-496a-ac03-eefa9a983a59 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 200 len: 61 microversion: 2.26 time: 0.100821 Oct 11 20:20:00.491776 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2926/5812] 10.222.0.27 () {62 vars in 1312 bytes} [Tue Oct 11 20:20:00 2022] PUT /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 61 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:00.502324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5bd43c03-58d4-4f4a-bcb8-90dcfd239015 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83c7246310>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:00.511001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bd43c03-58d4-4f4a-bcb8-90dcfd239015 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.511571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bd43c03-58d4-4f4a-bcb8-90dcfd239015 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.512095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bd43c03-58d4-4f4a-bcb8-90dcfd239015 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.522075 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5bd43c03-58d4-4f4a-bcb8-90dcfd239015 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 200 len: 61 microversion: 2.26 time: 0.023793 Oct 11 20:20:00.528069 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2887/5813] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 11 20:20:00 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 61 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:00.534860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '.version_select at 0x7f83cc2f8a60>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:00.545923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.546697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.547330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.547809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:00.554773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.555258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.558154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.558967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.559534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.559966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.585374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.586407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.586961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.617820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'flavor' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:20:00.636193 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d798c0bd-0aa2-4791-939f-99d8553b7606 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags" status: 204 len: 0 microversion: 2.26 time: 0.106737 Oct 11 20:20:00.637409 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2927/5814] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Oct 11 20:20:00 2022] DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba/tags => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 20:20:00.648056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2ca13012-23bd-4b71-a197-5b6d81226623 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:00.648654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2ca13012-23bd-4b71-a197-5b6d81226623 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:00.655447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ca13012-23bd-4b71-a197-5b6d81226623 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.655936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ca13012-23bd-4b71-a197-5b6d81226623 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.656373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ca13012-23bd-4b71-a197-5b6d81226623 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.657128 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ca13012-23bd-4b71-a197-5b6d81226623 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.657591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ca13012-23bd-4b71-a197-5b6d81226623 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.658012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ca13012-23bd-4b71-a197-5b6d81226623 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.690336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2ca13012-23bd-4b71-a197-5b6d81226623 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:20:00.787234 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2ca13012-23bd-4b71-a197-5b6d81226623 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 204 len: 0 microversion: 2.26 time: 0.142567 Oct 11 20:20:00.789548 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2888/5815] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 11 20:20:00 2022] DELETE /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 20:20:00.798698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:00.799281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:00.808062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.808848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.809513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.810850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:00.811381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:00.811876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:00.959654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:00.971200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:00.973007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:00.974226 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-57fd7264-3fc3-4917-88f0-e1ae07c04ac2 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1550 microversion: 2.26 time: 0.181339 Oct 11 20:20:00.975163 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2928/5816] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:20:00 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:20:02.001366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:02.002244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:02.009382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:02.009915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:02.010355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:02.011174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:02.011640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:02.012069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:02.161030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:02.170514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:02.172248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:02.173847 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c6479d60-106a-4946-8017-b64258a1a282 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1550 microversion: 2.26 time: 0.176886 Oct 11 20:20:02.179095 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2889/5817] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:20:01 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:20:02.906999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-71e581d4-0626-4325-81cd-fc872053b692 req-44efc49b-c871-44d7-a37a-ef2f97e405d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "589aeec4-06af-409f-a8fa-fba299c704ba", "name": "network-vif-deleted", "tag": "16b1522f-dcac-4492-a764-5f268440af03"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:20:02.917831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-71e581d4-0626-4325-81cd-fc872053b692 req-44efc49b-c871-44d7-a37a-ef2f97e405d0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:02.918316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-71e581d4-0626-4325-81cd-fc872053b692 req-44efc49b-c871-44d7-a37a-ef2f97e405d0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:02.918938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-71e581d4-0626-4325-81cd-fc872053b692 req-44efc49b-c871-44d7-a37a-ef2f97e405d0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:02.936963 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-71e581d4-0626-4325-81cd-fc872053b692 req-44efc49b-c871-44d7-a37a-ef2f97e405d0 service nova] Creating event network-vif-deleted:16b1522f-dcac-4492-a764-5f268440af03 for instance 589aeec4-06af-409f-a8fa-fba299c704ba on n-h2-860864-3 Oct 11 20:20:02.942796 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-71e581d4-0626-4325-81cd-fc872053b692 req-44efc49b-c871-44d7-a37a-ef2f97e405d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206416 Oct 11 20:20:02.944057 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2929/5818] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:03.200049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:03.201432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:03.208493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:03.208985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:03.209497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:03.210377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:03.210866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:03.211318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:03.245324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:03.245955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:03.246502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:03.247186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lazy-loading 'fault' on Instance uuid 589aeec4-06af-409f-a8fa-fba299c704ba {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:20:03.293817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:03.313859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:03.315381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd797e17e31144a6da6bf282a36486d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb25bbf8fa04b6abc18725111add072', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:03.316586 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eefa79b6-a032-4aee-b21d-7afaa13a9fb7 tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 200 len: 1351 microversion: 2.26 time: 0.120934 Oct 11 20:20:03.317146 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2890/5819] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:20:03 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 1351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 20:20:04.345709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:04.346417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] [instance: 589aeec4-06af-409f-a8fa-fba299c704ba] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:04.363419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:04.364035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:04.364580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:04.365546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:04.366425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:04.367805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:04.386188 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] HTTP exception thrown: Instance 589aeec4-06af-409f-a8fa-fba299c704ba could not be found. Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Request method failure captured: Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba HTTP/1.1 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRc_kJ6xxPWQiRW8h6mM_-vfpiwYyoAQStn0oQTNuzYl2y5AiFaD0fLFtys6EXOiFNc-ZrzFpYiuesa-s1cudWhVvZu3sxkDv7IvFfpnETB1AC3I8IqhgS0eiOmhY_Fz7Xc0VxwwJYyHvftz8NeJk73C7gj_8F8gPq5XTqTVODEnuV1k Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Openstack-Nova-Api-Version: 2.26 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 6cb25bbf8fa04b6abc18725111add072 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerTagsTestJSON-1037126350 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6cb25bbf8fa04b6abc18725111add072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6cb25bbf8fa04b6abc18725111add072", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cb25bbf8fa04b6abc18725111add072"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cb25bbf8fa04b6abc18725111add072"}]}] Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerTagsTestJSON-1037126350 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 6cb25bbf8fa04b6abc18725111add072 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerTagsTestJSON-1037126350 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerTagsTestJSON-1037126350-project Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d797e17e31144a6da6bf282a36486d38 Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerTagsTestJSON-1037126350-project Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 589aeec4-06af-409f-a8fa-fba299c704ba could not be found. Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '589aeec4-06af-409f-a8fa-fba299c704ba'} Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 589aeec4-06af-409f-a8fa-fba299c704ba could not be found. Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 589aeec4-06af-409f-a8fa-fba299c704ba could not be found. Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:04.389323 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:04.393456 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:04.393456 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:04.393456 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:04.393456 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:20:04.393456 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:20:04.393456 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 589aeec4-06af-409f-a8fa-fba299c704ba could not be found. Oct 11 20:20:04.393456 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:04.393456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] Returning 404 to user: Instance 589aeec4-06af-409f-a8fa-fba299c704ba could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:20:04.393456 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-62462ef6-452d-425c-a5c0-a2df5ceeb52c tempest-ServerTagsTestJSON-1037126350 tempest-ServerTagsTestJSON-1037126350-project] 10.222.0.27 "GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba" status: 404 len: 111 microversion: 2.26 time: 0.052346 Oct 11 20:20:04.393456 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2930/5820] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 11 20:20:04 2022] GET /compute/v2.1/servers/589aeec4-06af-409f-a8fa-fba299c704ba => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:20:09.874388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cba6f9ab-3748-4071-bdb7-fbcf158c96fb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ae36dc7-995c-44e2-b9b4-cc101400a2ad", "device": "/dev/sdb"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:20:09.876957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cba6f9ab-3748-4071-bdb7-fbcf158c96fb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:09.884784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cba6f9ab-3748-4071-bdb7-fbcf158c96fb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:09.885267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cba6f9ab-3748-4071-bdb7-fbcf158c96fb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:09.885908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cba6f9ab-3748-4071-bdb7-fbcf158c96fb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:09.886700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cba6f9ab-3748-4071-bdb7-fbcf158c96fb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:09.887153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cba6f9ab-3748-4071-bdb7-fbcf158c96fb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:09.888094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cba6f9ab-3748-4071-bdb7-fbcf158c96fb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:10.183008 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cba6f9ab-3748-4071-bdb7-fbcf158c96fb tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "POST /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312638 Oct 11 20:20:10.184435 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2891/5821] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:20:09 2022] POST /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:10.399277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0880e678-d31a-4580-9d2b-3dabbb5dcf4d tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Action: 'create', calling method: .version_select at 0x7f83cc3280d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1092974851"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:20:10.779986 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0880e678-d31a-4580-9d2b-3dabbb5dcf4d tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.575740 Oct 11 20:20:10.780608 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2931/5822] 10.222.0.27 () {60 vars in 1155 bytes} [Tue Oct 11 20:20:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 577 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 11 20:20:10.794512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-00a1da25-02ba-4c79-9b9c-97f87dbe7f2e tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c7021700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:10.848855 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-00a1da25-02ba-4c79-9b9c-97f87dbe7f2e tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a" status: 200 len: 345 microversion: 2.1 time: 0.058894 Oct 11 20:20:10.849519 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2892/5823] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:10 2022] GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:11.864348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d5b7e89b-ba4d-40db-b580-a8c753c55254 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83cc4d6670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:11.920127 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d5b7e89b-ba4d-40db-b580-a8c753c55254 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a" status: 200 len: 346 microversion: 2.1 time: 0.060390 Oct 11 20:20:11.920745 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2932/5824] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:11 2022] GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:11.936345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f15fa55-2257-4082-b37c-67b486695668 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Action: 'create', calling method: .version_select at 0x7f83c6f98430>, body: {"snapshot": {"volume_id": "18adeebc-c75d-4481-ba76-2d6a1a71949a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-609650994"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:20:12.105607 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f15fa55-2257-4082-b37c-67b486695668 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.175201 Oct 11 20:20:12.106362 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2893/5825] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Oct 11 20:20:11 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:12.117565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-76ca6656-c7f0-488c-b7a3-e40b69fe6d2c tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c7370ca0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:12.157843 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-76ca6656-c7f0-488c-b7a3-e40b69fe6d2c tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4" status: 200 len: 286 microversion: 2.1 time: 0.043880 Oct 11 20:20:12.169822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32f9a520-6a4a-41aa-a5ec-f1e587fcbe05 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c6fc9b80>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:12.170346 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2933/5826] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 20:20:12 2022] GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:12.206105 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-32f9a520-6a4a-41aa-a5ec-f1e587fcbe05 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.040407 Oct 11 20:20:12.206724 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2894/5827] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 11 20:20:12 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:12.219263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e2b28636-7fcf-4bbf-981f-7f0df85b20a2 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c7333b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:12.256876 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e2b28636-7fcf-4bbf-981f-7f0df85b20a2 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4" status: 200 len: 286 microversion: 2.1 time: 0.042752 Oct 11 20:20:12.258354 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2934/5828] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 20:20:12 2022] GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:13.270171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9565e137-fc4b-4cd9-ad8c-890005067d12 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c6fa2550>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:13.307345 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9565e137-fc4b-4cd9-ad8c-890005067d12 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4" status: 200 len: 286 microversion: 2.1 time: 0.041758 Oct 11 20:20:13.313650 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2895/5829] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 20:20:13 2022] GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:14.321855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-59640847-394f-4ab0-b62c-1270d66a0919 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83d06918b0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:14.353773 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-59640847-394f-4ab0-b62c-1270d66a0919 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4" status: 200 len: 287 microversion: 2.1 time: 0.036696 Oct 11 20:20:14.354568 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2935/5830] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 20:20:14 2022] GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:14.366670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d7ea082b-fe25-461c-99d8-b49ef283e82e tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c6f98670>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:14.446698 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d7ea082b-fe25-461c-99d8-b49ef283e82e tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4" status: 202 len: 0 microversion: 2.1 time: 0.084646 Oct 11 20:20:14.447500 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2896/5831] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 11 20:20:14 2022] DELETE /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:20:14.458010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1523d0ce-e4d4-4d1c-9455-41306ffeda25 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83ccb88670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:14.467023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=49 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:20:14.478980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=71,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:20:14.516604 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1523d0ce-e4d4-4d1c-9455-41306ffeda25 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4" status: 200 len: 286 microversion: 2.1 time: 0.063914 Oct 11 20:20:14.517907 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2936/5832] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 20:20:14 2022] GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:15.531321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-433e3be4-5c1a-4f04-bf08-071c7cd52341 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c6fa2ee0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:15.566458 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-433e3be4-5c1a-4f04-bf08-071c7cd52341 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4" status: 200 len: 286 microversion: 2.1 time: 0.040666 Oct 11 20:20:15.572261 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2897/5833] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 20:20:15 2022] GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:16.581400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77b7efc9-3f09-437b-a047-c9f12b9e91dd tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c7370310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:16.612460 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-77b7efc9-3f09-437b-a047-c9f12b9e91dd tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] HTTP exception thrown: Snapshot 60262ca8-40c0-41b7-8803-7afd2d6819d4 could not be found. Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77b7efc9-3f09-437b-a047-c9f12b9e91dd tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Request method failure captured: Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4 HTTP/1.1 Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRc_6X_WL141Gs3ZGZGs1nB8kyZ31T13rg9iTkUtZhNzTIvKzxF4rnYF2XJF92kmle7XMBduDkhhT-UXwC6vukBn_q5rBA9zoohJzOoOupLbMwMLcOE0VkyUqEVKL_5LmEJX__gKu8045YMhiBN0h_nuhH1bDcZLVJOeJhRyUyCwuz6c Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: cef157c113d84bd682ca1e5285130b30 Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cef157c113d84bd682ca1e5285130b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cef157c113d84bd682ca1e5285130b30", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef157c113d84bd682ca1e5285130b30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef157c113d84bd682ca1e5285130b30"}]}] Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: cef157c113d84bd682ca1e5285130b30 Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesSnapshotsTestJSON-2061384638-project Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 84ac4c5657de473d9ab075d25dbee443 Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2061384638-project Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: exception: Snapshot 60262ca8-40c0-41b7-8803-7afd2d6819d4 could not be found. Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '60262ca8-40c0-41b7-8803-7afd2d6819d4'} Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 60262ca8-40c0-41b7-8803-7afd2d6819d4 could not be found. (HTTP 404) (Request-ID: req-417e2f97-daba-414e-b68d-5ef6531c51c6) Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 20:20:16.625989 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 60262ca8-40c0-41b7-8803-7afd2d6819d4 could not be found. Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 60262ca8-40c0-41b7-8803-7afd2d6819d4 could not be found. Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 60262ca8-40c0-41b7-8803-7afd2d6819d4 could not be found. Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-77b7efc9-3f09-437b-a047-c9f12b9e91dd tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Returning 404 to user: Snapshot 60262ca8-40c0-41b7-8803-7afd2d6819d4 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-77b7efc9-3f09-437b-a047-c9f12b9e91dd tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4" status: 404 len: 111 microversion: 2.1 time: 0.051135 Oct 11 20:20:16.630387 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2937/5834] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 20:20:16 2022] GET /compute/v2.1/os-snapshots/60262ca8-40c0-41b7-8803-7afd2d6819d4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:20:16.638787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d9614752-ef4e-4659-848c-ca2760b967c2 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c7032ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:16.720545 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d9614752-ef4e-4659-848c-ca2760b967c2 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a" status: 202 len: 0 microversion: 2.1 time: 0.086801 Oct 11 20:20:16.721156 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2898/5835] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:20:16 2022] DELETE /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:20:16.730783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87b4e658-a853-4513-9dd7-55e16932dc46 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83ccae5160>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:16.826920 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87b4e658-a853-4513-9dd7-55e16932dc46 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a" status: 200 len: 345 microversion: 2.1 time: 0.098988 Oct 11 20:20:16.827747 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2938/5836] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:16 2022] GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:17.601139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0012d743-6732-4e8e-92c7-da523ca52f48 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:17.602172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0012d743-6732-4e8e-92c7-da523ca52f48 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:17.602952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-de81e525-5cce-4af3-bb89-28d4db435493 req-3112b1d4-c2a5-4602-9e52-095e2fc5aae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6514d0-68d1-4a81-aadf-c87a122d0531", "tag": "70e9f4bf-358b-49b4-a779-d87851017a93"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:20:17.615872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-de81e525-5cce-4af3-bb89-28d4db435493 req-3112b1d4-c2a5-4602-9e52-095e2fc5aae3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:17.616591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-de81e525-5cce-4af3-bb89-28d4db435493 req-3112b1d4-c2a5-4602-9e52-095e2fc5aae3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:17.617102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0012d743-6732-4e8e-92c7-da523ca52f48 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:17.617384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-de81e525-5cce-4af3-bb89-28d4db435493 req-3112b1d4-c2a5-4602-9e52-095e2fc5aae3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:17.617610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0012d743-6732-4e8e-92c7-da523ca52f48 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:17.621024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0012d743-6732-4e8e-92c7-da523ca52f48 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:17.622369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0012d743-6732-4e8e-92c7-da523ca52f48 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:17.622571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0012d743-6732-4e8e-92c7-da523ca52f48 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:17.623027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0012d743-6732-4e8e-92c7-da523ca52f48 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:17.647354 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-de81e525-5cce-4af3-bb89-28d4db435493 req-3112b1d4-c2a5-4602-9e52-095e2fc5aae3 service nova] Creating event network-changed:70e9f4bf-358b-49b4-a779-d87851017a93 for instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 on n-h2-860864-3 Oct 11 20:20:17.653659 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-de81e525-5cce-4af3-bb89-28d4db435493 req-3112b1d4-c2a5-4602-9e52-095e2fc5aae3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054972 Oct 11 20:20:17.654659 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2939/5837] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:20:17.676586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0012d743-6732-4e8e-92c7-da523ca52f48 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:20:17.754312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:20:17.851367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-88769d60-73d3-44da-8928-a9777580b98a tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c71cf8b0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:17.885210 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0012d743-6732-4e8e-92c7-da523ca52f48 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 204 len: 0 microversion: 2.1 time: 0.289637 Oct 11 20:20:17.885916 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2899/5838] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:20:17 2022] DELETE /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:20:17.904968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c566a2a7-d39c-476b-8ac5-81e0ec9c3f15 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:17.905655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c566a2a7-d39c-476b-8ac5-81e0ec9c3f15 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:17.927200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c566a2a7-d39c-476b-8ac5-81e0ec9c3f15 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:17.927702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c566a2a7-d39c-476b-8ac5-81e0ec9c3f15 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:17.929845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c566a2a7-d39c-476b-8ac5-81e0ec9c3f15 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:17.931668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c566a2a7-d39c-476b-8ac5-81e0ec9c3f15 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:17.932498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c566a2a7-d39c-476b-8ac5-81e0ec9c3f15 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:17.938037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c566a2a7-d39c-476b-8ac5-81e0ec9c3f15 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:17.948161 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-88769d60-73d3-44da-8928-a9777580b98a tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a" status: 200 len: 345 microversion: 2.1 time: 0.102549 Oct 11 20:20:17.948911 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2940/5839] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:17 2022] GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:20:18.117165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c566a2a7-d39c-476b-8ac5-81e0ec9c3f15 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:18.125534 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c566a2a7-d39c-476b-8ac5-81e0ec9c3f15 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1583 microversion: 2.1 time: 0.225280 Oct 11 20:20:18.126114 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2900/5840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:17 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1583 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:18.963421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0467a99d-c539-402a-bb64-0c70f65eefc5 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c7370820>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:19.018257 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0467a99d-c539-402a-bb64-0c70f65eefc5 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a" status: 200 len: 345 microversion: 2.1 time: 0.058874 Oct 11 20:20:19.018890 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2941/5841] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:18 2022] GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:19.151937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a49cee4-f3a9-454a-ab87-a9799a4d1226 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:19.155449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a49cee4-f3a9-454a-ab87-a9799a4d1226 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:19.162864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a49cee4-f3a9-454a-ab87-a9799a4d1226 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:19.163649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a49cee4-f3a9-454a-ab87-a9799a4d1226 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:19.164553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a49cee4-f3a9-454a-ab87-a9799a4d1226 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:19.165624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a49cee4-f3a9-454a-ab87-a9799a4d1226 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:19.166304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a49cee4-f3a9-454a-ab87-a9799a4d1226 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:19.167072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a49cee4-f3a9-454a-ab87-a9799a4d1226 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:19.326663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4a49cee4-f3a9-454a-ab87-a9799a4d1226 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:19.338283 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a49cee4-f3a9-454a-ab87-a9799a4d1226 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1583 microversion: 2.1 time: 0.189776 Oct 11 20:20:19.339635 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2901/5842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:19 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1583 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:19.875495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8ad547d5-612e-4f86-929a-48eda09b1095 req-cd1579e0-7612-4793-81b6-cb08ebe5e01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6514d0-68d1-4a81-aadf-c87a122d0531", "name": "network-vif-deleted", "tag": "70e9f4bf-358b-49b4-a779-d87851017a93"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:20:19.891859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ad547d5-612e-4f86-929a-48eda09b1095 req-cd1579e0-7612-4793-81b6-cb08ebe5e01c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:19.892794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ad547d5-612e-4f86-929a-48eda09b1095 req-cd1579e0-7612-4793-81b6-cb08ebe5e01c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:19.893632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8ad547d5-612e-4f86-929a-48eda09b1095 req-cd1579e0-7612-4793-81b6-cb08ebe5e01c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:19.913483 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8ad547d5-612e-4f86-929a-48eda09b1095 req-cd1579e0-7612-4793-81b6-cb08ebe5e01c service nova] Creating event network-vif-deleted:70e9f4bf-358b-49b4-a779-d87851017a93 for instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 on n-h2-860864-3 Oct 11 20:20:19.918885 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8ad547d5-612e-4f86-929a-48eda09b1095 req-cd1579e0-7612-4793-81b6-cb08ebe5e01c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049479 Oct 11 20:20:19.923888 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2942/5843] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:20.032684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-429b964d-539b-4ba1-95dc-c72167c32e51 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c6fa28b0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:20.081311 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-429b964d-539b-4ba1-95dc-c72167c32e51 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] HTTP exception thrown: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-429b964d-539b-4ba1-95dc-c72167c32e51 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Request method failure captured: Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a HTTP/1.1 Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc_6X_WL141Gs3ZGZGs1nB8kyZ31T13rg9iTkUtZhNzTIvKzxF4rnYF2XJF92kmle7XMBduDkhhT-UXwC6vukBn_q5rBA9zoohJzOoOupLbMwMLcOE0VkyUqEVKL_5LmEJX__gKu8045YMhiBN0h_nuhH1bDcZLVJOeJhRyUyCwuz6c Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: cef157c113d84bd682ca1e5285130b30 Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cef157c113d84bd682ca1e5285130b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cef157c113d84bd682ca1e5285130b30", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef157c113d84bd682ca1e5285130b30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef157c113d84bd682ca1e5285130b30"}]}] Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: cef157c113d84bd682ca1e5285130b30 Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesSnapshotsTestJSON-2061384638-project Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 84ac4c5657de473d9ab075d25dbee443 Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2061384638-project Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: exception: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '18adeebc-c75d-4481-ba76-2d6a1a71949a'} Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. (HTTP 404) (Request-ID: req-99a0c45c-7dc0-44ca-8078-d0310c23447d) Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 20:20:20.083403 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.087341 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.091756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-429b964d-539b-4ba1-95dc-c72167c32e51 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Returning 404 to user: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:20:20.092853 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-429b964d-539b-4ba1-95dc-c72167c32e51 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a" status: 404 len: 109 microversion: 2.1 time: 0.064007 Oct 11 20:20:20.094102 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2902/5844] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:20 2022] GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:20:20.103602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-88c827a1-9132-4c10-b3a7-aaa976f67649 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c71cf040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:20.224748 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-88c827a1-9132-4c10-b3a7-aaa976f67649 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] HTTP exception thrown: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-88c827a1-9132-4c10-b3a7-aaa976f67649 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Request method failure captured: Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a HTTP/1.1 Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRc_6X_WL141Gs3ZGZGs1nB8kyZ31T13rg9iTkUtZhNzTIvKzxF4rnYF2XJF92kmle7XMBduDkhhT-UXwC6vukBn_q5rBA9zoohJzOoOupLbMwMLcOE0VkyUqEVKL_5LmEJX__gKu8045YMhiBN0h_nuhH1bDcZLVJOeJhRyUyCwuz6c Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: cef157c113d84bd682ca1e5285130b30 Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cef157c113d84bd682ca1e5285130b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cef157c113d84bd682ca1e5285130b30", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef157c113d84bd682ca1e5285130b30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef157c113d84bd682ca1e5285130b30"}]}] Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: cef157c113d84bd682ca1e5285130b30 Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesSnapshotsTestJSON-2061384638-project Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 84ac4c5657de473d9ab075d25dbee443 Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2061384638-project Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: method: Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: exception: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '18adeebc-c75d-4481-ba76-2d6a1a71949a'} Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. (HTTP 404) (Request-ID: req-fe749b6a-43b5-4bde-8eb3-832de5dce369) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 20:20:20.226873 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-88c827a1-9132-4c10-b3a7-aaa976f67649 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Returning 404 to user: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-88c827a1-9132-4c10-b3a7-aaa976f67649 tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a" status: 404 len: 109 microversion: 2.1 time: 0.129755 Oct 11 20:20:20.231637 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2943/5845] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:20:20 2022] DELETE /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:20:20.238762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-392549a1-bf5f-416b-9ec8-3d727abc149c tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Calling method '.version_select at 0x7f83c6fa1af0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:20.274021 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-392549a1-bf5f-416b-9ec8-3d727abc149c tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] HTTP exception thrown: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-392549a1-bf5f-416b-9ec8-3d727abc149c tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Request method failure captured: Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a HTTP/1.1 Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc_6X_WL141Gs3ZGZGs1nB8kyZ31T13rg9iTkUtZhNzTIvKzxF4rnYF2XJF92kmle7XMBduDkhhT-UXwC6vukBn_q5rBA9zoohJzOoOupLbMwMLcOE0VkyUqEVKL_5LmEJX__gKu8045YMhiBN0h_nuhH1bDcZLVJOeJhRyUyCwuz6c Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: cef157c113d84bd682ca1e5285130b30 Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cef157c113d84bd682ca1e5285130b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cef157c113d84bd682ca1e5285130b30", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef157c113d84bd682ca1e5285130b30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef157c113d84bd682ca1e5285130b30"}]}] Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: cef157c113d84bd682ca1e5285130b30 Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2061384638 Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesSnapshotsTestJSON-2061384638-project Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 84ac4c5657de473d9ab075d25dbee443 Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2061384638-project Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: exception: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '18adeebc-c75d-4481-ba76-2d6a1a71949a'} Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. (HTTP 404) (Request-ID: req-b0642a53-12f5-4d02-893d-648087fc9dde) Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 20:20:20.276023 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-392549a1-bf5f-416b-9ec8-3d727abc149c tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] Returning 404 to user: Volume 18adeebc-c75d-4481-ba76-2d6a1a71949a could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-392549a1-bf5f-416b-9ec8-3d727abc149c tempest-VolumesSnapshotsTestJSON-2061384638 tempest-VolumesSnapshotsTestJSON-2061384638-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a" status: 404 len: 109 microversion: 2.1 time: 0.043046 Oct 11 20:20:20.280668 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2903/5846] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:20 2022] GET /compute/v2.1/os-volumes/18adeebc-c75d-4481-ba76-2d6a1a71949a => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:20:20.364753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2d585116-404d-48e0-91ab-01078b4a02fb tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:20.365494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2d585116-404d-48e0-91ab-01078b4a02fb tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:20.373078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d585116-404d-48e0-91ab-01078b4a02fb tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:20.373574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d585116-404d-48e0-91ab-01078b4a02fb tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:20.381431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d585116-404d-48e0-91ab-01078b4a02fb tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:20.382296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d585116-404d-48e0-91ab-01078b4a02fb tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:20.383004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d585116-404d-48e0-91ab-01078b4a02fb tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:20.383454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d585116-404d-48e0-91ab-01078b4a02fb tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:20.495046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2d585116-404d-48e0-91ab-01078b4a02fb tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:20.505730 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2d585116-404d-48e0-91ab-01078b4a02fb tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1230 microversion: 2.1 time: 0.145550 Oct 11 20:20:20.521876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2944/5847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:20 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1230 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:21.529819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a782c697-8c54-471f-8932-4536be31a8f4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:21.530428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a782c697-8c54-471f-8932-4536be31a8f4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:21.558733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a782c697-8c54-471f-8932-4536be31a8f4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:21.560372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a782c697-8c54-471f-8932-4536be31a8f4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:21.560372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a782c697-8c54-471f-8932-4536be31a8f4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:21.560836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a782c697-8c54-471f-8932-4536be31a8f4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:21.561290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a782c697-8c54-471f-8932-4536be31a8f4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:21.561711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a782c697-8c54-471f-8932-4536be31a8f4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:21.659046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a782c697-8c54-471f-8932-4536be31a8f4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:21.667646 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a782c697-8c54-471f-8932-4536be31a8f4 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1230 microversion: 2.1 time: 0.142896 Oct 11 20:20:21.683122 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2904/5848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:21 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1230 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:22.213462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-39eff16e-1861-4d14-a4fb-54eb2a1aa148 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Action: 'create', calling method: .version_select at 0x7f83c71cf940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1261185551", "metadata": {"Type": "work"}}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:20:22.710667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-944631dd-bcaa-4eb9-9edb-c91a5c8b16c9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:22.711385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-944631dd-bcaa-4eb9-9edb-c91a5c8b16c9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:22.752114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-944631dd-bcaa-4eb9-9edb-c91a5c8b16c9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:22.759112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-944631dd-bcaa-4eb9-9edb-c91a5c8b16c9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:22.759824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-944631dd-bcaa-4eb9-9edb-c91a5c8b16c9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:22.762763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-944631dd-bcaa-4eb9-9edb-c91a5c8b16c9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:22.764611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-944631dd-bcaa-4eb9-9edb-c91a5c8b16c9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:22.765768 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-39eff16e-1861-4d14-a4fb-54eb2a1aa148 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.732896 Oct 11 20:20:22.767304 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2945/5849] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 11 20:20:22 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 735 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 20:20:22.775035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-944631dd-bcaa-4eb9-9edb-c91a5c8b16c9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:22.779985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-283516b2-ad85-4e72-bc6f-67245f78e8c5 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Calling method '.version_select at 0x7f83c72e19d0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:22.874476 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-283516b2-ad85-4e72-bc6f-67245f78e8c5 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e" status: 200 len: 353 microversion: 2.1 time: 0.098383 Oct 11 20:20:22.875897 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2946/5850] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:22 2022] GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:22.969724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-944631dd-bcaa-4eb9-9edb-c91a5c8b16c9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:22.979651 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-944631dd-bcaa-4eb9-9edb-c91a5c8b16c9 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1230 microversion: 2.1 time: 0.282159 Oct 11 20:20:22.982588 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2905/5851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:22 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1230 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:23.894238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4122946d-422b-489b-871e-ab902b2ab7c3 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Calling method '.version_select at 0x7f83c71cfd30>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:24.003062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae956cd4-1291-40d8-99d1-7f8342878796 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:24.003686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae956cd4-1291-40d8-99d1-7f8342878796 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:24.007542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:20:24.019489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae956cd4-1291-40d8-99d1-7f8342878796 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:24.019868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae956cd4-1291-40d8-99d1-7f8342878796 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:24.020831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae956cd4-1291-40d8-99d1-7f8342878796 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:24.021801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae956cd4-1291-40d8-99d1-7f8342878796 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:24.023063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae956cd4-1291-40d8-99d1-7f8342878796 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:24.025769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ae956cd4-1291-40d8-99d1-7f8342878796 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:24.086620 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4122946d-422b-489b-871e-ab902b2ab7c3 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e" status: 200 len: 353 microversion: 2.1 time: 0.198251 Oct 11 20:20:24.093917 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2947/5852] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:23 2022] GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:24.176356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ae956cd4-1291-40d8-99d1-7f8342878796 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:24.188643 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ae956cd4-1291-40d8-99d1-7f8342878796 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1230 microversion: 2.1 time: 0.189467 Oct 11 20:20:24.189665 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2906/5853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:23 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1230 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:25.102380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4157afc6-f068-4e3c-952d-c4db7ea5e8cc tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Calling method '.version_select at 0x7f83c72e1a60>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:25.186487 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4157afc6-f068-4e3c-952d-c4db7ea5e8cc tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e" status: 200 len: 354 microversion: 2.1 time: 0.089046 Oct 11 20:20:25.187667 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2948/5854] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:25 2022] GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:25.201040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-993f243e-b9da-43d1-bb35-fbe60d2d107b tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Calling method '.version_select at 0x7f83c7032280>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:25.216441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-192dfed0-4368-4ff5-8f84-2e563bc8e518 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:25.217449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-192dfed0-4368-4ff5-8f84-2e563bc8e518 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:25.227752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192dfed0-4368-4ff5-8f84-2e563bc8e518 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:25.238168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192dfed0-4368-4ff5-8f84-2e563bc8e518 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:25.238919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192dfed0-4368-4ff5-8f84-2e563bc8e518 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:25.240127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192dfed0-4368-4ff5-8f84-2e563bc8e518 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:25.240790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192dfed0-4368-4ff5-8f84-2e563bc8e518 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:25.243574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-192dfed0-4368-4ff5-8f84-2e563bc8e518 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:25.311545 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-993f243e-b9da-43d1-bb35-fbe60d2d107b tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e" status: 200 len: 354 microversion: 2.1 time: 0.114547 Oct 11 20:20:25.312434 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2907/5855] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:25 2022] GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:25.325612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7df75bb-e7b9-41b1-b4ce-9b85f9b9de86 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Calling method '.version_select at 0x7f83c703c940>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:25.363647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-192dfed0-4368-4ff5-8f84-2e563bc8e518 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62822a2d7276492181b8c3aa25c3b12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ab6a64bcb341089312117e408c02b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:25.384955 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-192dfed0-4368-4ff5-8f84-2e563bc8e518 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 200 len: 1230 microversion: 2.1 time: 0.173348 Oct 11 20:20:25.397774 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2949/5856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:25 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 1230 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:25.426429 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e7df75bb-e7b9-41b1-b4ce-9b85f9b9de86 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e" status: 202 len: 0 microversion: 2.1 time: 0.104749 Oct 11 20:20:25.427050 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2908/5857] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 11 20:20:25 2022] DELETE /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 20:20:25.436484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ef99542-e1f8-4246-8e5b-c21fb14aeee5 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Calling method '.version_select at 0x7f83cc61e790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:25.516846 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0ef99542-e1f8-4246-8e5b-c21fb14aeee5 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e" status: 200 len: 353 microversion: 2.1 time: 0.085316 Oct 11 20:20:25.517800 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2950/5858] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:25 2022] GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:26.412883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:26.414255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] [instance: 1b6514d0-68d1-4a81-aadf-c87a122d0531] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:26.424053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:26.425314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:26.426024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:26.428936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:26.429564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:26.431783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:26.480288 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] HTTP exception thrown: Instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 could not be found. Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Request method failure captured: Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 HTTP/1.1 Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc7plzTbqI0yOOdSew3NrGdLbpjWw-XJIc4HmQaucVn_1KoBwRmMYu35tINCVln9yidIStxkGMDXMVpzrGnsIba1uULW_aS-fiXO-AEksWBhKBItgHreIKdO--8Mdduqj-VDzOg2fdYfTzibUFfjtGK_Km7kxhtyWasPf_gj9Vv4bUI Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 28ab6a64bcb341089312117e408c02b7 Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestVolumeBackupRestore-1571575739 Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/28ab6a64bcb341089312117e408c02b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_28ab6a64bcb341089312117e408c02b7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/28ab6a64bcb341089312117e408c02b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/28ab6a64bcb341089312117e408c02b7"}]}] Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestVolumeBackupRestore-1571575739 Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 28ab6a64bcb341089312117e408c02b7 Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1571575739 Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestVolumeBackupRestore-1571575739-project Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 62822a2d7276492181b8c3aa25c3b12a Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestVolumeBackupRestore-1571575739-project Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 could not be found. Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '1b6514d0-68d1-4a81-aadf-c87a122d0531'} Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 could not be found. Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 could not be found. Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:26.483061 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:26.488544 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:26.488544 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:26.488544 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:26.488544 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:20:26.488544 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:20:26.488544 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 could not be found. Oct 11 20:20:26.488544 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:26.488544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Returning 404 to user: Instance 1b6514d0-68d1-4a81-aadf-c87a122d0531 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:20:26.488544 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-099d48eb-8a6a-4446-947c-3c48426e84a8 tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531" status: 404 len: 111 microversion: 2.1 time: 0.079113 Oct 11 20:20:26.504915 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2909/5859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:26 2022] GET /compute/v2.1/servers/1b6514d0-68d1-4a81-aadf-c87a122d0531 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:20:26.533370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d74feab7-d9cd-45e5-929f-17b8ca46d879 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Calling method '.version_select at 0x7f83ccb881f0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:26.611958 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d74feab7-d9cd-45e5-929f-17b8ca46d879 tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e" status: 200 len: 353 microversion: 2.1 time: 0.084095 Oct 11 20:20:26.613838 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2951/5860] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:26 2022] GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:26.768222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aaf3b3cf-851c-4ce0-9fe7-910aab07e7be tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] Calling method '.version_select at 0x7f83c703c700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:26.812832 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aaf3b3cf-851c-4ce0-9fe7-910aab07e7be tempest-TestVolumeBackupRestore-1571575739 tempest-TestVolumeBackupRestore-1571575739-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1606708251" status: 202 len: 0 microversion: 2.1 time: 0.048740 Oct 11 20:20:26.814800 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2910/5861] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 11 20:20:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1606708251 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:20:27.628318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-28109e36-3918-4316-b99f-608fdc86187c tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Calling method '.version_select at 0x7f83ccba8b80>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:27.724463 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-28109e36-3918-4316-b99f-608fdc86187c tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e" status: 200 len: 353 microversion: 2.1 time: 0.101391 Oct 11 20:20:27.724855 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2952/5862] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:27 2022] GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:20:28.743758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b1bb432-ee51-4578-838a-dbb814e4292c tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Calling method '.version_select at 0x7f83c6f98d30>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:28.846067 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-7b1bb432-ee51-4578-838a-dbb814e4292c tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] HTTP exception thrown: Volume a100941c-2f51-4bdf-bd90-bfb09131728e could not be found. Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b1bb432-ee51-4578-838a-dbb814e4292c tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Request method failure captured: Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e HTTP/1.1 Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdAFlWvXRpiLlxrEfNgbOU7YhEXy1wUwc1OF9P2Vp1g4EXvMCV9-zFdd_kVjKCAyHVVZYE9tLu2p8UmEf7Lh6AjmX5jvLlZnTu_OJySRJwIVJVzLIzq9GzsT-4PrnwEgnWILpczG22GQi6JE6IECgQO5fU2iYLcLiJjkagJxVLHuo-s Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 87d979027b0d4ab3963570b468ada8a5 Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesGetTestJSON-7640658 Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87d979027b0d4ab3963570b468ada8a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87d979027b0d4ab3963570b468ada8a5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87d979027b0d4ab3963570b468ada8a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87d979027b0d4ab3963570b468ada8a5"}]}] Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesGetTestJSON-7640658 Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 87d979027b0d4ab3963570b468ada8a5 Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesGetTestJSON-7640658 Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesGetTestJSON-7640658-project Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: e8345fa4e38041a78de282d6fa0e39d4 Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesGetTestJSON-7640658-project Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: method: Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: exception: Volume a100941c-2f51-4bdf-bd90-bfb09131728e could not be found. Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a100941c-2f51-4bdf-bd90-bfb09131728e'} Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a100941c-2f51-4bdf-bd90-bfb09131728e could not be found. (HTTP 404) (Request-ID: req-eb3b17eb-eea1-42ea-9ee2-6c363c38ae6e) Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 20:20:28.849191 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a100941c-2f51-4bdf-bd90-bfb09131728e could not be found. Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a100941c-2f51-4bdf-bd90-bfb09131728e could not be found. Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a100941c-2f51-4bdf-bd90-bfb09131728e could not be found. Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:28.853593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b1bb432-ee51-4578-838a-dbb814e4292c tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] Returning 404 to user: Volume a100941c-2f51-4bdf-bd90-bfb09131728e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:20:28.861177 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7b1bb432-ee51-4578-838a-dbb814e4292c tempest-VolumesGetTestJSON-7640658 tempest-VolumesGetTestJSON-7640658-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e" status: 404 len: 109 microversion: 2.1 time: 0.121029 Oct 11 20:20:28.861177 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2911/5863] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 20:20:28 2022] GET /compute/v2.1/os-volumes/a100941c-2f51-4bdf-bd90-bfb09131728e => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:20:39.733019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5942d69-0b04-4076-8410-797585204a97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:39.734327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f5942d69-0b04-4076-8410-797585204a97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:39.742201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:20:39.743213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=16 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:20:39.745019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5942d69-0b04-4076-8410-797585204a97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:39.746692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5942d69-0b04-4076-8410-797585204a97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:39.747376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5942d69-0b04-4076-8410-797585204a97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:39.748520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5942d69-0b04-4076-8410-797585204a97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:39.749530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5942d69-0b04-4076-8410-797585204a97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:39.750194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5942d69-0b04-4076-8410-797585204a97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:39.848429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-f5942d69-0b04-4076-8410-797585204a97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lazy-loading 'services' on Instance uuid a41dd4d0-6814-4834-bbc6-aa66fff3942f {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:20:39.936570 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5942d69-0b04-4076-8410-797585204a97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f/os-volume_attachments/7ae36dc7-995c-44e2-b9b4-cc101400a2ad" status: 202 len: 0 microversion: 2.1 time: 0.209468 Oct 11 20:20:39.938698 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2953/5864] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:20:39 2022] DELETE /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f/os-volume_attachments/7ae36dc7-995c-44e2-b9b4-cc101400a2ad => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:20:47.788402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-016eebaa-3d09-4981-bde8-bd06700d6b03 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:47.789586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-016eebaa-3d09-4981-bde8-bd06700d6b03 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:47.796731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:20:47.798251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:20:47.800824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-016eebaa-3d09-4981-bde8-bd06700d6b03 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:47.801478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-016eebaa-3d09-4981-bde8-bd06700d6b03 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:47.802251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-016eebaa-3d09-4981-bde8-bd06700d6b03 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:47.803271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-016eebaa-3d09-4981-bde8-bd06700d6b03 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:47.804454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-016eebaa-3d09-4981-bde8-bd06700d6b03 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:47.805116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-016eebaa-3d09-4981-bde8-bd06700d6b03 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:47.841788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-016eebaa-3d09-4981-bde8-bd06700d6b03 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:20:47.941405 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-016eebaa-3d09-4981-bde8-bd06700d6b03 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 204 len: 0 microversion: 2.1 time: 0.157086 Oct 11 20:20:47.946463 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2912/5865] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:20:47 2022] DELETE /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:20:47.954586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2e6e7e3e-1e9e-49a7-b6c5-21e0ade54d9d tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:47.956126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2e6e7e3e-1e9e-49a7-b6c5-21e0ade54d9d tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:47.967945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e6e7e3e-1e9e-49a7-b6c5-21e0ade54d9d tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:47.968605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e6e7e3e-1e9e-49a7-b6c5-21e0ade54d9d tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:47.969199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e6e7e3e-1e9e-49a7-b6c5-21e0ade54d9d tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:47.970381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e6e7e3e-1e9e-49a7-b6c5-21e0ade54d9d tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:47.971047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e6e7e3e-1e9e-49a7-b6c5-21e0ade54d9d tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:47.971699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e6e7e3e-1e9e-49a7-b6c5-21e0ade54d9d tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:48.183981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2e6e7e3e-1e9e-49a7-b6c5-21e0ade54d9d tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:48.193442 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2e6e7e3e-1e9e-49a7-b6c5-21e0ade54d9d tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1512 microversion: 2.1 time: 0.245755 Oct 11 20:20:48.195669 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2954/5866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:47 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:49.222302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6eda7d61-045c-4baa-93e4-c5d02d3a6c51 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:49.224801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6eda7d61-045c-4baa-93e4-c5d02d3a6c51 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:49.242480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eda7d61-045c-4baa-93e4-c5d02d3a6c51 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:49.243377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eda7d61-045c-4baa-93e4-c5d02d3a6c51 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:49.244045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eda7d61-045c-4baa-93e4-c5d02d3a6c51 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:49.245872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eda7d61-045c-4baa-93e4-c5d02d3a6c51 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:49.246657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eda7d61-045c-4baa-93e4-c5d02d3a6c51 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:49.247310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eda7d61-045c-4baa-93e4-c5d02d3a6c51 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:49.429731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6eda7d61-045c-4baa-93e4-c5d02d3a6c51 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:49.457650 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6eda7d61-045c-4baa-93e4-c5d02d3a6c51 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1512 microversion: 2.1 time: 0.243005 Oct 11 20:20:49.458877 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2913/5867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:49 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:50.509571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-315d1041-7b45-44a4-aa0f-5fa6fadd5cff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:50.510770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-315d1041-7b45-44a4-aa0f-5fa6fadd5cff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:50.550052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315d1041-7b45-44a4-aa0f-5fa6fadd5cff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:50.550692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315d1041-7b45-44a4-aa0f-5fa6fadd5cff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:50.551489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315d1041-7b45-44a4-aa0f-5fa6fadd5cff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:50.553513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315d1041-7b45-44a4-aa0f-5fa6fadd5cff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:50.554197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315d1041-7b45-44a4-aa0f-5fa6fadd5cff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:50.554898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-315d1041-7b45-44a4-aa0f-5fa6fadd5cff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:50.568234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-99d0fbf9-7f2f-473d-9b16-865285bdcf0f req-518e761b-844d-4ce2-90f9-a373756ca61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41dd4d0-6814-4834-bbc6-aa66fff3942f", "name": "network-vif-deleted", "tag": "4d92ea17-9c3c-44e6-8cae-6ef668d7db95"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:20:50.591830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-99d0fbf9-7f2f-473d-9b16-865285bdcf0f req-518e761b-844d-4ce2-90f9-a373756ca61b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:50.596787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-99d0fbf9-7f2f-473d-9b16-865285bdcf0f req-518e761b-844d-4ce2-90f9-a373756ca61b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:50.597264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-99d0fbf9-7f2f-473d-9b16-865285bdcf0f req-518e761b-844d-4ce2-90f9-a373756ca61b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:50.626313 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-99d0fbf9-7f2f-473d-9b16-865285bdcf0f req-518e761b-844d-4ce2-90f9-a373756ca61b service nova] Creating event network-vif-deleted:4d92ea17-9c3c-44e6-8cae-6ef668d7db95 for instance a41dd4d0-6814-4834-bbc6-aa66fff3942f on n-h1-860864-3 Oct 11 20:20:50.637413 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-99d0fbf9-7f2f-473d-9b16-865285bdcf0f req-518e761b-844d-4ce2-90f9-a373756ca61b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071569 Oct 11 20:20:50.639335 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2914/5868] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:20:50.719582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-315d1041-7b45-44a4-aa0f-5fa6fadd5cff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:20:50.731231 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-315d1041-7b45-44a4-aa0f-5fa6fadd5cff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 200 len: 1470 microversion: 2.1 time: 0.246615 Oct 11 20:20:50.735331 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2955/5869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:50 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 1470 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:20:51.770555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:20:51.771977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: a41dd4d0-6814-4834-bbc6-aa66fff3942f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:20:51.780032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:51.780819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:51.781664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:51.783083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:20:51.783763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:20:51.784431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:20:51.801119 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] HTTP exception thrown: Instance a41dd4d0-6814-4834-bbc6-aa66fff3942f could not be found. Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Request method failure captured: Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f HTTP/1.1 Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRc-C83PE7QfQ4dGlA3bKIpxBXmQlkcGjEJS0Wo6ks0-V5SD4KArqEfw10pTqaQGrZaWf_wrKiOiTxybKpnZhNiwBNVT3fPGtJDNne5rJd5nCqmSyehTe9fVPndJkSE5nJ--nFkAIOiOSPHjIOGYdMUegBloXJRqEZAwqHnSA4slsQ5I Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: a70d2e9b4f464eefac9d4c5ab51c47f2 Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-VolumesSnapshotTestJSON-938310633 Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a70d2e9b4f464eefac9d4c5ab51c47f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a70d2e9b4f464eefac9d4c5ab51c47f2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a70d2e9b4f464eefac9d4c5ab51c47f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a70d2e9b4f464eefac9d4c5ab51c47f2"}]}] Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-VolumesSnapshotTestJSON-938310633 Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: a70d2e9b4f464eefac9d4c5ab51c47f2 Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-938310633 Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-VolumesSnapshotTestJSON-938310633-project Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: ae4ea8b90e6f480f8480dafec996bbcb Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-VolumesSnapshotTestJSON-938310633-project Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance a41dd4d0-6814-4834-bbc6-aa66fff3942f could not be found. Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'a41dd4d0-6814-4834-bbc6-aa66fff3942f'} Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41dd4d0-6814-4834-bbc6-aa66fff3942f could not be found. Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41dd4d0-6814-4834-bbc6-aa66fff3942f could not be found. Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:20:51.804676 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:51.809638 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:20:51.809638 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:20:51.809638 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:20:51.809638 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:20:51.809638 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:20:51.809638 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41dd4d0-6814-4834-bbc6-aa66fff3942f could not be found. Oct 11 20:20:51.809638 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:20:51.812752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Returning 404 to user: Instance a41dd4d0-6814-4834-bbc6-aa66fff3942f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:20:51.813852 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8f9e9a88-412a-4934-920d-74dfe218163f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f" status: 404 len: 111 microversion: 2.1 time: 0.047614 Oct 11 20:20:51.818587 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2915/5870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:20:51 2022] GET /compute/v2.1/servers/a41dd4d0-6814-4834-bbc6-aa66fff3942f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:21:02.659133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1992848095", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "13d33a44-fe09-4837-b4fa-9dd17aef19f7"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:02.715442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:02.718580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:02.777068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] validate_networks() for [('13d33a44-fe09-4837-b4fa-9dd17aef19f7', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:21:03.547025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:21:03.547464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:21:03.547942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:21:03.548415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:21:03.548837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:21:03.560586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:03.561030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:03.561757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:03.562785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:03.563473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:03.564283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:03.593617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Getting quotas for project a70d2e9b4f464eefac9d4c5ab51c47f2. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:21:03.600288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Getting quotas for user ae4ea8b90e6f480f8480dafec996bbcb and project a70d2e9b4f464eefac9d4c5ab51c47f2. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:21:03.626347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:21:03.629268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:21:03.700642 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1aee6ed5-b25c-41da-b069-62c8bcbcb02a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045674 Oct 11 20:21:03.704645 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2956/5871] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:21:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:21:03.714569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9f223d61-01c7-4597-b225-a3d2e5766062 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:03.715343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9f223d61-01c7-4597-b225-a3d2e5766062 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:03.734950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:03.736193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:03.883671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9f223d61-01c7-4597-b225-a3d2e5766062 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:03.897117 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9f223d61-01c7-4597-b225-a3d2e5766062 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1219 microversion: 2.1 time: 0.186775 Oct 11 20:21:03.906878 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2916/5872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:03 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1219 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:04.933095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d9dc52b-99fe-4832-bdeb-eac07726d0ee tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:04.934784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0d9dc52b-99fe-4832-bdeb-eac07726d0ee tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:04.951434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d9dc52b-99fe-4832-bdeb-eac07726d0ee tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:04.953561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d9dc52b-99fe-4832-bdeb-eac07726d0ee tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:04.956487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d9dc52b-99fe-4832-bdeb-eac07726d0ee tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:04.957564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d9dc52b-99fe-4832-bdeb-eac07726d0ee tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:04.958844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d9dc52b-99fe-4832-bdeb-eac07726d0ee tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:04.960725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d9dc52b-99fe-4832-bdeb-eac07726d0ee tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:05.298685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0d9dc52b-99fe-4832-bdeb-eac07726d0ee tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:05.315786 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0d9dc52b-99fe-4832-bdeb-eac07726d0ee tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1215 microversion: 2.1 time: 0.388932 Oct 11 20:21:05.316979 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2957/5873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:04 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:05.797738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2089366456", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "264c85b6-4589-414d-98ce-510b2df05547", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06296b2d-bf7f-4d21-bab0-dfde6b2c7622"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:05.915836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] validate_networks() for [('06296b2d-bf7f-4d21-bab0-dfde6b2c7622', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:21:06.344088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d9589ace-6a97-42ce-82ac-6e0d48aa9034 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:06.344954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d9589ace-6a97-42ce-82ac-6e0d48aa9034 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:06.381660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9589ace-6a97-42ce-82ac-6e0d48aa9034 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:06.398000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9589ace-6a97-42ce-82ac-6e0d48aa9034 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:06.398834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9589ace-6a97-42ce-82ac-6e0d48aa9034 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:06.401242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9589ace-6a97-42ce-82ac-6e0d48aa9034 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:06.401752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9589ace-6a97-42ce-82ac-6e0d48aa9034 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:06.402198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d9589ace-6a97-42ce-82ac-6e0d48aa9034 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:06.626768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d9589ace-6a97-42ce-82ac-6e0d48aa9034 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:06.677798 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d9589ace-6a97-42ce-82ac-6e0d48aa9034 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1277 microversion: 2.1 time: 0.336700 Oct 11 20:21:06.681695 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2958/5874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:06 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1277 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:21:06.793629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:21:06.794770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:21:06.797010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:21:06.797758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:21:06.799097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:21:06.818344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:06.819514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:06.820124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:06.821048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:06.823328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:06.823991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:06.866659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:21:06.883806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for user cbcf07bc33104f78adbcd3dfa198a570 and project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:21:07.020033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:21:07.023186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='264c85b6-4589-414d-98ce-510b2df05547',volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:21:07.253993 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-72e5d78b-394c-4a7e-a92b-6a46dc4ec384 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.462124 Oct 11 20:21:07.261060 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2917/5875] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:21:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:21:07.272599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-56cd939b-3412-4a98-8db8-502f32b16097 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:07.273626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-56cd939b-3412-4a98-8db8-502f32b16097 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:07.439830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56cd939b-3412-4a98-8db8-502f32b16097 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:07.449536 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-56cd939b-3412-4a98-8db8-502f32b16097 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1057 microversion: 2.1 time: 0.180843 Oct 11 20:21:07.466939 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2959/5876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:07 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1057 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:07.707974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-17bb25a2-419b-4e76-bfb0-07f5260941b8 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:07.709972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-17bb25a2-419b-4e76-bfb0-07f5260941b8 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:07.735329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17bb25a2-419b-4e76-bfb0-07f5260941b8 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:07.739860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17bb25a2-419b-4e76-bfb0-07f5260941b8 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:07.740481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17bb25a2-419b-4e76-bfb0-07f5260941b8 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:07.744993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17bb25a2-419b-4e76-bfb0-07f5260941b8 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:07.745945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17bb25a2-419b-4e76-bfb0-07f5260941b8 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:07.747728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17bb25a2-419b-4e76-bfb0-07f5260941b8 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:08.392613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-17bb25a2-419b-4e76-bfb0-07f5260941b8 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:08.406433 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-17bb25a2-419b-4e76-bfb0-07f5260941b8 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1319 microversion: 2.1 time: 0.702640 Oct 11 20:21:08.414037 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2918/5877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:07 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1319 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:08.475163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a32331e-6504-4b8b-ac4e-845870998263 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:08.476530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7a32331e-6504-4b8b-ac4e-845870998263 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:08.508206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a32331e-6504-4b8b-ac4e-845870998263 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:08.510561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a32331e-6504-4b8b-ac4e-845870998263 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:08.511235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a32331e-6504-4b8b-ac4e-845870998263 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:08.512244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a32331e-6504-4b8b-ac4e-845870998263 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:08.512860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a32331e-6504-4b8b-ac4e-845870998263 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:08.513458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a32331e-6504-4b8b-ac4e-845870998263 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:08.737957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7a32331e-6504-4b8b-ac4e-845870998263 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:08.755458 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a32331e-6504-4b8b-ac4e-845870998263 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1099 microversion: 2.1 time: 0.285422 Oct 11 20:21:08.759902 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2960/5878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:08 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1099 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:08.960064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1d32a955-bbc6-48e2-97f4-d0da51b80592 req-8e1ee7fd-cf13-4bee-a2c2-f31847169b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "126b8538-c9e4-438e-a3cf-fed38d24036b", "tag": "d0aa3fe9-e56c-4472-9202-18c6e56232ab"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:08.991038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1d32a955-bbc6-48e2-97f4-d0da51b80592 req-8e1ee7fd-cf13-4bee-a2c2-f31847169b42 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:08.991702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1d32a955-bbc6-48e2-97f4-d0da51b80592 req-8e1ee7fd-cf13-4bee-a2c2-f31847169b42 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:08.992965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1d32a955-bbc6-48e2-97f4-d0da51b80592 req-8e1ee7fd-cf13-4bee-a2c2-f31847169b42 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:09.007333 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1d32a955-bbc6-48e2-97f4-d0da51b80592 req-8e1ee7fd-cf13-4bee-a2c2-f31847169b42 service nova] Creating event network-changed:d0aa3fe9-e56c-4472-9202-18c6e56232ab for instance 126b8538-c9e4-438e-a3cf-fed38d24036b on n-h2-860864-3 Oct 11 20:21:09.014094 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1d32a955-bbc6-48e2-97f4-d0da51b80592 req-8e1ee7fd-cf13-4bee-a2c2-f31847169b42 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057839 Oct 11 20:21:09.015390 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2919/5879] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:21:09.440960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d81bce80-7a12-4086-81bb-a3ff3cbcca97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:09.441584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d81bce80-7a12-4086-81bb-a3ff3cbcca97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:09.451352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d81bce80-7a12-4086-81bb-a3ff3cbcca97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:09.451856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d81bce80-7a12-4086-81bb-a3ff3cbcca97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:09.452296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d81bce80-7a12-4086-81bb-a3ff3cbcca97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:09.454682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d81bce80-7a12-4086-81bb-a3ff3cbcca97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:09.455187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d81bce80-7a12-4086-81bb-a3ff3cbcca97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:09.455620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d81bce80-7a12-4086-81bb-a3ff3cbcca97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:09.731073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d81bce80-7a12-4086-81bb-a3ff3cbcca97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:09.740430 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d81bce80-7a12-4086-81bb-a3ff3cbcca97 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1319 microversion: 2.1 time: 0.303334 Oct 11 20:21:09.746613 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2961/5880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:09 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:09.785802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53296882-c163-4894-806e-19732369844c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:09.786741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-53296882-c163-4894-806e-19732369844c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:09.794109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53296882-c163-4894-806e-19732369844c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:09.794643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53296882-c163-4894-806e-19732369844c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:09.795087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53296882-c163-4894-806e-19732369844c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:09.795803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53296882-c163-4894-806e-19732369844c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:09.796264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53296882-c163-4894-806e-19732369844c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:09.796947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53296882-c163-4894-806e-19732369844c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:09.959186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-53296882-c163-4894-806e-19732369844c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:09.971479 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-53296882-c163-4894-806e-19732369844c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1173 microversion: 2.1 time: 0.189698 Oct 11 20:21:09.972374 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2920/5881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:09 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1173 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:10.764416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d27ae6a-f347-4176-ab76-d14362130f6c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:10.765757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4d27ae6a-f347-4176-ab76-d14362130f6c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:10.780639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d27ae6a-f347-4176-ab76-d14362130f6c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:10.786611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d27ae6a-f347-4176-ab76-d14362130f6c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:10.788410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d27ae6a-f347-4176-ab76-d14362130f6c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:10.789437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d27ae6a-f347-4176-ab76-d14362130f6c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:10.790140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d27ae6a-f347-4176-ab76-d14362130f6c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:10.791368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d27ae6a-f347-4176-ab76-d14362130f6c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:10.999869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8cb883ba-1179-4a7e-b6fe-7d5fc188bd5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:11.000497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8cb883ba-1179-4a7e-b6fe-7d5fc188bd5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:11.017069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cb883ba-1179-4a7e-b6fe-7d5fc188bd5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:11.017559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cb883ba-1179-4a7e-b6fe-7d5fc188bd5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:11.018280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cb883ba-1179-4a7e-b6fe-7d5fc188bd5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:11.019167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cb883ba-1179-4a7e-b6fe-7d5fc188bd5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:11.019774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cb883ba-1179-4a7e-b6fe-7d5fc188bd5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:11.020399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8cb883ba-1179-4a7e-b6fe-7d5fc188bd5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:11.391761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4d27ae6a-f347-4176-ab76-d14362130f6c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:11.399846 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4d27ae6a-f347-4176-ab76-d14362130f6c tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1319 microversion: 2.1 time: 0.639560 Oct 11 20:21:11.408407 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2962/5882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:10 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:11.578113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8cb883ba-1179-4a7e-b6fe-7d5fc188bd5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:11.595326 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8cb883ba-1179-4a7e-b6fe-7d5fc188bd5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1215 microversion: 2.1 time: 0.601626 Oct 11 20:21:11.602466 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2921/5883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:10 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1215 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:12.346351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-bc7d002e-6273-427c-a1d3-1812caddac49 req-ffece9b8-ff38-4d76-a7c1-0b299f850a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1de24d37-9854-494e-90d4-633f1a262c06", "tag": "c174386a-2add-41d2-bde3-1238d16b7090"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:12.366430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc7d002e-6273-427c-a1d3-1812caddac49 req-ffece9b8-ff38-4d76-a7c1-0b299f850a6e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:12.373191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc7d002e-6273-427c-a1d3-1812caddac49 req-ffece9b8-ff38-4d76-a7c1-0b299f850a6e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:12.374174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-bc7d002e-6273-427c-a1d3-1812caddac49 req-ffece9b8-ff38-4d76-a7c1-0b299f850a6e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:12.397941 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-bc7d002e-6273-427c-a1d3-1812caddac49 req-ffece9b8-ff38-4d76-a7c1-0b299f850a6e service nova] Creating event network-changed:c174386a-2add-41d2-bde3-1238d16b7090 for instance 1de24d37-9854-494e-90d4-633f1a262c06 on n-h1-860864-3 Oct 11 20:21:12.404031 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-bc7d002e-6273-427c-a1d3-1812caddac49 req-ffece9b8-ff38-4d76-a7c1-0b299f850a6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063128 Oct 11 20:21:12.405209 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2963/5884] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:21:12.432964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc72922d-327a-48bf-9b22-a2e9c9e2e496 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:12.433789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc72922d-327a-48bf-9b22-a2e9c9e2e496 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:12.448678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc72922d-327a-48bf-9b22-a2e9c9e2e496 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:12.449349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc72922d-327a-48bf-9b22-a2e9c9e2e496 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:12.449909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc72922d-327a-48bf-9b22-a2e9c9e2e496 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:12.455510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc72922d-327a-48bf-9b22-a2e9c9e2e496 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:12.456455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc72922d-327a-48bf-9b22-a2e9c9e2e496 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:12.457017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc72922d-327a-48bf-9b22-a2e9c9e2e496 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:12.621381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ba1de62-9d39-4829-8c56-adddef36e6da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:12.622170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1ba1de62-9d39-4829-8c56-adddef36e6da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:12.629213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba1de62-9d39-4829-8c56-adddef36e6da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:12.629868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba1de62-9d39-4829-8c56-adddef36e6da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:12.630769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba1de62-9d39-4829-8c56-adddef36e6da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:12.631594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba1de62-9d39-4829-8c56-adddef36e6da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:12.632170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba1de62-9d39-4829-8c56-adddef36e6da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:12.632710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba1de62-9d39-4829-8c56-adddef36e6da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:13.038596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc72922d-327a-48bf-9b22-a2e9c9e2e496 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:13.067302 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc72922d-327a-48bf-9b22-a2e9c9e2e496 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1319 microversion: 2.1 time: 0.637218 Oct 11 20:21:13.067833 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2922/5885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:12 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:13.071576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1ba1de62-9d39-4829-8c56-adddef36e6da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:13.091850 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1ba1de62-9d39-4829-8c56-adddef36e6da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1215 microversion: 2.1 time: 0.476118 Oct 11 20:21:13.120787 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2964/5886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:12 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1215 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:14.104884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05afb764-4a85-4576-99e8-b31e3f1ecaff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:14.108589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05afb764-4a85-4576-99e8-b31e3f1ecaff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:14.121194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a1972532-2805-4d4f-81d1-634fc695366f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:14.122842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a1972532-2805-4d4f-81d1-634fc695366f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:14.128443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:14.141448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05afb764-4a85-4576-99e8-b31e3f1ecaff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:14.144456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05afb764-4a85-4576-99e8-b31e3f1ecaff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:14.145017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05afb764-4a85-4576-99e8-b31e3f1ecaff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:14.146377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05afb764-4a85-4576-99e8-b31e3f1ecaff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:14.147430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1972532-2805-4d4f-81d1-634fc695366f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:14.148629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1972532-2805-4d4f-81d1-634fc695366f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:14.148860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05afb764-4a85-4576-99e8-b31e3f1ecaff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:14.150424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05afb764-4a85-4576-99e8-b31e3f1ecaff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:14.151134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1972532-2805-4d4f-81d1-634fc695366f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:14.154347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1972532-2805-4d4f-81d1-634fc695366f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:14.154973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1972532-2805-4d4f-81d1-634fc695366f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:14.155480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1972532-2805-4d4f-81d1-634fc695366f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:14.487365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-05afb764-4a85-4576-99e8-b31e3f1ecaff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:14.497102 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05afb764-4a85-4576-99e8-b31e3f1ecaff tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1319 microversion: 2.1 time: 0.398481 Oct 11 20:21:14.497769 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2923/5887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:14 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:14.503471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a1972532-2805-4d4f-81d1-634fc695366f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:14.514426 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a1972532-2805-4d4f-81d1-634fc695366f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1215 microversion: 2.1 time: 0.398897 Oct 11 20:21:14.515419 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2965/5888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:14 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1215 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:15.522207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dd711cfb-835e-4965-b9c8-aab056998b7a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:15.522941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dd711cfb-835e-4965-b9c8-aab056998b7a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:15.537749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8fa27bce-ce55-44fb-acf9-c8a02115ccf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:15.538280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd711cfb-835e-4965-b9c8-aab056998b7a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:15.538563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8fa27bce-ce55-44fb-acf9-c8a02115ccf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:15.538923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd711cfb-835e-4965-b9c8-aab056998b7a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:15.540110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd711cfb-835e-4965-b9c8-aab056998b7a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:15.542546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd711cfb-835e-4965-b9c8-aab056998b7a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:15.543094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd711cfb-835e-4965-b9c8-aab056998b7a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:15.545513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd711cfb-835e-4965-b9c8-aab056998b7a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:15.549375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa27bce-ce55-44fb-acf9-c8a02115ccf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:15.550850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa27bce-ce55-44fb-acf9-c8a02115ccf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:15.551537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa27bce-ce55-44fb-acf9-c8a02115ccf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:15.553989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa27bce-ce55-44fb-acf9-c8a02115ccf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:15.558084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa27bce-ce55-44fb-acf9-c8a02115ccf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:15.558818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa27bce-ce55-44fb-acf9-c8a02115ccf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:15.844647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dd711cfb-835e-4965-b9c8-aab056998b7a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:15.855978 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dd711cfb-835e-4965-b9c8-aab056998b7a tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1319 microversion: 2.1 time: 0.339124 Oct 11 20:21:15.857009 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2924/5889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:15 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:15.861878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-378b4b8e-934f-4326-8f93-7b281cda57ad req-658763fe-5524-4349-ada2-bc27f241cf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "126b8538-c9e4-438e-a3cf-fed38d24036b", "name": "network-vif-plugged", "status": "completed", "tag": "d0aa3fe9-e56c-4472-9202-18c6e56232ab"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:15.864378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8fa27bce-ce55-44fb-acf9-c8a02115ccf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:15.873497 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8fa27bce-ce55-44fb-acf9-c8a02115ccf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1215 microversion: 2.1 time: 0.340094 Oct 11 20:21:15.873654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-378b4b8e-934f-4326-8f93-7b281cda57ad req-658763fe-5524-4349-ada2-bc27f241cf3a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:15.873984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-378b4b8e-934f-4326-8f93-7b281cda57ad req-658763fe-5524-4349-ada2-bc27f241cf3a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:15.874420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-378b4b8e-934f-4326-8f93-7b281cda57ad req-658763fe-5524-4349-ada2-bc27f241cf3a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:15.875956 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2966/5890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:15 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:21:15.906395 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-378b4b8e-934f-4326-8f93-7b281cda57ad req-658763fe-5524-4349-ada2-bc27f241cf3a service nova] Creating event network-vif-plugged:d0aa3fe9-e56c-4472-9202-18c6e56232ab for instance 126b8538-c9e4-438e-a3cf-fed38d24036b on n-h2-860864-3 Oct 11 20:21:15.914396 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-378b4b8e-934f-4326-8f93-7b281cda57ad req-658763fe-5524-4349-ada2-bc27f241cf3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055891 Oct 11 20:21:15.915803 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2925/5891] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:21:16.881022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cf7b6e1e-f015-4e0a-a4a8-cea1c3ead8ca tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:16.881641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cf7b6e1e-f015-4e0a-a4a8-cea1c3ead8ca tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:16.889053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf7b6e1e-f015-4e0a-a4a8-cea1c3ead8ca tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:16.889556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf7b6e1e-f015-4e0a-a4a8-cea1c3ead8ca tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:16.889998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf7b6e1e-f015-4e0a-a4a8-cea1c3ead8ca tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:16.890796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf7b6e1e-f015-4e0a-a4a8-cea1c3ead8ca tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:16.891266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf7b6e1e-f015-4e0a-a4a8-cea1c3ead8ca tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:16.891692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cf7b6e1e-f015-4e0a-a4a8-cea1c3ead8ca tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:16.901553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67fb4f46-ffe9-4794-a6ab-dd843ef90123 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:16.903280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-67fb4f46-ffe9-4794-a6ab-dd843ef90123 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:16.906593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:16.907636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:16.914392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67fb4f46-ffe9-4794-a6ab-dd843ef90123 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:16.915903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67fb4f46-ffe9-4794-a6ab-dd843ef90123 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:16.916753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67fb4f46-ffe9-4794-a6ab-dd843ef90123 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:16.917671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67fb4f46-ffe9-4794-a6ab-dd843ef90123 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:16.918338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67fb4f46-ffe9-4794-a6ab-dd843ef90123 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:16.919003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67fb4f46-ffe9-4794-a6ab-dd843ef90123 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:17.224046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-67fb4f46-ffe9-4794-a6ab-dd843ef90123 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:17.230147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cf7b6e1e-f015-4e0a-a4a8-cea1c3ead8ca tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:17.237433 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-67fb4f46-ffe9-4794-a6ab-dd843ef90123 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1203 microversion: 2.1 time: 0.341616 Oct 11 20:21:17.239108 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2926/5892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:16 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1203 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:17.241972 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cf7b6e1e-f015-4e0a-a4a8-cea1c3ead8ca tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1319 microversion: 2.1 time: 0.364693 Oct 11 20:21:17.255183 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2967/5893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:16 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:18.269101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-23aa32d9-0ecf-468f-8dd5-777aaa495521 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:18.270207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-23aa32d9-0ecf-468f-8dd5-777aaa495521 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:18.273518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-af08f47f-a954-473c-9cb2-64fce231558d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:18.273518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-af08f47f-a954-473c-9cb2-64fce231558d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:18.281545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:18.290895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23aa32d9-0ecf-468f-8dd5-777aaa495521 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:18.291426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23aa32d9-0ecf-468f-8dd5-777aaa495521 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:18.292013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af08f47f-a954-473c-9cb2-64fce231558d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:18.292532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af08f47f-a954-473c-9cb2-64fce231558d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:18.292962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af08f47f-a954-473c-9cb2-64fce231558d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:18.293662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af08f47f-a954-473c-9cb2-64fce231558d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:18.294111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af08f47f-a954-473c-9cb2-64fce231558d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:18.294501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23aa32d9-0ecf-468f-8dd5-777aaa495521 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:18.295479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23aa32d9-0ecf-468f-8dd5-777aaa495521 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:18.296527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af08f47f-a954-473c-9cb2-64fce231558d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:18.299286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23aa32d9-0ecf-468f-8dd5-777aaa495521 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:18.299833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-23aa32d9-0ecf-468f-8dd5-777aaa495521 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:18.523756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-23aa32d9-0ecf-468f-8dd5-777aaa495521 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:18.527855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-af08f47f-a954-473c-9cb2-64fce231558d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:18.536270 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-af08f47f-a954-473c-9cb2-64fce231558d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1203 microversion: 2.1 time: 0.278782 Oct 11 20:21:18.537049 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2927/5894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:18 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1203 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:18.542751 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-23aa32d9-0ecf-468f-8dd5-777aaa495521 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1507 microversion: 2.1 time: 0.280545 Oct 11 20:21:18.543786 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2968/5895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:18 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:18.566410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b7562ec0-c7cc-4182-ac3f-6f6e1f31bf41 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf8b7cf9-ac5a-4301-923e-90b235c8fea4", "device": "/dev/sdb"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:18.569060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b7562ec0-c7cc-4182-ac3f-6f6e1f31bf41 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:18.576124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7562ec0-c7cc-4182-ac3f-6f6e1f31bf41 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:18.576679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7562ec0-c7cc-4182-ac3f-6f6e1f31bf41 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:18.577120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7562ec0-c7cc-4182-ac3f-6f6e1f31bf41 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:18.577820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7562ec0-c7cc-4182-ac3f-6f6e1f31bf41 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:18.578508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7562ec0-c7cc-4182-ac3f-6f6e1f31bf41 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:18.579168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7562ec0-c7cc-4182-ac3f-6f6e1f31bf41 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:18.845644 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b7562ec0-c7cc-4182-ac3f-6f6e1f31bf41 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "POST /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283154 Oct 11 20:21:18.846309 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2928/5896] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:21:18 2022] POST /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:21:19.560134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e95186a-7b41-49e2-a3c4-b616395520e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:19.561092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e95186a-7b41-49e2-a3c4-b616395520e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:19.570222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e95186a-7b41-49e2-a3c4-b616395520e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:19.570891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e95186a-7b41-49e2-a3c4-b616395520e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:19.571997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e95186a-7b41-49e2-a3c4-b616395520e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:19.572933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e95186a-7b41-49e2-a3c4-b616395520e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:19.573487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e95186a-7b41-49e2-a3c4-b616395520e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:19.574135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e95186a-7b41-49e2-a3c4-b616395520e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:19.749937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e95186a-7b41-49e2-a3c4-b616395520e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:19.761352 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e95186a-7b41-49e2-a3c4-b616395520e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1203 microversion: 2.1 time: 0.205542 Oct 11 20:21:19.769422 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2969/5897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:19 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1203 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:20.792444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-313543b5-3da2-4a82-b72b-c373a5a674fc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:20.794430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-313543b5-3da2-4a82-b72b-c373a5a674fc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:20.833969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-313543b5-3da2-4a82-b72b-c373a5a674fc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:20.835184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-313543b5-3da2-4a82-b72b-c373a5a674fc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:20.835772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-313543b5-3da2-4a82-b72b-c373a5a674fc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:20.838471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-313543b5-3da2-4a82-b72b-c373a5a674fc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:20.839219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-313543b5-3da2-4a82-b72b-c373a5a674fc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:20.840005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-313543b5-3da2-4a82-b72b-c373a5a674fc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:21.012309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-313543b5-3da2-4a82-b72b-c373a5a674fc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:21.021205 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-313543b5-3da2-4a82-b72b-c373a5a674fc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1203 microversion: 2.1 time: 0.236586 Oct 11 20:21:21.040492 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2929/5898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:20 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1203 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:22.049176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d35611d-7800-4eb4-a39a-fbaccceeecd8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:22.050040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0d35611d-7800-4eb4-a39a-fbaccceeecd8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:22.058465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d35611d-7800-4eb4-a39a-fbaccceeecd8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:22.059239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d35611d-7800-4eb4-a39a-fbaccceeecd8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:22.060212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d35611d-7800-4eb4-a39a-fbaccceeecd8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:22.061135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d35611d-7800-4eb4-a39a-fbaccceeecd8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:22.061813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d35611d-7800-4eb4-a39a-fbaccceeecd8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:22.062470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d35611d-7800-4eb4-a39a-fbaccceeecd8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:22.235038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0d35611d-7800-4eb4-a39a-fbaccceeecd8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:22.244276 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0d35611d-7800-4eb4-a39a-fbaccceeecd8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1203 microversion: 2.1 time: 0.199424 Oct 11 20:21:22.244867 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2970/5899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:22 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1203 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:23.266424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f7aa7a1b-ceac-4c36-8fc1-a2853e4896d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:23.267067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f7aa7a1b-ceac-4c36-8fc1-a2853e4896d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:23.274144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7aa7a1b-ceac-4c36-8fc1-a2853e4896d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:23.274681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7aa7a1b-ceac-4c36-8fc1-a2853e4896d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:23.275124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7aa7a1b-ceac-4c36-8fc1-a2853e4896d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:23.276041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7aa7a1b-ceac-4c36-8fc1-a2853e4896d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:23.276506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7aa7a1b-ceac-4c36-8fc1-a2853e4896d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:23.276932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7aa7a1b-ceac-4c36-8fc1-a2853e4896d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:23.428860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f7aa7a1b-ceac-4c36-8fc1-a2853e4896d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:23.438331 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f7aa7a1b-ceac-4c36-8fc1-a2853e4896d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1203 microversion: 2.1 time: 0.175272 Oct 11 20:21:23.439681 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2930/5900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:23 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:24.462074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f2c4a4cc-8c47-4c65-b9f4-af433b69e44d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:24.463646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f2c4a4cc-8c47-4c65-b9f4-af433b69e44d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:24.475424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2c4a4cc-8c47-4c65-b9f4-af433b69e44d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:24.480109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2c4a4cc-8c47-4c65-b9f4-af433b69e44d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:24.480573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2c4a4cc-8c47-4c65-b9f4-af433b69e44d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:24.481309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2c4a4cc-8c47-4c65-b9f4-af433b69e44d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:24.485147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2c4a4cc-8c47-4c65-b9f4-af433b69e44d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:24.485793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f2c4a4cc-8c47-4c65-b9f4-af433b69e44d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:24.731941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f2c4a4cc-8c47-4c65-b9f4-af433b69e44d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:24.739778 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f2c4a4cc-8c47-4c65-b9f4-af433b69e44d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1203 microversion: 2.1 time: 0.282351 Oct 11 20:21:24.755008 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2971/5901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:24 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1203 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:25.762642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c76f1d63-2e10-43db-8762-0f878fcc694e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:25.763907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c76f1d63-2e10-43db-8762-0f878fcc694e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:25.772604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c76f1d63-2e10-43db-8762-0f878fcc694e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:25.773329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c76f1d63-2e10-43db-8762-0f878fcc694e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:25.774051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c76f1d63-2e10-43db-8762-0f878fcc694e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:25.775259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c76f1d63-2e10-43db-8762-0f878fcc694e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:25.775886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c76f1d63-2e10-43db-8762-0f878fcc694e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:25.776468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c76f1d63-2e10-43db-8762-0f878fcc694e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:26.660825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c76f1d63-2e10-43db-8762-0f878fcc694e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:26.670041 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c76f1d63-2e10-43db-8762-0f878fcc694e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1203 microversion: 2.1 time: 0.912037 Oct 11 20:21:26.670827 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2931/5902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:25 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1203 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:27.693170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-17c91324-ef6a-4946-82ac-2f0d8fe53730 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:27.694388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-17c91324-ef6a-4946-82ac-2f0d8fe53730 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:27.702432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17c91324-ef6a-4946-82ac-2f0d8fe53730 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:27.703244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17c91324-ef6a-4946-82ac-2f0d8fe53730 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:27.703837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17c91324-ef6a-4946-82ac-2f0d8fe53730 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:27.704720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17c91324-ef6a-4946-82ac-2f0d8fe53730 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:27.705337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17c91324-ef6a-4946-82ac-2f0d8fe53730 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:27.705935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-17c91324-ef6a-4946-82ac-2f0d8fe53730 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:27.899057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-59f78038-f87b-48dc-af29-8173411ca43e req-439c70b1-9f18-40ae-8705-2d91b41f55d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de24d37-9854-494e-90d4-633f1a262c06", "name": "network-vif-plugged", "status": "completed", "tag": "c174386a-2add-41d2-bde3-1238d16b7090"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:27.923984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-17c91324-ef6a-4946-82ac-2f0d8fe53730 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:27.933210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-59f78038-f87b-48dc-af29-8173411ca43e req-439c70b1-9f18-40ae-8705-2d91b41f55d6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:27.933713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-59f78038-f87b-48dc-af29-8173411ca43e req-439c70b1-9f18-40ae-8705-2d91b41f55d6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:27.934155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-59f78038-f87b-48dc-af29-8173411ca43e req-439c70b1-9f18-40ae-8705-2d91b41f55d6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:27.939304 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-17c91324-ef6a-4946-82ac-2f0d8fe53730 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1203 microversion: 2.1 time: 0.249846 Oct 11 20:21:27.951952 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2972/5903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:27 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1203 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:27.974511 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-59f78038-f87b-48dc-af29-8173411ca43e req-439c70b1-9f18-40ae-8705-2d91b41f55d6 service nova] Creating event network-vif-plugged:c174386a-2add-41d2-bde3-1238d16b7090 for instance 1de24d37-9854-494e-90d4-633f1a262c06 on n-h1-860864-3 Oct 11 20:21:27.982652 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-59f78038-f87b-48dc-af29-8173411ca43e req-439c70b1-9f18-40ae-8705-2d91b41f55d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111195 Oct 11 20:21:27.983816 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2932/5904] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:21:28.964691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9f23d534-c315-4634-931b-1f610dc7f2fe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:28.965299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9f23d534-c315-4634-931b-1f610dc7f2fe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:28.972147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f23d534-c315-4634-931b-1f610dc7f2fe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:28.972629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f23d534-c315-4634-931b-1f610dc7f2fe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:28.973063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f23d534-c315-4634-931b-1f610dc7f2fe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:28.973740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f23d534-c315-4634-931b-1f610dc7f2fe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:28.974191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f23d534-c315-4634-931b-1f610dc7f2fe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:28.974644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9f23d534-c315-4634-931b-1f610dc7f2fe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:29.112366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9f23d534-c315-4634-931b-1f610dc7f2fe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:29.120726 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9f23d534-c315-4634-931b-1f610dc7f2fe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1203 microversion: 2.1 time: 0.160519 Oct 11 20:21:29.121294 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2973/5905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:28 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:30.147947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-44b0d0f1-3328-4ada-8550-abc56983529d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:30.150080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-44b0d0f1-3328-4ada-8550-abc56983529d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:30.156321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b0d0f1-3328-4ada-8550-abc56983529d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:30.156809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b0d0f1-3328-4ada-8550-abc56983529d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:30.157250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b0d0f1-3328-4ada-8550-abc56983529d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:30.157941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b0d0f1-3328-4ada-8550-abc56983529d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:30.158402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b0d0f1-3328-4ada-8550-abc56983529d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:30.158918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44b0d0f1-3328-4ada-8550-abc56983529d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:30.295462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-44b0d0f1-3328-4ada-8550-abc56983529d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:30.306370 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-44b0d0f1-3328-4ada-8550-abc56983529d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1389 microversion: 2.1 time: 0.163310 Oct 11 20:21:30.308085 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2933/5906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:30 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:21:30.330838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c864dadf-8a07-495c-aeda-263aeee389a0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:30.332595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c864dadf-8a07-495c-aeda-263aeee389a0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:30.341073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c864dadf-8a07-495c-aeda-263aeee389a0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:30.341969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c864dadf-8a07-495c-aeda-263aeee389a0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:30.342939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c864dadf-8a07-495c-aeda-263aeee389a0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:30.343962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c864dadf-8a07-495c-aeda-263aeee389a0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:30.344639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c864dadf-8a07-495c-aeda-263aeee389a0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:30.345899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c864dadf-8a07-495c-aeda-263aeee389a0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:30.489441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c864dadf-8a07-495c-aeda-263aeee389a0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:30.494281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:30.500987 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c864dadf-8a07-495c-aeda-263aeee389a0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1389 microversion: 2.1 time: 0.175211 Oct 11 20:21:30.501928 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2974/5907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:30 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1389 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:30.524635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f3cc687e-2972-428e-94c0-e931def501ae tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:30.525537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f3cc687e-2972-428e-94c0-e931def501ae tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:30.533009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3cc687e-2972-428e-94c0-e931def501ae tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:30.534016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3cc687e-2972-428e-94c0-e931def501ae tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:30.534707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3cc687e-2972-428e-94c0-e931def501ae tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:30.535621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3cc687e-2972-428e-94c0-e931def501ae tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:30.536284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3cc687e-2972-428e-94c0-e931def501ae tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:30.536979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f3cc687e-2972-428e-94c0-e931def501ae tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:30.689648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f3cc687e-2972-428e-94c0-e931def501ae tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:30.697438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:30.704803 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f3cc687e-2972-428e-94c0-e931def501ae tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1389 microversion: 2.1 time: 0.182926 Oct 11 20:21:30.715227 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2934/5908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:30 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1389 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:30.736002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-517dbd43-ab35-4d37-80c6-fbc092d86937 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:30.736647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-517dbd43-ab35-4d37-80c6-fbc092d86937 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:30.744281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-517dbd43-ab35-4d37-80c6-fbc092d86937 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:30.745750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-517dbd43-ab35-4d37-80c6-fbc092d86937 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:30.746275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-517dbd43-ab35-4d37-80c6-fbc092d86937 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:30.747314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-517dbd43-ab35-4d37-80c6-fbc092d86937 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:30.748313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-517dbd43-ab35-4d37-80c6-fbc092d86937 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:30.748960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-517dbd43-ab35-4d37-80c6-fbc092d86937 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:30.785891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-517dbd43-ab35-4d37-80c6-fbc092d86937 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:21:30.869180 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-517dbd43-ab35-4d37-80c6-fbc092d86937 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 204 len: 0 microversion: 2.1 time: 0.137649 Oct 11 20:21:30.869925 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2975/5909] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:21:30 2022] DELETE /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:21:30.878426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7f3bbbf2-4925-4d1b-becd-31dbe024f6c7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:30.879153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7f3bbbf2-4925-4d1b-becd-31dbe024f6c7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:30.887281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f3bbbf2-4925-4d1b-becd-31dbe024f6c7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:30.887874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f3bbbf2-4925-4d1b-becd-31dbe024f6c7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:30.888405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f3bbbf2-4925-4d1b-becd-31dbe024f6c7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:30.889176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f3bbbf2-4925-4d1b-becd-31dbe024f6c7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:30.889711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f3bbbf2-4925-4d1b-becd-31dbe024f6c7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:30.890207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f3bbbf2-4925-4d1b-becd-31dbe024f6c7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:31.028954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7f3bbbf2-4925-4d1b-becd-31dbe024f6c7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:31.038439 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7f3bbbf2-4925-4d1b-becd-31dbe024f6c7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1395 microversion: 2.1 time: 0.164039 Oct 11 20:21:31.047149 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2935/5910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:30 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:21:32.064852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6d0b2198-f653-40d7-aa08-e308d00a4565 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:32.065583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6d0b2198-f653-40d7-aa08-e308d00a4565 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:32.084299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d0b2198-f653-40d7-aa08-e308d00a4565 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:32.084299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d0b2198-f653-40d7-aa08-e308d00a4565 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:32.084299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d0b2198-f653-40d7-aa08-e308d00a4565 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:32.084547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d0b2198-f653-40d7-aa08-e308d00a4565 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:32.084993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d0b2198-f653-40d7-aa08-e308d00a4565 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:32.085426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6d0b2198-f653-40d7-aa08-e308d00a4565 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:32.249387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6d0b2198-f653-40d7-aa08-e308d00a4565 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:32.262785 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6d0b2198-f653-40d7-aa08-e308d00a4565 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1395 microversion: 2.1 time: 0.202433 Oct 11 20:21:32.264049 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2976/5911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:32 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1395 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:33.222340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-bbd946c8-fdcc-4b7d-8172-7229fbbbaae2 req-6c3df61b-04f5-43b9-8111-74afc73dd9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de24d37-9854-494e-90d4-633f1a262c06", "name": "network-vif-deleted", "tag": "c174386a-2add-41d2-bde3-1238d16b7090"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:33.264927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bbd946c8-fdcc-4b7d-8172-7229fbbbaae2 req-6c3df61b-04f5-43b9-8111-74afc73dd9b8 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:33.266449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bbd946c8-fdcc-4b7d-8172-7229fbbbaae2 req-6c3df61b-04f5-43b9-8111-74afc73dd9b8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:33.267099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bbd946c8-fdcc-4b7d-8172-7229fbbbaae2 req-6c3df61b-04f5-43b9-8111-74afc73dd9b8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:33.286956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-638b05cc-fd2d-4fe9-b910-037e13e0de60 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:33.287581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-638b05cc-fd2d-4fe9-b910-037e13e0de60 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:33.291623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:33.313159 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-bbd946c8-fdcc-4b7d-8172-7229fbbbaae2 req-6c3df61b-04f5-43b9-8111-74afc73dd9b8 service nova] Creating event network-vif-deleted:c174386a-2add-41d2-bde3-1238d16b7090 for instance 1de24d37-9854-494e-90d4-633f1a262c06 on n-h1-860864-3 Oct 11 20:21:33.315946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-638b05cc-fd2d-4fe9-b910-037e13e0de60 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:33.318807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-638b05cc-fd2d-4fe9-b910-037e13e0de60 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:33.319519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-638b05cc-fd2d-4fe9-b910-037e13e0de60 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:33.322386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-638b05cc-fd2d-4fe9-b910-037e13e0de60 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:33.323359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-638b05cc-fd2d-4fe9-b910-037e13e0de60 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:33.324110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-638b05cc-fd2d-4fe9-b910-037e13e0de60 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:33.333465 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-bbd946c8-fdcc-4b7d-8172-7229fbbbaae2 req-6c3df61b-04f5-43b9-8111-74afc73dd9b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114641 Oct 11 20:21:33.335626 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2936/5912] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:21:33.517980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-638b05cc-fd2d-4fe9-b910-037e13e0de60 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:33.545299 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-638b05cc-fd2d-4fe9-b910-037e13e0de60 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1188 microversion: 2.1 time: 0.261810 Oct 11 20:21:33.546789 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2977/5913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:33 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1188 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:34.570548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0fd01db-9f65-4a52-a98b-1ae6e7af3ec6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:34.572500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a0fd01db-9f65-4a52-a98b-1ae6e7af3ec6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:34.576760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:34.589011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0fd01db-9f65-4a52-a98b-1ae6e7af3ec6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:34.589592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0fd01db-9f65-4a52-a98b-1ae6e7af3ec6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:34.589962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0fd01db-9f65-4a52-a98b-1ae6e7af3ec6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:34.590728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0fd01db-9f65-4a52-a98b-1ae6e7af3ec6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:34.591190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0fd01db-9f65-4a52-a98b-1ae6e7af3ec6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:34.591618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0fd01db-9f65-4a52-a98b-1ae6e7af3ec6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:34.745522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a0fd01db-9f65-4a52-a98b-1ae6e7af3ec6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:34.767845 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a0fd01db-9f65-4a52-a98b-1ae6e7af3ec6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1188 microversion: 2.1 time: 0.202111 Oct 11 20:21:34.768752 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2937/5914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:34 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1188 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:35.797763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-da1f3a17-fba0-4b76-91de-5c0d26781043 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:35.799297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-da1f3a17-fba0-4b76-91de-5c0d26781043 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:35.808211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da1f3a17-fba0-4b76-91de-5c0d26781043 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:35.809972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da1f3a17-fba0-4b76-91de-5c0d26781043 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:35.810740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da1f3a17-fba0-4b76-91de-5c0d26781043 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:35.811861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da1f3a17-fba0-4b76-91de-5c0d26781043 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:35.812502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da1f3a17-fba0-4b76-91de-5c0d26781043 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:35.813360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da1f3a17-fba0-4b76-91de-5c0d26781043 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:36.002738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-da1f3a17-fba0-4b76-91de-5c0d26781043 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:36.015529 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-da1f3a17-fba0-4b76-91de-5c0d26781043 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1188 microversion: 2.1 time: 0.224660 Oct 11 20:21:36.025779 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2978/5915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:35 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1188 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:37.041082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-839ce9c0-106e-49a9-ac3e-cb326dbed9e3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:37.042326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-839ce9c0-106e-49a9-ac3e-cb326dbed9e3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:37.049972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-839ce9c0-106e-49a9-ac3e-cb326dbed9e3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:37.050960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-839ce9c0-106e-49a9-ac3e-cb326dbed9e3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:37.051770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-839ce9c0-106e-49a9-ac3e-cb326dbed9e3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:37.052821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-839ce9c0-106e-49a9-ac3e-cb326dbed9e3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:37.053723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-839ce9c0-106e-49a9-ac3e-cb326dbed9e3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:37.063136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-839ce9c0-106e-49a9-ac3e-cb326dbed9e3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:37.160656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-839ce9c0-106e-49a9-ac3e-cb326dbed9e3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:37.169605 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-839ce9c0-106e-49a9-ac3e-cb326dbed9e3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1188 microversion: 2.1 time: 0.133069 Oct 11 20:21:37.170367 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2938/5916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:37 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1188 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:38.192779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae025466-e1a1-4f75-9710-2ad715bbe400 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:38.193541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ae025466-e1a1-4f75-9710-2ad715bbe400 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:38.201167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae025466-e1a1-4f75-9710-2ad715bbe400 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:38.201669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae025466-e1a1-4f75-9710-2ad715bbe400 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:38.202105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae025466-e1a1-4f75-9710-2ad715bbe400 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:38.203023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae025466-e1a1-4f75-9710-2ad715bbe400 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:38.203630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae025466-e1a1-4f75-9710-2ad715bbe400 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:38.204070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae025466-e1a1-4f75-9710-2ad715bbe400 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:38.294360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae025466-e1a1-4f75-9710-2ad715bbe400 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:38.308476 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae025466-e1a1-4f75-9710-2ad715bbe400 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1188 microversion: 2.1 time: 0.119529 Oct 11 20:21:38.309683 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2979/5917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:38 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:39.342805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8d4c53cd-daf2-4b60-86c0-e3ffde7d2bf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:39.343949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8d4c53cd-daf2-4b60-86c0-e3ffde7d2bf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:39.353673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d4c53cd-daf2-4b60-86c0-e3ffde7d2bf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:39.354438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d4c53cd-daf2-4b60-86c0-e3ffde7d2bf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:39.355171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d4c53cd-daf2-4b60-86c0-e3ffde7d2bf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:39.356087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d4c53cd-daf2-4b60-86c0-e3ffde7d2bf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:39.356697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d4c53cd-daf2-4b60-86c0-e3ffde7d2bf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:39.357379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d4c53cd-daf2-4b60-86c0-e3ffde7d2bf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:39.483745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8d4c53cd-daf2-4b60-86c0-e3ffde7d2bf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:39.493620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8d4c53cd-daf2-4b60-86c0-e3ffde7d2bf1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 200 len: 1188 microversion: 2.1 time: 0.162620 Oct 11 20:21:39.502941 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2939/5918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:39 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 1188 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:40.520073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:40.520695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 1de24d37-9854-494e-90d4-633f1a262c06] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:40.529352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:40.530126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:40.530975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:40.531862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:40.532502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:40.533086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:40.548550 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 1de24d37-9854-494e-90d4-633f1a262c06 could not be found. Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 HTTP/1.1 Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 1de24d37-9854-494e-90d4-633f1a262c06 could not be found. Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '1de24d37-9854-494e-90d4-633f1a262c06'} Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de24d37-9854-494e-90d4-633f1a262c06 could not be found. Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de24d37-9854-494e-90d4-633f1a262c06 could not be found. Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:21:40.550216 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:21:40.555399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:21:40.555399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:21:40.555399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:21:40.555399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:21:40.555399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:21:40.555399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de24d37-9854-494e-90d4-633f1a262c06 could not be found. Oct 11 20:21:40.555399 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:21:40.555399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 1de24d37-9854-494e-90d4-633f1a262c06 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:21:40.555399 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2ce750d2-a3ea-42dd-a139-25a321e91fb1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06" status: 404 len: 111 microversion: 2.1 time: 0.036369 Oct 11 20:21:40.559886 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2980/5919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:40 2022] GET /compute/v2.1/servers/1de24d37-9854-494e-90d4-633f1a262c06 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:21:44.082758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1bc342d7-34d9-4325-a74f-11b9e22f2823 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:44.083408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1bc342d7-34d9-4325-a74f-11b9e22f2823 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:44.095391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bc342d7-34d9-4325-a74f-11b9e22f2823 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:44.096396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bc342d7-34d9-4325-a74f-11b9e22f2823 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:44.096920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bc342d7-34d9-4325-a74f-11b9e22f2823 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:44.097716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bc342d7-34d9-4325-a74f-11b9e22f2823 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:44.098265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bc342d7-34d9-4325-a74f-11b9e22f2823 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:44.098797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bc342d7-34d9-4325-a74f-11b9e22f2823 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:44.206996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-1bc342d7-34d9-4325-a74f-11b9e22f2823 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lazy-loading 'services' on Instance uuid 126b8538-c9e4-438e-a3cf-fed38d24036b {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:21:44.319493 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1bc342d7-34d9-4325-a74f-11b9e22f2823 tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b/os-volume_attachments/cf8b7cf9-ac5a-4301-923e-90b235c8fea4" status: 202 len: 0 microversion: 2.1 time: 0.240268 Oct 11 20:21:44.327019 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2940/5920] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:21:44 2022] DELETE /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b/os-volume_attachments/cf8b7cf9-ac5a-4301-923e-90b235c8fea4 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:21:49.993495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1842160153", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a2cc2bad-317b-4a9c-9f10-fd9546ace039", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06296b2d-bf7f-4d21-bab0-dfde6b2c7622"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:50.166672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] validate_networks() for [('06296b2d-bf7f-4d21-bab0-dfde6b2c7622', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:21:50.538941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:21:50.838238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:21:50.838765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:21:50.839331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:21:50.839888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:21:50.840370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:21:50.860037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:50.860918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:50.861597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:50.862660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:50.863397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:50.864081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:50.909866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:21:50.917959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for user cbcf07bc33104f78adbcd3dfa198a570 and project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:21:51.004837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:21:51.008427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2cc2bad-317b-4a9c-9f10-fd9546ace039',volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:21:51.379120 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0012050-5d38-41fe-88ad-362e64e1fe47 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.386144 Oct 11 20:21:51.380776 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2981/5921] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:21:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:21:51.393919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b34384d1-2c9a-4f6b-b579-c414d2932068 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:51.394666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b34384d1-2c9a-4f6b-b579-c414d2932068 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:51.546028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b34384d1-2c9a-4f6b-b579-c414d2932068 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:51.561143 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b34384d1-2c9a-4f6b-b579-c414d2932068 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1057 microversion: 2.1 time: 0.172836 Oct 11 20:21:51.561750 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2941/5922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:51 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1057 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:52.236412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d67dca25-ba46-448d-9584-b17c59c9312b tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:52.236999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d67dca25-ba46-448d-9584-b17c59c9312b tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:52.249598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d67dca25-ba46-448d-9584-b17c59c9312b tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:52.250088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d67dca25-ba46-448d-9584-b17c59c9312b tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:52.250557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d67dca25-ba46-448d-9584-b17c59c9312b tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:52.251437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d67dca25-ba46-448d-9584-b17c59c9312b tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:52.251984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d67dca25-ba46-448d-9584-b17c59c9312b tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:52.252589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d67dca25-ba46-448d-9584-b17c59c9312b tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:52.302217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d67dca25-ba46-448d-9584-b17c59c9312b tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:21:52.414815 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d67dca25-ba46-448d-9584-b17c59c9312b tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 204 len: 0 microversion: 2.1 time: 0.182795 Oct 11 20:21:52.418566 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2982/5923] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:21:52 2022] DELETE /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:21:52.423846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7dc7fc00-ce19-481c-ac02-fd5697056f7e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:52.425041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7dc7fc00-ce19-481c-ac02-fd5697056f7e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:52.433330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7dc7fc00-ce19-481c-ac02-fd5697056f7e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:52.434066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7dc7fc00-ce19-481c-ac02-fd5697056f7e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:52.434802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7dc7fc00-ce19-481c-ac02-fd5697056f7e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:52.435726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7dc7fc00-ce19-481c-ac02-fd5697056f7e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:52.436592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7dc7fc00-ce19-481c-ac02-fd5697056f7e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:52.437190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7dc7fc00-ce19-481c-ac02-fd5697056f7e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:52.588090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f33f4b9e-a347-4659-9eb3-db22219efe76 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:52.588805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f33f4b9e-a347-4659-9eb3-db22219efe76 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:52.597121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f33f4b9e-a347-4659-9eb3-db22219efe76 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:52.597624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f33f4b9e-a347-4659-9eb3-db22219efe76 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:52.598059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f33f4b9e-a347-4659-9eb3-db22219efe76 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:52.598791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f33f4b9e-a347-4659-9eb3-db22219efe76 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:52.599243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f33f4b9e-a347-4659-9eb3-db22219efe76 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:52.599676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f33f4b9e-a347-4659-9eb3-db22219efe76 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:52.611568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7dc7fc00-ce19-481c-ac02-fd5697056f7e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:52.621938 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7dc7fc00-ce19-481c-ac02-fd5697056f7e tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1513 microversion: 2.1 time: 0.202149 Oct 11 20:21:52.623165 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2942/5924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:52 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:52.699860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f33f4b9e-a347-4659-9eb3-db22219efe76 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:52.711061 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f33f4b9e-a347-4659-9eb3-db22219efe76 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1155 microversion: 2.1 time: 0.127078 Oct 11 20:21:52.711772 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2983/5925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:52 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1155 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:53.651696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-febe8766-d47b-4326-ad27-8b2ebf34c1da tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:53.653361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-febe8766-d47b-4326-ad27-8b2ebf34c1da tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:53.661262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-febe8766-d47b-4326-ad27-8b2ebf34c1da tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:53.662416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-febe8766-d47b-4326-ad27-8b2ebf34c1da tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:53.663734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-febe8766-d47b-4326-ad27-8b2ebf34c1da tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:53.664695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-febe8766-d47b-4326-ad27-8b2ebf34c1da tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:53.665397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-febe8766-d47b-4326-ad27-8b2ebf34c1da tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:53.666037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-febe8766-d47b-4326-ad27-8b2ebf34c1da tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:53.736526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8077f6e8-ca42-4976-9f58-4147b4436c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:53.737299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8077f6e8-ca42-4976-9f58-4147b4436c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:53.753522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8077f6e8-ca42-4976-9f58-4147b4436c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:53.758673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8077f6e8-ca42-4976-9f58-4147b4436c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:53.759110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8077f6e8-ca42-4976-9f58-4147b4436c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:53.763311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8077f6e8-ca42-4976-9f58-4147b4436c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:53.764351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8077f6e8-ca42-4976-9f58-4147b4436c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:53.764951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8077f6e8-ca42-4976-9f58-4147b4436c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:54.005948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8077f6e8-ca42-4976-9f58-4147b4436c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:54.029337 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8077f6e8-ca42-4976-9f58-4147b4436c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1215 microversion: 2.1 time: 0.298460 Oct 11 20:21:54.030562 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2984/5926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:53 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1215 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:21:54.453384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-febe8766-d47b-4326-ad27-8b2ebf34c1da tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4ea8b90e6f480f8480dafec996bbcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70d2e9b4f464eefac9d4c5ab51c47f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:54.470314 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-febe8766-d47b-4326-ad27-8b2ebf34c1da tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 200 len: 1513 microversion: 2.1 time: 0.822926 Oct 11 20:21:54.470314 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2943/5927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:53 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 1513 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:54.773477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-794b3ef5-0986-4c39-90b2-a8eac76c112f req-615f2a49-84b9-448f-bf07-fba51f487d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "126b8538-c9e4-438e-a3cf-fed38d24036b", "name": "network-vif-deleted", "tag": "d0aa3fe9-e56c-4472-9202-18c6e56232ab"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:54.788858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-794b3ef5-0986-4c39-90b2-a8eac76c112f req-615f2a49-84b9-448f-bf07-fba51f487d50 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:54.789704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-794b3ef5-0986-4c39-90b2-a8eac76c112f req-615f2a49-84b9-448f-bf07-fba51f487d50 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:54.791039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-794b3ef5-0986-4c39-90b2-a8eac76c112f req-615f2a49-84b9-448f-bf07-fba51f487d50 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:54.817374 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-794b3ef5-0986-4c39-90b2-a8eac76c112f req-615f2a49-84b9-448f-bf07-fba51f487d50 service nova] Creating event network-vif-deleted:d0aa3fe9-e56c-4472-9202-18c6e56232ab for instance 126b8538-c9e4-438e-a3cf-fed38d24036b on n-h2-860864-3 Oct 11 20:21:54.843464 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-794b3ef5-0986-4c39-90b2-a8eac76c112f req-615f2a49-84b9-448f-bf07-fba51f487d50 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077475 Oct 11 20:21:54.849774 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2985/5928] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:21:55.056745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f7c3b8a4-a5b3-48f7-8a1b-0fecb6288fcd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:55.057372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f7c3b8a4-a5b3-48f7-8a1b-0fecb6288fcd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:55.066949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7c3b8a4-a5b3-48f7-8a1b-0fecb6288fcd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:55.067449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7c3b8a4-a5b3-48f7-8a1b-0fecb6288fcd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:55.067898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7c3b8a4-a5b3-48f7-8a1b-0fecb6288fcd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:55.068613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7c3b8a4-a5b3-48f7-8a1b-0fecb6288fcd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:55.069196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7c3b8a4-a5b3-48f7-8a1b-0fecb6288fcd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:55.069632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f7c3b8a4-a5b3-48f7-8a1b-0fecb6288fcd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:55.276186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f7c3b8a4-a5b3-48f7-8a1b-0fecb6288fcd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:55.297925 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f7c3b8a4-a5b3-48f7-8a1b-0fecb6288fcd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1215 microversion: 2.1 time: 0.245647 Oct 11 20:21:55.298558 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2944/5929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:55 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:55.497241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:55.497948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] [instance: 126b8538-c9e4-438e-a3cf-fed38d24036b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:55.511356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:55.514568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:55.515208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:55.517103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:55.517895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:55.520175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:55.545068 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] HTTP exception thrown: Instance 126b8538-c9e4-438e-a3cf-fed38d24036b could not be found. Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Request method failure captured: Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b HTTP/1.1 Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRc-C83PE7QfQ4dGlA3bKIpxBXmQlkcGjEJS0Wo6ks0-V5SD4KArqEfw10pTqaQGrZaWf_wrKiOiTxybKpnZhNiwBNVT3fPGtJDNne5rJd5nCqmSyehTe9fVPndJkSE5nJ--nFkAIOiOSPHjIOGYdMUegBloXJRqEZAwqHnSA4slsQ5I Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: a70d2e9b4f464eefac9d4c5ab51c47f2 Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-VolumesSnapshotTestJSON-938310633 Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a70d2e9b4f464eefac9d4c5ab51c47f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a70d2e9b4f464eefac9d4c5ab51c47f2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a70d2e9b4f464eefac9d4c5ab51c47f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a70d2e9b4f464eefac9d4c5ab51c47f2"}]}] Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-VolumesSnapshotTestJSON-938310633 Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: a70d2e9b4f464eefac9d4c5ab51c47f2 Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-938310633 Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-VolumesSnapshotTestJSON-938310633-project Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: ae4ea8b90e6f480f8480dafec996bbcb Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-VolumesSnapshotTestJSON-938310633-project Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 126b8538-c9e4-438e-a3cf-fed38d24036b could not be found. Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '126b8538-c9e4-438e-a3cf-fed38d24036b'} Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 126b8538-c9e4-438e-a3cf-fed38d24036b could not be found. Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 126b8538-c9e4-438e-a3cf-fed38d24036b could not be found. Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:21:55.549283 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:21:55.554473 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:21:55.554473 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:21:55.554473 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:21:55.554473 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:21:55.554473 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:21:55.554473 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 126b8538-c9e4-438e-a3cf-fed38d24036b could not be found. Oct 11 20:21:55.554473 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:21:55.556067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] Returning 404 to user: Instance 126b8538-c9e4-438e-a3cf-fed38d24036b could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:21:55.557124 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bb50ab87-d646-4a8f-8d70-0804e3457d4f tempest-VolumesSnapshotTestJSON-938310633 tempest-VolumesSnapshotTestJSON-938310633-project] 10.222.0.27 "GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b" status: 404 len: 111 microversion: 2.1 time: 0.064394 Oct 11 20:21:55.558039 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2986/5930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:55 2022] GET /compute/v2.1/servers/126b8538-c9e4-438e-a3cf-fed38d24036b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:21:56.145274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-d75bd9dc-bde9-4912-be00-1d833e9d7334 req-7a3e2f23-85e1-4c68-90fd-d5cbbf706daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f8496a-69fe-460f-9e73-2f2d8425ee9a", "tag": "ec0c40cc-2817-4faa-a339-c266604c583d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:21:56.164559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d75bd9dc-bde9-4912-be00-1d833e9d7334 req-7a3e2f23-85e1-4c68-90fd-d5cbbf706daa service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:56.165051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d75bd9dc-bde9-4912-be00-1d833e9d7334 req-7a3e2f23-85e1-4c68-90fd-d5cbbf706daa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:56.165485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-d75bd9dc-bde9-4912-be00-1d833e9d7334 req-7a3e2f23-85e1-4c68-90fd-d5cbbf706daa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:56.215178 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-d75bd9dc-bde9-4912-be00-1d833e9d7334 req-7a3e2f23-85e1-4c68-90fd-d5cbbf706daa service nova] Creating event network-changed:ec0c40cc-2817-4faa-a339-c266604c583d for instance e3f8496a-69fe-460f-9e73-2f2d8425ee9a on n-h1-860864-3 Oct 11 20:21:56.221518 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-d75bd9dc-bde9-4912-be00-1d833e9d7334 req-7a3e2f23-85e1-4c68-90fd-d5cbbf706daa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079586 Oct 11 20:21:56.224930 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2945/5931] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:21:56.326840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-146fff5a-9f93-40b2-8ab3-c50dda8996d8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:56.327457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-146fff5a-9f93-40b2-8ab3-c50dda8996d8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:56.338613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-146fff5a-9f93-40b2-8ab3-c50dda8996d8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:56.339532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-146fff5a-9f93-40b2-8ab3-c50dda8996d8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:56.341123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-146fff5a-9f93-40b2-8ab3-c50dda8996d8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:56.343408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-146fff5a-9f93-40b2-8ab3-c50dda8996d8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:56.356073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-146fff5a-9f93-40b2-8ab3-c50dda8996d8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:56.357617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-146fff5a-9f93-40b2-8ab3-c50dda8996d8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:56.696426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-146fff5a-9f93-40b2-8ab3-c50dda8996d8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:56.710029 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-146fff5a-9f93-40b2-8ab3-c50dda8996d8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1215 microversion: 2.1 time: 0.385360 Oct 11 20:21:56.711876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2987/5932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:56 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1215 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:57.743630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-09481b85-fe67-4597-8e39-e93f2d24d595 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:57.744902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-09481b85-fe67-4597-8e39-e93f2d24d595 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:57.751916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09481b85-fe67-4597-8e39-e93f2d24d595 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:57.752656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09481b85-fe67-4597-8e39-e93f2d24d595 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:57.753284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09481b85-fe67-4597-8e39-e93f2d24d595 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:57.754178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09481b85-fe67-4597-8e39-e93f2d24d595 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:57.754842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09481b85-fe67-4597-8e39-e93f2d24d595 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:57.755454 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09481b85-fe67-4597-8e39-e93f2d24d595 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:58.280902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-09481b85-fe67-4597-8e39-e93f2d24d595 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:58.291676 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-09481b85-fe67-4597-8e39-e93f2d24d595 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1215 microversion: 2.1 time: 0.553035 Oct 11 20:21:58.292878 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2946/5933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:57 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1215 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:21:59.316920 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-087720b9-0cf8-444a-83b9-de067ab1aaf5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:21:59.317834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-087720b9-0cf8-444a-83b9-de067ab1aaf5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:21:59.342437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-087720b9-0cf8-444a-83b9-de067ab1aaf5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:59.342974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-087720b9-0cf8-444a-83b9-de067ab1aaf5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:59.343400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-087720b9-0cf8-444a-83b9-de067ab1aaf5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:59.344118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-087720b9-0cf8-444a-83b9-de067ab1aaf5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:21:59.344575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-087720b9-0cf8-444a-83b9-de067ab1aaf5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:21:59.344999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-087720b9-0cf8-444a-83b9-de067ab1aaf5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:21:59.696972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-087720b9-0cf8-444a-83b9-de067ab1aaf5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:21:59.725859 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-087720b9-0cf8-444a-83b9-de067ab1aaf5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1215 microversion: 2.1 time: 0.412368 Oct 11 20:21:59.730267 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2988/5934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:21:59 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1215 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:00.756470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d4e9a930-f997-4986-80ea-8d8ceb112a82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:00.758162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d4e9a930-f997-4986-80ea-8d8ceb112a82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:00.774960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e9a930-f997-4986-80ea-8d8ceb112a82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:00.778640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e9a930-f997-4986-80ea-8d8ceb112a82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:00.779216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e9a930-f997-4986-80ea-8d8ceb112a82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:00.780021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e9a930-f997-4986-80ea-8d8ceb112a82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:00.780555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e9a930-f997-4986-80ea-8d8ceb112a82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:00.781050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4e9a930-f997-4986-80ea-8d8ceb112a82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:01.001786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d4e9a930-f997-4986-80ea-8d8ceb112a82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:01.010468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:22:01.013074 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d4e9a930-f997-4986-80ea-8d8ceb112a82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1203 microversion: 2.1 time: 0.263324 Oct 11 20:22:01.014164 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2947/5935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:00 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1203 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:02.036933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-516c1e6e-6d62-44f9-8218-ba5b35f9cfa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:02.037726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-516c1e6e-6d62-44f9-8218-ba5b35f9cfa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:02.044265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:22:02.046123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:22:02.048321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-516c1e6e-6d62-44f9-8218-ba5b35f9cfa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:02.049165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-516c1e6e-6d62-44f9-8218-ba5b35f9cfa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:02.049751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-516c1e6e-6d62-44f9-8218-ba5b35f9cfa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:02.050761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-516c1e6e-6d62-44f9-8218-ba5b35f9cfa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:02.051359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-516c1e6e-6d62-44f9-8218-ba5b35f9cfa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:02.051874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-516c1e6e-6d62-44f9-8218-ba5b35f9cfa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:02.290055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-516c1e6e-6d62-44f9-8218-ba5b35f9cfa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:02.307808 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-516c1e6e-6d62-44f9-8218-ba5b35f9cfa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1203 microversion: 2.1 time: 0.274636 Oct 11 20:22:02.309209 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2989/5936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:02 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1203 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:03.336727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5254ff4-607d-4ffe-87ab-49937460e827 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:03.337351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e5254ff4-607d-4ffe-87ab-49937460e827 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:03.340375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:22:03.356717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5254ff4-607d-4ffe-87ab-49937460e827 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:03.361821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5254ff4-607d-4ffe-87ab-49937460e827 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:03.363000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5254ff4-607d-4ffe-87ab-49937460e827 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:03.367058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5254ff4-607d-4ffe-87ab-49937460e827 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:03.367798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5254ff4-607d-4ffe-87ab-49937460e827 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:03.371419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5254ff4-607d-4ffe-87ab-49937460e827 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:03.636145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e5254ff4-607d-4ffe-87ab-49937460e827 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:03.646007 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e5254ff4-607d-4ffe-87ab-49937460e827 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1203 microversion: 2.1 time: 0.314457 Oct 11 20:22:03.658443 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2948/5937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:03 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1203 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:04.674381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b1918d97-71f8-4db6-8c9c-1d71396928e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:04.675947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b1918d97-71f8-4db6-8c9c-1d71396928e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:04.680171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:22:04.690110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1918d97-71f8-4db6-8c9c-1d71396928e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:04.690909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1918d97-71f8-4db6-8c9c-1d71396928e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:04.691521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1918d97-71f8-4db6-8c9c-1d71396928e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:04.692491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1918d97-71f8-4db6-8c9c-1d71396928e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:04.696273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1918d97-71f8-4db6-8c9c-1d71396928e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:04.697046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1918d97-71f8-4db6-8c9c-1d71396928e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:04.988572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b1918d97-71f8-4db6-8c9c-1d71396928e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:05.004009 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b1918d97-71f8-4db6-8c9c-1d71396928e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1203 microversion: 2.1 time: 0.333354 Oct 11 20:22:05.005226 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2990/5938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:04 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1203 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:06.040963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b80be60a-9407-4bf1-8b21-9414c596dd0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:06.045101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b80be60a-9407-4bf1-8b21-9414c596dd0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:06.053249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=26 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:22:06.060210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80be60a-9407-4bf1-8b21-9414c596dd0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:06.061476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80be60a-9407-4bf1-8b21-9414c596dd0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:06.062175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80be60a-9407-4bf1-8b21-9414c596dd0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:06.063348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80be60a-9407-4bf1-8b21-9414c596dd0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:06.064075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80be60a-9407-4bf1-8b21-9414c596dd0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:06.065499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b80be60a-9407-4bf1-8b21-9414c596dd0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:06.312481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b80be60a-9407-4bf1-8b21-9414c596dd0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:06.334474 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b80be60a-9407-4bf1-8b21-9414c596dd0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1203 microversion: 2.1 time: 0.308685 Oct 11 20:22:06.346545 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2949/5939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:06 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1203 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:07.357420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10f65ab5-11da-4b5b-8322-17b71a33f37d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:07.358113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10f65ab5-11da-4b5b-8322-17b71a33f37d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:07.384186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10f65ab5-11da-4b5b-8322-17b71a33f37d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:07.387675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10f65ab5-11da-4b5b-8322-17b71a33f37d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:07.388290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10f65ab5-11da-4b5b-8322-17b71a33f37d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:07.389036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10f65ab5-11da-4b5b-8322-17b71a33f37d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:07.389565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10f65ab5-11da-4b5b-8322-17b71a33f37d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:07.399167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10f65ab5-11da-4b5b-8322-17b71a33f37d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:07.669646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-10f65ab5-11da-4b5b-8322-17b71a33f37d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:07.678741 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10f65ab5-11da-4b5b-8322-17b71a33f37d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1203 microversion: 2.1 time: 0.325382 Oct 11 20:22:07.679941 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2991/5940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:07 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1203 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:08.707872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0c14628-8c63-436f-9a56-f481f7400d8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:08.711833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a0c14628-8c63-436f-9a56-f481f7400d8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:08.721191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c14628-8c63-436f-9a56-f481f7400d8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:08.722043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c14628-8c63-436f-9a56-f481f7400d8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:08.723709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c14628-8c63-436f-9a56-f481f7400d8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:08.725032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c14628-8c63-436f-9a56-f481f7400d8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:08.725718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c14628-8c63-436f-9a56-f481f7400d8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:08.726367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0c14628-8c63-436f-9a56-f481f7400d8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:08.969357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a0c14628-8c63-436f-9a56-f481f7400d8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:08.982914 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a0c14628-8c63-436f-9a56-f481f7400d8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1203 microversion: 2.1 time: 0.282012 Oct 11 20:22:08.983938 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2950/5941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:08 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1203 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:10.018296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-36157b28-fa60-42e0-9267-f1ff968084da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:10.023748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-36157b28-fa60-42e0-9267-f1ff968084da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:10.035484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36157b28-fa60-42e0-9267-f1ff968084da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:10.038627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36157b28-fa60-42e0-9267-f1ff968084da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:10.039374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36157b28-fa60-42e0-9267-f1ff968084da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:10.043883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36157b28-fa60-42e0-9267-f1ff968084da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:10.044369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36157b28-fa60-42e0-9267-f1ff968084da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:10.045064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-36157b28-fa60-42e0-9267-f1ff968084da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:10.460025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-36157b28-fa60-42e0-9267-f1ff968084da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:10.470461 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-36157b28-fa60-42e0-9267-f1ff968084da tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1203 microversion: 2.1 time: 0.468637 Oct 11 20:22:10.482046 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2992/5942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:10 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1203 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:11.509955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe9a5eab-61ac-4c30-bb6f-ff9a5c153f32 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:11.511484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fe9a5eab-61ac-4c30-bb6f-ff9a5c153f32 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:11.530183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9a5eab-61ac-4c30-bb6f-ff9a5c153f32 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:11.530971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9a5eab-61ac-4c30-bb6f-ff9a5c153f32 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:11.531803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9a5eab-61ac-4c30-bb6f-ff9a5c153f32 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:11.532961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9a5eab-61ac-4c30-bb6f-ff9a5c153f32 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:11.533597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9a5eab-61ac-4c30-bb6f-ff9a5c153f32 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:11.534210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe9a5eab-61ac-4c30-bb6f-ff9a5c153f32 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:11.859415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fe9a5eab-61ac-4c30-bb6f-ff9a5c153f32 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:11.870504 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fe9a5eab-61ac-4c30-bb6f-ff9a5c153f32 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1203 microversion: 2.1 time: 0.364974 Oct 11 20:22:11.889024 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2951/5943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:11 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1203 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:12.011385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-264dea5c-dbc4-47e0-aa6d-cc8d3c64c190 req-d9735c19-08dd-48b3-9ac8-c6904ac03246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f8496a-69fe-460f-9e73-2f2d8425ee9a", "name": "network-vif-plugged", "status": "completed", "tag": "ec0c40cc-2817-4faa-a339-c266604c583d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:22:12.031091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-264dea5c-dbc4-47e0-aa6d-cc8d3c64c190 req-d9735c19-08dd-48b3-9ac8-c6904ac03246 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:12.034924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-264dea5c-dbc4-47e0-aa6d-cc8d3c64c190 req-d9735c19-08dd-48b3-9ac8-c6904ac03246 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:12.035376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-264dea5c-dbc4-47e0-aa6d-cc8d3c64c190 req-d9735c19-08dd-48b3-9ac8-c6904ac03246 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:12.064940 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-264dea5c-dbc4-47e0-aa6d-cc8d3c64c190 req-d9735c19-08dd-48b3-9ac8-c6904ac03246 service nova] Creating event network-vif-plugged:ec0c40cc-2817-4faa-a339-c266604c583d for instance e3f8496a-69fe-460f-9e73-2f2d8425ee9a on n-h1-860864-3 Oct 11 20:22:12.090988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-264dea5c-dbc4-47e0-aa6d-cc8d3c64c190 req-d9735c19-08dd-48b3-9ac8-c6904ac03246 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083929 Oct 11 20:22:12.091534 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2993/5944] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:22:12.895364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5bcba340-344a-4374-a97f-0bcacdfa79fb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:12.896922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5bcba340-344a-4374-a97f-0bcacdfa79fb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:12.905890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bcba340-344a-4374-a97f-0bcacdfa79fb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:12.906720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bcba340-344a-4374-a97f-0bcacdfa79fb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:12.907329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bcba340-344a-4374-a97f-0bcacdfa79fb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:12.908404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bcba340-344a-4374-a97f-0bcacdfa79fb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:12.909030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bcba340-344a-4374-a97f-0bcacdfa79fb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:12.909633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bcba340-344a-4374-a97f-0bcacdfa79fb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:13.070797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5bcba340-344a-4374-a97f-0bcacdfa79fb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:13.079339 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5bcba340-344a-4374-a97f-0bcacdfa79fb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1203 microversion: 2.1 time: 0.187918 Oct 11 20:22:13.084148 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2952/5945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:12 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1203 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:14.109665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-742b208a-f987-4435-ba93-8d0571881a33 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:14.110582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-742b208a-f987-4435-ba93-8d0571881a33 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:14.122363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-742b208a-f987-4435-ba93-8d0571881a33 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:14.125208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-742b208a-f987-4435-ba93-8d0571881a33 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:14.125670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-742b208a-f987-4435-ba93-8d0571881a33 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:14.126391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-742b208a-f987-4435-ba93-8d0571881a33 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:14.129593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-742b208a-f987-4435-ba93-8d0571881a33 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:14.130580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-742b208a-f987-4435-ba93-8d0571881a33 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:14.364121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-742b208a-f987-4435-ba93-8d0571881a33 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:14.378317 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-742b208a-f987-4435-ba93-8d0571881a33 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1390 microversion: 2.1 time: 0.276214 Oct 11 20:22:14.388204 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2994/5946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:14 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1390 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:14.404706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc21f782-8bab-41fe-b67e-22722e797864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:14.405426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc21f782-8bab-41fe-b67e-22722e797864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:14.420963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc21f782-8bab-41fe-b67e-22722e797864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:14.422629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc21f782-8bab-41fe-b67e-22722e797864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:14.423598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc21f782-8bab-41fe-b67e-22722e797864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:14.425994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc21f782-8bab-41fe-b67e-22722e797864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:14.428265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc21f782-8bab-41fe-b67e-22722e797864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:14.430015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc21f782-8bab-41fe-b67e-22722e797864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:14.706584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc21f782-8bab-41fe-b67e-22722e797864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:14.725373 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc21f782-8bab-41fe-b67e-22722e797864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1390 microversion: 2.1 time: 0.324906 Oct 11 20:22:14.726314 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2953/5947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:14 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1390 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:14.749767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc829f52-9d06-484f-86de-afa23601d97f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:14.750928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc829f52-9d06-484f-86de-afa23601d97f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:14.758782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc829f52-9d06-484f-86de-afa23601d97f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:14.759690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc829f52-9d06-484f-86de-afa23601d97f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:14.760485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc829f52-9d06-484f-86de-afa23601d97f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:14.761710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc829f52-9d06-484f-86de-afa23601d97f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:14.762162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc829f52-9d06-484f-86de-afa23601d97f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:14.762632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc829f52-9d06-484f-86de-afa23601d97f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:15.549009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dc829f52-9d06-484f-86de-afa23601d97f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:15.561815 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc829f52-9d06-484f-86de-afa23601d97f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1390 microversion: 2.1 time: 0.816807 Oct 11 20:22:15.564423 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2995/5948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:14 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1390 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:15.585959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8fbffd5c-b6aa-4fa1-aae5-9f7d2497e340 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:15.586465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8fbffd5c-b6aa-4fa1-aae5-9f7d2497e340 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:15.607917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fbffd5c-b6aa-4fa1-aae5-9f7d2497e340 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:15.608690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fbffd5c-b6aa-4fa1-aae5-9f7d2497e340 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:15.609319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fbffd5c-b6aa-4fa1-aae5-9f7d2497e340 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:15.610119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fbffd5c-b6aa-4fa1-aae5-9f7d2497e340 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:15.610663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fbffd5c-b6aa-4fa1-aae5-9f7d2497e340 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:15.611340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fbffd5c-b6aa-4fa1-aae5-9f7d2497e340 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:15.639192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8fbffd5c-b6aa-4fa1-aae5-9f7d2497e340 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:22:15.750222 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8fbffd5c-b6aa-4fa1-aae5-9f7d2497e340 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 204 len: 0 microversion: 2.1 time: 0.168264 Oct 11 20:22:15.754389 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2954/5949] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:22:15 2022] DELETE /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:22:15.762452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2127c80f-c5cc-4558-89c3-d1f98449d0cd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:15.763754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2127c80f-c5cc-4558-89c3-d1f98449d0cd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:15.770436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2127c80f-c5cc-4558-89c3-d1f98449d0cd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:15.771417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2127c80f-c5cc-4558-89c3-d1f98449d0cd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:15.772126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2127c80f-c5cc-4558-89c3-d1f98449d0cd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:15.773105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2127c80f-c5cc-4558-89c3-d1f98449d0cd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:15.773632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2127c80f-c5cc-4558-89c3-d1f98449d0cd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:15.774184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2127c80f-c5cc-4558-89c3-d1f98449d0cd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:16.050517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2127c80f-c5cc-4558-89c3-d1f98449d0cd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:16.069558 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2127c80f-c5cc-4558-89c3-d1f98449d0cd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1396 microversion: 2.1 time: 0.309997 Oct 11 20:22:16.070230 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2996/5950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:15 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1396 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:17.093592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9f32a803-4f31-4474-9938-c0b0cb310bf3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:17.094372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9f32a803-4f31-4474-9938-c0b0cb310bf3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:17.113989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f32a803-4f31-4474-9938-c0b0cb310bf3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:17.117788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f32a803-4f31-4474-9938-c0b0cb310bf3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:17.118411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f32a803-4f31-4474-9938-c0b0cb310bf3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:17.119327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f32a803-4f31-4474-9938-c0b0cb310bf3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:17.119940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f32a803-4f31-4474-9938-c0b0cb310bf3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:17.120614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f32a803-4f31-4474-9938-c0b0cb310bf3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:17.419169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9f32a803-4f31-4474-9938-c0b0cb310bf3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:17.436826 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9f32a803-4f31-4474-9938-c0b0cb310bf3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1396 microversion: 2.1 time: 0.341433 Oct 11 20:22:17.440908 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2955/5951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:17 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1396 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:18.117330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f242df45-31bc-4a61-a0f0-9c490e63ad8b req-8555663b-178e-468a-b94b-a2d4263ef1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f8496a-69fe-460f-9e73-2f2d8425ee9a", "name": "network-vif-deleted", "tag": "ec0c40cc-2817-4faa-a339-c266604c583d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:22:18.133934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f242df45-31bc-4a61-a0f0-9c490e63ad8b req-8555663b-178e-468a-b94b-a2d4263ef1e0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:18.134701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f242df45-31bc-4a61-a0f0-9c490e63ad8b req-8555663b-178e-468a-b94b-a2d4263ef1e0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:18.135332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f242df45-31bc-4a61-a0f0-9c490e63ad8b req-8555663b-178e-468a-b94b-a2d4263ef1e0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:18.166454 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f242df45-31bc-4a61-a0f0-9c490e63ad8b req-8555663b-178e-468a-b94b-a2d4263ef1e0 service nova] Creating event network-vif-deleted:ec0c40cc-2817-4faa-a339-c266604c583d for instance e3f8496a-69fe-460f-9e73-2f2d8425ee9a on n-h1-860864-3 Oct 11 20:22:18.173014 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f242df45-31bc-4a61-a0f0-9c490e63ad8b req-8555663b-178e-468a-b94b-a2d4263ef1e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059627 Oct 11 20:22:18.174403 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2997/5952] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:22:18.467272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-de8d46fc-cd9b-464f-a6fb-facc92b54b26 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:18.467826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-de8d46fc-cd9b-464f-a6fb-facc92b54b26 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:18.476181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de8d46fc-cd9b-464f-a6fb-facc92b54b26 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:18.477085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de8d46fc-cd9b-464f-a6fb-facc92b54b26 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:18.477709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de8d46fc-cd9b-464f-a6fb-facc92b54b26 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:18.478709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de8d46fc-cd9b-464f-a6fb-facc92b54b26 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:18.479350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de8d46fc-cd9b-464f-a6fb-facc92b54b26 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:18.479994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de8d46fc-cd9b-464f-a6fb-facc92b54b26 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:18.649636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-de8d46fc-cd9b-464f-a6fb-facc92b54b26 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:18.664393 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-de8d46fc-cd9b-464f-a6fb-facc92b54b26 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1188 microversion: 2.1 time: 0.201033 Oct 11 20:22:18.674892 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2956/5953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:18 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1188 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:19.695656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-24331409-5692-482c-a638-ebec4f05098b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:19.696494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-24331409-5692-482c-a638-ebec4f05098b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:19.714695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24331409-5692-482c-a638-ebec4f05098b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:19.715903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24331409-5692-482c-a638-ebec4f05098b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:19.717954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24331409-5692-482c-a638-ebec4f05098b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:19.720055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24331409-5692-482c-a638-ebec4f05098b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:19.721995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24331409-5692-482c-a638-ebec4f05098b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:19.722501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24331409-5692-482c-a638-ebec4f05098b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:19.816786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-24331409-5692-482c-a638-ebec4f05098b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:19.827058 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-24331409-5692-482c-a638-ebec4f05098b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1188 microversion: 2.1 time: 0.141577 Oct 11 20:22:19.828584 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2998/5954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:19 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1188 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:20.851521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51866a12-9b25-4a43-8ac7-3356975bedfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:20.852782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51866a12-9b25-4a43-8ac7-3356975bedfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:20.863201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51866a12-9b25-4a43-8ac7-3356975bedfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:20.867515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51866a12-9b25-4a43-8ac7-3356975bedfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:20.868098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51866a12-9b25-4a43-8ac7-3356975bedfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:20.871343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51866a12-9b25-4a43-8ac7-3356975bedfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:20.871936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51866a12-9b25-4a43-8ac7-3356975bedfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:20.872442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51866a12-9b25-4a43-8ac7-3356975bedfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:21.068863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51866a12-9b25-4a43-8ac7-3356975bedfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:21.078717 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51866a12-9b25-4a43-8ac7-3356975bedfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1188 microversion: 2.1 time: 0.231645 Oct 11 20:22:21.079318 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2957/5955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:20 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1188 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:22.103472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7e780826-2a2d-4658-abef-ef547af9b4aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:22.104211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7e780826-2a2d-4658-abef-ef547af9b4aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:22.118772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e780826-2a2d-4658-abef-ef547af9b4aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:22.119268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e780826-2a2d-4658-abef-ef547af9b4aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:22.119845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e780826-2a2d-4658-abef-ef547af9b4aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:22.120394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e780826-2a2d-4658-abef-ef547af9b4aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:22.121041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e780826-2a2d-4658-abef-ef547af9b4aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:22.121663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7e780826-2a2d-4658-abef-ef547af9b4aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:22.135642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:22:22.397882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7e780826-2a2d-4658-abef-ef547af9b4aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:22.408496 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7e780826-2a2d-4658-abef-ef547af9b4aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1188 microversion: 2.1 time: 0.310937 Oct 11 20:22:22.420823 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 2999/5956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:22 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:23.433191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-24fb3a4f-5dd0-4dfe-8c6b-fab4668d7c79 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:23.433819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-24fb3a4f-5dd0-4dfe-8c6b-fab4668d7c79 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:23.443705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fb3a4f-5dd0-4dfe-8c6b-fab4668d7c79 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:23.451478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fb3a4f-5dd0-4dfe-8c6b-fab4668d7c79 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:23.451992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fb3a4f-5dd0-4dfe-8c6b-fab4668d7c79 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:23.452746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fb3a4f-5dd0-4dfe-8c6b-fab4668d7c79 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:23.453212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fb3a4f-5dd0-4dfe-8c6b-fab4668d7c79 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:23.453644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24fb3a4f-5dd0-4dfe-8c6b-fab4668d7c79 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:23.594239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-24fb3a4f-5dd0-4dfe-8c6b-fab4668d7c79 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:23.604376 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-24fb3a4f-5dd0-4dfe-8c6b-fab4668d7c79 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1188 microversion: 2.1 time: 0.174987 Oct 11 20:22:23.605523 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2958/5957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:23 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1188 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:24.629484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:24.631137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:24.644090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:24.649607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:24.650068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:24.650849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:24.651388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:24.651853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:24.730438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:24.739621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:24.740811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:24.741447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lazy-loading 'fault' on Instance uuid e3f8496a-69fe-460f-9e73-2f2d8425ee9a {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:22:24.873707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:22:24.885919 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9af884d8-99c6-4425-bc15-080da063d2ce tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 200 len: 1147 microversion: 2.1 time: 0.260030 Oct 11 20:22:24.887067 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3000/5958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:24 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 1147 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:22:25.909431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:22:25.910040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: e3f8496a-69fe-460f-9e73-2f2d8425ee9a] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:22:25.923739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:25.929620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:25.930313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:25.931575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:22:25.932197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:22:25.932924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:22:25.967909 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance e3f8496a-69fe-460f-9e73-2f2d8425ee9a could not be found. Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a HTTP/1.1 Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance e3f8496a-69fe-460f-9e73-2f2d8425ee9a could not be found. Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'e3f8496a-69fe-460f-9e73-2f2d8425ee9a'} Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f8496a-69fe-460f-9e73-2f2d8425ee9a could not be found. Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f8496a-69fe-460f-9e73-2f2d8425ee9a could not be found. Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:22:25.971666 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:22:25.978897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:22:25.978897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:22:25.978897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:22:25.978897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:22:25.978897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:22:25.978897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f8496a-69fe-460f-9e73-2f2d8425ee9a could not be found. Oct 11 20:22:25.978897 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:22:25.978897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance e3f8496a-69fe-460f-9e73-2f2d8425ee9a could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:22:25.978897 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-456a6706-25f4-4023-b9b5-f9d83669c18b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a" status: 404 len: 111 microversion: 2.1 time: 0.068077 Oct 11 20:22:25.978897 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2959/5959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:22:25 2022] GET /compute/v2.1/servers/e3f8496a-69fe-460f-9e73-2f2d8425ee9a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:23:06.648759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-495345154", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a3f43fab-6533-42e2-915b-c218090e0f59", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "06296b2d-bf7f-4d21-bab0-dfde6b2c7622"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:23:06.662514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=23 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:06.663192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=13 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:06.791865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] validate_networks() for [('06296b2d-bf7f-4d21-bab0-dfde6b2c7622', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:23:07.475743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:23:07.476166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:23:07.476633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:23:07.477384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:23:07.477954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:23:07.494335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:07.495993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:07.496810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:07.499831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:07.500431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:07.500870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:07.553444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:23:07.565007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for user cbcf07bc33104f78adbcd3dfa198a570 and project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:23:07.588153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:23:07.590485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a3f43fab-6533-42e2-915b-c218090e0f59',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:23:07.724192 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1d01131e-8372-48c2-841a-b16825f7b1e2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078669 Oct 11 20:23:07.725959 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3001/5960] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:23:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:23:07.740063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7382a424-9c8a-45cb-98d1-ea7b97fe9907 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:07.744511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7382a424-9c8a-45cb-98d1-ea7b97fe9907 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:07.748581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:07.753867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:08.703809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7382a424-9c8a-45cb-98d1-ea7b97fe9907 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:08.717041 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7382a424-9c8a-45cb-98d1-ea7b97fe9907 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1056 microversion: 2.1 time: 0.982607 Oct 11 20:23:08.718051 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2960/5961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:07 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1056 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:09.744195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-09172b25-ed2c-4214-af99-033afe98ce03 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:09.744977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-09172b25-ed2c-4214-af99-033afe98ce03 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:09.761922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09172b25-ed2c-4214-af99-033afe98ce03 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:09.762929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09172b25-ed2c-4214-af99-033afe98ce03 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:09.764309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09172b25-ed2c-4214-af99-033afe98ce03 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:09.765270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09172b25-ed2c-4214-af99-033afe98ce03 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:09.765955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09172b25-ed2c-4214-af99-033afe98ce03 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:09.766634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09172b25-ed2c-4214-af99-033afe98ce03 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:10.156650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-09172b25-ed2c-4214-af99-033afe98ce03 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:10.175903 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-09172b25-ed2c-4214-af99-033afe98ce03 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1126 microversion: 2.1 time: 0.431666 Oct 11 20:23:10.177761 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3002/5962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:09 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1126 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:11.203263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc071049-614a-4a43-8101-7bbd5ad3676a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:11.204052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc071049-614a-4a43-8101-7bbd5ad3676a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:11.218094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc071049-614a-4a43-8101-7bbd5ad3676a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:11.221843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc071049-614a-4a43-8101-7bbd5ad3676a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:11.222801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc071049-614a-4a43-8101-7bbd5ad3676a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:11.225484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc071049-614a-4a43-8101-7bbd5ad3676a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:11.227119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc071049-614a-4a43-8101-7bbd5ad3676a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:11.227689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dc071049-614a-4a43-8101-7bbd5ad3676a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:11.761186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc071049-614a-4a43-8101-7bbd5ad3676a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:11.783204 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc071049-614a-4a43-8101-7bbd5ad3676a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.585515 Oct 11 20:23:11.785396 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2961/5963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:11 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:12.809653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-24eb9c4b-8c95-4416-bd23-e2ac9f2f0708 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:12.810938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-24eb9c4b-8c95-4416-bd23-e2ac9f2f0708 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:12.823409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24eb9c4b-8c95-4416-bd23-e2ac9f2f0708 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:12.823910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24eb9c4b-8c95-4416-bd23-e2ac9f2f0708 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:12.824354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24eb9c4b-8c95-4416-bd23-e2ac9f2f0708 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:12.849726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24eb9c4b-8c95-4416-bd23-e2ac9f2f0708 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:12.850314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24eb9c4b-8c95-4416-bd23-e2ac9f2f0708 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:12.852378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-24eb9c4b-8c95-4416-bd23-e2ac9f2f0708 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:13.780882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-24eb9c4b-8c95-4416-bd23-e2ac9f2f0708 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:13.797707 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-24eb9c4b-8c95-4416-bd23-e2ac9f2f0708 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.992222 Oct 11 20:23:13.799083 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3003/5964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:12 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:13.800370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ad24ba94-c176-4e89-b1e7-05677ecd9548 req-9a7fecae-beb5-45e6-adbf-dcaa9eed8089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "810fa621-4501-4d97-843c-5692dbe59a15", "tag": "e3da125b-6cd9-4a58-9e66-2d1f930c1747"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:23:13.828285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ad24ba94-c176-4e89-b1e7-05677ecd9548 req-9a7fecae-beb5-45e6-adbf-dcaa9eed8089 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:13.829355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ad24ba94-c176-4e89-b1e7-05677ecd9548 req-9a7fecae-beb5-45e6-adbf-dcaa9eed8089 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:13.830818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ad24ba94-c176-4e89-b1e7-05677ecd9548 req-9a7fecae-beb5-45e6-adbf-dcaa9eed8089 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:13.871051 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ad24ba94-c176-4e89-b1e7-05677ecd9548 req-9a7fecae-beb5-45e6-adbf-dcaa9eed8089 service nova] Creating event network-changed:e3da125b-6cd9-4a58-9e66-2d1f930c1747 for instance 810fa621-4501-4d97-843c-5692dbe59a15 on n-h1-860864-3 Oct 11 20:23:13.882194 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ad24ba94-c176-4e89-b1e7-05677ecd9548 req-9a7fecae-beb5-45e6-adbf-dcaa9eed8089 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085761 Oct 11 20:23:13.886581 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2962/5965] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:23:14.822109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bf2172d7-4944-4fd9-9c3f-1052396c7211 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:14.822769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bf2172d7-4944-4fd9-9c3f-1052396c7211 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:14.840863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf2172d7-4944-4fd9-9c3f-1052396c7211 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:14.841416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf2172d7-4944-4fd9-9c3f-1052396c7211 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:14.841863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf2172d7-4944-4fd9-9c3f-1052396c7211 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:14.846984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf2172d7-4944-4fd9-9c3f-1052396c7211 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:14.847929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf2172d7-4944-4fd9-9c3f-1052396c7211 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:14.848548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf2172d7-4944-4fd9-9c3f-1052396c7211 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:15.275509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bf2172d7-4944-4fd9-9c3f-1052396c7211 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:15.290552 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bf2172d7-4944-4fd9-9c3f-1052396c7211 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.467763 Oct 11 20:23:15.291233 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3004/5966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:14 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:16.315564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5f6d2a88-701e-41eb-8014-8d5ba892f9c1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:16.317648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f6d2a88-701e-41eb-8014-8d5ba892f9c1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:16.335056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f6d2a88-701e-41eb-8014-8d5ba892f9c1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:16.336110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f6d2a88-701e-41eb-8014-8d5ba892f9c1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:16.338228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f6d2a88-701e-41eb-8014-8d5ba892f9c1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:16.342505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f6d2a88-701e-41eb-8014-8d5ba892f9c1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:16.343382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f6d2a88-701e-41eb-8014-8d5ba892f9c1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:16.344151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f6d2a88-701e-41eb-8014-8d5ba892f9c1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:17.447117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5f6d2a88-701e-41eb-8014-8d5ba892f9c1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:17.456643 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5f6d2a88-701e-41eb-8014-8d5ba892f9c1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 1.146653 Oct 11 20:23:17.463267 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2963/5967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:16 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:18.487517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b4b72bd7-37c5-43a6-aafd-c395b998ea18 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:18.489131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b4b72bd7-37c5-43a6-aafd-c395b998ea18 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:18.500466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:18.501857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:18.505823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4b72bd7-37c5-43a6-aafd-c395b998ea18 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:18.506863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4b72bd7-37c5-43a6-aafd-c395b998ea18 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:18.507706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4b72bd7-37c5-43a6-aafd-c395b998ea18 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:18.508689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4b72bd7-37c5-43a6-aafd-c395b998ea18 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:18.509600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4b72bd7-37c5-43a6-aafd-c395b998ea18 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:18.510967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4b72bd7-37c5-43a6-aafd-c395b998ea18 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:18.958283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b4b72bd7-37c5-43a6-aafd-c395b998ea18 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:18.974921 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b4b72bd7-37c5-43a6-aafd-c395b998ea18 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.495240 Oct 11 20:23:18.976782 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3005/5968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:18 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:20.026147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6d37ae79-a6ff-4400-9794-fb65bbecaf7f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:20.032096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6d37ae79-a6ff-4400-9794-fb65bbecaf7f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:20.050038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:20.053401 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:23:20.054302 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 20:23:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 (ip 10.222.0.27) !!! Oct 11 20:23:20.057720 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:23:20.059171 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 20:23:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 (ip 10.222.0.27) !!! Oct 11 20:23:20.066284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d37ae79-a6ff-4400-9794-fb65bbecaf7f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:20.068320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d37ae79-a6ff-4400-9794-fb65bbecaf7f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:20.069162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d37ae79-a6ff-4400-9794-fb65bbecaf7f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:20.070940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d37ae79-a6ff-4400-9794-fb65bbecaf7f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:20.072616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d37ae79-a6ff-4400-9794-fb65bbecaf7f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:20.073600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6d37ae79-a6ff-4400-9794-fb65bbecaf7f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:20.461208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6d37ae79-a6ff-4400-9794-fb65bbecaf7f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:20.469325 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6d37ae79-a6ff-4400-9794-fb65bbecaf7f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.468964 Oct 11 20:23:20.472679 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2964/5969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:19 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:21.499325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8280a215-0c80-49c5-9094-f14c81bd894e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:21.500155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8280a215-0c80-49c5-9094-f14c81bd894e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:21.514209 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:23:21.514519 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:23:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 (ip 10.222.0.27) !!! Oct 11 20:23:21.517685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8280a215-0c80-49c5-9094-f14c81bd894e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:21.521208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8280a215-0c80-49c5-9094-f14c81bd894e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:21.522070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8280a215-0c80-49c5-9094-f14c81bd894e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:21.523379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8280a215-0c80-49c5-9094-f14c81bd894e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:21.524531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8280a215-0c80-49c5-9094-f14c81bd894e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:21.525383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8280a215-0c80-49c5-9094-f14c81bd894e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:22.538610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fac3a666-4728-454d-b056-0f38d2509029 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Action: 'create', calling method: .version_select at 0x7f83c7374b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-986649424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsIWqpAmsbMEW/Ib6epY64f9Q076MkRtrYWyY1hFO2KNDQS/m5aJV4ysPmPw+sW3hNGqRYC/a3MaZmVvKX0Y11+VkBcUCYe+zqiii7/7il+QE5StFNR8KIpNbIXHY7Sjg=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:23:22.574577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-fac3a666-4728-454d-b056-0f38d2509029 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for project bf306e7b9d4546b782e7f06728a927b7. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:23:22.591007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-fac3a666-4728-454d-b056-0f38d2509029 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for user d2e611fef85942e587a8a4e49e10d1b6 and project bf306e7b9d4546b782e7f06728a927b7. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:23:22.664408 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fac3a666-4728-454d-b056-0f38d2509029 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.130017 Oct 11 20:23:22.674289 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2965/5970] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:23:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:23:22.733886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8280a215-0c80-49c5-9094-f14c81bd894e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:22.746565 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8280a215-0c80-49c5-9094-f14c81bd894e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 1.251611 Oct 11 20:23:22.771820 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3006/5971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:21 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:23.806439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-122d07c5-bca4-409a-8ea0-b15a76835be5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:23.820847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-122d07c5-bca4-409a-8ea0-b15a76835be5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:23.878802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-122d07c5-bca4-409a-8ea0-b15a76835be5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:23.883919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-122d07c5-bca4-409a-8ea0-b15a76835be5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:23.897126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-122d07c5-bca4-409a-8ea0-b15a76835be5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:23.900789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-122d07c5-bca4-409a-8ea0-b15a76835be5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:23.903168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-122d07c5-bca4-409a-8ea0-b15a76835be5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:23.903881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-122d07c5-bca4-409a-8ea0-b15a76835be5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:24.576274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-122d07c5-bca4-409a-8ea0-b15a76835be5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:24.589836 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-122d07c5-bca4-409a-8ea0-b15a76835be5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.811884 Oct 11 20:23:24.594346 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2966/5972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:23 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:25.208925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-873714942", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "0a1e087f-a729-4359-8d7a-08f7192fba8a"}], "key_name": "tempest-TestNetworkBasicOps-986649424", "security_groups": [{"name": "tempest-secgroup-smoke-551241896"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:23:25.572232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] validate_networks() for [('0a1e087f-a729-4359-8d7a-08f7192fba8a', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:23:25.619560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ea9d97c8-7e1f-4a6c-8503-8483dec8be1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:25.620977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ea9d97c8-7e1f-4a6c-8503-8483dec8be1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:25.635291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea9d97c8-7e1f-4a6c-8503-8483dec8be1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:25.636260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea9d97c8-7e1f-4a6c-8503-8483dec8be1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:25.642431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea9d97c8-7e1f-4a6c-8503-8483dec8be1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:25.643396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea9d97c8-7e1f-4a6c-8503-8483dec8be1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:25.643893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea9d97c8-7e1f-4a6c-8503-8483dec8be1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:25.644323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ea9d97c8-7e1f-4a6c-8503-8483dec8be1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:26.813090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ea9d97c8-7e1f-4a6c-8503-8483dec8be1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:26.821923 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ea9d97c8-7e1f-4a6c-8503-8483dec8be1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 1.206377 Oct 11 20:23:26.822757 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2967/5973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:25 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:23:27.262878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:23:27.263574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:23:27.264286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:23:27.264914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:23:27.265389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:23:27.275156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:27.275805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:27.276341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:27.277302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:27.277874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:27.278345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:27.328090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for project bf306e7b9d4546b782e7f06728a927b7. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:23:27.339168 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for user d2e611fef85942e587a8a4e49e10d1b6 and project bf306e7b9d4546b782e7f06728a927b7. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:23:27.386923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:23:27.389222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:23:27.455959 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-58a7b4d4-e342-424a-8519-6a471ad9d699 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.253176 Oct 11 20:23:27.457550 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3007/5974] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:23:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:23:27.469956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8630e09c-30f8-40e7-a6e5-f55b9fe38f1f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:27.470727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8630e09c-30f8-40e7-a6e5-f55b9fe38f1f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:27.573181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8630e09c-30f8-40e7-a6e5-f55b9fe38f1f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:27.581694 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8630e09c-30f8-40e7-a6e5-f55b9fe38f1f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1247 microversion: 2.1 time: 0.115905 Oct 11 20:23:27.595267 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2968/5975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:27 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1247 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:27.846977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d217b14-0423-4ac7-8726-aea5ca4586e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:27.848190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8d217b14-0423-4ac7-8726-aea5ca4586e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:27.855779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d217b14-0423-4ac7-8726-aea5ca4586e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:27.856576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d217b14-0423-4ac7-8726-aea5ca4586e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:27.857234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d217b14-0423-4ac7-8726-aea5ca4586e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:27.858348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d217b14-0423-4ac7-8726-aea5ca4586e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:27.859006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d217b14-0423-4ac7-8726-aea5ca4586e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:27.859764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d217b14-0423-4ac7-8726-aea5ca4586e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:28.127054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8d217b14-0423-4ac7-8726-aea5ca4586e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:28.142022 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8d217b14-0423-4ac7-8726-aea5ca4586e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.299948 Oct 11 20:23:28.142793 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3008/5976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:27 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:28.617965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cd78d7fe-6c78-48b5-a054-1717d7374e3c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:28.619233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cd78d7fe-6c78-48b5-a054-1717d7374e3c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:28.626957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd78d7fe-6c78-48b5-a054-1717d7374e3c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:28.627449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd78d7fe-6c78-48b5-a054-1717d7374e3c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:28.627892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd78d7fe-6c78-48b5-a054-1717d7374e3c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:28.628608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd78d7fe-6c78-48b5-a054-1717d7374e3c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:28.629066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd78d7fe-6c78-48b5-a054-1717d7374e3c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:28.629490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd78d7fe-6c78-48b5-a054-1717d7374e3c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:28.774995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cd78d7fe-6c78-48b5-a054-1717d7374e3c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:28.789149 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cd78d7fe-6c78-48b5-a054-1717d7374e3c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1299 microversion: 2.1 time: 0.175428 Oct 11 20:23:28.789739 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2969/5977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:28 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:29.169932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b21f4fa5-6909-4fe4-aad1-42f133024549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:29.170634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b21f4fa5-6909-4fe4-aad1-42f133024549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:29.177861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b21f4fa5-6909-4fe4-aad1-42f133024549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:29.178349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b21f4fa5-6909-4fe4-aad1-42f133024549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:29.178827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b21f4fa5-6909-4fe4-aad1-42f133024549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:29.179745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b21f4fa5-6909-4fe4-aad1-42f133024549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:29.180196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b21f4fa5-6909-4fe4-aad1-42f133024549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:29.180620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b21f4fa5-6909-4fe4-aad1-42f133024549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:29.528022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b21f4fa5-6909-4fe4-aad1-42f133024549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:29.542808 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b21f4fa5-6909-4fe4-aad1-42f133024549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.381204 Oct 11 20:23:29.545057 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3009/5978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:29 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:29.814548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1899e04d-c400-4678-adc0-f08e8af0e292 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:29.815896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1899e04d-c400-4678-adc0-f08e8af0e292 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:29.831845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1899e04d-c400-4678-adc0-f08e8af0e292 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:29.833935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1899e04d-c400-4678-adc0-f08e8af0e292 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:29.834663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1899e04d-c400-4678-adc0-f08e8af0e292 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:29.835579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1899e04d-c400-4678-adc0-f08e8af0e292 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:29.836219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1899e04d-c400-4678-adc0-f08e8af0e292 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:29.836818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1899e04d-c400-4678-adc0-f08e8af0e292 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:30.066918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1899e04d-c400-4678-adc0-f08e8af0e292 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:30.083620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1899e04d-c400-4678-adc0-f08e8af0e292 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1305 microversion: 2.1 time: 0.273285 Oct 11 20:23:30.084584 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2970/5979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:29 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1305 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:30.570502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-197bafa0-28a0-468d-9206-0efbda7cd43f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:30.571729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-197bafa0-28a0-468d-9206-0efbda7cd43f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:30.580940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197bafa0-28a0-468d-9206-0efbda7cd43f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:30.582107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197bafa0-28a0-468d-9206-0efbda7cd43f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:30.582765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197bafa0-28a0-468d-9206-0efbda7cd43f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:30.583654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197bafa0-28a0-468d-9206-0efbda7cd43f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:30.584288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197bafa0-28a0-468d-9206-0efbda7cd43f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:30.584871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197bafa0-28a0-468d-9206-0efbda7cd43f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:31.000267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-197bafa0-28a0-468d-9206-0efbda7cd43f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:31.009304 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-197bafa0-28a0-468d-9206-0efbda7cd43f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.444393 Oct 11 20:23:31.010199 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3010/5980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:30 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:31.113246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3801ce4d-38bc-4969-bcfc-a3b14ac1e1a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:31.114511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3801ce4d-38bc-4969-bcfc-a3b14ac1e1a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:31.121001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3801ce4d-38bc-4969-bcfc-a3b14ac1e1a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:31.121503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3801ce4d-38bc-4969-bcfc-a3b14ac1e1a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:31.122343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3801ce4d-38bc-4969-bcfc-a3b14ac1e1a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:31.122692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3801ce4d-38bc-4969-bcfc-a3b14ac1e1a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:31.123155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3801ce4d-38bc-4969-bcfc-a3b14ac1e1a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:31.123589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3801ce4d-38bc-4969-bcfc-a3b14ac1e1a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:31.436037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3801ce4d-38bc-4969-bcfc-a3b14ac1e1a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:31.449597 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3801ce4d-38bc-4969-bcfc-a3b14ac1e1a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1372 microversion: 2.1 time: 0.341262 Oct 11 20:23:31.451227 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2971/5981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:31 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1372 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:23:31.597989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f4b8ca9d-e16f-4c8f-a35e-0a4e3cca29b7 req-fc7e8696-ecbf-4742-b918-8ec709ef48c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd1c053-7968-43d6-8381-3c3ec27e24dc", "tag": "4676a8b3-2f11-416a-8951-7b4e803d2ff6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:23:31.628460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f4b8ca9d-e16f-4c8f-a35e-0a4e3cca29b7 req-fc7e8696-ecbf-4742-b918-8ec709ef48c2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:31.629474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f4b8ca9d-e16f-4c8f-a35e-0a4e3cca29b7 req-fc7e8696-ecbf-4742-b918-8ec709ef48c2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:31.630276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f4b8ca9d-e16f-4c8f-a35e-0a4e3cca29b7 req-fc7e8696-ecbf-4742-b918-8ec709ef48c2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:31.647655 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f4b8ca9d-e16f-4c8f-a35e-0a4e3cca29b7 req-fc7e8696-ecbf-4742-b918-8ec709ef48c2 service nova] Creating event network-changed:4676a8b3-2f11-416a-8951-7b4e803d2ff6 for instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc on n-h2-860864-3 Oct 11 20:23:31.659906 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f4b8ca9d-e16f-4c8f-a35e-0a4e3cca29b7 req-fc7e8696-ecbf-4742-b918-8ec709ef48c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066161 Oct 11 20:23:31.661450 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3011/5982] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:23:32.033476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6850c20b-316f-4365-80b7-8363effc8c54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:32.034315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6850c20b-316f-4365-80b7-8363effc8c54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:32.041682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6850c20b-316f-4365-80b7-8363effc8c54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:32.042906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6850c20b-316f-4365-80b7-8363effc8c54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:32.045743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6850c20b-316f-4365-80b7-8363effc8c54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:32.046900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6850c20b-316f-4365-80b7-8363effc8c54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:32.048895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6850c20b-316f-4365-80b7-8363effc8c54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:32.049469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6850c20b-316f-4365-80b7-8363effc8c54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:32.209763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6850c20b-316f-4365-80b7-8363effc8c54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:32.218690 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6850c20b-316f-4365-80b7-8363effc8c54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.190126 Oct 11 20:23:32.220471 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2972/5983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:32 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:32.474858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7c49516e-498d-4651-a7bb-8c6b528bfb13 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:32.476073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7c49516e-498d-4651-a7bb-8c6b528bfb13 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:32.483774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c49516e-498d-4651-a7bb-8c6b528bfb13 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:32.486557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c49516e-498d-4651-a7bb-8c6b528bfb13 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:32.487512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c49516e-498d-4651-a7bb-8c6b528bfb13 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:32.488480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c49516e-498d-4651-a7bb-8c6b528bfb13 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:32.489191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c49516e-498d-4651-a7bb-8c6b528bfb13 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:32.489541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c49516e-498d-4651-a7bb-8c6b528bfb13 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:32.664583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7c49516e-498d-4651-a7bb-8c6b528bfb13 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:32.673601 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7c49516e-498d-4651-a7bb-8c6b528bfb13 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1372 microversion: 2.1 time: 0.204130 Oct 11 20:23:32.687056 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3012/5984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:32 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:33.243296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-81d250a9-1505-4fad-8e25-364f4fe2a753 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:33.243912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-81d250a9-1505-4fad-8e25-364f4fe2a753 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:33.251799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81d250a9-1505-4fad-8e25-364f4fe2a753 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:33.252514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81d250a9-1505-4fad-8e25-364f4fe2a753 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:33.253147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81d250a9-1505-4fad-8e25-364f4fe2a753 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:33.253852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81d250a9-1505-4fad-8e25-364f4fe2a753 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:33.254472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81d250a9-1505-4fad-8e25-364f4fe2a753 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:33.255079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-81d250a9-1505-4fad-8e25-364f4fe2a753 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:33.486110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-81d250a9-1505-4fad-8e25-364f4fe2a753 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:33.494966 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-81d250a9-1505-4fad-8e25-364f4fe2a753 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1168 microversion: 2.1 time: 0.255483 Oct 11 20:23:33.510803 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2973/5985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:33 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1168 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:33.700223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-41db9c58-6875-4170-ac40-591b71a056dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:33.701761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-41db9c58-6875-4170-ac40-591b71a056dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:33.711022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41db9c58-6875-4170-ac40-591b71a056dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:33.711707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41db9c58-6875-4170-ac40-591b71a056dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:33.712152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41db9c58-6875-4170-ac40-591b71a056dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:33.713090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41db9c58-6875-4170-ac40-591b71a056dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:33.713703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41db9c58-6875-4170-ac40-591b71a056dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:33.714290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41db9c58-6875-4170-ac40-591b71a056dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:33.863572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-41db9c58-6875-4170-ac40-591b71a056dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:33.872375 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-41db9c58-6875-4170-ac40-591b71a056dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1372 microversion: 2.1 time: 0.178807 Oct 11 20:23:33.872971 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3013/5986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:33 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:34.517526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f5bb2793-98b8-4cd8-a332-5189b2180064 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:34.518140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f5bb2793-98b8-4cd8-a332-5189b2180064 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:34.530069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5bb2793-98b8-4cd8-a332-5189b2180064 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:34.530785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5bb2793-98b8-4cd8-a332-5189b2180064 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:34.531335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5bb2793-98b8-4cd8-a332-5189b2180064 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:34.532894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5bb2793-98b8-4cd8-a332-5189b2180064 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:34.533283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5bb2793-98b8-4cd8-a332-5189b2180064 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:34.533852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f5bb2793-98b8-4cd8-a332-5189b2180064 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:34.775949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f5bb2793-98b8-4cd8-a332-5189b2180064 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:34.787080 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f5bb2793-98b8-4cd8-a332-5189b2180064 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1214 microversion: 2.1 time: 0.272144 Oct 11 20:23:34.788742 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2974/5987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:34 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1214 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:34.897497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c41ec38-fcef-47cf-8218-e75690bf7be3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:34.898345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c41ec38-fcef-47cf-8218-e75690bf7be3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:34.906032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c41ec38-fcef-47cf-8218-e75690bf7be3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:34.906767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c41ec38-fcef-47cf-8218-e75690bf7be3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:34.907470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c41ec38-fcef-47cf-8218-e75690bf7be3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:34.908437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c41ec38-fcef-47cf-8218-e75690bf7be3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:34.909111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c41ec38-fcef-47cf-8218-e75690bf7be3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:34.909646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c41ec38-fcef-47cf-8218-e75690bf7be3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:35.072210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c41ec38-fcef-47cf-8218-e75690bf7be3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:35.085313 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c41ec38-fcef-47cf-8218-e75690bf7be3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1372 microversion: 2.1 time: 0.191994 Oct 11 20:23:35.085975 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3014/5988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:34 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:23:35.813505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7f9edd68-21c5-497e-a627-d85320b08759 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:35.814899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7f9edd68-21c5-497e-a627-d85320b08759 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:35.822607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f9edd68-21c5-497e-a627-d85320b08759 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:35.823486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f9edd68-21c5-497e-a627-d85320b08759 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:35.824202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f9edd68-21c5-497e-a627-d85320b08759 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:35.824968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f9edd68-21c5-497e-a627-d85320b08759 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:35.825491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f9edd68-21c5-497e-a627-d85320b08759 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:35.825985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7f9edd68-21c5-497e-a627-d85320b08759 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:36.111929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b582253-ec33-4ec3-b767-dba18e314fe0 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:36.114214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0b582253-ec33-4ec3-b767-dba18e314fe0 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:36.123102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b582253-ec33-4ec3-b767-dba18e314fe0 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:36.124054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b582253-ec33-4ec3-b767-dba18e314fe0 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:36.126315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b582253-ec33-4ec3-b767-dba18e314fe0 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:36.127828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b582253-ec33-4ec3-b767-dba18e314fe0 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:36.128452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b582253-ec33-4ec3-b767-dba18e314fe0 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:36.129062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0b582253-ec33-4ec3-b767-dba18e314fe0 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:36.246208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7f9edd68-21c5-497e-a627-d85320b08759 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:36.270826 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7f9edd68-21c5-497e-a627-d85320b08759 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1202 microversion: 2.1 time: 0.461506 Oct 11 20:23:36.290406 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2975/5989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:35 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1202 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:36.466782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0b582253-ec33-4ec3-b767-dba18e314fe0 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:36.477385 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b582253-ec33-4ec3-b767-dba18e314fe0 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1372 microversion: 2.1 time: 0.369805 Oct 11 20:23:36.477929 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3015/5990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:36 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:37.295761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-acee4db9-84f6-4676-ba54-cd5ae36c2d82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:37.297754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-acee4db9-84f6-4676-ba54-cd5ae36c2d82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:37.306099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acee4db9-84f6-4676-ba54-cd5ae36c2d82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:37.306811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acee4db9-84f6-4676-ba54-cd5ae36c2d82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:37.307525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acee4db9-84f6-4676-ba54-cd5ae36c2d82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:37.308406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acee4db9-84f6-4676-ba54-cd5ae36c2d82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:37.309220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acee4db9-84f6-4676-ba54-cd5ae36c2d82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:37.309812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-acee4db9-84f6-4676-ba54-cd5ae36c2d82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:37.501473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6e89ee0-9511-419c-ad92-164b9d4babb7 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:37.502587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6e89ee0-9511-419c-ad92-164b9d4babb7 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:37.505513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:37.506439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:37.507367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:37.515354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e89ee0-9511-419c-ad92-164b9d4babb7 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:37.517131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e89ee0-9511-419c-ad92-164b9d4babb7 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:37.517597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e89ee0-9511-419c-ad92-164b9d4babb7 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:37.518362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e89ee0-9511-419c-ad92-164b9d4babb7 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:37.519014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e89ee0-9511-419c-ad92-164b9d4babb7 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:37.519448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6e89ee0-9511-419c-ad92-164b9d4babb7 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:37.538070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=79 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:37.566960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-acee4db9-84f6-4676-ba54-cd5ae36c2d82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:37.581232 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-acee4db9-84f6-4676-ba54-cd5ae36c2d82 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1202 microversion: 2.1 time: 0.290404 Oct 11 20:23:37.582224 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2976/5991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:37 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1202 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:37.794273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6e89ee0-9511-419c-ad92-164b9d4babb7 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:37.806220 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6e89ee0-9511-419c-ad92-164b9d4babb7 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1372 microversion: 2.1 time: 0.308743 Oct 11 20:23:37.807486 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3016/5992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:37 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1372 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-24f79d00-4a95-4933-acd6-7a7cdc970b19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-24f79d00-4a95-4933-acd6-7a7cdc970b19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24f79d00-4a95-4933-acd6-7a7cdc970b19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24f79d00-4a95-4933-acd6-7a7cdc970b19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24f79d00-4a95-4933-acd6-7a7cdc970b19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24f79d00-4a95-4933-acd6-7a7cdc970b19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24f79d00-4a95-4933-acd6-7a7cdc970b19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24f79d00-4a95-4933-acd6-7a7cdc970b19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:38.758898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=81 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:23:38.763267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-14f05320-de29-428b-83b3-a572e333712e req-8cd35de2-1c26-4f36-9b59-b79c40f8c916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd1c053-7968-43d6-8381-3c3ec27e24dc", "name": "network-vif-plugged", "status": "completed", "tag": "4676a8b3-2f11-416a-8951-7b4e803d2ff6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:23:38.771183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-14f05320-de29-428b-83b3-a572e333712e req-8cd35de2-1c26-4f36-9b59-b79c40f8c916 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:38.774181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-14f05320-de29-428b-83b3-a572e333712e req-8cd35de2-1c26-4f36-9b59-b79c40f8c916 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:38.778663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-14f05320-de29-428b-83b3-a572e333712e req-8cd35de2-1c26-4f36-9b59-b79c40f8c916 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:38.792413 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-14f05320-de29-428b-83b3-a572e333712e req-8cd35de2-1c26-4f36-9b59-b79c40f8c916 service nova] Creating event network-vif-plugged:4676a8b3-2f11-416a-8951-7b4e803d2ff6 for instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc on n-h2-860864-3 Oct 11 20:23:38.800779 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-14f05320-de29-428b-83b3-a572e333712e req-8cd35de2-1c26-4f36-9b59-b79c40f8c916 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050746 Oct 11 20:23:38.801081 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3017/5993] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:23:38.852352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-68516c2c-5eb9-42ce-b1b1-8704aced74cd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:38.853220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68516c2c-5eb9-42ce-b1b1-8704aced74cd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:38.870128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68516c2c-5eb9-42ce-b1b1-8704aced74cd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:38.871465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68516c2c-5eb9-42ce-b1b1-8704aced74cd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:38.872199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68516c2c-5eb9-42ce-b1b1-8704aced74cd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:38.873271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68516c2c-5eb9-42ce-b1b1-8704aced74cd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:38.874011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68516c2c-5eb9-42ce-b1b1-8704aced74cd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:38.874703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68516c2c-5eb9-42ce-b1b1-8704aced74cd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:39.049723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-24f79d00-4a95-4933-acd6-7a7cdc970b19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:39.060467 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-24f79d00-4a95-4933-acd6-7a7cdc970b19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1202 microversion: 2.1 time: 0.454852 Oct 11 20:23:39.061747 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2977/5994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:38 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1202 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:39.279486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68516c2c-5eb9-42ce-b1b1-8704aced74cd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:39.290691 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-68516c2c-5eb9-42ce-b1b1-8704aced74cd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1372 microversion: 2.1 time: 0.462333 Oct 11 20:23:39.293595 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3018/5995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:38 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1372 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:40.085411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f75cef91-6dd7-482f-a1cb-e2844c653674 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:40.086019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f75cef91-6dd7-482f-a1cb-e2844c653674 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:40.092955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75cef91-6dd7-482f-a1cb-e2844c653674 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:40.093447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75cef91-6dd7-482f-a1cb-e2844c653674 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:40.094664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75cef91-6dd7-482f-a1cb-e2844c653674 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:40.095628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75cef91-6dd7-482f-a1cb-e2844c653674 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:40.096085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75cef91-6dd7-482f-a1cb-e2844c653674 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:40.096560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f75cef91-6dd7-482f-a1cb-e2844c653674 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:40.247009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f75cef91-6dd7-482f-a1cb-e2844c653674 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:40.257186 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f75cef91-6dd7-482f-a1cb-e2844c653674 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1202 microversion: 2.1 time: 0.175285 Oct 11 20:23:40.257806 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2978/5996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:40 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:40.317012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6d68e1f-4530-44fd-b75d-2c284315254d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:40.318628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6d68e1f-4530-44fd-b75d-2c284315254d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:40.335590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d68e1f-4530-44fd-b75d-2c284315254d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:40.335590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d68e1f-4530-44fd-b75d-2c284315254d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:40.335590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d68e1f-4530-44fd-b75d-2c284315254d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:40.336076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d68e1f-4530-44fd-b75d-2c284315254d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:40.336525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d68e1f-4530-44fd-b75d-2c284315254d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:40.336936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6d68e1f-4530-44fd-b75d-2c284315254d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:40.527746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6d68e1f-4530-44fd-b75d-2c284315254d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:40.543367 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6d68e1f-4530-44fd-b75d-2c284315254d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1372 microversion: 2.1 time: 0.223862 Oct 11 20:23:40.554121 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3019/5997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:40 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:41.294161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2a8fba34-9e23-430a-bbcd-1d80f3579ebf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:41.295328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2a8fba34-9e23-430a-bbcd-1d80f3579ebf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:41.305111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a8fba34-9e23-430a-bbcd-1d80f3579ebf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:41.305111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a8fba34-9e23-430a-bbcd-1d80f3579ebf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:41.305111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a8fba34-9e23-430a-bbcd-1d80f3579ebf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:41.305111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a8fba34-9e23-430a-bbcd-1d80f3579ebf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:41.305111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a8fba34-9e23-430a-bbcd-1d80f3579ebf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:41.305580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a8fba34-9e23-430a-bbcd-1d80f3579ebf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:41.571443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f705381-e74b-4d97-bb5f-5ff943ada5dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:41.573437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f705381-e74b-4d97-bb5f-5ff943ada5dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:41.582996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f705381-e74b-4d97-bb5f-5ff943ada5dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:41.583683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f705381-e74b-4d97-bb5f-5ff943ada5dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:41.584311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f705381-e74b-4d97-bb5f-5ff943ada5dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:41.585195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f705381-e74b-4d97-bb5f-5ff943ada5dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:41.585814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f705381-e74b-4d97-bb5f-5ff943ada5dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:41.586400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f705381-e74b-4d97-bb5f-5ff943ada5dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:41.885655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2a8fba34-9e23-430a-bbcd-1d80f3579ebf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:41.895514 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2a8fba34-9e23-430a-bbcd-1d80f3579ebf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1202 microversion: 2.1 time: 0.605403 Oct 11 20:23:41.901261 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2979/5998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:41 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1202 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:41.976916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f705381-e74b-4d97-bb5f-5ff943ada5dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:41.986628 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f705381-e74b-4d97-bb5f-5ff943ada5dc tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1545 microversion: 2.1 time: 0.419016 Oct 11 20:23:41.987476 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3020/5999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:41 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1545 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:23:42.010053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8d871686-6bc4-498f-9022-e845b73901d6 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:42.022031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8d871686-6bc4-498f-9022-e845b73901d6 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:42.028775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d871686-6bc4-498f-9022-e845b73901d6 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:42.029283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d871686-6bc4-498f-9022-e845b73901d6 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:42.029754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d871686-6bc4-498f-9022-e845b73901d6 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:42.030635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d871686-6bc4-498f-9022-e845b73901d6 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:42.031631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d871686-6bc4-498f-9022-e845b73901d6 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:42.032108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d871686-6bc4-498f-9022-e845b73901d6 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:42.252225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8d871686-6bc4-498f-9022-e845b73901d6 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:42.261196 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8d871686-6bc4-498f-9022-e845b73901d6 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1545 microversion: 2.1 time: 0.255458 Oct 11 20:23:42.261812 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2980/6000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:42 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1545 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:42.919262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-474fbfc6-9929-458e-97d5-2db38d83d788 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:42.920195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-474fbfc6-9929-458e-97d5-2db38d83d788 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:42.931063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-474fbfc6-9929-458e-97d5-2db38d83d788 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:42.932892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-474fbfc6-9929-458e-97d5-2db38d83d788 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:42.933514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-474fbfc6-9929-458e-97d5-2db38d83d788 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:42.934414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-474fbfc6-9929-458e-97d5-2db38d83d788 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:42.935061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-474fbfc6-9929-458e-97d5-2db38d83d788 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:42.935652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-474fbfc6-9929-458e-97d5-2db38d83d788 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:43.192507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-474fbfc6-9929-458e-97d5-2db38d83d788 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:43.200473 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-474fbfc6-9929-458e-97d5-2db38d83d788 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1202 microversion: 2.1 time: 0.286590 Oct 11 20:23:43.201544 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3021/6001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:42 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1202 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:44.226081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56ac8966-8541-48ab-84ed-53db565851aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:44.227455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56ac8966-8541-48ab-84ed-53db565851aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:44.236097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56ac8966-8541-48ab-84ed-53db565851aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:44.236877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56ac8966-8541-48ab-84ed-53db565851aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:44.237500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56ac8966-8541-48ab-84ed-53db565851aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:44.238416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56ac8966-8541-48ab-84ed-53db565851aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:44.239062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56ac8966-8541-48ab-84ed-53db565851aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:44.239652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56ac8966-8541-48ab-84ed-53db565851aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:44.526919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1658639b-214a-477e-bfe2-2a334e217707 req-f3d3419e-b30e-4aba-82d7-f3c792e31b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810fa621-4501-4d97-843c-5692dbe59a15", "name": "network-vif-plugged", "status": "completed", "tag": "e3da125b-6cd9-4a58-9e66-2d1f930c1747"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:23:44.556903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1658639b-214a-477e-bfe2-2a334e217707 req-f3d3419e-b30e-4aba-82d7-f3c792e31b3f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:44.558874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1658639b-214a-477e-bfe2-2a334e217707 req-f3d3419e-b30e-4aba-82d7-f3c792e31b3f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:44.558874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1658639b-214a-477e-bfe2-2a334e217707 req-f3d3419e-b30e-4aba-82d7-f3c792e31b3f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:44.586551 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1658639b-214a-477e-bfe2-2a334e217707 req-f3d3419e-b30e-4aba-82d7-f3c792e31b3f service nova] Creating event network-vif-plugged:e3da125b-6cd9-4a58-9e66-2d1f930c1747 for instance 810fa621-4501-4d97-843c-5692dbe59a15 on n-h1-860864-3 Oct 11 20:23:44.599389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56ac8966-8541-48ab-84ed-53db565851aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:44.610842 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56ac8966-8541-48ab-84ed-53db565851aa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1202 microversion: 2.1 time: 0.389483 Oct 11 20:23:44.626786 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1658639b-214a-477e-bfe2-2a334e217707 req-f3d3419e-b30e-4aba-82d7-f3c792e31b3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086786 Oct 11 20:23:44.627863 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2981/6002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:44 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:44.628288 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3022/6003] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:23:45.307406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-00575a18-4292-4b32-8668-1ae76637f46d req-6a3a3ec7-f667-476f-a016-c425b4eb8bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd1c053-7968-43d6-8381-3c3ec27e24dc", "tag": "4676a8b3-2f11-416a-8951-7b4e803d2ff6"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:23:45.325405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-00575a18-4292-4b32-8668-1ae76637f46d req-6a3a3ec7-f667-476f-a016-c425b4eb8bc8 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:45.330286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-00575a18-4292-4b32-8668-1ae76637f46d req-6a3a3ec7-f667-476f-a016-c425b4eb8bc8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:45.331718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-00575a18-4292-4b32-8668-1ae76637f46d req-6a3a3ec7-f667-476f-a016-c425b4eb8bc8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:45.360967 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-00575a18-4292-4b32-8668-1ae76637f46d req-6a3a3ec7-f667-476f-a016-c425b4eb8bc8 service nova] Creating event network-changed:4676a8b3-2f11-416a-8951-7b4e803d2ff6 for instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc on n-h2-860864-3 Oct 11 20:23:45.377586 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-00575a18-4292-4b32-8668-1ae76637f46d req-6a3a3ec7-f667-476f-a016-c425b4eb8bc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083492 Oct 11 20:23:45.378222 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2982/6004] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:23:45.634095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0d8f77c-5f49-4302-b4e0-0beab8aaa2d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:45.635218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0d8f77c-5f49-4302-b4e0-0beab8aaa2d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:45.642951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d8f77c-5f49-4302-b4e0-0beab8aaa2d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:45.644541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d8f77c-5f49-4302-b4e0-0beab8aaa2d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:45.645583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d8f77c-5f49-4302-b4e0-0beab8aaa2d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:45.647659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d8f77c-5f49-4302-b4e0-0beab8aaa2d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:45.648592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d8f77c-5f49-4302-b4e0-0beab8aaa2d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:45.649444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d8f77c-5f49-4302-b4e0-0beab8aaa2d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:46.207651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e0d8f77c-5f49-4302-b4e0-0beab8aaa2d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:46.216352 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0d8f77c-5f49-4302-b4e0-0beab8aaa2d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1202 microversion: 2.1 time: 0.586561 Oct 11 20:23:46.217504 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3023/6005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:45 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1202 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:47.242178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f40001e5-752f-4103-b4cb-39bcb47a35e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:47.244681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f40001e5-752f-4103-b4cb-39bcb47a35e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:47.258601 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f40001e5-752f-4103-b4cb-39bcb47a35e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:47.259370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f40001e5-752f-4103-b4cb-39bcb47a35e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:47.260242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f40001e5-752f-4103-b4cb-39bcb47a35e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:47.261151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f40001e5-752f-4103-b4cb-39bcb47a35e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:47.261617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f40001e5-752f-4103-b4cb-39bcb47a35e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:47.262062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f40001e5-752f-4103-b4cb-39bcb47a35e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:48.087501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f40001e5-752f-4103-b4cb-39bcb47a35e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:48.103816 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f40001e5-752f-4103-b4cb-39bcb47a35e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1388 microversion: 2.1 time: 0.866154 Oct 11 20:23:48.105288 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2983/6006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:47 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1388 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:48.130281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c2811b4a-c504-4740-b3ce-d52aedfd27b7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:48.131034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c2811b4a-c504-4740-b3ce-d52aedfd27b7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:48.139578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2811b4a-c504-4740-b3ce-d52aedfd27b7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:48.140264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2811b4a-c504-4740-b3ce-d52aedfd27b7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:48.140803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2811b4a-c504-4740-b3ce-d52aedfd27b7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:48.141620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2811b4a-c504-4740-b3ce-d52aedfd27b7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:48.142188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2811b4a-c504-4740-b3ce-d52aedfd27b7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:48.142657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c2811b4a-c504-4740-b3ce-d52aedfd27b7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:48.451661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c2811b4a-c504-4740-b3ce-d52aedfd27b7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:48.461129 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c2811b4a-c504-4740-b3ce-d52aedfd27b7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1388 microversion: 2.1 time: 0.336627 Oct 11 20:23:48.462381 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3024/6007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:48 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1388 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:48.484439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c753b8dc-981f-4250-b9bc-721b6d874868 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:48.485918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c753b8dc-981f-4250-b9bc-721b6d874868 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:48.493650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c753b8dc-981f-4250-b9bc-721b6d874868 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:48.495008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c753b8dc-981f-4250-b9bc-721b6d874868 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:48.495686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c753b8dc-981f-4250-b9bc-721b6d874868 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:48.496646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c753b8dc-981f-4250-b9bc-721b6d874868 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:48.497323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c753b8dc-981f-4250-b9bc-721b6d874868 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:48.498033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c753b8dc-981f-4250-b9bc-721b6d874868 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:48.793594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c753b8dc-981f-4250-b9bc-721b6d874868 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:48.803994 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c753b8dc-981f-4250-b9bc-721b6d874868 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1388 microversion: 2.1 time: 0.323905 Oct 11 20:23:48.821787 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2984/6008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:48 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1388 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:48.910081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ef63cc0b-54bc-4102-83db-1edc9ca3c2d9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:48.911433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef63cc0b-54bc-4102-83db-1edc9ca3c2d9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:48.921661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef63cc0b-54bc-4102-83db-1edc9ca3c2d9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:48.924567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef63cc0b-54bc-4102-83db-1edc9ca3c2d9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:48.925380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef63cc0b-54bc-4102-83db-1edc9ca3c2d9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:48.927869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef63cc0b-54bc-4102-83db-1edc9ca3c2d9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:48.929284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef63cc0b-54bc-4102-83db-1edc9ca3c2d9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:48.930443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef63cc0b-54bc-4102-83db-1edc9ca3c2d9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:48.980539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef63cc0b-54bc-4102-83db-1edc9ca3c2d9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:23:49.151239 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ef63cc0b-54bc-4102-83db-1edc9ca3c2d9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 204 len: 0 microversion: 2.1 time: 0.249036 Oct 11 20:23:49.154752 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3025/6009] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:23:48 2022] DELETE /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:23:49.177682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8ae9ad8b-9a02-4945-aa28-d7d04d43dc10 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:49.178764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8ae9ad8b-9a02-4945-aa28-d7d04d43dc10 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:49.186775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae9ad8b-9a02-4945-aa28-d7d04d43dc10 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:49.188296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae9ad8b-9a02-4945-aa28-d7d04d43dc10 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:49.188901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae9ad8b-9a02-4945-aa28-d7d04d43dc10 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:49.189791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae9ad8b-9a02-4945-aa28-d7d04d43dc10 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:49.190635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae9ad8b-9a02-4945-aa28-d7d04d43dc10 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:49.191246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ae9ad8b-9a02-4945-aa28-d7d04d43dc10 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:49.548311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8ae9ad8b-9a02-4945-aa28-d7d04d43dc10 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:49.562499 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8ae9ad8b-9a02-4945-aa28-d7d04d43dc10 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1394 microversion: 2.1 time: 0.403072 Oct 11 20:23:49.567072 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2985/6010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:49 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1394 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:50.590333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-33b51d23-deda-4794-a2e1-d65c2b24b26c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:50.591072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-33b51d23-deda-4794-a2e1-d65c2b24b26c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:50.599290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b51d23-deda-4794-a2e1-d65c2b24b26c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:50.599781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b51d23-deda-4794-a2e1-d65c2b24b26c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:50.600396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b51d23-deda-4794-a2e1-d65c2b24b26c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:50.601303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b51d23-deda-4794-a2e1-d65c2b24b26c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:50.601930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b51d23-deda-4794-a2e1-d65c2b24b26c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:50.602542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33b51d23-deda-4794-a2e1-d65c2b24b26c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:50.983244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-33b51d23-deda-4794-a2e1-d65c2b24b26c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:50.992049 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-33b51d23-deda-4794-a2e1-d65c2b24b26c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1394 microversion: 2.1 time: 0.405834 Oct 11 20:23:50.993321 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3026/6011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:50 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1394 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:51.534028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-0ab5d0fd-1efa-46e5-a00d-3d16db3ea399 req-9d8a6684-4de8-4ddb-8ccf-10e8eaf772ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810fa621-4501-4d97-843c-5692dbe59a15", "name": "network-vif-deleted", "tag": "e3da125b-6cd9-4a58-9e66-2d1f930c1747"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:23:51.564544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0ab5d0fd-1efa-46e5-a00d-3d16db3ea399 req-9d8a6684-4de8-4ddb-8ccf-10e8eaf772ac service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:51.565932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0ab5d0fd-1efa-46e5-a00d-3d16db3ea399 req-9d8a6684-4de8-4ddb-8ccf-10e8eaf772ac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:51.566453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0ab5d0fd-1efa-46e5-a00d-3d16db3ea399 req-9d8a6684-4de8-4ddb-8ccf-10e8eaf772ac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:51.583126 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-0ab5d0fd-1efa-46e5-a00d-3d16db3ea399 req-9d8a6684-4de8-4ddb-8ccf-10e8eaf772ac service nova] Creating event network-vif-deleted:e3da125b-6cd9-4a58-9e66-2d1f930c1747 for instance 810fa621-4501-4d97-843c-5692dbe59a15 on n-h1-860864-3 Oct 11 20:23:51.591048 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-0ab5d0fd-1efa-46e5-a00d-3d16db3ea399 req-9d8a6684-4de8-4ddb-8ccf-10e8eaf772ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062423 Oct 11 20:23:51.631054 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2986/6012] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:23:52.018070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e431bdc-a411-4004-b47f-c1a2f47bd393 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:52.018828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e431bdc-a411-4004-b47f-c1a2f47bd393 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:52.029144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e431bdc-a411-4004-b47f-c1a2f47bd393 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:52.035492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e431bdc-a411-4004-b47f-c1a2f47bd393 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:52.036317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e431bdc-a411-4004-b47f-c1a2f47bd393 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:52.038454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e431bdc-a411-4004-b47f-c1a2f47bd393 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:52.039214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e431bdc-a411-4004-b47f-c1a2f47bd393 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:52.040464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e431bdc-a411-4004-b47f-c1a2f47bd393 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:52.187952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e431bdc-a411-4004-b47f-c1a2f47bd393 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:52.202207 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e431bdc-a411-4004-b47f-c1a2f47bd393 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1187 microversion: 2.1 time: 0.187356 Oct 11 20:23:52.204663 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3027/6013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:52 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1187 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:53.229469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8b53578f-12d1-454a-8b02-c9c0d54b0125 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:53.230509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8b53578f-12d1-454a-8b02-c9c0d54b0125 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:53.251134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b53578f-12d1-454a-8b02-c9c0d54b0125 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:53.251859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b53578f-12d1-454a-8b02-c9c0d54b0125 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:53.255276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b53578f-12d1-454a-8b02-c9c0d54b0125 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:53.257064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b53578f-12d1-454a-8b02-c9c0d54b0125 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:53.261470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b53578f-12d1-454a-8b02-c9c0d54b0125 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:53.262054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8b53578f-12d1-454a-8b02-c9c0d54b0125 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:53.486467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8b53578f-12d1-454a-8b02-c9c0d54b0125 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:53.520333 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8b53578f-12d1-454a-8b02-c9c0d54b0125 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1187 microversion: 2.1 time: 0.296602 Oct 11 20:23:53.521595 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2987/6014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:53 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1187 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:54.547471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd664a11-99ec-40c4-9e04-de318d1d439c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:54.548958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fd664a11-99ec-40c4-9e04-de318d1d439c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:54.564368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd664a11-99ec-40c4-9e04-de318d1d439c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:54.565153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd664a11-99ec-40c4-9e04-de318d1d439c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:54.567066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd664a11-99ec-40c4-9e04-de318d1d439c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:54.570362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd664a11-99ec-40c4-9e04-de318d1d439c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:54.575337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd664a11-99ec-40c4-9e04-de318d1d439c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:54.575817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd664a11-99ec-40c4-9e04-de318d1d439c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:54.663334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fd664a11-99ec-40c4-9e04-de318d1d439c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:54.674834 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fd664a11-99ec-40c4-9e04-de318d1d439c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1187 microversion: 2.1 time: 0.132020 Oct 11 20:23:54.675599 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3028/6015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:54 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1187 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:55.701491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d52c9549-babc-43e1-83e6-630905235092 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:55.702113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d52c9549-babc-43e1-83e6-630905235092 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:55.713591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c9549-babc-43e1-83e6-630905235092 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:55.714103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c9549-babc-43e1-83e6-630905235092 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:55.714575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c9549-babc-43e1-83e6-630905235092 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:55.715295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c9549-babc-43e1-83e6-630905235092 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:55.715759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c9549-babc-43e1-83e6-630905235092 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:55.716192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d52c9549-babc-43e1-83e6-630905235092 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:55.809029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d52c9549-babc-43e1-83e6-630905235092 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:55.823333 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d52c9549-babc-43e1-83e6-630905235092 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1187 microversion: 2.1 time: 0.125729 Oct 11 20:23:55.831775 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2988/6016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:55 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1187 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:56.849402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8dbbc1bd-580e-4265-b1cd-632d8ee4fd50 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:56.850027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8dbbc1bd-580e-4265-b1cd-632d8ee4fd50 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:56.862617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dbbc1bd-580e-4265-b1cd-632d8ee4fd50 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:56.863130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dbbc1bd-580e-4265-b1cd-632d8ee4fd50 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:56.863576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dbbc1bd-580e-4265-b1cd-632d8ee4fd50 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:56.864322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dbbc1bd-580e-4265-b1cd-632d8ee4fd50 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:56.864776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dbbc1bd-580e-4265-b1cd-632d8ee4fd50 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:56.865205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dbbc1bd-580e-4265-b1cd-632d8ee4fd50 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:57.036953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8dbbc1bd-580e-4265-b1cd-632d8ee4fd50 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:57.051446 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8dbbc1bd-580e-4265-b1cd-632d8ee4fd50 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1187 microversion: 2.1 time: 0.206580 Oct 11 20:23:57.052408 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3029/6017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:56 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1187 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:58.083278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:58.084017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:58.091094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:58.091725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:58.092891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:58.093879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:58.094628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:58.095423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:58.135339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:58.136196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:58.136870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:58.137558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lazy-loading 'fault' on Instance uuid 810fa621-4501-4d97-843c-5692dbe59a15 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:23:58.227091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:23:58.239432 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-649b5859-fa87-4019-a885-90f0fd5198b5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 200 len: 1192 microversion: 2.1 time: 0.160256 Oct 11 20:23:58.242882 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2989/6018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:58 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 1192 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:23:59.265257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:23:59.265958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:23:59.280843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:59.281693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:59.282366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:59.283361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:23:59.284150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:23:59.284822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:23:59.309508 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 HTTP/1.1 Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '810fa621-4501-4d97-843c-5692dbe59a15'} Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:23:59.311365 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:23:59.316555 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:23:59.316555 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:23:59.316555 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:23:59.316555 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:23:59.316555 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:23:59.316555 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:23:59.316555 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:23:59.317155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:23:59.318142 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3a752c03-5207-4684-9b55-fa873f4b7c16 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 404 len: 111 microversion: 2.1 time: 0.056847 Oct 11 20:23:59.319769 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3030/6019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:23:59 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:24:03.778204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:03.779450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:03.792484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:03.793270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:03.793890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:03.796657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:03.797370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:03.798093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:03.815088 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 HTTP/1.1 Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '810fa621-4501-4d97-843c-5692dbe59a15'} Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:24:03.817694 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:24:03.822631 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:24:03.824342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:24:03.825661 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0a3b5c56-103a-4ce8-86e4-47ed83cd26fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 404 len: 111 microversion: 2.1 time: 0.052635 Oct 11 20:24:03.827054 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2990/6020] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:24:03 2022] DELETE /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:24:03.836131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:03.837727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 810fa621-4501-4d97-843c-5692dbe59a15] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:03.851442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:03.852182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:03.852894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:03.853879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:03.854517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:03.855139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:03.873707 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 HTTP/1.1 Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '810fa621-4501-4d97-843c-5692dbe59a15'} Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:24:03.875720 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:24:03.880626 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:24:03.880626 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:24:03.880626 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:24:03.880626 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:24:03.880626 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:24:03.880626 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. Oct 11 20:24:03.880626 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:24:03.883300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 810fa621-4501-4d97-843c-5692dbe59a15 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:24:03.884471 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0d2e9740-19b9-4f96-87ec-1e0b5d956719 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15" status: 404 len: 111 microversion: 2.1 time: 0.053533 Oct 11 20:24:03.886765 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3031/6021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:03 2022] GET /compute/v2.1/servers/810fa621-4501-4d97-843c-5692dbe59a15 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 20:24:04.028498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f8301343-1c40-4266-977d-f475c917f771 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:24:04.032461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f8301343-1c40-4266-977d-f475c917f771 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:04.047624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8301343-1c40-4266-977d-f475c917f771 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:04.052027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8301343-1c40-4266-977d-f475c917f771 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:04.052542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8301343-1c40-4266-977d-f475c917f771 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:04.058415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8301343-1c40-4266-977d-f475c917f771 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:04.059018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8301343-1c40-4266-977d-f475c917f771 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:04.059476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8301343-1c40-4266-977d-f475c917f771 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:04.146784 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f8301343-1c40-4266-977d-f475c917f771 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "POST /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc/action" status: 200 len: 24570 microversion: 2.1 time: 0.131881 Oct 11 20:24:04.154218 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2991/6022] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:24:04 2022] POST /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc/action => generated 24570 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:24:19.709910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc98292a-7fa0-4c79-880a-da28bb1e29ac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Action: 'create', calling method: .version_select at 0x7f83c73334c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1664858811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEXoNFjjUpuNsF79Oh2kXYutLemYcyLpOI/kj4W7w2cK6arPF985+DGBqIka/bmWb7qyurjaJUi/XOyR6tS5GHA0LClvyk1P/Qwr3X9c/HBOHU+of3vnyWQOYvF5Se4EQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:24:19.723244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:19.724520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:19.741002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-dc98292a-7fa0-4c79-880a-da28bb1e29ac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for project bf306e7b9d4546b782e7f06728a927b7. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:24:19.751895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-dc98292a-7fa0-4c79-880a-da28bb1e29ac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for user d2e611fef85942e587a8a4e49e10d1b6 and project bf306e7b9d4546b782e7f06728a927b7. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:24:19.806144 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc98292a-7fa0-4c79-880a-da28bb1e29ac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.100648 Oct 11 20:24:19.807783 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3032/6023] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:24:19 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:24:21.699429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-898921955", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "346d91cf-862c-4329-9c1f-7aeab1fb3ca8"}], "key_name": "tempest-TestNetworkBasicOps-1664858811", "security_groups": [{"name": "tempest-secgroup-smoke-281844668"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:24:21.734200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=31 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:21.735031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=77 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:21.886442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] validate_networks() for [('346d91cf-862c-4329-9c1f-7aeab1fb3ca8', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:24:22.835188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:24:22.836544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:24:22.837246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:24:22.837859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:24:22.838682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:24:22.861486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:22.865275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:22.866246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:22.868356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:22.869663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:22.871766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:22.926370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for project bf306e7b9d4546b782e7f06728a927b7. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:24:22.944457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for user d2e611fef85942e587a8a4e49e10d1b6 and project bf306e7b9d4546b782e7f06728a927b7. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:24:22.979354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:24:23.004653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:24:23.136681 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e08f7e7-799c-4ea2-be4f-17215279a785 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.442071 Oct 11 20:24:23.143448 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2992/6024] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:24:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:24:23.154228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e87b9a7-fc58-4409-9c83-9c230fbabea9 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:23.154866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e87b9a7-fc58-4409-9c83-9c230fbabea9 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:23.304303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e87b9a7-fc58-4409-9c83-9c230fbabea9 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:23.318241 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e87b9a7-fc58-4409-9c83-9c230fbabea9 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1248 microversion: 2.1 time: 0.169239 Oct 11 20:24:23.320121 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3033/6025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:23 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1248 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:24.347082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6ff82fe5-4afb-4744-a31e-d75671354bca tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:24.348700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6ff82fe5-4afb-4744-a31e-d75671354bca tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:24.362820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ff82fe5-4afb-4744-a31e-d75671354bca tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:24.363995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ff82fe5-4afb-4744-a31e-d75671354bca tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:24.364690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ff82fe5-4afb-4744-a31e-d75671354bca tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:24.367444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ff82fe5-4afb-4744-a31e-d75671354bca tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:24.368359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ff82fe5-4afb-4744-a31e-d75671354bca tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:24.369522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ff82fe5-4afb-4744-a31e-d75671354bca tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:24.542830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6ff82fe5-4afb-4744-a31e-d75671354bca tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:24.554353 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6ff82fe5-4afb-4744-a31e-d75671354bca tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1244 microversion: 2.1 time: 0.212589 Oct 11 20:24:24.563170 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2993/6026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:24 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1244 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:24:25.589486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c0f4f01f-efc8-4918-b360-2bdbf0eaadc4 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:25.590230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c0f4f01f-efc8-4918-b360-2bdbf0eaadc4 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:25.606428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0f4f01f-efc8-4918-b360-2bdbf0eaadc4 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:25.609823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0f4f01f-efc8-4918-b360-2bdbf0eaadc4 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:25.610572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0f4f01f-efc8-4918-b360-2bdbf0eaadc4 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:25.613283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0f4f01f-efc8-4918-b360-2bdbf0eaadc4 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:25.614505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0f4f01f-efc8-4918-b360-2bdbf0eaadc4 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:25.617075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c0f4f01f-efc8-4918-b360-2bdbf0eaadc4 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:25.744656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c0f4f01f-efc8-4918-b360-2bdbf0eaadc4 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:25.755201 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c0f4f01f-efc8-4918-b360-2bdbf0eaadc4 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1306 microversion: 2.1 time: 0.170468 Oct 11 20:24:25.771459 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3034/6027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:25 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1306 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:26.782801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d592ef5b-23d6-4e04-8968-2eec3d117e73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:26.784412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d592ef5b-23d6-4e04-8968-2eec3d117e73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:26.833742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d592ef5b-23d6-4e04-8968-2eec3d117e73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:26.841719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d592ef5b-23d6-4e04-8968-2eec3d117e73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:26.842632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d592ef5b-23d6-4e04-8968-2eec3d117e73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:26.849622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d592ef5b-23d6-4e04-8968-2eec3d117e73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:26.850439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d592ef5b-23d6-4e04-8968-2eec3d117e73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:26.852006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d592ef5b-23d6-4e04-8968-2eec3d117e73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:27.061297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d592ef5b-23d6-4e04-8968-2eec3d117e73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:27.069735 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d592ef5b-23d6-4e04-8968-2eec3d117e73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1373 microversion: 2.1 time: 0.292090 Oct 11 20:24:27.070316 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2994/6028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:26 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1373 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:27.476492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-09e48fbd-d344-4d1a-baf6-f0da59921102 req-85271d0a-c979-4c9f-aa7b-3379c7c4f784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b601046-8b39-43d0-a353-24423bc5f9aa", "tag": "c3e15180-6594-4bb1-8a17-9392200ebf42"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:24:27.491966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-09e48fbd-d344-4d1a-baf6-f0da59921102 req-85271d0a-c979-4c9f-aa7b-3379c7c4f784 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:27.492453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-09e48fbd-d344-4d1a-baf6-f0da59921102 req-85271d0a-c979-4c9f-aa7b-3379c7c4f784 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:27.492883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-09e48fbd-d344-4d1a-baf6-f0da59921102 req-85271d0a-c979-4c9f-aa7b-3379c7c4f784 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:27.510927 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-09e48fbd-d344-4d1a-baf6-f0da59921102 req-85271d0a-c979-4c9f-aa7b-3379c7c4f784 service nova] Creating event network-changed:c3e15180-6594-4bb1-8a17-9392200ebf42 for instance 4b601046-8b39-43d0-a353-24423bc5f9aa on n-h1-860864-3 Oct 11 20:24:27.516570 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-09e48fbd-d344-4d1a-baf6-f0da59921102 req-85271d0a-c979-4c9f-aa7b-3379c7c4f784 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043768 Oct 11 20:24:27.517483 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3035/6029] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:24:28.096665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ed357efa-e152-48dc-bf51-0a05da331da8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:28.097756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ed357efa-e152-48dc-bf51-0a05da331da8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:28.107734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed357efa-e152-48dc-bf51-0a05da331da8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:28.111281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed357efa-e152-48dc-bf51-0a05da331da8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:28.112035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed357efa-e152-48dc-bf51-0a05da331da8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:28.113433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed357efa-e152-48dc-bf51-0a05da331da8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:28.114253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed357efa-e152-48dc-bf51-0a05da331da8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:28.114966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed357efa-e152-48dc-bf51-0a05da331da8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:28.274386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ed357efa-e152-48dc-bf51-0a05da331da8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:28.285025 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ed357efa-e152-48dc-bf51-0a05da331da8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1373 microversion: 2.1 time: 0.195089 Oct 11 20:24:28.285805 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2995/6030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:28 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:29.311257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6cbe020d-310c-4f2f-b994-bf6807e6e2e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:29.312084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6cbe020d-310c-4f2f-b994-bf6807e6e2e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:29.319941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cbe020d-310c-4f2f-b994-bf6807e6e2e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:29.320507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cbe020d-310c-4f2f-b994-bf6807e6e2e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:29.321297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cbe020d-310c-4f2f-b994-bf6807e6e2e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:29.322212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cbe020d-310c-4f2f-b994-bf6807e6e2e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:29.323122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cbe020d-310c-4f2f-b994-bf6807e6e2e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:29.323721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6cbe020d-310c-4f2f-b994-bf6807e6e2e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:29.478335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6cbe020d-310c-4f2f-b994-bf6807e6e2e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:29.487791 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6cbe020d-310c-4f2f-b994-bf6807e6e2e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1373 microversion: 2.1 time: 0.182256 Oct 11 20:24:29.488666 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3036/6031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:29 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:30.511188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-773f6d66-6b61-4e06-a4f8-0d690d937454 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:30.513135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-773f6d66-6b61-4e06-a4f8-0d690d937454 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:30.526376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-773f6d66-6b61-4e06-a4f8-0d690d937454 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:30.526955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-773f6d66-6b61-4e06-a4f8-0d690d937454 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:30.527383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-773f6d66-6b61-4e06-a4f8-0d690d937454 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:30.534455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-773f6d66-6b61-4e06-a4f8-0d690d937454 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:30.535274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-773f6d66-6b61-4e06-a4f8-0d690d937454 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:30.535723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-773f6d66-6b61-4e06-a4f8-0d690d937454 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:30.770917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-773f6d66-6b61-4e06-a4f8-0d690d937454 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:30.786348 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-773f6d66-6b61-4e06-a4f8-0d690d937454 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1373 microversion: 2.1 time: 0.278949 Oct 11 20:24:30.791940 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2996/6032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:30 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1373 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:31.819803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-62f551d6-137d-45ca-949b-13bc7405582f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:31.820349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-62f551d6-137d-45ca-949b-13bc7405582f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:31.827621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f551d6-137d-45ca-949b-13bc7405582f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:31.835086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f551d6-137d-45ca-949b-13bc7405582f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:31.835586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f551d6-137d-45ca-949b-13bc7405582f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:31.836535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f551d6-137d-45ca-949b-13bc7405582f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:31.837009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f551d6-137d-45ca-949b-13bc7405582f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:31.837446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-62f551d6-137d-45ca-949b-13bc7405582f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:32.005647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-62f551d6-137d-45ca-949b-13bc7405582f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:32.015325 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-62f551d6-137d-45ca-949b-13bc7405582f tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1373 microversion: 2.1 time: 0.200213 Oct 11 20:24:32.027793 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3037/6033] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:31 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1373 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:32.253351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-58ca91f6-627b-44d6-8bf7-f11fb737e455 req-a3897042-6057-4e38-983d-2e300fd7030d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b601046-8b39-43d0-a353-24423bc5f9aa", "name": "network-vif-plugged", "status": "completed", "tag": "c3e15180-6594-4bb1-8a17-9392200ebf42"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:24:32.270651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-58ca91f6-627b-44d6-8bf7-f11fb737e455 req-a3897042-6057-4e38-983d-2e300fd7030d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:32.274641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-58ca91f6-627b-44d6-8bf7-f11fb737e455 req-a3897042-6057-4e38-983d-2e300fd7030d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:32.275453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-58ca91f6-627b-44d6-8bf7-f11fb737e455 req-a3897042-6057-4e38-983d-2e300fd7030d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:32.294770 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-58ca91f6-627b-44d6-8bf7-f11fb737e455 req-a3897042-6057-4e38-983d-2e300fd7030d service nova] Creating event network-vif-plugged:c3e15180-6594-4bb1-8a17-9392200ebf42 for instance 4b601046-8b39-43d0-a353-24423bc5f9aa on n-h1-860864-3 Oct 11 20:24:32.319953 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-58ca91f6-627b-44d6-8bf7-f11fb737e455 req-a3897042-6057-4e38-983d-2e300fd7030d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069399 Oct 11 20:24:32.321090 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2997/6034] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:24:33.041948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c769dc30-fba0-454d-aa9b-b80e94f46854 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:33.045254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c769dc30-fba0-454d-aa9b-b80e94f46854 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:33.066158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c769dc30-fba0-454d-aa9b-b80e94f46854 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:33.066698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c769dc30-fba0-454d-aa9b-b80e94f46854 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:33.067144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c769dc30-fba0-454d-aa9b-b80e94f46854 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:33.067864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c769dc30-fba0-454d-aa9b-b80e94f46854 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:33.068329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c769dc30-fba0-454d-aa9b-b80e94f46854 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:33.080548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c769dc30-fba0-454d-aa9b-b80e94f46854 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:33.283526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c769dc30-fba0-454d-aa9b-b80e94f46854 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:33.292951 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c769dc30-fba0-454d-aa9b-b80e94f46854 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1373 microversion: 2.1 time: 0.255398 Oct 11 20:24:33.296565 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3038/6035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:33 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1373 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:34.318055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b5ccdf9d-caa6-4832-8aa1-bc88ffb34a91 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:34.319438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b5ccdf9d-caa6-4832-8aa1-bc88ffb34a91 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:34.321596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:34.322333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:34.333348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5ccdf9d-caa6-4832-8aa1-bc88ffb34a91 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:34.334230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5ccdf9d-caa6-4832-8aa1-bc88ffb34a91 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:34.334971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5ccdf9d-caa6-4832-8aa1-bc88ffb34a91 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:34.336017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5ccdf9d-caa6-4832-8aa1-bc88ffb34a91 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:34.336695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5ccdf9d-caa6-4832-8aa1-bc88ffb34a91 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:34.337606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5ccdf9d-caa6-4832-8aa1-bc88ffb34a91 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:34.559863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b5ccdf9d-caa6-4832-8aa1-bc88ffb34a91 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:34.568790 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b5ccdf9d-caa6-4832-8aa1-bc88ffb34a91 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1545 microversion: 2.1 time: 0.255216 Oct 11 20:24:34.569466 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2998/6036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:34 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1545 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:34.592663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fb896ba7-3c17-4134-9523-63951ab7497d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:34.593362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fb896ba7-3c17-4134-9523-63951ab7497d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:34.596738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:34.601277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb896ba7-3c17-4134-9523-63951ab7497d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:34.601982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb896ba7-3c17-4134-9523-63951ab7497d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:34.602482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb896ba7-3c17-4134-9523-63951ab7497d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:34.603280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb896ba7-3c17-4134-9523-63951ab7497d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:34.603802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb896ba7-3c17-4134-9523-63951ab7497d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:34.604293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb896ba7-3c17-4134-9523-63951ab7497d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:34.744851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fb896ba7-3c17-4134-9523-63951ab7497d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:34.754127 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fb896ba7-3c17-4134-9523-63951ab7497d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1545 microversion: 2.1 time: 0.166185 Oct 11 20:24:34.754895 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3039/6037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:34 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1545 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:35.771691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1588933209", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "72311ca2-5937-4a9e-b876-2d8368b81b4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "06296b2d-bf7f-4d21-bab0-dfde6b2c7622"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:24:35.838170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] validate_networks() for [('06296b2d-bf7f-4d21-bab0-dfde6b2c7622', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:24:36.649993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:24:36.650518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:24:36.651238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:24:36.651725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:24:36.652206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:24:36.670162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:36.673262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:36.673972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:36.677455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:36.678167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:36.681004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:36.721495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:24:36.728800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for user cbcf07bc33104f78adbcd3dfa198a570 and project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:24:36.812303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:24:36.815570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72311ca2-5937-4a9e-b876-2d8368b81b4e',volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:24:37.009776 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1878d79b-ca0a-44c5-bccb-465f23ca9a0d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245190 Oct 11 20:24:37.010506 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 2999/6038] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:24:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:24:37.022838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5655d100-9e7b-4fcb-94fa-db66b691d713 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:37.023462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5655d100-9e7b-4fcb-94fa-db66b691d713 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:37.115712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5655d100-9e7b-4fcb-94fa-db66b691d713 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:37.124114 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5655d100-9e7b-4fcb-94fa-db66b691d713 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1071 microversion: 2.1 time: 0.104417 Oct 11 20:24:37.125245 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3040/6039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:37 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1071 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:38.149513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f0c608c-ecb4-44c7-b28e-9a7764350a80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:38.150766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f0c608c-ecb4-44c7-b28e-9a7764350a80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:38.173367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f0c608c-ecb4-44c7-b28e-9a7764350a80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:38.175155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f0c608c-ecb4-44c7-b28e-9a7764350a80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:38.179047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f0c608c-ecb4-44c7-b28e-9a7764350a80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:38.179949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f0c608c-ecb4-44c7-b28e-9a7764350a80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:38.180415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f0c608c-ecb4-44c7-b28e-9a7764350a80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:38.181001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f0c608c-ecb4-44c7-b28e-9a7764350a80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:38.289579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2f0c608c-ecb4-44c7-b28e-9a7764350a80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:38.298509 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f0c608c-ecb4-44c7-b28e-9a7764350a80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1169 microversion: 2.1 time: 0.153188 Oct 11 20:24:38.298509 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3000/6040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:38 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1169 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:39.331645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93b3ad58-22c8-4b2f-9c86-09381ae4ab4e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:39.332970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-93b3ad58-22c8-4b2f-9c86-09381ae4ab4e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:39.368210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b3ad58-22c8-4b2f-9c86-09381ae4ab4e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:39.368838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b3ad58-22c8-4b2f-9c86-09381ae4ab4e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:39.372746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b3ad58-22c8-4b2f-9c86-09381ae4ab4e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:39.374100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b3ad58-22c8-4b2f-9c86-09381ae4ab4e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:39.374844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b3ad58-22c8-4b2f-9c86-09381ae4ab4e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:39.382256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93b3ad58-22c8-4b2f-9c86-09381ae4ab4e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:39.721498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-93b3ad58-22c8-4b2f-9c86-09381ae4ab4e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:39.733949 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-93b3ad58-22c8-4b2f-9c86-09381ae4ab4e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1187 microversion: 2.1 time: 0.411955 Oct 11 20:24:39.748416 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3041/6041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:39 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1187 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:40.761449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc67ff71-2573-4c68-bc9f-47aafe2237b9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:40.762182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc67ff71-2573-4c68-bc9f-47aafe2237b9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:40.792285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc67ff71-2573-4c68-bc9f-47aafe2237b9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:40.793228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc67ff71-2573-4c68-bc9f-47aafe2237b9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:40.797507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc67ff71-2573-4c68-bc9f-47aafe2237b9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:40.798494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc67ff71-2573-4c68-bc9f-47aafe2237b9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:40.803922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc67ff71-2573-4c68-bc9f-47aafe2237b9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:40.804680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc67ff71-2573-4c68-bc9f-47aafe2237b9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:41.087736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fc67ff71-2573-4c68-bc9f-47aafe2237b9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:41.106976 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc67ff71-2573-4c68-bc9f-47aafe2237b9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1229 microversion: 2.1 time: 0.346306 Oct 11 20:24:41.111749 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3001/6042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:40 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1229 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:41.956512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-01138d31-5b8c-4f4e-ba9c-e4ca36fd813e req-20135965-dd97-4f24-9f74-e8fc041a08ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce9fa15-1442-4b81-87d1-060b8f35e5e8", "tag": "329f7af5-3747-401e-8771-6e29da46ad7b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:24:42.009001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-01138d31-5b8c-4f4e-ba9c-e4ca36fd813e req-20135965-dd97-4f24-9f74-e8fc041a08ac service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:42.013171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-01138d31-5b8c-4f4e-ba9c-e4ca36fd813e req-20135965-dd97-4f24-9f74-e8fc041a08ac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:42.013919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-01138d31-5b8c-4f4e-ba9c-e4ca36fd813e req-20135965-dd97-4f24-9f74-e8fc041a08ac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:42.040921 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-01138d31-5b8c-4f4e-ba9c-e4ca36fd813e req-20135965-dd97-4f24-9f74-e8fc041a08ac service nova] Creating event network-changed:329f7af5-3747-401e-8771-6e29da46ad7b for instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 on n-h2-860864-3 Oct 11 20:24:42.046798 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-01138d31-5b8c-4f4e-ba9c-e4ca36fd813e req-20135965-dd97-4f24-9f74-e8fc041a08ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097942 Oct 11 20:24:42.047734 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3042/6043] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:24:42.131600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c59f0b3e-59a9-4918-9347-328c0d66b2c9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:42.133137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c59f0b3e-59a9-4918-9347-328c0d66b2c9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:42.150474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59f0b3e-59a9-4918-9347-328c0d66b2c9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:42.155305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59f0b3e-59a9-4918-9347-328c0d66b2c9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:42.155963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59f0b3e-59a9-4918-9347-328c0d66b2c9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:42.156858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59f0b3e-59a9-4918-9347-328c0d66b2c9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:42.163541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59f0b3e-59a9-4918-9347-328c0d66b2c9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:42.164035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c59f0b3e-59a9-4918-9347-328c0d66b2c9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:42.609325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c59f0b3e-59a9-4918-9347-328c0d66b2c9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:42.626496 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c59f0b3e-59a9-4918-9347-328c0d66b2c9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1229 microversion: 2.1 time: 0.501035 Oct 11 20:24:42.639303 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3002/6044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:42 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1229 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:43.652208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-985d0582-ae94-415d-8915-c560a5388f5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:43.654191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-985d0582-ae94-415d-8915-c560a5388f5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:43.673048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-985d0582-ae94-415d-8915-c560a5388f5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:43.673422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-985d0582-ae94-415d-8915-c560a5388f5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:43.673864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-985d0582-ae94-415d-8915-c560a5388f5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:43.674600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-985d0582-ae94-415d-8915-c560a5388f5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:43.675058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-985d0582-ae94-415d-8915-c560a5388f5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:43.675698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-985d0582-ae94-415d-8915-c560a5388f5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:44.038048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-985d0582-ae94-415d-8915-c560a5388f5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:44.047189 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-985d0582-ae94-415d-8915-c560a5388f5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1229 microversion: 2.1 time: 0.399226 Oct 11 20:24:44.047786 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3043/6045] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:43 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1229 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:45.071032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-117d4e83-30e9-4fcb-8f6c-4bf977a0c8ab tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:45.072368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-117d4e83-30e9-4fcb-8f6c-4bf977a0c8ab tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:45.083315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-117d4e83-30e9-4fcb-8f6c-4bf977a0c8ab tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:45.084055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-117d4e83-30e9-4fcb-8f6c-4bf977a0c8ab tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:45.084713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-117d4e83-30e9-4fcb-8f6c-4bf977a0c8ab tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:45.085635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-117d4e83-30e9-4fcb-8f6c-4bf977a0c8ab tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:45.086292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-117d4e83-30e9-4fcb-8f6c-4bf977a0c8ab tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:45.086942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-117d4e83-30e9-4fcb-8f6c-4bf977a0c8ab tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:45.280135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-117d4e83-30e9-4fcb-8f6c-4bf977a0c8ab tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:45.288328 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-117d4e83-30e9-4fcb-8f6c-4bf977a0c8ab tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1229 microversion: 2.1 time: 0.222181 Oct 11 20:24:45.288929 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3003/6046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:45 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1229 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:46.323440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5ec364ae-256d-4b10-ae6c-8a6d47184f8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:46.324000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5ec364ae-256d-4b10-ae6c-8a6d47184f8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:46.331076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec364ae-256d-4b10-ae6c-8a6d47184f8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:46.331562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec364ae-256d-4b10-ae6c-8a6d47184f8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:46.331992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec364ae-256d-4b10-ae6c-8a6d47184f8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:46.332685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec364ae-256d-4b10-ae6c-8a6d47184f8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:46.333139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec364ae-256d-4b10-ae6c-8a6d47184f8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:46.333555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec364ae-256d-4b10-ae6c-8a6d47184f8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:46.522499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5ec364ae-256d-4b10-ae6c-8a6d47184f8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:46.532459 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5ec364ae-256d-4b10-ae6c-8a6d47184f8d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1229 microversion: 2.1 time: 0.212912 Oct 11 20:24:46.535738 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3044/6047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:46 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1229 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:47.560730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5459bef-39ed-4c20-8f11-99538789cb35 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:47.562954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c5459bef-39ed-4c20-8f11-99538789cb35 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:47.571954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:47.573492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:47.576576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5459bef-39ed-4c20-8f11-99538789cb35 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:47.577211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5459bef-39ed-4c20-8f11-99538789cb35 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:47.578075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5459bef-39ed-4c20-8f11-99538789cb35 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:47.579115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5459bef-39ed-4c20-8f11-99538789cb35 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:47.580084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5459bef-39ed-4c20-8f11-99538789cb35 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:47.580583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c5459bef-39ed-4c20-8f11-99538789cb35 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:47.753822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c5459bef-39ed-4c20-8f11-99538789cb35 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:47.764012 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c5459bef-39ed-4c20-8f11-99538789cb35 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.207520 Oct 11 20:24:47.765868 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3004/6048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:47 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:48.789532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f762f6c0-c9c9-4b88-aa83-2562e88c8c93 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:48.790476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f762f6c0-c9c9-4b88-aa83-2562e88c8c93 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:48.793374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:48.800158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f762f6c0-c9c9-4b88-aa83-2562e88c8c93 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:48.801044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f762f6c0-c9c9-4b88-aa83-2562e88c8c93 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:48.801559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f762f6c0-c9c9-4b88-aa83-2562e88c8c93 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:48.802333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f762f6c0-c9c9-4b88-aa83-2562e88c8c93 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:48.802888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f762f6c0-c9c9-4b88-aa83-2562e88c8c93 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:48.803399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f762f6c0-c9c9-4b88-aa83-2562e88c8c93 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:48.974152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f762f6c0-c9c9-4b88-aa83-2562e88c8c93 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:48.982802 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f762f6c0-c9c9-4b88-aa83-2562e88c8c93 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.197126 Oct 11 20:24:48.983598 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3045/6049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:48 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:50.005238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bffe843c-bb4a-48ff-890e-5dcfff541b63 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:50.006015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bffe843c-bb4a-48ff-890e-5dcfff541b63 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:50.013729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bffe843c-bb4a-48ff-890e-5dcfff541b63 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:50.014227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bffe843c-bb4a-48ff-890e-5dcfff541b63 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:50.014719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bffe843c-bb4a-48ff-890e-5dcfff541b63 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:50.015432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bffe843c-bb4a-48ff-890e-5dcfff541b63 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:50.015931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bffe843c-bb4a-48ff-890e-5dcfff541b63 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:50.016366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bffe843c-bb4a-48ff-890e-5dcfff541b63 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:50.168826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bffe843c-bb4a-48ff-890e-5dcfff541b63 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:50.178817 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bffe843c-bb4a-48ff-890e-5dcfff541b63 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.177289 Oct 11 20:24:50.179516 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3005/6050] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:50 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:51.206040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c3b2e01-e25e-4175-a014-5e8ad6544764 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:51.206729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c3b2e01-e25e-4175-a014-5e8ad6544764 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:51.209505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:51.215324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b2e01-e25e-4175-a014-5e8ad6544764 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:51.215800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b2e01-e25e-4175-a014-5e8ad6544764 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:51.216232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b2e01-e25e-4175-a014-5e8ad6544764 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:51.216949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b2e01-e25e-4175-a014-5e8ad6544764 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:51.217399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b2e01-e25e-4175-a014-5e8ad6544764 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:51.217818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c3b2e01-e25e-4175-a014-5e8ad6544764 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:51.360533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c3b2e01-e25e-4175-a014-5e8ad6544764 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:51.371207 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c3b2e01-e25e-4175-a014-5e8ad6544764 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.169075 Oct 11 20:24:51.372089 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3046/6051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:51 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:52.394094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ad91f622-02e0-42bc-bcb2-258ab64dbe3a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:52.397414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ad91f622-02e0-42bc-bcb2-258ab64dbe3a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:52.400781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:52.408051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad91f622-02e0-42bc-bcb2-258ab64dbe3a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:52.408653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad91f622-02e0-42bc-bcb2-258ab64dbe3a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:52.409164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad91f622-02e0-42bc-bcb2-258ab64dbe3a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:52.410120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad91f622-02e0-42bc-bcb2-258ab64dbe3a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:52.410728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad91f622-02e0-42bc-bcb2-258ab64dbe3a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:52.411328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ad91f622-02e0-42bc-bcb2-258ab64dbe3a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:52.415399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=73 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:52.582468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ad91f622-02e0-42bc-bcb2-258ab64dbe3a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:52.591813 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ad91f622-02e0-42bc-bcb2-258ab64dbe3a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.201762 Oct 11 20:24:52.601564 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3006/6052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:52 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:53.617414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7aca31ab-2dd9-45d2-ac41-01d00ac3df99 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:53.617944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7aca31ab-2dd9-45d2-ac41-01d00ac3df99 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:53.625015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aca31ab-2dd9-45d2-ac41-01d00ac3df99 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:53.625496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aca31ab-2dd9-45d2-ac41-01d00ac3df99 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:53.625925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aca31ab-2dd9-45d2-ac41-01d00ac3df99 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:53.626647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aca31ab-2dd9-45d2-ac41-01d00ac3df99 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:53.627100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aca31ab-2dd9-45d2-ac41-01d00ac3df99 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:53.627519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aca31ab-2dd9-45d2-ac41-01d00ac3df99 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:53.630082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=65 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:24:53.768714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7aca31ab-2dd9-45d2-ac41-01d00ac3df99 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:53.777051 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7aca31ab-2dd9-45d2-ac41-01d00ac3df99 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.163363 Oct 11 20:24:53.794450 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3047/6053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:53 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:54.801426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c1407c2e-cb28-4a0d-b9ad-f002ed1fbe17 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:54.802355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c1407c2e-cb28-4a0d-b9ad-f002ed1fbe17 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:54.810282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1407c2e-cb28-4a0d-b9ad-f002ed1fbe17 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:54.810815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1407c2e-cb28-4a0d-b9ad-f002ed1fbe17 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:54.811494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1407c2e-cb28-4a0d-b9ad-f002ed1fbe17 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:54.812264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1407c2e-cb28-4a0d-b9ad-f002ed1fbe17 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:54.812817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1407c2e-cb28-4a0d-b9ad-f002ed1fbe17 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:54.813383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1407c2e-cb28-4a0d-b9ad-f002ed1fbe17 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:55.000524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c1407c2e-cb28-4a0d-b9ad-f002ed1fbe17 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:55.010181 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c1407c2e-cb28-4a0d-b9ad-f002ed1fbe17 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.212692 Oct 11 20:24:55.011200 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3007/6054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:54 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:56.033774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ef3dcb59-2961-4edf-929b-aafb2d56ec5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:56.034512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef3dcb59-2961-4edf-929b-aafb2d56ec5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:56.041797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef3dcb59-2961-4edf-929b-aafb2d56ec5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:56.042402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef3dcb59-2961-4edf-929b-aafb2d56ec5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:56.043025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef3dcb59-2961-4edf-929b-aafb2d56ec5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:56.043840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef3dcb59-2961-4edf-929b-aafb2d56ec5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:56.044328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef3dcb59-2961-4edf-929b-aafb2d56ec5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:56.044876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef3dcb59-2961-4edf-929b-aafb2d56ec5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:56.192406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ef3dcb59-2961-4edf-929b-aafb2d56ec5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:56.201200 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ef3dcb59-2961-4edf-929b-aafb2d56ec5d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.171440 Oct 11 20:24:56.201898 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3048/6055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:56 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:57.224598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7d0ae9da-1dd3-438b-81d2-bf0ce8836126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:57.225208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7d0ae9da-1dd3-438b-81d2-bf0ce8836126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:57.232774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d0ae9da-1dd3-438b-81d2-bf0ce8836126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:57.233260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d0ae9da-1dd3-438b-81d2-bf0ce8836126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:57.233692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d0ae9da-1dd3-438b-81d2-bf0ce8836126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:57.234379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d0ae9da-1dd3-438b-81d2-bf0ce8836126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:57.234873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d0ae9da-1dd3-438b-81d2-bf0ce8836126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:57.235293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d0ae9da-1dd3-438b-81d2-bf0ce8836126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:57.385335 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d0ae9da-1dd3-438b-81d2-bf0ce8836126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:57.393787 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7d0ae9da-1dd3-438b-81d2-bf0ce8836126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.173195 Oct 11 20:24:57.394471 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3008/6056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:57 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:58.418069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-783d56e9-c17a-4324-a92a-e86026252e53 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:58.418755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-783d56e9-c17a-4324-a92a-e86026252e53 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:58.425619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783d56e9-c17a-4324-a92a-e86026252e53 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:58.426099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783d56e9-c17a-4324-a92a-e86026252e53 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:58.426616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783d56e9-c17a-4324-a92a-e86026252e53 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:58.427302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783d56e9-c17a-4324-a92a-e86026252e53 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:58.427748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783d56e9-c17a-4324-a92a-e86026252e53 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:58.428167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-783d56e9-c17a-4324-a92a-e86026252e53 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:58.575407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-783d56e9-c17a-4324-a92a-e86026252e53 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:58.584239 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-783d56e9-c17a-4324-a92a-e86026252e53 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.170772 Oct 11 20:24:58.585003 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3049/6057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:58 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:24:58.815072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8e96e86c-7d0f-4e55-9254-cba1f64e5d61 req-66dca710-fecf-4a5c-b982-0a6017f7f3bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce9fa15-1442-4b81-87d1-060b8f35e5e8", "name": "network-vif-plugged", "status": "completed", "tag": "329f7af5-3747-401e-8771-6e29da46ad7b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:24:58.825516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8e96e86c-7d0f-4e55-9254-cba1f64e5d61 req-66dca710-fecf-4a5c-b982-0a6017f7f3bc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:58.826001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8e96e86c-7d0f-4e55-9254-cba1f64e5d61 req-66dca710-fecf-4a5c-b982-0a6017f7f3bc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:58.826428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8e96e86c-7d0f-4e55-9254-cba1f64e5d61 req-66dca710-fecf-4a5c-b982-0a6017f7f3bc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:58.837861 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8e96e86c-7d0f-4e55-9254-cba1f64e5d61 req-66dca710-fecf-4a5c-b982-0a6017f7f3bc service nova] Creating event network-vif-plugged:329f7af5-3747-401e-8771-6e29da46ad7b for instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 on n-h2-860864-3 Oct 11 20:24:58.843287 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8e96e86c-7d0f-4e55-9254-cba1f64e5d61 req-66dca710-fecf-4a5c-b982-0a6017f7f3bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195407 Oct 11 20:24:58.843892 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3009/6058] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:24:59.607936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c1be4439-7d8b-4928-a0e1-45405115cb51 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:24:59.608558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1be4439-7d8b-4928-a0e1-45405115cb51 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:24:59.615590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1be4439-7d8b-4928-a0e1-45405115cb51 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:59.616082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1be4439-7d8b-4928-a0e1-45405115cb51 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:59.616536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1be4439-7d8b-4928-a0e1-45405115cb51 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:59.617222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1be4439-7d8b-4928-a0e1-45405115cb51 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:24:59.617688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1be4439-7d8b-4928-a0e1-45405115cb51 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:24:59.618113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1be4439-7d8b-4928-a0e1-45405115cb51 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:24:59.757213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c1be4439-7d8b-4928-a0e1-45405115cb51 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:24:59.766320 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c1be4439-7d8b-4928-a0e1-45405115cb51 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1217 microversion: 2.1 time: 0.163031 Oct 11 20:24:59.778248 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3050/6059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:24:59 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:00.529082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-390d7fff-9a56-4cee-975e-21979f2dd6f3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:00.529908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-390d7fff-9a56-4cee-975e-21979f2dd6f3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:00.542518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390d7fff-9a56-4cee-975e-21979f2dd6f3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:00.545548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390d7fff-9a56-4cee-975e-21979f2dd6f3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:00.546012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390d7fff-9a56-4cee-975e-21979f2dd6f3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:00.546823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390d7fff-9a56-4cee-975e-21979f2dd6f3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:00.547291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390d7fff-9a56-4cee-975e-21979f2dd6f3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:00.547719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-390d7fff-9a56-4cee-975e-21979f2dd6f3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:00.582633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-390d7fff-9a56-4cee-975e-21979f2dd6f3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:25:00.683628 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-390d7fff-9a56-4cee-975e-21979f2dd6f3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 204 len: 0 microversion: 2.1 time: 0.163519 Oct 11 20:25:00.684899 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3010/6060] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:25:00 2022] DELETE /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:25:00.693752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-571b5444-bad8-469b-aeeb-53bd71ec8502 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:00.695034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-571b5444-bad8-469b-aeeb-53bd71ec8502 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:00.704338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-571b5444-bad8-469b-aeeb-53bd71ec8502 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:00.705146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-571b5444-bad8-469b-aeeb-53bd71ec8502 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:00.705763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-571b5444-bad8-469b-aeeb-53bd71ec8502 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:00.706888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-571b5444-bad8-469b-aeeb-53bd71ec8502 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:00.707507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-571b5444-bad8-469b-aeeb-53bd71ec8502 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:00.708122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-571b5444-bad8-469b-aeeb-53bd71ec8502 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:00.805224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a823e23-e4a2-439e-a048-892e75ab9603 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:00.806284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a823e23-e4a2-439e-a048-892e75ab9603 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:00.816705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a823e23-e4a2-439e-a048-892e75ab9603 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:00.817567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a823e23-e4a2-439e-a048-892e75ab9603 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:00.818295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a823e23-e4a2-439e-a048-892e75ab9603 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:00.819485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a823e23-e4a2-439e-a048-892e75ab9603 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:00.820193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a823e23-e4a2-439e-a048-892e75ab9603 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:00.820878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a823e23-e4a2-439e-a048-892e75ab9603 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:00.969482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-571b5444-bad8-469b-aeeb-53bd71ec8502 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:00.983453 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-571b5444-bad8-469b-aeeb-53bd71ec8502 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1551 microversion: 2.1 time: 0.294141 Oct 11 20:25:01.002552 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3051/6061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:00 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1551 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:01.060477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4a823e23-e4a2-439e-a048-892e75ab9603 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:01.069906 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a823e23-e4a2-439e-a048-892e75ab9603 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1404 microversion: 2.1 time: 0.281207 Oct 11 20:25:01.073995 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3011/6062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:00 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1404 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:01.108570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cb481bfa-241b-4dcb-aff8-ae7d4896f823 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:01.109206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cb481bfa-241b-4dcb-aff8-ae7d4896f823 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:01.122434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb481bfa-241b-4dcb-aff8-ae7d4896f823 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:01.123506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb481bfa-241b-4dcb-aff8-ae7d4896f823 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:01.124351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb481bfa-241b-4dcb-aff8-ae7d4896f823 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:01.125469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb481bfa-241b-4dcb-aff8-ae7d4896f823 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:01.126167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb481bfa-241b-4dcb-aff8-ae7d4896f823 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:01.126912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb481bfa-241b-4dcb-aff8-ae7d4896f823 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:01.336205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cb481bfa-241b-4dcb-aff8-ae7d4896f823 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:01.348700 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cb481bfa-241b-4dcb-aff8-ae7d4896f823 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1404 microversion: 2.1 time: 0.245879 Oct 11 20:25:01.349587 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3052/6063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:01 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1404 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:01.374579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1967325383"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:01.376713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:01.383778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:01.384188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:01.384640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:01.385358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:01.386377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:01.386891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:01.558252 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.compute.api [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Attempting to quiesce instance before volume snapshot. Oct 11 20:25:01.621729 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.compute.api [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 11 20:25:01.720232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Creating snapshot from volume 72311ca2-5937-4a9e-b876-2d8368b81b4e. {{(pid=126955) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 11 20:25:02.012968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-197a17e2-5266-411e-a884-acdfd00009ab tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:02.014428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-197a17e2-5266-411e-a884-acdfd00009ab tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:02.044729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197a17e2-5266-411e-a884-acdfd00009ab tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:02.047636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197a17e2-5266-411e-a884-acdfd00009ab tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:02.048351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197a17e2-5266-411e-a884-acdfd00009ab tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:02.049633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197a17e2-5266-411e-a884-acdfd00009ab tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:02.050906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197a17e2-5266-411e-a884-acdfd00009ab tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:02.052327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-197a17e2-5266-411e-a884-acdfd00009ab tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:02.257978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-197a17e2-5266-411e-a884-acdfd00009ab tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:02.266681 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-197a17e2-5266-411e-a884-acdfd00009ab tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1551 microversion: 2.1 time: 0.259886 Oct 11 20:25:02.268597 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3053/6064] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:02 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1551 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:02.957227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-5130b540-d5f1-48fb-9480-55ac6da5c33b req-ba38f876-9381-4468-860a-b48a22b29ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b601046-8b39-43d0-a353-24423bc5f9aa", "name": "network-vif-deleted", "tag": "c3e15180-6594-4bb1-8a17-9392200ebf42"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:02.995794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5130b540-d5f1-48fb-9480-55ac6da5c33b req-ba38f876-9381-4468-860a-b48a22b29ac6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:02.996306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5130b540-d5f1-48fb-9480-55ac6da5c33b req-ba38f876-9381-4468-860a-b48a22b29ac6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:02.997357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-5130b540-d5f1-48fb-9480-55ac6da5c33b req-ba38f876-9381-4468-860a-b48a22b29ac6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:03.019182 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-5130b540-d5f1-48fb-9480-55ac6da5c33b req-ba38f876-9381-4468-860a-b48a22b29ac6 service nova] Creating event network-vif-deleted:c3e15180-6594-4bb1-8a17-9392200ebf42 for instance 4b601046-8b39-43d0-a353-24423bc5f9aa on n-h1-860864-3 Oct 11 20:25:03.032931 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-5130b540-d5f1-48fb-9480-55ac6da5c33b req-ba38f876-9381-4468-860a-b48a22b29ac6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211204 Oct 11 20:25:03.040592 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3054/6065] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:25:03.205482 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f9fe314f-63c8-4ed8-bf4a-e6e3bd48449b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "POST /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8/action" status: 202 len: 0 microversion: 2.1 time: 1.835201 Oct 11 20:25:03.214488 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3012/6066] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:25:01 2022] POST /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8/action => generated 0 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 20:25:03.296070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:03.296597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:03.309337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:03.310090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:03.311045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:03.312005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:03.312743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:03.313360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:03.410818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:03.411580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:03.412308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:03.413586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lazy-loading 'fault' on Instance uuid 4b601046-8b39-43d0-a353-24423bc5f9aa {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:25:03.483580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:03.496378 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-21b37209-4223-4fb6-8df4-3307e3ea4400 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 200 len: 1338 microversion: 2.1 time: 0.205266 Oct 11 20:25:03.497140 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3055/6067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:03 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 1338 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:04.416532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-964845839", "imageRef": "32c68051-949c-47c6-9105-cb92ba67476e", "flavorRef": "452", "networks": [{"uuid": "06296b2d-bf7f-4d21-bab0-dfde6b2c7622"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:04.480391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] validate_networks() for [('06296b2d-bf7f-4d21-bab0-dfde6b2c7622', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:25:04.521556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:04.522283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 4b601046-8b39-43d0-a353-24423bc5f9aa] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:04.530059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:04.530574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:04.531013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:04.531711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:04.532165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:04.532583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:04.547174 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] HTTP exception thrown: Instance 4b601046-8b39-43d0-a353-24423bc5f9aa could not be found. Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Request method failure captured: Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa HTTP/1.1 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdCr-M_FbfsQy6CjQxVoYHdTRUq6OZ8iaPQW8LuQmL4jPryCOLRs8uLNlueIitNm4qFvQnO0gkIZlOV0FVQ2Wm5LACPf3_toYnFesO7coTdaEjtgScrIEPCiBXjASPxlOtJ1SAZX1SElyAmaSmrv18u_CzG-1unGtINTBnXHEjC1JN4 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bf306e7b9d4546b782e7f06728a927b7 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestNetworkBasicOps-368215535 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf306e7b9d4546b782e7f06728a927b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf306e7b9d4546b782e7f06728a927b7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf306e7b9d4546b782e7f06728a927b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf306e7b9d4546b782e7f06728a927b7"}]}] Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestNetworkBasicOps-368215535 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bf306e7b9d4546b782e7f06728a927b7 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestNetworkBasicOps-368215535 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestNetworkBasicOps-368215535-project Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d2e611fef85942e587a8a4e49e10d1b6 Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestNetworkBasicOps-368215535-project Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 4b601046-8b39-43d0-a353-24423bc5f9aa could not be found. Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '4b601046-8b39-43d0-a353-24423bc5f9aa'} Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b601046-8b39-43d0-a353-24423bc5f9aa could not be found. Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b601046-8b39-43d0-a353-24423bc5f9aa could not be found. Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:25:04.549130 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:25:04.554560 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:25:04.554560 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:25:04.554560 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:25:04.554560 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:25:04.554560 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:25:04.554560 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b601046-8b39-43d0-a353-24423bc5f9aa could not be found. Oct 11 20:25:04.554560 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:25:04.555774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Returning 404 to user: Instance 4b601046-8b39-43d0-a353-24423bc5f9aa could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:25:04.556794 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99298c49-42c6-4f5d-8dfd-280df557b76c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa" status: 404 len: 111 microversion: 2.1 time: 0.039351 Oct 11 20:25:04.558355 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3056/6068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:04 2022] GET /compute/v2.1/servers/4b601046-8b39-43d0-a353-24423bc5f9aa => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:25:04.750694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f5ed558-8251-430b-a688-d403ce7da4e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '.version_select at 0x7f83c755aca0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:04.798416 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f5ed558-8251-430b-a688-d403ce7da4e5 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1664858811" status: 202 len: 0 microversion: 2.1 time: 0.051629 Oct 11 20:25:04.799523 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3057/6069] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 11 20:25:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1664858811 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 20:25:04.978440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:25:04.978911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:25:04.980026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:25:04.980786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:25:04.981226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:25:04.994763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:04.996079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:04.997468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:04.998431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:04.999126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:04.999742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:05.021956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:25:05.029349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for user cbcf07bc33104f78adbcd3dfa198a570 and project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:25:05.060319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:25:05.064637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='99b2ab4a-785f-4a2e-aa64-254614b4256a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:25:05.200138 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7a33ffbf-f459-48e6-b22c-8fdbeef87b12 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789180 Oct 11 20:25:05.208430 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3013/6070] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:25:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 20:25:05.216479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-51f21ba5-a101-47be-bcd3-a9a82e3091ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:05.219106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-51f21ba5-a101-47be-bcd3-a9a82e3091ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:05.368506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-51f21ba5-a101-47be-bcd3-a9a82e3091ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:05.388681 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-51f21ba5-a101-47be-bcd3-a9a82e3091ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1229 microversion: 2.1 time: 0.180110 Oct 11 20:25:05.389840 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3058/6071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:05 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1229 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:06.419126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-62339802-4a1f-479f-a9bc-18b18872252a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:06.419930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-62339802-4a1f-479f-a9bc-18b18872252a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:06.428476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62339802-4a1f-479f-a9bc-18b18872252a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:06.429319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62339802-4a1f-479f-a9bc-18b18872252a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:06.430042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62339802-4a1f-479f-a9bc-18b18872252a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:06.430992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62339802-4a1f-479f-a9bc-18b18872252a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:06.431816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62339802-4a1f-479f-a9bc-18b18872252a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:06.432834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-62339802-4a1f-479f-a9bc-18b18872252a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:06.501573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-62339802-4a1f-479f-a9bc-18b18872252a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:06.511951 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-62339802-4a1f-479f-a9bc-18b18872252a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1281 microversion: 2.1 time: 0.099667 Oct 11 20:25:06.512897 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3014/6072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:06 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1281 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:07.538424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d3a4fb67-f3e6-4559-8b52-8ba263228ae0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:07.544933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d3a4fb67-f3e6-4559-8b52-8ba263228ae0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:07.558177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3a4fb67-f3e6-4559-8b52-8ba263228ae0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:07.559053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3a4fb67-f3e6-4559-8b52-8ba263228ae0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:07.559493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3a4fb67-f3e6-4559-8b52-8ba263228ae0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:07.560191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3a4fb67-f3e6-4559-8b52-8ba263228ae0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:07.560827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3a4fb67-f3e6-4559-8b52-8ba263228ae0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:07.561681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d3a4fb67-f3e6-4559-8b52-8ba263228ae0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:07.659883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d3a4fb67-f3e6-4559-8b52-8ba263228ae0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:07.675506 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d3a4fb67-f3e6-4559-8b52-8ba263228ae0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1299 microversion: 2.1 time: 0.143358 Oct 11 20:25:07.676371 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3059/6073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:07 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1299 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:07.893043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4ce59953-149f-4fc0-bd44-9c967207f98d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:07.893760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ce59953-149f-4fc0-bd44-9c967207f98d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:07.896148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-7c99f489-09e6-4ed1-b25c-9463742974e4 req-1ded0883-644b-4f8e-8b35-c587c92062f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd1c053-7968-43d6-8381-3c3ec27e24dc", "tag": "4676a8b3-2f11-416a-8951-7b4e803d2ff6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:07.913326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7c99f489-09e6-4ed1-b25c-9463742974e4 req-1ded0883-644b-4f8e-8b35-c587c92062f5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:07.914044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7c99f489-09e6-4ed1-b25c-9463742974e4 req-1ded0883-644b-4f8e-8b35-c587c92062f5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:07.914929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7c99f489-09e6-4ed1-b25c-9463742974e4 req-1ded0883-644b-4f8e-8b35-c587c92062f5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:07.926109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ce59953-149f-4fc0-bd44-9c967207f98d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:07.933484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ce59953-149f-4fc0-bd44-9c967207f98d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:07.937330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ce59953-149f-4fc0-bd44-9c967207f98d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:07.939731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ce59953-149f-4fc0-bd44-9c967207f98d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:07.940670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ce59953-149f-4fc0-bd44-9c967207f98d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:07.942594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ce59953-149f-4fc0-bd44-9c967207f98d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:07.951279 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-7c99f489-09e6-4ed1-b25c-9463742974e4 req-1ded0883-644b-4f8e-8b35-c587c92062f5 service nova] Creating event network-changed:4676a8b3-2f11-416a-8951-7b4e803d2ff6 for instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc on n-h2-860864-3 Oct 11 20:25:07.977833 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-7c99f489-09e6-4ed1-b25c-9463742974e4 req-1ded0883-644b-4f8e-8b35-c587c92062f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072567 Oct 11 20:25:07.992848 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3060/6074] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:25:08.028780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ce59953-149f-4fc0-bd44-9c967207f98d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:25:08.218801 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4ce59953-149f-4fc0-bd44-9c967207f98d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 204 len: 0 microversion: 2.1 time: 0.329880 Oct 11 20:25:08.220424 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3015/6075] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:25:07 2022] DELETE /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:25:08.231308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-648c0d62-4ba0-4488-9cda-b033dd75c799 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:08.232448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-648c0d62-4ba0-4488-9cda-b033dd75c799 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:08.246546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648c0d62-4ba0-4488-9cda-b033dd75c799 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:08.247343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648c0d62-4ba0-4488-9cda-b033dd75c799 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:08.248692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648c0d62-4ba0-4488-9cda-b033dd75c799 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:08.250304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648c0d62-4ba0-4488-9cda-b033dd75c799 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:08.252752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648c0d62-4ba0-4488-9cda-b033dd75c799 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:08.253370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-648c0d62-4ba0-4488-9cda-b033dd75c799 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:08.498661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-648c0d62-4ba0-4488-9cda-b033dd75c799 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:08.509642 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-648c0d62-4ba0-4488-9cda-b033dd75c799 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1670 microversion: 2.1 time: 0.283066 Oct 11 20:25:08.511224 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3061/6076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:08 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1670 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:08.701752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-599b3b05-fc77-498a-930a-ba074e5dd2e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:08.703739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-599b3b05-fc77-498a-930a-ba074e5dd2e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:08.720952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-599b3b05-fc77-498a-930a-ba074e5dd2e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:08.721749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-599b3b05-fc77-498a-930a-ba074e5dd2e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:08.722552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-599b3b05-fc77-498a-930a-ba074e5dd2e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:08.723653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-599b3b05-fc77-498a-930a-ba074e5dd2e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:08.724381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-599b3b05-fc77-498a-930a-ba074e5dd2e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:08.725131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-599b3b05-fc77-498a-930a-ba074e5dd2e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:09.075699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-599b3b05-fc77-498a-930a-ba074e5dd2e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:09.085481 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-599b3b05-fc77-498a-930a-ba074e5dd2e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.388637 Oct 11 20:25:09.086450 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3016/6077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:08 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:09.542359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-275926a2-e77d-4e33-96ae-89c1d1355743 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:09.546998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-275926a2-e77d-4e33-96ae-89c1d1355743 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:09.565305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-275926a2-e77d-4e33-96ae-89c1d1355743 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:09.566078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-275926a2-e77d-4e33-96ae-89c1d1355743 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:09.566538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-275926a2-e77d-4e33-96ae-89c1d1355743 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:09.568131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-275926a2-e77d-4e33-96ae-89c1d1355743 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:09.568604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-275926a2-e77d-4e33-96ae-89c1d1355743 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:09.569040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-275926a2-e77d-4e33-96ae-89c1d1355743 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:10.116558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-87e0ff77-f74b-4bd3-9a7f-6c3ecc01efa3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:10.116558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-87e0ff77-f74b-4bd3-9a7f-6c3ecc01efa3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:10.143901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87e0ff77-f74b-4bd3-9a7f-6c3ecc01efa3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:10.144655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87e0ff77-f74b-4bd3-9a7f-6c3ecc01efa3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:10.148788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87e0ff77-f74b-4bd3-9a7f-6c3ecc01efa3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:10.149770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87e0ff77-f74b-4bd3-9a7f-6c3ecc01efa3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:10.150440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87e0ff77-f74b-4bd3-9a7f-6c3ecc01efa3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:10.151955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-87e0ff77-f74b-4bd3-9a7f-6c3ecc01efa3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:10.361267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-275926a2-e77d-4e33-96ae-89c1d1355743 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:10.376828 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-275926a2-e77d-4e33-96ae-89c1d1355743 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1670 microversion: 2.1 time: 0.843473 Oct 11 20:25:10.377708 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3062/6078] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:09 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1670 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:10.464852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-faaead8b-1260-4c31-b43b-b469d0ffe094 req-d9eb61b0-3bd7-4fb4-8f05-fd64ea93c994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290", "tag": "8e39ae3d-37bc-48e4-8940-d4bf38693ed4"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:10.488462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-faaead8b-1260-4c31-b43b-b469d0ffe094 req-d9eb61b0-3bd7-4fb4-8f05-fd64ea93c994 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:10.496820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-faaead8b-1260-4c31-b43b-b469d0ffe094 req-d9eb61b0-3bd7-4fb4-8f05-fd64ea93c994 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:10.497306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-faaead8b-1260-4c31-b43b-b469d0ffe094 req-d9eb61b0-3bd7-4fb4-8f05-fd64ea93c994 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:10.535830 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-faaead8b-1260-4c31-b43b-b469d0ffe094 req-d9eb61b0-3bd7-4fb4-8f05-fd64ea93c994 service nova] Creating event network-changed:8e39ae3d-37bc-48e4-8940-d4bf38693ed4 for instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 on n-h1-860864-3 Oct 11 20:25:10.547295 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-faaead8b-1260-4c31-b43b-b469d0ffe094 req-d9eb61b0-3bd7-4fb4-8f05-fd64ea93c994 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088279 Oct 11 20:25:10.548624 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3063/6079] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:25:10.552345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-87e0ff77-f74b-4bd3-9a7f-6c3ecc01efa3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:10.564971 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-87e0ff77-f74b-4bd3-9a7f-6c3ecc01efa3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.456541 Oct 11 20:25:10.565512 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3017/6080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:10 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:25:11.167616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-97a1d97e-1d14-486b-a936-e0e9fba2548a req-5f99d596-6e51-4ff2-aa9e-1ce6f06294ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd1c053-7968-43d6-8381-3c3ec27e24dc", "name": "network-vif-deleted", "tag": "4676a8b3-2f11-416a-8951-7b4e803d2ff6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:11.188856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-97a1d97e-1d14-486b-a936-e0e9fba2548a req-5f99d596-6e51-4ff2-aa9e-1ce6f06294ae service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:11.189384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-97a1d97e-1d14-486b-a936-e0e9fba2548a req-5f99d596-6e51-4ff2-aa9e-1ce6f06294ae service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:11.189822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-97a1d97e-1d14-486b-a936-e0e9fba2548a req-5f99d596-6e51-4ff2-aa9e-1ce6f06294ae service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:11.222040 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-97a1d97e-1d14-486b-a936-e0e9fba2548a req-5f99d596-6e51-4ff2-aa9e-1ce6f06294ae service nova] Creating event network-vif-deleted:4676a8b3-2f11-416a-8951-7b4e803d2ff6 for instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc on n-h2-860864-3 Oct 11 20:25:11.242424 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-97a1d97e-1d14-486b-a936-e0e9fba2548a req-5f99d596-6e51-4ff2-aa9e-1ce6f06294ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310356 Oct 11 20:25:11.243502 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3064/6081] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:25:11.404908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:11.407064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:11.424706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:11.425500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:11.425979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:11.426940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:11.428342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:11.428956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:11.461982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:11.499612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:11.500742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:11.501425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:11.502821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lazy-loading 'fault' on Instance uuid 2cd1c053-7968-43d6-8381-3c3ec27e24dc {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:25:11.598269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-69a43e4b-6392-4e66-aa32-1f18272beff3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:11.598749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:11.599297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-69a43e4b-6392-4e66-aa32-1f18272beff3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:11.610022 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5203b6c6-b304-4611-9847-98bfa11b0d5d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 200 len: 1337 microversion: 2.1 time: 0.212244 Oct 11 20:25:11.611035 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3018/6082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:11 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 1337 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:11.615670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69a43e4b-6392-4e66-aa32-1f18272beff3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:11.616535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69a43e4b-6392-4e66-aa32-1f18272beff3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:11.617045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69a43e4b-6392-4e66-aa32-1f18272beff3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:11.617821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69a43e4b-6392-4e66-aa32-1f18272beff3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:11.618934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69a43e4b-6392-4e66-aa32-1f18272beff3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:11.619310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69a43e4b-6392-4e66-aa32-1f18272beff3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:11.881317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-69a43e4b-6392-4e66-aa32-1f18272beff3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:11.893306 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-69a43e4b-6392-4e66-aa32-1f18272beff3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.298383 Oct 11 20:25:11.894099 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3065/6083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:11 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:12.645700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:12.647073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 2cd1c053-7968-43d6-8381-3c3ec27e24dc] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:12.655929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:12.656641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:12.657292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:12.658381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:12.659103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:12.659751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:12.677479 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] HTTP exception thrown: Instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc could not be found. Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Request method failure captured: Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc HTTP/1.1 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdCr-M_FbfsQy6CjQxVoYHdTRUq6OZ8iaPQW8LuQmL4jPryCOLRs8uLNlueIitNm4qFvQnO0gkIZlOV0FVQ2Wm5LACPf3_toYnFesO7coTdaEjtgScrIEPCiBXjASPxlOtJ1SAZX1SElyAmaSmrv18u_CzG-1unGtINTBnXHEjC1JN4 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: bf306e7b9d4546b782e7f06728a927b7 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestNetworkBasicOps-368215535 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf306e7b9d4546b782e7f06728a927b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf306e7b9d4546b782e7f06728a927b7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf306e7b9d4546b782e7f06728a927b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf306e7b9d4546b782e7f06728a927b7"}]}] Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestNetworkBasicOps-368215535 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: bf306e7b9d4546b782e7f06728a927b7 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestNetworkBasicOps-368215535 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestNetworkBasicOps-368215535-project Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d2e611fef85942e587a8a4e49e10d1b6 Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestNetworkBasicOps-368215535-project Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc could not be found. Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '2cd1c053-7968-43d6-8381-3c3ec27e24dc'} Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc could not be found. Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc could not be found. Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:25:12.679575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:25:12.684907 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:25:12.684907 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:25:12.684907 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:25:12.684907 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:25:12.684907 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:25:12.684907 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc could not be found. Oct 11 20:25:12.684907 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:25:12.687217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Returning 404 to user: Instance 2cd1c053-7968-43d6-8381-3c3ec27e24dc could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:25:12.688453 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a9dd821-53db-4050-89fe-d4e3d37eb5a3 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc" status: 404 len: 111 microversion: 2.1 time: 0.052041 Oct 11 20:25:12.692578 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3019/6084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:12 2022] GET /compute/v2.1/servers/2cd1c053-7968-43d6-8381-3c3ec27e24dc => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:25:12.920672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-446c62d0-a74e-4506-9466-6e9bf46038dc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:12.922153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-446c62d0-a74e-4506-9466-6e9bf46038dc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:12.931106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-446c62d0-a74e-4506-9466-6e9bf46038dc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:12.931826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-446c62d0-a74e-4506-9466-6e9bf46038dc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:12.933582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-446c62d0-a74e-4506-9466-6e9bf46038dc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:12.935125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-446c62d0-a74e-4506-9466-6e9bf46038dc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:12.935812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-446c62d0-a74e-4506-9466-6e9bf46038dc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:12.936457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-446c62d0-a74e-4506-9466-6e9bf46038dc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:12.980063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dd698222-cc38-4ffc-bc52-0162eb6c826a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '.version_select at 0x7f83c718b8b0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:13.020558 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dd698222-cc38-4ffc-bc52-0162eb6c826a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-986649424" status: 202 len: 0 microversion: 2.1 time: 0.045139 Oct 11 20:25:13.022214 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3020/6085] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 11 20:25:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-986649424 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:25:13.147689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-446c62d0-a74e-4506-9466-6e9bf46038dc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:13.170303 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-446c62d0-a74e-4506-9466-6e9bf46038dc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.253979 Oct 11 20:25:13.175818 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3066/6086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:12 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:14.196628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-72468ebc-1364-4eb1-add3-024d7bf8ec31 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:14.197279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-72468ebc-1364-4eb1-add3-024d7bf8ec31 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:14.235790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72468ebc-1364-4eb1-add3-024d7bf8ec31 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:14.238047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72468ebc-1364-4eb1-add3-024d7bf8ec31 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:14.238823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72468ebc-1364-4eb1-add3-024d7bf8ec31 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:14.239765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72468ebc-1364-4eb1-add3-024d7bf8ec31 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:14.246762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72468ebc-1364-4eb1-add3-024d7bf8ec31 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:14.247493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-72468ebc-1364-4eb1-add3-024d7bf8ec31 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:14.624582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-72468ebc-1364-4eb1-add3-024d7bf8ec31 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:14.642568 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-72468ebc-1364-4eb1-add3-024d7bf8ec31 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.451221 Oct 11 20:25:14.643490 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3021/6087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:14 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:25:15.677494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-667cae0d-a0ea-44fb-b727-8464821f869f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:15.679446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-667cae0d-a0ea-44fb-b727-8464821f869f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:15.684092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:15.708739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-667cae0d-a0ea-44fb-b727-8464821f869f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:15.709698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-667cae0d-a0ea-44fb-b727-8464821f869f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:15.710423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-667cae0d-a0ea-44fb-b727-8464821f869f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:15.711371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-667cae0d-a0ea-44fb-b727-8464821f869f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:15.712022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-667cae0d-a0ea-44fb-b727-8464821f869f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:15.712642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-667cae0d-a0ea-44fb-b727-8464821f869f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:16.235122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-667cae0d-a0ea-44fb-b727-8464821f869f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:16.244347 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-667cae0d-a0ea-44fb-b727-8464821f869f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.573803 Oct 11 20:25:16.251218 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3067/6088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:15 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:17.274047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97b46bdb-7890-4215-a183-201bab09ce20 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:17.274840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97b46bdb-7890-4215-a183-201bab09ce20 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:17.283568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:17.285793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:17.303452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b46bdb-7890-4215-a183-201bab09ce20 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:17.306163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b46bdb-7890-4215-a183-201bab09ce20 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:17.306719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b46bdb-7890-4215-a183-201bab09ce20 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:17.310371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b46bdb-7890-4215-a183-201bab09ce20 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:17.312937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b46bdb-7890-4215-a183-201bab09ce20 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:17.315433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b46bdb-7890-4215-a183-201bab09ce20 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:17.653327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97b46bdb-7890-4215-a183-201bab09ce20 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:17.670756 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97b46bdb-7890-4215-a183-201bab09ce20 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.400771 Oct 11 20:25:17.673460 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3022/6089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:17 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:18.700544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-19fe859f-7978-4274-b60b-1e6bbdd10143 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:18.701277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-19fe859f-7978-4274-b60b-1e6bbdd10143 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:18.708774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19fe859f-7978-4274-b60b-1e6bbdd10143 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:18.709535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19fe859f-7978-4274-b60b-1e6bbdd10143 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:18.710244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19fe859f-7978-4274-b60b-1e6bbdd10143 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:18.711226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19fe859f-7978-4274-b60b-1e6bbdd10143 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:18.711913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19fe859f-7978-4274-b60b-1e6bbdd10143 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:18.712559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-19fe859f-7978-4274-b60b-1e6bbdd10143 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:19.084221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-19fe859f-7978-4274-b60b-1e6bbdd10143 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:19.086450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:19.097351 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-19fe859f-7978-4274-b60b-1e6bbdd10143 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.401335 Oct 11 20:25:19.110925 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3068/6090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:18 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:20.121720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db676227-48d6-49d7-a831-737c1fefdd7e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:20.122510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-db676227-48d6-49d7-a831-737c1fefdd7e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:20.135280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db676227-48d6-49d7-a831-737c1fefdd7e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:20.138011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db676227-48d6-49d7-a831-737c1fefdd7e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:20.138861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db676227-48d6-49d7-a831-737c1fefdd7e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:20.139828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db676227-48d6-49d7-a831-737c1fefdd7e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:20.140552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db676227-48d6-49d7-a831-737c1fefdd7e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:20.141312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db676227-48d6-49d7-a831-737c1fefdd7e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:20.657751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-db676227-48d6-49d7-a831-737c1fefdd7e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:20.672096 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-db676227-48d6-49d7-a831-737c1fefdd7e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.554636 Oct 11 20:25:20.673536 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3023/6091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:20 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:21.696730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-da2989f9-1f93-431c-b0a9-0594b61996e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:21.697348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-da2989f9-1f93-431c-b0a9-0594b61996e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:21.700405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:21.713472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da2989f9-1f93-431c-b0a9-0594b61996e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:21.718911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da2989f9-1f93-431c-b0a9-0594b61996e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:21.722597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da2989f9-1f93-431c-b0a9-0594b61996e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:21.724251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da2989f9-1f93-431c-b0a9-0594b61996e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:21.724972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da2989f9-1f93-431c-b0a9-0594b61996e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:21.725289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da2989f9-1f93-431c-b0a9-0594b61996e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:21.922309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-da2989f9-1f93-431c-b0a9-0594b61996e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:21.938139 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-da2989f9-1f93-431c-b0a9-0594b61996e6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.244153 Oct 11 20:25:21.951373 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3069/6092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:21 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:22.965520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-68b57a30-542b-4e72-b187-e5dc5a90b720 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:22.966427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-68b57a30-542b-4e72-b187-e5dc5a90b720 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:22.969440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:22.983346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b57a30-542b-4e72-b187-e5dc5a90b720 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:22.986218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b57a30-542b-4e72-b187-e5dc5a90b720 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:22.986729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b57a30-542b-4e72-b187-e5dc5a90b720 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:22.987861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b57a30-542b-4e72-b187-e5dc5a90b720 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:22.988566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b57a30-542b-4e72-b187-e5dc5a90b720 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:22.989156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-68b57a30-542b-4e72-b187-e5dc5a90b720 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:23.340177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-68b57a30-542b-4e72-b187-e5dc5a90b720 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:23.357903 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-68b57a30-542b-4e72-b187-e5dc5a90b720 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.395387 Oct 11 20:25:23.360047 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3024/6093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:22 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:24.383878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f28b748-1b79-4618-8240-65020e4272b3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:24.384906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f28b748-1b79-4618-8240-65020e4272b3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:24.410835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f28b748-1b79-4618-8240-65020e4272b3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:24.410835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f28b748-1b79-4618-8240-65020e4272b3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:24.410835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f28b748-1b79-4618-8240-65020e4272b3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:24.410835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f28b748-1b79-4618-8240-65020e4272b3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:24.410835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f28b748-1b79-4618-8240-65020e4272b3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:24.410835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f28b748-1b79-4618-8240-65020e4272b3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:24.654163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f28b748-1b79-4618-8240-65020e4272b3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:24.670611 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f28b748-1b79-4618-8240-65020e4272b3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.289860 Oct 11 20:25:24.674724 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3070/6094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:24 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:25.698386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6b450f00-1a97-4819-9727-00af275264d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:25.700230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6b450f00-1a97-4819-9727-00af275264d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:25.718674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b450f00-1a97-4819-9727-00af275264d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:25.719204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b450f00-1a97-4819-9727-00af275264d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:25.719669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b450f00-1a97-4819-9727-00af275264d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:25.724996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b450f00-1a97-4819-9727-00af275264d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:25.732740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b450f00-1a97-4819-9727-00af275264d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:25.733288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6b450f00-1a97-4819-9727-00af275264d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:26.198174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6b450f00-1a97-4819-9727-00af275264d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:26.213141 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6b450f00-1a97-4819-9727-00af275264d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.519020 Oct 11 20:25:26.213766 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3025/6095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:25 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:27.237672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-28621697-d8da-4a17-a358-92986764894f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:27.239137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-28621697-d8da-4a17-a358-92986764894f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:27.251947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28621697-d8da-4a17-a358-92986764894f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:27.252723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28621697-d8da-4a17-a358-92986764894f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:27.263330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28621697-d8da-4a17-a358-92986764894f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:27.264133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28621697-d8da-4a17-a358-92986764894f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:27.264595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28621697-d8da-4a17-a358-92986764894f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:27.265065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28621697-d8da-4a17-a358-92986764894f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:28.318061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-28621697-d8da-4a17-a358-92986764894f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:28.332350 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-28621697-d8da-4a17-a358-92986764894f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 1.097650 Oct 11 20:25:28.333818 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3071/6096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:27 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:28.490989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-541c9568-bae8-4541-90d2-7d7ffc76ad0c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Action: 'create', calling method: .version_select at 0x7f83c7374b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-703503919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpTUuFUQR+FVHsSwcnTZgo+bWTr1zcF/QDDohxbZreZGfq+Ee8D3dYiurJttzSfffeGed9Gct3CCme6O7XTU88ht5/n7Ulu3aPX8oRFs8du4ro+tsJRtCjHh6Rv26aASA=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:28.523069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-541c9568-bae8-4541-90d2-7d7ffc76ad0c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for project bf306e7b9d4546b782e7f06728a927b7. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:25:28.533165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-541c9568-bae8-4541-90d2-7d7ffc76ad0c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for user d2e611fef85942e587a8a4e49e10d1b6 and project bf306e7b9d4546b782e7f06728a927b7. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:25:28.571835 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-541c9568-bae8-4541-90d2-7d7ffc76ad0c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.086583 Oct 11 20:25:28.573165 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3026/6097] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:25:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:25:29.366220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a8813771-fe5e-4f19-9c09-1bb2f63a2e88 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:29.367668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a8813771-fe5e-4f19-9c09-1bb2f63a2e88 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:29.387734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8813771-fe5e-4f19-9c09-1bb2f63a2e88 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:29.389281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8813771-fe5e-4f19-9c09-1bb2f63a2e88 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:29.390688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8813771-fe5e-4f19-9c09-1bb2f63a2e88 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:29.393135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8813771-fe5e-4f19-9c09-1bb2f63a2e88 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:29.394214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8813771-fe5e-4f19-9c09-1bb2f63a2e88 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:29.394916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a8813771-fe5e-4f19-9c09-1bb2f63a2e88 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:29.694661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a8813771-fe5e-4f19-9c09-1bb2f63a2e88 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:29.707273 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a8813771-fe5e-4f19-9c09-1bb2f63a2e88 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.348990 Oct 11 20:25:29.708518 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3072/6098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:29 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:30.237435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2056025987", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "f9e91149-8085-475d-8467-9380311e5967"}], "key_name": "tempest-TestNetworkBasicOps-703503919", "security_groups": [{"name": "tempest-secgroup-smoke-803269409"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:30.417088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] validate_networks() for [('f9e91149-8085-475d-8467-9380311e5967', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:25:30.737132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-163e42b6-2be4-4268-9e06-eec980d5b685 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:30.738346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-163e42b6-2be4-4268-9e06-eec980d5b685 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:30.749764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-163e42b6-2be4-4268-9e06-eec980d5b685 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:30.754772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-163e42b6-2be4-4268-9e06-eec980d5b685 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:30.766346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-163e42b6-2be4-4268-9e06-eec980d5b685 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:30.767231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-163e42b6-2be4-4268-9e06-eec980d5b685 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:30.767731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-163e42b6-2be4-4268-9e06-eec980d5b685 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:30.768178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-163e42b6-2be4-4268-9e06-eec980d5b685 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:31.061747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-163e42b6-2be4-4268-9e06-eec980d5b685 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:31.069880 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-163e42b6-2be4-4268-9e06-eec980d5b685 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.337548 Oct 11 20:25:31.083079 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3073/6099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:30 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:31.092296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:25:31.092742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:25:31.093236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:25:31.093661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:25:31.094088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:25:31.110602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:31.111184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:31.111645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:31.112517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:31.113084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:31.113533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:31.132116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for project bf306e7b9d4546b782e7f06728a927b7. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:25:31.142976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Getting quotas for user d2e611fef85942e587a8a4e49e10d1b6 and project bf306e7b9d4546b782e7f06728a927b7. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:25:31.165523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:25:31.168897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:25:31.289975 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dba31233-7457-4ba4-b919-7f36253363db tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.045417 Oct 11 20:25:31.292257 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3027/6100] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:25:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:25:31.318215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd853b86-4fde-4ef7-a1b0-16238360a7a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:31.319212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fd853b86-4fde-4ef7-a1b0-16238360a7a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:31.475591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fd853b86-4fde-4ef7-a1b0-16238360a7a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:31.483497 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fd853b86-4fde-4ef7-a1b0-16238360a7a8 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1248 microversion: 2.1 time: 0.175877 Oct 11 20:25:31.484085 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3074/6101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:31 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1248 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:32.107259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-be3260be-8b43-469b-b5ba-fd7431b90194 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:32.108219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-be3260be-8b43-469b-b5ba-fd7431b90194 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:32.118649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be3260be-8b43-469b-b5ba-fd7431b90194 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:32.119567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be3260be-8b43-469b-b5ba-fd7431b90194 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:32.120340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be3260be-8b43-469b-b5ba-fd7431b90194 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:32.121531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be3260be-8b43-469b-b5ba-fd7431b90194 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:32.122944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be3260be-8b43-469b-b5ba-fd7431b90194 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:32.123757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be3260be-8b43-469b-b5ba-fd7431b90194 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:32.409448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-be3260be-8b43-469b-b5ba-fd7431b90194 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:32.420252 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-be3260be-8b43-469b-b5ba-fd7431b90194 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1341 microversion: 2.1 time: 0.318782 Oct 11 20:25:32.421722 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3028/6102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:32 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1341 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:32.520013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a59ac991-fff2-4158-bd7c-7cb31c771848 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:32.521522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a59ac991-fff2-4158-bd7c-7cb31c771848 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:32.532615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ac991-fff2-4158-bd7c-7cb31c771848 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:32.533564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ac991-fff2-4158-bd7c-7cb31c771848 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:32.534255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ac991-fff2-4158-bd7c-7cb31c771848 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:32.535182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ac991-fff2-4158-bd7c-7cb31c771848 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:32.535844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ac991-fff2-4158-bd7c-7cb31c771848 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:32.536445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ac991-fff2-4158-bd7c-7cb31c771848 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:32.619227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a59ac991-fff2-4158-bd7c-7cb31c771848 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:32.628529 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a59ac991-fff2-4158-bd7c-7cb31c771848 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1300 microversion: 2.1 time: 0.117036 Oct 11 20:25:32.629997 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3075/6103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:32 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:33.445458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4e1b55a1-32ca-4fe0-b561-dc5357995ed5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:33.446652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4e1b55a1-32ca-4fe0-b561-dc5357995ed5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:33.461833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e1b55a1-32ca-4fe0-b561-dc5357995ed5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:33.463270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e1b55a1-32ca-4fe0-b561-dc5357995ed5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:33.463987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e1b55a1-32ca-4fe0-b561-dc5357995ed5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:33.465344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e1b55a1-32ca-4fe0-b561-dc5357995ed5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:33.466197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e1b55a1-32ca-4fe0-b561-dc5357995ed5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:33.467100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4e1b55a1-32ca-4fe0-b561-dc5357995ed5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:33.644299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4e1b55a1-32ca-4fe0-b561-dc5357995ed5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:33.656956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbb568f7-6f5c-4a59-8332-5a813ff29a33 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:33.658518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fbb568f7-6f5c-4a59-8332-5a813ff29a33 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:33.674253 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4e1b55a1-32ca-4fe0-b561-dc5357995ed5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1375 microversion: 2.1 time: 0.230435 Oct 11 20:25:33.677054 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3029/6104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:33 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1375 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:33.678827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb568f7-6f5c-4a59-8332-5a813ff29a33 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:33.679605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb568f7-6f5c-4a59-8332-5a813ff29a33 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:33.680404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb568f7-6f5c-4a59-8332-5a813ff29a33 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:33.681412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb568f7-6f5c-4a59-8332-5a813ff29a33 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:33.682105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb568f7-6f5c-4a59-8332-5a813ff29a33 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:33.683183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbb568f7-6f5c-4a59-8332-5a813ff29a33 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:33.797175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fbb568f7-6f5c-4a59-8332-5a813ff29a33 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:33.809430 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fbb568f7-6f5c-4a59-8332-5a813ff29a33 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1308 microversion: 2.1 time: 0.157582 Oct 11 20:25:33.815357 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3076/6105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:33 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:34.707175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-889fa97b-f129-4845-8847-07162c491e80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:34.708618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-889fa97b-f129-4845-8847-07162c491e80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:34.718322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-889fa97b-f129-4845-8847-07162c491e80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:34.719281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-889fa97b-f129-4845-8847-07162c491e80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:34.719988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-889fa97b-f129-4845-8847-07162c491e80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:34.721028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-889fa97b-f129-4845-8847-07162c491e80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:34.721764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-889fa97b-f129-4845-8847-07162c491e80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:34.723205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-889fa97b-f129-4845-8847-07162c491e80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:34.837838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e48ee0bd-cb6a-4e42-8ed7-1d5ead360330 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:34.839365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e48ee0bd-cb6a-4e42-8ed7-1d5ead360330 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:34.850946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e48ee0bd-cb6a-4e42-8ed7-1d5ead360330 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:34.853131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e48ee0bd-cb6a-4e42-8ed7-1d5ead360330 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:34.853783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e48ee0bd-cb6a-4e42-8ed7-1d5ead360330 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:34.855012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e48ee0bd-cb6a-4e42-8ed7-1d5ead360330 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:34.874110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e48ee0bd-cb6a-4e42-8ed7-1d5ead360330 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:34.875079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e48ee0bd-cb6a-4e42-8ed7-1d5ead360330 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:34.992824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-889fa97b-f129-4845-8847-07162c491e80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:35.005149 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-889fa97b-f129-4845-8847-07162c491e80 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1375 microversion: 2.1 time: 0.303688 Oct 11 20:25:35.009673 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3030/6106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:34 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1375 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:35.141305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e48ee0bd-cb6a-4e42-8ed7-1d5ead360330 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:35.151660 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e48ee0bd-cb6a-4e42-8ed7-1d5ead360330 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1373 microversion: 2.1 time: 0.319576 Oct 11 20:25:35.166566 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3077/6107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:34 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1373 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:25:35.951587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4f0fc3d7-70b8-4ec5-9495-0652dbb51d17 req-06d887a4-bf4c-4a61-8f58-0e918ec0c3fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ff9779-7944-461a-8234-f889fa28e6f3", "tag": "f38bcf82-3d18-4683-a6af-81975a0b5e85"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:35.979629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4f0fc3d7-70b8-4ec5-9495-0652dbb51d17 req-06d887a4-bf4c-4a61-8f58-0e918ec0c3fb service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:35.980140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4f0fc3d7-70b8-4ec5-9495-0652dbb51d17 req-06d887a4-bf4c-4a61-8f58-0e918ec0c3fb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:35.982182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4f0fc3d7-70b8-4ec5-9495-0652dbb51d17 req-06d887a4-bf4c-4a61-8f58-0e918ec0c3fb service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:36.014770 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4f0fc3d7-70b8-4ec5-9495-0652dbb51d17 req-06d887a4-bf4c-4a61-8f58-0e918ec0c3fb service nova] Creating event network-changed:f38bcf82-3d18-4683-a6af-81975a0b5e85 for instance 18ff9779-7944-461a-8234-f889fa28e6f3 on n-h1-860864-3 Oct 11 20:25:36.022410 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4f0fc3d7-70b8-4ec5-9495-0652dbb51d17 req-06d887a4-bf4c-4a61-8f58-0e918ec0c3fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075624 Oct 11 20:25:36.023872 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3031/6108] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:25:36.037808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8fbb37e8-33b5-49ed-887e-2c71f7d5c864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:36.038465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8fbb37e8-33b5-49ed-887e-2c71f7d5c864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:36.048297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fbb37e8-33b5-49ed-887e-2c71f7d5c864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:36.048844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fbb37e8-33b5-49ed-887e-2c71f7d5c864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:36.049709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fbb37e8-33b5-49ed-887e-2c71f7d5c864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:36.050749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fbb37e8-33b5-49ed-887e-2c71f7d5c864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:36.051245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fbb37e8-33b5-49ed-887e-2c71f7d5c864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:36.051682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fbb37e8-33b5-49ed-887e-2c71f7d5c864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:36.177984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dda75e0e-70b0-4a75-a7fd-283b580ff619 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:36.185006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dda75e0e-70b0-4a75-a7fd-283b580ff619 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:36.202948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dda75e0e-70b0-4a75-a7fd-283b580ff619 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:36.203469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dda75e0e-70b0-4a75-a7fd-283b580ff619 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:36.203929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dda75e0e-70b0-4a75-a7fd-283b580ff619 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:36.204670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dda75e0e-70b0-4a75-a7fd-283b580ff619 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:36.205215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dda75e0e-70b0-4a75-a7fd-283b580ff619 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:36.205658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dda75e0e-70b0-4a75-a7fd-283b580ff619 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:36.269455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8fbb37e8-33b5-49ed-887e-2c71f7d5c864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:36.280085 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8fbb37e8-33b5-49ed-887e-2c71f7d5c864 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1375 microversion: 2.1 time: 0.247619 Oct 11 20:25:36.282380 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3078/6109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:36 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1375 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:36.478254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dda75e0e-70b0-4a75-a7fd-283b580ff619 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:36.489950 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dda75e0e-70b0-4a75-a7fd-283b580ff619 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1373 microversion: 2.1 time: 0.316248 Oct 11 20:25:36.491150 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3032/6110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:36 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1373 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:37.305676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0901156c-566b-4ab4-b643-2d693b808067 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:37.306597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0901156c-566b-4ab4-b643-2d693b808067 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:37.314956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0901156c-566b-4ab4-b643-2d693b808067 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:37.315415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0901156c-566b-4ab4-b643-2d693b808067 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:37.315851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0901156c-566b-4ab4-b643-2d693b808067 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:37.316552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0901156c-566b-4ab4-b643-2d693b808067 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:37.317015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0901156c-566b-4ab4-b643-2d693b808067 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:37.317439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0901156c-566b-4ab4-b643-2d693b808067 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:37.515463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c7b25336-c28b-4b9d-acde-6616913d8eac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:37.516255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c7b25336-c28b-4b9d-acde-6616913d8eac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:37.532300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b25336-c28b-4b9d-acde-6616913d8eac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:37.534049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b25336-c28b-4b9d-acde-6616913d8eac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:37.542810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b25336-c28b-4b9d-acde-6616913d8eac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:37.546644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b25336-c28b-4b9d-acde-6616913d8eac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:37.548658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b25336-c28b-4b9d-acde-6616913d8eac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:37.549331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c7b25336-c28b-4b9d-acde-6616913d8eac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:37.599406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0901156c-566b-4ab4-b643-2d693b808067 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:37.609321 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0901156c-566b-4ab4-b643-2d693b808067 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1375 microversion: 2.1 time: 0.307511 Oct 11 20:25:37.610951 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3079/6111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:37 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1375 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:37.717936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c7b25336-c28b-4b9d-acde-6616913d8eac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:37.726140 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c7b25336-c28b-4b9d-acde-6616913d8eac tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1373 microversion: 2.1 time: 0.216566 Oct 11 20:25:37.726862 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3033/6112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:37 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1373 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:25:38.636451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0205061f-1877-42ca-b5e4-5d21584a49e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:38.639131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0205061f-1877-42ca-b5e4-5d21584a49e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:38.651744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0205061f-1877-42ca-b5e4-5d21584a49e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:38.652965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0205061f-1877-42ca-b5e4-5d21584a49e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:38.653648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0205061f-1877-42ca-b5e4-5d21584a49e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:38.654205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0205061f-1877-42ca-b5e4-5d21584a49e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:38.655542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0205061f-1877-42ca-b5e4-5d21584a49e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:38.656154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0205061f-1877-42ca-b5e4-5d21584a49e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:38.748388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-530d32cc-3a73-4b6e-992e-e6c14d1f94c4 req-586375ff-99d0-44b2-959a-b7294290ca24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290", "name": "network-vif-plugged", "status": "completed", "tag": "8e39ae3d-37bc-48e4-8940-d4bf38693ed4"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:38.769725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-530d32cc-3a73-4b6e-992e-e6c14d1f94c4 req-586375ff-99d0-44b2-959a-b7294290ca24 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:38.772269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-530d32cc-3a73-4b6e-992e-e6c14d1f94c4 req-586375ff-99d0-44b2-959a-b7294290ca24 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:38.773098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-530d32cc-3a73-4b6e-992e-e6c14d1f94c4 req-586375ff-99d0-44b2-959a-b7294290ca24 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:38.794284 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-530d32cc-3a73-4b6e-992e-e6c14d1f94c4 req-586375ff-99d0-44b2-959a-b7294290ca24 service nova] Creating event network-vif-plugged:8e39ae3d-37bc-48e4-8940-d4bf38693ed4 for instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 on n-h1-860864-3 Oct 11 20:25:38.805750 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-530d32cc-3a73-4b6e-992e-e6c14d1f94c4 req-586375ff-99d0-44b2-959a-b7294290ca24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063906 Oct 11 20:25:38.807057 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3034/6113] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:25:38.855823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2abc9174-d432-4bc9-9df9-a3aa117eaa83 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:38.865405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2abc9174-d432-4bc9-9df9-a3aa117eaa83 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:38.895802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2abc9174-d432-4bc9-9df9-a3aa117eaa83 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:38.901272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2abc9174-d432-4bc9-9df9-a3aa117eaa83 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:38.905689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2abc9174-d432-4bc9-9df9-a3aa117eaa83 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:38.906692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2abc9174-d432-4bc9-9df9-a3aa117eaa83 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:38.909801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2abc9174-d432-4bc9-9df9-a3aa117eaa83 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:38.914489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2abc9174-d432-4bc9-9df9-a3aa117eaa83 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:39.013402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0205061f-1877-42ca-b5e4-5d21584a49e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:39.031184 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0205061f-1877-42ca-b5e4-5d21584a49e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1375 microversion: 2.1 time: 0.400824 Oct 11 20:25:39.036047 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3080/6114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:38 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1375 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:39.227669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2abc9174-d432-4bc9-9df9-a3aa117eaa83 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:39.239402 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2abc9174-d432-4bc9-9df9-a3aa117eaa83 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1373 microversion: 2.1 time: 0.428294 Oct 11 20:25:39.240572 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3035/6115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:38 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1373 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:40.064279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-00a990a2-8790-42d2-ad4b-6bb1bd4ec9ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:40.064917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-00a990a2-8790-42d2-ad4b-6bb1bd4ec9ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:40.081553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a990a2-8790-42d2-ad4b-6bb1bd4ec9ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:40.082064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a990a2-8790-42d2-ad4b-6bb1bd4ec9ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:40.082505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a990a2-8790-42d2-ad4b-6bb1bd4ec9ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:40.083264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a990a2-8790-42d2-ad4b-6bb1bd4ec9ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:40.084506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a990a2-8790-42d2-ad4b-6bb1bd4ec9ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:40.084906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00a990a2-8790-42d2-ad4b-6bb1bd4ec9ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:40.270630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f44c192b-e9f1-4cf7-95c2-e34294d79888 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:40.272035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f44c192b-e9f1-4cf7-95c2-e34294d79888 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:40.281057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44c192b-e9f1-4cf7-95c2-e34294d79888 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:40.281877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44c192b-e9f1-4cf7-95c2-e34294d79888 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:40.282659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44c192b-e9f1-4cf7-95c2-e34294d79888 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:40.284689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44c192b-e9f1-4cf7-95c2-e34294d79888 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:40.285649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44c192b-e9f1-4cf7-95c2-e34294d79888 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:40.286273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f44c192b-e9f1-4cf7-95c2-e34294d79888 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:40.387561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-00a990a2-8790-42d2-ad4b-6bb1bd4ec9ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:40.395739 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-00a990a2-8790-42d2-ad4b-6bb1bd4ec9ac tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1375 microversion: 2.1 time: 0.337322 Oct 11 20:25:40.396536 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3081/6116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:40 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1375 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:40.514130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f44c192b-e9f1-4cf7-95c2-e34294d79888 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:40.523755 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f44c192b-e9f1-4cf7-95c2-e34294d79888 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1373 microversion: 2.1 time: 0.259203 Oct 11 20:25:40.525692 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3036/6117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:40 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1373 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:40.822647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-7217b3bf-621b-43e5-8331-5f0e8178c3f3 req-ab428083-32be-44cf-90b1-99d2b661dc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ff9779-7944-461a-8234-f889fa28e6f3", "name": "network-vif-plugged", "status": "completed", "tag": "f38bcf82-3d18-4683-a6af-81975a0b5e85"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:40.832749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7217b3bf-621b-43e5-8331-5f0e8178c3f3 req-ab428083-32be-44cf-90b1-99d2b661dc22 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:40.833223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7217b3bf-621b-43e5-8331-5f0e8178c3f3 req-ab428083-32be-44cf-90b1-99d2b661dc22 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:40.833655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-7217b3bf-621b-43e5-8331-5f0e8178c3f3 req-ab428083-32be-44cf-90b1-99d2b661dc22 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:40.846326 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-7217b3bf-621b-43e5-8331-5f0e8178c3f3 req-ab428083-32be-44cf-90b1-99d2b661dc22 service nova] Creating event network-vif-plugged:f38bcf82-3d18-4683-a6af-81975a0b5e85 for instance 18ff9779-7944-461a-8234-f889fa28e6f3 on n-h1-860864-3 Oct 11 20:25:40.851626 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-7217b3bf-621b-43e5-8331-5f0e8178c3f3 req-ab428083-32be-44cf-90b1-99d2b661dc22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032678 Oct 11 20:25:40.852546 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3082/6118] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:25:41.426991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b292f5b0-3038-42b0-afcc-329aad0ae63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:41.427647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b292f5b0-3038-42b0-afcc-329aad0ae63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:41.429691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:41.430406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:41.438336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b292f5b0-3038-42b0-afcc-329aad0ae63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:41.438862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b292f5b0-3038-42b0-afcc-329aad0ae63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:41.439313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b292f5b0-3038-42b0-afcc-329aad0ae63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:41.440017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b292f5b0-3038-42b0-afcc-329aad0ae63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:41.440483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b292f5b0-3038-42b0-afcc-329aad0ae63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:41.440919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b292f5b0-3038-42b0-afcc-329aad0ae63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:41.550237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-021de411-8d24-4211-8da9-18381cf37073 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:41.551089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-021de411-8d24-4211-8da9-18381cf37073 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:41.553938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:41.561255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021de411-8d24-4211-8da9-18381cf37073 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:41.561748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021de411-8d24-4211-8da9-18381cf37073 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:41.562184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021de411-8d24-4211-8da9-18381cf37073 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:41.563122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021de411-8d24-4211-8da9-18381cf37073 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:41.563578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021de411-8d24-4211-8da9-18381cf37073 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:41.564257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-021de411-8d24-4211-8da9-18381cf37073 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:41.580586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b292f5b0-3038-42b0-afcc-329aad0ae63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:41.582802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=89 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:41.590151 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b292f5b0-3038-42b0-afcc-329aad0ae63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1562 microversion: 2.1 time: 0.166973 Oct 11 20:25:41.591343 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3037/6119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:41 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:41.613741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d8b0b1eb-6274-4968-8755-150170a32fa4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:41.614441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d8b0b1eb-6274-4968-8755-150170a32fa4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:41.621919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b0b1eb-6274-4968-8755-150170a32fa4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:41.622302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b0b1eb-6274-4968-8755-150170a32fa4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:41.622779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b0b1eb-6274-4968-8755-150170a32fa4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:41.623494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b0b1eb-6274-4968-8755-150170a32fa4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:41.623966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b0b1eb-6274-4968-8755-150170a32fa4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:41.624404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8b0b1eb-6274-4968-8755-150170a32fa4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:41.786751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-021de411-8d24-4211-8da9-18381cf37073 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:41.797432 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-021de411-8d24-4211-8da9-18381cf37073 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1373 microversion: 2.1 time: 0.251291 Oct 11 20:25:41.798274 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3083/6120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:41 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1373 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:41.819219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d8b0b1eb-6274-4968-8755-150170a32fa4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:41.828356 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d8b0b1eb-6274-4968-8755-150170a32fa4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1562 microversion: 2.1 time: 0.218798 Oct 11 20:25:41.829111 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3038/6121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:41 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1562 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:25:41.914247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4808dce0-d8ae-4ff8-b0c3-c0cbf310f7d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:41.914772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4808dce0-d8ae-4ff8-b0c3-c0cbf310f7d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:41.923128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4808dce0-d8ae-4ff8-b0c3-c0cbf310f7d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:41.923775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4808dce0-d8ae-4ff8-b0c3-c0cbf310f7d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:41.924326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4808dce0-d8ae-4ff8-b0c3-c0cbf310f7d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:41.925176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4808dce0-d8ae-4ff8-b0c3-c0cbf310f7d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:41.925861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4808dce0-d8ae-4ff8-b0c3-c0cbf310f7d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:41.926367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4808dce0-d8ae-4ff8-b0c3-c0cbf310f7d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:41.953747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4808dce0-d8ae-4ff8-b0c3-c0cbf310f7d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:25:42.036340 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4808dce0-d8ae-4ff8-b0c3-c0cbf310f7d1 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 204 len: 0 microversion: 2.1 time: 0.126300 Oct 11 20:25:42.036969 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3084/6122] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:25:41 2022] DELETE /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:25:42.046026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-116dcae5-9b9c-455f-9017-2affa3b88787 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:42.046853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-116dcae5-9b9c-455f-9017-2affa3b88787 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:42.053220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116dcae5-9b9c-455f-9017-2affa3b88787 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:42.053825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116dcae5-9b9c-455f-9017-2affa3b88787 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:42.054692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116dcae5-9b9c-455f-9017-2affa3b88787 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:42.055539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116dcae5-9b9c-455f-9017-2affa3b88787 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:42.056108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116dcae5-9b9c-455f-9017-2affa3b88787 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:42.056635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-116dcae5-9b9c-455f-9017-2affa3b88787 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:42.209211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-116dcae5-9b9c-455f-9017-2affa3b88787 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:42.218493 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-116dcae5-9b9c-455f-9017-2affa3b88787 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1568 microversion: 2.1 time: 0.177077 Oct 11 20:25:42.219153 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3039/6123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:42 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:42.822351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4e83697d-387a-483d-b042-842bfbf8a57a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:42.824105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4e83697d-387a-483d-b042-842bfbf8a57a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:42.834721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e83697d-387a-483d-b042-842bfbf8a57a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:42.834721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e83697d-387a-483d-b042-842bfbf8a57a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:42.834721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e83697d-387a-483d-b042-842bfbf8a57a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:42.835646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e83697d-387a-483d-b042-842bfbf8a57a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:42.836444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e83697d-387a-483d-b042-842bfbf8a57a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:42.837078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4e83697d-387a-483d-b042-842bfbf8a57a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:42.863209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:42.990785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4e83697d-387a-483d-b042-842bfbf8a57a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:42.999093 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4e83697d-387a-483d-b042-842bfbf8a57a tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1545 microversion: 2.1 time: 0.181473 Oct 11 20:25:42.999676 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3085/6124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:42 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1545 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:43.021767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c4b3650e-68fd-466d-a11b-58d92c6cd77e tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:43.022543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4b3650e-68fd-466d-a11b-58d92c6cd77e tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:43.030112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b3650e-68fd-466d-a11b-58d92c6cd77e tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:43.030743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b3650e-68fd-466d-a11b-58d92c6cd77e tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:43.031267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b3650e-68fd-466d-a11b-58d92c6cd77e tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:43.032065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b3650e-68fd-466d-a11b-58d92c6cd77e tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:43.032610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b3650e-68fd-466d-a11b-58d92c6cd77e tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:43.033122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b3650e-68fd-466d-a11b-58d92c6cd77e tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:43.168358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c4b3650e-68fd-466d-a11b-58d92c6cd77e tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:43.177153 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c4b3650e-68fd-466d-a11b-58d92c6cd77e tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1545 microversion: 2.1 time: 0.159256 Oct 11 20:25:43.177880 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3040/6125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:43 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1545 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:43.245389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-03b187cc-750e-4d5a-a3e5-91ae98c3a696 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:43.246114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-03b187cc-750e-4d5a-a3e5-91ae98c3a696 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:43.253228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b187cc-750e-4d5a-a3e5-91ae98c3a696 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:43.253917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b187cc-750e-4d5a-a3e5-91ae98c3a696 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:43.254361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b187cc-750e-4d5a-a3e5-91ae98c3a696 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:43.255204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b187cc-750e-4d5a-a3e5-91ae98c3a696 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:43.255757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b187cc-750e-4d5a-a3e5-91ae98c3a696 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:43.256281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03b187cc-750e-4d5a-a3e5-91ae98c3a696 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:43.403594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-03b187cc-750e-4d5a-a3e5-91ae98c3a696 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:43.412003 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-03b187cc-750e-4d5a-a3e5-91ae98c3a696 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1568 microversion: 2.1 time: 0.172232 Oct 11 20:25:43.413439 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3086/6126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:43 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:44.439796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cc950051-d7eb-44f5-a098-db2b6b7d99db tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:44.441082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cc950051-d7eb-44f5-a098-db2b6b7d99db tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:44.449721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc950051-d7eb-44f5-a098-db2b6b7d99db tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:44.451250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc950051-d7eb-44f5-a098-db2b6b7d99db tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:44.451903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc950051-d7eb-44f5-a098-db2b6b7d99db tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:44.452821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc950051-d7eb-44f5-a098-db2b6b7d99db tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:44.453616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc950051-d7eb-44f5-a098-db2b6b7d99db tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:44.454250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cc950051-d7eb-44f5-a098-db2b6b7d99db tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:44.828695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-63a298ac-d0a9-467c-9808-69a3b1edffc8 req-b7dbe42c-f09d-43d9-b385-e80fe3f824a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290", "name": "network-vif-deleted", "tag": "8e39ae3d-37bc-48e4-8940-d4bf38693ed4"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:44.833541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cc950051-d7eb-44f5-a098-db2b6b7d99db tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:44.843449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-63a298ac-d0a9-467c-9808-69a3b1edffc8 req-b7dbe42c-f09d-43d9-b385-e80fe3f824a3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:44.844487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-63a298ac-d0a9-467c-9808-69a3b1edffc8 req-b7dbe42c-f09d-43d9-b385-e80fe3f824a3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:44.844991 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cc950051-d7eb-44f5-a098-db2b6b7d99db tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1568 microversion: 2.1 time: 0.409151 Oct 11 20:25:44.845272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-63a298ac-d0a9-467c-9808-69a3b1edffc8 req-b7dbe42c-f09d-43d9-b385-e80fe3f824a3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:44.845954 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3041/6127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:44 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1568 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:44.881350 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-63a298ac-d0a9-467c-9808-69a3b1edffc8 req-b7dbe42c-f09d-43d9-b385-e80fe3f824a3 service nova] Creating event network-vif-deleted:8e39ae3d-37bc-48e4-8940-d4bf38693ed4 for instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 on n-h1-860864-3 Oct 11 20:25:44.893595 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-63a298ac-d0a9-467c-9808-69a3b1edffc8 req-b7dbe42c-f09d-43d9-b385-e80fe3f824a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082975 Oct 11 20:25:44.895431 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3087/6128] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:25:45.875046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56b969f8-e143-4465-99a2-07a90a81ef22 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:45.875751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56b969f8-e143-4465-99a2-07a90a81ef22 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:45.891568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b969f8-e143-4465-99a2-07a90a81ef22 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:45.892872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b969f8-e143-4465-99a2-07a90a81ef22 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:45.902090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b969f8-e143-4465-99a2-07a90a81ef22 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:45.906357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b969f8-e143-4465-99a2-07a90a81ef22 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:45.909536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b969f8-e143-4465-99a2-07a90a81ef22 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:45.910333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56b969f8-e143-4465-99a2-07a90a81ef22 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:46.037749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56b969f8-e143-4465-99a2-07a90a81ef22 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:46.070005 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56b969f8-e143-4465-99a2-07a90a81ef22 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1360 microversion: 2.1 time: 0.200321 Oct 11 20:25:46.070646 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3042/6129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:45 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:25:46.929028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f10d9581-8b1c-4d75-9179-8440673279c2 req-214366d6-efa6-4813-ae37-d356e75b5525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ff9779-7944-461a-8234-f889fa28e6f3", "tag": "f38bcf82-3d18-4683-a6af-81975a0b5e85"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:46.948956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f10d9581-8b1c-4d75-9179-8440673279c2 req-214366d6-efa6-4813-ae37-d356e75b5525 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:46.949439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f10d9581-8b1c-4d75-9179-8440673279c2 req-214366d6-efa6-4813-ae37-d356e75b5525 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:46.949979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f10d9581-8b1c-4d75-9179-8440673279c2 req-214366d6-efa6-4813-ae37-d356e75b5525 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:46.976438 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f10d9581-8b1c-4d75-9179-8440673279c2 req-214366d6-efa6-4813-ae37-d356e75b5525 service nova] Creating event network-changed:f38bcf82-3d18-4683-a6af-81975a0b5e85 for instance 18ff9779-7944-461a-8234-f889fa28e6f3 on n-h1-860864-3 Oct 11 20:25:46.993315 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f10d9581-8b1c-4d75-9179-8440673279c2 req-214366d6-efa6-4813-ae37-d356e75b5525 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068835 Oct 11 20:25:46.999349 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3088/6130] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:25:47.095914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d950805a-7048-46d9-b012-d63f561895c4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:47.096553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d950805a-7048-46d9-b012-d63f561895c4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:47.109487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d950805a-7048-46d9-b012-d63f561895c4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:47.113139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d950805a-7048-46d9-b012-d63f561895c4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:47.117806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d950805a-7048-46d9-b012-d63f561895c4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:47.118714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d950805a-7048-46d9-b012-d63f561895c4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:47.119217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d950805a-7048-46d9-b012-d63f561895c4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:47.119663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d950805a-7048-46d9-b012-d63f561895c4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:47.310195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d950805a-7048-46d9-b012-d63f561895c4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:47.323300 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d950805a-7048-46d9-b012-d63f561895c4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1360 microversion: 2.1 time: 0.230246 Oct 11 20:25:47.326763 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3043/6131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:47 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1360 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:48.352175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5ca4336a-0b30-4d4b-ab6b-bef2cecaed96 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:48.353645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5ca4336a-0b30-4d4b-ab6b-bef2cecaed96 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:48.363846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ca4336a-0b30-4d4b-ab6b-bef2cecaed96 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:48.364683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ca4336a-0b30-4d4b-ab6b-bef2cecaed96 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:48.365676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ca4336a-0b30-4d4b-ab6b-bef2cecaed96 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:48.367454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ca4336a-0b30-4d4b-ab6b-bef2cecaed96 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:48.368150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ca4336a-0b30-4d4b-ab6b-bef2cecaed96 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:48.368814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ca4336a-0b30-4d4b-ab6b-bef2cecaed96 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:48.481149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5ca4336a-0b30-4d4b-ab6b-bef2cecaed96 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:48.496157 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5ca4336a-0b30-4d4b-ab6b-bef2cecaed96 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1360 microversion: 2.1 time: 0.148143 Oct 11 20:25:48.496978 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3089/6132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:48 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:49.520472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bdd5ab1e-b16a-40c2-8455-d0b9902a9e1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:49.521105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bdd5ab1e-b16a-40c2-8455-d0b9902a9e1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:49.528036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdd5ab1e-b16a-40c2-8455-d0b9902a9e1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:49.529088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdd5ab1e-b16a-40c2-8455-d0b9902a9e1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:49.529549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdd5ab1e-b16a-40c2-8455-d0b9902a9e1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:49.530343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdd5ab1e-b16a-40c2-8455-d0b9902a9e1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:49.530853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdd5ab1e-b16a-40c2-8455-d0b9902a9e1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:49.531296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bdd5ab1e-b16a-40c2-8455-d0b9902a9e1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:49.627019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bdd5ab1e-b16a-40c2-8455-d0b9902a9e1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:49.660346 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bdd5ab1e-b16a-40c2-8455-d0b9902a9e1c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1360 microversion: 2.1 time: 0.141902 Oct 11 20:25:49.661556 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3044/6133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:49 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1360 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:50.686644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-63b0ea4d-a792-43cb-9860-97325ae7c1a4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:50.687991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-63b0ea4d-a792-43cb-9860-97325ae7c1a4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:50.704157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63b0ea4d-a792-43cb-9860-97325ae7c1a4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:50.705699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63b0ea4d-a792-43cb-9860-97325ae7c1a4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:50.707085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63b0ea4d-a792-43cb-9860-97325ae7c1a4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:50.708936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63b0ea4d-a792-43cb-9860-97325ae7c1a4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:50.710517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63b0ea4d-a792-43cb-9860-97325ae7c1a4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:50.711009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-63b0ea4d-a792-43cb-9860-97325ae7c1a4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:50.809083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-63b0ea4d-a792-43cb-9860-97325ae7c1a4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:50.821141 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-63b0ea4d-a792-43cb-9860-97325ae7c1a4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 200 len: 1360 microversion: 2.1 time: 0.139358 Oct 11 20:25:50.822902 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3090/6134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:50 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 1360 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:51.847766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:51.849232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:51.864307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:51.864852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:51.865318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:51.866160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:51.866679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:51.867131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:51.883022 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 HTTP/1.1 Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290'} Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:25:51.884756 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:25:51.890633 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:25:51.890633 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:25:51.890633 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:25:51.890633 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:25:51.890633 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:25:51.890633 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:25:51.890633 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:25:51.890633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:25:51.890633 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-475f16a8-8c0d-4b56-9312-6cdb20c05678 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 404 len: 111 microversion: 2.1 time: 0.042452 Oct 11 20:25:51.890633 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3045/6135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:51 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:25:57.297999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7d39b538-2553-428d-8de4-e6dd22d284f2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:57.298576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d39b538-2553-428d-8de4-e6dd22d284f2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:57.302720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:57.307217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d39b538-2553-428d-8de4-e6dd22d284f2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:57.307719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d39b538-2553-428d-8de4-e6dd22d284f2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:57.308164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d39b538-2553-428d-8de4-e6dd22d284f2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:57.308870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d39b538-2553-428d-8de4-e6dd22d284f2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:57.309330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d39b538-2553-428d-8de4-e6dd22d284f2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:57.309767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d39b538-2553-428d-8de4-e6dd22d284f2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:57.341803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d39b538-2553-428d-8de4-e6dd22d284f2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:25:57.425415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7d39b538-2553-428d-8de4-e6dd22d284f2 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 204 len: 0 microversion: 2.1 time: 0.131630 Oct 11 20:25:57.426029 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3091/6136] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:25:57 2022] DELETE /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:25:57.434398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d22640c9-2b21-4157-a86e-25b7600e66e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:57.436304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d22640c9-2b21-4157-a86e-25b7600e66e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:57.443151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:25:57.445430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d22640c9-2b21-4157-a86e-25b7600e66e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:57.446215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d22640c9-2b21-4157-a86e-25b7600e66e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:57.446885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d22640c9-2b21-4157-a86e-25b7600e66e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:57.448250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d22640c9-2b21-4157-a86e-25b7600e66e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:57.448899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d22640c9-2b21-4157-a86e-25b7600e66e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:57.449526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d22640c9-2b21-4157-a86e-25b7600e66e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:57.619744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d22640c9-2b21-4157-a86e-25b7600e66e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:57.628984 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d22640c9-2b21-4157-a86e-25b7600e66e0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1410 microversion: 2.1 time: 0.198581 Oct 11 20:25:57.629583 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3046/6137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:57 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1410 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:58.655244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cfa97537-fd53-4976-b50e-91c33e73fc06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:58.655956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cfa97537-fd53-4976-b50e-91c33e73fc06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:58.663183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa97537-fd53-4976-b50e-91c33e73fc06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:58.663672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa97537-fd53-4976-b50e-91c33e73fc06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:58.664114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa97537-fd53-4976-b50e-91c33e73fc06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:58.664904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa97537-fd53-4976-b50e-91c33e73fc06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:58.665382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa97537-fd53-4976-b50e-91c33e73fc06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:58.665806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfa97537-fd53-4976-b50e-91c33e73fc06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:58.835792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cfa97537-fd53-4976-b50e-91c33e73fc06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:25:58.845358 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cfa97537-fd53-4976-b50e-91c33e73fc06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1410 microversion: 2.1 time: 0.195309 Oct 11 20:25:58.846266 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3092/6138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:58 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1410 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:25:59.526672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c5a4a318-70f4-4b50-bfb6-aa8729241b0e req-ac700d24-bd95-44b4-b64e-8ff5f727f13a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce9fa15-1442-4b81-87d1-060b8f35e5e8", "name": "network-vif-deleted", "tag": "329f7af5-3747-401e-8771-6e29da46ad7b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:25:59.547359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c5a4a318-70f4-4b50-bfb6-aa8729241b0e req-ac700d24-bd95-44b4-b64e-8ff5f727f13a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:59.550048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c5a4a318-70f4-4b50-bfb6-aa8729241b0e req-ac700d24-bd95-44b4-b64e-8ff5f727f13a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:59.551709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c5a4a318-70f4-4b50-bfb6-aa8729241b0e req-ac700d24-bd95-44b4-b64e-8ff5f727f13a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:59.569394 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c5a4a318-70f4-4b50-bfb6-aa8729241b0e req-ac700d24-bd95-44b4-b64e-8ff5f727f13a service nova] Creating event network-vif-deleted:329f7af5-3747-401e-8771-6e29da46ad7b for instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 on n-h2-860864-3 Oct 11 20:25:59.575358 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c5a4a318-70f4-4b50-bfb6-aa8729241b0e req-ac700d24-bd95-44b4-b64e-8ff5f727f13a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052454 Oct 11 20:25:59.580714 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3047/6139] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:25:59.870409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-630445aa-a888-4829-9272-a9d3a8ef262f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:25:59.871206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-630445aa-a888-4829-9272-a9d3a8ef262f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:25:59.883963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-630445aa-a888-4829-9272-a9d3a8ef262f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:59.887795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-630445aa-a888-4829-9272-a9d3a8ef262f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:59.888911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-630445aa-a888-4829-9272-a9d3a8ef262f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:25:59.894297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-630445aa-a888-4829-9272-a9d3a8ef262f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:25:59.895656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-630445aa-a888-4829-9272-a9d3a8ef262f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:25:59.896333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-630445aa-a888-4829-9272-a9d3a8ef262f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:00.037644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-630445aa-a888-4829-9272-a9d3a8ef262f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:00.053750 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-630445aa-a888-4829-9272-a9d3a8ef262f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1202 microversion: 2.1 time: 0.188204 Oct 11 20:26:00.054832 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3093/6140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:25:59 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1202 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:01.078885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6332857b-b406-4e2e-aaf8-23c95236d49e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:01.080321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6332857b-b406-4e2e-aaf8-23c95236d49e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:01.088722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6332857b-b406-4e2e-aaf8-23c95236d49e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:01.089358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6332857b-b406-4e2e-aaf8-23c95236d49e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:01.090072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6332857b-b406-4e2e-aaf8-23c95236d49e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:01.090895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6332857b-b406-4e2e-aaf8-23c95236d49e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:01.092232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6332857b-b406-4e2e-aaf8-23c95236d49e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:01.092916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6332857b-b406-4e2e-aaf8-23c95236d49e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:01.167627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6332857b-b406-4e2e-aaf8-23c95236d49e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:01.177515 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6332857b-b406-4e2e-aaf8-23c95236d49e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1202 microversion: 2.1 time: 0.103855 Oct 11 20:26:01.178144 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3048/6141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:01 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1202 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:02.200231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-756209f0-99fa-4a81-9f4b-2f9a74f8b63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:02.201318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-756209f0-99fa-4a81-9f4b-2f9a74f8b63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:02.208548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-756209f0-99fa-4a81-9f4b-2f9a74f8b63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:02.209039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-756209f0-99fa-4a81-9f4b-2f9a74f8b63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:02.209486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-756209f0-99fa-4a81-9f4b-2f9a74f8b63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:02.210186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-756209f0-99fa-4a81-9f4b-2f9a74f8b63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:02.210832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-756209f0-99fa-4a81-9f4b-2f9a74f8b63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:02.211286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-756209f0-99fa-4a81-9f4b-2f9a74f8b63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:02.287634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-756209f0-99fa-4a81-9f4b-2f9a74f8b63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:02.303034 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-756209f0-99fa-4a81-9f4b-2f9a74f8b63a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1202 microversion: 2.1 time: 0.100918 Oct 11 20:26:02.303695 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3094/6142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:02 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1202 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:03.522248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d7036427-2b07-4866-8fb8-17cc107bafaf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:03.523595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d7036427-2b07-4866-8fb8-17cc107bafaf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:03.531204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7036427-2b07-4866-8fb8-17cc107bafaf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:03.532141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7036427-2b07-4866-8fb8-17cc107bafaf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:03.532769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7036427-2b07-4866-8fb8-17cc107bafaf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:03.534015 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7036427-2b07-4866-8fb8-17cc107bafaf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:03.534693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7036427-2b07-4866-8fb8-17cc107bafaf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:03.535302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d7036427-2b07-4866-8fb8-17cc107bafaf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:03.602070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d7036427-2b07-4866-8fb8-17cc107bafaf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:03.611047 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d7036427-2b07-4866-8fb8-17cc107bafaf tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 200 len: 1202 microversion: 2.1 time: 0.288527 Oct 11 20:26:03.611638 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3049/6143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:03 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 1202 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:04.633386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:04.633981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:04.642156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:04.643534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:04.643975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:04.644856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:04.645404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:04.645831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:04.662818 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 HTTP/1.1 Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '8ce9fa15-1442-4b81-87d1-060b8f35e5e8'} Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:04.664471 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:04.674047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:04.674047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:04.674047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:04.674047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:26:04.674047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:26:04.674047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:04.674047 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:04.674047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:26:04.674047 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ee3766cc-f23c-4066-9785-8112e721e040 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 404 len: 111 microversion: 2.1 time: 0.036430 Oct 11 20:26:04.674047 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3095/6144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:04 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:26:07.119638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05b640db-4eaa-437a-a668-9576e64dc82c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:07.122868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05b640db-4eaa-437a-a668-9576e64dc82c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:07.130556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b640db-4eaa-437a-a668-9576e64dc82c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:07.131083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b640db-4eaa-437a-a668-9576e64dc82c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:07.131541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b640db-4eaa-437a-a668-9576e64dc82c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:07.132264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b640db-4eaa-437a-a668-9576e64dc82c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:07.132743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b640db-4eaa-437a-a668-9576e64dc82c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:07.133189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05b640db-4eaa-437a-a668-9576e64dc82c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:07.191329 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05b640db-4eaa-437a-a668-9576e64dc82c tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "POST /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3/action" status: 200 len: 24574 microversion: 2.1 time: 0.075204 Oct 11 20:26:07.192343 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3050/6145] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:26:07 2022] POST /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3/action => generated 24574 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:26:07.880298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:07.881416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:07.888559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:07.889829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:07.890377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:07.891162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:07.891695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:07.892206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:07.906437 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 HTTP/1.1 Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290'} Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:26:07.908587 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ac6d1d2c-eee8-4029-ad86-680f8e97b70b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 404 len: 111 microversion: 2.1 time: 0.033633 Oct 11 20:26:07.914556 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3096/6146] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:26:07 2022] DELETE /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:26:07.919218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:07.920225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:07.927165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:07.927654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:07.928099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:07.928802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:07.929266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:07.929701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:07.944726 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 HTTP/1.1 Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290'} Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:07.946391 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:26:07.953363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:07.953363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:07.953363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:07.953363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:26:07.953363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:26:07.953363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. Oct 11 20:26:07.953363 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:26:07.953363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:26:07.953363 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-017d1a60-ddf5-470e-9e95-6f32f3e2b496 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290" status: 404 len: 111 microversion: 2.1 time: 0.032781 Oct 11 20:26:07.953363 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3051/6147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:07 2022] GET /compute/v2.1/servers/0cdbf43b-8f42-45c9-8e4a-4aea2cf9b290 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:26:08.516351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:08.517386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:08.548777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:08.549288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:08.549731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:08.550452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:08.550989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:08.551609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:08.568490 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 HTTP/1.1 Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '8ce9fa15-1442-4b81-87d1-060b8f35e5e8'} Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:26:08.570347 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:08.575361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:26:08.579272 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-86dcf359-5471-4d43-8855-9521b3543091 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 404 len: 111 microversion: 2.1 time: 0.071778 Oct 11 20:26:08.579272 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3097/6148] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:26:08 2022] DELETE /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:26:08.593067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:08.593631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 8ce9fa15-1442-4b81-87d1-060b8f35e5e8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:08.609503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:08.610049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:08.610562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:08.611272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:08.611747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:08.612190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:08.630257 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 HTTP/1.1 Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '8ce9fa15-1442-4b81-87d1-060b8f35e5e8'} Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:08.631899 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:26:08.638009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:08.638009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:08.638009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:08.638009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:26:08.638009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:26:08.638009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. Oct 11 20:26:08.638009 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:26:08.638009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 8ce9fa15-1442-4b81-87d1-060b8f35e5e8 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:26:08.638009 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fcb49f00-ef98-44b9-86b0-2047eaa60c14 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8" status: 404 len: 111 microversion: 2.1 time: 0.049617 Oct 11 20:26:08.638009 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3052/6149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:08 2022] GET /compute/v2.1/servers/8ce9fa15-1442-4b81-87d1-060b8f35e5e8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:26:08.712962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-106045ac-0711-4a43-bd9f-ddad919d09f9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Action: 'create', calling method: .version_select at 0x7f83d07c1700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-113237225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZBlX4CHhOC+D0dnrirJrySLg1rBfzIHOlnFBgYGi0E0IGNaqwcz2L2acAtQQiWpHXOVqiGwIyZ8sN7LgkiTZe/236RXk2HrIkpQ3Eh0J762nmzFiviMVVtTEQnDLEL1Q=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:08.729295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-106045ac-0711-4a43-bd9f-ddad919d09f9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for project 563ad430e2af4c469e0a0afa967d580e. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:26:08.734703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-106045ac-0711-4a43-bd9f-ddad919d09f9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for user cbcf07bc33104f78adbcd3dfa198a570 and project 563ad430e2af4c469e0a0afa967d580e. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:26:08.759451 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-106045ac-0711-4a43-bd9f-ddad919d09f9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.050300 Oct 11 20:26:08.760032 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3098/6150] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:26:08 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:26:18.315338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f4e16491-bba7-4851-9d07-8ec26773e11d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:18.317704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f4e16491-bba7-4851-9d07-8ec26773e11d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:18.325826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4e16491-bba7-4851-9d07-8ec26773e11d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:18.326643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4e16491-bba7-4851-9d07-8ec26773e11d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:18.327871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4e16491-bba7-4851-9d07-8ec26773e11d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:18.328600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4e16491-bba7-4851-9d07-8ec26773e11d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:18.329068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4e16491-bba7-4851-9d07-8ec26773e11d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:18.329506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f4e16491-bba7-4851-9d07-8ec26773e11d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:18.334080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=74 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:18.388694 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f4e16491-bba7-4851-9d07-8ec26773e11d tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "POST /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3/action" status: 200 len: 32648 microversion: 2.1 time: 0.077580 Oct 11 20:26:18.390161 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3053/6151] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:26:18 2022] POST /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3/action => generated 32648 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:26:19.832666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-729b6e27-bc5d-4f92-8410-ab0b22dfea08 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:19.838643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-729b6e27-bc5d-4f92-8410-ab0b22dfea08 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:19.838801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7508b403-8ca0-4579-8459-17a6dd35a0e0 req-6a5898cf-2068-4060-81fc-50df6e6b95ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ff9779-7944-461a-8234-f889fa28e6f3", "tag": "f38bcf82-3d18-4683-a6af-81975a0b5e85"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:19.844128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:19.845192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:19.846042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:19.852294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729b6e27-bc5d-4f92-8410-ab0b22dfea08 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:19.852794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729b6e27-bc5d-4f92-8410-ab0b22dfea08 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:19.853411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729b6e27-bc5d-4f92-8410-ab0b22dfea08 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:19.854297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729b6e27-bc5d-4f92-8410-ab0b22dfea08 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:19.854951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729b6e27-bc5d-4f92-8410-ab0b22dfea08 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:19.855567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729b6e27-bc5d-4f92-8410-ab0b22dfea08 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:19.859303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7508b403-8ca0-4579-8459-17a6dd35a0e0 req-6a5898cf-2068-4060-81fc-50df6e6b95ad service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:19.860028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7508b403-8ca0-4579-8459-17a6dd35a0e0 req-6a5898cf-2068-4060-81fc-50df6e6b95ad service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:19.860663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7508b403-8ca0-4579-8459-17a6dd35a0e0 req-6a5898cf-2068-4060-81fc-50df6e6b95ad service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:19.873075 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7508b403-8ca0-4579-8459-17a6dd35a0e0 req-6a5898cf-2068-4060-81fc-50df6e6b95ad service nova] Creating event network-changed:f38bcf82-3d18-4683-a6af-81975a0b5e85 for instance 18ff9779-7944-461a-8234-f889fa28e6f3 on n-h1-860864-3 Oct 11 20:26:19.879170 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7508b403-8ca0-4579-8459-17a6dd35a0e0 req-6a5898cf-2068-4060-81fc-50df6e6b95ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044261 Oct 11 20:26:19.880458 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3054/6152] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:26:19.891275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-729b6e27-bc5d-4f92-8410-ab0b22dfea08 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:26:20.028041 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-729b6e27-bc5d-4f92-8410-ab0b22dfea08 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "DELETE /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 204 len: 0 microversion: 2.1 time: 0.199073 Oct 11 20:26:20.032438 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3099/6153] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:26:19 2022] DELETE /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:26:20.040848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-02c91001-5c99-42a5-a5ed-30c7e0c1e1bd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:20.042277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-02c91001-5c99-42a5-a5ed-30c7e0c1e1bd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:20.062998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02c91001-5c99-42a5-a5ed-30c7e0c1e1bd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:20.063819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02c91001-5c99-42a5-a5ed-30c7e0c1e1bd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:20.064466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02c91001-5c99-42a5-a5ed-30c7e0c1e1bd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:20.065391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02c91001-5c99-42a5-a5ed-30c7e0c1e1bd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:20.066037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02c91001-5c99-42a5-a5ed-30c7e0c1e1bd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:20.066683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-02c91001-5c99-42a5-a5ed-30c7e0c1e1bd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:20.243758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-02c91001-5c99-42a5-a5ed-30c7e0c1e1bd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:20.252699 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-02c91001-5c99-42a5-a5ed-30c7e0c1e1bd tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1669 microversion: 2.1 time: 0.218630 Oct 11 20:26:20.253807 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3055/6154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:20 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1669 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:21.292973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a5355fa8-91a6-45a0-849f-e80e10aab647 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:21.293841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a5355fa8-91a6-45a0-849f-e80e10aab647 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:21.308343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5355fa8-91a6-45a0-849f-e80e10aab647 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:21.308979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5355fa8-91a6-45a0-849f-e80e10aab647 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:21.309516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5355fa8-91a6-45a0-849f-e80e10aab647 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:21.310578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5355fa8-91a6-45a0-849f-e80e10aab647 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:21.313162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5355fa8-91a6-45a0-849f-e80e10aab647 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:21.313162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a5355fa8-91a6-45a0-849f-e80e10aab647 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:21.705688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a5355fa8-91a6-45a0-849f-e80e10aab647 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e611fef85942e587a8a4e49e10d1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf306e7b9d4546b782e7f06728a927b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:21.716138 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a5355fa8-91a6-45a0-849f-e80e10aab647 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 200 len: 1669 microversion: 2.1 time: 0.427309 Oct 11 20:26:21.733859 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3100/6155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:21 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 1669 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:21.992288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1e9f4d46-b4be-4deb-a4f2-5d2b0fa30cda req-29ea2768-0220-4317-a110-48910498c1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ff9779-7944-461a-8234-f889fa28e6f3", "name": "network-vif-deleted", "tag": "f38bcf82-3d18-4683-a6af-81975a0b5e85"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:22.004977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1e9f4d46-b4be-4deb-a4f2-5d2b0fa30cda req-29ea2768-0220-4317-a110-48910498c1fa service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:22.005468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1e9f4d46-b4be-4deb-a4f2-5d2b0fa30cda req-29ea2768-0220-4317-a110-48910498c1fa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:22.006171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1e9f4d46-b4be-4deb-a4f2-5d2b0fa30cda req-29ea2768-0220-4317-a110-48910498c1fa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:22.030942 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1e9f4d46-b4be-4deb-a4f2-5d2b0fa30cda req-29ea2768-0220-4317-a110-48910498c1fa service nova] Creating event network-vif-deleted:f38bcf82-3d18-4683-a6af-81975a0b5e85 for instance 18ff9779-7944-461a-8234-f889fa28e6f3 on n-h1-860864-3 Oct 11 20:26:22.053220 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1e9f4d46-b4be-4deb-a4f2-5d2b0fa30cda req-29ea2768-0220-4317-a110-48910498c1fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065878 Oct 11 20:26:22.060806 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3056/6156] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:26:22.740466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:22.741041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] [instance: 18ff9779-7944-461a-8234-f889fa28e6f3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:22.750224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:22.750752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:22.751193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:22.752059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:22.752518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:22.752978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:22.769047 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] HTTP exception thrown: Instance 18ff9779-7944-461a-8234-f889fa28e6f3 could not be found. Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Request method failure captured: Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 HTTP/1.1 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdCr-M_FbfsQy6CjQxVoYHdTRUq6OZ8iaPQW8LuQmL4jPryCOLRs8uLNlueIitNm4qFvQnO0gkIZlOV0FVQ2Wm5LACPf3_toYnFesO7coTdaEjtgScrIEPCiBXjASPxlOtJ1SAZX1SElyAmaSmrv18u_CzG-1unGtINTBnXHEjC1JN4 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: bf306e7b9d4546b782e7f06728a927b7 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestNetworkBasicOps-368215535 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf306e7b9d4546b782e7f06728a927b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf306e7b9d4546b782e7f06728a927b7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf306e7b9d4546b782e7f06728a927b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf306e7b9d4546b782e7f06728a927b7"}]}] Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestNetworkBasicOps-368215535 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: bf306e7b9d4546b782e7f06728a927b7 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestNetworkBasicOps-368215535 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestNetworkBasicOps-368215535-project Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d2e611fef85942e587a8a4e49e10d1b6 Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestNetworkBasicOps-368215535-project Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 18ff9779-7944-461a-8234-f889fa28e6f3 could not be found. Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '18ff9779-7944-461a-8234-f889fa28e6f3'} Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ff9779-7944-461a-8234-f889fa28e6f3 could not be found. Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ff9779-7944-461a-8234-f889fa28e6f3 could not be found. Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:26:22.771965 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:22.777537 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:26:22.777537 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:26:22.777537 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:26:22.777537 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:26:22.777537 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:26:22.777537 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ff9779-7944-461a-8234-f889fa28e6f3 could not be found. Oct 11 20:26:22.777537 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:26:22.777537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Returning 404 to user: Instance 18ff9779-7944-461a-8234-f889fa28e6f3 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:26:22.777537 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cbe0ea2c-234d-48eb-9873-ee24223f1f73 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3" status: 404 len: 111 microversion: 2.1 time: 0.038092 Oct 11 20:26:22.777537 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3101/6157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:22 2022] GET /compute/v2.1/servers/18ff9779-7944-461a-8234-f889fa28e6f3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:26:23.004767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7b667b6-5933-42c1-8800-4b981a3f92c1 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] Calling method '.version_select at 0x7f83c7377160>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:23.032044 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e7b667b6-5933-42c1-8800-4b981a3f92c1 tempest-TestNetworkBasicOps-368215535 tempest-TestNetworkBasicOps-368215535-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-703503919" status: 202 len: 0 microversion: 2.1 time: 0.029896 Oct 11 20:26:23.032614 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3057/6158] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 11 20:26:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-703503919 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:26:28.654662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1521171602", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-113237225", "security_groups": [{"name": "tempest-secgroup-smoke-1811756876"}], "block_device_mapping_v2": [{"uuid": "6ddc5e4e-9424-4ba7-8c5a-d4cb1f82667b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06296b2d-bf7f-4d21-bab0-dfde6b2c7622"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:28.873292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] validate_networks() for [('06296b2d-bf7f-4d21-bab0-dfde6b2c7622', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:26:29.774127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:26:29.775306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:26:29.775786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:26:29.776514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:26:29.776932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:26:29.786828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:29.787558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:29.788298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:29.789243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:29.789699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:29.790110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:29.809594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:26:29.816271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for user cbcf07bc33104f78adbcd3dfa198a570 and project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:26:29.896773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:26:29.899222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ddc5e4e-9424-4ba7-8c5a-d4cb1f82667b',volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:26:30.149328 n-d-860864-3 devstack@n-api.service[126956]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [a1c25c39-e1cf-44df-9624-4357a80aae75] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 20:26:31.157932 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [a1c25c39-e1cf-44df-9624-4357a80aae75] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40018. Oct 11 20:26:31.163016 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8720263c-22bc-4306-a3d3-3df827fa7eee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.512744 Oct 11 20:26:31.164131 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3102/6159] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:26:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 2515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:26:31.178049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8f8091f-5002-46a8-8be1-c6f648141c83 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:31.178684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c8f8091f-5002-46a8-8be1-c6f648141c83 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:31.185117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:31.310343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c8f8091f-5002-46a8-8be1-c6f648141c83 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:31.323901 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8f8091f-5002-46a8-8be1-c6f648141c83 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1094 microversion: 2.1 time: 0.152313 Oct 11 20:26:31.325168 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3058/6160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:31 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1094 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:32.349463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6e13aae-27c6-42ab-942c-77cd93ca42ee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:32.350293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6e13aae-27c6-42ab-942c-77cd93ca42ee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:32.378402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e13aae-27c6-42ab-942c-77cd93ca42ee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:32.379241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e13aae-27c6-42ab-942c-77cd93ca42ee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:32.379782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e13aae-27c6-42ab-942c-77cd93ca42ee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:32.381115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e13aae-27c6-42ab-942c-77cd93ca42ee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:32.383582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e13aae-27c6-42ab-942c-77cd93ca42ee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:32.384931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6e13aae-27c6-42ab-942c-77cd93ca42ee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:32.557521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f6e13aae-27c6-42ab-942c-77cd93ca42ee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:32.574336 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6e13aae-27c6-42ab-942c-77cd93ca42ee tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1192 microversion: 2.1 time: 0.229520 Oct 11 20:26:32.586608 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3103/6161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:32 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1192 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:33.603279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-703b1715-235c-4760-bbd2-e934cb0ebe19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:33.603279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-703b1715-235c-4760-bbd2-e934cb0ebe19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:33.614599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=13 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:33.618376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-703b1715-235c-4760-bbd2-e934cb0ebe19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:33.618931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-703b1715-235c-4760-bbd2-e934cb0ebe19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:33.619691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-703b1715-235c-4760-bbd2-e934cb0ebe19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:33.620227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-703b1715-235c-4760-bbd2-e934cb0ebe19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:33.620567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-703b1715-235c-4760-bbd2-e934cb0ebe19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:33.621065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-703b1715-235c-4760-bbd2-e934cb0ebe19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:33.767256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-703b1715-235c-4760-bbd2-e934cb0ebe19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:33.800908 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-703b1715-235c-4760-bbd2-e934cb0ebe19 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1210 microversion: 2.1 time: 0.203745 Oct 11 20:26:33.802109 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3059/6162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:33 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1210 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:34.824584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0aff68b3-d97a-40b9-a8f8-a45c08996a4d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:34.828073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0aff68b3-d97a-40b9-a8f8-a45c08996a4d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:34.846264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0aff68b3-d97a-40b9-a8f8-a45c08996a4d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:34.847286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0aff68b3-d97a-40b9-a8f8-a45c08996a4d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:34.848013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0aff68b3-d97a-40b9-a8f8-a45c08996a4d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:34.849139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0aff68b3-d97a-40b9-a8f8-a45c08996a4d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:34.851902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0aff68b3-d97a-40b9-a8f8-a45c08996a4d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:34.852650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0aff68b3-d97a-40b9-a8f8-a45c08996a4d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:35.683895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0aff68b3-d97a-40b9-a8f8-a45c08996a4d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:35.696389 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0aff68b3-d97a-40b9-a8f8-a45c08996a4d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1278 microversion: 2.1 time: 0.872794 Oct 11 20:26:35.699328 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3104/6163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:34 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1278 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:36.730483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-48bdde61-6333-4712-825a-595083816a37 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:36.731198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-48bdde61-6333-4712-825a-595083816a37 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:36.759889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48bdde61-6333-4712-825a-595083816a37 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:36.760408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48bdde61-6333-4712-825a-595083816a37 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:36.760874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48bdde61-6333-4712-825a-595083816a37 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:36.761657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48bdde61-6333-4712-825a-595083816a37 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:36.762439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48bdde61-6333-4712-825a-595083816a37 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:36.763151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48bdde61-6333-4712-825a-595083816a37 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:37.708868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-48bdde61-6333-4712-825a-595083816a37 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:37.726227 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-48bdde61-6333-4712-825a-595083816a37 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1278 microversion: 2.1 time: 0.998847 Oct 11 20:26:37.727189 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3060/6164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:36 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1278 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:38.351279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b17f0c5a-a466-41be-8fca-61df04f229c5 req-503df14e-2ad6-44e1-80a1-527c5ac814df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4993eb1-b6c0-4fdb-a47c-4e175639bb9e", "tag": "5eca6ca2-0fbe-4182-9544-cef2e27cca4d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:38.400393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b17f0c5a-a466-41be-8fca-61df04f229c5 req-503df14e-2ad6-44e1-80a1-527c5ac814df service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:38.400393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b17f0c5a-a466-41be-8fca-61df04f229c5 req-503df14e-2ad6-44e1-80a1-527c5ac814df service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:38.400625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b17f0c5a-a466-41be-8fca-61df04f229c5 req-503df14e-2ad6-44e1-80a1-527c5ac814df service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:38.430228 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b17f0c5a-a466-41be-8fca-61df04f229c5 req-503df14e-2ad6-44e1-80a1-527c5ac814df service nova] Creating event network-changed:5eca6ca2-0fbe-4182-9544-cef2e27cca4d for instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e on n-h1-860864-3 Oct 11 20:26:38.442203 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b17f0c5a-a466-41be-8fca-61df04f229c5 req-503df14e-2ad6-44e1-80a1-527c5ac814df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107550 Oct 11 20:26:38.443602 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3105/6165] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:26:38.766509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2307f734-e6c6-4300-896d-ed88855fe27b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:38.768192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2307f734-e6c6-4300-896d-ed88855fe27b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:38.789463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2307f734-e6c6-4300-896d-ed88855fe27b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:38.798065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2307f734-e6c6-4300-896d-ed88855fe27b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:38.802400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2307f734-e6c6-4300-896d-ed88855fe27b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:38.805449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2307f734-e6c6-4300-896d-ed88855fe27b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:38.806056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2307f734-e6c6-4300-896d-ed88855fe27b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:38.807661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2307f734-e6c6-4300-896d-ed88855fe27b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:39.788097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2307f734-e6c6-4300-896d-ed88855fe27b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:39.798395 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2307f734-e6c6-4300-896d-ed88855fe27b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1278 microversion: 2.1 time: 1.048512 Oct 11 20:26:39.807908 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3061/6166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:38 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1278 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:40.499869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:40.501275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:40.664983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2e7bd04-102f-495e-b124-41ab96c78358 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:40.666690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7bd04-102f-495e-b124-41ab96c78358 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:40.667190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7bd04-102f-495e-b124-41ab96c78358 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:40.667640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7bd04-102f-495e-b124-41ab96c78358 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:40.668380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7bd04-102f-495e-b124-41ab96c78358 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:40.668839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7bd04-102f-495e-b124-41ab96c78358 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:40.671133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2e7bd04-102f-495e-b124-41ab96c78358 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:40.698999 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2e7bd04-102f-495e-b124-41ab96c78358 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.204747 Oct 11 20:26:40.721968 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3106/6167] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 11 20:26:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:26:40.833343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1775701656", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "availability_zone": "nova:n-h1-860864-3", "networks": [{"uuid": "1c0bdbc6-137b-4041-9431-a7ade8007b18"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:40.835769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-14762b11-2584-4966-8243-89d314148abc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:40.836723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-14762b11-2584-4966-8243-89d314148abc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:40.845420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14762b11-2584-4966-8243-89d314148abc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:40.846079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14762b11-2584-4966-8243-89d314148abc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:40.846702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14762b11-2584-4966-8243-89d314148abc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:40.847813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14762b11-2584-4966-8243-89d314148abc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:40.848611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14762b11-2584-4966-8243-89d314148abc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:40.849191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-14762b11-2584-4966-8243-89d314148abc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:40.961520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] validate_networks() for [('1c0bdbc6-137b-4041-9431-a7ade8007b18', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:26:41.323716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:41.597618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-14762b11-2584-4966-8243-89d314148abc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:41.607411 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-14762b11-2584-4966-8243-89d314148abc tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1278 microversion: 2.1 time: 0.775604 Oct 11 20:26:41.622479 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3107/6168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:40 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1278 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:42.437011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:26:42.437638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:26:42.439246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:26:42.439705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:26:42.440139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:26:42.452001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:42.452513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:42.452985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:42.453941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:42.454591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:42.455190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:42.479239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Getting quotas for project e5985e9625834f2d87aa09e031e41a74. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:26:42.486932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Getting quotas for user 416a259a085c4fa2ad6ae75905c69481 and project e5985e9625834f2d87aa09e031e41a74. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:26:42.505313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:26:42.507942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:26:42.595080 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-adcb8f76-565b-419e-afd0-29e566504bad tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.766417 Oct 11 20:26:42.595994 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3062/6169] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:26:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:26:42.607332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dd5a4f3b-5537-4a67-88a1-efd1c22d82e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:42.608071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dd5a4f3b-5537-4a67-88a1-efd1c22d82e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:42.631823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-275a8d3e-6e92-4170-8eb5-2be5d2650631 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:42.632465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-275a8d3e-6e92-4170-8eb5-2be5d2650631 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:42.647492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-275a8d3e-6e92-4170-8eb5-2be5d2650631 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:42.649360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-275a8d3e-6e92-4170-8eb5-2be5d2650631 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:42.649861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-275a8d3e-6e92-4170-8eb5-2be5d2650631 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:42.650655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-275a8d3e-6e92-4170-8eb5-2be5d2650631 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:42.654747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-275a8d3e-6e92-4170-8eb5-2be5d2650631 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:42.656064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-275a8d3e-6e92-4170-8eb5-2be5d2650631 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:42.781670 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dd5a4f3b-5537-4a67-88a1-efd1c22d82e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1329 microversion: 2.1 time: 0.176500 Oct 11 20:26:42.783353 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3108/6170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:42 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1329 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:43.019838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-275a8d3e-6e92-4170-8eb5-2be5d2650631 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:43.033097 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-275a8d3e-6e92-4170-8eb5-2be5d2650631 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1266 microversion: 2.1 time: 0.405427 Oct 11 20:26:43.034196 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3063/6171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:42 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1266 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:43.808751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d5a1db9f-5aa8-44fe-93af-c020d6c16706 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:43.809513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d5a1db9f-5aa8-44fe-93af-c020d6c16706 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:43.820705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a1db9f-5aa8-44fe-93af-c020d6c16706 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:43.821312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a1db9f-5aa8-44fe-93af-c020d6c16706 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:43.822377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a1db9f-5aa8-44fe-93af-c020d6c16706 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:43.823230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a1db9f-5aa8-44fe-93af-c020d6c16706 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:43.823706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a1db9f-5aa8-44fe-93af-c020d6c16706 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:43.824140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5a1db9f-5aa8-44fe-93af-c020d6c16706 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:43.951854 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d5a1db9f-5aa8-44fe-93af-c020d6c16706 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1416 microversion: 2.1 time: 0.149715 Oct 11 20:26:43.952549 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3109/6172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:43 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:44.059026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-37c40135-9461-450f-af7c-00d6f11c0549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:44.060179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-37c40135-9461-450f-af7c-00d6f11c0549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:44.073377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37c40135-9461-450f-af7c-00d6f11c0549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:44.074124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37c40135-9461-450f-af7c-00d6f11c0549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:44.075531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37c40135-9461-450f-af7c-00d6f11c0549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:44.079019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37c40135-9461-450f-af7c-00d6f11c0549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:44.080727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37c40135-9461-450f-af7c-00d6f11c0549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:44.081500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-37c40135-9461-450f-af7c-00d6f11c0549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:44.480286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-37c40135-9461-450f-af7c-00d6f11c0549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:44.489333 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-37c40135-9461-450f-af7c-00d6f11c0549 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1266 microversion: 2.1 time: 0.435683 Oct 11 20:26:44.489995 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3064/6173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:44 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1266 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:44.976834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9edaf8cd-d80a-4200-9d44-bcddfd45d9e1 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:44.978264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9edaf8cd-d80a-4200-9d44-bcddfd45d9e1 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:44.987992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9edaf8cd-d80a-4200-9d44-bcddfd45d9e1 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:44.989015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9edaf8cd-d80a-4200-9d44-bcddfd45d9e1 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:44.991059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9edaf8cd-d80a-4200-9d44-bcddfd45d9e1 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:44.992600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9edaf8cd-d80a-4200-9d44-bcddfd45d9e1 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:44.993298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9edaf8cd-d80a-4200-9d44-bcddfd45d9e1 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:44.994173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9edaf8cd-d80a-4200-9d44-bcddfd45d9e1 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:45.139429 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9edaf8cd-d80a-4200-9d44-bcddfd45d9e1 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1422 microversion: 2.1 time: 0.165956 Oct 11 20:26:45.140067 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3110/6174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:44 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1422 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:45.514011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5a6114df-e553-4f2b-a65b-f50fcf10b702 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:45.515415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5a6114df-e553-4f2b-a65b-f50fcf10b702 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:45.525388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a6114df-e553-4f2b-a65b-f50fcf10b702 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:45.532041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a6114df-e553-4f2b-a65b-f50fcf10b702 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:45.533367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a6114df-e553-4f2b-a65b-f50fcf10b702 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:45.535191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a6114df-e553-4f2b-a65b-f50fcf10b702 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:45.538114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a6114df-e553-4f2b-a65b-f50fcf10b702 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:45.539858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a6114df-e553-4f2b-a65b-f50fcf10b702 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:45.851614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5a6114df-e553-4f2b-a65b-f50fcf10b702 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:45.871866 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5a6114df-e553-4f2b-a65b-f50fcf10b702 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1266 microversion: 2.1 time: 0.363070 Oct 11 20:26:45.873050 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3065/6175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:45 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1266 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:46.167325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-592dc82a-9da0-4a0c-b73c-8af50ea2158a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:46.167947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-592dc82a-9da0-4a0c-b73c-8af50ea2158a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:46.185063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-592dc82a-9da0-4a0c-b73c-8af50ea2158a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:46.194510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-592dc82a-9da0-4a0c-b73c-8af50ea2158a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:46.195203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-592dc82a-9da0-4a0c-b73c-8af50ea2158a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:46.196086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-592dc82a-9da0-4a0c-b73c-8af50ea2158a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:46.202776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-592dc82a-9da0-4a0c-b73c-8af50ea2158a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:46.203492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-592dc82a-9da0-4a0c-b73c-8af50ea2158a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:46.443418 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-592dc82a-9da0-4a0c-b73c-8af50ea2158a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1464 microversion: 2.1 time: 0.280058 Oct 11 20:26:46.444018 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3111/6176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:46 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1464 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:46.569982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5ee4ec37-7839-4352-a4ec-83ff449c86c8 req-4a2a50b1-d534-4310-89cc-ea2d5ca76d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556dd04b-c9c1-43a0-a117-e9fe089e7b6d", "tag": "5f997f10-ac4e-44f2-8d26-d51f29a73f36"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:46.592480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ee4ec37-7839-4352-a4ec-83ff449c86c8 req-4a2a50b1-d534-4310-89cc-ea2d5ca76d0b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:46.593002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ee4ec37-7839-4352-a4ec-83ff449c86c8 req-4a2a50b1-d534-4310-89cc-ea2d5ca76d0b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:46.593460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ee4ec37-7839-4352-a4ec-83ff449c86c8 req-4a2a50b1-d534-4310-89cc-ea2d5ca76d0b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:46.613539 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5ee4ec37-7839-4352-a4ec-83ff449c86c8 req-4a2a50b1-d534-4310-89cc-ea2d5ca76d0b service nova] Creating event network-changed:5f997f10-ac4e-44f2-8d26-d51f29a73f36 for instance 556dd04b-c9c1-43a0-a117-e9fe089e7b6d on n-h1-860864-3 Oct 11 20:26:46.619086 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5ee4ec37-7839-4352-a4ec-83ff449c86c8 req-4a2a50b1-d534-4310-89cc-ea2d5ca76d0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053306 Oct 11 20:26:46.620239 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3066/6177] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:26:46.896291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a2cbfeb-de7f-4abd-ad8f-e5e8c667a6d5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:46.897015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0a2cbfeb-de7f-4abd-ad8f-e5e8c667a6d5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:46.906068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2cbfeb-de7f-4abd-ad8f-e5e8c667a6d5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:46.912795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2cbfeb-de7f-4abd-ad8f-e5e8c667a6d5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:46.914886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2cbfeb-de7f-4abd-ad8f-e5e8c667a6d5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:46.915786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2cbfeb-de7f-4abd-ad8f-e5e8c667a6d5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:46.917800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2cbfeb-de7f-4abd-ad8f-e5e8c667a6d5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:46.918344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a2cbfeb-de7f-4abd-ad8f-e5e8c667a6d5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:47.276136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0a2cbfeb-de7f-4abd-ad8f-e5e8c667a6d5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:47.286451 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a2cbfeb-de7f-4abd-ad8f-e5e8c667a6d5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1266 microversion: 2.1 time: 0.394330 Oct 11 20:26:47.294768 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3112/6178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:46 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1266 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:47.470209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-298071b7-571b-4e9b-b17a-4be7d283b00c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:47.470971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-298071b7-571b-4e9b-b17a-4be7d283b00c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:47.477763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-298071b7-571b-4e9b-b17a-4be7d283b00c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:47.480183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-298071b7-571b-4e9b-b17a-4be7d283b00c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:47.480873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-298071b7-571b-4e9b-b17a-4be7d283b00c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:47.481837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-298071b7-571b-4e9b-b17a-4be7d283b00c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:47.482606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-298071b7-571b-4e9b-b17a-4be7d283b00c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:47.483491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-298071b7-571b-4e9b-b17a-4be7d283b00c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:47.642248 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-298071b7-571b-4e9b-b17a-4be7d283b00c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1464 microversion: 2.1 time: 0.176935 Oct 11 20:26:47.649463 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3067/6179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:47 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1464 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:48.318375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-82367ccf-1ee7-411b-aa62-6e581518942c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:48.319074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-82367ccf-1ee7-411b-aa62-6e581518942c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:48.333009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82367ccf-1ee7-411b-aa62-6e581518942c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:48.336807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82367ccf-1ee7-411b-aa62-6e581518942c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:48.338153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82367ccf-1ee7-411b-aa62-6e581518942c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:48.339821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82367ccf-1ee7-411b-aa62-6e581518942c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:48.340538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82367ccf-1ee7-411b-aa62-6e581518942c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:48.342242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82367ccf-1ee7-411b-aa62-6e581518942c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:48.518380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82367ccf-1ee7-411b-aa62-6e581518942c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:48.530936 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-82367ccf-1ee7-411b-aa62-6e581518942c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1266 microversion: 2.1 time: 0.215528 Oct 11 20:26:48.546561 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3113/6180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:48 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:48.669206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2ba49a05-df53-4960-aa79-5883e12eafc8 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:48.669838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2ba49a05-df53-4960-aa79-5883e12eafc8 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:48.683199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ba49a05-df53-4960-aa79-5883e12eafc8 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:48.683913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ba49a05-df53-4960-aa79-5883e12eafc8 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:48.684691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ba49a05-df53-4960-aa79-5883e12eafc8 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:48.685567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ba49a05-df53-4960-aa79-5883e12eafc8 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:48.686188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ba49a05-df53-4960-aa79-5883e12eafc8 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:48.686810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ba49a05-df53-4960-aa79-5883e12eafc8 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:49.009543 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2ba49a05-df53-4960-aa79-5883e12eafc8 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1464 microversion: 2.1 time: 0.345679 Oct 11 20:26:49.012383 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3068/6181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:48 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1464 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:49.563158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c4b4bd50-736f-4d1b-89fa-ec0a9ae34170 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:49.563971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c4b4bd50-736f-4d1b-89fa-ec0a9ae34170 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:49.568152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f9b71a05-07b5-41e1-8932-e1516006d914 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Action: 'create', calling method: .version_select at 0x7f83cc668a60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1581959324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkV0GrwkEDqeE5IJvABHIoPU+4vLNJSwsvoD/1yZpVzkfp+KgF6V1vMYO7ddplPHAovCC9kDxjmynKPIX6EZvfNgkoqKw9whUm/Igpzhwd+Gdr5V+XgcUeCeAz1e/K+oQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:49.584481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b4bd50-736f-4d1b-89fa-ec0a9ae34170 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:49.585021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b4bd50-736f-4d1b-89fa-ec0a9ae34170 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:49.585471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b4bd50-736f-4d1b-89fa-ec0a9ae34170 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:49.586209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b4bd50-736f-4d1b-89fa-ec0a9ae34170 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:49.586722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b4bd50-736f-4d1b-89fa-ec0a9ae34170 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:49.587169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c4b4bd50-736f-4d1b-89fa-ec0a9ae34170 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:49.610124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f9b71a05-07b5-41e1-8932-e1516006d914 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Getting quotas for project ed1a5c5f3da341d9a2ab9ee299f2323a. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:26:49.631574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f9b71a05-07b5-41e1-8932-e1516006d914 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Getting quotas for user 5d7b72d57cfb4c44919cdf8f4778c222 and project ed1a5c5f3da341d9a2ab9ee299f2323a. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:26:49.676043 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f9b71a05-07b5-41e1-8932-e1516006d914 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.452841 Oct 11 20:26:49.677045 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3114/6182] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:26:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:26:49.980146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c4b4bd50-736f-4d1b-89fa-ec0a9ae34170 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:49.988425 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c4b4bd50-736f-4d1b-89fa-ec0a9ae34170 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1266 microversion: 2.1 time: 0.432813 Oct 11 20:26:49.989394 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3069/6183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:49 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1266 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:50.035191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3e648245-d711-4015-a06b-2f3c202b9ccf tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:50.035893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3e648245-d711-4015-a06b-2f3c202b9ccf tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:50.041549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:50.044021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e648245-d711-4015-a06b-2f3c202b9ccf tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:50.044580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e648245-d711-4015-a06b-2f3c202b9ccf tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:50.045083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e648245-d711-4015-a06b-2f3c202b9ccf tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:50.045774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e648245-d711-4015-a06b-2f3c202b9ccf tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:50.046232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e648245-d711-4015-a06b-2f3c202b9ccf tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:50.046689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e648245-d711-4015-a06b-2f3c202b9ccf tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:50.051973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:50.256380 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3e648245-d711-4015-a06b-2f3c202b9ccf tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1464 microversion: 2.1 time: 0.225186 Oct 11 20:26:50.274975 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3115/6184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:50 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1464 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:50.892670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2031022074", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1581959324", "security_groups": [{"name": "tempest-secgroup-smoke-2143448485"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "1c6d9dad-a533-4e5d-b58c-e64fc884b957"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:51.012708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] validate_networks() for [('1c6d9dad-a533-4e5d-b58c-e64fc884b957', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:26:51.013330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e7beab28-ca80-4abd-904d-553dd868d098 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:51.013897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e7beab28-ca80-4abd-904d-553dd868d098 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:51.021084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:51.024177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7beab28-ca80-4abd-904d-553dd868d098 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:51.024876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7beab28-ca80-4abd-904d-553dd868d098 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:51.025506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7beab28-ca80-4abd-904d-553dd868d098 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:51.026603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7beab28-ca80-4abd-904d-553dd868d098 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:51.027276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7beab28-ca80-4abd-904d-553dd868d098 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:51.027950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7beab28-ca80-4abd-904d-553dd868d098 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:51.238258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e7beab28-ca80-4abd-904d-553dd868d098 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:51.246783 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e7beab28-ca80-4abd-904d-553dd868d098 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1266 microversion: 2.1 time: 0.237774 Oct 11 20:26:51.251469 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3116/6185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:51 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:26:51.257000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-09345fdf-5f52-4aa0-b6f4-7dd552988e5d req-e1fd4037-ee00-4ea4-9c26-083e835787b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556dd04b-c9c1-43a0-a117-e9fe089e7b6d", "name": "network-vif-plugged", "status": "completed", "tag": "5f997f10-ac4e-44f2-8d26-d51f29a73f36"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:51.268028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-09345fdf-5f52-4aa0-b6f4-7dd552988e5d req-e1fd4037-ee00-4ea4-9c26-083e835787b9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:51.268479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-09345fdf-5f52-4aa0-b6f4-7dd552988e5d req-e1fd4037-ee00-4ea4-9c26-083e835787b9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:51.268901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-09345fdf-5f52-4aa0-b6f4-7dd552988e5d req-e1fd4037-ee00-4ea4-9c26-083e835787b9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:51.279981 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-09345fdf-5f52-4aa0-b6f4-7dd552988e5d req-e1fd4037-ee00-4ea4-9c26-083e835787b9 service nova] Creating event network-vif-plugged:5f997f10-ac4e-44f2-8d26-d51f29a73f36 for instance 556dd04b-c9c1-43a0-a117-e9fe089e7b6d on n-h1-860864-3 Oct 11 20:26:51.285166 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-09345fdf-5f52-4aa0-b6f4-7dd552988e5d req-e1fd4037-ee00-4ea4-9c26-083e835787b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031881 Oct 11 20:26:51.286101 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3117/6186] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:26:51.291933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d82e7844-0092-4f4b-b7a3-82bd520a638a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:51.292628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d82e7844-0092-4f4b-b7a3-82bd520a638a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:51.300399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d82e7844-0092-4f4b-b7a3-82bd520a638a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:51.300571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d82e7844-0092-4f4b-b7a3-82bd520a638a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:51.300943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d82e7844-0092-4f4b-b7a3-82bd520a638a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:51.301640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d82e7844-0092-4f4b-b7a3-82bd520a638a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:51.302414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d82e7844-0092-4f4b-b7a3-82bd520a638a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:51.302867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d82e7844-0092-4f4b-b7a3-82bd520a638a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:51.606483 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d82e7844-0092-4f4b-b7a3-82bd520a638a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1464 microversion: 2.1 time: 0.319012 Oct 11 20:26:51.607091 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3118/6187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:51 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:51.645589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Getting quotas for project ed1a5c5f3da341d9a2ab9ee299f2323a. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:26:51.650811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Getting quotas for user 5d7b72d57cfb4c44919cdf8f4778c222 and project ed1a5c5f3da341d9a2ab9ee299f2323a. Resources: dict_keys(['metadata_items']) {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:26:51.663878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:26:51.664292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:26:51.664775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:26:51.665191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:26:51.665611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:26:51.673907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:51.674399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:51.674884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:51.675616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:51.676082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:51.676520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:51.693354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Getting quotas for project ed1a5c5f3da341d9a2ab9ee299f2323a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:26:51.698413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Getting quotas for user 5d7b72d57cfb4c44919cdf8f4778c222 and project ed1a5c5f3da341d9a2ab9ee299f2323a. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:26:51.711481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:26:51.713845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:26:51.762146 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9b3e981b-8908-409a-ad8f-d8781286a14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.873640 Oct 11 20:26:51.762845 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3070/6188] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:26:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:26:51.774008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cfd0e8a4-4dc2-4905-ba73-674fefd0e181 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:51.774703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cfd0e8a4-4dc2-4905-ba73-674fefd0e181 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:51.831489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cfd0e8a4-4dc2-4905-ba73-674fefd0e181 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:51.838548 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cfd0e8a4-4dc2-4905-ba73-674fefd0e181 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1303 microversion: 2.1 time: 0.068094 Oct 11 20:26:51.839318 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3119/6189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:51 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1303 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:52.274393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fdf711cc-1441-49f3-861e-a417beeaec5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:52.275158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fdf711cc-1441-49f3-861e-a417beeaec5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:52.282912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf711cc-1441-49f3-861e-a417beeaec5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:52.283582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf711cc-1441-49f3-861e-a417beeaec5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:52.284039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf711cc-1441-49f3-861e-a417beeaec5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:52.284753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf711cc-1441-49f3-861e-a417beeaec5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:52.285742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf711cc-1441-49f3-861e-a417beeaec5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:52.285742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fdf711cc-1441-49f3-861e-a417beeaec5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:52.429777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fdf711cc-1441-49f3-861e-a417beeaec5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:52.437667 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fdf711cc-1441-49f3-861e-a417beeaec5f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1266 microversion: 2.1 time: 0.168141 Oct 11 20:26:52.438277 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3071/6190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:52 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:52.630323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cea534d7-a9a5-4ed2-8b98-c9a49acfe0b3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:52.630968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cea534d7-a9a5-4ed2-8b98-c9a49acfe0b3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:52.637737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea534d7-a9a5-4ed2-8b98-c9a49acfe0b3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:52.638194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea534d7-a9a5-4ed2-8b98-c9a49acfe0b3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:52.638740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea534d7-a9a5-4ed2-8b98-c9a49acfe0b3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:52.639441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea534d7-a9a5-4ed2-8b98-c9a49acfe0b3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:52.639894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea534d7-a9a5-4ed2-8b98-c9a49acfe0b3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:52.640319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cea534d7-a9a5-4ed2-8b98-c9a49acfe0b3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:52.776056 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cea534d7-a9a5-4ed2-8b98-c9a49acfe0b3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1649 microversion: 2.1 time: 0.150386 Oct 11 20:26:52.776979 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3120/6191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:52 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1649 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:52.800535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-69a0e6ed-f3a0-42b9-8095-1de1989a4ada tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:52.801171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-69a0e6ed-f3a0-42b9-8095-1de1989a4ada tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:52.807806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a0e6ed-f3a0-42b9-8095-1de1989a4ada tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:52.808326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a0e6ed-f3a0-42b9-8095-1de1989a4ada tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:52.808819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a0e6ed-f3a0-42b9-8095-1de1989a4ada tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:52.809709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a0e6ed-f3a0-42b9-8095-1de1989a4ada tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:52.810191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a0e6ed-f3a0-42b9-8095-1de1989a4ada tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:52.810669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69a0e6ed-f3a0-42b9-8095-1de1989a4ada tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:52.861718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-37d1da1b-ce57-457d-9b9f-16e7e6c9be54 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:52.862338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-37d1da1b-ce57-457d-9b9f-16e7e6c9be54 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:52.871670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d1da1b-ce57-457d-9b9f-16e7e6c9be54 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:52.872180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d1da1b-ce57-457d-9b9f-16e7e6c9be54 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:52.872622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d1da1b-ce57-457d-9b9f-16e7e6c9be54 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:52.873330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d1da1b-ce57-457d-9b9f-16e7e6c9be54 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:52.873789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d1da1b-ce57-457d-9b9f-16e7e6c9be54 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:52.874219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37d1da1b-ce57-457d-9b9f-16e7e6c9be54 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:53.004151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-37d1da1b-ce57-457d-9b9f-16e7e6c9be54 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:53.015627 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-37d1da1b-ce57-457d-9b9f-16e7e6c9be54 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1363 microversion: 2.1 time: 0.158053 Oct 11 20:26:53.030807 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3121/6192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:52 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:26:53.138496 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-69a0e6ed-f3a0-42b9-8095-1de1989a4ada tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1649 microversion: 2.1 time: 0.342149 Oct 11 20:26:53.139215 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3072/6193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:52 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1649 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:53.162903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c14573e9-34b1-47b2-b731-f0b3a453936e tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:53.163592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c14573e9-34b1-47b2-b731-f0b3a453936e tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:53.169674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c14573e9-34b1-47b2-b731-f0b3a453936e tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:53.170265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c14573e9-34b1-47b2-b731-f0b3a453936e tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:53.170808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c14573e9-34b1-47b2-b731-f0b3a453936e tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:53.171720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c14573e9-34b1-47b2-b731-f0b3a453936e tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:53.172261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c14573e9-34b1-47b2-b731-f0b3a453936e tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:53.173871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c14573e9-34b1-47b2-b731-f0b3a453936e tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:53.312536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-69747cb1-8093-4698-8184-a59c0541fa93 req-1c95a47b-8c1b-4c90-9f50-2eeb0950818c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4993eb1-b6c0-4fdb-a47c-4e175639bb9e", "name": "network-vif-plugged", "status": "completed", "tag": "5eca6ca2-0fbe-4182-9544-cef2e27cca4d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:53.324754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-69747cb1-8093-4698-8184-a59c0541fa93 req-1c95a47b-8c1b-4c90-9f50-2eeb0950818c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:53.325412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-69747cb1-8093-4698-8184-a59c0541fa93 req-1c95a47b-8c1b-4c90-9f50-2eeb0950818c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:53.325956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-69747cb1-8093-4698-8184-a59c0541fa93 req-1c95a47b-8c1b-4c90-9f50-2eeb0950818c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:53.338781 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-69747cb1-8093-4698-8184-a59c0541fa93 req-1c95a47b-8c1b-4c90-9f50-2eeb0950818c service nova] Creating event network-vif-plugged:5eca6ca2-0fbe-4182-9544-cef2e27cca4d for instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e on n-h1-860864-3 Oct 11 20:26:53.345713 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-69747cb1-8093-4698-8184-a59c0541fa93 req-1c95a47b-8c1b-4c90-9f50-2eeb0950818c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035755 Oct 11 20:26:53.347090 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3073/6194] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:26:53.407780 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c14573e9-34b1-47b2-b731-f0b3a453936e tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1649 microversion: 2.1 time: 0.247613 Oct 11 20:26:53.408841 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3122/6195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:53 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1649 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:53.465411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9812ea81-139a-4abb-953c-a604a85e218c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:53.466845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9812ea81-139a-4abb-953c-a604a85e218c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:53.476574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9812ea81-139a-4abb-953c-a604a85e218c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:53.477399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9812ea81-139a-4abb-953c-a604a85e218c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:53.478164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9812ea81-139a-4abb-953c-a604a85e218c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:53.479263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9812ea81-139a-4abb-953c-a604a85e218c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:53.480299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9812ea81-139a-4abb-953c-a604a85e218c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:53.480968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9812ea81-139a-4abb-953c-a604a85e218c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:53.572513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-969195721", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "availability_zone": "nova:n-h2-860864-3", "networks": [{"uuid": "1c0bdbc6-137b-4041-9431-a7ade8007b18"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:53.644104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] validate_networks() for [('1c0bdbc6-137b-4041-9431-a7ade8007b18', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:26:53.842189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9812ea81-139a-4abb-953c-a604a85e218c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:53.854158 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9812ea81-139a-4abb-953c-a604a85e218c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1266 microversion: 2.1 time: 0.395206 Oct 11 20:26:53.855003 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3074/6196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:53 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1266 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:54.042169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6512491d-abc8-4c4f-a33b-68b49b057cf9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:54.043012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6512491d-abc8-4c4f-a33b-68b49b057cf9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:54.050969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6512491d-abc8-4c4f-a33b-68b49b057cf9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:54.051825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6512491d-abc8-4c4f-a33b-68b49b057cf9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:54.052428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6512491d-abc8-4c4f-a33b-68b49b057cf9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:54.053416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6512491d-abc8-4c4f-a33b-68b49b057cf9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:54.054188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6512491d-abc8-4c4f-a33b-68b49b057cf9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:54.054818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6512491d-abc8-4c4f-a33b-68b49b057cf9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:54.394189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6512491d-abc8-4c4f-a33b-68b49b057cf9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:54.403157 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6512491d-abc8-4c4f-a33b-68b49b057cf9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1429 microversion: 2.1 time: 0.365689 Oct 11 20:26:54.404206 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3075/6197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:54 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1429 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:54.589139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:26:54.589640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:26:54.590384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:26:54.590927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:26:54.592644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:26:54.602640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:54.603131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:54.603560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:54.604278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:54.604732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:54.605150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:54.624442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Getting quotas for project e5985e9625834f2d87aa09e031e41a74. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:26:54.631408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Getting quotas for user 416a259a085c4fa2ad6ae75905c69481 and project e5985e9625834f2d87aa09e031e41a74. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:26:54.645532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:26:54.647936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:26:54.709220 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0ddf88df-434b-4601-a7af-b7fdb7c62ba7 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.139740 Oct 11 20:26:54.710167 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3123/6198] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:26:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 20:26:54.721656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ae2e72ab-cbaf-496c-8fa0-8429934e3b7c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:54.722253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ae2e72ab-cbaf-496c-8fa0-8429934e3b7c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:54.821011 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ae2e72ab-cbaf-496c-8fa0-8429934e3b7c tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1328 microversion: 2.1 time: 0.103209 Oct 11 20:26:54.821524 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3076/6199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:54 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:54.892105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d06b721-ab70-40b2-a6ad-ed2f6e3208e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:54.893252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8d06b721-ab70-40b2-a6ad-ed2f6e3208e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:54.901930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d06b721-ab70-40b2-a6ad-ed2f6e3208e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:54.902761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d06b721-ab70-40b2-a6ad-ed2f6e3208e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:54.903745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d06b721-ab70-40b2-a6ad-ed2f6e3208e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:54.904615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d06b721-ab70-40b2-a6ad-ed2f6e3208e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:54.905220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d06b721-ab70-40b2-a6ad-ed2f6e3208e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:54.906151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d06b721-ab70-40b2-a6ad-ed2f6e3208e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:55.179799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8d06b721-ab70-40b2-a6ad-ed2f6e3208e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:55.189439 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8d06b721-ab70-40b2-a6ad-ed2f6e3208e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1452 microversion: 2.1 time: 0.315226 Oct 11 20:26:55.190093 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3124/6200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:54 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1452 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:55.213519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3e1943c4-3161-4d5f-acdc-7aa646d2a95b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:55.214366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3e1943c4-3161-4d5f-acdc-7aa646d2a95b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:55.222157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1943c4-3161-4d5f-acdc-7aa646d2a95b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:55.222905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1943c4-3161-4d5f-acdc-7aa646d2a95b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:55.223353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1943c4-3161-4d5f-acdc-7aa646d2a95b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:55.224067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1943c4-3161-4d5f-acdc-7aa646d2a95b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:55.224534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1943c4-3161-4d5f-acdc-7aa646d2a95b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:55.224969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3e1943c4-3161-4d5f-acdc-7aa646d2a95b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:55.428664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3b18b6ab-3693-4f86-800d-0deff9243fdc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:55.429381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3b18b6ab-3693-4f86-800d-0deff9243fdc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:55.437029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3e1943c4-3161-4d5f-acdc-7aa646d2a95b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:55.437527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b18b6ab-3693-4f86-800d-0deff9243fdc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:55.438134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b18b6ab-3693-4f86-800d-0deff9243fdc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:55.439118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b18b6ab-3693-4f86-800d-0deff9243fdc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:55.440180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b18b6ab-3693-4f86-800d-0deff9243fdc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:55.441154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b18b6ab-3693-4f86-800d-0deff9243fdc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:55.442142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3b18b6ab-3693-4f86-800d-0deff9243fdc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:55.449082 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3e1943c4-3161-4d5f-acdc-7aa646d2a95b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1452 microversion: 2.1 time: 0.239484 Oct 11 20:26:55.450137 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3077/6201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:55 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1452 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:55.456670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7165294b-78bf-4baf-be02-f5e7caba3a4c req-b4accca1-6ee8-4707-9ea0-0e79efd38fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaff5f7c-4258-45de-abe9-f4e0440648e6", "tag": "158262b7-3b14-436b-bb2b-e3dd173eaf62"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:55.481647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7165294b-78bf-4baf-be02-f5e7caba3a4c req-b4accca1-6ee8-4707-9ea0-0e79efd38fd4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:55.482430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7165294b-78bf-4baf-be02-f5e7caba3a4c req-b4accca1-6ee8-4707-9ea0-0e79efd38fd4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:55.483182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7165294b-78bf-4baf-be02-f5e7caba3a4c req-b4accca1-6ee8-4707-9ea0-0e79efd38fd4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:55.505528 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7165294b-78bf-4baf-be02-f5e7caba3a4c req-b4accca1-6ee8-4707-9ea0-0e79efd38fd4 service nova] Creating event network-changed:158262b7-3b14-436b-bb2b-e3dd173eaf62 for instance aaff5f7c-4258-45de-abe9-f4e0440648e6 on n-h2-860864-3 Oct 11 20:26:55.515802 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7165294b-78bf-4baf-be02-f5e7caba3a4c req-b4accca1-6ee8-4707-9ea0-0e79efd38fd4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062834 Oct 11 20:26:55.518386 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3078/6202] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:26:55.752014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3b18b6ab-3693-4f86-800d-0deff9243fdc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:55.760988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3b18b6ab-3693-4f86-800d-0deff9243fdc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1429 microversion: 2.1 time: 0.337990 Oct 11 20:26:55.776291 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3125/6203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:55 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1429 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:26:55.848170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-523a83f7-211e-46e4-b497-af5daaa47927 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:55.848903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-523a83f7-211e-46e4-b497-af5daaa47927 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:55.855499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-523a83f7-211e-46e4-b497-af5daaa47927 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:55.856012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-523a83f7-211e-46e4-b497-af5daaa47927 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:55.856484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-523a83f7-211e-46e4-b497-af5daaa47927 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:55.857190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-523a83f7-211e-46e4-b497-af5daaa47927 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:55.857664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-523a83f7-211e-46e4-b497-af5daaa47927 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:55.858111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-523a83f7-211e-46e4-b497-af5daaa47927 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:55.942024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=100 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:26:55.948269 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-523a83f7-211e-46e4-b497-af5daaa47927 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1415 microversion: 2.1 time: 0.105398 Oct 11 20:26:55.949266 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3079/6204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:55 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1415 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:56.786898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-34e8b3b5-c9a2-4e22-9f8e-3c04c986b2f9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:56.787522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-34e8b3b5-c9a2-4e22-9f8e-3c04c986b2f9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:56.794771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34e8b3b5-c9a2-4e22-9f8e-3c04c986b2f9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:56.795423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34e8b3b5-c9a2-4e22-9f8e-3c04c986b2f9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:56.795901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34e8b3b5-c9a2-4e22-9f8e-3c04c986b2f9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:56.796608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34e8b3b5-c9a2-4e22-9f8e-3c04c986b2f9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:56.797075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34e8b3b5-c9a2-4e22-9f8e-3c04c986b2f9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:56.797501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-34e8b3b5-c9a2-4e22-9f8e-3c04c986b2f9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:56.977749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0a10afa-4fbf-4152-89a2-ba3a7374b192 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:56.978630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c0a10afa-4fbf-4152-89a2-ba3a7374b192 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:56.992608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0a10afa-4fbf-4152-89a2-ba3a7374b192 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:57.006412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0a10afa-4fbf-4152-89a2-ba3a7374b192 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:57.009279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0a10afa-4fbf-4152-89a2-ba3a7374b192 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:57.010854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0a10afa-4fbf-4152-89a2-ba3a7374b192 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:57.011497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0a10afa-4fbf-4152-89a2-ba3a7374b192 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:57.012347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0a10afa-4fbf-4152-89a2-ba3a7374b192 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:57.478861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-34e8b3b5-c9a2-4e22-9f8e-3c04c986b2f9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:57.500074 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-34e8b3b5-c9a2-4e22-9f8e-3c04c986b2f9 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1429 microversion: 2.1 time: 0.717587 Oct 11 20:26:57.500696 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3126/6205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:56 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1429 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:57.502534 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c0a10afa-4fbf-4152-89a2-ba3a7374b192 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1463 microversion: 2.1 time: 0.524410 Oct 11 20:26:57.503289 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3080/6206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:56 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1463 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:58.526444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-14ff0ad1-0e95-430d-af5a-2563b43005fc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:58.526444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-14ff0ad1-0e95-430d-af5a-2563b43005fc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:58.528498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d4a37a40-6ca2-47dc-8879-2a9463dbb56b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:58.529415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d4a37a40-6ca2-47dc-8879-2a9463dbb56b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:58.538181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4a37a40-6ca2-47dc-8879-2a9463dbb56b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:58.538790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4a37a40-6ca2-47dc-8879-2a9463dbb56b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:58.539430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4a37a40-6ca2-47dc-8879-2a9463dbb56b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:58.540349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4a37a40-6ca2-47dc-8879-2a9463dbb56b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:58.540998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4a37a40-6ca2-47dc-8879-2a9463dbb56b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:58.541383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14ff0ad1-0e95-430d-af5a-2563b43005fc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:58.541799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4a37a40-6ca2-47dc-8879-2a9463dbb56b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:58.541910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14ff0ad1-0e95-430d-af5a-2563b43005fc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:58.542591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14ff0ad1-0e95-430d-af5a-2563b43005fc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:58.543250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14ff0ad1-0e95-430d-af5a-2563b43005fc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:58.543730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14ff0ad1-0e95-430d-af5a-2563b43005fc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:58.544655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14ff0ad1-0e95-430d-af5a-2563b43005fc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:58.766017 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d4a37a40-6ca2-47dc-8879-2a9463dbb56b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1463 microversion: 2.1 time: 0.242872 Oct 11 20:26:58.769142 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3127/6207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:58 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1463 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:58.774456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-01a976c0-dc34-42f9-8445-37468daeb016 req-5f5cea88-4a91-422a-978c-e93a472a29e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4993eb1-b6c0-4fdb-a47c-4e175639bb9e", "tag": "5eca6ca2-0fbe-4182-9544-cef2e27cca4d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:26:58.786317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-14ff0ad1-0e95-430d-af5a-2563b43005fc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:26:58.790138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-01a976c0-dc34-42f9-8445-37468daeb016 req-5f5cea88-4a91-422a-978c-e93a472a29e7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:58.790809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-01a976c0-dc34-42f9-8445-37468daeb016 req-5f5cea88-4a91-422a-978c-e93a472a29e7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:58.791387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-01a976c0-dc34-42f9-8445-37468daeb016 req-5f5cea88-4a91-422a-978c-e93a472a29e7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:58.795268 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-14ff0ad1-0e95-430d-af5a-2563b43005fc tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1429 microversion: 2.1 time: 0.275435 Oct 11 20:26:58.806043 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-01a976c0-dc34-42f9-8445-37468daeb016 req-5f5cea88-4a91-422a-978c-e93a472a29e7 service nova] Creating event network-changed:5eca6ca2-0fbe-4182-9544-cef2e27cca4d for instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e on n-h1-860864-3 Oct 11 20:26:58.812296 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3081/6208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:58 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1429 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:26:58.815018 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-01a976c0-dc34-42f9-8445-37468daeb016 req-5f5cea88-4a91-422a-978c-e93a472a29e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044096 Oct 11 20:26:58.815724 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3128/6209] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:26:59.791947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-61560fc8-6cbb-426b-ba30-0dc8881bfe1b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:59.792579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-61560fc8-6cbb-426b-ba30-0dc8881bfe1b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:59.800929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61560fc8-6cbb-426b-ba30-0dc8881bfe1b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:59.801434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61560fc8-6cbb-426b-ba30-0dc8881bfe1b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:59.801882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61560fc8-6cbb-426b-ba30-0dc8881bfe1b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:59.802764 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61560fc8-6cbb-426b-ba30-0dc8881bfe1b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:59.803218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61560fc8-6cbb-426b-ba30-0dc8881bfe1b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:59.803775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-61560fc8-6cbb-426b-ba30-0dc8881bfe1b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:59.822262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-56d3bf97-de92-4ccd-9008-203ceb147084 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:26:59.823033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-56d3bf97-de92-4ccd-9008-203ceb147084 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:26:59.829498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56d3bf97-de92-4ccd-9008-203ceb147084 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:59.830153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56d3bf97-de92-4ccd-9008-203ceb147084 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:59.830796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56d3bf97-de92-4ccd-9008-203ceb147084 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:59.831674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56d3bf97-de92-4ccd-9008-203ceb147084 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:26:59.832138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56d3bf97-de92-4ccd-9008-203ceb147084 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:26:59.832570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56d3bf97-de92-4ccd-9008-203ceb147084 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:26:59.988424 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-61560fc8-6cbb-426b-ba30-0dc8881bfe1b tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1463 microversion: 2.1 time: 0.200125 Oct 11 20:26:59.989282 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3082/6210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:59 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1463 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:00.005710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56d3bf97-de92-4ccd-9008-203ceb147084 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:27:00.013509 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-56d3bf97-de92-4ccd-9008-203ceb147084 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1429 microversion: 2.1 time: 0.196535 Oct 11 20:27:00.014078 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3129/6211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:26:59 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1429 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:27:00.830860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8307e020-78af-4fda-9bd0-2b618a38252f req-ae462dfd-28a0-4d1a-bf8c-17a3e090235b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8415108-c702-4392-b654-0ca3eb9a459f", "tag": "345e0857-df88-4001-a75d-8c569761d572"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:27:00.840925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8307e020-78af-4fda-9bd0-2b618a38252f req-ae462dfd-28a0-4d1a-bf8c-17a3e090235b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:00.841418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8307e020-78af-4fda-9bd0-2b618a38252f req-ae462dfd-28a0-4d1a-bf8c-17a3e090235b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:00.841862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8307e020-78af-4fda-9bd0-2b618a38252f req-ae462dfd-28a0-4d1a-bf8c-17a3e090235b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:00.852790 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8307e020-78af-4fda-9bd0-2b618a38252f req-ae462dfd-28a0-4d1a-bf8c-17a3e090235b service nova] Creating event network-changed:345e0857-df88-4001-a75d-8c569761d572 for instance c8415108-c702-4392-b654-0ca3eb9a459f on n-h2-860864-3 Oct 11 20:27:00.857784 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8307e020-78af-4fda-9bd0-2b618a38252f req-ae462dfd-28a0-4d1a-bf8c-17a3e090235b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030701 Oct 11 20:27:00.858393 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3083/6212] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:27:01.011576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b9943e02-2649-4f06-a1c2-accef56a991f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:01.012124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b9943e02-2649-4f06-a1c2-accef56a991f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:01.020140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9943e02-2649-4f06-a1c2-accef56a991f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:01.020716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9943e02-2649-4f06-a1c2-accef56a991f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:01.021249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9943e02-2649-4f06-a1c2-accef56a991f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:01.022022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9943e02-2649-4f06-a1c2-accef56a991f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:01.022571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9943e02-2649-4f06-a1c2-accef56a991f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:01.023070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b9943e02-2649-4f06-a1c2-accef56a991f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:01.040539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-606401ff-7f64-45f1-827b-7f7e91b103a2 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:01.041666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-606401ff-7f64-45f1-827b-7f7e91b103a2 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:01.052416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606401ff-7f64-45f1-827b-7f7e91b103a2 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:01.053125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606401ff-7f64-45f1-827b-7f7e91b103a2 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:01.053728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606401ff-7f64-45f1-827b-7f7e91b103a2 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:01.055047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606401ff-7f64-45f1-827b-7f7e91b103a2 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:01.055842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606401ff-7f64-45f1-827b-7f7e91b103a2 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:01.056453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-606401ff-7f64-45f1-827b-7f7e91b103a2 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:01.246706 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b9943e02-2649-4f06-a1c2-accef56a991f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1463 microversion: 2.1 time: 0.239275 Oct 11 20:27:01.247436 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3130/6213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:01 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1463 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:27:01.252733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-92b99774-f500-4bcc-900b-8bd2a2c2cd14 req-3cb9f1ee-f2b2-4d27-8e17-7a55a733f4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaff5f7c-4258-45de-abe9-f4e0440648e6", "name": "network-vif-plugged", "status": "completed", "tag": "158262b7-3b14-436b-bb2b-e3dd173eaf62"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:27:01.258892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-606401ff-7f64-45f1-827b-7f7e91b103a2 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:27:01.263344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-92b99774-f500-4bcc-900b-8bd2a2c2cd14 req-3cb9f1ee-f2b2-4d27-8e17-7a55a733f4e9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:01.263899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-92b99774-f500-4bcc-900b-8bd2a2c2cd14 req-3cb9f1ee-f2b2-4d27-8e17-7a55a733f4e9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:01.264334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-92b99774-f500-4bcc-900b-8bd2a2c2cd14 req-3cb9f1ee-f2b2-4d27-8e17-7a55a733f4e9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:01.268054 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-606401ff-7f64-45f1-827b-7f7e91b103a2 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1429 microversion: 2.1 time: 0.233042 Oct 11 20:27:01.268623 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3084/6214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:01 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1429 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:01.291937 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-92b99774-f500-4bcc-900b-8bd2a2c2cd14 req-3cb9f1ee-f2b2-4d27-8e17-7a55a733f4e9 service nova] Creating event network-vif-plugged:158262b7-3b14-436b-bb2b-e3dd173eaf62 for instance aaff5f7c-4258-45de-abe9-f4e0440648e6 on n-h2-860864-3 Oct 11 20:27:01.296778 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-92b99774-f500-4bcc-900b-8bd2a2c2cd14 req-3cb9f1ee-f2b2-4d27-8e17-7a55a733f4e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048007 Oct 11 20:27:01.297746 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3131/6215] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:27:02.272475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f93bf1da-c6ee-4829-a7c7-8d58af30ca06 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:02.273098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f93bf1da-c6ee-4829-a7c7-8d58af30ca06 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:02.275305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:27:02.276451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:27:02.281923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f93bf1da-c6ee-4829-a7c7-8d58af30ca06 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:02.283106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f93bf1da-c6ee-4829-a7c7-8d58af30ca06 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:02.283569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f93bf1da-c6ee-4829-a7c7-8d58af30ca06 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:02.284276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f93bf1da-c6ee-4829-a7c7-8d58af30ca06 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:02.284746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f93bf1da-c6ee-4829-a7c7-8d58af30ca06 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:02.285185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f93bf1da-c6ee-4829-a7c7-8d58af30ca06 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:02.291637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d475db1c-8f98-43bb-ab32-cf77585ec14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:02.292406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d475db1c-8f98-43bb-ab32-cf77585ec14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:02.298870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d475db1c-8f98-43bb-ab32-cf77585ec14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:02.299622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d475db1c-8f98-43bb-ab32-cf77585ec14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:02.300063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d475db1c-8f98-43bb-ab32-cf77585ec14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:02.300769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d475db1c-8f98-43bb-ab32-cf77585ec14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:02.301230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d475db1c-8f98-43bb-ab32-cf77585ec14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:02.301665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d475db1c-8f98-43bb-ab32-cf77585ec14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:02.479587 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f93bf1da-c6ee-4829-a7c7-8d58af30ca06 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1463 microversion: 2.1 time: 0.211683 Oct 11 20:27:02.480636 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3085/6216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:02 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1463 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:02.497822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d475db1c-8f98-43bb-ab32-cf77585ec14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:27:02.505749 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d475db1c-8f98-43bb-ab32-cf77585ec14b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1429 microversion: 2.1 time: 0.219382 Oct 11 20:27:02.506617 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3132/6217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:02 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1429 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:27:03.501991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-769750ee-4470-4678-bd75-e2926a6323e2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:03.502655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-769750ee-4470-4678-bd75-e2926a6323e2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:03.509618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-769750ee-4470-4678-bd75-e2926a6323e2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:03.510127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-769750ee-4470-4678-bd75-e2926a6323e2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:03.510620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-769750ee-4470-4678-bd75-e2926a6323e2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:03.511333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-769750ee-4470-4678-bd75-e2926a6323e2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:03.511813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-769750ee-4470-4678-bd75-e2926a6323e2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:03.512260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-769750ee-4470-4678-bd75-e2926a6323e2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:03.533045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4648f7e7-978c-4b67-89e5-bc51a5dee402 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:03.533798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4648f7e7-978c-4b67-89e5-bc51a5dee402 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:03.540656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4648f7e7-978c-4b67-89e5-bc51a5dee402 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:03.541176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4648f7e7-978c-4b67-89e5-bc51a5dee402 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:03.541610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4648f7e7-978c-4b67-89e5-bc51a5dee402 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:03.542302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4648f7e7-978c-4b67-89e5-bc51a5dee402 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:03.542786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4648f7e7-978c-4b67-89e5-bc51a5dee402 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:03.543215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4648f7e7-978c-4b67-89e5-bc51a5dee402 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:03.694671 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-769750ee-4470-4678-bd75-e2926a6323e2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1463 microversion: 2.1 time: 0.196504 Oct 11 20:27:03.695274 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3086/6218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:03 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1463 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:03.717320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4648f7e7-978c-4b67-89e5-bc51a5dee402 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:27:03.725870 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4648f7e7-978c-4b67-89e5-bc51a5dee402 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1609 microversion: 2.1 time: 0.197224 Oct 11 20:27:03.726560 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3133/6219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:03 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1609 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:27:03.748189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67b99897-2fec-45bd-aeeb-3aba4e2e7811 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:03.748826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-67b99897-2fec-45bd-aeeb-3aba4e2e7811 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:03.754864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67b99897-2fec-45bd-aeeb-3aba4e2e7811 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:03.755378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67b99897-2fec-45bd-aeeb-3aba4e2e7811 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:03.755838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67b99897-2fec-45bd-aeeb-3aba4e2e7811 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:03.756557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67b99897-2fec-45bd-aeeb-3aba4e2e7811 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:03.757033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67b99897-2fec-45bd-aeeb-3aba4e2e7811 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:03.757481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67b99897-2fec-45bd-aeeb-3aba4e2e7811 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:03.895186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-67b99897-2fec-45bd-aeeb-3aba4e2e7811 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:27:03.903029 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-67b99897-2fec-45bd-aeeb-3aba4e2e7811 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1609 microversion: 2.1 time: 0.158608 Oct 11 20:27:03.903604 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3087/6220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:03 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1609 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:03.926688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-843138e8-4192-4892-82a8-93a92d91db57 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:03.927427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-843138e8-4192-4892-82a8-93a92d91db57 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:03.933792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-843138e8-4192-4892-82a8-93a92d91db57 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:03.934282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-843138e8-4192-4892-82a8-93a92d91db57 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:03.934744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-843138e8-4192-4892-82a8-93a92d91db57 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:03.935424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-843138e8-4192-4892-82a8-93a92d91db57 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:03.935874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-843138e8-4192-4892-82a8-93a92d91db57 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:03.936293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-843138e8-4192-4892-82a8-93a92d91db57 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:04.067513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-843138e8-4192-4892-82a8-93a92d91db57 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:27:04.075377 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-843138e8-4192-4892-82a8-93a92d91db57 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1609 microversion: 2.1 time: 0.153528 Oct 11 20:27:04.075956 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3134/6221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:03 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1609 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:27:04.718610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eeb5ccfd-c533-4e30-9915-85e7b034532a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:04.719269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eeb5ccfd-c533-4e30-9915-85e7b034532a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:04.726030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb5ccfd-c533-4e30-9915-85e7b034532a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:04.726578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb5ccfd-c533-4e30-9915-85e7b034532a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:04.727039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb5ccfd-c533-4e30-9915-85e7b034532a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:04.727759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb5ccfd-c533-4e30-9915-85e7b034532a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:04.728231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb5ccfd-c533-4e30-9915-85e7b034532a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:04.728672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eeb5ccfd-c533-4e30-9915-85e7b034532a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:04.818316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=18 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:27:05.003237 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eeb5ccfd-c533-4e30-9915-85e7b034532a tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1463 microversion: 2.1 time: 0.289678 Oct 11 20:27:05.014710 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3088/6222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:04 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1463 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:05.125661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-db3eb20b-84c8-4c3f-bc75-fb50c10571ab req-a3ead16c-ada1-4034-b008-d6d12a0d4231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8415108-c702-4392-b654-0ca3eb9a459f", "name": "network-vif-plugged", "status": "completed", "tag": "345e0857-df88-4001-a75d-8c569761d572"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:27:05.137900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:27:05.138566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=14 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:27:05.143941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-db3eb20b-84c8-4c3f-bc75-fb50c10571ab req-a3ead16c-ada1-4034-b008-d6d12a0d4231 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:05.144429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-db3eb20b-84c8-4c3f-bc75-fb50c10571ab req-a3ead16c-ada1-4034-b008-d6d12a0d4231 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:05.144860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-db3eb20b-84c8-4c3f-bc75-fb50c10571ab req-a3ead16c-ada1-4034-b008-d6d12a0d4231 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:05.166068 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-db3eb20b-84c8-4c3f-bc75-fb50c10571ab req-a3ead16c-ada1-4034-b008-d6d12a0d4231 service nova] Creating event network-vif-plugged:345e0857-df88-4001-a75d-8c569761d572 for instance c8415108-c702-4392-b654-0ca3eb9a459f on n-h2-860864-3 Oct 11 20:27:05.171460 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-db3eb20b-84c8-4c3f-bc75-fb50c10571ab req-a3ead16c-ada1-4034-b008-d6d12a0d4231 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049500 Oct 11 20:27:05.172005 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3135/6223] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:27:06.029593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7c94d9ac-b25d-4508-828f-33510ded2541 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:06.030234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7c94d9ac-b25d-4508-828f-33510ded2541 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:06.037822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c94d9ac-b25d-4508-828f-33510ded2541 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:06.038362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c94d9ac-b25d-4508-828f-33510ded2541 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:06.038828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c94d9ac-b25d-4508-828f-33510ded2541 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:06.039876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c94d9ac-b25d-4508-828f-33510ded2541 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:06.040363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c94d9ac-b25d-4508-828f-33510ded2541 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:06.040839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c94d9ac-b25d-4508-828f-33510ded2541 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:06.241923 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7c94d9ac-b25d-4508-828f-33510ded2541 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1463 microversion: 2.1 time: 0.216059 Oct 11 20:27:06.242514 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3089/6224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:06 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1463 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:06.401193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d2d72d7a-1fbe-4c42-b357-b63af0184e71 req-5bdfe801-95a5-4d1b-9a8b-9cbc2ba45f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaff5f7c-4258-45de-abe9-f4e0440648e6", "tag": "158262b7-3b14-436b-bb2b-e3dd173eaf62"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:27:06.419497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d2d72d7a-1fbe-4c42-b357-b63af0184e71 req-5bdfe801-95a5-4d1b-9a8b-9cbc2ba45f05 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:06.420269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d2d72d7a-1fbe-4c42-b357-b63af0184e71 req-5bdfe801-95a5-4d1b-9a8b-9cbc2ba45f05 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:06.420796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d2d72d7a-1fbe-4c42-b357-b63af0184e71 req-5bdfe801-95a5-4d1b-9a8b-9cbc2ba45f05 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:06.424429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:27:06.435309 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d2d72d7a-1fbe-4c42-b357-b63af0184e71 req-5bdfe801-95a5-4d1b-9a8b-9cbc2ba45f05 service nova] Creating event network-changed:158262b7-3b14-436b-bb2b-e3dd173eaf62 for instance aaff5f7c-4258-45de-abe9-f4e0440648e6 on n-h2-860864-3 Oct 11 20:27:06.441408 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d2d72d7a-1fbe-4c42-b357-b63af0184e71 req-5bdfe801-95a5-4d1b-9a8b-9cbc2ba45f05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045319 Oct 11 20:27:06.442025 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3136/6225] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:27:07.264808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b293ad69-6a1b-423d-bde2-5d72d59de510 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:07.265463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b293ad69-6a1b-423d-bde2-5d72d59de510 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:07.272634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b293ad69-6a1b-423d-bde2-5d72d59de510 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:07.273144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b293ad69-6a1b-423d-bde2-5d72d59de510 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:07.273603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b293ad69-6a1b-423d-bde2-5d72d59de510 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:07.274317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b293ad69-6a1b-423d-bde2-5d72d59de510 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:07.274813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b293ad69-6a1b-423d-bde2-5d72d59de510 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:07.275259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b293ad69-6a1b-423d-bde2-5d72d59de510 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:07.411899 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b293ad69-6a1b-423d-bde2-5d72d59de510 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1648 microversion: 2.1 time: 0.150814 Oct 11 20:27:07.412475 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3090/6226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:07 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1648 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:07.436161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99b69a06-54bb-4c1d-98ac-e6bdb3ca5909 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:07.436860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-99b69a06-54bb-4c1d-98ac-e6bdb3ca5909 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:07.443275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b69a06-54bb-4c1d-98ac-e6bdb3ca5909 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:07.443760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b69a06-54bb-4c1d-98ac-e6bdb3ca5909 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:07.444193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b69a06-54bb-4c1d-98ac-e6bdb3ca5909 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:07.444880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b69a06-54bb-4c1d-98ac-e6bdb3ca5909 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:07.445336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b69a06-54bb-4c1d-98ac-e6bdb3ca5909 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:07.445755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-99b69a06-54bb-4c1d-98ac-e6bdb3ca5909 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:07.581862 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99b69a06-54bb-4c1d-98ac-e6bdb3ca5909 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1648 microversion: 2.1 time: 0.150467 Oct 11 20:27:07.582424 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3137/6227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:07 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1648 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:07.604043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3396db7a-f0b2-48d2-8ef2-90307d127c3f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:07.604679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3396db7a-f0b2-48d2-8ef2-90307d127c3f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:07.611333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3396db7a-f0b2-48d2-8ef2-90307d127c3f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:07.611845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3396db7a-f0b2-48d2-8ef2-90307d127c3f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:07.612341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3396db7a-f0b2-48d2-8ef2-90307d127c3f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:07.613066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3396db7a-f0b2-48d2-8ef2-90307d127c3f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:07.613531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3396db7a-f0b2-48d2-8ef2-90307d127c3f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:07.613975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3396db7a-f0b2-48d2-8ef2-90307d127c3f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:07.748779 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3396db7a-f0b2-48d2-8ef2-90307d127c3f tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1648 microversion: 2.1 time: 0.148276 Oct 11 20:27:07.750070 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3091/6228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:07 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1648 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:07.771887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f09d6632-1e3a-437b-ba2e-676bb518b2e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:07.772330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f09d6632-1e3a-437b-ba2e-676bb518b2e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:07.778354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f09d6632-1e3a-437b-ba2e-676bb518b2e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:07.778868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f09d6632-1e3a-437b-ba2e-676bb518b2e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:07.779304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f09d6632-1e3a-437b-ba2e-676bb518b2e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:07.779985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f09d6632-1e3a-437b-ba2e-676bb518b2e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:07.780438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f09d6632-1e3a-437b-ba2e-676bb518b2e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:07.780858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f09d6632-1e3a-437b-ba2e-676bb518b2e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:07.805633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f09d6632-1e3a-437b-ba2e-676bb518b2e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:27:07.877769 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f09d6632-1e3a-437b-ba2e-676bb518b2e3 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 204 len: 0 microversion: 2.1 time: 0.109261 Oct 11 20:27:07.878624 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3138/6229] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:27:07 2022] DELETE /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:27:07.887133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-44da0e4a-821f-4ddf-9ef6-245248ef1666 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:07.887765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-44da0e4a-821f-4ddf-9ef6-245248ef1666 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:07.894978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44da0e4a-821f-4ddf-9ef6-245248ef1666 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:07.895485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44da0e4a-821f-4ddf-9ef6-245248ef1666 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:07.895939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44da0e4a-821f-4ddf-9ef6-245248ef1666 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:07.896646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44da0e4a-821f-4ddf-9ef6-245248ef1666 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:07.897121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44da0e4a-821f-4ddf-9ef6-245248ef1666 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:07.897554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-44da0e4a-821f-4ddf-9ef6-245248ef1666 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:08.030174 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-44da0e4a-821f-4ddf-9ef6-245248ef1666 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1654 microversion: 2.1 time: 0.146755 Oct 11 20:27:08.030743 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3092/6230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:07 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:09.054448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1514c20a-6c65-4117-b516-25c649ba5470 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:09.055117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1514c20a-6c65-4117-b516-25c649ba5470 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:09.061995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1514c20a-6c65-4117-b516-25c649ba5470 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:09.062474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1514c20a-6c65-4117-b516-25c649ba5470 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:09.062939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1514c20a-6c65-4117-b516-25c649ba5470 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:09.063626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1514c20a-6c65-4117-b516-25c649ba5470 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:09.064768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1514c20a-6c65-4117-b516-25c649ba5470 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:09.065205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1514c20a-6c65-4117-b516-25c649ba5470 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:09.221303 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1514c20a-6c65-4117-b516-25c649ba5470 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 200 len: 1654 microversion: 2.1 time: 0.171200 Oct 11 20:27:09.221870 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3139/6231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:09 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 1654 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:09.619300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8d78187a-4679-4054-9bcc-3b0620023445 req-b5bf98ad-1240-41ab-85c7-042279db1bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8415108-c702-4392-b654-0ca3eb9a459f", "name": "network-vif-deleted", "tag": "345e0857-df88-4001-a75d-8c569761d572"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:27:09.632969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8d78187a-4679-4054-9bcc-3b0620023445 req-b5bf98ad-1240-41ab-85c7-042279db1bc1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:09.633778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8d78187a-4679-4054-9bcc-3b0620023445 req-b5bf98ad-1240-41ab-85c7-042279db1bc1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:09.634431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8d78187a-4679-4054-9bcc-3b0620023445 req-b5bf98ad-1240-41ab-85c7-042279db1bc1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:09.648599 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8d78187a-4679-4054-9bcc-3b0620023445 req-b5bf98ad-1240-41ab-85c7-042279db1bc1 service nova] Creating event network-vif-deleted:345e0857-df88-4001-a75d-8c569761d572 for instance c8415108-c702-4392-b654-0ca3eb9a459f on n-h2-860864-3 Oct 11 20:27:09.654701 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8d78187a-4679-4054-9bcc-3b0620023445 req-b5bf98ad-1240-41ab-85c7-042279db1bc1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038923 Oct 11 20:27:09.655468 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3093/6232] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:27:10.245038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:10.245646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: c8415108-c702-4392-b654-0ca3eb9a459f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:10.252422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:10.252901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:10.253334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:10.254008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:10.254456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:10.254899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:10.270391 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] HTTP exception thrown: Instance c8415108-c702-4392-b654-0ca3eb9a459f could not be found. Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Request method failure captured: Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f HTTP/1.1 Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdGAgsJT_l9fHjHONtc8TSFK2SBkTAmQkRYLsb674Cg24AIS3Hg3QOoCEFHdYphcGvMen9ifMJGdAZ1jTCRjkav2-n2FYO21huTl6OAwTQwEskX4M_x5E4FSvtp11pUKUZU5Y4osCluIBsa8EaB85OnOAumJ0ADhts0PCHpcWofHiWY Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: e5985e9625834f2d87aa09e031e41a74 Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestServerMultinode-748505175 Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5985e9625834f2d87aa09e031e41a74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5985e9625834f2d87aa09e031e41a74", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5985e9625834f2d87aa09e031e41a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5985e9625834f2d87aa09e031e41a74"}]}] Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestServerMultinode-748505175 Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: e5985e9625834f2d87aa09e031e41a74 Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestServerMultinode-748505175 Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestServerMultinode-748505175-project-admin Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 416a259a085c4fa2ad6ae75905c69481 Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestServerMultinode-748505175-project-admin Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance c8415108-c702-4392-b654-0ca3eb9a459f could not be found. Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'c8415108-c702-4392-b654-0ca3eb9a459f'} Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8415108-c702-4392-b654-0ca3eb9a459f could not be found. Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8415108-c702-4392-b654-0ca3eb9a459f could not be found. Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:27:10.272034 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:27:10.276287 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:27:10.276287 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:27:10.276287 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:27:10.276287 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:27:10.276287 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:27:10.276287 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8415108-c702-4392-b654-0ca3eb9a459f could not be found. Oct 11 20:27:10.276287 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:27:10.276287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Returning 404 to user: Instance c8415108-c702-4392-b654-0ca3eb9a459f could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:27:10.276287 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3ca9b0cc-bc68-4caf-80b8-dea57fee42fb tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f" status: 404 len: 111 microversion: 2.1 time: 0.032149 Oct 11 20:27:10.276287 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3140/6233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:10 2022] GET /compute/v2.1/servers/c8415108-c702-4392-b654-0ca3eb9a459f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:27:10.283267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7bbb453b-b581-4b40-af23-1918761f89b5 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:10.283831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7bbb453b-b581-4b40-af23-1918761f89b5 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:10.290117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7bbb453b-b581-4b40-af23-1918761f89b5 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:10.290826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7bbb453b-b581-4b40-af23-1918761f89b5 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:10.291383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7bbb453b-b581-4b40-af23-1918761f89b5 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:10.292106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7bbb453b-b581-4b40-af23-1918761f89b5 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:10.292585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7bbb453b-b581-4b40-af23-1918761f89b5 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:10.293065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7bbb453b-b581-4b40-af23-1918761f89b5 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:10.319154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7bbb453b-b581-4b40-af23-1918761f89b5 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:27:10.393643 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7bbb453b-b581-4b40-af23-1918761f89b5 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 204 len: 0 microversion: 2.1 time: 0.114878 Oct 11 20:27:10.394288 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3094/6234] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:27:10 2022] DELETE /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:27:10.402287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6f6921a2-8383-469b-9f53-bd62d79fdba6 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:10.402935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6f6921a2-8383-469b-9f53-bd62d79fdba6 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:10.416548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6921a2-8383-469b-9f53-bd62d79fdba6 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:10.417069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6921a2-8383-469b-9f53-bd62d79fdba6 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:10.417477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6921a2-8383-469b-9f53-bd62d79fdba6 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:10.418162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6921a2-8383-469b-9f53-bd62d79fdba6 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:10.418647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6921a2-8383-469b-9f53-bd62d79fdba6 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:10.419067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6f6921a2-8383-469b-9f53-bd62d79fdba6 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:10.548081 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6f6921a2-8383-469b-9f53-bd62d79fdba6 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1655 microversion: 2.1 time: 0.149410 Oct 11 20:27:10.548757 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3141/6235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:10 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:11.571707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-209075ba-8a65-4353-9063-cb835e54cf56 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:11.572416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-209075ba-8a65-4353-9063-cb835e54cf56 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:11.579274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-209075ba-8a65-4353-9063-cb835e54cf56 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:11.579770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-209075ba-8a65-4353-9063-cb835e54cf56 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:11.580221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-209075ba-8a65-4353-9063-cb835e54cf56 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:11.580919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-209075ba-8a65-4353-9063-cb835e54cf56 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:11.581385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-209075ba-8a65-4353-9063-cb835e54cf56 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:11.581821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-209075ba-8a65-4353-9063-cb835e54cf56 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:11.708550 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-209075ba-8a65-4353-9063-cb835e54cf56 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1655 microversion: 2.1 time: 0.140872 Oct 11 20:27:11.709121 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3095/6236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:11 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:12.227098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fdc40630-cf9e-40b1-9e36-59064cc68976 req-72fa3403-bb1d-4b8c-8a59-b2cea9702b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556dd04b-c9c1-43a0-a117-e9fe089e7b6d", "name": "network-vif-deleted", "tag": "5f997f10-ac4e-44f2-8d26-d51f29a73f36"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:27:12.240045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fdc40630-cf9e-40b1-9e36-59064cc68976 req-72fa3403-bb1d-4b8c-8a59-b2cea9702b49 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:12.240795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fdc40630-cf9e-40b1-9e36-59064cc68976 req-72fa3403-bb1d-4b8c-8a59-b2cea9702b49 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:12.241573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fdc40630-cf9e-40b1-9e36-59064cc68976 req-72fa3403-bb1d-4b8c-8a59-b2cea9702b49 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:12.255348 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fdc40630-cf9e-40b1-9e36-59064cc68976 req-72fa3403-bb1d-4b8c-8a59-b2cea9702b49 service nova] Creating event network-vif-deleted:5f997f10-ac4e-44f2-8d26-d51f29a73f36 for instance 556dd04b-c9c1-43a0-a117-e9fe089e7b6d on n-h1-860864-3 Oct 11 20:27:12.260515 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fdc40630-cf9e-40b1-9e36-59064cc68976 req-72fa3403-bb1d-4b8c-8a59-b2cea9702b49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037825 Oct 11 20:27:12.261797 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3142/6237] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:27:12.732197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:12.732840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:12.740386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:12.740882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:12.741327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:12.742030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:12.742547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:12.742984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:12.746999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:27:12.776710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:12.777212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:12.777661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:12.778124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lazy-loading 'fault' on Instance uuid 556dd04b-c9c1-43a0-a117-e9fe089e7b6d {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:27:12.826936 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bf77779d-e41c-4bb5-9f65-fd0b165cc5c2 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 200 len: 1454 microversion: 2.1 time: 0.098401 Oct 11 20:27:12.827507 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3096/6238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:12 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:27:13.851162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:13.851779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] [instance: 556dd04b-c9c1-43a0-a117-e9fe089e7b6d] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:13.858889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:13.859369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:13.859804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:13.860480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:13.860930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:13.861350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:13.874743 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] HTTP exception thrown: Instance 556dd04b-c9c1-43a0-a117-e9fe089e7b6d could not be found. Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Request method failure captured: Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d HTTP/1.1 Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdGAgsJT_l9fHjHONtc8TSFK2SBkTAmQkRYLsb674Cg24AIS3Hg3QOoCEFHdYphcGvMen9ifMJGdAZ1jTCRjkav2-n2FYO21huTl6OAwTQwEskX4M_x5E4FSvtp11pUKUZU5Y4osCluIBsa8EaB85OnOAumJ0ADhts0PCHpcWofHiWY Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: e5985e9625834f2d87aa09e031e41a74 Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestServerMultinode-748505175 Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5985e9625834f2d87aa09e031e41a74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5985e9625834f2d87aa09e031e41a74", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5985e9625834f2d87aa09e031e41a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5985e9625834f2d87aa09e031e41a74"}]}] Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestServerMultinode-748505175 Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: e5985e9625834f2d87aa09e031e41a74 Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestServerMultinode-748505175 Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestServerMultinode-748505175-project-admin Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 416a259a085c4fa2ad6ae75905c69481 Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestServerMultinode-748505175-project-admin Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 556dd04b-c9c1-43a0-a117-e9fe089e7b6d could not be found. Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '556dd04b-c9c1-43a0-a117-e9fe089e7b6d'} Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556dd04b-c9c1-43a0-a117-e9fe089e7b6d could not be found. Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556dd04b-c9c1-43a0-a117-e9fe089e7b6d could not be found. Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:27:13.876329 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:27:13.881571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:27:13.881571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:27:13.881571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:27:13.881571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:27:13.881571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:27:13.881571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556dd04b-c9c1-43a0-a117-e9fe089e7b6d could not be found. Oct 11 20:27:13.881571 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:27:13.881571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] Returning 404 to user: Instance 556dd04b-c9c1-43a0-a117-e9fe089e7b6d could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:27:13.881571 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dedc889a-637e-4405-ac82-213c7da6c113 tempest-TestServerMultinode-748505175 tempest-TestServerMultinode-748505175-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d" status: 404 len: 111 microversion: 2.1 time: 0.030690 Oct 11 20:27:13.881571 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3143/6239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:27:13 2022] GET /compute/v2.1/servers/556dd04b-c9c1-43a0-a117-e9fe089e7b6d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:27:41.677271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bbdeaa5e-66b4-4356-b5e2-cd647da13903 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:27:41.677772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bbdeaa5e-66b4-4356-b5e2-cd647da13903 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:27:41.680157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:27:41.681611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:27:41.687417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdeaa5e-66b4-4356-b5e2-cd647da13903 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:41.687915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdeaa5e-66b4-4356-b5e2-cd647da13903 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:41.688366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdeaa5e-66b4-4356-b5e2-cd647da13903 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:41.689063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdeaa5e-66b4-4356-b5e2-cd647da13903 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:27:41.689529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdeaa5e-66b4-4356-b5e2-cd647da13903 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:27:41.690021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbdeaa5e-66b4-4356-b5e2-cd647da13903 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:27:41.715316 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bbdeaa5e-66b4-4356-b5e2-cd647da13903 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042495 Oct 11 20:27:41.715892 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3097/6240] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 11 20:27:41 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:28:55.944943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:28:55.945690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:28:55.950656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-57bd67a7-e368-4083-baf0-d0a7047c7311 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:28:55.951145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-57bd67a7-e368-4083-baf0-d0a7047c7311 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:28:55.959780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57bd67a7-e368-4083-baf0-d0a7047c7311 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:55.960289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57bd67a7-e368-4083-baf0-d0a7047c7311 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:55.960718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57bd67a7-e368-4083-baf0-d0a7047c7311 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:55.961393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57bd67a7-e368-4083-baf0-d0a7047c7311 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:55.961841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57bd67a7-e368-4083-baf0-d0a7047c7311 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:55.962257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-57bd67a7-e368-4083-baf0-d0a7047c7311 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:55.989100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-57bd67a7-e368-4083-baf0-d0a7047c7311 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:28:56.065834 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-57bd67a7-e368-4083-baf0-d0a7047c7311 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 204 len: 0 microversion: 2.1 time: 0.122772 Oct 11 20:28:56.066432 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3144/6241] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:28:55 2022] DELETE /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:28:56.073082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:28:56.073901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:28:56.074880 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 11 20:28:56.079341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c8d94c86-f608-40fd-bf85-f16d15ae4aa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:28:56.080043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c8d94c86-f608-40fd-bf85-f16d15ae4aa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:28:56.087800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d94c86-f608-40fd-bf85-f16d15ae4aa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:56.088298 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d94c86-f608-40fd-bf85-f16d15ae4aa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:56.088745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d94c86-f608-40fd-bf85-f16d15ae4aa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:56.089445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d94c86-f608-40fd-bf85-f16d15ae4aa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:56.089913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d94c86-f608-40fd-bf85-f16d15ae4aa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:56.090348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c8d94c86-f608-40fd-bf85-f16d15ae4aa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:56.338697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c8d94c86-f608-40fd-bf85-f16d15ae4aa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:28:56.347489 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c8d94c86-f608-40fd-bf85-f16d15ae4aa6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1576 microversion: 2.1 time: 0.276218 Oct 11 20:28:56.348076 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3098/6242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:28:56 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1576 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:28:57.375563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-03608ba4-50d8-4ee1-b7b9-2af41b75bfd3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:28:57.376193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-03608ba4-50d8-4ee1-b7b9-2af41b75bfd3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:28:57.383894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03608ba4-50d8-4ee1-b7b9-2af41b75bfd3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:57.384381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03608ba4-50d8-4ee1-b7b9-2af41b75bfd3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:57.384818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03608ba4-50d8-4ee1-b7b9-2af41b75bfd3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:57.385499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03608ba4-50d8-4ee1-b7b9-2af41b75bfd3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:57.385962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03608ba4-50d8-4ee1-b7b9-2af41b75bfd3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:57.386382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-03608ba4-50d8-4ee1-b7b9-2af41b75bfd3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:57.580215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-03608ba4-50d8-4ee1-b7b9-2af41b75bfd3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:28:57.588011 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-03608ba4-50d8-4ee1-b7b9-2af41b75bfd3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1576 microversion: 2.1 time: 0.216847 Oct 11 20:28:57.588578 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3145/6243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:28:57 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:28:58.489410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-72183b8d-a134-4e97-a14c-bb22f1ffc0b1 req-935e2779-066e-4dac-82e3-9afba362e0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4993eb1-b6c0-4fdb-a47c-4e175639bb9e", "name": "network-vif-deleted", "tag": "5eca6ca2-0fbe-4182-9544-cef2e27cca4d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:28:58.503871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-72183b8d-a134-4e97-a14c-bb22f1ffc0b1 req-935e2779-066e-4dac-82e3-9afba362e0f2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:58.504375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-72183b8d-a134-4e97-a14c-bb22f1ffc0b1 req-935e2779-066e-4dac-82e3-9afba362e0f2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:58.504821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-72183b8d-a134-4e97-a14c-bb22f1ffc0b1 req-935e2779-066e-4dac-82e3-9afba362e0f2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:58.518964 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-72183b8d-a134-4e97-a14c-bb22f1ffc0b1 req-935e2779-066e-4dac-82e3-9afba362e0f2 service nova] Creating event network-vif-deleted:5eca6ca2-0fbe-4182-9544-cef2e27cca4d for instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e on n-h1-860864-3 Oct 11 20:28:58.524462 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-72183b8d-a134-4e97-a14c-bb22f1ffc0b1 req-935e2779-066e-4dac-82e3-9afba362e0f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039526 Oct 11 20:28:58.526218 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3099/6244] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:28:58.616318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e2f79a32-7e3e-4815-afed-ff7196aa980c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:28:58.617692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e2f79a32-7e3e-4815-afed-ff7196aa980c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:28:58.626679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f79a32-7e3e-4815-afed-ff7196aa980c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:58.643149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f79a32-7e3e-4815-afed-ff7196aa980c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:58.643806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f79a32-7e3e-4815-afed-ff7196aa980c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:58.644647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f79a32-7e3e-4815-afed-ff7196aa980c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:58.645183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f79a32-7e3e-4815-afed-ff7196aa980c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:58.645728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f79a32-7e3e-4815-afed-ff7196aa980c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:58.719346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e2f79a32-7e3e-4815-afed-ff7196aa980c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:28:58.730150 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e2f79a32-7e3e-4815-afed-ff7196aa980c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1225 microversion: 2.1 time: 0.123417 Oct 11 20:28:58.731472 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3146/6245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:28:58 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:28:59.753844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2969fd4d-54a3-482c-9136-a929c4cd8f13 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:28:59.754551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2969fd4d-54a3-482c-9136-a929c4cd8f13 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:28:59.762069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2969fd4d-54a3-482c-9136-a929c4cd8f13 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:59.762599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2969fd4d-54a3-482c-9136-a929c4cd8f13 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:59.763063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2969fd4d-54a3-482c-9136-a929c4cd8f13 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:59.763775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2969fd4d-54a3-482c-9136-a929c4cd8f13 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:28:59.764253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2969fd4d-54a3-482c-9136-a929c4cd8f13 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:28:59.764703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2969fd4d-54a3-482c-9136-a929c4cd8f13 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:28:59.831703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2969fd4d-54a3-482c-9136-a929c4cd8f13 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:28:59.839736 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2969fd4d-54a3-482c-9136-a929c4cd8f13 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1225 microversion: 2.1 time: 0.090347 Oct 11 20:28:59.840314 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3100/6246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:28:59 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:00.863845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11cb4114-3dbb-40f1-9ce4-87ec9e7cc06b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:00.864455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-11cb4114-3dbb-40f1-9ce4-87ec9e7cc06b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:00.871293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11cb4114-3dbb-40f1-9ce4-87ec9e7cc06b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:00.871776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11cb4114-3dbb-40f1-9ce4-87ec9e7cc06b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:00.872218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11cb4114-3dbb-40f1-9ce4-87ec9e7cc06b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:00.872907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11cb4114-3dbb-40f1-9ce4-87ec9e7cc06b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:00.873362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11cb4114-3dbb-40f1-9ce4-87ec9e7cc06b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:00.873786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11cb4114-3dbb-40f1-9ce4-87ec9e7cc06b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:00.938145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-11cb4114-3dbb-40f1-9ce4-87ec9e7cc06b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:00.946509 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-11cb4114-3dbb-40f1-9ce4-87ec9e7cc06b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1225 microversion: 2.1 time: 0.087136 Oct 11 20:29:00.947119 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3147/6247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:00 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:01.968826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-633e71e4-d5cf-4856-9325-79eac98c1c06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:01.969487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-633e71e4-d5cf-4856-9325-79eac98c1c06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:01.976784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-633e71e4-d5cf-4856-9325-79eac98c1c06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:01.977273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-633e71e4-d5cf-4856-9325-79eac98c1c06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:01.977718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-633e71e4-d5cf-4856-9325-79eac98c1c06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:01.978418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-633e71e4-d5cf-4856-9325-79eac98c1c06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:01.978921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-633e71e4-d5cf-4856-9325-79eac98c1c06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:01.979358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-633e71e4-d5cf-4856-9325-79eac98c1c06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:02.042204 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-633e71e4-d5cf-4856-9325-79eac98c1c06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:02.050139 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-633e71e4-d5cf-4856-9325-79eac98c1c06 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 200 len: 1225 microversion: 2.1 time: 0.085277 Oct 11 20:29:02.050745 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3101/6248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:01 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:03.073384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:03.074044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:03.081962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:03.082462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:03.083032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:03.083811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:03.084320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:03.084769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:03.101754 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e HTTP/1.1 Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'b4993eb1-b6c0-4fdb-a47c-4e175639bb9e'} Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:29:03.103450 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:29:03.107187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:29:03.107187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:29:03.107187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:29:03.107187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:29:03.107187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:29:03.107187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:29:03.107187 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:29:03.107187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:29:03.107187 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e39453e8-30bc-430e-b1cf-4a81cac4d25e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 404 len: 111 microversion: 2.1 time: 0.035580 Oct 11 20:29:03.107187 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3148/6249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:03 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:29:03.201618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-218409235", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-113237225", "security_groups": [{"name": "tempest-secgroup-smoke-1811756876"}], "block_device_mapping_v2": [{"uuid": "6ddc5e4e-9424-4ba7-8c5a-d4cb1f82667b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06296b2d-bf7f-4d21-bab0-dfde6b2c7622"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:29:03.316189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] validate_networks() for [('06296b2d-bf7f-4d21-bab0-dfde6b2c7622', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:29:03.691462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:29:03.691908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:29:03.692402 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:29:03.692838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:29:03.693269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:29:03.702216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:03.702768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:03.703227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:03.703974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:03.704456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:03.704908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:03.722258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:29:03.727618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for user cbcf07bc33104f78adbcd3dfa198a570 and project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:29:03.786958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:29:03.789574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ddc5e4e-9424-4ba7-8c5a-d4cb1f82667b',volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:29:03.919523 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2cead4f9-53dd-4575-82ba-db4df89fa915 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721804 Oct 11 20:29:03.920181 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3102/6250] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:29:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:29:03.931924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bba0caf3-3459-4115-935f-840f32e2fe7d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:03.932797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bba0caf3-3459-4115-935f-840f32e2fe7d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:03.990489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bba0caf3-3459-4115-935f-840f32e2fe7d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:03.998182 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bba0caf3-3459-4115-935f-840f32e2fe7d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1093 microversion: 2.1 time: 0.069981 Oct 11 20:29:03.999095 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3149/6251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:03 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:05.022390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-24393166-0357-467c-ab4c-23ef6d6f6a9d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:05.023061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-24393166-0357-467c-ab4c-23ef6d6f6a9d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:05.029469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24393166-0357-467c-ab4c-23ef6d6f6a9d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:05.029983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24393166-0357-467c-ab4c-23ef6d6f6a9d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:05.030700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24393166-0357-467c-ab4c-23ef6d6f6a9d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:05.031550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24393166-0357-467c-ab4c-23ef6d6f6a9d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:05.033501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24393166-0357-467c-ab4c-23ef6d6f6a9d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:05.033974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-24393166-0357-467c-ab4c-23ef6d6f6a9d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:05.420455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-24393166-0357-467c-ab4c-23ef6d6f6a9d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:05.429241 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-24393166-0357-467c-ab4c-23ef6d6f6a9d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1209 microversion: 2.1 time: 0.411946 Oct 11 20:29:05.429848 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3103/6252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:05 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1209 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:06.452543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40ba7089-ae48-4910-842d-1f0e044e5382 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:06.453328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-40ba7089-ae48-4910-842d-1f0e044e5382 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:06.461965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40ba7089-ae48-4910-842d-1f0e044e5382 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:06.462583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40ba7089-ae48-4910-842d-1f0e044e5382 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:06.463095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40ba7089-ae48-4910-842d-1f0e044e5382 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:06.464021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40ba7089-ae48-4910-842d-1f0e044e5382 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:06.464548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40ba7089-ae48-4910-842d-1f0e044e5382 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:06.465042 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40ba7089-ae48-4910-842d-1f0e044e5382 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:06.667639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-40ba7089-ae48-4910-842d-1f0e044e5382 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:06.679061 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40ba7089-ae48-4910-842d-1f0e044e5382 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1277 microversion: 2.1 time: 0.230371 Oct 11 20:29:06.679952 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3150/6253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:06 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:06.727071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ccd00dfc-50e1-4d10-b5cc-73d83a0f6911 req-5a84629e-9f9c-4107-88a3-1bcf1d58a1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3803a626-793a-402f-b547-dabc7c25582f", "tag": "92d15300-4a17-4dd1-b132-9488570668db"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:29:06.740082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ccd00dfc-50e1-4d10-b5cc-73d83a0f6911 req-5a84629e-9f9c-4107-88a3-1bcf1d58a1dc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:06.740735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ccd00dfc-50e1-4d10-b5cc-73d83a0f6911 req-5a84629e-9f9c-4107-88a3-1bcf1d58a1dc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:06.741202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ccd00dfc-50e1-4d10-b5cc-73d83a0f6911 req-5a84629e-9f9c-4107-88a3-1bcf1d58a1dc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:06.753166 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ccd00dfc-50e1-4d10-b5cc-73d83a0f6911 req-5a84629e-9f9c-4107-88a3-1bcf1d58a1dc service nova] Creating event network-changed:92d15300-4a17-4dd1-b132-9488570668db for instance 3803a626-793a-402f-b547-dabc7c25582f on n-h1-860864-3 Oct 11 20:29:06.759547 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ccd00dfc-50e1-4d10-b5cc-73d83a0f6911 req-5a84629e-9f9c-4107-88a3-1bcf1d58a1dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038651 Oct 11 20:29:06.760982 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3104/6254] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:29:07.702517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-26b6b784-c9cb-49a9-a383-623380bbe37e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:07.703085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-26b6b784-c9cb-49a9-a383-623380bbe37e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:07.710321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26b6b784-c9cb-49a9-a383-623380bbe37e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:07.710844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26b6b784-c9cb-49a9-a383-623380bbe37e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:07.711286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26b6b784-c9cb-49a9-a383-623380bbe37e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:07.711990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26b6b784-c9cb-49a9-a383-623380bbe37e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:07.712455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26b6b784-c9cb-49a9-a383-623380bbe37e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:07.712887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-26b6b784-c9cb-49a9-a383-623380bbe37e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:07.857890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-26b6b784-c9cb-49a9-a383-623380bbe37e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:07.866433 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-26b6b784-c9cb-49a9-a383-623380bbe37e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1277 microversion: 2.1 time: 0.167863 Oct 11 20:29:07.867045 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3151/6255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:07 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:08.889486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d9964131-3246-4283-9722-b92197264954 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:08.890200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d9964131-3246-4283-9722-b92197264954 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:08.898094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9964131-3246-4283-9722-b92197264954 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:08.898617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9964131-3246-4283-9722-b92197264954 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:08.899070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9964131-3246-4283-9722-b92197264954 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:08.899775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9964131-3246-4283-9722-b92197264954 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:08.900473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9964131-3246-4283-9722-b92197264954 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:08.900912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9964131-3246-4283-9722-b92197264954 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:09.046279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d9964131-3246-4283-9722-b92197264954 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:09.054348 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d9964131-3246-4283-9722-b92197264954 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1277 microversion: 2.1 time: 0.169144 Oct 11 20:29:09.054983 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3105/6256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:08 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:10.077789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7cc26068-553a-44a0-92be-cc77e1d29d81 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:10.078155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7cc26068-553a-44a0-92be-cc77e1d29d81 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:10.085498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cc26068-553a-44a0-92be-cc77e1d29d81 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:10.085990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cc26068-553a-44a0-92be-cc77e1d29d81 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:10.086454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cc26068-553a-44a0-92be-cc77e1d29d81 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:10.087179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cc26068-553a-44a0-92be-cc77e1d29d81 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:10.087639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cc26068-553a-44a0-92be-cc77e1d29d81 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:10.088066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cc26068-553a-44a0-92be-cc77e1d29d81 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:10.216976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7cc26068-553a-44a0-92be-cc77e1d29d81 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:10.224893 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7cc26068-553a-44a0-92be-cc77e1d29d81 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1265 microversion: 2.1 time: 0.151562 Oct 11 20:29:10.225473 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3152/6257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:10 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:11.248467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7190d090-201d-43a0-b463-81813fb78ffd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:11.249092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7190d090-201d-43a0-b463-81813fb78ffd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:11.256253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7190d090-201d-43a0-b463-81813fb78ffd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:11.256748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7190d090-201d-43a0-b463-81813fb78ffd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:11.257200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7190d090-201d-43a0-b463-81813fb78ffd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:11.257927 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7190d090-201d-43a0-b463-81813fb78ffd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:11.258397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7190d090-201d-43a0-b463-81813fb78ffd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:11.258867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7190d090-201d-43a0-b463-81813fb78ffd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:11.392566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7190d090-201d-43a0-b463-81813fb78ffd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:11.401396 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7190d090-201d-43a0-b463-81813fb78ffd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1265 microversion: 2.1 time: 0.156876 Oct 11 20:29:11.401965 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3106/6258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:11 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:12.424072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5d51a801-bc96-41d5-b029-8c9f65cbe921 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:12.424708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5d51a801-bc96-41d5-b029-8c9f65cbe921 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:12.432212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d51a801-bc96-41d5-b029-8c9f65cbe921 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:12.432698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d51a801-bc96-41d5-b029-8c9f65cbe921 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:12.433459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d51a801-bc96-41d5-b029-8c9f65cbe921 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:12.434316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d51a801-bc96-41d5-b029-8c9f65cbe921 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:12.434795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d51a801-bc96-41d5-b029-8c9f65cbe921 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:12.435215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d51a801-bc96-41d5-b029-8c9f65cbe921 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:12.565033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5d51a801-bc96-41d5-b029-8c9f65cbe921 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:12.572801 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5d51a801-bc96-41d5-b029-8c9f65cbe921 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1265 microversion: 2.1 time: 0.152627 Oct 11 20:29:12.573491 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3153/6259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:12 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:13.595476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-01510ce5-d7e6-48b2-b8ac-0bca2af376d7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:13.596108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-01510ce5-d7e6-48b2-b8ac-0bca2af376d7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:13.603704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01510ce5-d7e6-48b2-b8ac-0bca2af376d7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:13.604211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01510ce5-d7e6-48b2-b8ac-0bca2af376d7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:13.604671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01510ce5-d7e6-48b2-b8ac-0bca2af376d7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:13.605383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01510ce5-d7e6-48b2-b8ac-0bca2af376d7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:13.605865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01510ce5-d7e6-48b2-b8ac-0bca2af376d7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:13.606307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-01510ce5-d7e6-48b2-b8ac-0bca2af376d7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:13.713288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:29:13.733964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:29:13.738470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-01510ce5-d7e6-48b2-b8ac-0bca2af376d7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:13.746488 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-01510ce5-d7e6-48b2-b8ac-0bca2af376d7 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1265 microversion: 2.1 time: 0.154964 Oct 11 20:29:13.747099 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3107/6260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:13 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:14.770098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3f14a120-d3fa-40b2-916c-4f6d78992ad3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:14.770755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3f14a120-d3fa-40b2-916c-4f6d78992ad3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:14.773327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:29:14.778952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f14a120-d3fa-40b2-916c-4f6d78992ad3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:14.779434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f14a120-d3fa-40b2-916c-4f6d78992ad3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:14.779866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f14a120-d3fa-40b2-916c-4f6d78992ad3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:14.780543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f14a120-d3fa-40b2-916c-4f6d78992ad3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:14.780996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f14a120-d3fa-40b2-916c-4f6d78992ad3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:14.781415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3f14a120-d3fa-40b2-916c-4f6d78992ad3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:14.915309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3f14a120-d3fa-40b2-916c-4f6d78992ad3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:14.922994 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3f14a120-d3fa-40b2-916c-4f6d78992ad3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1265 microversion: 2.1 time: 0.157353 Oct 11 20:29:14.923563 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3154/6261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:14 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:15.946266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ceacfab-fb33-4f7c-b1bc-ad123b05702f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:15.946910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7ceacfab-fb33-4f7c-b1bc-ad123b05702f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:15.953735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ceacfab-fb33-4f7c-b1bc-ad123b05702f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:15.954231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ceacfab-fb33-4f7c-b1bc-ad123b05702f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:15.954716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ceacfab-fb33-4f7c-b1bc-ad123b05702f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:15.955414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ceacfab-fb33-4f7c-b1bc-ad123b05702f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:15.955879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ceacfab-fb33-4f7c-b1bc-ad123b05702f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:15.957062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ceacfab-fb33-4f7c-b1bc-ad123b05702f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:16.087789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7ceacfab-fb33-4f7c-b1bc-ad123b05702f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:16.095558 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7ceacfab-fb33-4f7c-b1bc-ad123b05702f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1265 microversion: 2.1 time: 0.153270 Oct 11 20:29:16.096127 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3108/6262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:15 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:17.117801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3e7226ad-3195-43d7-b405-55b72c1294b0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:17.118417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3e7226ad-3195-43d7-b405-55b72c1294b0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:17.125087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7226ad-3195-43d7-b405-55b72c1294b0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:17.125575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7226ad-3195-43d7-b405-55b72c1294b0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:17.126014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7226ad-3195-43d7-b405-55b72c1294b0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:17.126733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7226ad-3195-43d7-b405-55b72c1294b0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:17.127190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7226ad-3195-43d7-b405-55b72c1294b0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:17.127616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e7226ad-3195-43d7-b405-55b72c1294b0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:17.265549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3e7226ad-3195-43d7-b405-55b72c1294b0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:17.273441 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3e7226ad-3195-43d7-b405-55b72c1294b0 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1265 microversion: 2.1 time: 0.159506 Oct 11 20:29:17.274018 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3155/6263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:17 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:18.296274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d9b356ce-1607-48de-9fe4-a27cc5126edd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:18.296896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d9b356ce-1607-48de-9fe4-a27cc5126edd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:18.303899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9b356ce-1607-48de-9fe4-a27cc5126edd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:18.304400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9b356ce-1607-48de-9fe4-a27cc5126edd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:18.304853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9b356ce-1607-48de-9fe4-a27cc5126edd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:18.305557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9b356ce-1607-48de-9fe4-a27cc5126edd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:18.306038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9b356ce-1607-48de-9fe4-a27cc5126edd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:18.306518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d9b356ce-1607-48de-9fe4-a27cc5126edd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:18.439361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d9b356ce-1607-48de-9fe4-a27cc5126edd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:18.447183 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d9b356ce-1607-48de-9fe4-a27cc5126edd tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1265 microversion: 2.1 time: 0.154871 Oct 11 20:29:18.447758 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3109/6264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:18 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:19.469265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0f7ae4fe-01e1-44a8-a3c2-3a3729780cfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:19.469911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0f7ae4fe-01e1-44a8-a3c2-3a3729780cfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:19.476856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f7ae4fe-01e1-44a8-a3c2-3a3729780cfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:19.477337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f7ae4fe-01e1-44a8-a3c2-3a3729780cfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:19.477772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f7ae4fe-01e1-44a8-a3c2-3a3729780cfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:19.478458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f7ae4fe-01e1-44a8-a3c2-3a3729780cfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:19.478937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f7ae4fe-01e1-44a8-a3c2-3a3729780cfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:19.479364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0f7ae4fe-01e1-44a8-a3c2-3a3729780cfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:19.615288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0f7ae4fe-01e1-44a8-a3c2-3a3729780cfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:19.622992 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0f7ae4fe-01e1-44a8-a3c2-3a3729780cfb tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1265 microversion: 2.1 time: 0.157593 Oct 11 20:29:19.623596 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3156/6265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:19 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:29:19.943434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8ed8e272-8cac-4ebc-84d9-3d9e30a8627f req-03b816e3-e332-419f-a34e-b70c7ed59916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3803a626-793a-402f-b547-dabc7c25582f", "name": "network-vif-plugged", "status": "completed", "tag": "92d15300-4a17-4dd1-b132-9488570668db"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:29:19.954241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8ed8e272-8cac-4ebc-84d9-3d9e30a8627f req-03b816e3-e332-419f-a34e-b70c7ed59916 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:19.954776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8ed8e272-8cac-4ebc-84d9-3d9e30a8627f req-03b816e3-e332-419f-a34e-b70c7ed59916 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:19.955234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8ed8e272-8cac-4ebc-84d9-3d9e30a8627f req-03b816e3-e332-419f-a34e-b70c7ed59916 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:19.967789 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8ed8e272-8cac-4ebc-84d9-3d9e30a8627f req-03b816e3-e332-419f-a34e-b70c7ed59916 service nova] Creating event network-vif-plugged:92d15300-4a17-4dd1-b132-9488570668db for instance 3803a626-793a-402f-b547-dabc7c25582f on n-h1-860864-3 Oct 11 20:29:19.973341 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8ed8e272-8cac-4ebc-84d9-3d9e30a8627f req-03b816e3-e332-419f-a34e-b70c7ed59916 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034273 Oct 11 20:29:19.973948 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3110/6266] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:29:20.645759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-af105c32-ebce-4342-a31f-5e32ef57a295 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:20.646369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-af105c32-ebce-4342-a31f-5e32ef57a295 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:20.653194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af105c32-ebce-4342-a31f-5e32ef57a295 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:20.653674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af105c32-ebce-4342-a31f-5e32ef57a295 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:20.654107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af105c32-ebce-4342-a31f-5e32ef57a295 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:20.654817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af105c32-ebce-4342-a31f-5e32ef57a295 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:20.655266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af105c32-ebce-4342-a31f-5e32ef57a295 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:20.655684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af105c32-ebce-4342-a31f-5e32ef57a295 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:20.785401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-af105c32-ebce-4342-a31f-5e32ef57a295 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:20.793145 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-af105c32-ebce-4342-a31f-5e32ef57a295 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1265 microversion: 2.1 time: 0.151568 Oct 11 20:29:20.793723 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3157/6267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:20 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:21.817755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cf84e6cc-83b9-460c-b598-f939a0a09590 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:21.818470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cf84e6cc-83b9-460c-b598-f939a0a09590 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:21.824870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf84e6cc-83b9-460c-b598-f939a0a09590 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:21.825374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf84e6cc-83b9-460c-b598-f939a0a09590 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:21.825829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf84e6cc-83b9-460c-b598-f939a0a09590 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:21.826560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf84e6cc-83b9-460c-b598-f939a0a09590 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:21.827047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf84e6cc-83b9-460c-b598-f939a0a09590 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:21.827492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf84e6cc-83b9-460c-b598-f939a0a09590 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:21.962121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cf84e6cc-83b9-460c-b598-f939a0a09590 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:21.969946 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cf84e6cc-83b9-460c-b598-f939a0a09590 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1451 microversion: 2.1 time: 0.157948 Oct 11 20:29:21.970541 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3111/6268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:21 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:21.992392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-41a056b2-565a-429d-afcb-a92f647a9646 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:29:21.993022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-41a056b2-565a-429d-afcb-a92f647a9646 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:29:21.999827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41a056b2-565a-429d-afcb-a92f647a9646 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:22.000336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41a056b2-565a-429d-afcb-a92f647a9646 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:22.000772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41a056b2-565a-429d-afcb-a92f647a9646 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:22.001448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41a056b2-565a-429d-afcb-a92f647a9646 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:22.001908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41a056b2-565a-429d-afcb-a92f647a9646 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:22.002326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-41a056b2-565a-429d-afcb-a92f647a9646 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:22.133935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-41a056b2-565a-429d-afcb-a92f647a9646 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:29:22.141656 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-41a056b2-565a-429d-afcb-a92f647a9646 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1451 microversion: 2.1 time: 0.153159 Oct 11 20:29:22.142224 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3158/6269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:29:21 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:29:24.051091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-84b3e93a-38f7-4201-876a-da476b5ac44d req-1f62cf3d-615d-4eab-8ee7-dc1abf351743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3803a626-793a-402f-b547-dabc7c25582f", "tag": "92d15300-4a17-4dd1-b132-9488570668db"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:29:24.069153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-84b3e93a-38f7-4201-876a-da476b5ac44d req-1f62cf3d-615d-4eab-8ee7-dc1abf351743 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:29:24.069656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-84b3e93a-38f7-4201-876a-da476b5ac44d req-1f62cf3d-615d-4eab-8ee7-dc1abf351743 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:29:24.070110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-84b3e93a-38f7-4201-876a-da476b5ac44d req-1f62cf3d-615d-4eab-8ee7-dc1abf351743 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:29:24.085211 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-84b3e93a-38f7-4201-876a-da476b5ac44d req-1f62cf3d-615d-4eab-8ee7-dc1abf351743 service nova] Creating event network-changed:92d15300-4a17-4dd1-b132-9488570668db for instance 3803a626-793a-402f-b547-dabc7c25582f on n-h1-860864-3 Oct 11 20:29:24.090380 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-84b3e93a-38f7-4201-876a-da476b5ac44d req-1f62cf3d-615d-4eab-8ee7-dc1abf351743 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043570 Oct 11 20:29:24.091234 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3112/6270] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:31:02.546821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:02.547761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:02.548983 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:31:02.549122 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:31:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 11 20:31:02.550466 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:31:02.550621 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:31:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 11 20:31:02.556024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-541510116", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-113237225", "security_groups": [{"name": "tempest-secgroup-smoke-1811756876"}], "block_device_mapping_v2": [{"uuid": "442e5d14-3740-41da-bd46-4d033f2d4367", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06296b2d-bf7f-4d21-bab0-dfde6b2c7622"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:31:02.678087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] validate_networks() for [('06296b2d-bf7f-4d21-bab0-dfde6b2c7622', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:31:03.417637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:31:03.418067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:31:03.418584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:31:03.419023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:31:03.419434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:31:03.428314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:03.428797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:03.429234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:03.430555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:03.431021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:03.431450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:03.449196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:31:03.454395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Getting quotas for user cbcf07bc33104f78adbcd3dfa198a570 and project 563ad430e2af4c469e0a0afa967d580e. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:31:03.512335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:31:03.514474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='442e5d14-3740-41da-bd46-4d033f2d4367',volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:31:03.641372 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2edcc4a8-7675-4c66-bcf1-557fa7bf79d4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.096435 Oct 11 20:31:03.642356 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3159/6271] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:31:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:31:03.651502 n-d-860864-3 devstack@n-api.service[126955]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0fc4d99-c6db-4dc7-baac-a9ae8040cf98] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 20:31:03.652331 n-d-860864-3 devstack@n-api.service[126955]: ERROR oslo.messaging._drivers.impl_rabbit [-] [40238a9c-3606-4385-94b6-ee4512c24920] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 20:31:03.652960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:03.653804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=70 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:03.659762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c746303e-da93-4a8c-bbd6-10e7cfe50289 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:03.660482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c746303e-da93-4a8c-bbd6-10e7cfe50289 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:03.717389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c746303e-da93-4a8c-bbd6-10e7cfe50289 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:03.724755 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c746303e-da93-4a8c-bbd6-10e7cfe50289 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1093 microversion: 2.1 time: 0.074906 Oct 11 20:31:03.725383 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3113/6272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:03 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:04.751391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f68096f2-18b6-447f-9ad8-c0c16e546efe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:04.751990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f68096f2-18b6-447f-9ad8-c0c16e546efe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:04.759587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f68096f2-18b6-447f-9ad8-c0c16e546efe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:04.760086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f68096f2-18b6-447f-9ad8-c0c16e546efe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:04.760526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f68096f2-18b6-447f-9ad8-c0c16e546efe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:04.761539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f68096f2-18b6-447f-9ad8-c0c16e546efe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:04.762005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f68096f2-18b6-447f-9ad8-c0c16e546efe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:04.762437 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f68096f2-18b6-447f-9ad8-c0c16e546efe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:04.847893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f68096f2-18b6-447f-9ad8-c0c16e546efe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:04.857852 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f68096f2-18b6-447f-9ad8-c0c16e546efe tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1209 microversion: 2.1 time: 0.112077 Oct 11 20:31:04.859047 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3160/6273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:04 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:05.881451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-09825e4f-1457-4a98-819b-80ce437ba751 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:05.882081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-09825e4f-1457-4a98-819b-80ce437ba751 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:05.893831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09825e4f-1457-4a98-819b-80ce437ba751 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:05.894331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09825e4f-1457-4a98-819b-80ce437ba751 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:05.894811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09825e4f-1457-4a98-819b-80ce437ba751 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:05.895719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09825e4f-1457-4a98-819b-80ce437ba751 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:05.896343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09825e4f-1457-4a98-819b-80ce437ba751 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:05.896957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-09825e4f-1457-4a98-819b-80ce437ba751 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:05.904709 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] [40238a9c-3606-4385-94b6-ee4512c24920] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40662. Oct 11 20:31:05.921131 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0fc4d99-c6db-4dc7-baac-a9ae8040cf98] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40660. Oct 11 20:31:06.119809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-09825e4f-1457-4a98-819b-80ce437ba751 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:06.128522 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-09825e4f-1457-4a98-819b-80ce437ba751 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1277 microversion: 2.1 time: 0.251050 Oct 11 20:31:06.129194 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3114/6274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:05 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1277 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:06.349021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-836eac5a-d539-471c-a514-ee9336d85d57 req-edc8f66a-2552-4317-b6fc-3bf2053a9a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26612e1f-5b2b-47a2-a9b4-0553414c6acd", "tag": "372e79ab-76be-491b-936d-7e610da507f1"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:31:06.367486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-836eac5a-d539-471c-a514-ee9336d85d57 req-edc8f66a-2552-4317-b6fc-3bf2053a9a04 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:06.367893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-836eac5a-d539-471c-a514-ee9336d85d57 req-edc8f66a-2552-4317-b6fc-3bf2053a9a04 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:06.368329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-836eac5a-d539-471c-a514-ee9336d85d57 req-edc8f66a-2552-4317-b6fc-3bf2053a9a04 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:06.380042 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-836eac5a-d539-471c-a514-ee9336d85d57 req-edc8f66a-2552-4317-b6fc-3bf2053a9a04 service nova] Creating event network-changed:372e79ab-76be-491b-936d-7e610da507f1 for instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd on n-h1-860864-3 Oct 11 20:31:06.385413 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-836eac5a-d539-471c-a514-ee9336d85d57 req-edc8f66a-2552-4317-b6fc-3bf2053a9a04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123125 Oct 11 20:31:06.386361 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3161/6275] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:31:07.151811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4d4073b8-6f65-4b3e-81d4-b23d2e138aea tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:07.152443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4d4073b8-6f65-4b3e-81d4-b23d2e138aea tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:07.159973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d4073b8-6f65-4b3e-81d4-b23d2e138aea tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:07.160100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d4073b8-6f65-4b3e-81d4-b23d2e138aea tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:07.160801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d4073b8-6f65-4b3e-81d4-b23d2e138aea tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:07.161251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d4073b8-6f65-4b3e-81d4-b23d2e138aea tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:07.161729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d4073b8-6f65-4b3e-81d4-b23d2e138aea tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:07.162171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d4073b8-6f65-4b3e-81d4-b23d2e138aea tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:07.322396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4d4073b8-6f65-4b3e-81d4-b23d2e138aea tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:07.330604 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4d4073b8-6f65-4b3e-81d4-b23d2e138aea tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1277 microversion: 2.1 time: 0.183184 Oct 11 20:31:07.331203 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3115/6276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:07 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:08.355972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c3cf190-7263-4ea8-9d55-e8cc0ba2f767 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:08.356773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c3cf190-7263-4ea8-9d55-e8cc0ba2f767 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:08.364337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c3cf190-7263-4ea8-9d55-e8cc0ba2f767 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:08.364829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c3cf190-7263-4ea8-9d55-e8cc0ba2f767 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:08.365278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c3cf190-7263-4ea8-9d55-e8cc0ba2f767 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:08.366011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c3cf190-7263-4ea8-9d55-e8cc0ba2f767 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:08.366467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c3cf190-7263-4ea8-9d55-e8cc0ba2f767 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:08.366919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c3cf190-7263-4ea8-9d55-e8cc0ba2f767 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:08.511564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1c3cf190-7263-4ea8-9d55-e8cc0ba2f767 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:08.519529 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c3cf190-7263-4ea8-9d55-e8cc0ba2f767 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1277 microversion: 2.1 time: 0.168132 Oct 11 20:31:08.520199 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3162/6277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:08 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:09.545775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fc265412-673f-440a-9b0d-e6f17edb3762 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:09.546916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fc265412-673f-440a-9b0d-e6f17edb3762 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:09.559400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc265412-673f-440a-9b0d-e6f17edb3762 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:09.560291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc265412-673f-440a-9b0d-e6f17edb3762 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:09.561152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc265412-673f-440a-9b0d-e6f17edb3762 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:09.562414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc265412-673f-440a-9b0d-e6f17edb3762 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:09.563333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc265412-673f-440a-9b0d-e6f17edb3762 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:09.564337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fc265412-673f-440a-9b0d-e6f17edb3762 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:09.729769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fc265412-673f-440a-9b0d-e6f17edb3762 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:09.738473 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fc265412-673f-440a-9b0d-e6f17edb3762 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1277 microversion: 2.1 time: 0.199862 Oct 11 20:31:09.739055 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3116/6278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:09 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:10.761591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-303b72de-9ba3-46d0-8588-d1e60216274d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:10.762199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-303b72de-9ba3-46d0-8588-d1e60216274d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:10.770216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-303b72de-9ba3-46d0-8588-d1e60216274d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:10.770788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-303b72de-9ba3-46d0-8588-d1e60216274d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:10.771246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-303b72de-9ba3-46d0-8588-d1e60216274d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:10.772025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-303b72de-9ba3-46d0-8588-d1e60216274d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:10.772521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-303b72de-9ba3-46d0-8588-d1e60216274d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:10.772985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-303b72de-9ba3-46d0-8588-d1e60216274d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:10.909234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-303b72de-9ba3-46d0-8588-d1e60216274d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:10.917566 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-303b72de-9ba3-46d0-8588-d1e60216274d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1265 microversion: 2.1 time: 0.160186 Oct 11 20:31:10.918137 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3163/6279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:10 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:11.940888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b3190f4-4fa6-4285-bc11-64bdb0f0e056 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:11.941514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b3190f4-4fa6-4285-bc11-64bdb0f0e056 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:11.949373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3190f4-4fa6-4285-bc11-64bdb0f0e056 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:11.949873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3190f4-4fa6-4285-bc11-64bdb0f0e056 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:11.950327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3190f4-4fa6-4285-bc11-64bdb0f0e056 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:11.951056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3190f4-4fa6-4285-bc11-64bdb0f0e056 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:11.951530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3190f4-4fa6-4285-bc11-64bdb0f0e056 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:11.951972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b3190f4-4fa6-4285-bc11-64bdb0f0e056 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:12.081897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b3190f4-4fa6-4285-bc11-64bdb0f0e056 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:12.090680 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b3190f4-4fa6-4285-bc11-64bdb0f0e056 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1265 microversion: 2.1 time: 0.154026 Oct 11 20:31:12.091256 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3117/6280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:11 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:13.114804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6053715-3919-408a-80c5-d10581fc5571 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:13.115414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6053715-3919-408a-80c5-d10581fc5571 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:13.122600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6053715-3919-408a-80c5-d10581fc5571 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:13.123079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6053715-3919-408a-80c5-d10581fc5571 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:13.123510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6053715-3919-408a-80c5-d10581fc5571 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:13.124186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6053715-3919-408a-80c5-d10581fc5571 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:13.124641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6053715-3919-408a-80c5-d10581fc5571 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:13.125059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6053715-3919-408a-80c5-d10581fc5571 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:13.258553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6053715-3919-408a-80c5-d10581fc5571 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:13.266169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6053715-3919-408a-80c5-d10581fc5571 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1265 microversion: 2.1 time: 0.155851 Oct 11 20:31:13.266775 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3164/6281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:13 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:14.289047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cf9fe4b4-c360-42a6-9521-a122b1020dc6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:14.289701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cf9fe4b4-c360-42a6-9521-a122b1020dc6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:14.292486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:14.298083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf9fe4b4-c360-42a6-9521-a122b1020dc6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:14.298615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf9fe4b4-c360-42a6-9521-a122b1020dc6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:14.299074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf9fe4b4-c360-42a6-9521-a122b1020dc6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:14.299784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf9fe4b4-c360-42a6-9521-a122b1020dc6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:14.300261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf9fe4b4-c360-42a6-9521-a122b1020dc6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:14.300706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cf9fe4b4-c360-42a6-9521-a122b1020dc6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:14.433080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-cf9fe4b4-c360-42a6-9521-a122b1020dc6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:14.441130 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cf9fe4b4-c360-42a6-9521-a122b1020dc6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1265 microversion: 2.1 time: 0.156015 Oct 11 20:31:14.441726 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3118/6282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:14 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:15.465037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-316a3a6d-1150-4402-a6e6-cd486a4a0902 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:15.465652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-316a3a6d-1150-4402-a6e6-cd486a4a0902 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:15.467622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:15.468402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:15.475014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-316a3a6d-1150-4402-a6e6-cd486a4a0902 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:15.475500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-316a3a6d-1150-4402-a6e6-cd486a4a0902 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:15.475934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-316a3a6d-1150-4402-a6e6-cd486a4a0902 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:15.476645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-316a3a6d-1150-4402-a6e6-cd486a4a0902 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:15.478186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-316a3a6d-1150-4402-a6e6-cd486a4a0902 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:15.478649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-316a3a6d-1150-4402-a6e6-cd486a4a0902 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:15.613229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-316a3a6d-1150-4402-a6e6-cd486a4a0902 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:15.621858 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-316a3a6d-1150-4402-a6e6-cd486a4a0902 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1265 microversion: 2.1 time: 0.161489 Oct 11 20:31:15.622403 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3165/6283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:15 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:16.645144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-29615197-a4d2-40c6-aaf9-ac46ca0e23b6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:16.645806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-29615197-a4d2-40c6-aaf9-ac46ca0e23b6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:16.652799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29615197-a4d2-40c6-aaf9-ac46ca0e23b6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:16.653312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29615197-a4d2-40c6-aaf9-ac46ca0e23b6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:16.653772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29615197-a4d2-40c6-aaf9-ac46ca0e23b6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:16.654488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29615197-a4d2-40c6-aaf9-ac46ca0e23b6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:16.655001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29615197-a4d2-40c6-aaf9-ac46ca0e23b6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:16.655501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-29615197-a4d2-40c6-aaf9-ac46ca0e23b6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:16.792698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-29615197-a4d2-40c6-aaf9-ac46ca0e23b6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:16.800915 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-29615197-a4d2-40c6-aaf9-ac46ca0e23b6 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1265 microversion: 2.1 time: 0.159845 Oct 11 20:31:16.801491 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3119/6284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:16 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:17.825151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb8e0f6d-a714-4d6a-99d3-a93ae87d019b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:17.825794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eb8e0f6d-a714-4d6a-99d3-a93ae87d019b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:17.832628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb8e0f6d-a714-4d6a-99d3-a93ae87d019b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:17.833114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb8e0f6d-a714-4d6a-99d3-a93ae87d019b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:17.833551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb8e0f6d-a714-4d6a-99d3-a93ae87d019b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:17.834232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb8e0f6d-a714-4d6a-99d3-a93ae87d019b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:17.834717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb8e0f6d-a714-4d6a-99d3-a93ae87d019b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:17.835141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb8e0f6d-a714-4d6a-99d3-a93ae87d019b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:17.964001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb8e0f6d-a714-4d6a-99d3-a93ae87d019b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:17.971734 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb8e0f6d-a714-4d6a-99d3-a93ae87d019b tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1265 microversion: 2.1 time: 0.151181 Oct 11 20:31:17.972306 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3166/6285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:17 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:18.366251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-bc0c32bd-0b2e-40f5-9699-2e34ff678745 req-66b16e0c-cfba-401d-8c42-f28c809d813f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26612e1f-5b2b-47a2-a9b4-0553414c6acd", "name": "network-vif-plugged", "status": "completed", "tag": "372e79ab-76be-491b-936d-7e610da507f1"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:31:18.376607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bc0c32bd-0b2e-40f5-9699-2e34ff678745 req-66b16e0c-cfba-401d-8c42-f28c809d813f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:18.377300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bc0c32bd-0b2e-40f5-9699-2e34ff678745 req-66b16e0c-cfba-401d-8c42-f28c809d813f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:18.377742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bc0c32bd-0b2e-40f5-9699-2e34ff678745 req-66b16e0c-cfba-401d-8c42-f28c809d813f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:18.389211 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-bc0c32bd-0b2e-40f5-9699-2e34ff678745 req-66b16e0c-cfba-401d-8c42-f28c809d813f service nova] Creating event network-vif-plugged:372e79ab-76be-491b-936d-7e610da507f1 for instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd on n-h1-860864-3 Oct 11 20:31:18.394016 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-bc0c32bd-0b2e-40f5-9699-2e34ff678745 req-66b16e0c-cfba-401d-8c42-f28c809d813f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102046 Oct 11 20:31:18.394643 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3120/6286] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:31:18.993223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ee1ba570-e8df-4be1-b62b-ac08ace72640 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:18.993842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ee1ba570-e8df-4be1-b62b-ac08ace72640 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:19.000705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee1ba570-e8df-4be1-b62b-ac08ace72640 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:19.001180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee1ba570-e8df-4be1-b62b-ac08ace72640 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:19.001611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee1ba570-e8df-4be1-b62b-ac08ace72640 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:19.002282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee1ba570-e8df-4be1-b62b-ac08ace72640 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:19.002871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee1ba570-e8df-4be1-b62b-ac08ace72640 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:19.003293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ee1ba570-e8df-4be1-b62b-ac08ace72640 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:19.131837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ee1ba570-e8df-4be1-b62b-ac08ace72640 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:19.139544 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ee1ba570-e8df-4be1-b62b-ac08ace72640 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1265 microversion: 2.1 time: 0.150246 Oct 11 20:31:19.140115 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3167/6287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:18 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:20.163847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b4d0b729-234b-4560-8c31-5c4956ecce0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:20.164558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b4d0b729-234b-4560-8c31-5c4956ecce0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:20.171660 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4d0b729-234b-4560-8c31-5c4956ecce0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:20.172160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4d0b729-234b-4560-8c31-5c4956ecce0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:20.172605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4d0b729-234b-4560-8c31-5c4956ecce0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:20.173302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4d0b729-234b-4560-8c31-5c4956ecce0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:20.173767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4d0b729-234b-4560-8c31-5c4956ecce0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:20.174198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b4d0b729-234b-4560-8c31-5c4956ecce0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:20.310742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b4d0b729-234b-4560-8c31-5c4956ecce0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:20.319073 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b4d0b729-234b-4560-8c31-5c4956ecce0c tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1451 microversion: 2.1 time: 0.160310 Oct 11 20:31:20.319657 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3121/6288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:20 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:20.341573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-81f8b497-6da4-44fd-8b0b-6e435a5844ec tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:20.342177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-81f8b497-6da4-44fd-8b0b-6e435a5844ec tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:20.348946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81f8b497-6da4-44fd-8b0b-6e435a5844ec tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:20.349425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81f8b497-6da4-44fd-8b0b-6e435a5844ec tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:20.349855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81f8b497-6da4-44fd-8b0b-6e435a5844ec tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:20.350556 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81f8b497-6da4-44fd-8b0b-6e435a5844ec tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:20.351004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81f8b497-6da4-44fd-8b0b-6e435a5844ec tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:20.351422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-81f8b497-6da4-44fd-8b0b-6e435a5844ec tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:20.487326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-81f8b497-6da4-44fd-8b0b-6e435a5844ec tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:20.495622 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-81f8b497-6da4-44fd-8b0b-6e435a5844ec tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1451 microversion: 2.1 time: 0.158618 Oct 11 20:31:20.496190 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3168/6289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:20 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:22.158195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-621bb730-54f3-49c1-a94b-999bf584bd61 req-3f8078c4-c68c-4f4c-8f72-df5a00a05f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26612e1f-5b2b-47a2-a9b4-0553414c6acd", "tag": "372e79ab-76be-491b-936d-7e610da507f1"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:31:22.168445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-621bb730-54f3-49c1-a94b-999bf584bd61 req-3f8078c4-c68c-4f4c-8f72-df5a00a05f08 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:22.168941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-621bb730-54f3-49c1-a94b-999bf584bd61 req-3f8078c4-c68c-4f4c-8f72-df5a00a05f08 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:22.169390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-621bb730-54f3-49c1-a94b-999bf584bd61 req-3f8078c4-c68c-4f4c-8f72-df5a00a05f08 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:22.180617 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-621bb730-54f3-49c1-a94b-999bf584bd61 req-3f8078c4-c68c-4f4c-8f72-df5a00a05f08 service nova] Creating event network-changed:372e79ab-76be-491b-936d-7e610da507f1 for instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd on n-h1-860864-3 Oct 11 20:31:22.185531 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-621bb730-54f3-49c1-a94b-999bf584bd61 req-3f8078c4-c68c-4f4c-8f72-df5a00a05f08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095652 Oct 11 20:31:22.186127 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3122/6290] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:31:45.189319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-33a80e45-5c7f-4581-a349-949a6de1c6e6 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:45.189867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-33a80e45-5c7f-4581-a349-949a6de1c6e6 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:45.192078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:45.192728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=52 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:45.199702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a80e45-5c7f-4581-a349-949a6de1c6e6 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:45.200276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a80e45-5c7f-4581-a349-949a6de1c6e6 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:45.200681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a80e45-5c7f-4581-a349-949a6de1c6e6 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:45.201379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a80e45-5c7f-4581-a349-949a6de1c6e6 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:45.201837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a80e45-5c7f-4581-a349-949a6de1c6e6 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:45.202261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-33a80e45-5c7f-4581-a349-949a6de1c6e6 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:45.230154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-33a80e45-5c7f-4581-a349-949a6de1c6e6 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:31:45.313080 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-33a80e45-5c7f-4581-a349-949a6de1c6e6 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 204 len: 0 microversion: 2.1 time: 0.128361 Oct 11 20:31:45.314561 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3169/6291] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:31:45 2022] DELETE /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:31:45.321182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=22 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:45.322371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=46 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:31:45.327397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3782cbf9-b4c1-48ae-b174-f35d453f2217 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:45.328417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3782cbf9-b4c1-48ae-b174-f35d453f2217 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:45.335523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3782cbf9-b4c1-48ae-b174-f35d453f2217 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:45.336039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3782cbf9-b4c1-48ae-b174-f35d453f2217 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:45.336499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3782cbf9-b4c1-48ae-b174-f35d453f2217 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:45.337217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3782cbf9-b4c1-48ae-b174-f35d453f2217 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:45.337719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3782cbf9-b4c1-48ae-b174-f35d453f2217 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:45.338172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3782cbf9-b4c1-48ae-b174-f35d453f2217 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:45.496554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3782cbf9-b4c1-48ae-b174-f35d453f2217 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:45.504382 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3782cbf9-b4c1-48ae-b174-f35d453f2217 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1734 microversion: 2.1 time: 0.185609 Oct 11 20:31:45.504951 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3123/6292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:45 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:46.528097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d6fb3609-c79d-44a5-b775-9ee40bada81c tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:46.528788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d6fb3609-c79d-44a5-b775-9ee40bada81c tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:46.535668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6fb3609-c79d-44a5-b775-9ee40bada81c tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:46.536149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6fb3609-c79d-44a5-b775-9ee40bada81c tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:46.536579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6fb3609-c79d-44a5-b775-9ee40bada81c tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:46.537261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6fb3609-c79d-44a5-b775-9ee40bada81c tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:46.537710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6fb3609-c79d-44a5-b775-9ee40bada81c tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:46.538127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d6fb3609-c79d-44a5-b775-9ee40bada81c tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:46.737529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d6fb3609-c79d-44a5-b775-9ee40bada81c tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:46.745350 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d6fb3609-c79d-44a5-b775-9ee40bada81c tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1734 microversion: 2.1 time: 0.221642 Oct 11 20:31:46.745932 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3170/6293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:46 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:47.470814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4609a6cd-ab90-4f7e-a021-fa5ca987a627 req-fc124898-8a3d-4b70-bc3c-b8b91d722157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaff5f7c-4258-45de-abe9-f4e0440648e6", "name": "network-vif-deleted", "tag": "158262b7-3b14-436b-bb2b-e3dd173eaf62"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:31:47.482044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4609a6cd-ab90-4f7e-a021-fa5ca987a627 req-fc124898-8a3d-4b70-bc3c-b8b91d722157 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:47.482854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4609a6cd-ab90-4f7e-a021-fa5ca987a627 req-fc124898-8a3d-4b70-bc3c-b8b91d722157 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:47.483489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4609a6cd-ab90-4f7e-a021-fa5ca987a627 req-fc124898-8a3d-4b70-bc3c-b8b91d722157 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:47.497213 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4609a6cd-ab90-4f7e-a021-fa5ca987a627 req-fc124898-8a3d-4b70-bc3c-b8b91d722157 service nova] Creating event network-vif-deleted:158262b7-3b14-436b-bb2b-e3dd173eaf62 for instance aaff5f7c-4258-45de-abe9-f4e0440648e6 on n-h2-860864-3 Oct 11 20:31:47.502792 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4609a6cd-ab90-4f7e-a021-fa5ca987a627 req-fc124898-8a3d-4b70-bc3c-b8b91d722157 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036407 Oct 11 20:31:47.503607 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3124/6294] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:31:47.771338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:47.773036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:47.781637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:47.782185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:47.782643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:47.783488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:47.783941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:47.784402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:47.816765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:47.817249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:47.817683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:47.818123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lazy-loading 'fault' on Instance uuid aaff5f7c-4258-45de-abe9-f4e0440648e6 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:31:47.864185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7b72d57cfb4c44919cdf8f4778c222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1a5c5f3da341d9a2ab9ee299f2323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:31:47.872348 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c5b7e7dd-f9ad-4055-8841-01449a894a7e tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 200 len: 1389 microversion: 2.1 time: 0.106980 Oct 11 20:31:47.873032 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3171/6295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:47 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 1389 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:31:48.898845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:48.899561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:48.905749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:48.906795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:48.907282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:48.907977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:48.908442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:48.908875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:48.922709 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] HTTP exception thrown: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Request method failure captured: Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 HTTP/1.1 Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdGCZ0js2HJXi5PTDRBnQJkxC40jsGkmD80S5dNO1aGtbUIIuBz3Wl1LVLYSbrtB-JA7xLnaT6hhdn3A8ls8UmCJFWS1OZji110PdIiG9Av6WTyXL_UrJCb4uDgtLsE3mzE39AvTX3xodYGOAnCUth7dx2ttGLBel8MPLkjorOmK1wE Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ed1a5c5f3da341d9a2ab9ee299f2323a Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestServerBasicOps-650206144 Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed1a5c5f3da341d9a2ab9ee299f2323a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed1a5c5f3da341d9a2ab9ee299f2323a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed1a5c5f3da341d9a2ab9ee299f2323a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed1a5c5f3da341d9a2ab9ee299f2323a"}]}] Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestServerBasicOps-650206144 Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ed1a5c5f3da341d9a2ab9ee299f2323a Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestServerBasicOps-650206144 Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestServerBasicOps-650206144-project Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 5d7b72d57cfb4c44919cdf8f4778c222 Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestServerBasicOps-650206144-project Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'aaff5f7c-4258-45de-abe9-f4e0440648e6'} Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:31:48.924349 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:31:48.929610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:31:48.929610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:31:48.929610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:31:48.929610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:31:48.929610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:31:48.929610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:48.929610 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:31:48.929610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Returning 404 to user: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:31:48.929610 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-956fbd83-1d84-4840-a8cf-770e285fc723 tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 404 len: 111 microversion: 2.1 time: 0.032076 Oct 11 20:31:48.929610 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3125/6296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:48 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:31:49.672512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:49.673025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:49.679830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:49.680311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:49.680742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:49.681422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:49.681870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:49.682288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:49.695503 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] HTTP exception thrown: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Request method failure captured: Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 HTTP/1.1 Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdGCZ0js2HJXi5PTDRBnQJkxC40jsGkmD80S5dNO1aGtbUIIuBz3Wl1LVLYSbrtB-JA7xLnaT6hhdn3A8ls8UmCJFWS1OZji110PdIiG9Av6WTyXL_UrJCb4uDgtLsE3mzE39AvTX3xodYGOAnCUth7dx2ttGLBel8MPLkjorOmK1wE Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: ed1a5c5f3da341d9a2ab9ee299f2323a Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestServerBasicOps-650206144 Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed1a5c5f3da341d9a2ab9ee299f2323a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed1a5c5f3da341d9a2ab9ee299f2323a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed1a5c5f3da341d9a2ab9ee299f2323a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed1a5c5f3da341d9a2ab9ee299f2323a"}]}] Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestServerBasicOps-650206144 Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: ed1a5c5f3da341d9a2ab9ee299f2323a Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestServerBasicOps-650206144 Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestServerBasicOps-650206144-project Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 5d7b72d57cfb4c44919cdf8f4778c222 Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestServerBasicOps-650206144-project Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'aaff5f7c-4258-45de-abe9-f4e0440648e6'} Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:31:49.697150 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Returning 404 to user: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b6e9a855-b80c-41d0-8fc7-da8ff5665ace tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 404 len: 111 microversion: 2.1 time: 0.030578 Oct 11 20:31:49.701117 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3172/6297] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:31:49 2022] DELETE /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:31:49.707264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:49.707896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] [instance: aaff5f7c-4258-45de-abe9-f4e0440648e6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:31:49.713799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:49.714297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:49.714777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:49.715479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:31:49.715947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:31:49.716383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:31:49.730410 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] HTTP exception thrown: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Request method failure captured: Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 HTTP/1.1 Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdGCZ0js2HJXi5PTDRBnQJkxC40jsGkmD80S5dNO1aGtbUIIuBz3Wl1LVLYSbrtB-JA7xLnaT6hhdn3A8ls8UmCJFWS1OZji110PdIiG9Av6WTyXL_UrJCb4uDgtLsE3mzE39AvTX3xodYGOAnCUth7dx2ttGLBel8MPLkjorOmK1wE Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: ed1a5c5f3da341d9a2ab9ee299f2323a Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestServerBasicOps-650206144 Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed1a5c5f3da341d9a2ab9ee299f2323a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed1a5c5f3da341d9a2ab9ee299f2323a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed1a5c5f3da341d9a2ab9ee299f2323a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed1a5c5f3da341d9a2ab9ee299f2323a"}]}] Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestServerBasicOps-650206144 Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: ed1a5c5f3da341d9a2ab9ee299f2323a Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestServerBasicOps-650206144 Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestServerBasicOps-650206144-project Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 5d7b72d57cfb4c44919cdf8f4778c222 Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestServerBasicOps-650206144-project Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'aaff5f7c-4258-45de-abe9-f4e0440648e6'} Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:31:49.732001 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:31:49.737032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:31:49.737032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:31:49.737032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:31:49.737032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:31:49.737032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:31:49.737032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. Oct 11 20:31:49.737032 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:31:49.737032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Returning 404 to user: Instance aaff5f7c-4258-45de-abe9-f4e0440648e6 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:31:49.737032 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6a0469a9-6f53-4c5b-aec5-578f8931c81b tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6" status: 404 len: 111 microversion: 2.1 time: 0.029984 Oct 11 20:31:49.737032 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3126/6298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:31:49 2022] GET /compute/v2.1/servers/aaff5f7c-4258-45de-abe9-f4e0440648e6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:31:49.995298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0b74197a-317b-4631-ab8b-5d33b4e7554d tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] Calling method '.version_select at 0x7f83cc2f83a0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:31:50.018618 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0b74197a-317b-4631-ab8b-5d33b4e7554d tempest-TestServerBasicOps-650206144 tempest-TestServerBasicOps-650206144-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1581959324" status: 202 len: 0 microversion: 2.1 time: 0.128035 Oct 11 20:31:50.019195 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3173/6299] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 11 20:31:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1581959324 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:33:04.536161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:04.537633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=12 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:04.539067 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:33:04.539407 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 20:33:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd (ip 10.222.0.27) !!! Oct 11 20:33:04.540677 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:33:04.541118 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 20:33:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd (ip 10.222.0.27) !!! Oct 11 20:33:04.541221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:04.542093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:04.548682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-af0304bf-4946-4c7d-8eed-6a65e72f85e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:04.549505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-af0304bf-4946-4c7d-8eed-6a65e72f85e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:04.554007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8e7c97c2-c7cb-40d1-80a7-0819c8c602ce req-8c4a5c73-2543-4c33-8867-b711f6cef238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26612e1f-5b2b-47a2-a9b4-0553414c6acd", "tag": "372e79ab-76be-491b-936d-7e610da507f1"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:04.560801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af0304bf-4946-4c7d-8eed-6a65e72f85e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:04.561435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af0304bf-4946-4c7d-8eed-6a65e72f85e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:04.561904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af0304bf-4946-4c7d-8eed-6a65e72f85e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:04.562789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af0304bf-4946-4c7d-8eed-6a65e72f85e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:04.563309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af0304bf-4946-4c7d-8eed-6a65e72f85e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:04.564186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-af0304bf-4946-4c7d-8eed-6a65e72f85e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:04.570315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8e7c97c2-c7cb-40d1-80a7-0819c8c602ce req-8c4a5c73-2543-4c33-8867-b711f6cef238 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:04.570821 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8e7c97c2-c7cb-40d1-80a7-0819c8c602ce req-8c4a5c73-2543-4c33-8867-b711f6cef238 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:04.571254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8e7c97c2-c7cb-40d1-80a7-0819c8c602ce req-8c4a5c73-2543-4c33-8867-b711f6cef238 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:04.585858 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8e7c97c2-c7cb-40d1-80a7-0819c8c602ce req-8c4a5c73-2543-4c33-8867-b711f6cef238 service nova] Creating event network-changed:372e79ab-76be-491b-936d-7e610da507f1 for instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd on n-h1-860864-3 Oct 11 20:33:04.591122 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8e7c97c2-c7cb-40d1-80a7-0819c8c602ce req-8c4a5c73-2543-4c33-8867-b711f6cef238 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054665 Oct 11 20:33:04.591933 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3174/6300] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:33:04.593481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-af0304bf-4946-4c7d-8eed-6a65e72f85e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:33:04.698488 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-af0304bf-4946-4c7d-8eed-6a65e72f85e5 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 204 len: 0 microversion: 2.1 time: 0.164793 Oct 11 20:33:04.700153 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3127/6301] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:33:04 2022] DELETE /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:33:04.709094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-013bdf04-3df7-4bb4-b107-0eba8f51fcc8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:04.710206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-013bdf04-3df7-4bb4-b107-0eba8f51fcc8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:04.717959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-013bdf04-3df7-4bb4-b107-0eba8f51fcc8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:04.719442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-013bdf04-3df7-4bb4-b107-0eba8f51fcc8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:04.720144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-013bdf04-3df7-4bb4-b107-0eba8f51fcc8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:04.721735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-013bdf04-3df7-4bb4-b107-0eba8f51fcc8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:04.722570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-013bdf04-3df7-4bb4-b107-0eba8f51fcc8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:04.723375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-013bdf04-3df7-4bb4-b107-0eba8f51fcc8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:04.874286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-013bdf04-3df7-4bb4-b107-0eba8f51fcc8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:04.882494 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-013bdf04-3df7-4bb4-b107-0eba8f51fcc8 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1575 microversion: 2.1 time: 0.178217 Oct 11 20:33:04.883099 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3175/6302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:04 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:05.906578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e8ed287-d32f-40a3-9044-94e0eaf499c3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:05.907339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e8ed287-d32f-40a3-9044-94e0eaf499c3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:05.913997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8ed287-d32f-40a3-9044-94e0eaf499c3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:05.914506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8ed287-d32f-40a3-9044-94e0eaf499c3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:05.914988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8ed287-d32f-40a3-9044-94e0eaf499c3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:05.915694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8ed287-d32f-40a3-9044-94e0eaf499c3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:05.916167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8ed287-d32f-40a3-9044-94e0eaf499c3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:05.916624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8ed287-d32f-40a3-9044-94e0eaf499c3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:06.052899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e8ed287-d32f-40a3-9044-94e0eaf499c3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:06.060941 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e8ed287-d32f-40a3-9044-94e0eaf499c3 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1575 microversion: 2.1 time: 0.159035 Oct 11 20:33:06.061518 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3128/6303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:05 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:06.622022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8d0a1560-3cf9-4362-8ffd-161a0f6e68b1 req-52e1f68a-1f4e-4a5b-b42f-432d8958cd70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26612e1f-5b2b-47a2-a9b4-0553414c6acd", "name": "network-vif-deleted", "tag": "372e79ab-76be-491b-936d-7e610da507f1"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:06.633157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8d0a1560-3cf9-4362-8ffd-161a0f6e68b1 req-52e1f68a-1f4e-4a5b-b42f-432d8958cd70 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:06.633733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8d0a1560-3cf9-4362-8ffd-161a0f6e68b1 req-52e1f68a-1f4e-4a5b-b42f-432d8958cd70 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:06.634177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8d0a1560-3cf9-4362-8ffd-161a0f6e68b1 req-52e1f68a-1f4e-4a5b-b42f-432d8958cd70 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:06.648879 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8d0a1560-3cf9-4362-8ffd-161a0f6e68b1 req-52e1f68a-1f4e-4a5b-b42f-432d8958cd70 service nova] Creating event network-vif-deleted:372e79ab-76be-491b-936d-7e610da507f1 for instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd on n-h1-860864-3 Oct 11 20:33:06.653787 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8d0a1560-3cf9-4362-8ffd-161a0f6e68b1 req-52e1f68a-1f4e-4a5b-b42f-432d8958cd70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035528 Oct 11 20:33:06.654576 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3176/6304] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:33:07.086117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2fd5f2f8-766f-4f08-b306-38e1ef18469e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:07.086852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2fd5f2f8-766f-4f08-b306-38e1ef18469e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:07.094004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd5f2f8-766f-4f08-b306-38e1ef18469e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:07.094621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd5f2f8-766f-4f08-b306-38e1ef18469e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:07.095151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd5f2f8-766f-4f08-b306-38e1ef18469e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:07.096032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd5f2f8-766f-4f08-b306-38e1ef18469e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:07.096835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd5f2f8-766f-4f08-b306-38e1ef18469e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:07.097283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd5f2f8-766f-4f08-b306-38e1ef18469e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:07.159192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2fd5f2f8-766f-4f08-b306-38e1ef18469e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:07.167424 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2fd5f2f8-766f-4f08-b306-38e1ef18469e tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1224 microversion: 2.1 time: 0.085283 Oct 11 20:33:07.168015 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3129/6305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:07 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:08.192160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c30793f1-2fc5-40b9-8651-bf52a7d43c1d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:08.192878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c30793f1-2fc5-40b9-8651-bf52a7d43c1d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:08.199943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c30793f1-2fc5-40b9-8651-bf52a7d43c1d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:08.200447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c30793f1-2fc5-40b9-8651-bf52a7d43c1d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:08.200890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c30793f1-2fc5-40b9-8651-bf52a7d43c1d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:08.201609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c30793f1-2fc5-40b9-8651-bf52a7d43c1d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:08.202076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c30793f1-2fc5-40b9-8651-bf52a7d43c1d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:08.202509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c30793f1-2fc5-40b9-8651-bf52a7d43c1d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:08.526547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c30793f1-2fc5-40b9-8651-bf52a7d43c1d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:08.534622 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c30793f1-2fc5-40b9-8651-bf52a7d43c1d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1224 microversion: 2.1 time: 0.348406 Oct 11 20:33:08.535292 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3177/6306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:08 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1224 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:09.556836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c3512291-4bee-4b4c-be4e-5a584636e40d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:09.557469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c3512291-4bee-4b4c-be4e-5a584636e40d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:09.564535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3512291-4bee-4b4c-be4e-5a584636e40d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:09.565076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3512291-4bee-4b4c-be4e-5a584636e40d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:09.565751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3512291-4bee-4b4c-be4e-5a584636e40d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:09.566474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3512291-4bee-4b4c-be4e-5a584636e40d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:09.567048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3512291-4bee-4b4c-be4e-5a584636e40d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:09.567495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3512291-4bee-4b4c-be4e-5a584636e40d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:09.633896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c3512291-4bee-4b4c-be4e-5a584636e40d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:09.641901 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c3512291-4bee-4b4c-be4e-5a584636e40d tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1224 microversion: 2.1 time: 0.089136 Oct 11 20:33:09.642498 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3130/6307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:09 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:10.664790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-97c6b356-ab11-4b27-93ed-9e6535e48668 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:10.665447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-97c6b356-ab11-4b27-93ed-9e6535e48668 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:10.672183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97c6b356-ab11-4b27-93ed-9e6535e48668 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:10.672665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97c6b356-ab11-4b27-93ed-9e6535e48668 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:10.673092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97c6b356-ab11-4b27-93ed-9e6535e48668 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:10.673772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97c6b356-ab11-4b27-93ed-9e6535e48668 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:10.674217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97c6b356-ab11-4b27-93ed-9e6535e48668 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:10.675166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97c6b356-ab11-4b27-93ed-9e6535e48668 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:10.739553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-97c6b356-ab11-4b27-93ed-9e6535e48668 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:10.747498 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-97c6b356-ab11-4b27-93ed-9e6535e48668 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 200 len: 1224 microversion: 2.1 time: 0.086513 Oct 11 20:33:10.748075 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3178/6308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:10 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:11.772525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:11.773152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 26612e1f-5b2b-47a2-a9b4-0553414c6acd] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:11.779999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:11.780505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:11.780956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:11.781657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:11.782122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:11.782583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:11.795668 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd could not be found. Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd HTTP/1.1 Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd could not be found. Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '26612e1f-5b2b-47a2-a9b4-0553414c6acd'} Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd could not be found. Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd could not be found. Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:11.797252 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:11.804146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:11.804146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:11.804146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:11.804146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:33:11.804146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:33:11.804146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd could not be found. Oct 11 20:33:11.804146 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:11.804146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 26612e1f-5b2b-47a2-a9b4-0553414c6acd could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:33:11.804146 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a62780db-0520-4380-8e45-ca3ec0e25485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd" status: 404 len: 111 microversion: 2.1 time: 0.030836 Oct 11 20:33:11.804146 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3131/6309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:11 2022] GET /compute/v2.1/servers/26612e1f-5b2b-47a2-a9b4-0553414c6acd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:33:18.338298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c656fda-68ec-4368-91a8-79c5425bd485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:18.339625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c656fda-68ec-4368-91a8-79c5425bd485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:18.341464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7afe635a-e381-43f4-bd40-87bbde1e31e3 req-25cee4cf-d212-4643-97df-be994788c1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3803a626-793a-402f-b547-dabc7c25582f", "tag": "92d15300-4a17-4dd1-b132-9488570668db"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:18.346267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c656fda-68ec-4368-91a8-79c5425bd485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:18.346870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c656fda-68ec-4368-91a8-79c5425bd485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:18.347383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c656fda-68ec-4368-91a8-79c5425bd485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:18.348922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c656fda-68ec-4368-91a8-79c5425bd485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:18.348922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c656fda-68ec-4368-91a8-79c5425bd485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:18.349100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c656fda-68ec-4368-91a8-79c5425bd485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:18.352074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7afe635a-e381-43f4-bd40-87bbde1e31e3 req-25cee4cf-d212-4643-97df-be994788c1b0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:18.352566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7afe635a-e381-43f4-bd40-87bbde1e31e3 req-25cee4cf-d212-4643-97df-be994788c1b0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:18.353214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7afe635a-e381-43f4-bd40-87bbde1e31e3 req-25cee4cf-d212-4643-97df-be994788c1b0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:18.365351 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7afe635a-e381-43f4-bd40-87bbde1e31e3 req-25cee4cf-d212-4643-97df-be994788c1b0 service nova] Creating event network-changed:92d15300-4a17-4dd1-b132-9488570668db for instance 3803a626-793a-402f-b547-dabc7c25582f on n-h1-860864-3 Oct 11 20:33:18.371660 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7afe635a-e381-43f4-bd40-87bbde1e31e3 req-25cee4cf-d212-4643-97df-be994788c1b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035017 Oct 11 20:33:18.372932 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3132/6310] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:33:18.376944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c656fda-68ec-4368-91a8-79c5425bd485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:33:18.466447 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c656fda-68ec-4368-91a8-79c5425bd485 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 204 len: 0 microversion: 2.1 time: 0.133208 Oct 11 20:33:18.467745 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3179/6311] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:33:18 2022] DELETE /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:33:18.477251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3dd44d7b-842b-4c91-88c3-2b8a7c6c7f9f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:18.478767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3dd44d7b-842b-4c91-88c3-2b8a7c6c7f9f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:18.485991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dd44d7b-842b-4c91-88c3-2b8a7c6c7f9f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:18.486875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dd44d7b-842b-4c91-88c3-2b8a7c6c7f9f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:18.487561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dd44d7b-842b-4c91-88c3-2b8a7c6c7f9f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:18.488941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dd44d7b-842b-4c91-88c3-2b8a7c6c7f9f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:18.489657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dd44d7b-842b-4c91-88c3-2b8a7c6c7f9f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:18.490616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3dd44d7b-842b-4c91-88c3-2b8a7c6c7f9f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:18.629363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3dd44d7b-842b-4c91-88c3-2b8a7c6c7f9f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:18.638341 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3dd44d7b-842b-4c91-88c3-2b8a7c6c7f9f tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1576 microversion: 2.1 time: 0.165804 Oct 11 20:33:18.639035 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3133/6312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:18 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:19.661763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a4ce7d5-80f8-4d57-a0d2-19aa55c92c85 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:19.663296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5a4ce7d5-80f8-4d57-a0d2-19aa55c92c85 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:19.670657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4ce7d5-80f8-4d57-a0d2-19aa55c92c85 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:19.671148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4ce7d5-80f8-4d57-a0d2-19aa55c92c85 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:19.671588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4ce7d5-80f8-4d57-a0d2-19aa55c92c85 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:19.672279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4ce7d5-80f8-4d57-a0d2-19aa55c92c85 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:19.672761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4ce7d5-80f8-4d57-a0d2-19aa55c92c85 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:19.673183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4ce7d5-80f8-4d57-a0d2-19aa55c92c85 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:19.809905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a4ce7d5-80f8-4d57-a0d2-19aa55c92c85 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:19.818214 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a4ce7d5-80f8-4d57-a0d2-19aa55c92c85 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1576 microversion: 2.1 time: 0.160634 Oct 11 20:33:19.819544 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3180/6313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:19 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:20.388428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8267f275-189a-45d2-bb44-fd7c64b2b34b req-d78a0bf3-0ce5-4224-979a-490fc6284958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3803a626-793a-402f-b547-dabc7c25582f", "name": "network-vif-deleted", "tag": "92d15300-4a17-4dd1-b132-9488570668db"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:20.398495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8267f275-189a-45d2-bb44-fd7c64b2b34b req-d78a0bf3-0ce5-4224-979a-490fc6284958 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:20.399022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8267f275-189a-45d2-bb44-fd7c64b2b34b req-d78a0bf3-0ce5-4224-979a-490fc6284958 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:20.399468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8267f275-189a-45d2-bb44-fd7c64b2b34b req-d78a0bf3-0ce5-4224-979a-490fc6284958 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:20.410398 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8267f275-189a-45d2-bb44-fd7c64b2b34b req-d78a0bf3-0ce5-4224-979a-490fc6284958 service nova] Creating event network-vif-deleted:92d15300-4a17-4dd1-b132-9488570668db for instance 3803a626-793a-402f-b547-dabc7c25582f on n-h1-860864-3 Oct 11 20:33:20.416046 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8267f275-189a-45d2-bb44-fd7c64b2b34b req-d78a0bf3-0ce5-4224-979a-490fc6284958 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031404 Oct 11 20:33:20.416652 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3134/6314] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:33:20.842405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c33793d6-4067-4c3f-849d-540b3b818add tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:20.842956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c33793d6-4067-4c3f-849d-540b3b818add tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:20.850516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c33793d6-4067-4c3f-849d-540b3b818add tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:20.851067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c33793d6-4067-4c3f-849d-540b3b818add tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:20.851505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c33793d6-4067-4c3f-849d-540b3b818add tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:20.852193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c33793d6-4067-4c3f-849d-540b3b818add tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:20.852644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c33793d6-4067-4c3f-849d-540b3b818add tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:20.853064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c33793d6-4067-4c3f-849d-540b3b818add tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:20.918643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c33793d6-4067-4c3f-849d-540b3b818add tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:20.926717 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c33793d6-4067-4c3f-849d-540b3b818add tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1224 microversion: 2.1 time: 0.088233 Oct 11 20:33:20.927286 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3181/6315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:20 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:21.950770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6f7d818c-42c4-4f30-bfaf-5c093bf6bb62 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:21.951524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6f7d818c-42c4-4f30-bfaf-5c093bf6bb62 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:21.957999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f7d818c-42c4-4f30-bfaf-5c093bf6bb62 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:21.958561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f7d818c-42c4-4f30-bfaf-5c093bf6bb62 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:21.959164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f7d818c-42c4-4f30-bfaf-5c093bf6bb62 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:21.959887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f7d818c-42c4-4f30-bfaf-5c093bf6bb62 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:21.960359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f7d818c-42c4-4f30-bfaf-5c093bf6bb62 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:21.960805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6f7d818c-42c4-4f30-bfaf-5c093bf6bb62 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:22.028705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6f7d818c-42c4-4f30-bfaf-5c093bf6bb62 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:22.036725 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6f7d818c-42c4-4f30-bfaf-5c093bf6bb62 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1224 microversion: 2.1 time: 0.091197 Oct 11 20:33:22.038038 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3135/6316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:21 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:23.059999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-06092154-c4ef-45cf-b9f8-d32504e0f126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:23.060720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-06092154-c4ef-45cf-b9f8-d32504e0f126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:23.067466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06092154-c4ef-45cf-b9f8-d32504e0f126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:23.067960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06092154-c4ef-45cf-b9f8-d32504e0f126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:23.068963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06092154-c4ef-45cf-b9f8-d32504e0f126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:23.069680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06092154-c4ef-45cf-b9f8-d32504e0f126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:23.070142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06092154-c4ef-45cf-b9f8-d32504e0f126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:23.070630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06092154-c4ef-45cf-b9f8-d32504e0f126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:23.133278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-06092154-c4ef-45cf-b9f8-d32504e0f126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:23.141031 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-06092154-c4ef-45cf-b9f8-d32504e0f126 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1224 microversion: 2.1 time: 0.085505 Oct 11 20:33:23.141620 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3182/6317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:23 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:24.165909 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84033298-bdab-495e-8afd-8a858cf4639a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:24.166645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-84033298-bdab-495e-8afd-8a858cf4639a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:24.173945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84033298-bdab-495e-8afd-8a858cf4639a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:24.174457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84033298-bdab-495e-8afd-8a858cf4639a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:24.174951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84033298-bdab-495e-8afd-8a858cf4639a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:24.175677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84033298-bdab-495e-8afd-8a858cf4639a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:24.176150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84033298-bdab-495e-8afd-8a858cf4639a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:24.176593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84033298-bdab-495e-8afd-8a858cf4639a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:24.249577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-84033298-bdab-495e-8afd-8a858cf4639a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcf07bc33104f78adbcd3dfa198a570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563ad430e2af4c469e0a0afa967d580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:24.259104 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-84033298-bdab-495e-8afd-8a858cf4639a tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 200 len: 1224 microversion: 2.1 time: 0.098728 Oct 11 20:33:24.260052 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3136/6318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:24 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:25.283353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:25.283893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: 3803a626-793a-402f-b547-dabc7c25582f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:25.290973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:25.291462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:25.291925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:25.292612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:25.293067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:25.293492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:25.307371 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance 3803a626-793a-402f-b547-dabc7c25582f could not be found. Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f HTTP/1.1 Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 3803a626-793a-402f-b547-dabc7c25582f could not be found. Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '3803a626-793a-402f-b547-dabc7c25582f'} Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3803a626-793a-402f-b547-dabc7c25582f could not be found. Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3803a626-793a-402f-b547-dabc7c25582f could not be found. Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:25.309045 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.314467 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:25.314467 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:25.314467 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:25.314467 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:33:25.314467 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:33:25.314467 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3803a626-793a-402f-b547-dabc7c25582f could not be found. Oct 11 20:33:25.314467 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.314467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance 3803a626-793a-402f-b547-dabc7c25582f could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:33:25.314467 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-305e3cef-fc2e-41bb-8ef6-1a2747061dd9 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f" status: 404 len: 111 microversion: 2.1 time: 0.031059 Oct 11 20:33:25.314467 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3183/6319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:25 2022] GET /compute/v2.1/servers/3803a626-793a-402f-b547-dabc7c25582f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:33:25.759885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:25.760407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:25.768274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:25.768785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:25.769244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:25.769959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:25.770434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:25.770901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:25.784117 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e HTTP/1.1 Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'b4993eb1-b6c0-4fdb-a47c-4e175639bb9e'} Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:33:25.785837 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5aaff71e-1b50-4f72-9016-6b390e2ae7fa tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 404 len: 111 microversion: 2.1 time: 0.032130 Oct 11 20:33:25.790417 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3137/6320] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:33:25 2022] DELETE /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:33:25.796527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:25.797158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] [instance: b4993eb1-b6c0-4fdb-a47c-4e175639bb9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:25.803686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:25.804171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:25.804602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:25.805290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:25.805740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:25.806161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:25.819685 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] HTTP exception thrown: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Request method failure captured: Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e HTTP/1.1 Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdAlSTCaJF_AS3shd-_RRZoK8k_bkKyarXh5tZbuo7HxCSqgfIoumqvM18E6rdokW8xgxSRfpfZC59pQmOVxc_iLVzk0v_syqKNdHZGpWnhyrjS0C5nsaHhe6kfUa5n33VonCrpFVnmXnHpU259t4HnC7o18MzUOM8VgJLm5jN0AYQo Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_563ad430e2af4c469e0a0afa967d580e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/563ad430e2af4c469e0a0afa967d580e"}]}] Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 563ad430e2af4c469e0a0afa967d580e Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609114683 Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: cbcf07bc33104f78adbcd3dfa198a570 Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestVolumeBootPattern-1609114683-project Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'b4993eb1-b6c0-4fdb-a47c-4e175639bb9e'} Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:25.821202 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.825241 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:25.825241 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:25.825241 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:25.825241 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:33:25.825241 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:33:25.825241 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. Oct 11 20:33:25.825241 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:25.825241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Returning 404 to user: Instance b4993eb1-b6c0-4fdb-a47c-4e175639bb9e could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:33:25.825241 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b3c56494-85a8-46d9-9fe7-ca3663d2c9e4 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e" status: 404 len: 111 microversion: 2.1 time: 0.029927 Oct 11 20:33:25.825241 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3184/6321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:25 2022] GET /compute/v2.1/servers/b4993eb1-b6c0-4fdb-a47c-4e175639bb9e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:33:29.239597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-24221438-64ca-4c64-881b-2105b98d9a54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] Calling method '.version_select at 0x7f83c7317940>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:29.283890 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-24221438-64ca-4c64-881b-2105b98d9a54 tempest-TestVolumeBootPattern-1609114683 tempest-TestVolumeBootPattern-1609114683-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-113237225" status: 202 len: 0 microversion: 2.1 time: 0.050526 Oct 11 20:33:29.284487 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3138/6322] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 11 20:33:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-113237225 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:33:47.571933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:47.572700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:47.713285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-683932814", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:47.765778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] validate_networks() for None {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:33:48.039615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:33:48.040039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:33:48.040513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:33:48.040924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:33:48.041340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:33:48.050260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:48.050922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:48.051369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:48.052100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:48.052559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:48.053843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:48.071669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Getting quotas for project 602f0da2c3884793aa22f3e1b285d9b9. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:33:48.077461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Getting quotas for user 311ffe9a408a47e4ab81b275368093ab and project 602f0da2c3884793aa22f3e1b285d9b9. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:33:48.090669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:33:48.093048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:33:48.137593 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8a250419-6b95-4cda-ac0d-5b4562389546 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571754 Oct 11 20:33:48.138237 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3185/6323] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:33:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:33:48.149491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:48.150553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:48.155686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b35e786-16a5-488b-904a-4b5435fd7a10 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:48.156320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9b35e786-16a5-488b-904a-4b5435fd7a10 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:48.216586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9b35e786-16a5-488b-904a-4b5435fd7a10 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:48.223694 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9b35e786-16a5-488b-904a-4b5435fd7a10 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1221 microversion: 2.1 time: 0.076979 Oct 11 20:33:48.224274 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3139/6324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:48 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:49.247609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ad9abee6-1d2d-4945-bf71-8c59ff99600b tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:49.248220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ad9abee6-1d2d-4945-bf71-8c59ff99600b tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:49.256405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad9abee6-1d2d-4945-bf71-8c59ff99600b tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:49.257305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad9abee6-1d2d-4945-bf71-8c59ff99600b tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:49.257909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad9abee6-1d2d-4945-bf71-8c59ff99600b tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:49.258448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad9abee6-1d2d-4945-bf71-8c59ff99600b tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:49.258959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad9abee6-1d2d-4945-bf71-8c59ff99600b tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:49.259359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad9abee6-1d2d-4945-bf71-8c59ff99600b tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:49.361222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ad9abee6-1d2d-4945-bf71-8c59ff99600b tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:49.369682 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ad9abee6-1d2d-4945-bf71-8c59ff99600b tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1281 microversion: 2.1 time: 0.126024 Oct 11 20:33:49.377719 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3186/6325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:49 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1281 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:50.394997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-31181638-407c-4c2a-b527-cebb68208cec tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:50.395732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-31181638-407c-4c2a-b527-cebb68208cec tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:50.404371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31181638-407c-4c2a-b527-cebb68208cec tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:50.404946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31181638-407c-4c2a-b527-cebb68208cec tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:50.405408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31181638-407c-4c2a-b527-cebb68208cec tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:50.406193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31181638-407c-4c2a-b527-cebb68208cec tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:50.406864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31181638-407c-4c2a-b527-cebb68208cec tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:50.407469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-31181638-407c-4c2a-b527-cebb68208cec tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:50.593767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-31181638-407c-4c2a-b527-cebb68208cec tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:50.602288 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-31181638-407c-4c2a-b527-cebb68208cec tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1321 microversion: 2.1 time: 0.211235 Oct 11 20:33:50.602908 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3140/6326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:50 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:50.939986 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-dc716f92-8052-462d-98b4-818c9680d352 req-dfd964e1-9f3e-4137-bce5-a57a293377f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc9f778-87f8-41bc-b5bb-0df35cef14cf", "tag": "5aac4b5a-922f-43cd-a544-517dbadd9b24"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:50.951578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dc716f92-8052-462d-98b4-818c9680d352 req-dfd964e1-9f3e-4137-bce5-a57a293377f6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:50.952126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dc716f92-8052-462d-98b4-818c9680d352 req-dfd964e1-9f3e-4137-bce5-a57a293377f6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:50.952696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-dc716f92-8052-462d-98b4-818c9680d352 req-dfd964e1-9f3e-4137-bce5-a57a293377f6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:50.971938 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-dc716f92-8052-462d-98b4-818c9680d352 req-dfd964e1-9f3e-4137-bce5-a57a293377f6 service nova] Creating event network-changed:5aac4b5a-922f-43cd-a544-517dbadd9b24 for instance 8fc9f778-87f8-41bc-b5bb-0df35cef14cf on n-h1-860864-3 Oct 11 20:33:50.976863 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-dc716f92-8052-462d-98b4-818c9680d352 req-dfd964e1-9f3e-4137-bce5-a57a293377f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040713 Oct 11 20:33:50.977773 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3187/6327] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:33:51.625212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b0e93454-fa2f-47f3-93cb-4991a422015a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:51.625732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b0e93454-fa2f-47f3-93cb-4991a422015a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:51.632604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e93454-fa2f-47f3-93cb-4991a422015a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:51.633097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e93454-fa2f-47f3-93cb-4991a422015a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:51.633543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e93454-fa2f-47f3-93cb-4991a422015a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:51.634251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e93454-fa2f-47f3-93cb-4991a422015a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:51.634740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e93454-fa2f-47f3-93cb-4991a422015a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:51.635175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b0e93454-fa2f-47f3-93cb-4991a422015a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:51.768756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b0e93454-fa2f-47f3-93cb-4991a422015a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:51.776824 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b0e93454-fa2f-47f3-93cb-4991a422015a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1321 microversion: 2.1 time: 0.155640 Oct 11 20:33:51.777406 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3141/6328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:51 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:52.800615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e7c75bb4-63c5-452f-8f1d-dc612704c4a8 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:52.801336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e7c75bb4-63c5-452f-8f1d-dc612704c4a8 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:52.808107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7c75bb4-63c5-452f-8f1d-dc612704c4a8 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:52.808588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7c75bb4-63c5-452f-8f1d-dc612704c4a8 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:52.809031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7c75bb4-63c5-452f-8f1d-dc612704c4a8 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:52.809712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7c75bb4-63c5-452f-8f1d-dc612704c4a8 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:52.810200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7c75bb4-63c5-452f-8f1d-dc612704c4a8 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:52.810658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7c75bb4-63c5-452f-8f1d-dc612704c4a8 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:52.942192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e7c75bb4-63c5-452f-8f1d-dc612704c4a8 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:52.950814 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e7c75bb4-63c5-452f-8f1d-dc612704c4a8 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1321 microversion: 2.1 time: 0.155341 Oct 11 20:33:52.951388 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3188/6329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:52 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:53.973401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-74851eec-c4d6-43a1-8160-76e24019ae80 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:53.974025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-74851eec-c4d6-43a1-8160-76e24019ae80 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:53.981096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74851eec-c4d6-43a1-8160-76e24019ae80 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:53.981598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74851eec-c4d6-43a1-8160-76e24019ae80 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:53.982048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74851eec-c4d6-43a1-8160-76e24019ae80 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:53.982769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74851eec-c4d6-43a1-8160-76e24019ae80 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:53.983239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74851eec-c4d6-43a1-8160-76e24019ae80 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:53.983674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74851eec-c4d6-43a1-8160-76e24019ae80 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:54.115951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-74851eec-c4d6-43a1-8160-76e24019ae80 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:54.123692 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-74851eec-c4d6-43a1-8160-76e24019ae80 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1321 microversion: 2.1 time: 0.154210 Oct 11 20:33:54.124264 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3142/6330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:53 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:55.146314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbf72a19-4f13-49ab-82ad-24fc7380736f tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:55.146956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cbf72a19-4f13-49ab-82ad-24fc7380736f tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:55.153907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf72a19-4f13-49ab-82ad-24fc7380736f tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:55.154408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf72a19-4f13-49ab-82ad-24fc7380736f tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:55.154897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf72a19-4f13-49ab-82ad-24fc7380736f tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:55.155603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf72a19-4f13-49ab-82ad-24fc7380736f tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:55.156060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf72a19-4f13-49ab-82ad-24fc7380736f tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:55.156489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbf72a19-4f13-49ab-82ad-24fc7380736f tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:55.287393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cbf72a19-4f13-49ab-82ad-24fc7380736f tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:55.295789 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cbf72a19-4f13-49ab-82ad-24fc7380736f tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1321 microversion: 2.1 time: 0.153423 Oct 11 20:33:55.296380 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3189/6331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:55 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:56.319297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84f2c4ad-d752-4b9b-b877-7601266de42a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:56.320190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-84f2c4ad-d752-4b9b-b877-7601266de42a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:56.327342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f2c4ad-d752-4b9b-b877-7601266de42a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:56.327791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f2c4ad-d752-4b9b-b877-7601266de42a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:56.328249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f2c4ad-d752-4b9b-b877-7601266de42a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:56.328962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f2c4ad-d752-4b9b-b877-7601266de42a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:56.329444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f2c4ad-d752-4b9b-b877-7601266de42a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:56.329893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84f2c4ad-d752-4b9b-b877-7601266de42a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:56.518935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-84f2c4ad-d752-4b9b-b877-7601266de42a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:56.526674 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-84f2c4ad-d752-4b9b-b877-7601266de42a tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1321 microversion: 2.1 time: 0.211379 Oct 11 20:33:56.527266 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3143/6332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:56 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:56.863981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-77b47cd2-b6ef-4ec8-a0fb-0ed2d154327b req-317ada51-9a34-439f-9e4b-be5ed39c6d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc9f778-87f8-41bc-b5bb-0df35cef14cf", "name": "network-vif-plugged", "status": "completed", "tag": "5aac4b5a-922f-43cd-a544-517dbadd9b24"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:56.875328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-77b47cd2-b6ef-4ec8-a0fb-0ed2d154327b req-317ada51-9a34-439f-9e4b-be5ed39c6d7a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:56.875812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-77b47cd2-b6ef-4ec8-a0fb-0ed2d154327b req-317ada51-9a34-439f-9e4b-be5ed39c6d7a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:56.876245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-77b47cd2-b6ef-4ec8-a0fb-0ed2d154327b req-317ada51-9a34-439f-9e4b-be5ed39c6d7a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:56.887421 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-77b47cd2-b6ef-4ec8-a0fb-0ed2d154327b req-317ada51-9a34-439f-9e4b-be5ed39c6d7a service nova] Creating event network-vif-plugged:5aac4b5a-922f-43cd-a544-517dbadd9b24 for instance 8fc9f778-87f8-41bc-b5bb-0df35cef14cf on n-h1-860864-3 Oct 11 20:33:56.892264 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-77b47cd2-b6ef-4ec8-a0fb-0ed2d154327b req-317ada51-9a34-439f-9e4b-be5ed39c6d7a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 Oct 11 20:33:56.892854 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3190/6333] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:33:57.549389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a05cef18-980c-4889-8a43-f70dd13f6308 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:57.550055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a05cef18-980c-4889-8a43-f70dd13f6308 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:57.556988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a05cef18-980c-4889-8a43-f70dd13f6308 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:57.557495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a05cef18-980c-4889-8a43-f70dd13f6308 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:57.557958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a05cef18-980c-4889-8a43-f70dd13f6308 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:57.558701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a05cef18-980c-4889-8a43-f70dd13f6308 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:57.559180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a05cef18-980c-4889-8a43-f70dd13f6308 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:57.559624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a05cef18-980c-4889-8a43-f70dd13f6308 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:57.686931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a05cef18-980c-4889-8a43-f70dd13f6308 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:57.694916 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a05cef18-980c-4889-8a43-f70dd13f6308 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1321 microversion: 2.1 time: 0.149209 Oct 11 20:33:57.695493 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3144/6334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:57 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:58.715805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:58.716571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:58.720657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-09c798c1-6e7e-49b4-a135-259f7151e338 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:58.721348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-09c798c1-6e7e-49b4-a135-259f7151e338 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:58.728297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09c798c1-6e7e-49b4-a135-259f7151e338 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:58.728777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09c798c1-6e7e-49b4-a135-259f7151e338 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:58.729226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09c798c1-6e7e-49b4-a135-259f7151e338 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:58.730634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09c798c1-6e7e-49b4-a135-259f7151e338 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:58.731099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09c798c1-6e7e-49b4-a135-259f7151e338 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:58.731520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-09c798c1-6e7e-49b4-a135-259f7151e338 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:58.919866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-09c798c1-6e7e-49b4-a135-259f7151e338 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:58.927683 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-09c798c1-6e7e-49b4-a135-259f7151e338 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1471 microversion: 2.1 time: 0.214150 Oct 11 20:33:58.928255 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3191/6335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:58 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:58.953556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:33:59.007668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-86d82257-891a-4a67-a44f-f3e51f2c7bfe tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Calling method '.version_select at 0x7f83d08ae820>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:59.074859 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-86d82257-891a-4a67-a44f-f3e51f2c7bfe tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/6984a462a6144abd9f8fd4f21f9e1572" status: 200 len: 371 microversion: 2.1 time: 0.126160 Oct 11 20:33:59.075963 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3145/6336] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 11 20:33:58 2022] GET /compute/v2.1/os-quota-sets/6984a462a6144abd9f8fd4f21f9e1572 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:33:59.087707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1f5d083f-2f2d-4a5d-9bf3-e61b1db7cf75 tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1296253313", "id": 1880665747, "os-flavor-access:is_public": "True"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:59.105451 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1f5d083f-2f2d-4a5d-9bf3-e61b1db7cf75 tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021522 Oct 11 20:33:59.106024 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3192/6337] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:33:59 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:33:59.118759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1880665747"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:59.121107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:59.127673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.128172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.128626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.129333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.129808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.130249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.268248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd0165b2550a243b2b6b08710134821e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6984a462a6144abd9f8fd4f21f9e1572', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:59.274512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1296253313 {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:33:59.281757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.282256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.282746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.283487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.283958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.284396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.307294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Getting quotas for project 602f0da2c3884793aa22f3e1b285d9b9. Resources: {'cores', 'ram'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:33:59.313254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Getting quotas for user 311ffe9a408a47e4ab81b275368093ab and project 602f0da2c3884793aa22f3e1b285d9b9. Resources: {'cores', 'ram'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:33:59.328972 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.compute.api [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] ram quota exceeded for 6984a462a6144abd9f8fd4f21f9e1572, tried to resize instance. Oct 11 20:33:59.329533 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Request method failure captured: Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf/action HTTP/1.1 Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 39 Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdMrdoRXidyYo-s2O4sqF96FrkKo6o_GQ8Go2zzwJPw-kkcja0Y3GmNvNvKiqHEuly5kEa5ZstT-OyrYvps91jOZf7z4dgcRQpOkGSQx7g5BSZhvps-_QCT3Hw2we5UUtfr1VQ2DTSS-GesqYELNSuP_pavjWs1Hs5gg9PKaUI7v4eo Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 6984a462a6144abd9f8fd4f21f9e1572 Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2031098391 Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,admin,reader Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,admin,reader Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6984a462a6144abd9f8fd4f21f9e1572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6984a462a6144abd9f8fd4f21f9e1572", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6984a462a6144abd9f8fd4f21f9e1572"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6984a462a6144abd9f8fd4f21f9e1572"}]}] Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2031098391 Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 6984a462a6144abd9f8fd4f21f9e1572 Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2031098391 Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersAdminNegativeTestJSON-2031098391-project-admin Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: d0165b2550a243b2b6b08710134821e1 Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2031098391-project-admin Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: {"resize": {"flavorRef": "1880665747"}} Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '8fc9f778-87f8-41bc-b5bb-0df35cef14cf', 'body': {'resize': {'flavorRef': '1880665747'}}} Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:33:59.331575 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-66e6559f-a6e8-4ffe-910f-f952c7be3c9f tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf/action" status: 403 len: 118 microversion: 2.1 time: 0.218176 Oct 11 20:33:59.335668 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3146/6338] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:33:59 2022] POST /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf/action => generated 118 bytes in 219 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:33:59.342021 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-94f59a95-3234-4309-af49-b996c7d72851 tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:59.358247 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-94f59a95-3234-4309-af49-b996c7d72851 tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1880665747" status: 202 len: 0 microversion: 2.1 time: 0.020139 Oct 11 20:33:59.358825 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3193/6339] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 11 20:33:59 2022] DELETE /compute/v2.1/flavors/1880665747 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:33:59.366484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32c8f96e-df3d-400a-813f-5cf280f80e3d tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:59.387073 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-32c8f96e-df3d-400a-813f-5cf280f80e3d tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024180 Oct 11 20:33:59.388645 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3147/6340] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 20:33:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:59.409186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0955d08b-0d5b-46b1-b742-7b427e81cb8a tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Calling method '.version_select at 0x7f83c728fee0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:59.483239 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0955d08b-0d5b-46b1-b742-7b427e81cb8a tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/6984a462a6144abd9f8fd4f21f9e1572" status: 200 len: 371 microversion: 2.1 time: 0.077722 Oct 11 20:33:59.483816 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3194/6341] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 11 20:33:59 2022] GET /compute/v2.1/os-quota-sets/6984a462a6144abd9f8fd4f21f9e1572 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:33:59.495719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a682dbd-cf83-4711-9472-8cc5afed5394 tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1372523340", "id": 785371979, "os-flavor-access:is_public": "True"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:59.512346 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a682dbd-cf83-4711-9472-8cc5afed5394 tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.020434 Oct 11 20:33:59.512919 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3148/6342] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:33:59 2022] POST /compute/v2.1/flavors => generated 434 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:33:59.525051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "785371979"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:33:59.527376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:59.533966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.534452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.534915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.535594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.536049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.536469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.673806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd0165b2550a243b2b6b08710134821e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6984a462a6144abd9f8fd4f21f9e1572', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:33:59.679985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1372523340 {{(pid=126956) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:33:59.686843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.687321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.687751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.688460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.688912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.689336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.710483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Getting quotas for project 602f0da2c3884793aa22f3e1b285d9b9. Resources: {'cores', 'ram'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:33:59.717338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Getting quotas for user 311ffe9a408a47e4ab81b275368093ab and project 602f0da2c3884793aa22f3e1b285d9b9. Resources: {'cores', 'ram'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:33:59.729293 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.compute.api [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] cores quota exceeded for 6984a462a6144abd9f8fd4f21f9e1572, tried to resize instance. Oct 11 20:33:59.729829 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Request method failure captured: Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf/action HTTP/1.1 Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 38 Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdMrdoRXidyYo-s2O4sqF96FrkKo6o_GQ8Go2zzwJPw-kkcja0Y3GmNvNvKiqHEuly5kEa5ZstT-OyrYvps91jOZf7z4dgcRQpOkGSQx7g5BSZhvps-_QCT3Hw2we5UUtfr1VQ2DTSS-GesqYELNSuP_pavjWs1Hs5gg9PKaUI7v4eo Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 6984a462a6144abd9f8fd4f21f9e1572 Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2031098391 Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,admin,reader Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,admin,reader Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6984a462a6144abd9f8fd4f21f9e1572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6984a462a6144abd9f8fd4f21f9e1572", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6984a462a6144abd9f8fd4f21f9e1572"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6984a462a6144abd9f8fd4f21f9e1572"}]}] Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2031098391 Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 6984a462a6144abd9f8fd4f21f9e1572 Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2031098391 Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersAdminNegativeTestJSON-2031098391-project-admin Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: d0165b2550a243b2b6b08710134821e1 Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2031098391-project-admin Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: {"resize": {"flavorRef": "785371979"}} Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '8fc9f778-87f8-41bc-b5bb-0df35cef14cf', 'body': {'resize': {'flavorRef': '785371979'}}} Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:33:59.732281 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-28b96a8a-a912-40e7-baad-22b43393890c tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf/action" status: 403 len: 113 microversion: 2.1 time: 0.212545 Oct 11 20:33:59.736431 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3195/6343] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:33:59 2022] POST /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf/action => generated 113 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:33:59.742299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-82e3c7d1-6740-400b-8127-4ca4df7e5dd1 tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:59.759875 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-82e3c7d1-6740-400b-8127-4ca4df7e5dd1 tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/785371979" status: 202 len: 0 microversion: 2.1 time: 0.021185 Oct 11 20:33:59.760455 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3149/6344] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 11 20:33:59 2022] DELETE /compute/v2.1/flavors/785371979 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:33:59.769055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-96f9e378-f36d-4c0d-a0c4-4bfc14e94634 tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:59.790396 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-96f9e378-f36d-4c0d-a0c4-4bfc14e94634 tempest-ServersAdminNegativeTestJSON-2031098391 tempest-ServersAdminNegativeTestJSON-2031098391-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025018 Oct 11 20:33:59.790989 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3196/6345] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 11 20:33:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:33:59.811585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e6de8207-dc1b-402d-98da-f7e7d1e601c4 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:59.812105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e6de8207-dc1b-402d-98da-f7e7d1e601c4 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:59.818141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6de8207-dc1b-402d-98da-f7e7d1e601c4 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.818681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6de8207-dc1b-402d-98da-f7e7d1e601c4 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.819142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6de8207-dc1b-402d-98da-f7e7d1e601c4 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.820111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6de8207-dc1b-402d-98da-f7e7d1e601c4 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.820586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6de8207-dc1b-402d-98da-f7e7d1e601c4 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.821029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e6de8207-dc1b-402d-98da-f7e7d1e601c4 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.849867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e6de8207-dc1b-402d-98da-f7e7d1e601c4 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:33:59.929321 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e6de8207-dc1b-402d-98da-f7e7d1e601c4 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 204 len: 0 microversion: 2.1 time: 0.121513 Oct 11 20:33:59.930432 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3150/6346] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:33:59 2022] DELETE /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:33:59.939055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6cf4523-8b1d-4016-8c36-3bfd29e18d60 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:33:59.939665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6cf4523-8b1d-4016-8c36-3bfd29e18d60 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:33:59.945735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6cf4523-8b1d-4016-8c36-3bfd29e18d60 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.946246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6cf4523-8b1d-4016-8c36-3bfd29e18d60 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.946701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6cf4523-8b1d-4016-8c36-3bfd29e18d60 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:33:59.947378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6cf4523-8b1d-4016-8c36-3bfd29e18d60 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:33:59.947826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6cf4523-8b1d-4016-8c36-3bfd29e18d60 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:33:59.948246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6cf4523-8b1d-4016-8c36-3bfd29e18d60 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:00.081924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f6cf4523-8b1d-4016-8c36-3bfd29e18d60 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:00.089804 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6cf4523-8b1d-4016-8c36-3bfd29e18d60 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1477 microversion: 2.1 time: 0.155522 Oct 11 20:34:00.090368 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3197/6347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:33:59 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:01.114498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-22de4b47-46b1-4c7d-9e7f-20cc5536f3fd tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:01.115250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-22de4b47-46b1-4c7d-9e7f-20cc5536f3fd tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:01.122224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22de4b47-46b1-4c7d-9e7f-20cc5536f3fd tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:01.122772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22de4b47-46b1-4c7d-9e7f-20cc5536f3fd tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:01.123236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22de4b47-46b1-4c7d-9e7f-20cc5536f3fd tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:01.123946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22de4b47-46b1-4c7d-9e7f-20cc5536f3fd tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:01.124422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22de4b47-46b1-4c7d-9e7f-20cc5536f3fd tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:01.124867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-22de4b47-46b1-4c7d-9e7f-20cc5536f3fd tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:01.338325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-22de4b47-46b1-4c7d-9e7f-20cc5536f3fd tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311ffe9a408a47e4ab81b275368093ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602f0da2c3884793aa22f3e1b285d9b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:01.347713 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-22de4b47-46b1-4c7d-9e7f-20cc5536f3fd tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 200 len: 1477 microversion: 2.1 time: 0.237491 Oct 11 20:34:01.348309 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3151/6348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:01 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 1477 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:01.676870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1aa11f1c-b517-4e79-80a2-b09bd675f5e4 req-2d9a06e5-3ad1-4d26-9cc1-92349c3269c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc9f778-87f8-41bc-b5bb-0df35cef14cf", "name": "network-vif-deleted", "tag": "5aac4b5a-922f-43cd-a544-517dbadd9b24"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:34:01.688504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1aa11f1c-b517-4e79-80a2-b09bd675f5e4 req-2d9a06e5-3ad1-4d26-9cc1-92349c3269c9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:01.689358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1aa11f1c-b517-4e79-80a2-b09bd675f5e4 req-2d9a06e5-3ad1-4d26-9cc1-92349c3269c9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:01.689713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1aa11f1c-b517-4e79-80a2-b09bd675f5e4 req-2d9a06e5-3ad1-4d26-9cc1-92349c3269c9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:01.703718 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1aa11f1c-b517-4e79-80a2-b09bd675f5e4 req-2d9a06e5-3ad1-4d26-9cc1-92349c3269c9 service nova] Creating event network-vif-deleted:5aac4b5a-922f-43cd-a544-517dbadd9b24 for instance 8fc9f778-87f8-41bc-b5bb-0df35cef14cf on n-h1-860864-3 Oct 11 20:34:01.708799 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1aa11f1c-b517-4e79-80a2-b09bd675f5e4 req-2d9a06e5-3ad1-4d26-9cc1-92349c3269c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035617 Oct 11 20:34:01.709413 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3198/6349] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:34:02.371344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:02.372545 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] [instance: 8fc9f778-87f8-41bc-b5bb-0df35cef14cf] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:02.380232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:02.380745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:02.381206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:02.381918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:02.382395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:02.382883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:02.397134 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] HTTP exception thrown: Instance 8fc9f778-87f8-41bc-b5bb-0df35cef14cf could not be found. Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Request method failure captured: Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf HTTP/1.1 Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdMqx0Am1NR0eKlny2IoF2_uHwJxRM_6DRr-tIhOgzLVRmmj-7gs2ice7s7dWPPeXnqB23rvKvuL4Qui_Hzhyw9XlPt5cySX9pBiBwA-Niej6tbi8jei1IRahR8BqZQi6mNIhvoKSwbHyrrOri1Fm2sjMn9F6FA6B7HPTRY-xMhLxSs Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 602f0da2c3884793aa22f3e1b285d9b9 Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1189412627 Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/602f0da2c3884793aa22f3e1b285d9b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_602f0da2c3884793aa22f3e1b285d9b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/602f0da2c3884793aa22f3e1b285d9b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/602f0da2c3884793aa22f3e1b285d9b9"}]}] Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1189412627 Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 602f0da2c3884793aa22f3e1b285d9b9 Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1189412627 Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersAdminNegativeTestJSON-1189412627-project Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 311ffe9a408a47e4ab81b275368093ab Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1189412627-project Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 8fc9f778-87f8-41bc-b5bb-0df35cef14cf could not be found. Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '8fc9f778-87f8-41bc-b5bb-0df35cef14cf'} Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc9f778-87f8-41bc-b5bb-0df35cef14cf could not be found. Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc9f778-87f8-41bc-b5bb-0df35cef14cf could not be found. Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:34:02.398854 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc9f778-87f8-41bc-b5bb-0df35cef14cf could not be found. Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] Returning 404 to user: Instance 8fc9f778-87f8-41bc-b5bb-0df35cef14cf could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-84893c5c-d60b-4c74-b7b5-e084b03d1344 tempest-ServersAdminNegativeTestJSON-1189412627 tempest-ServersAdminNegativeTestJSON-1189412627-project] 10.222.0.27 "GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf" status: 404 len: 111 microversion: 2.1 time: 0.033442 Oct 11 20:34:02.404739 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3152/6350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:02 2022] GET /compute/v2.1/servers/8fc9f778-87f8-41bc-b5bb-0df35cef14cf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:34:08.527957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-357408938", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "ecb86446-c15a-40a5-b85e-e249f3316636"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:34:08.596430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] validate_networks() for [('ecb86446-c15a-40a5-b85e-e249f3316636', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:34:09.001952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:34:09.002359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:34:09.002855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:34:09.003265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:34:09.003672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:34:09.012889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:09.013377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:09.014368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:09.015519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:09.015981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:09.016407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:09.034462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Getting quotas for project 6a50ea8a62654b64bd842ea8a9580611. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:34:09.039968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Getting quotas for user b1dce9a55a9b48259869bd42e9b7a5ff and project 6a50ea8a62654b64bd842ea8a9580611. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:34:09.052916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:34:09.055412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:34:09.104205 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ffade208-90e4-4ae0-aabd-ababcc635d82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749315 Oct 11 20:34:09.105045 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3199/6351] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:34:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:34:09.116712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4790e7b8-9646-480c-b55b-ab7f7a8ec179 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:09.117358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4790e7b8-9646-480c-b55b-ab7f7a8ec179 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:09.119895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:09.189416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4790e7b8-9646-480c-b55b-ab7f7a8ec179 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:09.197176 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4790e7b8-9646-480c-b55b-ab7f7a8ec179 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1214 microversion: 2.1 time: 0.084741 Oct 11 20:34:09.197751 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3153/6352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:09 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:10.222615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6a76c15c-3888-4b38-ac79-e3dcc8c1c61f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:10.223393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6a76c15c-3888-4b38-ac79-e3dcc8c1c61f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:10.230857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a76c15c-3888-4b38-ac79-e3dcc8c1c61f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:10.232253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a76c15c-3888-4b38-ac79-e3dcc8c1c61f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:10.232703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a76c15c-3888-4b38-ac79-e3dcc8c1c61f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:10.233634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a76c15c-3888-4b38-ac79-e3dcc8c1c61f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:10.234276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a76c15c-3888-4b38-ac79-e3dcc8c1c61f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:10.234748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6a76c15c-3888-4b38-ac79-e3dcc8c1c61f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:10.366305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6a76c15c-3888-4b38-ac79-e3dcc8c1c61f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:10.374971 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6a76c15c-3888-4b38-ac79-e3dcc8c1c61f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1266 microversion: 2.1 time: 0.157573 Oct 11 20:34:10.382309 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3200/6353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:10 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:11.410318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6dedbaca-be5a-467d-85c4-c06af9394217 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:11.411055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6dedbaca-be5a-467d-85c4-c06af9394217 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:11.413611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:11.423635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dedbaca-be5a-467d-85c4-c06af9394217 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:11.424399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dedbaca-be5a-467d-85c4-c06af9394217 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:11.424965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dedbaca-be5a-467d-85c4-c06af9394217 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:11.425774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dedbaca-be5a-467d-85c4-c06af9394217 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:11.426312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dedbaca-be5a-467d-85c4-c06af9394217 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:11.426774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6dedbaca-be5a-467d-85c4-c06af9394217 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:11.670459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6dedbaca-be5a-467d-85c4-c06af9394217 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:11.678257 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6dedbaca-be5a-467d-85c4-c06af9394217 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1314 microversion: 2.1 time: 0.272342 Oct 11 20:34:11.679236 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3154/6354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:11 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:11.846160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1511bd7b-af9b-4608-ae28-f2efc5ace1d6 req-2c1d504a-3b2e-4c6e-8f49-53c4efcab16a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63a6f62-3622-40e5-95ef-101a4eef3635", "tag": "181b107b-8d56-4ab3-96f5-3172ac707a0f"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:34:11.861520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1511bd7b-af9b-4608-ae28-f2efc5ace1d6 req-2c1d504a-3b2e-4c6e-8f49-53c4efcab16a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:11.862289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1511bd7b-af9b-4608-ae28-f2efc5ace1d6 req-2c1d504a-3b2e-4c6e-8f49-53c4efcab16a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:11.863110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1511bd7b-af9b-4608-ae28-f2efc5ace1d6 req-2c1d504a-3b2e-4c6e-8f49-53c4efcab16a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:11.879118 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1511bd7b-af9b-4608-ae28-f2efc5ace1d6 req-2c1d504a-3b2e-4c6e-8f49-53c4efcab16a service nova] Creating event network-changed:181b107b-8d56-4ab3-96f5-3172ac707a0f for instance d63a6f62-3622-40e5-95ef-101a4eef3635 on n-h1-860864-3 Oct 11 20:34:11.884570 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1511bd7b-af9b-4608-ae28-f2efc5ace1d6 req-2c1d504a-3b2e-4c6e-8f49-53c4efcab16a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043315 Oct 11 20:34:11.885342 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3201/6355] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:34:12.703154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a8deb04-3056-43da-86f5-a76bc0d49c08 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:12.703700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a8deb04-3056-43da-86f5-a76bc0d49c08 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:12.710730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a8deb04-3056-43da-86f5-a76bc0d49c08 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:12.711233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a8deb04-3056-43da-86f5-a76bc0d49c08 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:12.711679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a8deb04-3056-43da-86f5-a76bc0d49c08 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:12.712380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a8deb04-3056-43da-86f5-a76bc0d49c08 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:12.712873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a8deb04-3056-43da-86f5-a76bc0d49c08 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:12.713310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a8deb04-3056-43da-86f5-a76bc0d49c08 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:12.846340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4a8deb04-3056-43da-86f5-a76bc0d49c08 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:12.854116 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a8deb04-3056-43da-86f5-a76bc0d49c08 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1314 microversion: 2.1 time: 0.155711 Oct 11 20:34:12.854712 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3155/6356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:12 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:13.877879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c7516e64-4c7c-4f29-b64d-92e859410f19 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:13.878612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c7516e64-4c7c-4f29-b64d-92e859410f19 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:13.885407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7516e64-4c7c-4f29-b64d-92e859410f19 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:13.885892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7516e64-4c7c-4f29-b64d-92e859410f19 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:13.886334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7516e64-4c7c-4f29-b64d-92e859410f19 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:13.887045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7516e64-4c7c-4f29-b64d-92e859410f19 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:13.887998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7516e64-4c7c-4f29-b64d-92e859410f19 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:13.888428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c7516e64-4c7c-4f29-b64d-92e859410f19 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:14.021704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c7516e64-4c7c-4f29-b64d-92e859410f19 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:14.030305 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c7516e64-4c7c-4f29-b64d-92e859410f19 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1314 microversion: 2.1 time: 0.156727 Oct 11 20:34:14.030922 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3202/6357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:13 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:34:15.053248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-82623322-c846-46ab-9433-5dfc2bfd77ec tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:15.053882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-82623322-c846-46ab-9433-5dfc2bfd77ec tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:15.061411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82623322-c846-46ab-9433-5dfc2bfd77ec tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:15.061911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82623322-c846-46ab-9433-5dfc2bfd77ec tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:15.062359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82623322-c846-46ab-9433-5dfc2bfd77ec tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:15.063097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82623322-c846-46ab-9433-5dfc2bfd77ec tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:15.063569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82623322-c846-46ab-9433-5dfc2bfd77ec tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:15.064006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-82623322-c846-46ab-9433-5dfc2bfd77ec tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:15.203124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-82623322-c846-46ab-9433-5dfc2bfd77ec tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:15.210930 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-82623322-c846-46ab-9433-5dfc2bfd77ec tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1314 microversion: 2.1 time: 0.161522 Oct 11 20:34:15.211545 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3156/6358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:15 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:34:16.234495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70718e12-ac24-4250-a944-72f948c09a20 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:16.235170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-70718e12-ac24-4250-a944-72f948c09a20 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:16.241644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70718e12-ac24-4250-a944-72f948c09a20 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:16.242133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70718e12-ac24-4250-a944-72f948c09a20 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:16.242598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70718e12-ac24-4250-a944-72f948c09a20 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:16.243294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70718e12-ac24-4250-a944-72f948c09a20 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:16.243750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70718e12-ac24-4250-a944-72f948c09a20 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:16.244178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70718e12-ac24-4250-a944-72f948c09a20 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:16.376789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-70718e12-ac24-4250-a944-72f948c09a20 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:16.384516 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-70718e12-ac24-4250-a944-72f948c09a20 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1314 microversion: 2.1 time: 0.154657 Oct 11 20:34:16.385086 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3203/6359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:16 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:34:16.940124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-25056695-2ba4-4231-9be2-dd3ebb46b5e6 req-1787fb29-80bc-46e2-8fbe-065139189484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63a6f62-3622-40e5-95ef-101a4eef3635", "name": "network-vif-plugged", "status": "completed", "tag": "181b107b-8d56-4ab3-96f5-3172ac707a0f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:34:16.952285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-25056695-2ba4-4231-9be2-dd3ebb46b5e6 req-1787fb29-80bc-46e2-8fbe-065139189484 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:16.952794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-25056695-2ba4-4231-9be2-dd3ebb46b5e6 req-1787fb29-80bc-46e2-8fbe-065139189484 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:16.953249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-25056695-2ba4-4231-9be2-dd3ebb46b5e6 req-1787fb29-80bc-46e2-8fbe-065139189484 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:16.964656 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-25056695-2ba4-4231-9be2-dd3ebb46b5e6 req-1787fb29-80bc-46e2-8fbe-065139189484 service nova] Creating event network-vif-plugged:181b107b-8d56-4ab3-96f5-3172ac707a0f for instance d63a6f62-3622-40e5-95ef-101a4eef3635 on n-h1-860864-3 Oct 11 20:34:16.970879 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-25056695-2ba4-4231-9be2-dd3ebb46b5e6 req-1787fb29-80bc-46e2-8fbe-065139189484 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034433 Oct 11 20:34:16.971512 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3157/6360] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:34:17.408170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-779d6b74-ee68-4d5c-a6eb-01010fe01b82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:17.408689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-779d6b74-ee68-4d5c-a6eb-01010fe01b82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:17.415464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-779d6b74-ee68-4d5c-a6eb-01010fe01b82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:17.415980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-779d6b74-ee68-4d5c-a6eb-01010fe01b82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:17.416416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-779d6b74-ee68-4d5c-a6eb-01010fe01b82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:17.417100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-779d6b74-ee68-4d5c-a6eb-01010fe01b82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:17.417552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-779d6b74-ee68-4d5c-a6eb-01010fe01b82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:17.417967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-779d6b74-ee68-4d5c-a6eb-01010fe01b82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:17.550507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-779d6b74-ee68-4d5c-a6eb-01010fe01b82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:17.558219 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-779d6b74-ee68-4d5c-a6eb-01010fe01b82 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1314 microversion: 2.1 time: 0.154132 Oct 11 20:34:17.558830 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3204/6361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:17 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:18.583638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bc3bf889-f0d9-42ca-a6d9-fba0e2f41340 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:18.584362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bc3bf889-f0d9-42ca-a6d9-fba0e2f41340 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:18.586308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:18.593376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc3bf889-f0d9-42ca-a6d9-fba0e2f41340 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:18.593916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc3bf889-f0d9-42ca-a6d9-fba0e2f41340 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:18.594371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc3bf889-f0d9-42ca-a6d9-fba0e2f41340 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:18.595152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc3bf889-f0d9-42ca-a6d9-fba0e2f41340 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:18.595617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc3bf889-f0d9-42ca-a6d9-fba0e2f41340 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:18.596054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bc3bf889-f0d9-42ca-a6d9-fba0e2f41340 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:18.603856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:18.732103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bc3bf889-f0d9-42ca-a6d9-fba0e2f41340 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:18.739937 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bc3bf889-f0d9-42ca-a6d9-fba0e2f41340 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1501 microversion: 2.1 time: 0.161491 Oct 11 20:34:18.740527 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3158/6362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:18 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:18.763128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:34:18.765572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:18.768355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:18.777875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:18.778633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:18.779081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:18.779783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:18.780242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:18.780675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:18.785300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=80 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:18.808851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:18.814793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Old instance type m1.heat2, new instance type m1.heat {{(pid=126956) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:34:18.821545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:34:18.821972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:34:18.822562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:34:18.822981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:34:18.823393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:34:18.885890 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-93027afc-bba1-4981-a3f2-25ea2df276db tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "POST /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635/action" status: 202 len: 0 microversion: 2.1 time: 0.127134 Oct 11 20:34:18.886441 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3205/6363] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:34:18 2022] POST /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:34:18.895384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1bbc31db-2b0e-4f84-9696-3f21fc697555 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:18.895998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1bbc31db-2b0e-4f84-9696-3f21fc697555 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:18.901891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bbc31db-2b0e-4f84-9696-3f21fc697555 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:18.902414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bbc31db-2b0e-4f84-9696-3f21fc697555 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:18.903199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bbc31db-2b0e-4f84-9696-3f21fc697555 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:18.903905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bbc31db-2b0e-4f84-9696-3f21fc697555 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:18.904378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bbc31db-2b0e-4f84-9696-3f21fc697555 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:18.904828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bbc31db-2b0e-4f84-9696-3f21fc697555 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:19.077573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1bbc31db-2b0e-4f84-9696-3f21fc697555 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:19.085645 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1bbc31db-2b0e-4f84-9696-3f21fc697555 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1510 microversion: 2.1 time: 0.194092 Oct 11 20:34:19.086934 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3159/6364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:18 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:20.105745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=5 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:20.106730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:20.111901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-35b138ba-59f0-421f-b25e-9e93c2ffab38 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:20.112513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-35b138ba-59f0-421f-b25e-9e93c2ffab38 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:20.119502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b138ba-59f0-421f-b25e-9e93c2ffab38 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:20.119987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b138ba-59f0-421f-b25e-9e93c2ffab38 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:20.120423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b138ba-59f0-421f-b25e-9e93c2ffab38 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:20.121108 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b138ba-59f0-421f-b25e-9e93c2ffab38 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:20.121565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b138ba-59f0-421f-b25e-9e93c2ffab38 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:20.122066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35b138ba-59f0-421f-b25e-9e93c2ffab38 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:20.266302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35b138ba-59f0-421f-b25e-9e93c2ffab38 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:20.274405 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-35b138ba-59f0-421f-b25e-9e93c2ffab38 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1510 microversion: 2.1 time: 0.169346 Oct 11 20:34:20.275028 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3206/6365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:20 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:21.298001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ce9ced1c-7191-4dc7-a1ba-8dc7705d32a3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:21.298650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ce9ced1c-7191-4dc7-a1ba-8dc7705d32a3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:21.300557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:21.306677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce9ced1c-7191-4dc7-a1ba-8dc7705d32a3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:21.307170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce9ced1c-7191-4dc7-a1ba-8dc7705d32a3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:21.307614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce9ced1c-7191-4dc7-a1ba-8dc7705d32a3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:21.308316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce9ced1c-7191-4dc7-a1ba-8dc7705d32a3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:21.308782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce9ced1c-7191-4dc7-a1ba-8dc7705d32a3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:21.309286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce9ced1c-7191-4dc7-a1ba-8dc7705d32a3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:21.439550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce9ced1c-7191-4dc7-a1ba-8dc7705d32a3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:21.447530 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ce9ced1c-7191-4dc7-a1ba-8dc7705d32a3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.154075 Oct 11 20:34:21.448110 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3160/6366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:21 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:22.472308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-643177ca-c552-4129-af03-02af9f9cd477 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:22.472931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-643177ca-c552-4129-af03-02af9f9cd477 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:22.479854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-643177ca-c552-4129-af03-02af9f9cd477 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:22.480350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-643177ca-c552-4129-af03-02af9f9cd477 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:22.480790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-643177ca-c552-4129-af03-02af9f9cd477 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:22.482181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-643177ca-c552-4129-af03-02af9f9cd477 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:22.482667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-643177ca-c552-4129-af03-02af9f9cd477 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:22.483098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-643177ca-c552-4129-af03-02af9f9cd477 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:22.610904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-643177ca-c552-4129-af03-02af9f9cd477 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:22.618729 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-643177ca-c552-4129-af03-02af9f9cd477 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.150423 Oct 11 20:34:22.619302 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3207/6367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:22 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:23.642117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-56f30f07-5b1f-45ce-9cd1-ce2e667526c4 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:23.642774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-56f30f07-5b1f-45ce-9cd1-ce2e667526c4 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:23.649731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f30f07-5b1f-45ce-9cd1-ce2e667526c4 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:23.650228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f30f07-5b1f-45ce-9cd1-ce2e667526c4 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:23.650717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f30f07-5b1f-45ce-9cd1-ce2e667526c4 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:23.651420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f30f07-5b1f-45ce-9cd1-ce2e667526c4 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:23.651889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f30f07-5b1f-45ce-9cd1-ce2e667526c4 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:23.652327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-56f30f07-5b1f-45ce-9cd1-ce2e667526c4 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:23.781986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-56f30f07-5b1f-45ce-9cd1-ce2e667526c4 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:23.789994 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-56f30f07-5b1f-45ce-9cd1-ce2e667526c4 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.151819 Oct 11 20:34:23.790638 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3161/6368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:23 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:24.814604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e82b4b69-5b0e-4e40-a745-6e3355fc3cca tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:24.815231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e82b4b69-5b0e-4e40-a745-6e3355fc3cca tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:24.822368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e82b4b69-5b0e-4e40-a745-6e3355fc3cca tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:24.822893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e82b4b69-5b0e-4e40-a745-6e3355fc3cca tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:24.823338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e82b4b69-5b0e-4e40-a745-6e3355fc3cca tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:24.824075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e82b4b69-5b0e-4e40-a745-6e3355fc3cca tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:24.824520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e82b4b69-5b0e-4e40-a745-6e3355fc3cca tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:24.825684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e82b4b69-5b0e-4e40-a745-6e3355fc3cca tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:24.955597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e82b4b69-5b0e-4e40-a745-6e3355fc3cca tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:24.964060 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e82b4b69-5b0e-4e40-a745-6e3355fc3cca tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.153394 Oct 11 20:34:24.964649 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3208/6369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:24 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:25.988118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d14d46f9-7d93-44e6-a0b6-c11f0ba27bd0 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:25.988744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d14d46f9-7d93-44e6-a0b6-c11f0ba27bd0 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:25.995719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d14d46f9-7d93-44e6-a0b6-c11f0ba27bd0 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:25.996219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d14d46f9-7d93-44e6-a0b6-c11f0ba27bd0 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:25.996726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d14d46f9-7d93-44e6-a0b6-c11f0ba27bd0 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:25.998860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d14d46f9-7d93-44e6-a0b6-c11f0ba27bd0 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:25.999338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d14d46f9-7d93-44e6-a0b6-c11f0ba27bd0 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:25.999781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d14d46f9-7d93-44e6-a0b6-c11f0ba27bd0 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:26.131821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d14d46f9-7d93-44e6-a0b6-c11f0ba27bd0 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:26.139721 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d14d46f9-7d93-44e6-a0b6-c11f0ba27bd0 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.155587 Oct 11 20:34:26.140306 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3162/6370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:25 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:27.162771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1251d099-30f9-4ac5-a76b-6f0b50d81e8c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:27.163378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1251d099-30f9-4ac5-a76b-6f0b50d81e8c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:27.170277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1251d099-30f9-4ac5-a76b-6f0b50d81e8c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:27.170795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1251d099-30f9-4ac5-a76b-6f0b50d81e8c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:27.171227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1251d099-30f9-4ac5-a76b-6f0b50d81e8c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:27.171908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1251d099-30f9-4ac5-a76b-6f0b50d81e8c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:27.172389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1251d099-30f9-4ac5-a76b-6f0b50d81e8c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:27.172810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1251d099-30f9-4ac5-a76b-6f0b50d81e8c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:27.302308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1251d099-30f9-4ac5-a76b-6f0b50d81e8c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:27.310092 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1251d099-30f9-4ac5-a76b-6f0b50d81e8c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.151306 Oct 11 20:34:27.311250 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3209/6371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:27 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:28.335600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-851dd96c-3f59-41f4-b358-9a154ae9731f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:28.336176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-851dd96c-3f59-41f4-b358-9a154ae9731f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:28.343567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-851dd96c-3f59-41f4-b358-9a154ae9731f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:28.344074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-851dd96c-3f59-41f4-b358-9a154ae9731f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:28.344532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-851dd96c-3f59-41f4-b358-9a154ae9731f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:28.345245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-851dd96c-3f59-41f4-b358-9a154ae9731f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:28.345723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-851dd96c-3f59-41f4-b358-9a154ae9731f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:28.346170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-851dd96c-3f59-41f4-b358-9a154ae9731f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:28.480974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-851dd96c-3f59-41f4-b358-9a154ae9731f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:28.489392 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-851dd96c-3f59-41f4-b358-9a154ae9731f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.157853 Oct 11 20:34:28.489968 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3163/6372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:28 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:29.512492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9ea251db-2f5a-459b-a91a-861df3056208 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:29.513106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9ea251db-2f5a-459b-a91a-861df3056208 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:29.520700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea251db-2f5a-459b-a91a-861df3056208 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:29.521181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea251db-2f5a-459b-a91a-861df3056208 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:29.521617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea251db-2f5a-459b-a91a-861df3056208 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:29.522298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea251db-2f5a-459b-a91a-861df3056208 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:29.522772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea251db-2f5a-459b-a91a-861df3056208 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:29.523197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9ea251db-2f5a-459b-a91a-861df3056208 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:29.652868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9ea251db-2f5a-459b-a91a-861df3056208 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:29.660778 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9ea251db-2f5a-459b-a91a-861df3056208 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.152254 Oct 11 20:34:29.661359 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3210/6373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:29 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:30.684256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97a1b7d1-a651-41d1-9a2e-43042dc1d5ef tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:30.684891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97a1b7d1-a651-41d1-9a2e-43042dc1d5ef tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:30.691925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97a1b7d1-a651-41d1-9a2e-43042dc1d5ef tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:30.692426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97a1b7d1-a651-41d1-9a2e-43042dc1d5ef tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:30.692879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97a1b7d1-a651-41d1-9a2e-43042dc1d5ef tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:30.693592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97a1b7d1-a651-41d1-9a2e-43042dc1d5ef tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:30.694068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97a1b7d1-a651-41d1-9a2e-43042dc1d5ef tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:30.694511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97a1b7d1-a651-41d1-9a2e-43042dc1d5ef tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:30.828044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97a1b7d1-a651-41d1-9a2e-43042dc1d5ef tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:30.835858 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97a1b7d1-a651-41d1-9a2e-43042dc1d5ef tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.155481 Oct 11 20:34:30.836434 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3164/6374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:30 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:31.859918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-415e9d9e-5f7e-49d8-b84d-9b9fe617d4ab tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:31.860530 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-415e9d9e-5f7e-49d8-b84d-9b9fe617d4ab tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:31.867414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415e9d9e-5f7e-49d8-b84d-9b9fe617d4ab tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:31.867894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415e9d9e-5f7e-49d8-b84d-9b9fe617d4ab tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:31.868321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415e9d9e-5f7e-49d8-b84d-9b9fe617d4ab tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:31.868996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415e9d9e-5f7e-49d8-b84d-9b9fe617d4ab tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:31.869444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415e9d9e-5f7e-49d8-b84d-9b9fe617d4ab tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:31.869863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-415e9d9e-5f7e-49d8-b84d-9b9fe617d4ab tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:32.001481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-415e9d9e-5f7e-49d8-b84d-9b9fe617d4ab tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:32.009118 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-415e9d9e-5f7e-49d8-b84d-9b9fe617d4ab tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.153700 Oct 11 20:34:32.009688 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3211/6375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:31 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:33.032712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-165842be-068c-4d9e-8755-30b1dcd364b3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:33.033327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-165842be-068c-4d9e-8755-30b1dcd364b3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:33.040323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-165842be-068c-4d9e-8755-30b1dcd364b3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:33.040826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-165842be-068c-4d9e-8755-30b1dcd364b3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:33.041279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-165842be-068c-4d9e-8755-30b1dcd364b3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:33.041983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-165842be-068c-4d9e-8755-30b1dcd364b3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:33.042455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-165842be-068c-4d9e-8755-30b1dcd364b3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:33.042919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-165842be-068c-4d9e-8755-30b1dcd364b3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:33.173403 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-165842be-068c-4d9e-8755-30b1dcd364b3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:33.181283 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-165842be-068c-4d9e-8755-30b1dcd364b3 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.152651 Oct 11 20:34:33.181856 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3165/6376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:33 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:34.204894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff07fb41-3a9e-4ff9-9f84-82b6e5b8b33b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:34.205505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ff07fb41-3a9e-4ff9-9f84-82b6e5b8b33b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:34.212294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff07fb41-3a9e-4ff9-9f84-82b6e5b8b33b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:34.212802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff07fb41-3a9e-4ff9-9f84-82b6e5b8b33b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:34.213236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff07fb41-3a9e-4ff9-9f84-82b6e5b8b33b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:34.213912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff07fb41-3a9e-4ff9-9f84-82b6e5b8b33b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:34.214361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff07fb41-3a9e-4ff9-9f84-82b6e5b8b33b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:34.214808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff07fb41-3a9e-4ff9-9f84-82b6e5b8b33b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:34.348554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ff07fb41-3a9e-4ff9-9f84-82b6e5b8b33b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:34.356315 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff07fb41-3a9e-4ff9-9f84-82b6e5b8b33b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.155892 Oct 11 20:34:34.356889 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3212/6377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:34 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:35.379961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aa07746a-cfdd-43b2-a015-9b7e8ee6caea tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:35.380555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aa07746a-cfdd-43b2-a015-9b7e8ee6caea tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:35.387416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa07746a-cfdd-43b2-a015-9b7e8ee6caea tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:35.387918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa07746a-cfdd-43b2-a015-9b7e8ee6caea tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:35.388867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa07746a-cfdd-43b2-a015-9b7e8ee6caea tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:35.389380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa07746a-cfdd-43b2-a015-9b7e8ee6caea tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:35.389853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa07746a-cfdd-43b2-a015-9b7e8ee6caea tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:35.390295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aa07746a-cfdd-43b2-a015-9b7e8ee6caea tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:35.520169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-aa07746a-cfdd-43b2-a015-9b7e8ee6caea tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:35.527996 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aa07746a-cfdd-43b2-a015-9b7e8ee6caea tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.152311 Oct 11 20:34:35.528574 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3166/6378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:35 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:36.551923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2712eeaa-4c88-4402-a4a2-908d801c709c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:36.552559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2712eeaa-4c88-4402-a4a2-908d801c709c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:36.559447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2712eeaa-4c88-4402-a4a2-908d801c709c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:36.559929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2712eeaa-4c88-4402-a4a2-908d801c709c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:36.560587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2712eeaa-4c88-4402-a4a2-908d801c709c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:36.561267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2712eeaa-4c88-4402-a4a2-908d801c709c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:36.561720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2712eeaa-4c88-4402-a4a2-908d801c709c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:36.562140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2712eeaa-4c88-4402-a4a2-908d801c709c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:36.689893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2712eeaa-4c88-4402-a4a2-908d801c709c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:36.697939 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2712eeaa-4c88-4402-a4a2-908d801c709c tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.149974 Oct 11 20:34:36.698514 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3213/6379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:36 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:37.721438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d0977fd7-5989-4913-8a92-233e60e3143b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:37.722077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d0977fd7-5989-4913-8a92-233e60e3143b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:37.728616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0977fd7-5989-4913-8a92-233e60e3143b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:37.729127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0977fd7-5989-4913-8a92-233e60e3143b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:37.729589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0977fd7-5989-4913-8a92-233e60e3143b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:37.730296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0977fd7-5989-4913-8a92-233e60e3143b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:37.730799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0977fd7-5989-4913-8a92-233e60e3143b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:37.731245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0977fd7-5989-4913-8a92-233e60e3143b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:37.864633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d0977fd7-5989-4913-8a92-233e60e3143b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:37.872426 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d0977fd7-5989-4913-8a92-233e60e3143b tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.154963 Oct 11 20:34:37.873152 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3167/6380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:37 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:38.895951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78cbc6f8-9427-4f63-a6c9-f6d3e0e30121 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:38.896601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78cbc6f8-9427-4f63-a6c9-f6d3e0e30121 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:38.903459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cbc6f8-9427-4f63-a6c9-f6d3e0e30121 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:38.904006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cbc6f8-9427-4f63-a6c9-f6d3e0e30121 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:38.904661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cbc6f8-9427-4f63-a6c9-f6d3e0e30121 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:38.905362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cbc6f8-9427-4f63-a6c9-f6d3e0e30121 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:38.905823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cbc6f8-9427-4f63-a6c9-f6d3e0e30121 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:38.906256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78cbc6f8-9427-4f63-a6c9-f6d3e0e30121 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:39.033478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78cbc6f8-9427-4f63-a6c9-f6d3e0e30121 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:39.041249 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78cbc6f8-9427-4f63-a6c9-f6d3e0e30121 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.149213 Oct 11 20:34:39.041828 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3214/6381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:38 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:40.066143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6190c271-0c78-4ff9-a3a0-23057e64d537 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:40.066802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6190c271-0c78-4ff9-a3a0-23057e64d537 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:40.074023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6190c271-0c78-4ff9-a3a0-23057e64d537 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:40.074552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6190c271-0c78-4ff9-a3a0-23057e64d537 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:40.075001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6190c271-0c78-4ff9-a3a0-23057e64d537 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:40.075914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6190c271-0c78-4ff9-a3a0-23057e64d537 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:40.076642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6190c271-0c78-4ff9-a3a0-23057e64d537 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:40.077093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6190c271-0c78-4ff9-a3a0-23057e64d537 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:40.209983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6190c271-0c78-4ff9-a3a0-23057e64d537 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:40.218286 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6190c271-0c78-4ff9-a3a0-23057e64d537 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.156215 Oct 11 20:34:40.218893 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3168/6382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:40 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:41.242357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a7b802a8-4f3c-47b6-ad7a-75ac6e62d276 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:41.242997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a7b802a8-4f3c-47b6-ad7a-75ac6e62d276 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:41.250181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b802a8-4f3c-47b6-ad7a-75ac6e62d276 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:41.250700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b802a8-4f3c-47b6-ad7a-75ac6e62d276 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:41.251143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b802a8-4f3c-47b6-ad7a-75ac6e62d276 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:41.251836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b802a8-4f3c-47b6-ad7a-75ac6e62d276 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:41.252291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b802a8-4f3c-47b6-ad7a-75ac6e62d276 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:41.252715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a7b802a8-4f3c-47b6-ad7a-75ac6e62d276 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:41.380608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a7b802a8-4f3c-47b6-ad7a-75ac6e62d276 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:41.389460 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a7b802a8-4f3c-47b6-ad7a-75ac6e62d276 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.150799 Oct 11 20:34:41.390043 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3215/6383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:41 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:42.414862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d04c31a6-7d82-4f0e-a586-9f1737607d90 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:42.415499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d04c31a6-7d82-4f0e-a586-9f1737607d90 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:42.422728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d04c31a6-7d82-4f0e-a586-9f1737607d90 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:42.423233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d04c31a6-7d82-4f0e-a586-9f1737607d90 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:42.423688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d04c31a6-7d82-4f0e-a586-9f1737607d90 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:42.424396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d04c31a6-7d82-4f0e-a586-9f1737607d90 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:42.424867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d04c31a6-7d82-4f0e-a586-9f1737607d90 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:42.425309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d04c31a6-7d82-4f0e-a586-9f1737607d90 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:42.561237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d04c31a6-7d82-4f0e-a586-9f1737607d90 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:42.569050 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d04c31a6-7d82-4f0e-a586-9f1737607d90 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.159062 Oct 11 20:34:42.569634 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3169/6384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:42 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:43.592355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-337a6b59-7877-4ce1-84e3-5c79c871bcb9 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:43.593004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-337a6b59-7877-4ce1-84e3-5c79c871bcb9 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:43.599742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-337a6b59-7877-4ce1-84e3-5c79c871bcb9 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:43.600226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-337a6b59-7877-4ce1-84e3-5c79c871bcb9 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:43.600661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-337a6b59-7877-4ce1-84e3-5c79c871bcb9 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:43.601345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-337a6b59-7877-4ce1-84e3-5c79c871bcb9 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:43.601799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-337a6b59-7877-4ce1-84e3-5c79c871bcb9 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:43.602219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-337a6b59-7877-4ce1-84e3-5c79c871bcb9 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:43.733820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-337a6b59-7877-4ce1-84e3-5c79c871bcb9 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:43.741465 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-337a6b59-7877-4ce1-84e3-5c79c871bcb9 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.153125 Oct 11 20:34:43.742034 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3216/6385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:43 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:44.766247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-17838412-0142-453b-b767-d08498f8bb8a tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:44.766900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-17838412-0142-453b-b767-d08498f8bb8a tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:44.774998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17838412-0142-453b-b767-d08498f8bb8a tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:44.775489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17838412-0142-453b-b767-d08498f8bb8a tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:44.775939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17838412-0142-453b-b767-d08498f8bb8a tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:44.776655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17838412-0142-453b-b767-d08498f8bb8a tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:44.777123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17838412-0142-453b-b767-d08498f8bb8a tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:44.777558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-17838412-0142-453b-b767-d08498f8bb8a tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:44.915325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-17838412-0142-453b-b767-d08498f8bb8a tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:44.923392 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-17838412-0142-453b-b767-d08498f8bb8a tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.161900 Oct 11 20:34:44.923970 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3170/6386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:44 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:45.947206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9be1a55b-0413-44bd-b606-9703f54ed2cf tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:45.947812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9be1a55b-0413-44bd-b606-9703f54ed2cf tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:45.950138 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:34:45.950284 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 (ip 10.222.0.27) !!! Oct 11 20:34:45.960719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be1a55b-0413-44bd-b606-9703f54ed2cf tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:45.961209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be1a55b-0413-44bd-b606-9703f54ed2cf tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:45.961648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be1a55b-0413-44bd-b606-9703f54ed2cf tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:45.962347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be1a55b-0413-44bd-b606-9703f54ed2cf tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:45.962832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be1a55b-0413-44bd-b606-9703f54ed2cf tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:45.963261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9be1a55b-0413-44bd-b606-9703f54ed2cf tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:46.101451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9be1a55b-0413-44bd-b606-9703f54ed2cf tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:46.109874 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9be1a55b-0413-44bd-b606-9703f54ed2cf tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.166963 Oct 11 20:34:46.110456 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3217/6387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:45 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:47.132797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e72080a-5e89-4652-bbd4-14fa39e15712 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:47.133424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e72080a-5e89-4652-bbd4-14fa39e15712 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:47.140875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e72080a-5e89-4652-bbd4-14fa39e15712 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:47.141384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e72080a-5e89-4652-bbd4-14fa39e15712 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:47.141884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e72080a-5e89-4652-bbd4-14fa39e15712 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:47.142633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e72080a-5e89-4652-bbd4-14fa39e15712 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:47.143115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e72080a-5e89-4652-bbd4-14fa39e15712 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:47.143566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e72080a-5e89-4652-bbd4-14fa39e15712 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:47.272861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e72080a-5e89-4652-bbd4-14fa39e15712 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:47.281341 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e72080a-5e89-4652-bbd4-14fa39e15712 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1515 microversion: 2.1 time: 0.152354 Oct 11 20:34:47.284045 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3171/6388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:47 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:48.306039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-429e2b8e-57fe-4b05-ae27-fb3b5b3e177d tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:48.306672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-429e2b8e-57fe-4b05-ae27-fb3b5b3e177d tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:48.315994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-429e2b8e-57fe-4b05-ae27-fb3b5b3e177d tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:48.316481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-429e2b8e-57fe-4b05-ae27-fb3b5b3e177d tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:48.316919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-429e2b8e-57fe-4b05-ae27-fb3b5b3e177d tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:48.317824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-429e2b8e-57fe-4b05-ae27-fb3b5b3e177d tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:48.318652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-429e2b8e-57fe-4b05-ae27-fb3b5b3e177d tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:48.318746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-429e2b8e-57fe-4b05-ae27-fb3b5b3e177d tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:48.604796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-429e2b8e-57fe-4b05-ae27-fb3b5b3e177d tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:48.613054 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-429e2b8e-57fe-4b05-ae27-fb3b5b3e177d tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1514 microversion: 2.1 time: 0.311539 Oct 11 20:34:48.613639 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3218/6389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:48 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1514 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:48.658132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a6b25268-46de-4e65-83bf-d7bfe577ee36 req-c486ed17-2f9e-48a1-8473-d5a87ff13d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63a6f62-3622-40e5-95ef-101a4eef3635", "name": "network-vif-unplugged", "status": "completed", "tag": "181b107b-8d56-4ab3-96f5-3172ac707a0f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:34:48.663857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=28 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:48.670994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a6b25268-46de-4e65-83bf-d7bfe577ee36 req-c486ed17-2f9e-48a1-8473-d5a87ff13d34 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:48.671499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a6b25268-46de-4e65-83bf-d7bfe577ee36 req-c486ed17-2f9e-48a1-8473-d5a87ff13d34 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:48.671948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a6b25268-46de-4e65-83bf-d7bfe577ee36 req-c486ed17-2f9e-48a1-8473-d5a87ff13d34 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:48.676088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=84 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:48.684918 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a6b25268-46de-4e65-83bf-d7bfe577ee36 req-c486ed17-2f9e-48a1-8473-d5a87ff13d34 service nova] Creating event network-vif-unplugged:181b107b-8d56-4ab3-96f5-3172ac707a0f for instance d63a6f62-3622-40e5-95ef-101a4eef3635 on n-h2-860864-3 Oct 11 20:34:48.691101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-a6b25268-46de-4e65-83bf-d7bfe577ee36 req-c486ed17-2f9e-48a1-8473-d5a87ff13d34 service nova] Instance d63a6f62-3622-40e5-95ef-101a4eef3635 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:34:48.703215 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a6b25268-46de-4e65-83bf-d7bfe577ee36 req-c486ed17-2f9e-48a1-8473-d5a87ff13d34 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049093 Oct 11 20:34:48.703837 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3172/6390] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:34:49.637177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e6b24567-faad-4624-9234-007d7ae00d73 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:49.637795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e6b24567-faad-4624-9234-007d7ae00d73 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:49.641363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=32 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:49.646674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6b24567-faad-4624-9234-007d7ae00d73 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:49.647164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6b24567-faad-4624-9234-007d7ae00d73 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:49.647605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6b24567-faad-4624-9234-007d7ae00d73 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:49.648325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6b24567-faad-4624-9234-007d7ae00d73 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:49.648784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6b24567-faad-4624-9234-007d7ae00d73 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:49.649211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6b24567-faad-4624-9234-007d7ae00d73 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:49.653342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:34:49.786031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e6b24567-faad-4624-9234-007d7ae00d73 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:49.793865 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e6b24567-faad-4624-9234-007d7ae00d73 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1512 microversion: 2.1 time: 0.160618 Oct 11 20:34:49.794443 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3219/6391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:49 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:50.728809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-a3648020-f63a-43b0-b023-6bc83c44f9c0 req-471ad42d-22db-45dc-801a-b846ab376de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63a6f62-3622-40e5-95ef-101a4eef3635", "tag": "181b107b-8d56-4ab3-96f5-3172ac707a0f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:34:50.739352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a3648020-f63a-43b0-b023-6bc83c44f9c0 req-471ad42d-22db-45dc-801a-b846ab376de4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:50.739837 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a3648020-f63a-43b0-b023-6bc83c44f9c0 req-471ad42d-22db-45dc-801a-b846ab376de4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:50.740277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-a3648020-f63a-43b0-b023-6bc83c44f9c0 req-471ad42d-22db-45dc-801a-b846ab376de4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:50.751580 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-a3648020-f63a-43b0-b023-6bc83c44f9c0 req-471ad42d-22db-45dc-801a-b846ab376de4 service nova] Creating event network-changed:181b107b-8d56-4ab3-96f5-3172ac707a0f for instance d63a6f62-3622-40e5-95ef-101a4eef3635 on n-h2-860864-3 Oct 11 20:34:50.756805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-a3648020-f63a-43b0-b023-6bc83c44f9c0 req-471ad42d-22db-45dc-801a-b846ab376de4 service nova] Instance d63a6f62-3622-40e5-95ef-101a4eef3635 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:34:50.767379 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-a3648020-f63a-43b0-b023-6bc83c44f9c0 req-471ad42d-22db-45dc-801a-b846ab376de4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043547 Oct 11 20:34:50.767964 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3173/6392] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:34:50.818293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-371732f1-e80d-4bd6-87eb-33cea24b8f10 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:50.818999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-371732f1-e80d-4bd6-87eb-33cea24b8f10 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:50.826271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-371732f1-e80d-4bd6-87eb-33cea24b8f10 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:50.827205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-371732f1-e80d-4bd6-87eb-33cea24b8f10 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:50.827693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-371732f1-e80d-4bd6-87eb-33cea24b8f10 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:50.828401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-371732f1-e80d-4bd6-87eb-33cea24b8f10 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:50.828858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-371732f1-e80d-4bd6-87eb-33cea24b8f10 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:50.829292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-371732f1-e80d-4bd6-87eb-33cea24b8f10 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:51.145094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-371732f1-e80d-4bd6-87eb-33cea24b8f10 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:51.152968 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-371732f1-e80d-4bd6-87eb-33cea24b8f10 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1512 microversion: 2.1 time: 0.339160 Oct 11 20:34:51.153548 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3220/6393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:50 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1512 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:52.178609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e1e2724-ebfa-4bb0-96a9-e215089fc865 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:52.179321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e1e2724-ebfa-4bb0-96a9-e215089fc865 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:52.185573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e1e2724-ebfa-4bb0-96a9-e215089fc865 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:52.186073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e1e2724-ebfa-4bb0-96a9-e215089fc865 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:52.187211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e1e2724-ebfa-4bb0-96a9-e215089fc865 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:52.187940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e1e2724-ebfa-4bb0-96a9-e215089fc865 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:52.188407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e1e2724-ebfa-4bb0-96a9-e215089fc865 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:52.188845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e1e2724-ebfa-4bb0-96a9-e215089fc865 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:52.321250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2e1e2724-ebfa-4bb0-96a9-e215089fc865 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:52.329880 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2e1e2724-ebfa-4bb0-96a9-e215089fc865 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1509 microversion: 2.1 time: 0.156343 Oct 11 20:34:52.330451 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3174/6394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:52 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:52.351836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:52.352379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:52.359300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:52.359797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:52.360246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:52.360949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:52.361415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:52.361846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:52.391003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:34:52.440920 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.compute.api [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Found an unconfirmed migration during delete, id: 16, status: finished Oct 11 20:34:53.446968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8e144cc7-2347-46b9-a06c-e91954ac8d11 req-5d3d9a74-b333-4e2e-87f8-7d7a3066a747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63a6f62-3622-40e5-95ef-101a4eef3635", "name": "network-vif-plugged", "status": "completed", "tag": "181b107b-8d56-4ab3-96f5-3172ac707a0f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:34:53.458579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8e144cc7-2347-46b9-a06c-e91954ac8d11 req-5d3d9a74-b333-4e2e-87f8-7d7a3066a747 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:53.459086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8e144cc7-2347-46b9-a06c-e91954ac8d11 req-5d3d9a74-b333-4e2e-87f8-7d7a3066a747 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:53.459531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8e144cc7-2347-46b9-a06c-e91954ac8d11 req-5d3d9a74-b333-4e2e-87f8-7d7a3066a747 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:53.471631 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8e144cc7-2347-46b9-a06c-e91954ac8d11 req-5d3d9a74-b333-4e2e-87f8-7d7a3066a747 service nova] Creating event network-vif-plugged:181b107b-8d56-4ab3-96f5-3172ac707a0f for instance d63a6f62-3622-40e5-95ef-101a4eef3635 on n-h2-860864-3 Oct 11 20:34:53.477232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-8e144cc7-2347-46b9-a06c-e91954ac8d11 req-5d3d9a74-b333-4e2e-87f8-7d7a3066a747 service nova] Instance d63a6f62-3622-40e5-95ef-101a4eef3635 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:34:53.489692 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8e144cc7-2347-46b9-a06c-e91954ac8d11 req-5d3d9a74-b333-4e2e-87f8-7d7a3066a747 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045916 Oct 11 20:34:53.490312 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3175/6395] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:34:53.812924 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-417dff66-b1d6-445b-b0da-466a33bd91cb tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 204 len: 0 microversion: 2.1 time: 1.464613 Oct 11 20:34:53.813484 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3221/6396] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:34:52 2022] DELETE /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 0 bytes in 1466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:34:53.822428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2a7cc126-175a-4548-9f75-342465eb6a09 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:53.823274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2a7cc126-175a-4548-9f75-342465eb6a09 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:53.830461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a7cc126-175a-4548-9f75-342465eb6a09 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:53.831064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a7cc126-175a-4548-9f75-342465eb6a09 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:53.831587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a7cc126-175a-4548-9f75-342465eb6a09 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:53.832386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a7cc126-175a-4548-9f75-342465eb6a09 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:53.832923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a7cc126-175a-4548-9f75-342465eb6a09 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:53.833428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2a7cc126-175a-4548-9f75-342465eb6a09 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:53.966678 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2a7cc126-175a-4548-9f75-342465eb6a09 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:53.975144 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2a7cc126-175a-4548-9f75-342465eb6a09 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1501 microversion: 2.1 time: 0.157322 Oct 11 20:34:53.975717 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3176/6397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:53 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:34:54.998370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5cc1f35c-db41-467d-9926-b5188601e812 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:54.999560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5cc1f35c-db41-467d-9926-b5188601e812 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:55.006365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5cc1f35c-db41-467d-9926-b5188601e812 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:55.006892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5cc1f35c-db41-467d-9926-b5188601e812 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:55.007334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5cc1f35c-db41-467d-9926-b5188601e812 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:55.008026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5cc1f35c-db41-467d-9926-b5188601e812 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:55.008481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5cc1f35c-db41-467d-9926-b5188601e812 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:55.008906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5cc1f35c-db41-467d-9926-b5188601e812 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:55.207054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5cc1f35c-db41-467d-9926-b5188601e812 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1dce9a55a9b48259869bd42e9b7a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50ea8a62654b64bd842ea8a9580611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:34:55.214908 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5cc1f35c-db41-467d-9926-b5188601e812 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 200 len: 1501 microversion: 2.1 time: 0.220852 Oct 11 20:34:55.215488 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3222/6398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:54 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 1501 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:34:55.579147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-dc72a950-2f8a-466c-96d2-8459be882b07 req-5870e8b5-bd93-420d-81c4-19064923d829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63a6f62-3622-40e5-95ef-101a4eef3635", "name": "network-vif-deleted", "tag": "181b107b-8d56-4ab3-96f5-3172ac707a0f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:34:55.592025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dc72a950-2f8a-466c-96d2-8459be882b07 req-5870e8b5-bd93-420d-81c4-19064923d829 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:55.592716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dc72a950-2f8a-466c-96d2-8459be882b07 req-5870e8b5-bd93-420d-81c4-19064923d829 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:55.593239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dc72a950-2f8a-466c-96d2-8459be882b07 req-5870e8b5-bd93-420d-81c4-19064923d829 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:55.606516 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-dc72a950-2f8a-466c-96d2-8459be882b07 req-5870e8b5-bd93-420d-81c4-19064923d829 service nova] Creating event network-vif-deleted:181b107b-8d56-4ab3-96f5-3172ac707a0f for instance d63a6f62-3622-40e5-95ef-101a4eef3635 on n-h2-860864-3 Oct 11 20:34:55.612326 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-dc72a950-2f8a-466c-96d2-8459be882b07 req-5870e8b5-bd93-420d-81c4-19064923d829 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037782 Oct 11 20:34:55.613242 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3177/6399] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:34:56.238869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:56.239481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:56.246091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:56.246593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:56.247029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:56.247714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:56.248165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:56.248658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:56.262553 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] HTTP exception thrown: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Request method failure captured: Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 HTTP/1.1 Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdNAw7uT7T2l9eZ_7O6NcOaURkKtoetsUPFvueqcsT4PuYhMPpu4-fcpibAhBGssrJw1M8N_gKhUD5PWwGCAf09NbwIpRxBYK1X34ro5FRTGEIf8VsN1k0aA4dHiK2uQ3EBVVAcDjHcordYeE-gUtAfaveWKEilr7RuNRNzslYSuduQ Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 6a50ea8a62654b64bd842ea8a9580611 Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-DeleteServersTestJSON-1602632641 Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a50ea8a62654b64bd842ea8a9580611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a50ea8a62654b64bd842ea8a9580611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a50ea8a62654b64bd842ea8a9580611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a50ea8a62654b64bd842ea8a9580611"}]}] Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-DeleteServersTestJSON-1602632641 Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 6a50ea8a62654b64bd842ea8a9580611 Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632641 Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-DeleteServersTestJSON-1602632641-project Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: b1dce9a55a9b48259869bd42e9b7a5ff Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-DeleteServersTestJSON-1602632641-project Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'd63a6f62-3622-40e5-95ef-101a4eef3635'} Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:34:56.264240 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.268641 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:56.268641 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:34:56.268641 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:34:56.268641 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:34:56.268641 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:34:56.268641 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.268641 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.268641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Returning 404 to user: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:34:56.268641 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bcb6296e-f5dc-4590-9480-9dead2d424a1 tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 404 len: 111 microversion: 2.1 time: 0.030733 Oct 11 20:34:56.268641 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3223/6400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:56 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:34:56.281920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:56.282519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:56.288843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:56.289340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:56.289789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:56.290486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:56.290975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:56.291410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:56.304833 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] HTTP exception thrown: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Request method failure captured: Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 HTTP/1.1 Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdNAw7uT7T2l9eZ_7O6NcOaURkKtoetsUPFvueqcsT4PuYhMPpu4-fcpibAhBGssrJw1M8N_gKhUD5PWwGCAf09NbwIpRxBYK1X34ro5FRTGEIf8VsN1k0aA4dHiK2uQ3EBVVAcDjHcordYeE-gUtAfaveWKEilr7RuNRNzslYSuduQ Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 6a50ea8a62654b64bd842ea8a9580611 Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-DeleteServersTestJSON-1602632641 Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a50ea8a62654b64bd842ea8a9580611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a50ea8a62654b64bd842ea8a9580611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a50ea8a62654b64bd842ea8a9580611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a50ea8a62654b64bd842ea8a9580611"}]}] Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-DeleteServersTestJSON-1602632641 Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 6a50ea8a62654b64bd842ea8a9580611 Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632641 Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-DeleteServersTestJSON-1602632641-project Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: b1dce9a55a9b48259869bd42e9b7a5ff Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-DeleteServersTestJSON-1602632641-project Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'd63a6f62-3622-40e5-95ef-101a4eef3635'} Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:34:56.306464 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Returning 404 to user: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5b7fae93-9ca3-4439-ac6d-50c6768fd96f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 404 len: 111 microversion: 2.1 time: 0.030575 Oct 11 20:34:56.310347 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3178/6401] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:34:56 2022] DELETE /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:34:56.317725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:34:56.318375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] [instance: d63a6f62-3622-40e5-95ef-101a4eef3635] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:34:56.324634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:56.325121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:56.325562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:56.326248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:34:56.326738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:34:56.327481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:34:56.340915 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] HTTP exception thrown: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Request method failure captured: Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 HTTP/1.1 Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdNAw7uT7T2l9eZ_7O6NcOaURkKtoetsUPFvueqcsT4PuYhMPpu4-fcpibAhBGssrJw1M8N_gKhUD5PWwGCAf09NbwIpRxBYK1X34ro5FRTGEIf8VsN1k0aA4dHiK2uQ3EBVVAcDjHcordYeE-gUtAfaveWKEilr7RuNRNzslYSuduQ Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 6a50ea8a62654b64bd842ea8a9580611 Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-DeleteServersTestJSON-1602632641 Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a50ea8a62654b64bd842ea8a9580611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a50ea8a62654b64bd842ea8a9580611", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a50ea8a62654b64bd842ea8a9580611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a50ea8a62654b64bd842ea8a9580611"}]}] Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-DeleteServersTestJSON-1602632641 Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 6a50ea8a62654b64bd842ea8a9580611 Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602632641 Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-DeleteServersTestJSON-1602632641-project Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: b1dce9a55a9b48259869bd42e9b7a5ff Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-DeleteServersTestJSON-1602632641-project Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'd63a6f62-3622-40e5-95ef-101a4eef3635'} Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:34:56.342513 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.346396 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:34:56.346396 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:34:56.346396 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:34:56.346396 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:34:56.346396 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:34:56.346396 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. Oct 11 20:34:56.346396 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:34:56.346396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] Returning 404 to user: Instance d63a6f62-3622-40e5-95ef-101a4eef3635 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:34:56.346396 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2ef94cde-cec6-478c-b951-2ef5dfa62a9f tempest-DeleteServersTestJSON-1602632641 tempest-DeleteServersTestJSON-1602632641-project] 10.222.0.27 "GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635" status: 404 len: 111 microversion: 2.1 time: 0.030806 Oct 11 20:34:56.346396 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3224/6402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:34:56 2022] GET /compute/v2.1/servers/d63a6f62-3622-40e5-95ef-101a4eef3635 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:35:05.046078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1232923416", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "55c8ca22-3e6f-4cb0-8c43-1c5be84df754"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:05.106256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] validate_networks() for [('55c8ca22-3e6f-4cb0-8c43-1c5be84df754', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:35:05.488003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:35:05.488470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:35:05.488956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:35:05.489375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:35:05.489813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:35:05.499150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:05.499670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:05.500121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:05.500857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:05.501324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:05.501762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:05.518951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Getting quotas for project 1a96feeb52c6404c903aa288e4ffd73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:35:05.524197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Getting quotas for user 8968eed8964a4ea7b86e535625d48ec1 and project 1a96feeb52c6404c903aa288e4ffd73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:35:05.536986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:35:05.539346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:35:05.585737 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a93f926b-9544-4b40-972c-0194b0293fbb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668493 Oct 11 20:35:05.586314 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3179/6403] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:35:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:35:05.597668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f48668f-29db-4f1d-8e62-701d651e60c0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:05.598378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f48668f-29db-4f1d-8e62-701d651e60c0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:05.654728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f48668f-29db-4f1d-8e62-701d651e60c0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:05.661812 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f48668f-29db-4f1d-8e62-701d651e60c0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1218 microversion: 2.1 time: 0.068138 Oct 11 20:35:05.662441 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3225/6404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:05 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:06.685950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f13f6b0-858f-4adf-b083-99c2f23edafa tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:06.687719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f13f6b0-858f-4adf-b083-99c2f23edafa tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:06.697558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f13f6b0-858f-4adf-b083-99c2f23edafa tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:06.698295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f13f6b0-858f-4adf-b083-99c2f23edafa tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:06.698941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f13f6b0-858f-4adf-b083-99c2f23edafa tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:06.699817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f13f6b0-858f-4adf-b083-99c2f23edafa tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:06.700456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f13f6b0-858f-4adf-b083-99c2f23edafa tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:06.701040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f13f6b0-858f-4adf-b083-99c2f23edafa tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:06.804862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2f13f6b0-858f-4adf-b083-99c2f23edafa tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:06.813897 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f13f6b0-858f-4adf-b083-99c2f23edafa tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1288 microversion: 2.1 time: 0.132802 Oct 11 20:35:06.815267 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3180/6405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:06 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1288 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:07.837563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7c3c01b6-b95c-4840-9f04-f929be432994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:07.838285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7c3c01b6-b95c-4840-9f04-f929be432994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:07.842930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:07.848962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c3c01b6-b95c-4840-9f04-f929be432994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:07.850107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c3c01b6-b95c-4840-9f04-f929be432994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:07.850592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c3c01b6-b95c-4840-9f04-f929be432994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:07.851763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c3c01b6-b95c-4840-9f04-f929be432994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:07.852256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c3c01b6-b95c-4840-9f04-f929be432994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:07.852737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c3c01b6-b95c-4840-9f04-f929be432994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:08.064562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7c3c01b6-b95c-4840-9f04-f929be432994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:08.079706 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7c3c01b6-b95c-4840-9f04-f929be432994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1318 microversion: 2.1 time: 0.245922 Oct 11 20:35:08.091727 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3226/6406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:07 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:08.193469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-63b00971-d0bb-402a-bf6c-14e328917769 req-6f964438-4234-4357-a839-ffac51b41843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53328ab6-67ac-44b9-9059-ba24c8d99fd8", "tag": "c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:08.207431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-63b00971-d0bb-402a-bf6c-14e328917769 req-6f964438-4234-4357-a839-ffac51b41843 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:08.208173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-63b00971-d0bb-402a-bf6c-14e328917769 req-6f964438-4234-4357-a839-ffac51b41843 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:08.209206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-63b00971-d0bb-402a-bf6c-14e328917769 req-6f964438-4234-4357-a839-ffac51b41843 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:08.222235 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-63b00971-d0bb-402a-bf6c-14e328917769 req-6f964438-4234-4357-a839-ffac51b41843 service nova] Creating event network-changed:c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45 for instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 on n-h2-860864-3 Oct 11 20:35:08.228215 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-63b00971-d0bb-402a-bf6c-14e328917769 req-6f964438-4234-4357-a839-ffac51b41843 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040253 Oct 11 20:35:08.229117 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3181/6407] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:35:09.104485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c95dd43f-e60f-4eb2-bf80-faf57903d427 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:09.105125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c95dd43f-e60f-4eb2-bf80-faf57903d427 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:09.112175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c95dd43f-e60f-4eb2-bf80-faf57903d427 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:09.112690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c95dd43f-e60f-4eb2-bf80-faf57903d427 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:09.113127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c95dd43f-e60f-4eb2-bf80-faf57903d427 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:09.113816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c95dd43f-e60f-4eb2-bf80-faf57903d427 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:09.114272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c95dd43f-e60f-4eb2-bf80-faf57903d427 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:09.114731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c95dd43f-e60f-4eb2-bf80-faf57903d427 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:09.248040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c95dd43f-e60f-4eb2-bf80-faf57903d427 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:09.255832 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c95dd43f-e60f-4eb2-bf80-faf57903d427 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1318 microversion: 2.1 time: 0.155319 Oct 11 20:35:09.256407 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3227/6408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:09 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:10.280137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5f920835-9bb0-4b32-b65c-e13073a1462b tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:10.281018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f920835-9bb0-4b32-b65c-e13073a1462b tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:10.287250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f920835-9bb0-4b32-b65c-e13073a1462b tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:10.287741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f920835-9bb0-4b32-b65c-e13073a1462b tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:10.288191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f920835-9bb0-4b32-b65c-e13073a1462b tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:10.288883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f920835-9bb0-4b32-b65c-e13073a1462b tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:10.289348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f920835-9bb0-4b32-b65c-e13073a1462b tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:10.289780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f920835-9bb0-4b32-b65c-e13073a1462b tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:10.426570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5f920835-9bb0-4b32-b65c-e13073a1462b tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:10.434710 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5f920835-9bb0-4b32-b65c-e13073a1462b tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1318 microversion: 2.1 time: 0.159703 Oct 11 20:35:10.435385 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3182/6409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:10 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:11.458590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-93ae1ad4-eeee-43e5-945c-50bd415eca8a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:11.459243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-93ae1ad4-eeee-43e5-945c-50bd415eca8a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:11.466162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ae1ad4-eeee-43e5-945c-50bd415eca8a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:11.466681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ae1ad4-eeee-43e5-945c-50bd415eca8a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:11.467122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ae1ad4-eeee-43e5-945c-50bd415eca8a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:11.468759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ae1ad4-eeee-43e5-945c-50bd415eca8a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:11.469222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ae1ad4-eeee-43e5-945c-50bd415eca8a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:11.469649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-93ae1ad4-eeee-43e5-945c-50bd415eca8a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:11.600881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-93ae1ad4-eeee-43e5-945c-50bd415eca8a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:11.608788 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-93ae1ad4-eeee-43e5-945c-50bd415eca8a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1318 microversion: 2.1 time: 0.154444 Oct 11 20:35:11.609356 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3228/6410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:11 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:12.632077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97e3a61d-2722-44a4-96b9-3c186b582062 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:12.632626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97e3a61d-2722-44a4-96b9-3c186b582062 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:12.640323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e3a61d-2722-44a4-96b9-3c186b582062 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:12.640827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e3a61d-2722-44a4-96b9-3c186b582062 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:12.641285 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e3a61d-2722-44a4-96b9-3c186b582062 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:12.642001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e3a61d-2722-44a4-96b9-3c186b582062 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:12.642472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e3a61d-2722-44a4-96b9-3c186b582062 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:12.642942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97e3a61d-2722-44a4-96b9-3c186b582062 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:12.775936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97e3a61d-2722-44a4-96b9-3c186b582062 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:12.784089 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97e3a61d-2722-44a4-96b9-3c186b582062 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1318 microversion: 2.1 time: 0.155982 Oct 11 20:35:12.784706 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3183/6411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:12 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:13.522877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-54db3041-2c7c-4ef3-bb33-4ccd7e20200b req-8b1b0b5b-41ea-452e-a647-81609772e50c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53328ab6-67ac-44b9-9059-ba24c8d99fd8", "name": "network-vif-plugged", "status": "completed", "tag": "c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:13.533705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54db3041-2c7c-4ef3-bb33-4ccd7e20200b req-8b1b0b5b-41ea-452e-a647-81609772e50c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:13.534200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54db3041-2c7c-4ef3-bb33-4ccd7e20200b req-8b1b0b5b-41ea-452e-a647-81609772e50c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:13.534670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54db3041-2c7c-4ef3-bb33-4ccd7e20200b req-8b1b0b5b-41ea-452e-a647-81609772e50c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:13.546311 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-54db3041-2c7c-4ef3-bb33-4ccd7e20200b req-8b1b0b5b-41ea-452e-a647-81609772e50c service nova] Creating event network-vif-plugged:c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45 for instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 on n-h2-860864-3 Oct 11 20:35:13.551265 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-54db3041-2c7c-4ef3-bb33-4ccd7e20200b req-8b1b0b5b-41ea-452e-a647-81609772e50c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 Oct 11 20:35:13.551889 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3229/6412] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:35:13.808235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d519d9a-a8dd-4792-bb1d-eaef3b872eef tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:13.808852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0d519d9a-a8dd-4792-bb1d-eaef3b872eef tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:13.817060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d519d9a-a8dd-4792-bb1d-eaef3b872eef tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:13.817555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d519d9a-a8dd-4792-bb1d-eaef3b872eef tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:13.818002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d519d9a-a8dd-4792-bb1d-eaef3b872eef tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:13.818726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d519d9a-a8dd-4792-bb1d-eaef3b872eef tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:13.819192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d519d9a-a8dd-4792-bb1d-eaef3b872eef tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:13.819627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d519d9a-a8dd-4792-bb1d-eaef3b872eef tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:13.950657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0d519d9a-a8dd-4792-bb1d-eaef3b872eef tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:13.959174 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0d519d9a-a8dd-4792-bb1d-eaef3b872eef tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1318 microversion: 2.1 time: 0.154871 Oct 11 20:35:13.959745 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3184/6413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:13 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:14.984494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f27c4da6-8ca5-408b-a98b-9086757412b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:14.985228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f27c4da6-8ca5-408b-a98b-9086757412b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:14.991511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f27c4da6-8ca5-408b-a98b-9086757412b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:14.991944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f27c4da6-8ca5-408b-a98b-9086757412b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:14.992379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f27c4da6-8ca5-408b-a98b-9086757412b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:14.993067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f27c4da6-8ca5-408b-a98b-9086757412b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:14.993518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f27c4da6-8ca5-408b-a98b-9086757412b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:14.993951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f27c4da6-8ca5-408b-a98b-9086757412b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.127679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f27c4da6-8ca5-408b-a98b-9086757412b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:15.135524 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f27c4da6-8ca5-408b-a98b-9086757412b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1507 microversion: 2.1 time: 0.156811 Oct 11 20:35:15.136117 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3230/6414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:14 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:15.158321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8a93ccb7-f82f-47d7-a1df-e835d419b7c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:15.158980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8a93ccb7-f82f-47d7-a1df-e835d419b7c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:15.165964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a93ccb7-f82f-47d7-a1df-e835d419b7c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.166464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a93ccb7-f82f-47d7-a1df-e835d419b7c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.166948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a93ccb7-f82f-47d7-a1df-e835d419b7c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.167654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a93ccb7-f82f-47d7-a1df-e835d419b7c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.168124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a93ccb7-f82f-47d7-a1df-e835d419b7c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.168564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8a93ccb7-f82f-47d7-a1df-e835d419b7c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.299264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8a93ccb7-f82f-47d7-a1df-e835d419b7c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:15.307074 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8a93ccb7-f82f-47d7-a1df-e835d419b7c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1507 microversion: 2.1 time: 0.152673 Oct 11 20:35:15.307652 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3185/6415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:15 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:15.330373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ad3dcb4f-4ccc-4e1f-9323-b42017686598 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:15.332791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ad3dcb4f-4ccc-4e1f-9323-b42017686598 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:15.338726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3dcb4f-4ccc-4e1f-9323-b42017686598 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.339208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3dcb4f-4ccc-4e1f-9323-b42017686598 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.339641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3dcb4f-4ccc-4e1f-9323-b42017686598 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.340325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3dcb4f-4ccc-4e1f-9323-b42017686598 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.340774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3dcb4f-4ccc-4e1f-9323-b42017686598 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.341193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad3dcb4f-4ccc-4e1f-9323-b42017686598 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.404551 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ad3dcb4f-4ccc-4e1f-9323-b42017686598 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "PUT /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1079 microversion: 2.1 time: 0.078159 Oct 11 20:35:15.406226 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3231/6416] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 11 20:35:15 2022] PUT /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1079 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:15.425138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-799a3b8d-cb24-48f2-9d43-57600c0c66ff tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:15.425757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-799a3b8d-cb24-48f2-9d43-57600c0c66ff tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:15.431725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799a3b8d-cb24-48f2-9d43-57600c0c66ff tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.432218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799a3b8d-cb24-48f2-9d43-57600c0c66ff tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.432659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799a3b8d-cb24-48f2-9d43-57600c0c66ff tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.433656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799a3b8d-cb24-48f2-9d43-57600c0c66ff tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.434125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799a3b8d-cb24-48f2-9d43-57600c0c66ff tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.434580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-799a3b8d-cb24-48f2-9d43-57600c0c66ff tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.509312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:15.531296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:15.567217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-799a3b8d-cb24-48f2-9d43-57600c0c66ff tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:15.575151 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-799a3b8d-cb24-48f2-9d43-57600c0c66ff tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1505 microversion: 2.1 time: 0.154807 Oct 11 20:35:15.575728 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3186/6417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:15 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:15.597803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-55ff9660-94f8-4b29-97f0-febc001f852c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:15.598418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-55ff9660-94f8-4b29-97f0-febc001f852c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:15.604402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55ff9660-94f8-4b29-97f0-febc001f852c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.604888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55ff9660-94f8-4b29-97f0-febc001f852c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.605322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55ff9660-94f8-4b29-97f0-febc001f852c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.606005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55ff9660-94f8-4b29-97f0-febc001f852c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.606464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55ff9660-94f8-4b29-97f0-febc001f852c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.606915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-55ff9660-94f8-4b29-97f0-febc001f852c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.659186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:15.736601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-55ff9660-94f8-4b29-97f0-febc001f852c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:15.744453 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-55ff9660-94f8-4b29-97f0-febc001f852c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1505 microversion: 2.1 time: 0.150617 Oct 11 20:35:15.745054 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3232/6418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:15 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:15.767115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:15.769318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:15.775356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.775859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.776318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.777029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.777504 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.777949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.806259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:15.811824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Old instance type m1.heat2, new instance type m1.heat {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:35:15.818314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:35:15.818791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:35:15.819281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:35:15.819708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:35:15.820136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:35:15.882550 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c22ee680-f745-4e3c-a605-a687aa5cccf9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "POST /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8/action" status: 202 len: 0 microversion: 2.1 time: 0.120024 Oct 11 20:35:15.883168 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3187/6419] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:35:15 2022] POST /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:35:15.892811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40231150-3558-41c2-8977-0b87d6c3d87f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:15.893523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-40231150-3558-41c2-8977-0b87d6c3d87f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:15.900063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40231150-3558-41c2-8977-0b87d6c3d87f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.900628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40231150-3558-41c2-8977-0b87d6c3d87f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.901138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40231150-3558-41c2-8977-0b87d6c3d87f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:15.901901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40231150-3558-41c2-8977-0b87d6c3d87f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:15.902434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40231150-3558-41c2-8977-0b87d6c3d87f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:15.902982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40231150-3558-41c2-8977-0b87d6c3d87f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:16.063220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-40231150-3558-41c2-8977-0b87d6c3d87f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:16.072125 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40231150-3558-41c2-8977-0b87d6c3d87f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1516 microversion: 2.1 time: 0.184355 Oct 11 20:35:16.072835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3233/6420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:15 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:17.097163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3d22bd0c-2a03-45a5-891f-a4a02eb6afcb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:17.097964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3d22bd0c-2a03-45a5-891f-a4a02eb6afcb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:17.105182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d22bd0c-2a03-45a5-891f-a4a02eb6afcb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:17.105773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d22bd0c-2a03-45a5-891f-a4a02eb6afcb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:17.106232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d22bd0c-2a03-45a5-891f-a4a02eb6afcb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:17.106975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d22bd0c-2a03-45a5-891f-a4a02eb6afcb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:17.107445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d22bd0c-2a03-45a5-891f-a4a02eb6afcb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:17.107892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3d22bd0c-2a03-45a5-891f-a4a02eb6afcb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:17.329583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3d22bd0c-2a03-45a5-891f-a4a02eb6afcb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:17.337632 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3d22bd0c-2a03-45a5-891f-a4a02eb6afcb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1516 microversion: 2.1 time: 0.245795 Oct 11 20:35:17.338215 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3188/6421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:17 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:35:18.362432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c972b611-1693-4298-9712-ac39829a63be tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:18.363083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c972b611-1693-4298-9712-ac39829a63be tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:18.369961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c972b611-1693-4298-9712-ac39829a63be tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:18.370445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c972b611-1693-4298-9712-ac39829a63be tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:18.370906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c972b611-1693-4298-9712-ac39829a63be tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:18.371589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c972b611-1693-4298-9712-ac39829a63be tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:18.372039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c972b611-1693-4298-9712-ac39829a63be tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:18.372460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c972b611-1693-4298-9712-ac39829a63be tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:18.507059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c972b611-1693-4298-9712-ac39829a63be tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:18.514774 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c972b611-1693-4298-9712-ac39829a63be tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.157357 Oct 11 20:35:18.515541 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3234/6422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:18 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:19.538323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca548d7e-598b-445c-ad75-5164cc7d00da tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:19.538976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca548d7e-598b-445c-ad75-5164cc7d00da tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:19.541665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:19.547547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca548d7e-598b-445c-ad75-5164cc7d00da tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:19.548055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca548d7e-598b-445c-ad75-5164cc7d00da tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:19.548514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca548d7e-598b-445c-ad75-5164cc7d00da tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:19.549221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca548d7e-598b-445c-ad75-5164cc7d00da tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:19.549693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca548d7e-598b-445c-ad75-5164cc7d00da tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:19.550135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca548d7e-598b-445c-ad75-5164cc7d00da tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:19.554659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:19.684551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca548d7e-598b-445c-ad75-5164cc7d00da tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:19.692954 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca548d7e-598b-445c-ad75-5164cc7d00da tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.158608 Oct 11 20:35:19.693530 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3189/6423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:19 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:20.716995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78081e99-7765-4332-8bce-efaf3e73bbcd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:20.717618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78081e99-7765-4332-8bce-efaf3e73bbcd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:20.721244 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:20.726670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78081e99-7765-4332-8bce-efaf3e73bbcd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:20.727158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78081e99-7765-4332-8bce-efaf3e73bbcd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:20.727598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78081e99-7765-4332-8bce-efaf3e73bbcd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:20.728286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78081e99-7765-4332-8bce-efaf3e73bbcd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:20.728758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78081e99-7765-4332-8bce-efaf3e73bbcd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:20.729167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78081e99-7765-4332-8bce-efaf3e73bbcd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:20.858749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78081e99-7765-4332-8bce-efaf3e73bbcd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:20.867052 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78081e99-7765-4332-8bce-efaf3e73bbcd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.153983 Oct 11 20:35:20.867623 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3235/6424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:20 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:21.890175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-647a3d9e-7901-4521-b9f4-05c96d5e5b71 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:21.890851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-647a3d9e-7901-4521-b9f4-05c96d5e5b71 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:21.897737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647a3d9e-7901-4521-b9f4-05c96d5e5b71 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:21.898235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647a3d9e-7901-4521-b9f4-05c96d5e5b71 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:21.898720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647a3d9e-7901-4521-b9f4-05c96d5e5b71 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:21.899418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647a3d9e-7901-4521-b9f4-05c96d5e5b71 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:21.899887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647a3d9e-7901-4521-b9f4-05c96d5e5b71 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:21.900321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-647a3d9e-7901-4521-b9f4-05c96d5e5b71 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:22.031493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-647a3d9e-7901-4521-b9f4-05c96d5e5b71 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:22.039203 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-647a3d9e-7901-4521-b9f4-05c96d5e5b71 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.153111 Oct 11 20:35:22.039775 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3190/6425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:21 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:23.064130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-714ceec1-9f9f-4bb3-a448-9c91df4bd943 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:23.064646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-714ceec1-9f9f-4bb3-a448-9c91df4bd943 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:23.071526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-714ceec1-9f9f-4bb3-a448-9c91df4bd943 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:23.072264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-714ceec1-9f9f-4bb3-a448-9c91df4bd943 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:23.072700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-714ceec1-9f9f-4bb3-a448-9c91df4bd943 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:23.073388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-714ceec1-9f9f-4bb3-a448-9c91df4bd943 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:23.073838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-714ceec1-9f9f-4bb3-a448-9c91df4bd943 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:23.074257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-714ceec1-9f9f-4bb3-a448-9c91df4bd943 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:23.206693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-714ceec1-9f9f-4bb3-a448-9c91df4bd943 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:23.214454 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-714ceec1-9f9f-4bb3-a448-9c91df4bd943 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.154357 Oct 11 20:35:23.215072 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3236/6426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:23 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:24.238995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-64645fd7-98b8-4591-98dd-305cd2ad9a99 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:24.240122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-64645fd7-98b8-4591-98dd-305cd2ad9a99 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:24.247317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64645fd7-98b8-4591-98dd-305cd2ad9a99 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:24.247818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64645fd7-98b8-4591-98dd-305cd2ad9a99 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:24.248266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64645fd7-98b8-4591-98dd-305cd2ad9a99 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:24.248980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64645fd7-98b8-4591-98dd-305cd2ad9a99 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:24.249457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64645fd7-98b8-4591-98dd-305cd2ad9a99 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:24.249917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64645fd7-98b8-4591-98dd-305cd2ad9a99 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:24.385133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-64645fd7-98b8-4591-98dd-305cd2ad9a99 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:24.394406 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-64645fd7-98b8-4591-98dd-305cd2ad9a99 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.159270 Oct 11 20:35:24.395403 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3191/6427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:24 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:25.418936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cdaa7942-37c2-4345-8527-3ab788980e7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:25.419582 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cdaa7942-37c2-4345-8527-3ab788980e7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:25.426574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdaa7942-37c2-4345-8527-3ab788980e7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:25.427064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdaa7942-37c2-4345-8527-3ab788980e7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:25.427502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdaa7942-37c2-4345-8527-3ab788980e7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:25.428185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdaa7942-37c2-4345-8527-3ab788980e7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:25.428639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdaa7942-37c2-4345-8527-3ab788980e7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:25.429071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdaa7942-37c2-4345-8527-3ab788980e7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:25.562176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cdaa7942-37c2-4345-8527-3ab788980e7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:25.570469 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cdaa7942-37c2-4345-8527-3ab788980e7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.155517 Oct 11 20:35:25.571064 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3237/6428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:25 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:26.594621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a88b31b0-02c6-444b-a947-fb14a4cc653f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:26.595284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a88b31b0-02c6-444b-a947-fb14a4cc653f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:26.602271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88b31b0-02c6-444b-a947-fb14a4cc653f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:26.602801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88b31b0-02c6-444b-a947-fb14a4cc653f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:26.603254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88b31b0-02c6-444b-a947-fb14a4cc653f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:26.603949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88b31b0-02c6-444b-a947-fb14a4cc653f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:26.604417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88b31b0-02c6-444b-a947-fb14a4cc653f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:26.604852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a88b31b0-02c6-444b-a947-fb14a4cc653f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:26.736494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a88b31b0-02c6-444b-a947-fb14a4cc653f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:26.744242 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a88b31b0-02c6-444b-a947-fb14a4cc653f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.153757 Oct 11 20:35:26.744812 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3192/6429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:26 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:27.769113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bae89be8-b0c6-405d-858b-6603063c8dd7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:27.769730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bae89be8-b0c6-405d-858b-6603063c8dd7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:27.776736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae89be8-b0c6-405d-858b-6603063c8dd7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:27.777225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae89be8-b0c6-405d-858b-6603063c8dd7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:27.777660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae89be8-b0c6-405d-858b-6603063c8dd7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:27.778345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae89be8-b0c6-405d-858b-6603063c8dd7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:27.778827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae89be8-b0c6-405d-858b-6603063c8dd7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:27.779254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bae89be8-b0c6-405d-858b-6603063c8dd7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:27.934430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bae89be8-b0c6-405d-858b-6603063c8dd7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:27.943272 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bae89be8-b0c6-405d-858b-6603063c8dd7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.179152 Oct 11 20:35:27.943868 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3238/6430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:27 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:28.967566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-692a7df0-b53c-4441-a17b-895ae5d15b34 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:28.968195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-692a7df0-b53c-4441-a17b-895ae5d15b34 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:28.975561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-692a7df0-b53c-4441-a17b-895ae5d15b34 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:28.976061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-692a7df0-b53c-4441-a17b-895ae5d15b34 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:28.976512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-692a7df0-b53c-4441-a17b-895ae5d15b34 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:28.977215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-692a7df0-b53c-4441-a17b-895ae5d15b34 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:28.977684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-692a7df0-b53c-4441-a17b-895ae5d15b34 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:28.978119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-692a7df0-b53c-4441-a17b-895ae5d15b34 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:29.110187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-692a7df0-b53c-4441-a17b-895ae5d15b34 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:29.118150 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-692a7df0-b53c-4441-a17b-895ae5d15b34 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.154541 Oct 11 20:35:29.118748 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3193/6431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:28 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:30.142809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5dd0e8a5-c3c4-44bb-8ee0-81452ac1b4cd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:30.143430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5dd0e8a5-c3c4-44bb-8ee0-81452ac1b4cd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:30.150370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd0e8a5-c3c4-44bb-8ee0-81452ac1b4cd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:30.150899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd0e8a5-c3c4-44bb-8ee0-81452ac1b4cd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:30.151343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd0e8a5-c3c4-44bb-8ee0-81452ac1b4cd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:30.152033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd0e8a5-c3c4-44bb-8ee0-81452ac1b4cd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:30.152519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd0e8a5-c3c4-44bb-8ee0-81452ac1b4cd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:30.152946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd0e8a5-c3c4-44bb-8ee0-81452ac1b4cd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:30.280269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5dd0e8a5-c3c4-44bb-8ee0-81452ac1b4cd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:30.288687 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5dd0e8a5-c3c4-44bb-8ee0-81452ac1b4cd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.150299 Oct 11 20:35:30.289255 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3239/6432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:30 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:31.313480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-771e1ff4-9437-4ccb-8727-c28357347771 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:31.314116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-771e1ff4-9437-4ccb-8727-c28357347771 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:31.321100 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-771e1ff4-9437-4ccb-8727-c28357347771 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:31.321600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-771e1ff4-9437-4ccb-8727-c28357347771 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:31.322305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-771e1ff4-9437-4ccb-8727-c28357347771 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:31.323033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-771e1ff4-9437-4ccb-8727-c28357347771 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:31.323505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-771e1ff4-9437-4ccb-8727-c28357347771 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:31.323946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-771e1ff4-9437-4ccb-8727-c28357347771 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:31.456173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-771e1ff4-9437-4ccb-8727-c28357347771 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:31.463863 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-771e1ff4-9437-4ccb-8727-c28357347771 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.155175 Oct 11 20:35:31.464428 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3194/6433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:31 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:32.488174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e204c60-6f66-48b6-978c-4b889be0c30f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:32.488788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e204c60-6f66-48b6-978c-4b889be0c30f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:32.495702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e204c60-6f66-48b6-978c-4b889be0c30f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:32.496188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e204c60-6f66-48b6-978c-4b889be0c30f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:32.496626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e204c60-6f66-48b6-978c-4b889be0c30f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:32.497310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e204c60-6f66-48b6-978c-4b889be0c30f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:32.497767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e204c60-6f66-48b6-978c-4b889be0c30f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:32.498193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e204c60-6f66-48b6-978c-4b889be0c30f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:32.626397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e204c60-6f66-48b6-978c-4b889be0c30f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:32.634283 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e204c60-6f66-48b6-978c-4b889be0c30f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.151108 Oct 11 20:35:32.634892 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3240/6434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:32 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:33.658595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b83e4b4-d5be-4b8e-8fb6-ed8c5f9836b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:33.659228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b83e4b4-d5be-4b8e-8fb6-ed8c5f9836b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:33.666119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b83e4b4-d5be-4b8e-8fb6-ed8c5f9836b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:33.666662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b83e4b4-d5be-4b8e-8fb6-ed8c5f9836b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:33.667126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b83e4b4-d5be-4b8e-8fb6-ed8c5f9836b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:33.667834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b83e4b4-d5be-4b8e-8fb6-ed8c5f9836b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:33.668309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b83e4b4-d5be-4b8e-8fb6-ed8c5f9836b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:33.668755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b83e4b4-d5be-4b8e-8fb6-ed8c5f9836b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:33.800159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b83e4b4-d5be-4b8e-8fb6-ed8c5f9836b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:33.807907 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b83e4b4-d5be-4b8e-8fb6-ed8c5f9836b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.153892 Oct 11 20:35:33.808488 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3195/6435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:33 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:34.833347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e6bf5a89-3deb-49fc-beb6-a74530801b50 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:34.833964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e6bf5a89-3deb-49fc-beb6-a74530801b50 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:34.840917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bf5a89-3deb-49fc-beb6-a74530801b50 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:34.841403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bf5a89-3deb-49fc-beb6-a74530801b50 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:34.841842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bf5a89-3deb-49fc-beb6-a74530801b50 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:34.842548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bf5a89-3deb-49fc-beb6-a74530801b50 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:34.843005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bf5a89-3deb-49fc-beb6-a74530801b50 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:34.843429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bf5a89-3deb-49fc-beb6-a74530801b50 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:34.972625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e6bf5a89-3deb-49fc-beb6-a74530801b50 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:34.980402 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e6bf5a89-3deb-49fc-beb6-a74530801b50 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.152090 Oct 11 20:35:34.980978 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3241/6436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:34 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:36.005040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-336abf83-498b-4695-b456-14f25a7ec486 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:36.005664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-336abf83-498b-4695-b456-14f25a7ec486 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:36.011893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-336abf83-498b-4695-b456-14f25a7ec486 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:36.012389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-336abf83-498b-4695-b456-14f25a7ec486 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:36.012836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-336abf83-498b-4695-b456-14f25a7ec486 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:36.013535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-336abf83-498b-4695-b456-14f25a7ec486 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:36.013997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-336abf83-498b-4695-b456-14f25a7ec486 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:36.014430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-336abf83-498b-4695-b456-14f25a7ec486 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:36.146325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-336abf83-498b-4695-b456-14f25a7ec486 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:36.154056 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-336abf83-498b-4695-b456-14f25a7ec486 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.153157 Oct 11 20:35:36.154658 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3196/6437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:35 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:37.177943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b3ca6338-f376-4904-a9bf-86160a1f0028 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:37.178575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b3ca6338-f376-4904-a9bf-86160a1f0028 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:37.185468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ca6338-f376-4904-a9bf-86160a1f0028 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:37.185949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ca6338-f376-4904-a9bf-86160a1f0028 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:37.186751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ca6338-f376-4904-a9bf-86160a1f0028 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:37.188507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ca6338-f376-4904-a9bf-86160a1f0028 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:37.188980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ca6338-f376-4904-a9bf-86160a1f0028 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:37.189411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b3ca6338-f376-4904-a9bf-86160a1f0028 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:37.211216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:37.324973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b3ca6338-f376-4904-a9bf-86160a1f0028 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:37.333382 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b3ca6338-f376-4904-a9bf-86160a1f0028 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.159297 Oct 11 20:35:37.333918 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3242/6438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:37 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:38.356114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3feab8ba-437c-487a-9cde-cd71be7abdfb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:38.356769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3feab8ba-437c-487a-9cde-cd71be7abdfb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:38.364441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3feab8ba-437c-487a-9cde-cd71be7abdfb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:38.364933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3feab8ba-437c-487a-9cde-cd71be7abdfb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:38.365382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3feab8ba-437c-487a-9cde-cd71be7abdfb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:38.366072 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3feab8ba-437c-487a-9cde-cd71be7abdfb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:38.366616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3feab8ba-437c-487a-9cde-cd71be7abdfb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:38.367061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3feab8ba-437c-487a-9cde-cd71be7abdfb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:38.495588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3feab8ba-437c-487a-9cde-cd71be7abdfb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:38.503481 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3feab8ba-437c-487a-9cde-cd71be7abdfb tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.151262 Oct 11 20:35:38.504049 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3197/6439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:38 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:39.525937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c1056613-ab8b-4bd4-8278-b30d27ed3370 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:39.526571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1056613-ab8b-4bd4-8278-b30d27ed3370 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:39.534177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1056613-ab8b-4bd4-8278-b30d27ed3370 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:39.534688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1056613-ab8b-4bd4-8278-b30d27ed3370 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:39.535122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1056613-ab8b-4bd4-8278-b30d27ed3370 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:39.535831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1056613-ab8b-4bd4-8278-b30d27ed3370 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:39.536277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1056613-ab8b-4bd4-8278-b30d27ed3370 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:39.536695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1056613-ab8b-4bd4-8278-b30d27ed3370 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:39.668376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c1056613-ab8b-4bd4-8278-b30d27ed3370 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:39.676780 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c1056613-ab8b-4bd4-8278-b30d27ed3370 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.154809 Oct 11 20:35:39.677346 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3243/6440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:39 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:40.700462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb865ad7-7447-419a-a63b-ff57489d9857 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:40.701091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bb865ad7-7447-419a-a63b-ff57489d9857 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:40.708120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb865ad7-7447-419a-a63b-ff57489d9857 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:40.708622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb865ad7-7447-419a-a63b-ff57489d9857 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:40.709074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb865ad7-7447-419a-a63b-ff57489d9857 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:40.709782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb865ad7-7447-419a-a63b-ff57489d9857 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:40.710251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb865ad7-7447-419a-a63b-ff57489d9857 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:40.710722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb865ad7-7447-419a-a63b-ff57489d9857 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:40.840337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bb865ad7-7447-419a-a63b-ff57489d9857 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:40.848620 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bb865ad7-7447-419a-a63b-ff57489d9857 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.152367 Oct 11 20:35:40.849199 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3198/6441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:40 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:41.871858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1d25339e-90f6-419e-ad28-4d1fa482cb8e tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:41.872410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1d25339e-90f6-419e-ad28-4d1fa482cb8e tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:41.880743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d25339e-90f6-419e-ad28-4d1fa482cb8e tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:41.881240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d25339e-90f6-419e-ad28-4d1fa482cb8e tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:41.881687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d25339e-90f6-419e-ad28-4d1fa482cb8e tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:41.882391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d25339e-90f6-419e-ad28-4d1fa482cb8e tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:41.882878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d25339e-90f6-419e-ad28-4d1fa482cb8e tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:41.883308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1d25339e-90f6-419e-ad28-4d1fa482cb8e tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:42.014178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1d25339e-90f6-419e-ad28-4d1fa482cb8e tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:42.022314 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1d25339e-90f6-419e-ad28-4d1fa482cb8e tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.154507 Oct 11 20:35:42.022911 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3244/6442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:41 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:43.045440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ef230c10-77f0-4ec2-801e-989182c7cc43 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:43.045963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ef230c10-77f0-4ec2-801e-989182c7cc43 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:43.052862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef230c10-77f0-4ec2-801e-989182c7cc43 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:43.053354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef230c10-77f0-4ec2-801e-989182c7cc43 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:43.053806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef230c10-77f0-4ec2-801e-989182c7cc43 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:43.054549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef230c10-77f0-4ec2-801e-989182c7cc43 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:43.055028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef230c10-77f0-4ec2-801e-989182c7cc43 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:43.055462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ef230c10-77f0-4ec2-801e-989182c7cc43 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:43.183714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ef230c10-77f0-4ec2-801e-989182c7cc43 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:43.192063 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ef230c10-77f0-4ec2-801e-989182c7cc43 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.150616 Oct 11 20:35:43.192639 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3199/6443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:43 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:44.215101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-11e450f9-6efc-4160-83cc-d1f12afb306a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:44.215711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-11e450f9-6efc-4160-83cc-d1f12afb306a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:44.222389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e450f9-6efc-4160-83cc-d1f12afb306a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:44.222902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e450f9-6efc-4160-83cc-d1f12afb306a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:44.223334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e450f9-6efc-4160-83cc-d1f12afb306a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:44.224250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e450f9-6efc-4160-83cc-d1f12afb306a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:44.225076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e450f9-6efc-4160-83cc-d1f12afb306a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:44.225587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-11e450f9-6efc-4160-83cc-d1f12afb306a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:44.357166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-11e450f9-6efc-4160-83cc-d1f12afb306a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:44.365532 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-11e450f9-6efc-4160-83cc-d1f12afb306a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1521 microversion: 2.1 time: 0.154528 Oct 11 20:35:44.366096 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3245/6444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:44 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:45.168033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-25f563ff-927a-4a45-b52e-4a68a8caba90 req-7bbf40b2-031b-4dc8-aa9e-4ca86c01ea2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53328ab6-67ac-44b9-9059-ba24c8d99fd8", "name": "network-vif-unplugged", "status": "completed", "tag": "c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:45.180688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-25f563ff-927a-4a45-b52e-4a68a8caba90 req-7bbf40b2-031b-4dc8-aa9e-4ca86c01ea2b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:45.181248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-25f563ff-927a-4a45-b52e-4a68a8caba90 req-7bbf40b2-031b-4dc8-aa9e-4ca86c01ea2b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:45.181698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-25f563ff-927a-4a45-b52e-4a68a8caba90 req-7bbf40b2-031b-4dc8-aa9e-4ca86c01ea2b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:45.193852 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-25f563ff-927a-4a45-b52e-4a68a8caba90 req-7bbf40b2-031b-4dc8-aa9e-4ca86c01ea2b service nova] Creating event network-vif-unplugged:c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45 for instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 on n-h1-860864-3 Oct 11 20:35:45.199570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-25f563ff-927a-4a45-b52e-4a68a8caba90 req-7bbf40b2-031b-4dc8-aa9e-4ca86c01ea2b service nova] Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:35:45.210590 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-25f563ff-927a-4a45-b52e-4a68a8caba90 req-7bbf40b2-031b-4dc8-aa9e-4ca86c01ea2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046406 Oct 11 20:35:45.211238 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3200/6445] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:35:45.389377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2c07256b-59c7-471d-a67d-69aaf0d461d2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:45.389992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2c07256b-59c7-471d-a67d-69aaf0d461d2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:45.397294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c07256b-59c7-471d-a67d-69aaf0d461d2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:45.397779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c07256b-59c7-471d-a67d-69aaf0d461d2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:45.398221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c07256b-59c7-471d-a67d-69aaf0d461d2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:45.398940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c07256b-59c7-471d-a67d-69aaf0d461d2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:45.399399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c07256b-59c7-471d-a67d-69aaf0d461d2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:45.399827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2c07256b-59c7-471d-a67d-69aaf0d461d2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:45.651148 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2c07256b-59c7-471d-a67d-69aaf0d461d2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:45.659723 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2c07256b-59c7-471d-a67d-69aaf0d461d2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1520 microversion: 2.1 time: 0.274209 Oct 11 20:35:45.660442 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3246/6446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:45 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:46.686396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-677dd7fb-9a33-4743-b378-6492c30d43b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:46.687157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-677dd7fb-9a33-4743-b378-6492c30d43b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:46.694265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677dd7fb-9a33-4743-b378-6492c30d43b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:46.694810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677dd7fb-9a33-4743-b378-6492c30d43b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:46.695273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677dd7fb-9a33-4743-b378-6492c30d43b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:46.696046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677dd7fb-9a33-4743-b378-6492c30d43b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:46.696526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677dd7fb-9a33-4743-b378-6492c30d43b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:46.696972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-677dd7fb-9a33-4743-b378-6492c30d43b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:46.835673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-677dd7fb-9a33-4743-b378-6492c30d43b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:46.843465 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-677dd7fb-9a33-4743-b378-6492c30d43b4 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1518 microversion: 2.1 time: 0.162197 Oct 11 20:35:46.844062 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3201/6447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:46 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:47.242232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4cf8834d-b0eb-456c-9ee8-22e86aa83ba1 req-19fbc71a-181e-469c-9521-b31ab31fdbff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53328ab6-67ac-44b9-9059-ba24c8d99fd8", "tag": "c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:47.252496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4cf8834d-b0eb-456c-9ee8-22e86aa83ba1 req-19fbc71a-181e-469c-9521-b31ab31fdbff service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:47.253043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4cf8834d-b0eb-456c-9ee8-22e86aa83ba1 req-19fbc71a-181e-469c-9521-b31ab31fdbff service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:47.253473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4cf8834d-b0eb-456c-9ee8-22e86aa83ba1 req-19fbc71a-181e-469c-9521-b31ab31fdbff service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:47.265068 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4cf8834d-b0eb-456c-9ee8-22e86aa83ba1 req-19fbc71a-181e-469c-9521-b31ab31fdbff service nova] Creating event network-changed:c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45 for instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 on n-h1-860864-3 Oct 11 20:35:47.270341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-4cf8834d-b0eb-456c-9ee8-22e86aa83ba1 req-19fbc71a-181e-469c-9521-b31ab31fdbff service nova] Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:35:47.280816 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4cf8834d-b0eb-456c-9ee8-22e86aa83ba1 req-19fbc71a-181e-469c-9521-b31ab31fdbff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042334 Oct 11 20:35:47.281899 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3247/6448] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:35:47.868029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1260ab3c-4782-4ba1-9d91-be68adceb91a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:47.869035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1260ab3c-4782-4ba1-9d91-be68adceb91a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:47.879082 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1260ab3c-4782-4ba1-9d91-be68adceb91a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:47.879597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1260ab3c-4782-4ba1-9d91-be68adceb91a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:47.880049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1260ab3c-4782-4ba1-9d91-be68adceb91a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:47.880767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1260ab3c-4782-4ba1-9d91-be68adceb91a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:47.881239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1260ab3c-4782-4ba1-9d91-be68adceb91a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:47.881713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1260ab3c-4782-4ba1-9d91-be68adceb91a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:48.557277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1260ab3c-4782-4ba1-9d91-be68adceb91a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:48.565967 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1260ab3c-4782-4ba1-9d91-be68adceb91a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1515 microversion: 2.1 time: 0.702959 Oct 11 20:35:48.566575 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3202/6449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:47 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1515 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:48.589401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-83640814-b7b9-4001-8eb9-bf568e7c21c2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:48.590033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-83640814-b7b9-4001-8eb9-bf568e7c21c2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:48.597760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83640814-b7b9-4001-8eb9-bf568e7c21c2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:48.598490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83640814-b7b9-4001-8eb9-bf568e7c21c2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:48.598965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83640814-b7b9-4001-8eb9-bf568e7c21c2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:48.599674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83640814-b7b9-4001-8eb9-bf568e7c21c2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:48.600189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83640814-b7b9-4001-8eb9-bf568e7c21c2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:48.600564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83640814-b7b9-4001-8eb9-bf568e7c21c2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:48.659070 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-83640814-b7b9-4001-8eb9-bf568e7c21c2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "POST /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8/action" status: 204 len: 0 microversion: 2.1 time: 0.073775 Oct 11 20:35:48.659728 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3248/6450] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:35:48 2022] POST /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:35:48.668062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e0415be7-9f89-43c0-abb4-26aec2534813 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:48.668704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e0415be7-9f89-43c0-abb4-26aec2534813 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:48.675304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0415be7-9f89-43c0-abb4-26aec2534813 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:48.675907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0415be7-9f89-43c0-abb4-26aec2534813 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:48.676437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0415be7-9f89-43c0-abb4-26aec2534813 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:48.677278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0415be7-9f89-43c0-abb4-26aec2534813 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:48.677758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0415be7-9f89-43c0-abb4-26aec2534813 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:48.678203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e0415be7-9f89-43c0-abb4-26aec2534813 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:48.889060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e0415be7-9f89-43c0-abb4-26aec2534813 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:48.897095 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e0415be7-9f89-43c0-abb4-26aec2534813 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1515 microversion: 2.1 time: 0.233009 Oct 11 20:35:48.897676 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3203/6451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:48 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:49.922511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5ed8d90b-6f6b-4513-8a67-f8be7fe43953 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:49.923431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5ed8d90b-6f6b-4513-8a67-f8be7fe43953 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:49.930712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ed8d90b-6f6b-4513-8a67-f8be7fe43953 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:49.931343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ed8d90b-6f6b-4513-8a67-f8be7fe43953 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:49.931782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ed8d90b-6f6b-4513-8a67-f8be7fe43953 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:49.932491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ed8d90b-6f6b-4513-8a67-f8be7fe43953 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:49.932984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ed8d90b-6f6b-4513-8a67-f8be7fe43953 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:49.933416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ed8d90b-6f6b-4513-8a67-f8be7fe43953 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:50.076486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5ed8d90b-6f6b-4513-8a67-f8be7fe43953 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:50.085321 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5ed8d90b-6f6b-4513-8a67-f8be7fe43953 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1507 microversion: 2.1 time: 0.168578 Oct 11 20:35:50.085907 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3249/6452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:49 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:50.107830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-de796715-cb96-4f08-97cc-71d70cb04202 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:50.108457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-de796715-cb96-4f08-97cc-71d70cb04202 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:50.112096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=30 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:50.118210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de796715-cb96-4f08-97cc-71d70cb04202 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:50.118732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de796715-cb96-4f08-97cc-71d70cb04202 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:50.119182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de796715-cb96-4f08-97cc-71d70cb04202 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:50.119884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de796715-cb96-4f08-97cc-71d70cb04202 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:50.120353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de796715-cb96-4f08-97cc-71d70cb04202 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:50.120783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de796715-cb96-4f08-97cc-71d70cb04202 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:50.124984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=88 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:50.249595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-de796715-cb96-4f08-97cc-71d70cb04202 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:50.259233 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-de796715-cb96-4f08-97cc-71d70cb04202 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1507 microversion: 2.1 time: 0.155214 Oct 11 20:35:50.260109 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3204/6453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:50 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:50.285496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aefc8351-115a-42a6-8d86-820ed2d4b6c6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Action: 'create', calling method: .version_select at 0x7f83c73b08b0>, body: {"keypair": {"name": "tempest-keypair-393758146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtcyJq271OsgmnbSNTC8/BB7C9eraAE2EAsIofR14RxnXl+C/OYER/OJAdJgeAcmawN09CzE7q+GQLU9ftNU1c5QfWt0A1xEObCGQqAUg3f0kjYg56wDnkL4bwJiuuYkQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:50.300871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-aefc8351-115a-42a6-8d86-820ed2d4b6c6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Getting quotas for project 1a96feeb52c6404c903aa288e4ffd73b. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:35:50.305819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-aefc8351-115a-42a6-8d86-820ed2d4b6c6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Getting quotas for user 8968eed8964a4ea7b86e535625d48ec1 and project 1a96feeb52c6404c903aa288e4ffd73b. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:35:50.334027 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aefc8351-115a-42a6-8d86-820ed2d4b6c6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052610 Oct 11 20:35:50.334565 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3250/6454] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:35:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:35:51.451118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-01bfbfec-9aec-49c5-b5f3-6960560d7386 req-ab56d4f7-998d-424d-8ca6-0aa1c805ec85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53328ab6-67ac-44b9-9059-ba24c8d99fd8", "name": "network-vif-plugged", "status": "completed", "tag": "c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:51.464595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-01bfbfec-9aec-49c5-b5f3-6960560d7386 req-ab56d4f7-998d-424d-8ca6-0aa1c805ec85 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:51.465315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-01bfbfec-9aec-49c5-b5f3-6960560d7386 req-ab56d4f7-998d-424d-8ca6-0aa1c805ec85 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:51.465763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-01bfbfec-9aec-49c5-b5f3-6960560d7386 req-ab56d4f7-998d-424d-8ca6-0aa1c805ec85 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:51.480635 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-01bfbfec-9aec-49c5-b5f3-6960560d7386 req-ab56d4f7-998d-424d-8ca6-0aa1c805ec85 service nova] Creating event network-vif-plugged:c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45 for instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 on n-h1-860864-3 Oct 11 20:35:51.487038 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-01bfbfec-9aec-49c5-b5f3-6960560d7386 req-ab56d4f7-998d-424d-8ca6-0aa1c805ec85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040207 Oct 11 20:35:51.487950 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3205/6455] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:35:51.528378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-69e0abda-68e7-4df2-b307-d80cfd3abbc3 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:51.529000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-69e0abda-68e7-4df2-b307-d80cfd3abbc3 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:51.531227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:35:51.538059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69e0abda-68e7-4df2-b307-d80cfd3abbc3 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:51.538585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69e0abda-68e7-4df2-b307-d80cfd3abbc3 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:51.539035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69e0abda-68e7-4df2-b307-d80cfd3abbc3 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:51.539734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69e0abda-68e7-4df2-b307-d80cfd3abbc3 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:51.540200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69e0abda-68e7-4df2-b307-d80cfd3abbc3 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:51.540634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69e0abda-68e7-4df2-b307-d80cfd3abbc3 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:51.675173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-69e0abda-68e7-4df2-b307-d80cfd3abbc3 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:51.682918 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-69e0abda-68e7-4df2-b307-d80cfd3abbc3 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 200 len: 1507 microversion: 2.1 time: 0.159411 Oct 11 20:35:51.683495 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3251/6456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:51 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:51.706472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9dcaecc1-1986-4eeb-afb8-41384ce66f7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:51.707099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9dcaecc1-1986-4eeb-afb8-41384ce66f7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:51.713585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcaecc1-1986-4eeb-afb8-41384ce66f7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:51.714081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcaecc1-1986-4eeb-afb8-41384ce66f7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:51.714820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcaecc1-1986-4eeb-afb8-41384ce66f7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:51.715517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcaecc1-1986-4eeb-afb8-41384ce66f7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:51.715981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcaecc1-1986-4eeb-afb8-41384ce66f7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:51.716414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9dcaecc1-1986-4eeb-afb8-41384ce66f7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:51.742777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9dcaecc1-1986-4eeb-afb8-41384ce66f7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:35:51.818035 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9dcaecc1-1986-4eeb-afb8-41384ce66f7a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "DELETE /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 204 len: 0 microversion: 2.1 time: 0.115540 Oct 11 20:35:51.818692 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3206/6457] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:35:51 2022] DELETE /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:35:51.873365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2006295889", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "55c8ca22-3e6f-4cb0-8c43-1c5be84df754"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:51.926427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] validate_networks() for [('55c8ca22-3e6f-4cb0-8c43-1c5be84df754', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:35:52.292673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:35:52.293117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:35:52.293576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:35:52.293987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:35:52.294401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:35:52.303362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:52.303845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:52.304307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:52.305033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:52.305487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:52.305909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:52.322795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Getting quotas for project 1a96feeb52c6404c903aa288e4ffd73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:35:52.328080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Getting quotas for user 8968eed8964a4ea7b86e535625d48ec1 and project 1a96feeb52c6404c903aa288e4ffd73b. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:35:52.341018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:35:52.343352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:35:52.388483 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-73e3824b-0dfc-4e9e-b776-19ff800ad473 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519010 Oct 11 20:35:52.389136 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3252/6458] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:35:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:35:52.401445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-de315743-8ec6-41bd-b1de-7a7135ec4a75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:52.402260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-de315743-8ec6-41bd-b1de-7a7135ec4a75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:52.464256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-de315743-8ec6-41bd-b1de-7a7135ec4a75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:52.473281 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-de315743-8ec6-41bd-b1de-7a7135ec4a75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1218 microversion: 2.1 time: 0.076257 Oct 11 20:35:52.473875 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3207/6459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:52 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:53.498292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a72e5558-ef6a-408f-9886-1c537b4f1ed1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:53.499741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a72e5558-ef6a-408f-9886-1c537b4f1ed1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:53.509380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72e5558-ef6a-408f-9886-1c537b4f1ed1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:53.510142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72e5558-ef6a-408f-9886-1c537b4f1ed1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:53.510780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72e5558-ef6a-408f-9886-1c537b4f1ed1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:53.511674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72e5558-ef6a-408f-9886-1c537b4f1ed1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:53.512291 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72e5558-ef6a-408f-9886-1c537b4f1ed1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:53.512930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a72e5558-ef6a-408f-9886-1c537b4f1ed1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:53.612034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-3e1091bb-0109-4c75-98f8-36629f87462d req-0ea5fbbc-4059-4398-bc0a-e897d602d83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53328ab6-67ac-44b9-9059-ba24c8d99fd8", "name": "network-vif-deleted", "tag": "c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:53.620408 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a72e5558-ef6a-408f-9886-1c537b4f1ed1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:53.630967 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a72e5558-ef6a-408f-9886-1c537b4f1ed1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1270 microversion: 2.1 time: 0.139122 Oct 11 20:35:53.633652 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3253/6460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:53 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1270 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:53.648830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3e1091bb-0109-4c75-98f8-36629f87462d req-0ea5fbbc-4059-4398-bc0a-e897d602d83e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:53.649509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3e1091bb-0109-4c75-98f8-36629f87462d req-0ea5fbbc-4059-4398-bc0a-e897d602d83e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:53.649966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-3e1091bb-0109-4c75-98f8-36629f87462d req-0ea5fbbc-4059-4398-bc0a-e897d602d83e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:53.668064 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-3e1091bb-0109-4c75-98f8-36629f87462d req-0ea5fbbc-4059-4398-bc0a-e897d602d83e service nova] Creating event network-vif-deleted:c5a6a343-ec34-4a4a-b561-4e7a4e1e4e45 for instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 on n-h1-860864-3 Oct 11 20:35:53.676530 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-3e1091bb-0109-4c75-98f8-36629f87462d req-0ea5fbbc-4059-4398-bc0a-e897d602d83e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067971 Oct 11 20:35:53.677467 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3208/6461] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:35:54.655115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-871926a9-35ec-4526-b89f-ce19915187f2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:54.655641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-871926a9-35ec-4526-b89f-ce19915187f2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:54.663280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-871926a9-35ec-4526-b89f-ce19915187f2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:54.663770 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-871926a9-35ec-4526-b89f-ce19915187f2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:54.664208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-871926a9-35ec-4526-b89f-ce19915187f2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:54.664906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-871926a9-35ec-4526-b89f-ce19915187f2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:54.665367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-871926a9-35ec-4526-b89f-ce19915187f2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:54.665789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-871926a9-35ec-4526-b89f-ce19915187f2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:54.893870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-871926a9-35ec-4526-b89f-ce19915187f2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:54.901826 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-871926a9-35ec-4526-b89f-ce19915187f2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1318 microversion: 2.1 time: 0.250756 Oct 11 20:35:54.902409 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3254/6462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:54 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:55.694257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-8cee36ee-d63b-4dcf-bc79-fa7f09f01fb9 req-cbadf8cf-53aa-4936-a39f-4b8d84b09e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3739af2b-632a-4d3c-a815-164d0f722dde", "tag": "5a60f1fc-1bb8-4bfe-8821-9015382f46f9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:35:55.704973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8cee36ee-d63b-4dcf-bc79-fa7f09f01fb9 req-cbadf8cf-53aa-4936-a39f-4b8d84b09e9b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:55.705486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8cee36ee-d63b-4dcf-bc79-fa7f09f01fb9 req-cbadf8cf-53aa-4936-a39f-4b8d84b09e9b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:55.705930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-8cee36ee-d63b-4dcf-bc79-fa7f09f01fb9 req-cbadf8cf-53aa-4936-a39f-4b8d84b09e9b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:55.716605 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-8cee36ee-d63b-4dcf-bc79-fa7f09f01fb9 req-cbadf8cf-53aa-4936-a39f-4b8d84b09e9b service nova] Creating event network-changed:5a60f1fc-1bb8-4bfe-8821-9015382f46f9 for instance 3739af2b-632a-4d3c-a815-164d0f722dde on n-h1-860864-3 Oct 11 20:35:55.721595 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-8cee36ee-d63b-4dcf-bc79-fa7f09f01fb9 req-cbadf8cf-53aa-4936-a39f-4b8d84b09e9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032474 Oct 11 20:35:55.722180 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3209/6463] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:35:55.927173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d7f0876-b73f-42a9-9e32-892d72db5746 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:55.927788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8d7f0876-b73f-42a9-9e32-892d72db5746 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:55.934636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d7f0876-b73f-42a9-9e32-892d72db5746 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:55.935122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d7f0876-b73f-42a9-9e32-892d72db5746 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:55.935561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d7f0876-b73f-42a9-9e32-892d72db5746 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:55.936245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d7f0876-b73f-42a9-9e32-892d72db5746 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:55.936701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d7f0876-b73f-42a9-9e32-892d72db5746 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:55.937128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d7f0876-b73f-42a9-9e32-892d72db5746 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:56.067583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8d7f0876-b73f-42a9-9e32-892d72db5746 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:56.076654 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8d7f0876-b73f-42a9-9e32-892d72db5746 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1318 microversion: 2.1 time: 0.154456 Oct 11 20:35:56.077223 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3255/6464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:55 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:57.101092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d55de728-43b7-406b-9b7b-4e42323b2c0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:57.101811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d55de728-43b7-406b-9b7b-4e42323b2c0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:57.108032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d55de728-43b7-406b-9b7b-4e42323b2c0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:57.108548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d55de728-43b7-406b-9b7b-4e42323b2c0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:57.108992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d55de728-43b7-406b-9b7b-4e42323b2c0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:57.110338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d55de728-43b7-406b-9b7b-4e42323b2c0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:57.110881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d55de728-43b7-406b-9b7b-4e42323b2c0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:57.111274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d55de728-43b7-406b-9b7b-4e42323b2c0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:57.241997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d55de728-43b7-406b-9b7b-4e42323b2c0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:57.249753 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d55de728-43b7-406b-9b7b-4e42323b2c0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1318 microversion: 2.1 time: 0.153812 Oct 11 20:35:57.250372 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3210/6465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:57 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:35:58.272753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d32ece29-2eda-420c-a18b-684dd4bbe565 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:58.273360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d32ece29-2eda-420c-a18b-684dd4bbe565 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:58.280190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d32ece29-2eda-420c-a18b-684dd4bbe565 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:58.280671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d32ece29-2eda-420c-a18b-684dd4bbe565 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:58.281100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d32ece29-2eda-420c-a18b-684dd4bbe565 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:58.282431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d32ece29-2eda-420c-a18b-684dd4bbe565 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:58.282901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d32ece29-2eda-420c-a18b-684dd4bbe565 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:58.283320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d32ece29-2eda-420c-a18b-684dd4bbe565 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:58.417959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d32ece29-2eda-420c-a18b-684dd4bbe565 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:58.426215 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d32ece29-2eda-420c-a18b-684dd4bbe565 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1318 microversion: 2.1 time: 0.157337 Oct 11 20:35:58.426856 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3256/6466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:58 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:35:59.449368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-92ecf06a-d204-4bcb-9d87-17b2ab09cc31 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:35:59.449993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-92ecf06a-d204-4bcb-9d87-17b2ab09cc31 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:35:59.458055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92ecf06a-d204-4bcb-9d87-17b2ab09cc31 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:59.458579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92ecf06a-d204-4bcb-9d87-17b2ab09cc31 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:59.459038 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92ecf06a-d204-4bcb-9d87-17b2ab09cc31 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:59.459749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92ecf06a-d204-4bcb-9d87-17b2ab09cc31 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:35:59.460219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92ecf06a-d204-4bcb-9d87-17b2ab09cc31 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:35:59.460659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-92ecf06a-d204-4bcb-9d87-17b2ab09cc31 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:35:59.595886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-92ecf06a-d204-4bcb-9d87-17b2ab09cc31 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:35:59.603560 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-92ecf06a-d204-4bcb-9d87-17b2ab09cc31 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1318 microversion: 2.1 time: 0.158332 Oct 11 20:35:59.604169 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3211/6467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:35:59 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:00.627817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc0cc91e-3742-45e5-8735-64d30ab0e572 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:00.628342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc0cc91e-3742-45e5-8735-64d30ab0e572 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:00.635270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0cc91e-3742-45e5-8735-64d30ab0e572 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:00.635762 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0cc91e-3742-45e5-8735-64d30ab0e572 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:00.636203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0cc91e-3742-45e5-8735-64d30ab0e572 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:00.636900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0cc91e-3742-45e5-8735-64d30ab0e572 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:00.637358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0cc91e-3742-45e5-8735-64d30ab0e572 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:00.637786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc0cc91e-3742-45e5-8735-64d30ab0e572 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:00.772860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dc0cc91e-3742-45e5-8735-64d30ab0e572 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:00.780495 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc0cc91e-3742-45e5-8735-64d30ab0e572 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1318 microversion: 2.1 time: 0.157066 Oct 11 20:36:00.781067 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3257/6468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:00 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:01.531301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-636bdb6b-c5d1-41f8-97ff-bbca178f02d1 req-9abbb7cd-fc33-41a0-a61c-18b943638c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3739af2b-632a-4d3c-a815-164d0f722dde", "name": "network-vif-plugged", "status": "completed", "tag": "5a60f1fc-1bb8-4bfe-8821-9015382f46f9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:01.544965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-636bdb6b-c5d1-41f8-97ff-bbca178f02d1 req-9abbb7cd-fc33-41a0-a61c-18b943638c0d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:01.545471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-636bdb6b-c5d1-41f8-97ff-bbca178f02d1 req-9abbb7cd-fc33-41a0-a61c-18b943638c0d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:01.545920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-636bdb6b-c5d1-41f8-97ff-bbca178f02d1 req-9abbb7cd-fc33-41a0-a61c-18b943638c0d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:01.557717 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-636bdb6b-c5d1-41f8-97ff-bbca178f02d1 req-9abbb7cd-fc33-41a0-a61c-18b943638c0d service nova] Creating event network-vif-plugged:5a60f1fc-1bb8-4bfe-8821-9015382f46f9 for instance 3739af2b-632a-4d3c-a815-164d0f722dde on n-h1-860864-3 Oct 11 20:36:01.563306 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-636bdb6b-c5d1-41f8-97ff-bbca178f02d1 req-9abbb7cd-fc33-41a0-a61c-18b943638c0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035473 Oct 11 20:36:01.564145 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3212/6469] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:36:01.803413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7c2e6b8a-4c68-47be-b075-823c9d74fc5c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:01.804046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7c2e6b8a-4c68-47be-b075-823c9d74fc5c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:01.810913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c2e6b8a-4c68-47be-b075-823c9d74fc5c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:01.811395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c2e6b8a-4c68-47be-b075-823c9d74fc5c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:01.811830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c2e6b8a-4c68-47be-b075-823c9d74fc5c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:01.812512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c2e6b8a-4c68-47be-b075-823c9d74fc5c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:01.813516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c2e6b8a-4c68-47be-b075-823c9d74fc5c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:01.814085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7c2e6b8a-4c68-47be-b075-823c9d74fc5c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:01.945484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7c2e6b8a-4c68-47be-b075-823c9d74fc5c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:01.953525 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7c2e6b8a-4c68-47be-b075-823c9d74fc5c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1318 microversion: 2.1 time: 0.154051 Oct 11 20:36:01.954222 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3258/6470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:01 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:02.976747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2d90c168-98e9-44cc-af18-1bbf1d7f3576 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:02.977473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2d90c168-98e9-44cc-af18-1bbf1d7f3576 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:02.979522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:02.986052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d90c168-98e9-44cc-af18-1bbf1d7f3576 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:02.986567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d90c168-98e9-44cc-af18-1bbf1d7f3576 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:02.987018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d90c168-98e9-44cc-af18-1bbf1d7f3576 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:02.987742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d90c168-98e9-44cc-af18-1bbf1d7f3576 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:02.988214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d90c168-98e9-44cc-af18-1bbf1d7f3576 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:02.988647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d90c168-98e9-44cc-af18-1bbf1d7f3576 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:03.120083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2d90c168-98e9-44cc-af18-1bbf1d7f3576 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:03.128392 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2d90c168-98e9-44cc-af18-1bbf1d7f3576 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1508 microversion: 2.1 time: 0.155898 Oct 11 20:36:03.128975 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3213/6471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:02 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:03.151309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-264d4fc5-4628-42bf-a52e-c27d24431030 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:03.151924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-264d4fc5-4628-42bf-a52e-c27d24431030 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:03.153783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:03.154454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=10 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:03.161274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-264d4fc5-4628-42bf-a52e-c27d24431030 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:03.161761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-264d4fc5-4628-42bf-a52e-c27d24431030 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:03.162199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-264d4fc5-4628-42bf-a52e-c27d24431030 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:03.162919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-264d4fc5-4628-42bf-a52e-c27d24431030 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:03.163378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-264d4fc5-4628-42bf-a52e-c27d24431030 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:03.163804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-264d4fc5-4628-42bf-a52e-c27d24431030 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:03.289274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-264d4fc5-4628-42bf-a52e-c27d24431030 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:03.297121 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-264d4fc5-4628-42bf-a52e-c27d24431030 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1508 microversion: 2.1 time: 0.149688 Oct 11 20:36:03.297696 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3259/6472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:03 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:03.319609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:03.321801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:03.327958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:03.329365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:03.329593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:03.330288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:03.330773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:03.331213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:03.358782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:03.364689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Old instance type m1.heat2, new instance type m1.heat {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:36:03.371211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:36:03.371641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:36:03.372124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:36:03.372543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:36:03.372963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:36:03.434892 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-854094b0-4f6b-415c-8495-3e87ca8d8b0a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "POST /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde/action" status: 202 len: 0 microversion: 2.1 time: 0.119164 Oct 11 20:36:03.435520 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3214/6473] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:36:03 2022] POST /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:36:03.444648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-42a9279f-4a71-4637-8efa-2c32aa0f51d0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:03.445264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-42a9279f-4a71-4637-8efa-2c32aa0f51d0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:03.452222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42a9279f-4a71-4637-8efa-2c32aa0f51d0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:03.452715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42a9279f-4a71-4637-8efa-2c32aa0f51d0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:03.453156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42a9279f-4a71-4637-8efa-2c32aa0f51d0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:03.454369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42a9279f-4a71-4637-8efa-2c32aa0f51d0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:03.454868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42a9279f-4a71-4637-8efa-2c32aa0f51d0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:03.455300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-42a9279f-4a71-4637-8efa-2c32aa0f51d0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:03.471723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:03.624413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-42a9279f-4a71-4637-8efa-2c32aa0f51d0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:03.634632 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-42a9279f-4a71-4637-8efa-2c32aa0f51d0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1515 microversion: 2.1 time: 0.193801 Oct 11 20:36:03.635221 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3260/6474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:03 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:04.661716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1acecfd0-6b5d-40e9-902e-7f472559e2bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:04.662396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1acecfd0-6b5d-40e9-902e-7f472559e2bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:04.669463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acecfd0-6b5d-40e9-902e-7f472559e2bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:04.669974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acecfd0-6b5d-40e9-902e-7f472559e2bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:04.670433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acecfd0-6b5d-40e9-902e-7f472559e2bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:04.671201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acecfd0-6b5d-40e9-902e-7f472559e2bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:04.671674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acecfd0-6b5d-40e9-902e-7f472559e2bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:04.672120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1acecfd0-6b5d-40e9-902e-7f472559e2bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:04.890819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1acecfd0-6b5d-40e9-902e-7f472559e2bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:04.899252 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1acecfd0-6b5d-40e9-902e-7f472559e2bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1515 microversion: 2.1 time: 0.242410 Oct 11 20:36:04.899843 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3215/6475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:04 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:05.923411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8fa896ad-9530-4cb2-ad31-e87c314b5d30 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:05.924125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8fa896ad-9530-4cb2-ad31-e87c314b5d30 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:05.930844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa896ad-9530-4cb2-ad31-e87c314b5d30 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:05.931323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa896ad-9530-4cb2-ad31-e87c314b5d30 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:05.931754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa896ad-9530-4cb2-ad31-e87c314b5d30 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:05.932432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa896ad-9530-4cb2-ad31-e87c314b5d30 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:05.932879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa896ad-9530-4cb2-ad31-e87c314b5d30 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:05.933297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8fa896ad-9530-4cb2-ad31-e87c314b5d30 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:06.062876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8fa896ad-9530-4cb2-ad31-e87c314b5d30 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:06.071233 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8fa896ad-9530-4cb2-ad31-e87c314b5d30 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.152449 Oct 11 20:36:06.071998 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3261/6476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:05 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:07.095184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b6af25ea-bf57-4b8b-b90c-789bece46d95 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:07.095814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b6af25ea-bf57-4b8b-b90c-789bece46d95 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:07.102200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6af25ea-bf57-4b8b-b90c-789bece46d95 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:07.102756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6af25ea-bf57-4b8b-b90c-789bece46d95 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:07.103212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6af25ea-bf57-4b8b-b90c-789bece46d95 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:07.103915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6af25ea-bf57-4b8b-b90c-789bece46d95 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:07.104390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6af25ea-bf57-4b8b-b90c-789bece46d95 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:07.104829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b6af25ea-bf57-4b8b-b90c-789bece46d95 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:07.235723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b6af25ea-bf57-4b8b-b90c-789bece46d95 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:07.243584 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b6af25ea-bf57-4b8b-b90c-789bece46d95 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.152360 Oct 11 20:36:07.244162 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3216/6477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:07 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:08.267879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f5f50659-95c3-4b18-9e87-420b5aa00120 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:08.268518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f5f50659-95c3-4b18-9e87-420b5aa00120 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:08.275343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5f50659-95c3-4b18-9e87-420b5aa00120 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:08.275823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5f50659-95c3-4b18-9e87-420b5aa00120 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:08.276253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5f50659-95c3-4b18-9e87-420b5aa00120 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:08.276931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5f50659-95c3-4b18-9e87-420b5aa00120 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:08.277383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5f50659-95c3-4b18-9e87-420b5aa00120 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:08.277803 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f5f50659-95c3-4b18-9e87-420b5aa00120 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:08.411638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f5f50659-95c3-4b18-9e87-420b5aa00120 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:08.419423 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f5f50659-95c3-4b18-9e87-420b5aa00120 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.155542 Oct 11 20:36:08.420003 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3262/6478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:08 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:09.444625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b609373e-b006-45ba-9ff3-128be57fd0e7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:09.445262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b609373e-b006-45ba-9ff3-128be57fd0e7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:09.452476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b609373e-b006-45ba-9ff3-128be57fd0e7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:09.452982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b609373e-b006-45ba-9ff3-128be57fd0e7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:09.453444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b609373e-b006-45ba-9ff3-128be57fd0e7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:09.454314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b609373e-b006-45ba-9ff3-128be57fd0e7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:09.454835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b609373e-b006-45ba-9ff3-128be57fd0e7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:09.455282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b609373e-b006-45ba-9ff3-128be57fd0e7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:09.587251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b609373e-b006-45ba-9ff3-128be57fd0e7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:09.596443 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b609373e-b006-45ba-9ff3-128be57fd0e7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.155997 Oct 11 20:36:09.597029 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3217/6479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:09 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:10.619133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3a85a0a1-eb50-42fb-9240-b6bc83cf2fac tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:10.619667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3a85a0a1-eb50-42fb-9240-b6bc83cf2fac tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:10.626467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a85a0a1-eb50-42fb-9240-b6bc83cf2fac tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:10.626977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a85a0a1-eb50-42fb-9240-b6bc83cf2fac tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:10.627907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a85a0a1-eb50-42fb-9240-b6bc83cf2fac tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:10.628667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a85a0a1-eb50-42fb-9240-b6bc83cf2fac tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:10.629118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a85a0a1-eb50-42fb-9240-b6bc83cf2fac tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:10.629537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3a85a0a1-eb50-42fb-9240-b6bc83cf2fac tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:10.761005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3a85a0a1-eb50-42fb-9240-b6bc83cf2fac tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:10.769299 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3a85a0a1-eb50-42fb-9240-b6bc83cf2fac tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.154151 Oct 11 20:36:10.769874 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3263/6480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:10 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:11.791453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7ba7bf4d-a952-46d2-a022-987288059aa7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:11.792081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7ba7bf4d-a952-46d2-a022-987288059aa7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:11.799186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba7bf4d-a952-46d2-a022-987288059aa7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:11.799828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba7bf4d-a952-46d2-a022-987288059aa7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:11.800310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba7bf4d-a952-46d2-a022-987288059aa7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:11.801013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba7bf4d-a952-46d2-a022-987288059aa7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:11.801480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba7bf4d-a952-46d2-a022-987288059aa7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:11.801918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7ba7bf4d-a952-46d2-a022-987288059aa7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:11.929971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7ba7bf4d-a952-46d2-a022-987288059aa7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:11.937699 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7ba7bf4d-a952-46d2-a022-987288059aa7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.150189 Oct 11 20:36:11.938274 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3218/6481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:11 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:12.962684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40595986-a911-489a-9c76-fe2e51dec0b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:12.963325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-40595986-a911-489a-9c76-fe2e51dec0b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:12.970223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40595986-a911-489a-9c76-fe2e51dec0b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:12.970757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40595986-a911-489a-9c76-fe2e51dec0b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:12.971230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40595986-a911-489a-9c76-fe2e51dec0b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:12.971923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40595986-a911-489a-9c76-fe2e51dec0b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:12.972381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40595986-a911-489a-9c76-fe2e51dec0b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:12.972810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40595986-a911-489a-9c76-fe2e51dec0b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:13.105667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-40595986-a911-489a-9c76-fe2e51dec0b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:13.113907 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40595986-a911-489a-9c76-fe2e51dec0b2 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.155148 Oct 11 20:36:13.114480 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3264/6482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:12 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:14.137192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8398c410-1963-488a-bc6b-d2b6287b2579 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:14.137829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8398c410-1963-488a-bc6b-d2b6287b2579 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:14.145041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8398c410-1963-488a-bc6b-d2b6287b2579 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:14.145548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8398c410-1963-488a-bc6b-d2b6287b2579 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:14.146006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8398c410-1963-488a-bc6b-d2b6287b2579 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:14.146752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8398c410-1963-488a-bc6b-d2b6287b2579 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:14.147230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8398c410-1963-488a-bc6b-d2b6287b2579 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:14.147675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8398c410-1963-488a-bc6b-d2b6287b2579 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:14.277063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8398c410-1963-488a-bc6b-d2b6287b2579 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:14.285388 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8398c410-1963-488a-bc6b-d2b6287b2579 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.152366 Oct 11 20:36:14.285970 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3219/6483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:14 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:15.309156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66f34112-99c8-4de7-8ad4-963c2b23ae87 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:15.309767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-66f34112-99c8-4de7-8ad4-963c2b23ae87 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:15.317415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66f34112-99c8-4de7-8ad4-963c2b23ae87 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:15.317895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66f34112-99c8-4de7-8ad4-963c2b23ae87 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:15.318330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66f34112-99c8-4de7-8ad4-963c2b23ae87 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:15.319055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66f34112-99c8-4de7-8ad4-963c2b23ae87 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:15.319505 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66f34112-99c8-4de7-8ad4-963c2b23ae87 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:15.319924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66f34112-99c8-4de7-8ad4-963c2b23ae87 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:15.451187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-66f34112-99c8-4de7-8ad4-963c2b23ae87 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:15.459062 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-66f34112-99c8-4de7-8ad4-963c2b23ae87 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.153835 Oct 11 20:36:15.459646 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3265/6484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:15 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:16.481868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b2ceffd9-d8f4-4fec-bb0c-0529b487039a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:16.482494 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b2ceffd9-d8f4-4fec-bb0c-0529b487039a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:16.489664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2ceffd9-d8f4-4fec-bb0c-0529b487039a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:16.490161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2ceffd9-d8f4-4fec-bb0c-0529b487039a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:16.490639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2ceffd9-d8f4-4fec-bb0c-0529b487039a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:16.491343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2ceffd9-d8f4-4fec-bb0c-0529b487039a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:16.491814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2ceffd9-d8f4-4fec-bb0c-0529b487039a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:16.492256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2ceffd9-d8f4-4fec-bb0c-0529b487039a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:16.619533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b2ceffd9-d8f4-4fec-bb0c-0529b487039a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:16.627861 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b2ceffd9-d8f4-4fec-bb0c-0529b487039a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.149444 Oct 11 20:36:16.628434 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3220/6485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:16 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:17.651741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8c60b4b7-b1ed-4457-ba22-d5595980c33a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:17.652349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8c60b4b7-b1ed-4457-ba22-d5595980c33a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:17.660559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c60b4b7-b1ed-4457-ba22-d5595980c33a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:17.661043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c60b4b7-b1ed-4457-ba22-d5595980c33a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:17.661480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c60b4b7-b1ed-4457-ba22-d5595980c33a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:17.662169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c60b4b7-b1ed-4457-ba22-d5595980c33a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:17.662647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c60b4b7-b1ed-4457-ba22-d5595980c33a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:17.663072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c60b4b7-b1ed-4457-ba22-d5595980c33a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:17.790826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c60b4b7-b1ed-4457-ba22-d5595980c33a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:17.799569 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8c60b4b7-b1ed-4457-ba22-d5595980c33a tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.151731 Oct 11 20:36:17.800151 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3266/6486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:17 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:18.822743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a0c67e5-c59c-47cc-b710-3c9a13373797 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:18.823633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9a0c67e5-c59c-47cc-b710-3c9a13373797 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:18.830736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a0c67e5-c59c-47cc-b710-3c9a13373797 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:18.831243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a0c67e5-c59c-47cc-b710-3c9a13373797 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:18.831705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a0c67e5-c59c-47cc-b710-3c9a13373797 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:18.832420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a0c67e5-c59c-47cc-b710-3c9a13373797 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:18.832897 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a0c67e5-c59c-47cc-b710-3c9a13373797 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:18.833342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a0c67e5-c59c-47cc-b710-3c9a13373797 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:18.848682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:18.967066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9a0c67e5-c59c-47cc-b710-3c9a13373797 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:18.975461 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a0c67e5-c59c-47cc-b710-3c9a13373797 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.156755 Oct 11 20:36:18.976046 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3221/6487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:18 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:19.998950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-382e2c95-be8a-4939-a2c1-d4210210e373 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:19.999562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-382e2c95-be8a-4939-a2c1-d4210210e373 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:20.006958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-382e2c95-be8a-4939-a2c1-d4210210e373 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:20.007448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-382e2c95-be8a-4939-a2c1-d4210210e373 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:20.007883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-382e2c95-be8a-4939-a2c1-d4210210e373 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:20.008573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-382e2c95-be8a-4939-a2c1-d4210210e373 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:20.009027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-382e2c95-be8a-4939-a2c1-d4210210e373 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:20.009467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-382e2c95-be8a-4939-a2c1-d4210210e373 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:20.139870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-382e2c95-be8a-4939-a2c1-d4210210e373 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:20.148084 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-382e2c95-be8a-4939-a2c1-d4210210e373 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.153098 Oct 11 20:36:20.148670 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3267/6488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:19 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:21.171176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e4651f7f-9f55-4ea3-8893-6fbf933cfa61 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:21.171834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e4651f7f-9f55-4ea3-8893-6fbf933cfa61 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:21.174653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:21.180279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4651f7f-9f55-4ea3-8893-6fbf933cfa61 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:21.180793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4651f7f-9f55-4ea3-8893-6fbf933cfa61 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:21.181250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4651f7f-9f55-4ea3-8893-6fbf933cfa61 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:21.181959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4651f7f-9f55-4ea3-8893-6fbf933cfa61 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:21.182438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4651f7f-9f55-4ea3-8893-6fbf933cfa61 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:21.182911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4651f7f-9f55-4ea3-8893-6fbf933cfa61 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:21.315600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4651f7f-9f55-4ea3-8893-6fbf933cfa61 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:21.323666 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e4651f7f-9f55-4ea3-8893-6fbf933cfa61 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.156438 Oct 11 20:36:21.324244 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3222/6489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:21 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:22.346785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a4fad48-a32f-4d9e-b419-493b8067ef75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:22.347320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5a4fad48-a32f-4d9e-b419-493b8067ef75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:22.349995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:22.355243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4fad48-a32f-4d9e-b419-493b8067ef75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:22.355726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4fad48-a32f-4d9e-b419-493b8067ef75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:22.356160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4fad48-a32f-4d9e-b419-493b8067ef75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:22.356841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4fad48-a32f-4d9e-b419-493b8067ef75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:22.357290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4fad48-a32f-4d9e-b419-493b8067ef75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:22.357711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a4fad48-a32f-4d9e-b419-493b8067ef75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:22.494434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5a4fad48-a32f-4d9e-b419-493b8067ef75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:22.502461 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a4fad48-a32f-4d9e-b419-493b8067ef75 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.159754 Oct 11 20:36:22.503070 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3268/6490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:22 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:23.525467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d165e1c5-b76c-4812-ba16-c2b9830fc0d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:23.526096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d165e1c5-b76c-4812-ba16-c2b9830fc0d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:23.533044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d165e1c5-b76c-4812-ba16-c2b9830fc0d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:23.533576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d165e1c5-b76c-4812-ba16-c2b9830fc0d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:23.534035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d165e1c5-b76c-4812-ba16-c2b9830fc0d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:23.534775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d165e1c5-b76c-4812-ba16-c2b9830fc0d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:23.535253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d165e1c5-b76c-4812-ba16-c2b9830fc0d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:23.535706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d165e1c5-b76c-4812-ba16-c2b9830fc0d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:23.662886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d165e1c5-b76c-4812-ba16-c2b9830fc0d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:23.670589 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d165e1c5-b76c-4812-ba16-c2b9830fc0d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.149077 Oct 11 20:36:23.671177 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3223/6491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:23 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:24.695401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d4d4195c-6f14-4ae5-bf4b-9887934e43f6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:24.696019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d4d4195c-6f14-4ae5-bf4b-9887934e43f6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:24.703226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4d4195c-6f14-4ae5-bf4b-9887934e43f6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:24.703721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4d4195c-6f14-4ae5-bf4b-9887934e43f6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:24.704164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4d4195c-6f14-4ae5-bf4b-9887934e43f6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:24.704859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4d4195c-6f14-4ae5-bf4b-9887934e43f6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:24.706037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4d4195c-6f14-4ae5-bf4b-9887934e43f6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:24.706506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4d4195c-6f14-4ae5-bf4b-9887934e43f6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:24.841191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d4d4195c-6f14-4ae5-bf4b-9887934e43f6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:24.849616 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d4d4195c-6f14-4ae5-bf4b-9887934e43f6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.158207 Oct 11 20:36:24.850204 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3269/6492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:24 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:25.873656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8890b57c-ce19-4d04-9370-8c8a3165aa76 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:25.874262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8890b57c-ce19-4d04-9370-8c8a3165aa76 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:25.877990 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:36:25.878141 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 20:36:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde (ip 10.222.0.27) !!! Oct 11 20:36:25.885754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8890b57c-ce19-4d04-9370-8c8a3165aa76 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:25.886254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8890b57c-ce19-4d04-9370-8c8a3165aa76 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:25.886735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8890b57c-ce19-4d04-9370-8c8a3165aa76 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:25.887446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8890b57c-ce19-4d04-9370-8c8a3165aa76 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:25.887915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8890b57c-ce19-4d04-9370-8c8a3165aa76 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:25.888354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8890b57c-ce19-4d04-9370-8c8a3165aa76 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:26.018770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8890b57c-ce19-4d04-9370-8c8a3165aa76 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:26.026501 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8890b57c-ce19-4d04-9370-8c8a3165aa76 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.156866 Oct 11 20:36:26.027100 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3224/6493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:25 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:27.051092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2be822fa-a848-47b3-8a79-7d2dd5186fc7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:27.051714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2be822fa-a848-47b3-8a79-7d2dd5186fc7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:27.059280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2be822fa-a848-47b3-8a79-7d2dd5186fc7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:27.059768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2be822fa-a848-47b3-8a79-7d2dd5186fc7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:27.060212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2be822fa-a848-47b3-8a79-7d2dd5186fc7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:27.060914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2be822fa-a848-47b3-8a79-7d2dd5186fc7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:27.061372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2be822fa-a848-47b3-8a79-7d2dd5186fc7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:27.061802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2be822fa-a848-47b3-8a79-7d2dd5186fc7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:27.194090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2be822fa-a848-47b3-8a79-7d2dd5186fc7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:27.202060 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2be822fa-a848-47b3-8a79-7d2dd5186fc7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.155025 Oct 11 20:36:27.202651 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3270/6494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:27 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:28.225520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ddb66012-d577-427f-9238-72d3936462d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:28.226206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ddb66012-d577-427f-9238-72d3936462d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:28.232839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ddb66012-d577-427f-9238-72d3936462d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:28.233346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ddb66012-d577-427f-9238-72d3936462d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:28.233788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ddb66012-d577-427f-9238-72d3936462d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:28.234497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ddb66012-d577-427f-9238-72d3936462d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:28.234990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ddb66012-d577-427f-9238-72d3936462d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:28.235431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ddb66012-d577-427f-9238-72d3936462d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:28.370148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ddb66012-d577-427f-9238-72d3936462d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:28.378397 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ddb66012-d577-427f-9238-72d3936462d9 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.156021 Oct 11 20:36:28.379007 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3225/6495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:28 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:29.403085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-eb371f76-45eb-45c4-8cb1-afa867aa3305 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:29.403634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-eb371f76-45eb-45c4-8cb1-afa867aa3305 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:29.410852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb371f76-45eb-45c4-8cb1-afa867aa3305 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:29.411341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb371f76-45eb-45c4-8cb1-afa867aa3305 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:29.411785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb371f76-45eb-45c4-8cb1-afa867aa3305 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:29.412477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb371f76-45eb-45c4-8cb1-afa867aa3305 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:29.412935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb371f76-45eb-45c4-8cb1-afa867aa3305 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:29.413360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-eb371f76-45eb-45c4-8cb1-afa867aa3305 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:29.544299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-eb371f76-45eb-45c4-8cb1-afa867aa3305 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:29.552776 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-eb371f76-45eb-45c4-8cb1-afa867aa3305 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.153645 Oct 11 20:36:29.553352 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3271/6496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:29 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:30.578373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f8ab648b-05e4-4175-8cfb-797c280ba314 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:30.579033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f8ab648b-05e4-4175-8cfb-797c280ba314 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:30.585971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8ab648b-05e4-4175-8cfb-797c280ba314 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:30.586466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8ab648b-05e4-4175-8cfb-797c280ba314 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:30.586956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8ab648b-05e4-4175-8cfb-797c280ba314 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:30.587650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8ab648b-05e4-4175-8cfb-797c280ba314 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:30.588114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8ab648b-05e4-4175-8cfb-797c280ba314 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:30.588548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f8ab648b-05e4-4175-8cfb-797c280ba314 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:30.717683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f8ab648b-05e4-4175-8cfb-797c280ba314 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:30.725596 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f8ab648b-05e4-4175-8cfb-797c280ba314 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.152576 Oct 11 20:36:30.726176 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3226/6497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:30 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:31.749039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d769e990-ab4d-4b3f-97cc-53eb923c76c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:31.749656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d769e990-ab4d-4b3f-97cc-53eb923c76c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:31.757297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d769e990-ab4d-4b3f-97cc-53eb923c76c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:31.757778 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d769e990-ab4d-4b3f-97cc-53eb923c76c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:31.758218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d769e990-ab4d-4b3f-97cc-53eb923c76c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:31.758936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d769e990-ab4d-4b3f-97cc-53eb923c76c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:31.759392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d769e990-ab4d-4b3f-97cc-53eb923c76c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:31.759817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d769e990-ab4d-4b3f-97cc-53eb923c76c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:32.267144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d769e990-ab4d-4b3f-97cc-53eb923c76c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:32.275714 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d769e990-ab4d-4b3f-97cc-53eb923c76c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1520 microversion: 2.1 time: 0.530546 Oct 11 20:36:32.276288 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3272/6498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:31 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1520 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:32.845830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-52dafa26-f0cc-4ce4-aa9a-3444528e602e req-eb90af70-f899-429e-8570-3247bde6cb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3739af2b-632a-4d3c-a815-164d0f722dde", "name": "network-vif-unplugged", "status": "completed", "tag": "5a60f1fc-1bb8-4bfe-8821-9015382f46f9"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:32.855457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-52dafa26-f0cc-4ce4-aa9a-3444528e602e req-eb90af70-f899-429e-8570-3247bde6cb93 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:32.855954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-52dafa26-f0cc-4ce4-aa9a-3444528e602e req-eb90af70-f899-429e-8570-3247bde6cb93 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:32.856392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-52dafa26-f0cc-4ce4-aa9a-3444528e602e req-eb90af70-f899-429e-8570-3247bde6cb93 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:32.869579 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-52dafa26-f0cc-4ce4-aa9a-3444528e602e req-eb90af70-f899-429e-8570-3247bde6cb93 service nova] Creating event network-vif-unplugged:5a60f1fc-1bb8-4bfe-8821-9015382f46f9 for instance 3739af2b-632a-4d3c-a815-164d0f722dde on n-h2-860864-3 Oct 11 20:36:32.875458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-52dafa26-f0cc-4ce4-aa9a-3444528e602e req-eb90af70-f899-429e-8570-3247bde6cb93 service nova] Instance 3739af2b-632a-4d3c-a815-164d0f722dde is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:36:32.887351 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-52dafa26-f0cc-4ce4-aa9a-3444528e602e req-eb90af70-f899-429e-8570-3247bde6cb93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111614 Oct 11 20:36:32.887977 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3227/6499] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:36:33.299938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3dd8bb7-477f-4e90-a8fd-6525e36b12a6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:33.300559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3dd8bb7-477f-4e90-a8fd-6525e36b12a6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:33.307411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3dd8bb7-477f-4e90-a8fd-6525e36b12a6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:33.307900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3dd8bb7-477f-4e90-a8fd-6525e36b12a6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:33.308341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3dd8bb7-477f-4e90-a8fd-6525e36b12a6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:33.309039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3dd8bb7-477f-4e90-a8fd-6525e36b12a6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:33.309491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3dd8bb7-477f-4e90-a8fd-6525e36b12a6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:33.309918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3dd8bb7-477f-4e90-a8fd-6525e36b12a6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:33.526056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c3dd8bb7-477f-4e90-a8fd-6525e36b12a6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:33.528308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=82 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:33.536649 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3dd8bb7-477f-4e90-a8fd-6525e36b12a6 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1519 microversion: 2.1 time: 0.241182 Oct 11 20:36:33.537238 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3273/6500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:33 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:34.561996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-60fb544b-0d2b-438a-bcc0-6a15f4e2d9dc tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:34.562745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-60fb544b-0d2b-438a-bcc0-6a15f4e2d9dc tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:34.569910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60fb544b-0d2b-438a-bcc0-6a15f4e2d9dc tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:34.570414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60fb544b-0d2b-438a-bcc0-6a15f4e2d9dc tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:34.570898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60fb544b-0d2b-438a-bcc0-6a15f4e2d9dc tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:34.571599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60fb544b-0d2b-438a-bcc0-6a15f4e2d9dc tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:34.572071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60fb544b-0d2b-438a-bcc0-6a15f4e2d9dc tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:34.572513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60fb544b-0d2b-438a-bcc0-6a15f4e2d9dc tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:34.707083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-60fb544b-0d2b-438a-bcc0-6a15f4e2d9dc tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:34.715330 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-60fb544b-0d2b-438a-bcc0-6a15f4e2d9dc tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1517 microversion: 2.1 time: 0.158508 Oct 11 20:36:34.715906 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3228/6501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:34 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:34.906154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-1c2c4c61-1901-4e5a-b4cd-399fa620fb19 req-431ced5a-0e07-420a-97b5-e3bc83b09661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3739af2b-632a-4d3c-a815-164d0f722dde", "tag": "5a60f1fc-1bb8-4bfe-8821-9015382f46f9"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:34.917550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1c2c4c61-1901-4e5a-b4cd-399fa620fb19 req-431ced5a-0e07-420a-97b5-e3bc83b09661 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:34.917972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1c2c4c61-1901-4e5a-b4cd-399fa620fb19 req-431ced5a-0e07-420a-97b5-e3bc83b09661 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:34.918410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-1c2c4c61-1901-4e5a-b4cd-399fa620fb19 req-431ced5a-0e07-420a-97b5-e3bc83b09661 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:34.929913 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-1c2c4c61-1901-4e5a-b4cd-399fa620fb19 req-431ced5a-0e07-420a-97b5-e3bc83b09661 service nova] Creating event network-changed:5a60f1fc-1bb8-4bfe-8821-9015382f46f9 for instance 3739af2b-632a-4d3c-a815-164d0f722dde on n-h2-860864-3 Oct 11 20:36:34.935220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-1c2c4c61-1901-4e5a-b4cd-399fa620fb19 req-431ced5a-0e07-420a-97b5-e3bc83b09661 service nova] Instance 3739af2b-632a-4d3c-a815-164d0f722dde is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:36:34.946151 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-1c2c4c61-1901-4e5a-b4cd-399fa620fb19 req-431ced5a-0e07-420a-97b5-e3bc83b09661 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043791 Oct 11 20:36:34.946775 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3274/6502] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:36:35.739864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ed32e71b-3809-442a-9d9a-b4862d378994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:35.740410 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ed32e71b-3809-442a-9d9a-b4862d378994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:35.747296 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed32e71b-3809-442a-9d9a-b4862d378994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:35.747826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed32e71b-3809-442a-9d9a-b4862d378994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:35.748275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed32e71b-3809-442a-9d9a-b4862d378994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:35.749172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed32e71b-3809-442a-9d9a-b4862d378994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:35.749642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed32e71b-3809-442a-9d9a-b4862d378994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:35.750081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed32e71b-3809-442a-9d9a-b4862d378994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:35.910888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ed32e71b-3809-442a-9d9a-b4862d378994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:35.918641 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ed32e71b-3809-442a-9d9a-b4862d378994 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1514 microversion: 2.1 time: 0.183358 Oct 11 20:36:35.919481 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3229/6503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:35 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:36:35.943569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-40dcfa13-7763-4baa-9ebb-d8c8810887ea tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:35.944199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-40dcfa13-7763-4baa-9ebb-d8c8810887ea tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:35.951325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40dcfa13-7763-4baa-9ebb-d8c8810887ea tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:35.951802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40dcfa13-7763-4baa-9ebb-d8c8810887ea tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:35.952246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40dcfa13-7763-4baa-9ebb-d8c8810887ea tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:35.953199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40dcfa13-7763-4baa-9ebb-d8c8810887ea tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:35.953676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40dcfa13-7763-4baa-9ebb-d8c8810887ea tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:35.956234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-40dcfa13-7763-4baa-9ebb-d8c8810887ea tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:36.019772 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-40dcfa13-7763-4baa-9ebb-d8c8810887ea tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "POST /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde/action" status: 204 len: 0 microversion: 2.1 time: 0.081948 Oct 11 20:36:36.020455 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3275/6504] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:36:35 2022] POST /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 20:36:36.029721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c3df187c-7496-439a-9fdc-c6904be1c16c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:36.030348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c3df187c-7496-439a-9fdc-c6904be1c16c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:36.036994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3df187c-7496-439a-9fdc-c6904be1c16c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:36.037609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3df187c-7496-439a-9fdc-c6904be1c16c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:36.038159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3df187c-7496-439a-9fdc-c6904be1c16c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:36.039014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3df187c-7496-439a-9fdc-c6904be1c16c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:36.039602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3df187c-7496-439a-9fdc-c6904be1c16c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:36.040717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3df187c-7496-439a-9fdc-c6904be1c16c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:36.258670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c3df187c-7496-439a-9fdc-c6904be1c16c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:36.266585 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c3df187c-7496-439a-9fdc-c6904be1c16c tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1514 microversion: 2.1 time: 0.241844 Oct 11 20:36:36.267179 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3230/6505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:36 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:37.291206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e88b795-5735-4597-b15a-f19fb5f775bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:37.291946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e88b795-5735-4597-b15a-f19fb5f775bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:37.299296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e88b795-5735-4597-b15a-f19fb5f775bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:37.299782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e88b795-5735-4597-b15a-f19fb5f775bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:37.300226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e88b795-5735-4597-b15a-f19fb5f775bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:37.300945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e88b795-5735-4597-b15a-f19fb5f775bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:37.301400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e88b795-5735-4597-b15a-f19fb5f775bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:37.301825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e88b795-5735-4597-b15a-f19fb5f775bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:37.438226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e88b795-5735-4597-b15a-f19fb5f775bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:37.446519 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e88b795-5735-4597-b15a-f19fb5f775bf tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1506 microversion: 2.1 time: 0.159847 Oct 11 20:36:37.447117 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3276/6506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:37 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:37.469691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1a80de5c-63f3-4c1a-8dc6-010ffd39cd0f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:37.470251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1a80de5c-63f3-4c1a-8dc6-010ffd39cd0f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:37.477355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a80de5c-63f3-4c1a-8dc6-010ffd39cd0f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:37.477862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a80de5c-63f3-4c1a-8dc6-010ffd39cd0f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:37.478322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a80de5c-63f3-4c1a-8dc6-010ffd39cd0f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:37.479071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a80de5c-63f3-4c1a-8dc6-010ffd39cd0f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:37.479543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a80de5c-63f3-4c1a-8dc6-010ffd39cd0f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:37.479984 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1a80de5c-63f3-4c1a-8dc6-010ffd39cd0f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:37.609084 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1a80de5c-63f3-4c1a-8dc6-010ffd39cd0f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:37.617013 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1a80de5c-63f3-4c1a-8dc6-010ffd39cd0f tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1506 microversion: 2.1 time: 0.151291 Oct 11 20:36:37.617594 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3231/6507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:37 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:37.639438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6201425b-e0b1-4fb9-ad7c-3092f655c3ed tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:37.640065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6201425b-e0b1-4fb9-ad7c-3092f655c3ed tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:37.646430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201425b-e0b1-4fb9-ad7c-3092f655c3ed tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:37.646940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201425b-e0b1-4fb9-ad7c-3092f655c3ed tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:37.647371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201425b-e0b1-4fb9-ad7c-3092f655c3ed tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:37.648049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201425b-e0b1-4fb9-ad7c-3092f655c3ed tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:37.648495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201425b-e0b1-4fb9-ad7c-3092f655c3ed tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:37.648914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6201425b-e0b1-4fb9-ad7c-3092f655c3ed tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:37.779563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6201425b-e0b1-4fb9-ad7c-3092f655c3ed tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:37.788769 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6201425b-e0b1-4fb9-ad7c-3092f655c3ed tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1506 microversion: 2.1 time: 0.153213 Oct 11 20:36:37.789591 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3277/6508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:37 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:37.812282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-05ff2d9e-5715-4add-965d-5a5d801752ce tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:37.812842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05ff2d9e-5715-4add-965d-5a5d801752ce tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:37.819032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05ff2d9e-5715-4add-965d-5a5d801752ce tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:37.819538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05ff2d9e-5715-4add-965d-5a5d801752ce tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:37.820000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05ff2d9e-5715-4add-965d-5a5d801752ce tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:37.820706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05ff2d9e-5715-4add-965d-5a5d801752ce tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:37.821175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05ff2d9e-5715-4add-965d-5a5d801752ce tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:37.821618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-05ff2d9e-5715-4add-965d-5a5d801752ce tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:37.848002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-05ff2d9e-5715-4add-965d-5a5d801752ce tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:36:37.932674 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-05ff2d9e-5715-4add-965d-5a5d801752ce tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 204 len: 0 microversion: 2.1 time: 0.123967 Oct 11 20:36:37.936397 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3232/6509] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:36:37 2022] DELETE /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:36:37.950573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:37.951256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:37.958010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:37.958519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:37.959004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:37.959717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:37.960189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:37.960628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:37.992231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:36:38.005421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c288de3c-f5bd-4f96-b352-a9bef3442149 req-f2235cf0-6830-48ed-8959-dac60fef85f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3739af2b-632a-4d3c-a815-164d0f722dde", "name": "network-vif-plugged", "status": "completed", "tag": "5a60f1fc-1bb8-4bfe-8821-9015382f46f9"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:38.014959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c288de3c-f5bd-4f96-b352-a9bef3442149 req-f2235cf0-6830-48ed-8959-dac60fef85f5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:38.015446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c288de3c-f5bd-4f96-b352-a9bef3442149 req-f2235cf0-6830-48ed-8959-dac60fef85f5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:38.015884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c288de3c-f5bd-4f96-b352-a9bef3442149 req-f2235cf0-6830-48ed-8959-dac60fef85f5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:38.027796 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c288de3c-f5bd-4f96-b352-a9bef3442149 req-f2235cf0-6830-48ed-8959-dac60fef85f5 service nova] Creating event network-vif-plugged:5a60f1fc-1bb8-4bfe-8821-9015382f46f9 for instance 3739af2b-632a-4d3c-a815-164d0f722dde on n-h2-860864-3 Oct 11 20:36:38.032721 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c288de3c-f5bd-4f96-b352-a9bef3442149 req-f2235cf0-6830-48ed-8959-dac60fef85f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124877 Oct 11 20:36:38.034284 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3278/6510] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:36:38.039136 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.compute.api [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Instance is already in deleting state, ignoring this request Oct 11 20:36:38.039984 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4802c5c7-f21d-43a9-b6cd-a2e7482a62fd tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 204 len: 0 microversion: 2.1 time: 0.093954 Oct 11 20:36:38.040549 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3233/6511] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:36:37 2022] DELETE /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:36:38.048820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-04143479-6a4d-4117-ae3d-700660f50f17 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:38.049550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-04143479-6a4d-4117-ae3d-700660f50f17 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:38.055727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04143479-6a4d-4117-ae3d-700660f50f17 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:38.056217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04143479-6a4d-4117-ae3d-700660f50f17 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:38.056662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04143479-6a4d-4117-ae3d-700660f50f17 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:38.057365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04143479-6a4d-4117-ae3d-700660f50f17 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:38.057833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04143479-6a4d-4117-ae3d-700660f50f17 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:38.058271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04143479-6a4d-4117-ae3d-700660f50f17 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:38.187846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-04143479-6a4d-4117-ae3d-700660f50f17 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:38.196250 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-04143479-6a4d-4117-ae3d-700660f50f17 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1512 microversion: 2.1 time: 0.151530 Oct 11 20:36:38.196830 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3279/6512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:38 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:36:39.220287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-20a7f17d-2ace-44b2-874e-89d946670ec5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:39.221714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-20a7f17d-2ace-44b2-874e-89d946670ec5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:39.228682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20a7f17d-2ace-44b2-874e-89d946670ec5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:39.229183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20a7f17d-2ace-44b2-874e-89d946670ec5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:39.229632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20a7f17d-2ace-44b2-874e-89d946670ec5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:39.230339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20a7f17d-2ace-44b2-874e-89d946670ec5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:39.230828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20a7f17d-2ace-44b2-874e-89d946670ec5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:39.231268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20a7f17d-2ace-44b2-874e-89d946670ec5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:39.480681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-20a7f17d-2ace-44b2-874e-89d946670ec5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8968eed8964a4ea7b86e535625d48ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96feeb52c6404c903aa288e4ffd73b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:39.489053 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-20a7f17d-2ace-44b2-874e-89d946670ec5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 200 len: 1512 microversion: 2.1 time: 0.272665 Oct 11 20:36:39.489899 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3234/6513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:39 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:39.748870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-cd999f99-0c15-4c9e-a3f9-6ef659319056 req-1a31f813-83a7-4f63-88aa-1020e75bc7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3739af2b-632a-4d3c-a815-164d0f722dde", "name": "network-vif-deleted", "tag": "5a60f1fc-1bb8-4bfe-8821-9015382f46f9"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:39.762259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cd999f99-0c15-4c9e-a3f9-6ef659319056 req-1a31f813-83a7-4f63-88aa-1020e75bc7d9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:39.762785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cd999f99-0c15-4c9e-a3f9-6ef659319056 req-1a31f813-83a7-4f63-88aa-1020e75bc7d9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:39.763934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cd999f99-0c15-4c9e-a3f9-6ef659319056 req-1a31f813-83a7-4f63-88aa-1020e75bc7d9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:39.779774 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-cd999f99-0c15-4c9e-a3f9-6ef659319056 req-1a31f813-83a7-4f63-88aa-1020e75bc7d9 service nova] Creating event network-vif-deleted:5a60f1fc-1bb8-4bfe-8821-9015382f46f9 for instance 3739af2b-632a-4d3c-a815-164d0f722dde on n-h2-860864-3 Oct 11 20:36:39.786490 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-cd999f99-0c15-4c9e-a3f9-6ef659319056 req-1a31f813-83a7-4f63-88aa-1020e75bc7d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041797 Oct 11 20:36:39.787353 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3280/6514] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:36:40.512922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:40.513549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 3739af2b-632a-4d3c-a815-164d0f722dde] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:40.521623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:40.522129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:40.522606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:40.523313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:40.523777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:40.524214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:40.537883 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] HTTP exception thrown: Instance 3739af2b-632a-4d3c-a815-164d0f722dde could not be found. Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Request method failure captured: Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde HTTP/1.1 Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdN46wth5f9dykSGSIG0b4YcNy6-ybCbp8RiGukbNDnHpZjTOp2BteddJaS6_pKztlY8JO5ntQUZVQNf75q1uzqEgYpTReGL0N4qCP5T_9Qmc3htHrSFZ-fHM7to43ovAX7qL1NUOHSoCqrNixTS8rGWuT78jkvp5MtEj2jyA_g9uNQ Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 1a96feeb52c6404c903aa288e4ffd73b Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1613031170 Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a96feeb52c6404c903aa288e4ffd73b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a96feeb52c6404c903aa288e4ffd73b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a96feeb52c6404c903aa288e4ffd73b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a96feeb52c6404c903aa288e4ffd73b"}]}] Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerDiskConfigTestJSON-1613031170 Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 1a96feeb52c6404c903aa288e4ffd73b Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1613031170 Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerDiskConfigTestJSON-1613031170-project Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8968eed8964a4ea7b86e535625d48ec1 Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerDiskConfigTestJSON-1613031170-project Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 3739af2b-632a-4d3c-a815-164d0f722dde could not be found. Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '3739af2b-632a-4d3c-a815-164d0f722dde'} Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3739af2b-632a-4d3c-a815-164d0f722dde could not be found. Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3739af2b-632a-4d3c-a815-164d0f722dde could not be found. Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:36:40.539578 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:36:40.544702 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:36:40.544702 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:36:40.544702 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:36:40.544702 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:36:40.544702 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:36:40.544702 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3739af2b-632a-4d3c-a815-164d0f722dde could not be found. Oct 11 20:36:40.544702 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:36:40.544702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Returning 404 to user: Instance 3739af2b-632a-4d3c-a815-164d0f722dde could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:36:40.544702 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b9fdcaee-d877-4973-befb-e80f4122e2c1 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde" status: 404 len: 111 microversion: 2.1 time: 0.032088 Oct 11 20:36:40.544702 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3235/6515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:40 2022] GET /compute/v2.1/servers/3739af2b-632a-4d3c-a815-164d0f722dde => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:36:40.550572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-174b15ed-e200-45c1-9d81-03781a2370c7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '.version_select at 0x7f83cc4858b0>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:40.570520 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-174b15ed-e200-45c1-9d81-03781a2370c7 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-393758146" status: 202 len: 0 microversion: 2.1 time: 0.024457 Oct 11 20:36:40.571110 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3281/6516] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 11 20:36:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-393758146 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:36:41.181949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:41.182464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:41.188506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:41.189006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:41.189546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:41.190790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:41.191247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:41.191692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:41.195760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:41.206636 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] HTTP exception thrown: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Request method failure captured: Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 HTTP/1.1 Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdN46wth5f9dykSGSIG0b4YcNy6-ybCbp8RiGukbNDnHpZjTOp2BteddJaS6_pKztlY8JO5ntQUZVQNf75q1uzqEgYpTReGL0N4qCP5T_9Qmc3htHrSFZ-fHM7to43ovAX7qL1NUOHSoCqrNixTS8rGWuT78jkvp5MtEj2jyA_g9uNQ Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 1a96feeb52c6404c903aa288e4ffd73b Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1613031170 Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a96feeb52c6404c903aa288e4ffd73b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a96feeb52c6404c903aa288e4ffd73b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a96feeb52c6404c903aa288e4ffd73b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a96feeb52c6404c903aa288e4ffd73b"}]}] Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerDiskConfigTestJSON-1613031170 Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 1a96feeb52c6404c903aa288e4ffd73b Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1613031170 Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerDiskConfigTestJSON-1613031170-project Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 8968eed8964a4ea7b86e535625d48ec1 Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerDiskConfigTestJSON-1613031170-project Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '53328ab6-67ac-44b9-9059-ba24c8d99fd8'} Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:36:41.208217 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Returning 404 to user: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5017b2f4-b20f-402a-8196-67ae2550c8c5 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "DELETE /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 404 len: 111 microversion: 2.1 time: 0.031625 Oct 11 20:36:41.212145 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3236/6517] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:36:41 2022] DELETE /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:36:41.219009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:41.219746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] [instance: 53328ab6-67ac-44b9-9059-ba24c8d99fd8] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:41.227307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:41.227785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:41.228219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:41.228898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:41.229348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:41.229769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:41.243258 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] HTTP exception thrown: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Request method failure captured: Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 HTTP/1.1 Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdN46wth5f9dykSGSIG0b4YcNy6-ybCbp8RiGukbNDnHpZjTOp2BteddJaS6_pKztlY8JO5ntQUZVQNf75q1uzqEgYpTReGL0N4qCP5T_9Qmc3htHrSFZ-fHM7to43ovAX7qL1NUOHSoCqrNixTS8rGWuT78jkvp5MtEj2jyA_g9uNQ Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 1a96feeb52c6404c903aa288e4ffd73b Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1613031170 Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a96feeb52c6404c903aa288e4ffd73b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a96feeb52c6404c903aa288e4ffd73b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a96feeb52c6404c903aa288e4ffd73b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a96feeb52c6404c903aa288e4ffd73b"}]}] Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerDiskConfigTestJSON-1613031170 Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 1a96feeb52c6404c903aa288e4ffd73b Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1613031170 Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerDiskConfigTestJSON-1613031170-project Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 8968eed8964a4ea7b86e535625d48ec1 Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerDiskConfigTestJSON-1613031170-project Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '53328ab6-67ac-44b9-9059-ba24c8d99fd8'} Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:36:41.244887 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:36:41.248782 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:36:41.248782 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:36:41.248782 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:36:41.248782 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:36:41.248782 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:36:41.248782 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. Oct 11 20:36:41.248782 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:36:41.248782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] Returning 404 to user: Instance 53328ab6-67ac-44b9-9059-ba24c8d99fd8 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:36:41.248782 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c299885e-7e4b-4c74-8f32-1dee1a3a2af0 tempest-ServerDiskConfigTestJSON-1613031170 tempest-ServerDiskConfigTestJSON-1613031170-project] 10.222.0.27 "GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8" status: 404 len: 111 microversion: 2.1 time: 0.032016 Oct 11 20:36:41.248782 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3282/6518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:41 2022] GET /compute/v2.1/servers/53328ab6-67ac-44b9-9059-ba24c8d99fd8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:36:49.897399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b478e8a-0396-4c3b-b058-0ffede821883 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'create', calling method: .version_select at 0x7f83cc05d5e0>, body: {"keypair": {"name": "tempest-keypair-1593808265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD04wyVPl3XYpGcQH6cDJLCU0NLpnfIO/Jn72gr0a2vAxtm0pKgfALJulsYFdVUjAcqepX+NQ0Hmmr2frdNeKQcnLSjdNV7/EuspoHaTy19EcJTofMvozbHOS8i4uZONow=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:49.914739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-7b478e8a-0396-4c3b-b058-0ffede821883 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for project b52c54fe81544f05bb58bc292d2f1401. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:36:49.920677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-7b478e8a-0396-4c3b-b058-0ffede821883 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for user 12e7db2ab50d458583122a6bbba08426 and project b52c54fe81544f05bb58bc292d2f1401. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:36:49.952365 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7b478e8a-0396-4c3b-b058-0ffede821883 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183080 Oct 11 20:36:49.953013 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3237/6519] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:36:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:36:51.630237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-858413639", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4726f166-4133-4359-bc50-3edb25c6edd3"}], "security_groups": [{"name": "tempest-securitygroup--1093113557"}], "key_name": "tempest-keypair-1593808265", "user_data": "}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:51.639295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:51.640063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:51.744287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] validate_networks() for [('4726f166-4133-4359-bc50-3edb25c6edd3', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:36:52.122120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:36:52.122577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:36:52.123063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:36:52.123738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:36:52.124165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:36:52.133622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:52.134121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:52.134589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:52.135331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:52.135794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:52.136227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:52.154126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:36:52.160346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for user 12e7db2ab50d458583122a6bbba08426 and project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:36:52.173041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:36:52.175941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:36:52.225514 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-51c97e27-ba4b-44f6-96d1-c7818cdfd2dd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.601218 Oct 11 20:36:52.226475 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3283/6520] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:36:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:36:52.239300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6a8fe246-d03f-4868-999d-0250ee3f6af7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:52.240158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6a8fe246-d03f-4868-999d-0250ee3f6af7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:52.243131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:36:52.311962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6a8fe246-d03f-4868-999d-0250ee3f6af7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:52.321696 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6a8fe246-d03f-4868-999d-0250ee3f6af7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1238 microversion: 2.1 time: 0.087911 Oct 11 20:36:52.337237 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3238/6521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:52 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:53.349634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-59cd480a-3f27-4767-ba32-fb42c253da1c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:53.351613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59cd480a-3f27-4767-ba32-fb42c253da1c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:53.365896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59cd480a-3f27-4767-ba32-fb42c253da1c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:53.366752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59cd480a-3f27-4767-ba32-fb42c253da1c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:53.367535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59cd480a-3f27-4767-ba32-fb42c253da1c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:53.369928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59cd480a-3f27-4767-ba32-fb42c253da1c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:53.370581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59cd480a-3f27-4767-ba32-fb42c253da1c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:53.371162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59cd480a-3f27-4767-ba32-fb42c253da1c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:53.458681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59cd480a-3f27-4767-ba32-fb42c253da1c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:53.467144 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-59cd480a-3f27-4767-ba32-fb42c253da1c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1308 microversion: 2.1 time: 0.125715 Oct 11 20:36:53.467835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3284/6522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:53 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1308 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:54.493874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eacd5e66-f2e9-4709-9b5f-689d15623ef6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:54.494749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eacd5e66-f2e9-4709-9b5f-689d15623ef6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:54.509435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eacd5e66-f2e9-4709-9b5f-689d15623ef6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:54.511357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eacd5e66-f2e9-4709-9b5f-689d15623ef6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:54.511824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eacd5e66-f2e9-4709-9b5f-689d15623ef6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:54.512605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eacd5e66-f2e9-4709-9b5f-689d15623ef6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:54.513280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eacd5e66-f2e9-4709-9b5f-689d15623ef6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:54.513900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eacd5e66-f2e9-4709-9b5f-689d15623ef6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:54.733283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eacd5e66-f2e9-4709-9b5f-689d15623ef6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:54.741292 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eacd5e66-f2e9-4709-9b5f-689d15623ef6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1364 microversion: 2.1 time: 0.253536 Oct 11 20:36:54.741879 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3239/6523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:54 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:36:54.824082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-caccc9ff-1c15-4d1c-a730-c7c6ff181d16 req-61a873a2-1164-4220-9df0-ded1d7bd6fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94404510-de6c-4111-9f62-1903df7d2aa9", "tag": "f771f14f-b6a8-49a5-b12c-7b96769068d6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:54.840918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-caccc9ff-1c15-4d1c-a730-c7c6ff181d16 req-61a873a2-1164-4220-9df0-ded1d7bd6fe6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:54.841330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-caccc9ff-1c15-4d1c-a730-c7c6ff181d16 req-61a873a2-1164-4220-9df0-ded1d7bd6fe6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:54.841879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-caccc9ff-1c15-4d1c-a730-c7c6ff181d16 req-61a873a2-1164-4220-9df0-ded1d7bd6fe6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:54.853935 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-caccc9ff-1c15-4d1c-a730-c7c6ff181d16 req-61a873a2-1164-4220-9df0-ded1d7bd6fe6 service nova] Creating event network-changed:f771f14f-b6a8-49a5-b12c-7b96769068d6 for instance 94404510-de6c-4111-9f62-1903df7d2aa9 on n-h1-860864-3 Oct 11 20:36:54.859027 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-caccc9ff-1c15-4d1c-a730-c7c6ff181d16 req-61a873a2-1164-4220-9df0-ded1d7bd6fe6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039577 Oct 11 20:36:54.859780 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3285/6524] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:36:55.764759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5ac9ad59-8f3c-466a-ab30-2c89d7f2b8b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:55.765387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5ac9ad59-8f3c-466a-ab30-2c89d7f2b8b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:55.772281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac9ad59-8f3c-466a-ab30-2c89d7f2b8b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:55.772776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac9ad59-8f3c-466a-ab30-2c89d7f2b8b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:55.773219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac9ad59-8f3c-466a-ab30-2c89d7f2b8b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:55.773912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac9ad59-8f3c-466a-ab30-2c89d7f2b8b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:55.774374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac9ad59-8f3c-466a-ab30-2c89d7f2b8b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:55.774833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac9ad59-8f3c-466a-ab30-2c89d7f2b8b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:55.911933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5ac9ad59-8f3c-466a-ab30-2c89d7f2b8b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:55.919572 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5ac9ad59-8f3c-466a-ab30-2c89d7f2b8b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1364 microversion: 2.1 time: 0.158756 Oct 11 20:36:55.920144 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3240/6525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:55 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:56.943217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cba7cafa-2884-4ba9-af92-1a5583a38210 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:56.943918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cba7cafa-2884-4ba9-af92-1a5583a38210 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:56.951289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cba7cafa-2884-4ba9-af92-1a5583a38210 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:56.951768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cba7cafa-2884-4ba9-af92-1a5583a38210 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:56.952200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cba7cafa-2884-4ba9-af92-1a5583a38210 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:56.952882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cba7cafa-2884-4ba9-af92-1a5583a38210 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:56.953336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cba7cafa-2884-4ba9-af92-1a5583a38210 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:56.953755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cba7cafa-2884-4ba9-af92-1a5583a38210 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:57.084426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cba7cafa-2884-4ba9-af92-1a5583a38210 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:57.092344 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cba7cafa-2884-4ba9-af92-1a5583a38210 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1364 microversion: 2.1 time: 0.154021 Oct 11 20:36:57.092920 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3286/6526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:56 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:58.115397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-15e8e058-4e49-4cf2-983a-7b46c4208615 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:58.116031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-15e8e058-4e49-4cf2-983a-7b46c4208615 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:58.122950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15e8e058-4e49-4cf2-983a-7b46c4208615 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:58.123455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15e8e058-4e49-4cf2-983a-7b46c4208615 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:58.123914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15e8e058-4e49-4cf2-983a-7b46c4208615 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:58.124625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15e8e058-4e49-4cf2-983a-7b46c4208615 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:58.125101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15e8e058-4e49-4cf2-983a-7b46c4208615 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:58.125542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-15e8e058-4e49-4cf2-983a-7b46c4208615 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:58.260719 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-15e8e058-4e49-4cf2-983a-7b46c4208615 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:58.268681 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-15e8e058-4e49-4cf2-983a-7b46c4208615 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1364 microversion: 2.1 time: 0.157596 Oct 11 20:36:58.269306 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3241/6527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:58 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:59.292039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-409761f7-163c-4967-99b2-dd437b6556b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:36:59.292660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-409761f7-163c-4967-99b2-dd437b6556b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:36:59.299654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-409761f7-163c-4967-99b2-dd437b6556b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:59.300145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-409761f7-163c-4967-99b2-dd437b6556b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:59.300586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-409761f7-163c-4967-99b2-dd437b6556b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:59.301286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-409761f7-163c-4967-99b2-dd437b6556b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:59.301767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-409761f7-163c-4967-99b2-dd437b6556b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:59.302183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-409761f7-163c-4967-99b2-dd437b6556b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:59.429645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-409761f7-163c-4967-99b2-dd437b6556b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:36:59.437438 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-409761f7-163c-4967-99b2-dd437b6556b6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1364 microversion: 2.1 time: 0.149621 Oct 11 20:36:59.438016 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3287/6528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:36:59 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:36:59.951772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-332e7f54-e6d1-41c4-ba22-9db71a62fbb5 req-11d635b9-4476-45d6-9b46-9c97c5caa967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94404510-de6c-4111-9f62-1903df7d2aa9", "name": "network-vif-plugged", "status": "completed", "tag": "f771f14f-b6a8-49a5-b12c-7b96769068d6"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:36:59.962255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-332e7f54-e6d1-41c4-ba22-9db71a62fbb5 req-11d635b9-4476-45d6-9b46-9c97c5caa967 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:36:59.962780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-332e7f54-e6d1-41c4-ba22-9db71a62fbb5 req-11d635b9-4476-45d6-9b46-9c97c5caa967 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:36:59.963228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-332e7f54-e6d1-41c4-ba22-9db71a62fbb5 req-11d635b9-4476-45d6-9b46-9c97c5caa967 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:36:59.975394 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-332e7f54-e6d1-41c4-ba22-9db71a62fbb5 req-11d635b9-4476-45d6-9b46-9c97c5caa967 service nova] Creating event network-vif-plugged:f771f14f-b6a8-49a5-b12c-7b96769068d6 for instance 94404510-de6c-4111-9f62-1903df7d2aa9 on n-h1-860864-3 Oct 11 20:36:59.980324 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-332e7f54-e6d1-41c4-ba22-9db71a62fbb5 req-11d635b9-4476-45d6-9b46-9c97c5caa967 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032462 Oct 11 20:36:59.980921 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3242/6529] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:37:00.461773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1872742b-bb62-459a-b57d-9047e2e82503 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:00.462395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1872742b-bb62-459a-b57d-9047e2e82503 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:00.469303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1872742b-bb62-459a-b57d-9047e2e82503 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:00.469793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1872742b-bb62-459a-b57d-9047e2e82503 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:00.470236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1872742b-bb62-459a-b57d-9047e2e82503 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:00.470957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1872742b-bb62-459a-b57d-9047e2e82503 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:00.472046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1872742b-bb62-459a-b57d-9047e2e82503 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:00.472483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1872742b-bb62-459a-b57d-9047e2e82503 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:00.606317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1872742b-bb62-459a-b57d-9047e2e82503 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:00.614826 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1872742b-bb62-459a-b57d-9047e2e82503 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1364 microversion: 2.1 time: 0.156909 Oct 11 20:37:00.615413 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3288/6530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:00 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:01.638326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0bc654c2-0ed5-4fd1-8112-a493499125e9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:01.639091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0bc654c2-0ed5-4fd1-8112-a493499125e9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:01.646864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bc654c2-0ed5-4fd1-8112-a493499125e9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:01.647397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bc654c2-0ed5-4fd1-8112-a493499125e9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:01.647829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bc654c2-0ed5-4fd1-8112-a493499125e9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:01.648540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bc654c2-0ed5-4fd1-8112-a493499125e9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:01.649019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bc654c2-0ed5-4fd1-8112-a493499125e9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:01.649463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0bc654c2-0ed5-4fd1-8112-a493499125e9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:01.777574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0bc654c2-0ed5-4fd1-8112-a493499125e9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:01.785616 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0bc654c2-0ed5-4fd1-8112-a493499125e9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1550 microversion: 2.1 time: 0.151946 Oct 11 20:37:01.786192 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3243/6531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:01 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:01.808785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aca4c8b4-6e9b-4440-b1af-b72342596c7e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:01.809301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aca4c8b4-6e9b-4440-b1af-b72342596c7e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:01.817287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aca4c8b4-6e9b-4440-b1af-b72342596c7e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:01.817774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aca4c8b4-6e9b-4440-b1af-b72342596c7e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:01.818215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aca4c8b4-6e9b-4440-b1af-b72342596c7e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:01.818940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aca4c8b4-6e9b-4440-b1af-b72342596c7e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:01.819400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aca4c8b4-6e9b-4440-b1af-b72342596c7e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:01.819830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aca4c8b4-6e9b-4440-b1af-b72342596c7e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:01.898021 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aca4c8b4-6e9b-4440-b1af-b72342596c7e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093109 Oct 11 20:37:01.898657 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3289/6532] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:37:01 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:37:02.843358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ab2fb081-c3a5-488a-9805-7204a07a8f18 req-13781228-007d-4b20-ba5d-53598487c596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94404510-de6c-4111-9f62-1903df7d2aa9", "tag": "f771f14f-b6a8-49a5-b12c-7b96769068d6"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:37:02.849166 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:37:02.855939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab2fb081-c3a5-488a-9805-7204a07a8f18 req-13781228-007d-4b20-ba5d-53598487c596 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:02.856429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab2fb081-c3a5-488a-9805-7204a07a8f18 req-13781228-007d-4b20-ba5d-53598487c596 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:02.856870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab2fb081-c3a5-488a-9805-7204a07a8f18 req-13781228-007d-4b20-ba5d-53598487c596 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:02.867998 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ab2fb081-c3a5-488a-9805-7204a07a8f18 req-13781228-007d-4b20-ba5d-53598487c596 service nova] Creating event network-changed:f771f14f-b6a8-49a5-b12c-7b96769068d6 for instance 94404510-de6c-4111-9f62-1903df7d2aa9 on n-h1-860864-3 Oct 11 20:37:02.872852 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ab2fb081-c3a5-488a-9805-7204a07a8f18 req-13781228-007d-4b20-ba5d-53598487c596 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033073 Oct 11 20:37:02.873453 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3244/6533] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:37:39.121181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:37:39.121960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:37:39.124457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:37:39.125125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=32 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:37:39.130758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fa29d004-8f95-41d0-96f0-528339fb4fe0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:39.131412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fa29d004-8f95-41d0-96f0-528339fb4fe0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:39.139330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa29d004-8f95-41d0-96f0-528339fb4fe0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:39.139813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa29d004-8f95-41d0-96f0-528339fb4fe0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:39.140245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa29d004-8f95-41d0-96f0-528339fb4fe0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:39.140926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa29d004-8f95-41d0-96f0-528339fb4fe0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:39.141374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa29d004-8f95-41d0-96f0-528339fb4fe0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:39.141794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa29d004-8f95-41d0-96f0-528339fb4fe0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:39.277279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fa29d004-8f95-41d0-96f0-528339fb4fe0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:39.284930 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fa29d004-8f95-41d0-96f0-528339fb4fe0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1668 microversion: 2.1 time: 0.164597 Oct 11 20:37:39.285497 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3290/6534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:39 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:39.306589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=15 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:37:39.307412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=29 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:37:39.311452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c775303-f470-4e6c-82d3-7b065aed2e1d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:39.312172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c775303-f470-4e6c-82d3-7b065aed2e1d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:39.320562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c775303-f470-4e6c-82d3-7b065aed2e1d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:39.321067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c775303-f470-4e6c-82d3-7b065aed2e1d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:39.321525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c775303-f470-4e6c-82d3-7b065aed2e1d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:39.322234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c775303-f470-4e6c-82d3-7b065aed2e1d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:39.322751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c775303-f470-4e6c-82d3-7b065aed2e1d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:39.323191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c775303-f470-4e6c-82d3-7b065aed2e1d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:39.452434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6c775303-f470-4e6c-82d3-7b065aed2e1d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:39.460280 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c775303-f470-4e6c-82d3-7b065aed2e1d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1668 microversion: 2.1 time: 0.155960 Oct 11 20:37:39.460860 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3245/6535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:39 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:39.482912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5ec2684a-af38-4b25-8dbf-5c7f02da0151 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:39.483567 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5ec2684a-af38-4b25-8dbf-5c7f02da0151 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:39.490060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec2684a-af38-4b25-8dbf-5c7f02da0151 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:39.490558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec2684a-af38-4b25-8dbf-5c7f02da0151 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:39.490994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec2684a-af38-4b25-8dbf-5c7f02da0151 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:39.491672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec2684a-af38-4b25-8dbf-5c7f02da0151 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:39.492121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec2684a-af38-4b25-8dbf-5c7f02da0151 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:39.492540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5ec2684a-af38-4b25-8dbf-5c7f02da0151 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:39.633194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5ec2684a-af38-4b25-8dbf-5c7f02da0151 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:39.641363 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5ec2684a-af38-4b25-8dbf-5c7f02da0151 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1668 microversion: 2.1 time: 0.162324 Oct 11 20:37:39.641934 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3291/6536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:39 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:39.664388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:37:39.666548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:39.672505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:39.672999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:39.673444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:39.674141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:39.674636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:39.675073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:39.706251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:39.714636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Old instance type m1.heat2, new instance type m1.heat {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:37:39.721094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:37:39.721541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:37:39.721998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:37:39.722409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:37:39.722850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:37:39.785366 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c1464971-a988-4424-a6e9-25fbd11efec4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9/action" status: 202 len: 0 microversion: 2.1 time: 0.125240 Oct 11 20:37:39.785993 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3246/6537] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:37:39 2022] POST /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:37:39.794139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-37fa554f-69d2-471e-9772-8b9dfdfc3e2a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:39.794828 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-37fa554f-69d2-471e-9772-8b9dfdfc3e2a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:39.800781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37fa554f-69d2-471e-9772-8b9dfdfc3e2a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:39.801273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37fa554f-69d2-471e-9772-8b9dfdfc3e2a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:39.801709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37fa554f-69d2-471e-9772-8b9dfdfc3e2a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:39.802394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37fa554f-69d2-471e-9772-8b9dfdfc3e2a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:39.802931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37fa554f-69d2-471e-9772-8b9dfdfc3e2a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:39.803544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37fa554f-69d2-471e-9772-8b9dfdfc3e2a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:39.960515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-37fa554f-69d2-471e-9772-8b9dfdfc3e2a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:39.968768 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-37fa554f-69d2-471e-9772-8b9dfdfc3e2a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1677 microversion: 2.1 time: 0.178447 Oct 11 20:37:39.969412 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3292/6538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:39 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:40.993617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e849d2e2-7517-4d18-80d2-d6ae50aced18 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:40.994418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e849d2e2-7517-4d18-80d2-d6ae50aced18 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:41.001839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e849d2e2-7517-4d18-80d2-d6ae50aced18 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:41.002774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e849d2e2-7517-4d18-80d2-d6ae50aced18 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:41.003299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e849d2e2-7517-4d18-80d2-d6ae50aced18 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:41.004087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e849d2e2-7517-4d18-80d2-d6ae50aced18 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:41.004634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e849d2e2-7517-4d18-80d2-d6ae50aced18 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:41.005150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e849d2e2-7517-4d18-80d2-d6ae50aced18 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:41.474676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e849d2e2-7517-4d18-80d2-d6ae50aced18 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:41.483311 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e849d2e2-7517-4d18-80d2-d6ae50aced18 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1677 microversion: 2.1 time: 0.495617 Oct 11 20:37:41.483908 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3247/6539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:40 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1677 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:42.507066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4164e09f-ad26-4b99-95cb-e9c9b7343f69 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:42.507681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4164e09f-ad26-4b99-95cb-e9c9b7343f69 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:42.514492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4164e09f-ad26-4b99-95cb-e9c9b7343f69 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:42.514997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4164e09f-ad26-4b99-95cb-e9c9b7343f69 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:42.515430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4164e09f-ad26-4b99-95cb-e9c9b7343f69 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:42.516110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4164e09f-ad26-4b99-95cb-e9c9b7343f69 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:42.516560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4164e09f-ad26-4b99-95cb-e9c9b7343f69 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:42.516982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4164e09f-ad26-4b99-95cb-e9c9b7343f69 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:42.653927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4164e09f-ad26-4b99-95cb-e9c9b7343f69 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:42.661862 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4164e09f-ad26-4b99-95cb-e9c9b7343f69 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1682 microversion: 2.1 time: 0.158902 Oct 11 20:37:42.662683 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3293/6540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:42 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:43.685898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b0046a4-2809-454e-b9ee-87825d3c6658 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:43.686543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9b0046a4-2809-454e-b9ee-87825d3c6658 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:43.693628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b0046a4-2809-454e-b9ee-87825d3c6658 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:43.694123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b0046a4-2809-454e-b9ee-87825d3c6658 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:43.694598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b0046a4-2809-454e-b9ee-87825d3c6658 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:43.695294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b0046a4-2809-454e-b9ee-87825d3c6658 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:43.695760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b0046a4-2809-454e-b9ee-87825d3c6658 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:43.696192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b0046a4-2809-454e-b9ee-87825d3c6658 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:43.824648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9b0046a4-2809-454e-b9ee-87825d3c6658 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:43.832640 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9b0046a4-2809-454e-b9ee-87825d3c6658 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1682 microversion: 2.1 time: 0.150656 Oct 11 20:37:43.833211 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3248/6541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:43 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:44.856748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5319678a-7bbf-4643-be6d-c259c7dfc415 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:44.857366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5319678a-7bbf-4643-be6d-c259c7dfc415 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:44.863990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5319678a-7bbf-4643-be6d-c259c7dfc415 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:44.864480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5319678a-7bbf-4643-be6d-c259c7dfc415 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:44.864918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5319678a-7bbf-4643-be6d-c259c7dfc415 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:44.865634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5319678a-7bbf-4643-be6d-c259c7dfc415 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:44.866090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5319678a-7bbf-4643-be6d-c259c7dfc415 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:44.866515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5319678a-7bbf-4643-be6d-c259c7dfc415 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:44.995195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5319678a-7bbf-4643-be6d-c259c7dfc415 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:45.002875 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5319678a-7bbf-4643-be6d-c259c7dfc415 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1682 microversion: 2.1 time: 0.150060 Oct 11 20:37:45.003451 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3294/6542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:44 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:46.026517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97b62b6f-9531-4aaf-bb1c-e2d0f0efc509 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:46.027178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97b62b6f-9531-4aaf-bb1c-e2d0f0efc509 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:46.033979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b62b6f-9531-4aaf-bb1c-e2d0f0efc509 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:46.034475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b62b6f-9531-4aaf-bb1c-e2d0f0efc509 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:46.035009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b62b6f-9531-4aaf-bb1c-e2d0f0efc509 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:46.035705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b62b6f-9531-4aaf-bb1c-e2d0f0efc509 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:46.036170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b62b6f-9531-4aaf-bb1c-e2d0f0efc509 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:46.036608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97b62b6f-9531-4aaf-bb1c-e2d0f0efc509 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:46.168273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97b62b6f-9531-4aaf-bb1c-e2d0f0efc509 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:46.175910 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97b62b6f-9531-4aaf-bb1c-e2d0f0efc509 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1682 microversion: 2.1 time: 0.153348 Oct 11 20:37:46.176480 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3249/6543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:46 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:47.201016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b1564aa9-00a6-4c6d-a2ce-6e94e6f0a541 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:47.201631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b1564aa9-00a6-4c6d-a2ce-6e94e6f0a541 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:47.208236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1564aa9-00a6-4c6d-a2ce-6e94e6f0a541 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:47.208724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1564aa9-00a6-4c6d-a2ce-6e94e6f0a541 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:47.209955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1564aa9-00a6-4c6d-a2ce-6e94e6f0a541 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:47.210773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1564aa9-00a6-4c6d-a2ce-6e94e6f0a541 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:47.211239 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1564aa9-00a6-4c6d-a2ce-6e94e6f0a541 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:47.211670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1564aa9-00a6-4c6d-a2ce-6e94e6f0a541 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:47.340141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b1564aa9-00a6-4c6d-a2ce-6e94e6f0a541 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:47.348010 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b1564aa9-00a6-4c6d-a2ce-6e94e6f0a541 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1682 microversion: 2.1 time: 0.151411 Oct 11 20:37:47.348595 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3295/6544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:47 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:48.372126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d1079187-88a7-428f-a912-eff43f6cd52b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:48.372684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d1079187-88a7-428f-a912-eff43f6cd52b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:48.379540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1079187-88a7-428f-a912-eff43f6cd52b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:48.380037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1079187-88a7-428f-a912-eff43f6cd52b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:48.380484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1079187-88a7-428f-a912-eff43f6cd52b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:48.381843 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1079187-88a7-428f-a912-eff43f6cd52b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:48.382308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1079187-88a7-428f-a912-eff43f6cd52b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:48.382772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d1079187-88a7-428f-a912-eff43f6cd52b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:48.513844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d1079187-88a7-428f-a912-eff43f6cd52b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:48.521549 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d1079187-88a7-428f-a912-eff43f6cd52b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1682 microversion: 2.1 time: 0.153611 Oct 11 20:37:48.522296 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3250/6545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:48 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:49.545298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2bf3c94c-78b9-4182-9370-e3fa58b85368 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:49.545912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2bf3c94c-78b9-4182-9370-e3fa58b85368 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:49.553024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf3c94c-78b9-4182-9370-e3fa58b85368 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:49.553508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf3c94c-78b9-4182-9370-e3fa58b85368 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:49.553963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf3c94c-78b9-4182-9370-e3fa58b85368 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:49.554687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf3c94c-78b9-4182-9370-e3fa58b85368 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:49.555143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf3c94c-78b9-4182-9370-e3fa58b85368 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:49.555564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2bf3c94c-78b9-4182-9370-e3fa58b85368 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:49.691373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2bf3c94c-78b9-4182-9370-e3fa58b85368 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:49.700396 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2bf3c94c-78b9-4182-9370-e3fa58b85368 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1682 microversion: 2.1 time: 0.159007 Oct 11 20:37:49.700972 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3296/6546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:49 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:50.723772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-caa546b9-5d65-43ee-9612-64f6316fff60 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:50.724408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-caa546b9-5d65-43ee-9612-64f6316fff60 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:50.731972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa546b9-5d65-43ee-9612-64f6316fff60 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:50.732474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa546b9-5d65-43ee-9612-64f6316fff60 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:50.732928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa546b9-5d65-43ee-9612-64f6316fff60 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:50.733629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa546b9-5d65-43ee-9612-64f6316fff60 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:50.734105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa546b9-5d65-43ee-9612-64f6316fff60 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:50.734566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa546b9-5d65-43ee-9612-64f6316fff60 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:50.864793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-caa546b9-5d65-43ee-9612-64f6316fff60 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:50.872582 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-caa546b9-5d65-43ee-9612-64f6316fff60 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1682 microversion: 2.1 time: 0.152702 Oct 11 20:37:50.873159 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3251/6547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:50 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:51.897350 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-459ca79c-09c6-4b93-a2ca-3a0707affadf tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:51.897970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-459ca79c-09c6-4b93-a2ca-3a0707affadf tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:51.904917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-459ca79c-09c6-4b93-a2ca-3a0707affadf tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:51.905407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-459ca79c-09c6-4b93-a2ca-3a0707affadf tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:51.905848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-459ca79c-09c6-4b93-a2ca-3a0707affadf tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:51.906565 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-459ca79c-09c6-4b93-a2ca-3a0707affadf tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:51.907043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-459ca79c-09c6-4b93-a2ca-3a0707affadf tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:51.907462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-459ca79c-09c6-4b93-a2ca-3a0707affadf tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:52.040701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-459ca79c-09c6-4b93-a2ca-3a0707affadf tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:52.048382 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-459ca79c-09c6-4b93-a2ca-3a0707affadf tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1682 microversion: 2.1 time: 0.155601 Oct 11 20:37:52.048969 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3297/6548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:51 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:53.072925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5cc67c4c-55a4-4866-8a61-6faabd2db300 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:53.073555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5cc67c4c-55a4-4866-8a61-6faabd2db300 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:53.081135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5cc67c4c-55a4-4866-8a61-6faabd2db300 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:53.081671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5cc67c4c-55a4-4866-8a61-6faabd2db300 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:53.082127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5cc67c4c-55a4-4866-8a61-6faabd2db300 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:53.082885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5cc67c4c-55a4-4866-8a61-6faabd2db300 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:53.083358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5cc67c4c-55a4-4866-8a61-6faabd2db300 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:53.083800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5cc67c4c-55a4-4866-8a61-6faabd2db300 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:53.216928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5cc67c4c-55a4-4866-8a61-6faabd2db300 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:53.224695 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5cc67c4c-55a4-4866-8a61-6faabd2db300 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1682 microversion: 2.1 time: 0.156842 Oct 11 20:37:53.225280 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3252/6549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:53 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:54.123712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4d81836b-243d-4b6e-bff6-c3546f026ec4 req-c44a5c59-92f7-4e08-b78c-8ff70002279f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94404510-de6c-4111-9f62-1903df7d2aa9", "name": "network-vif-unplugged", "status": "completed", "tag": "f771f14f-b6a8-49a5-b12c-7b96769068d6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:37:54.133996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4d81836b-243d-4b6e-bff6-c3546f026ec4 req-c44a5c59-92f7-4e08-b78c-8ff70002279f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:54.134474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4d81836b-243d-4b6e-bff6-c3546f026ec4 req-c44a5c59-92f7-4e08-b78c-8ff70002279f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:54.135255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4d81836b-243d-4b6e-bff6-c3546f026ec4 req-c44a5c59-92f7-4e08-b78c-8ff70002279f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:54.150071 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4d81836b-243d-4b6e-bff6-c3546f026ec4 req-c44a5c59-92f7-4e08-b78c-8ff70002279f service nova] Creating event network-vif-unplugged:f771f14f-b6a8-49a5-b12c-7b96769068d6 for instance 94404510-de6c-4111-9f62-1903df7d2aa9 on n-h2-860864-3 Oct 11 20:37:54.155692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-4d81836b-243d-4b6e-bff6-c3546f026ec4 req-c44a5c59-92f7-4e08-b78c-8ff70002279f service nova] Instance 94404510-de6c-4111-9f62-1903df7d2aa9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:37:54.167793 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4d81836b-243d-4b6e-bff6-c3546f026ec4 req-c44a5c59-92f7-4e08-b78c-8ff70002279f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048798 Oct 11 20:37:54.168723 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3298/6550] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:37:54.247965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9378ed5-9c58-46c8-bc41-cfc4fb24cbd4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:54.248689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b9378ed5-9c58-46c8-bc41-cfc4fb24cbd4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:54.255617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9378ed5-9c58-46c8-bc41-cfc4fb24cbd4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:54.256258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9378ed5-9c58-46c8-bc41-cfc4fb24cbd4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:54.256712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9378ed5-9c58-46c8-bc41-cfc4fb24cbd4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:54.257419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9378ed5-9c58-46c8-bc41-cfc4fb24cbd4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:54.257924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9378ed5-9c58-46c8-bc41-cfc4fb24cbd4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:54.258367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9378ed5-9c58-46c8-bc41-cfc4fb24cbd4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:54.480965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b9378ed5-9c58-46c8-bc41-cfc4fb24cbd4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:54.488892 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b9378ed5-9c58-46c8-bc41-cfc4fb24cbd4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1681 microversion: 2.1 time: 0.244905 Oct 11 20:37:54.489473 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3253/6551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:54 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:55.514388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f502fc27-120c-4b4c-af6e-3e8dbb362f9f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:55.515130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f502fc27-120c-4b4c-af6e-3e8dbb362f9f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:55.521365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f502fc27-120c-4b4c-af6e-3e8dbb362f9f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:55.522575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f502fc27-120c-4b4c-af6e-3e8dbb362f9f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:55.523022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f502fc27-120c-4b4c-af6e-3e8dbb362f9f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:55.523710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f502fc27-120c-4b4c-af6e-3e8dbb362f9f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:55.524169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f502fc27-120c-4b4c-af6e-3e8dbb362f9f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:55.524592 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f502fc27-120c-4b4c-af6e-3e8dbb362f9f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:55.655773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f502fc27-120c-4b4c-af6e-3e8dbb362f9f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:55.663798 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f502fc27-120c-4b4c-af6e-3e8dbb362f9f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1679 microversion: 2.1 time: 0.154436 Oct 11 20:37:55.664370 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3299/6552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:55 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:56.192345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7790162b-3929-449a-8ecd-b00e0eb0221a req-a93f9d63-cef7-469a-9bab-e640e59811d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94404510-de6c-4111-9f62-1903df7d2aa9", "tag": "f771f14f-b6a8-49a5-b12c-7b96769068d6"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:37:56.203646 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7790162b-3929-449a-8ecd-b00e0eb0221a req-a93f9d63-cef7-469a-9bab-e640e59811d6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:56.204146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7790162b-3929-449a-8ecd-b00e0eb0221a req-a93f9d63-cef7-469a-9bab-e640e59811d6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:56.204595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7790162b-3929-449a-8ecd-b00e0eb0221a req-a93f9d63-cef7-469a-9bab-e640e59811d6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:56.216937 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7790162b-3929-449a-8ecd-b00e0eb0221a req-a93f9d63-cef7-469a-9bab-e640e59811d6 service nova] Creating event network-changed:f771f14f-b6a8-49a5-b12c-7b96769068d6 for instance 94404510-de6c-4111-9f62-1903df7d2aa9 on n-h2-860864-3 Oct 11 20:37:56.222288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-7790162b-3929-449a-8ecd-b00e0eb0221a req-a93f9d63-cef7-469a-9bab-e640e59811d6 service nova] Instance 94404510-de6c-4111-9f62-1903df7d2aa9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:37:56.232782 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7790162b-3929-449a-8ecd-b00e0eb0221a req-a93f9d63-cef7-469a-9bab-e640e59811d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044356 Oct 11 20:37:56.233369 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3254/6553] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:37:56.689179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e5cf631f-4a55-4ee7-930f-187e9740df4d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:56.689797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e5cf631f-4a55-4ee7-930f-187e9740df4d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:56.697153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5cf631f-4a55-4ee7-930f-187e9740df4d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:56.697650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5cf631f-4a55-4ee7-930f-187e9740df4d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:56.698170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5cf631f-4a55-4ee7-930f-187e9740df4d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:56.698911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5cf631f-4a55-4ee7-930f-187e9740df4d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:56.699629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5cf631f-4a55-4ee7-930f-187e9740df4d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:56.700060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e5cf631f-4a55-4ee7-930f-187e9740df4d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:57.026124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e5cf631f-4a55-4ee7-930f-187e9740df4d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:57.034453 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e5cf631f-4a55-4ee7-930f-187e9740df4d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1679 microversion: 2.1 time: 0.349157 Oct 11 20:37:57.035071 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3300/6554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:56 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1679 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:58.060854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8ea3b966-ed80-48d4-8286-c136e5c85c91 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:58.061526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8ea3b966-ed80-48d4-8286-c136e5c85c91 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:58.067856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ea3b966-ed80-48d4-8286-c136e5c85c91 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:58.068368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ea3b966-ed80-48d4-8286-c136e5c85c91 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:58.069384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ea3b966-ed80-48d4-8286-c136e5c85c91 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:58.070091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ea3b966-ed80-48d4-8286-c136e5c85c91 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:58.070600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ea3b966-ed80-48d4-8286-c136e5c85c91 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:58.071068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ea3b966-ed80-48d4-8286-c136e5c85c91 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:58.202172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8ea3b966-ed80-48d4-8286-c136e5c85c91 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:58.210143 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8ea3b966-ed80-48d4-8286-c136e5c85c91 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1676 microversion: 2.1 time: 0.154479 Oct 11 20:37:58.210959 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3255/6555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:58 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:58.232661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-91230f14-6b36-4bd7-8add-45667807bd37 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:37:58.233206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-91230f14-6b36-4bd7-8add-45667807bd37 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:58.240007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91230f14-6b36-4bd7-8add-45667807bd37 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:58.241218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91230f14-6b36-4bd7-8add-45667807bd37 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:58.241624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91230f14-6b36-4bd7-8add-45667807bd37 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:58.242334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91230f14-6b36-4bd7-8add-45667807bd37 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:58.242851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91230f14-6b36-4bd7-8add-45667807bd37 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:58.243284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-91230f14-6b36-4bd7-8add-45667807bd37 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:58.302409 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-91230f14-6b36-4bd7-8add-45667807bd37 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9/action" status: 204 len: 0 microversion: 2.1 time: 0.073485 Oct 11 20:37:58.303704 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3301/6556] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:37:58 2022] POST /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:37:58.313555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f040dea0-e507-4a55-8029-76d743585517 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:58.314329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f040dea0-e507-4a55-8029-76d743585517 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:58.320986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f040dea0-e507-4a55-8029-76d743585517 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:58.321535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f040dea0-e507-4a55-8029-76d743585517 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:58.322033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f040dea0-e507-4a55-8029-76d743585517 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:58.322855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f040dea0-e507-4a55-8029-76d743585517 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:58.323364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f040dea0-e507-4a55-8029-76d743585517 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:58.323815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f040dea0-e507-4a55-8029-76d743585517 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:58.544188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f040dea0-e507-4a55-8029-76d743585517 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:58.552977 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f040dea0-e507-4a55-8029-76d743585517 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1676 microversion: 2.1 time: 0.243621 Oct 11 20:37:58.553870 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3256/6557] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:58 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:59.579344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e67ed319-a8ae-43ed-beda-2972e4ad8e31 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:59.580122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e67ed319-a8ae-43ed-beda-2972e4ad8e31 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:59.586619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e67ed319-a8ae-43ed-beda-2972e4ad8e31 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:59.587115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e67ed319-a8ae-43ed-beda-2972e4ad8e31 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:59.587562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e67ed319-a8ae-43ed-beda-2972e4ad8e31 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:59.588333 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e67ed319-a8ae-43ed-beda-2972e4ad8e31 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:59.588885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e67ed319-a8ae-43ed-beda-2972e4ad8e31 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:59.589361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e67ed319-a8ae-43ed-beda-2972e4ad8e31 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:59.726202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e67ed319-a8ae-43ed-beda-2972e4ad8e31 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:59.734322 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e67ed319-a8ae-43ed-beda-2972e4ad8e31 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1668 microversion: 2.1 time: 0.160671 Oct 11 20:37:59.734936 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3302/6558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:59 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:59.758443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b5616d46-b368-4927-b6ba-6e8ed6ddc4b7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:59.759083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b5616d46-b368-4927-b6ba-6e8ed6ddc4b7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:59.768799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5616d46-b368-4927-b6ba-6e8ed6ddc4b7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:59.769300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5616d46-b368-4927-b6ba-6e8ed6ddc4b7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:59.769741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5616d46-b368-4927-b6ba-6e8ed6ddc4b7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:59.770436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5616d46-b368-4927-b6ba-6e8ed6ddc4b7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:59.771118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5616d46-b368-4927-b6ba-6e8ed6ddc4b7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:59.772056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5616d46-b368-4927-b6ba-6e8ed6ddc4b7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:59.904916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b5616d46-b368-4927-b6ba-6e8ed6ddc4b7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:37:59.912625 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b5616d46-b368-4927-b6ba-6e8ed6ddc4b7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1668 microversion: 2.1 time: 0.158860 Oct 11 20:37:59.913201 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3257/6559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:59 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:37:59.934576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d15bbe51-b931-4faa-b26c-5efd4f36d37c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:37:59.935193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d15bbe51-b931-4faa-b26c-5efd4f36d37c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:37:59.941065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d15bbe51-b931-4faa-b26c-5efd4f36d37c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:59.941553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d15bbe51-b931-4faa-b26c-5efd4f36d37c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:59.941988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d15bbe51-b931-4faa-b26c-5efd4f36d37c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:37:59.942701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d15bbe51-b931-4faa-b26c-5efd4f36d37c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:37:59.943158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d15bbe51-b931-4faa-b26c-5efd4f36d37c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:37:59.944142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d15bbe51-b931-4faa-b26c-5efd4f36d37c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:00.075744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d15bbe51-b931-4faa-b26c-5efd4f36d37c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:00.083646 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d15bbe51-b931-4faa-b26c-5efd4f36d37c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1668 microversion: 2.1 time: 0.152898 Oct 11 20:38:00.084324 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3303/6560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:37:59 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:00.105924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-caff02a4-aa38-4163-8cd0-60b9fbf8c153 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:00.106370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-caff02a4-aa38-4163-8cd0-60b9fbf8c153 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:00.112374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caff02a4-aa38-4163-8cd0-60b9fbf8c153 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:00.112873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caff02a4-aa38-4163-8cd0-60b9fbf8c153 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:00.113322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caff02a4-aa38-4163-8cd0-60b9fbf8c153 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:00.114019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caff02a4-aa38-4163-8cd0-60b9fbf8c153 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:00.114486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caff02a4-aa38-4163-8cd0-60b9fbf8c153 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:00.114947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caff02a4-aa38-4163-8cd0-60b9fbf8c153 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:00.142963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-caff02a4-aa38-4163-8cd0-60b9fbf8c153 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:38:00.194180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:00.225782 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-caff02a4-aa38-4163-8cd0-60b9fbf8c153 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "DELETE /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 204 len: 0 microversion: 2.1 time: 0.122885 Oct 11 20:38:00.226818 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3258/6561] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:38:00 2022] DELETE /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:38:00.235015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b652fb38-4a59-4189-a4aa-6e4bcb1d75da tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:00.235637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b652fb38-4a59-4189-a4aa-6e4bcb1d75da tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:00.242059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b652fb38-4a59-4189-a4aa-6e4bcb1d75da tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:00.242645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b652fb38-4a59-4189-a4aa-6e4bcb1d75da tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:00.243090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b652fb38-4a59-4189-a4aa-6e4bcb1d75da tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:00.243788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b652fb38-4a59-4189-a4aa-6e4bcb1d75da tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:00.244302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b652fb38-4a59-4189-a4aa-6e4bcb1d75da tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:00.244729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b652fb38-4a59-4189-a4aa-6e4bcb1d75da tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:00.300476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-1dbe5f27-cda5-4b24-8e96-89a2fb0fc300 req-b318a352-7411-4d40-813f-7b2340f2156d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94404510-de6c-4111-9f62-1903df7d2aa9", "name": "network-vif-plugged", "status": "completed", "tag": "f771f14f-b6a8-49a5-b12c-7b96769068d6"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:38:00.313150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1dbe5f27-cda5-4b24-8e96-89a2fb0fc300 req-b318a352-7411-4d40-813f-7b2340f2156d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:00.313657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1dbe5f27-cda5-4b24-8e96-89a2fb0fc300 req-b318a352-7411-4d40-813f-7b2340f2156d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:00.314107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-1dbe5f27-cda5-4b24-8e96-89a2fb0fc300 req-b318a352-7411-4d40-813f-7b2340f2156d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:00.326193 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-1dbe5f27-cda5-4b24-8e96-89a2fb0fc300 req-b318a352-7411-4d40-813f-7b2340f2156d service nova] Creating event network-vif-plugged:f771f14f-b6a8-49a5-b12c-7b96769068d6 for instance 94404510-de6c-4111-9f62-1903df7d2aa9 on n-h2-860864-3 Oct 11 20:38:00.331354 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-1dbe5f27-cda5-4b24-8e96-89a2fb0fc300 req-b318a352-7411-4d40-813f-7b2340f2156d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Oct 11 20:38:00.332412 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3259/6562] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:38:00.386117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b652fb38-4a59-4189-a4aa-6e4bcb1d75da tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:00.394747 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b652fb38-4a59-4189-a4aa-6e4bcb1d75da tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1674 microversion: 2.1 time: 0.163680 Oct 11 20:38:00.395332 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3304/6563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:00 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:01.420102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21b9b191-80f9-4958-a7aa-6929816e3358 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:01.420753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-21b9b191-80f9-4958-a7aa-6929816e3358 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:01.427007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21b9b191-80f9-4958-a7aa-6929816e3358 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:01.427510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21b9b191-80f9-4958-a7aa-6929816e3358 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:01.427995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21b9b191-80f9-4958-a7aa-6929816e3358 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:01.428698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21b9b191-80f9-4958-a7aa-6929816e3358 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:01.429168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21b9b191-80f9-4958-a7aa-6929816e3358 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:01.429610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21b9b191-80f9-4958-a7aa-6929816e3358 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:01.625473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-21b9b191-80f9-4958-a7aa-6929816e3358 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:01.633879 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21b9b191-80f9-4958-a7aa-6929816e3358 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1674 microversion: 2.1 time: 0.219085 Oct 11 20:38:01.634740 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3260/6564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:01 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1674 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:02.657657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f52a6594-4f3f-44dc-a59a-85d544a83e19 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:02.658376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f52a6594-4f3f-44dc-a59a-85d544a83e19 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:02.666149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f52a6594-4f3f-44dc-a59a-85d544a83e19 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:02.666756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f52a6594-4f3f-44dc-a59a-85d544a83e19 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:02.667265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f52a6594-4f3f-44dc-a59a-85d544a83e19 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:02.668069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f52a6594-4f3f-44dc-a59a-85d544a83e19 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:02.668581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f52a6594-4f3f-44dc-a59a-85d544a83e19 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:02.669085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f52a6594-4f3f-44dc-a59a-85d544a83e19 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:02.713759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-947615fa-cda2-4b9c-b434-c0ee60048b5d req-6b3548ce-9f9d-4798-adbf-a1e6b78c24d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94404510-de6c-4111-9f62-1903df7d2aa9", "name": "network-vif-deleted", "tag": "f771f14f-b6a8-49a5-b12c-7b96769068d6"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:38:02.727039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-947615fa-cda2-4b9c-b434-c0ee60048b5d req-6b3548ce-9f9d-4798-adbf-a1e6b78c24d6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:02.728624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-947615fa-cda2-4b9c-b434-c0ee60048b5d req-6b3548ce-9f9d-4798-adbf-a1e6b78c24d6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:02.729235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-947615fa-cda2-4b9c-b434-c0ee60048b5d req-6b3548ce-9f9d-4798-adbf-a1e6b78c24d6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:02.744803 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-947615fa-cda2-4b9c-b434-c0ee60048b5d req-6b3548ce-9f9d-4798-adbf-a1e6b78c24d6 service nova] Creating event network-vif-deleted:f771f14f-b6a8-49a5-b12c-7b96769068d6 for instance 94404510-de6c-4111-9f62-1903df7d2aa9 on n-h2-860864-3 Oct 11 20:38:02.750877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f52a6594-4f3f-44dc-a59a-85d544a83e19 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:02.753184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:02.758452 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-947615fa-cda2-4b9c-b434-c0ee60048b5d req-6b3548ce-9f9d-4798-adbf-a1e6b78c24d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048503 Oct 11 20:38:02.760347 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f52a6594-4f3f-44dc-a59a-85d544a83e19 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 200 len: 1606 microversion: 2.1 time: 0.106543 Oct 11 20:38:02.761414 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3305/6565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:02 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 1606 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:02.766851 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3261/6566] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:38:03.784738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:03.785409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:03.793025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:03.793522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:03.793965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:03.794712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:03.795173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:03.795629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:03.810619 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 HTTP/1.1 Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '94404510-de6c-4111-9f62-1903df7d2aa9'} Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:38:03.812293 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:38:03.816925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:38:03.816925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:38:03.816925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:38:03.816925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:38:03.816925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:38:03.816925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:38:03.816925 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:38:03.816925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:38:03.816925 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-239b493b-2623-452d-93de-3a5d872d6acb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 404 len: 111 microversion: 2.1 time: 0.033034 Oct 11 20:38:03.816925 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3306/6567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:03 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:38:03.829587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:03.830314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:03.838971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:03.839471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:03.839922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:03.840656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:03.841122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:03.841554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:03.856168 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 HTTP/1.1 Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '94404510-de6c-4111-9f62-1903df7d2aa9'} Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:38:03.857951 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:38:03.862155 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:38:03.862155 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:38:03.862155 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:38:03.862155 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:38:03.862155 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:38:03.862155 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:38:03.862155 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:38:03.862155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:38:03.862155 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-617eb204-170d-470a-97d3-e92e9bf62268 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 404 len: 111 microversion: 2.1 time: 0.034672 Oct 11 20:38:03.862155 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3262/6568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:03 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:38:03.908468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1996236201", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "4726f166-4133-4359-bc50-3edb25c6edd3"}], "security_groups": [{"name": "tempest-securitygroup--1093113557"}], "key_name": "tempest-keypair-1593808265", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:38:04.012450 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] validate_networks() for [('4726f166-4133-4359-bc50-3edb25c6edd3', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:38:04.394235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:38:04.394730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:38:04.395211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:38:04.395627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:38:04.396045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:38:04.405478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:04.405970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:04.406414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:04.407201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:04.407681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:04.408116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:04.425717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:38:04.431075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for user 12e7db2ab50d458583122a6bbba08426 and project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:38:04.444015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:38:04.446360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:38:04.493711 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-129bf8c1-1647-408b-8a5f-7e1ee6656479 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.589069 Oct 11 20:38:04.494360 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3307/6569] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:38:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:38:04.505727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a65c6089-5137-46d7-831f-e58fbb558ff7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:04.506353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a65c6089-5137-46d7-831f-e58fbb558ff7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:04.563320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a65c6089-5137-46d7-831f-e58fbb558ff7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:04.571067 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a65c6089-5137-46d7-831f-e58fbb558ff7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1239 microversion: 2.1 time: 0.069196 Oct 11 20:38:04.571652 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3263/6570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:04 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:05.595907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fa6446e1-bb8a-4d1a-b982-83ae4f8ed6b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:05.596761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fa6446e1-bb8a-4d1a-b982-83ae4f8ed6b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:05.605230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa6446e1-bb8a-4d1a-b982-83ae4f8ed6b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:05.605813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa6446e1-bb8a-4d1a-b982-83ae4f8ed6b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:05.606325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa6446e1-bb8a-4d1a-b982-83ae4f8ed6b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:05.607143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa6446e1-bb8a-4d1a-b982-83ae4f8ed6b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:05.607711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa6446e1-bb8a-4d1a-b982-83ae4f8ed6b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:05.608147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fa6446e1-bb8a-4d1a-b982-83ae4f8ed6b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:05.716486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fa6446e1-bb8a-4d1a-b982-83ae4f8ed6b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:05.724195 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fa6446e1-bb8a-4d1a-b982-83ae4f8ed6b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1297 microversion: 2.1 time: 0.133109 Oct 11 20:38:05.724764 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3308/6571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:05 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1297 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:06.748872 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8be3ba3c-84f7-487f-ba04-ed63e58b506d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:06.749506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8be3ba3c-84f7-487f-ba04-ed63e58b506d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:06.758735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8be3ba3c-84f7-487f-ba04-ed63e58b506d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:06.759247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8be3ba3c-84f7-487f-ba04-ed63e58b506d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:06.759704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8be3ba3c-84f7-487f-ba04-ed63e58b506d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:06.760421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8be3ba3c-84f7-487f-ba04-ed63e58b506d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:06.760896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8be3ba3c-84f7-487f-ba04-ed63e58b506d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:06.761339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8be3ba3c-84f7-487f-ba04-ed63e58b506d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:06.923366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-521d733a-17d7-46bf-a630-560401cc5d19 req-57b2bea2-ac61-4d4e-8edf-98ace43d14ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c81b5d-84c7-408f-9233-e4c87866e401", "tag": "fd35bf98-394e-4768-a561-60570a69b0b8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:38:06.937597 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-521d733a-17d7-46bf-a630-560401cc5d19 req-57b2bea2-ac61-4d4e-8edf-98ace43d14ad service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:06.938098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-521d733a-17d7-46bf-a630-560401cc5d19 req-57b2bea2-ac61-4d4e-8edf-98ace43d14ad service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:06.938634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-521d733a-17d7-46bf-a630-560401cc5d19 req-57b2bea2-ac61-4d4e-8edf-98ace43d14ad service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:06.952932 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-521d733a-17d7-46bf-a630-560401cc5d19 req-57b2bea2-ac61-4d4e-8edf-98ace43d14ad service nova] Creating event network-changed:fd35bf98-394e-4768-a561-60570a69b0b8 for instance 44c81b5d-84c7-408f-9233-e4c87866e401 on n-h2-860864-3 Oct 11 20:38:06.958545 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-521d733a-17d7-46bf-a630-560401cc5d19 req-57b2bea2-ac61-4d4e-8edf-98ace43d14ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039415 Oct 11 20:38:06.959535 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3309/6572] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:38:07.018191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8be3ba3c-84f7-487f-ba04-ed63e58b506d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:07.026963 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8be3ba3c-84f7-487f-ba04-ed63e58b506d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1365 microversion: 2.1 time: 0.282386 Oct 11 20:38:07.027549 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3264/6573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:06 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:08.051527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6b296d6-33b9-48a3-8712-a707e23e9cfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:08.052256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6b296d6-33b9-48a3-8712-a707e23e9cfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:08.060369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b296d6-33b9-48a3-8712-a707e23e9cfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:08.060856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b296d6-33b9-48a3-8712-a707e23e9cfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:08.061299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b296d6-33b9-48a3-8712-a707e23e9cfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:08.062003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b296d6-33b9-48a3-8712-a707e23e9cfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:08.062462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b296d6-33b9-48a3-8712-a707e23e9cfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:08.062921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6b296d6-33b9-48a3-8712-a707e23e9cfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:08.281954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f6b296d6-33b9-48a3-8712-a707e23e9cfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:08.290226 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6b296d6-33b9-48a3-8712-a707e23e9cfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1365 microversion: 2.1 time: 0.243035 Oct 11 20:38:08.290851 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3310/6574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:08 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:09.313332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bace30a7-b5d6-41b3-a15d-66c89760394f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:09.313997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bace30a7-b5d6-41b3-a15d-66c89760394f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:09.318022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:09.322280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace30a7-b5d6-41b3-a15d-66c89760394f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:09.322818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace30a7-b5d6-41b3-a15d-66c89760394f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:09.323277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace30a7-b5d6-41b3-a15d-66c89760394f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:09.323982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace30a7-b5d6-41b3-a15d-66c89760394f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:09.324456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace30a7-b5d6-41b3-a15d-66c89760394f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:09.325146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bace30a7-b5d6-41b3-a15d-66c89760394f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:09.454833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bace30a7-b5d6-41b3-a15d-66c89760394f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:09.463246 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bace30a7-b5d6-41b3-a15d-66c89760394f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1365 microversion: 2.1 time: 0.153909 Oct 11 20:38:09.463824 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3265/6575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:09 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:10.486708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-662c5798-7313-4368-b37c-63b48d9ef021 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:10.487353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-662c5798-7313-4368-b37c-63b48d9ef021 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:10.490159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:10.496466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-662c5798-7313-4368-b37c-63b48d9ef021 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:10.496955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-662c5798-7313-4368-b37c-63b48d9ef021 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:10.497391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-662c5798-7313-4368-b37c-63b48d9ef021 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:10.498075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-662c5798-7313-4368-b37c-63b48d9ef021 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:10.498554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-662c5798-7313-4368-b37c-63b48d9ef021 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:10.498973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-662c5798-7313-4368-b37c-63b48d9ef021 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:10.634895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-662c5798-7313-4368-b37c-63b48d9ef021 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:10.642868 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-662c5798-7313-4368-b37c-63b48d9ef021 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1365 microversion: 2.1 time: 0.159987 Oct 11 20:38:10.643656 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3311/6576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:10 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:11.667966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5f3f4db-91f7-4f6f-9d8b-c636015ad1a1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:11.668596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e5f3f4db-91f7-4f6f-9d8b-c636015ad1a1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:11.675666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5f3f4db-91f7-4f6f-9d8b-c636015ad1a1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:11.676168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5f3f4db-91f7-4f6f-9d8b-c636015ad1a1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:11.676620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5f3f4db-91f7-4f6f-9d8b-c636015ad1a1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:11.677321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5f3f4db-91f7-4f6f-9d8b-c636015ad1a1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:11.677791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5f3f4db-91f7-4f6f-9d8b-c636015ad1a1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:11.678788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5f3f4db-91f7-4f6f-9d8b-c636015ad1a1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:11.811374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e5f3f4db-91f7-4f6f-9d8b-c636015ad1a1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:11.819102 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e5f3f4db-91f7-4f6f-9d8b-c636015ad1a1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1365 microversion: 2.1 time: 0.155915 Oct 11 20:38:11.819669 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3266/6577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:11 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:38:12.349646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c0bd7582-605d-4583-bdd4-fadd527cc7a6 req-c5788f49-afba-467e-a3be-5ab7d331521a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c81b5d-84c7-408f-9233-e4c87866e401", "name": "network-vif-plugged", "status": "completed", "tag": "fd35bf98-394e-4768-a561-60570a69b0b8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:38:12.361103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c0bd7582-605d-4583-bdd4-fadd527cc7a6 req-c5788f49-afba-467e-a3be-5ab7d331521a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:12.361584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c0bd7582-605d-4583-bdd4-fadd527cc7a6 req-c5788f49-afba-467e-a3be-5ab7d331521a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:12.362050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c0bd7582-605d-4583-bdd4-fadd527cc7a6 req-c5788f49-afba-467e-a3be-5ab7d331521a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:12.373125 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c0bd7582-605d-4583-bdd4-fadd527cc7a6 req-c5788f49-afba-467e-a3be-5ab7d331521a service nova] Creating event network-vif-plugged:fd35bf98-394e-4768-a561-60570a69b0b8 for instance 44c81b5d-84c7-408f-9233-e4c87866e401 on n-h2-860864-3 Oct 11 20:38:12.377945 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c0bd7582-605d-4583-bdd4-fadd527cc7a6 req-c5788f49-afba-467e-a3be-5ab7d331521a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032014 Oct 11 20:38:12.378552 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3312/6578] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:38:12.842983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7464dbbc-425f-43fe-932f-189c85093b39 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:12.843607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7464dbbc-425f-43fe-932f-189c85093b39 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:12.850883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7464dbbc-425f-43fe-932f-189c85093b39 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:12.851391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7464dbbc-425f-43fe-932f-189c85093b39 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:12.851842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7464dbbc-425f-43fe-932f-189c85093b39 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:12.852546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7464dbbc-425f-43fe-932f-189c85093b39 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:12.853016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7464dbbc-425f-43fe-932f-189c85093b39 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:12.853465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7464dbbc-425f-43fe-932f-189c85093b39 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:12.987563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7464dbbc-425f-43fe-932f-189c85093b39 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:12.996223 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7464dbbc-425f-43fe-932f-189c85093b39 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1365 microversion: 2.1 time: 0.157421 Oct 11 20:38:12.996784 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3267/6579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:12 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:14.020754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-45f1e31d-2bf0-4b89-9b16-c932cc97befa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:14.021455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-45f1e31d-2bf0-4b89-9b16-c932cc97befa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:14.027869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f1e31d-2bf0-4b89-9b16-c932cc97befa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:14.028360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f1e31d-2bf0-4b89-9b16-c932cc97befa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:14.028794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f1e31d-2bf0-4b89-9b16-c932cc97befa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:14.029474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f1e31d-2bf0-4b89-9b16-c932cc97befa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:14.029926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f1e31d-2bf0-4b89-9b16-c932cc97befa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:14.030349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45f1e31d-2bf0-4b89-9b16-c932cc97befa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:14.160936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-45f1e31d-2bf0-4b89-9b16-c932cc97befa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:14.169150 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-45f1e31d-2bf0-4b89-9b16-c932cc97befa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1551 microversion: 2.1 time: 0.153526 Oct 11 20:38:14.169732 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3313/6580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:14 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:14.192702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51c8ac2d-4367-4451-b68f-f7b5d8eadaf6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:14.193205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51c8ac2d-4367-4451-b68f-f7b5d8eadaf6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:14.200650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51c8ac2d-4367-4451-b68f-f7b5d8eadaf6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:14.201150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51c8ac2d-4367-4451-b68f-f7b5d8eadaf6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:14.201602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51c8ac2d-4367-4451-b68f-f7b5d8eadaf6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:14.202306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51c8ac2d-4367-4451-b68f-f7b5d8eadaf6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:14.202835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51c8ac2d-4367-4451-b68f-f7b5d8eadaf6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:14.203274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51c8ac2d-4367-4451-b68f-f7b5d8eadaf6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:14.278364 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51c8ac2d-4367-4451-b68f-f7b5d8eadaf6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089530 Oct 11 20:38:14.279038 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3268/6581] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:38:14 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:38:15.200635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-8f42a062-d95f-42ec-b204-a2b295a073e7 req-76b86e04-346e-45f3-b242-b52ceeef7182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c81b5d-84c7-408f-9233-e4c87866e401", "tag": "fd35bf98-394e-4768-a561-60570a69b0b8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:38:15.205463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:15.206221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:15.213648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8f42a062-d95f-42ec-b204-a2b295a073e7 req-76b86e04-346e-45f3-b242-b52ceeef7182 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:15.214393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8f42a062-d95f-42ec-b204-a2b295a073e7 req-76b86e04-346e-45f3-b242-b52ceeef7182 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:15.214564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-8f42a062-d95f-42ec-b204-a2b295a073e7 req-76b86e04-346e-45f3-b242-b52ceeef7182 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:15.226439 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-8f42a062-d95f-42ec-b204-a2b295a073e7 req-76b86e04-346e-45f3-b242-b52ceeef7182 service nova] Creating event network-changed:fd35bf98-394e-4768-a561-60570a69b0b8 for instance 44c81b5d-84c7-408f-9233-e4c87866e401 on n-h2-860864-3 Oct 11 20:38:15.231511 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-8f42a062-d95f-42ec-b204-a2b295a073e7 req-76b86e04-346e-45f3-b242-b52ceeef7182 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034977 Oct 11 20:38:15.232187 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3314/6582] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:38:48.172761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:48.175304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:48.175948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=40 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:48.180225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-943f7165-a106-4081-959e-52e81ea84d65 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:38:48.187640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943f7165-a106-4081-959e-52e81ea84d65 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:48.188135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943f7165-a106-4081-959e-52e81ea84d65 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:48.188584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943f7165-a106-4081-959e-52e81ea84d65 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:48.211708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-943f7165-a106-4081-959e-52e81ea84d65 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Going to try to stop instance {{(pid=126955) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 20:38:48.253089 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-943f7165-a106-4081-959e-52e81ea84d65 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401/action" status: 202 len: 0 microversion: 2.1 time: 0.080790 Oct 11 20:38:48.253688 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3269/6583] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:38:48 2022] POST /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:38:48.260835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=7 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:48.262073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=35 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:38:48.266201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5941c092-aa58-4633-8c09-dc13716f97ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:48.266932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5941c092-aa58-4633-8c09-dc13716f97ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:48.275077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5941c092-aa58-4633-8c09-dc13716f97ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:48.275570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5941c092-aa58-4633-8c09-dc13716f97ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:48.276010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5941c092-aa58-4633-8c09-dc13716f97ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:48.276707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5941c092-aa58-4633-8c09-dc13716f97ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:48.277162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5941c092-aa58-4633-8c09-dc13716f97ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:48.277590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5941c092-aa58-4633-8c09-dc13716f97ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:48.415069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5941c092-aa58-4633-8c09-dc13716f97ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:48.422936 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5941c092-aa58-4633-8c09-dc13716f97ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.164131 Oct 11 20:38:48.423516 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3315/6584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:48 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:49.448556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9695c15f-ebd5-4bdd-95d5-6016786c51c5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:49.449275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9695c15f-ebd5-4bdd-95d5-6016786c51c5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:49.456603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9695c15f-ebd5-4bdd-95d5-6016786c51c5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:49.457095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9695c15f-ebd5-4bdd-95d5-6016786c51c5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:49.457544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9695c15f-ebd5-4bdd-95d5-6016786c51c5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:49.458244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9695c15f-ebd5-4bdd-95d5-6016786c51c5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:49.458742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9695c15f-ebd5-4bdd-95d5-6016786c51c5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:49.459827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9695c15f-ebd5-4bdd-95d5-6016786c51c5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:49.588801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9695c15f-ebd5-4bdd-95d5-6016786c51c5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:49.596531 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9695c15f-ebd5-4bdd-95d5-6016786c51c5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.152474 Oct 11 20:38:49.597111 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3270/6585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:49 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:50.624310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d31e8346-0238-470c-9236-91b4dcab9e58 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:50.624929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d31e8346-0238-470c-9236-91b4dcab9e58 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:50.632810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d31e8346-0238-470c-9236-91b4dcab9e58 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:50.633298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d31e8346-0238-470c-9236-91b4dcab9e58 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:50.633735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d31e8346-0238-470c-9236-91b4dcab9e58 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:50.634422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d31e8346-0238-470c-9236-91b4dcab9e58 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:50.634912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d31e8346-0238-470c-9236-91b4dcab9e58 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:50.635337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d31e8346-0238-470c-9236-91b4dcab9e58 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:50.783172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d31e8346-0238-470c-9236-91b4dcab9e58 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:50.794075 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d31e8346-0238-470c-9236-91b4dcab9e58 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.172570 Oct 11 20:38:50.794075 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3316/6586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:50 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:51.817238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c14c345d-f5ad-43b9-8162-7b188949b735 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:51.817868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c14c345d-f5ad-43b9-8162-7b188949b735 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:51.824891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c14c345d-f5ad-43b9-8162-7b188949b735 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:51.825652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c14c345d-f5ad-43b9-8162-7b188949b735 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:51.826109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c14c345d-f5ad-43b9-8162-7b188949b735 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:51.826851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c14c345d-f5ad-43b9-8162-7b188949b735 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:51.827326 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c14c345d-f5ad-43b9-8162-7b188949b735 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:51.827769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c14c345d-f5ad-43b9-8162-7b188949b735 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:51.959483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c14c345d-f5ad-43b9-8162-7b188949b735 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:51.967346 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c14c345d-f5ad-43b9-8162-7b188949b735 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.154042 Oct 11 20:38:51.967932 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3271/6587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:51 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:52.992046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b4a79cde-1f80-44af-b4cd-75284b131468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:52.992662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b4a79cde-1f80-44af-b4cd-75284b131468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:52.999573 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4a79cde-1f80-44af-b4cd-75284b131468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:53.000058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4a79cde-1f80-44af-b4cd-75284b131468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:53.000496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4a79cde-1f80-44af-b4cd-75284b131468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:53.001190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4a79cde-1f80-44af-b4cd-75284b131468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:53.001651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4a79cde-1f80-44af-b4cd-75284b131468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:53.002074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4a79cde-1f80-44af-b4cd-75284b131468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:53.132307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b4a79cde-1f80-44af-b4cd-75284b131468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:53.140519 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b4a79cde-1f80-44af-b4cd-75284b131468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.152563 Oct 11 20:38:53.141097 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3317/6588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:52 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:54.163632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5e2e6b3f-f325-48f6-8348-d3bfacbcccda tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:54.164183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5e2e6b3f-f325-48f6-8348-d3bfacbcccda tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:54.171080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e2e6b3f-f325-48f6-8348-d3bfacbcccda tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:54.171572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e2e6b3f-f325-48f6-8348-d3bfacbcccda tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:54.172017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e2e6b3f-f325-48f6-8348-d3bfacbcccda tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:54.172716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e2e6b3f-f325-48f6-8348-d3bfacbcccda tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:54.173180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e2e6b3f-f325-48f6-8348-d3bfacbcccda tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:54.173615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5e2e6b3f-f325-48f6-8348-d3bfacbcccda tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:54.305486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5e2e6b3f-f325-48f6-8348-d3bfacbcccda tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:54.313168 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5e2e6b3f-f325-48f6-8348-d3bfacbcccda tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.153742 Oct 11 20:38:54.313738 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3272/6589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:54 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:55.337945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c1ed4834-e090-49e1-bfb6-1a7b5daabfe5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:55.338479 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1ed4834-e090-49e1-bfb6-1a7b5daabfe5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:55.345342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ed4834-e090-49e1-bfb6-1a7b5daabfe5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:55.345829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ed4834-e090-49e1-bfb6-1a7b5daabfe5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:55.346268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ed4834-e090-49e1-bfb6-1a7b5daabfe5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:55.347000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ed4834-e090-49e1-bfb6-1a7b5daabfe5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:55.347460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ed4834-e090-49e1-bfb6-1a7b5daabfe5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:55.347889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1ed4834-e090-49e1-bfb6-1a7b5daabfe5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:55.480658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c1ed4834-e090-49e1-bfb6-1a7b5daabfe5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:55.488365 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c1ed4834-e090-49e1-bfb6-1a7b5daabfe5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.155089 Oct 11 20:38:55.488940 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3318/6590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:55 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:56.511315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2fd45360-4f79-490e-9737-fba102fc136d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:56.511973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2fd45360-4f79-490e-9737-fba102fc136d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:56.518863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd45360-4f79-490e-9737-fba102fc136d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:56.519365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd45360-4f79-490e-9737-fba102fc136d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:56.519810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd45360-4f79-490e-9737-fba102fc136d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:56.520503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd45360-4f79-490e-9737-fba102fc136d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:56.520965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd45360-4f79-490e-9737-fba102fc136d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:56.521919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd45360-4f79-490e-9737-fba102fc136d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:56.748721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2fd45360-4f79-490e-9737-fba102fc136d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:56.757039 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2fd45360-4f79-490e-9737-fba102fc136d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.249634 Oct 11 20:38:56.757623 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3273/6591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:56 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:57.779731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7cf9dadc-4865-419e-aaac-43a4c9062c53 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:57.780377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7cf9dadc-4865-419e-aaac-43a4c9062c53 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:57.787393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf9dadc-4865-419e-aaac-43a4c9062c53 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:57.787879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf9dadc-4865-419e-aaac-43a4c9062c53 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:57.788322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf9dadc-4865-419e-aaac-43a4c9062c53 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:57.789010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf9dadc-4865-419e-aaac-43a4c9062c53 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:57.789470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf9dadc-4865-419e-aaac-43a4c9062c53 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:57.789899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7cf9dadc-4865-419e-aaac-43a4c9062c53 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:57.922073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7cf9dadc-4865-419e-aaac-43a4c9062c53 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:57.930422 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7cf9dadc-4865-419e-aaac-43a4c9062c53 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.154607 Oct 11 20:38:57.931032 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3319/6592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:57 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:58.954672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-827c9a80-5269-4123-9dd7-6f2d2430fc92 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:58.955311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-827c9a80-5269-4123-9dd7-6f2d2430fc92 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:58.962959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-827c9a80-5269-4123-9dd7-6f2d2430fc92 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:58.963466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-827c9a80-5269-4123-9dd7-6f2d2430fc92 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:58.963936 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-827c9a80-5269-4123-9dd7-6f2d2430fc92 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:58.964687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-827c9a80-5269-4123-9dd7-6f2d2430fc92 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:58.965509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-827c9a80-5269-4123-9dd7-6f2d2430fc92 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:58.965963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-827c9a80-5269-4123-9dd7-6f2d2430fc92 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:59.095079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-827c9a80-5269-4123-9dd7-6f2d2430fc92 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:59.103584 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-827c9a80-5269-4123-9dd7-6f2d2430fc92 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1656 microversion: 2.1 time: 0.153124 Oct 11 20:38:59.104170 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3274/6593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:58 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1656 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:38:59.126518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:38:59.128833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:59.136498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:59.136984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:59.137422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:59.138115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:59.138608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:59.139035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:59.170643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:59.175969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Old instance type m1.heat2, new instance type m1.heat {{(pid=126956) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:38:59.182463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:38:59.182911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:38:59.183384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:38:59.183798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:38:59.184205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:38:59.247577 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-02b0e8e4-d139-4ff3-9be7-5bd46723723e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401/action" status: 202 len: 0 microversion: 2.1 time: 0.124999 Oct 11 20:38:59.248207 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3320/6594] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:38:59 2022] POST /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:38:59.257090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d99ae6f1-196e-4020-ab66-7bf99c5ba4e3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:38:59.257639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d99ae6f1-196e-4020-ab66-7bf99c5ba4e3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:38:59.263575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d99ae6f1-196e-4020-ab66-7bf99c5ba4e3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:59.264144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d99ae6f1-196e-4020-ab66-7bf99c5ba4e3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:59.264796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d99ae6f1-196e-4020-ab66-7bf99c5ba4e3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:59.265505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d99ae6f1-196e-4020-ab66-7bf99c5ba4e3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:38:59.265971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d99ae6f1-196e-4020-ab66-7bf99c5ba4e3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:38:59.266408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d99ae6f1-196e-4020-ab66-7bf99c5ba4e3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:38:59.423969 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d99ae6f1-196e-4020-ab66-7bf99c5ba4e3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:38:59.432465 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d99ae6f1-196e-4020-ab66-7bf99c5ba4e3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.179930 Oct 11 20:38:59.433048 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3275/6595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:38:59 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:00.458399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c51629e8-a81f-400e-bb8d-795e6c0e1806 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:00.459439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c51629e8-a81f-400e-bb8d-795e6c0e1806 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:00.466451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c51629e8-a81f-400e-bb8d-795e6c0e1806 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:00.466968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c51629e8-a81f-400e-bb8d-795e6c0e1806 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:00.467433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c51629e8-a81f-400e-bb8d-795e6c0e1806 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:00.468136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c51629e8-a81f-400e-bb8d-795e6c0e1806 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:00.468588 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c51629e8-a81f-400e-bb8d-795e6c0e1806 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:00.469012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c51629e8-a81f-400e-bb8d-795e6c0e1806 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:00.744202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c51629e8-a81f-400e-bb8d-795e6c0e1806 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:00.751982 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c51629e8-a81f-400e-bb8d-795e6c0e1806 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1679 microversion: 2.1 time: 0.299212 Oct 11 20:39:00.752560 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3321/6596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:00 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1679 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:01.777558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d81840b8-b38d-4c4c-b98f-8de710a1c43b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:01.778184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d81840b8-b38d-4c4c-b98f-8de710a1c43b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:01.785076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d81840b8-b38d-4c4c-b98f-8de710a1c43b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:01.785574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d81840b8-b38d-4c4c-b98f-8de710a1c43b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:01.786020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d81840b8-b38d-4c4c-b98f-8de710a1c43b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:01.787317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d81840b8-b38d-4c4c-b98f-8de710a1c43b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:01.787789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d81840b8-b38d-4c4c-b98f-8de710a1c43b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:01.788221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d81840b8-b38d-4c4c-b98f-8de710a1c43b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:01.914599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d81840b8-b38d-4c4c-b98f-8de710a1c43b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:01.922284 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d81840b8-b38d-4c4c-b98f-8de710a1c43b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1684 microversion: 2.1 time: 0.148767 Oct 11 20:39:01.922885 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3276/6597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:01 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:39:02.945842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f470774d-3e59-4853-81cd-a40d79f32e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:02.946459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f470774d-3e59-4853-81cd-a40d79f32e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:02.953731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f470774d-3e59-4853-81cd-a40d79f32e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:02.954215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f470774d-3e59-4853-81cd-a40d79f32e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:02.954685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f470774d-3e59-4853-81cd-a40d79f32e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:02.955374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f470774d-3e59-4853-81cd-a40d79f32e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:02.955826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f470774d-3e59-4853-81cd-a40d79f32e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:02.956246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f470774d-3e59-4853-81cd-a40d79f32e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:03.173928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f470774d-3e59-4853-81cd-a40d79f32e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:03.182925 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f470774d-3e59-4853-81cd-a40d79f32e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1683 microversion: 2.1 time: 0.241571 Oct 11 20:39:03.183520 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3322/6598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:02 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1683 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:03.460847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-bba47c2d-eb24-4c3b-a661-e68d5dd12c39 req-fb4716ba-e8fd-43d9-bf79-831d3b72245d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c81b5d-84c7-408f-9233-e4c87866e401", "name": "network-vif-unplugged", "status": "completed", "tag": "fd35bf98-394e-4768-a561-60570a69b0b8"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:03.471562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bba47c2d-eb24-4c3b-a661-e68d5dd12c39 req-fb4716ba-e8fd-43d9-bf79-831d3b72245d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:03.472066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bba47c2d-eb24-4c3b-a661-e68d5dd12c39 req-fb4716ba-e8fd-43d9-bf79-831d3b72245d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:03.472514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-bba47c2d-eb24-4c3b-a661-e68d5dd12c39 req-fb4716ba-e8fd-43d9-bf79-831d3b72245d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:03.485094 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-bba47c2d-eb24-4c3b-a661-e68d5dd12c39 req-fb4716ba-e8fd-43d9-bf79-831d3b72245d service nova] Creating event network-vif-unplugged:fd35bf98-394e-4768-a561-60570a69b0b8 for instance 44c81b5d-84c7-408f-9233-e4c87866e401 on n-h1-860864-3 Oct 11 20:39:03.491315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-bba47c2d-eb24-4c3b-a661-e68d5dd12c39 req-fb4716ba-e8fd-43d9-bf79-831d3b72245d service nova] Instance 44c81b5d-84c7-408f-9233-e4c87866e401 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:39:03.503587 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-bba47c2d-eb24-4c3b-a661-e68d5dd12c39 req-fb4716ba-e8fd-43d9-bf79-831d3b72245d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047254 Oct 11 20:39:03.504236 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3277/6599] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:39:04.207457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f54af2e9-f833-4807-a6ac-a27b5a6dc1c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:04.208077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f54af2e9-f833-4807-a6ac-a27b5a6dc1c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:04.215705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f54af2e9-f833-4807-a6ac-a27b5a6dc1c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:04.216394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f54af2e9-f833-4807-a6ac-a27b5a6dc1c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:04.217041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f54af2e9-f833-4807-a6ac-a27b5a6dc1c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:04.217781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f54af2e9-f833-4807-a6ac-a27b5a6dc1c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:04.218297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f54af2e9-f833-4807-a6ac-a27b5a6dc1c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:04.218751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f54af2e9-f833-4807-a6ac-a27b5a6dc1c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:04.459533 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f54af2e9-f833-4807-a6ac-a27b5a6dc1c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:04.467568 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f54af2e9-f833-4807-a6ac-a27b5a6dc1c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1683 microversion: 2.1 time: 0.264024 Oct 11 20:39:04.468146 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3323/6600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:04 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1683 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:05.492861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-23ad64b9-f714-4a24-9e51-f7596b03f748 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:05.493611 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-23ad64b9-f714-4a24-9e51-f7596b03f748 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:05.499818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23ad64b9-f714-4a24-9e51-f7596b03f748 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:05.500347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23ad64b9-f714-4a24-9e51-f7596b03f748 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:05.500795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23ad64b9-f714-4a24-9e51-f7596b03f748 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:05.501496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23ad64b9-f714-4a24-9e51-f7596b03f748 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:05.501959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23ad64b9-f714-4a24-9e51-f7596b03f748 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:05.502399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23ad64b9-f714-4a24-9e51-f7596b03f748 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:05.547001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-95fca438-2221-4627-bb29-6624c19739da req-e38b35d7-adf4-409c-b882-7a494a06d831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c81b5d-84c7-408f-9233-e4c87866e401", "tag": "fd35bf98-394e-4768-a561-60570a69b0b8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:05.558412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-95fca438-2221-4627-bb29-6624c19739da req-e38b35d7-adf4-409c-b882-7a494a06d831 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:05.558931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-95fca438-2221-4627-bb29-6624c19739da req-e38b35d7-adf4-409c-b882-7a494a06d831 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:05.559572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-95fca438-2221-4627-bb29-6624c19739da req-e38b35d7-adf4-409c-b882-7a494a06d831 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:05.572155 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-95fca438-2221-4627-bb29-6624c19739da req-e38b35d7-adf4-409c-b882-7a494a06d831 service nova] Creating event network-changed:fd35bf98-394e-4768-a561-60570a69b0b8 for instance 44c81b5d-84c7-408f-9233-e4c87866e401 on n-h1-860864-3 Oct 11 20:39:05.578125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-95fca438-2221-4627-bb29-6624c19739da req-e38b35d7-adf4-409c-b882-7a494a06d831 service nova] Instance 44c81b5d-84c7-408f-9233-e4c87866e401 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:39:05.590221 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-95fca438-2221-4627-bb29-6624c19739da req-e38b35d7-adf4-409c-b882-7a494a06d831 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046880 Oct 11 20:39:05.591050 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3324/6601] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:39:05.705113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-23ad64b9-f714-4a24-9e51-f7596b03f748 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:05.715103 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-23ad64b9-f714-4a24-9e51-f7596b03f748 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1681 microversion: 2.1 time: 0.227228 Oct 11 20:39:05.716138 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3278/6602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:05 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:06.741579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3c7ab9bd-0eaa-4f50-89aa-4e9896062382 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:06.742201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3c7ab9bd-0eaa-4f50-89aa-4e9896062382 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:06.749143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c7ab9bd-0eaa-4f50-89aa-4e9896062382 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:06.749631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c7ab9bd-0eaa-4f50-89aa-4e9896062382 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:06.750071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c7ab9bd-0eaa-4f50-89aa-4e9896062382 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:06.750855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c7ab9bd-0eaa-4f50-89aa-4e9896062382 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:06.751312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c7ab9bd-0eaa-4f50-89aa-4e9896062382 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:06.751737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3c7ab9bd-0eaa-4f50-89aa-4e9896062382 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:06.907714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3c7ab9bd-0eaa-4f50-89aa-4e9896062382 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:06.915993 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3c7ab9bd-0eaa-4f50-89aa-4e9896062382 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1677 microversion: 2.1 time: 0.178931 Oct 11 20:39:06.916575 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3325/6603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:06 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:06.939745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d8884ba7-5de1-4f0c-80e6-aee7a5d6dd1f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:06.940286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d8884ba7-5de1-4f0c-80e6-aee7a5d6dd1f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:06.947535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8884ba7-5de1-4f0c-80e6-aee7a5d6dd1f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:06.948036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8884ba7-5de1-4f0c-80e6-aee7a5d6dd1f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:06.948489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8884ba7-5de1-4f0c-80e6-aee7a5d6dd1f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:06.949192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8884ba7-5de1-4f0c-80e6-aee7a5d6dd1f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:06.949665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8884ba7-5de1-4f0c-80e6-aee7a5d6dd1f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:06.950102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d8884ba7-5de1-4f0c-80e6-aee7a5d6dd1f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:07.009532 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d8884ba7-5de1-4f0c-80e6-aee7a5d6dd1f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401/action" status: 204 len: 0 microversion: 2.1 time: 0.073653 Oct 11 20:39:07.010107 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3279/6604] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:39:06 2022] POST /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:39:07.018417 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-177fdb41-dc9b-43a6-9c6e-8a5985852954 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:07.019093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-177fdb41-dc9b-43a6-9c6e-8a5985852954 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:07.025257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-177fdb41-dc9b-43a6-9c6e-8a5985852954 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:07.025756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-177fdb41-dc9b-43a6-9c6e-8a5985852954 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:07.026240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-177fdb41-dc9b-43a6-9c6e-8a5985852954 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:07.026977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-177fdb41-dc9b-43a6-9c6e-8a5985852954 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:07.027436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-177fdb41-dc9b-43a6-9c6e-8a5985852954 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:07.027864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-177fdb41-dc9b-43a6-9c6e-8a5985852954 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:07.240416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-177fdb41-dc9b-43a6-9c6e-8a5985852954 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:07.248508 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-177fdb41-dc9b-43a6-9c6e-8a5985852954 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1677 microversion: 2.1 time: 0.234081 Oct 11 20:39:07.249084 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3326/6605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:07 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:08.274453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-db3c22c0-c034-4433-ab5e-2ee8cdb00059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:08.275206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-db3c22c0-c034-4433-ab5e-2ee8cdb00059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:08.281429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3c22c0-c034-4433-ab5e-2ee8cdb00059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:08.282132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3c22c0-c034-4433-ab5e-2ee8cdb00059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:08.282613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3c22c0-c034-4433-ab5e-2ee8cdb00059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:08.283774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3c22c0-c034-4433-ab5e-2ee8cdb00059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:08.283898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3c22c0-c034-4433-ab5e-2ee8cdb00059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:08.284284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-db3c22c0-c034-4433-ab5e-2ee8cdb00059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:08.431246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-db3c22c0-c034-4433-ab5e-2ee8cdb00059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:08.439351 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-db3c22c0-c034-4433-ab5e-2ee8cdb00059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1656 microversion: 2.1 time: 0.170370 Oct 11 20:39:08.439859 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3280/6606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:08 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1656 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:08.462268 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f66c04d7-54a5-42d3-8fd3-206c624d3f84 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:08.463050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f66c04d7-54a5-42d3-8fd3-206c624d3f84 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:08.469502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f66c04d7-54a5-42d3-8fd3-206c624d3f84 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:08.469992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f66c04d7-54a5-42d3-8fd3-206c624d3f84 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:08.470444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f66c04d7-54a5-42d3-8fd3-206c624d3f84 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:08.471341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f66c04d7-54a5-42d3-8fd3-206c624d3f84 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:08.471792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f66c04d7-54a5-42d3-8fd3-206c624d3f84 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:08.472388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f66c04d7-54a5-42d3-8fd3-206c624d3f84 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:08.605674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f66c04d7-54a5-42d3-8fd3-206c624d3f84 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:08.613665 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f66c04d7-54a5-42d3-8fd3-206c624d3f84 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1656 microversion: 2.1 time: 0.155741 Oct 11 20:39:08.614245 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3327/6607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:08 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:08.637356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb48421e-17c0-4e8d-bc3f-65504588961b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:08.643461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb48421e-17c0-4e8d-bc3f-65504588961b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:08.643958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb48421e-17c0-4e8d-bc3f-65504588961b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:08.644405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb48421e-17c0-4e8d-bc3f-65504588961b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:08.666376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bb48421e-17c0-4e8d-bc3f-65504588961b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Going to try to start instance {{(pid=126955) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 20:39:08.709334 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bb48421e-17c0-4e8d-bc3f-65504588961b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401/action" status: 202 len: 0 microversion: 2.1 time: 0.075447 Oct 11 20:39:08.710336 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3281/6608] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:39:08 2022] POST /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:39:08.718834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8a803bae-de32-4057-b540-1cdfa53d5507 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:08.719771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8a803bae-de32-4057-b540-1cdfa53d5507 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:08.726238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a803bae-de32-4057-b540-1cdfa53d5507 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:08.727009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a803bae-de32-4057-b540-1cdfa53d5507 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:08.727594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a803bae-de32-4057-b540-1cdfa53d5507 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:08.728423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a803bae-de32-4057-b540-1cdfa53d5507 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:08.728930 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a803bae-de32-4057-b540-1cdfa53d5507 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:08.729423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8a803bae-de32-4057-b540-1cdfa53d5507 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:08.954052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8a803bae-de32-4057-b540-1cdfa53d5507 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:08.962558 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8a803bae-de32-4057-b540-1cdfa53d5507 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1665 microversion: 2.1 time: 0.248083 Oct 11 20:39:08.963173 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3328/6609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:08 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1665 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:09.987342 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-de2cb0c3-088c-4ec2-bf56-316ac7e0dade tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:09.988063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-de2cb0c3-088c-4ec2-bf56-316ac7e0dade tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:09.994881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2cb0c3-088c-4ec2-bf56-316ac7e0dade tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:09.995391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2cb0c3-088c-4ec2-bf56-316ac7e0dade tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:09.995852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2cb0c3-088c-4ec2-bf56-316ac7e0dade tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:09.996562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2cb0c3-088c-4ec2-bf56-316ac7e0dade tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:09.997041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2cb0c3-088c-4ec2-bf56-316ac7e0dade tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:09.997668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-de2cb0c3-088c-4ec2-bf56-316ac7e0dade tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:10.130928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-de2cb0c3-088c-4ec2-bf56-316ac7e0dade tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:10.133271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:10.140409 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-de2cb0c3-088c-4ec2-bf56-316ac7e0dade tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1669 microversion: 2.1 time: 0.158350 Oct 11 20:39:10.140988 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3282/6610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:09 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:10.164144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2e90e7e7-c6e9-47c1-972f-117d457f107f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:10.164656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2e90e7e7-c6e9-47c1-972f-117d457f107f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:10.171576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e90e7e7-c6e9-47c1-972f-117d457f107f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:10.172056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e90e7e7-c6e9-47c1-972f-117d457f107f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:10.172494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e90e7e7-c6e9-47c1-972f-117d457f107f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:10.173172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e90e7e7-c6e9-47c1-972f-117d457f107f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:10.173624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e90e7e7-c6e9-47c1-972f-117d457f107f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:10.174046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2e90e7e7-c6e9-47c1-972f-117d457f107f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:10.199160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2e90e7e7-c6e9-47c1-972f-117d457f107f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:39:10.227656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:10.275202 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2e90e7e7-c6e9-47c1-972f-117d457f107f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "DELETE /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 204 len: 0 microversion: 2.1 time: 0.115281 Oct 11 20:39:10.275751 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3329/6611] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:39:10 2022] DELETE /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:39:10.284396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-012d49ec-ed23-4d9c-a0f9-975be360252c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:10.285026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-012d49ec-ed23-4d9c-a0f9-975be360252c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:10.292475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-012d49ec-ed23-4d9c-a0f9-975be360252c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:10.292980 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-012d49ec-ed23-4d9c-a0f9-975be360252c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:10.293435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-012d49ec-ed23-4d9c-a0f9-975be360252c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:10.294151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-012d49ec-ed23-4d9c-a0f9-975be360252c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:10.294652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-012d49ec-ed23-4d9c-a0f9-975be360252c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:10.295096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-012d49ec-ed23-4d9c-a0f9-975be360252c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:10.427642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-012d49ec-ed23-4d9c-a0f9-975be360252c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:10.436911 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-012d49ec-ed23-4d9c-a0f9-975be360252c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1675 microversion: 2.1 time: 0.156693 Oct 11 20:39:10.437505 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3283/6612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:10 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:10.508868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-81d17878-0a36-4846-aeac-a9310bc8750f req-fe83d091-27c6-434d-88c8-578e540dc083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c81b5d-84c7-408f-9233-e4c87866e401", "name": "network-vif-plugged", "status": "completed", "tag": "fd35bf98-394e-4768-a561-60570a69b0b8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:10.518540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-81d17878-0a36-4846-aeac-a9310bc8750f req-fe83d091-27c6-434d-88c8-578e540dc083 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:10.519153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-81d17878-0a36-4846-aeac-a9310bc8750f req-fe83d091-27c6-434d-88c8-578e540dc083 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:10.519660 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-81d17878-0a36-4846-aeac-a9310bc8750f req-fe83d091-27c6-434d-88c8-578e540dc083 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:10.532967 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-81d17878-0a36-4846-aeac-a9310bc8750f req-fe83d091-27c6-434d-88c8-578e540dc083 service nova] Creating event network-vif-plugged:fd35bf98-394e-4768-a561-60570a69b0b8 for instance 44c81b5d-84c7-408f-9233-e4c87866e401 on n-h1-860864-3 Oct 11 20:39:10.538402 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-81d17878-0a36-4846-aeac-a9310bc8750f req-fe83d091-27c6-434d-88c8-578e540dc083 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034100 Oct 11 20:39:10.539048 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3330/6613] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:39:11.461830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8d99f903-0724-4f0b-964f-e2d6602f72f2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:11.463690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8d99f903-0724-4f0b-964f-e2d6602f72f2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:11.469395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d99f903-0724-4f0b-964f-e2d6602f72f2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:11.469887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d99f903-0724-4f0b-964f-e2d6602f72f2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:11.470330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d99f903-0724-4f0b-964f-e2d6602f72f2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:11.471050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d99f903-0724-4f0b-964f-e2d6602f72f2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:11.471515 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d99f903-0724-4f0b-964f-e2d6602f72f2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:11.471945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d99f903-0724-4f0b-964f-e2d6602f72f2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:11.647230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8d99f903-0724-4f0b-964f-e2d6602f72f2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:11.655051 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8d99f903-0724-4f0b-964f-e2d6602f72f2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 200 len: 1675 microversion: 2.1 time: 0.197675 Oct 11 20:39:11.655625 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3284/6614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:11 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 1675 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:12.414937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-759f8b02-7618-4a0b-ad37-18f59a1152c5 req-9f09cecf-1a55-4643-84cb-948b12129f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c81b5d-84c7-408f-9233-e4c87866e401", "name": "network-vif-deleted", "tag": "fd35bf98-394e-4768-a561-60570a69b0b8"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:12.424738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-759f8b02-7618-4a0b-ad37-18f59a1152c5 req-9f09cecf-1a55-4643-84cb-948b12129f28 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:12.425229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-759f8b02-7618-4a0b-ad37-18f59a1152c5 req-9f09cecf-1a55-4643-84cb-948b12129f28 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:12.425664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-759f8b02-7618-4a0b-ad37-18f59a1152c5 req-9f09cecf-1a55-4643-84cb-948b12129f28 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:12.438035 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-759f8b02-7618-4a0b-ad37-18f59a1152c5 req-9f09cecf-1a55-4643-84cb-948b12129f28 service nova] Creating event network-vif-deleted:fd35bf98-394e-4768-a561-60570a69b0b8 for instance 44c81b5d-84c7-408f-9233-e4c87866e401 on n-h1-860864-3 Oct 11 20:39:12.444176 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-759f8b02-7618-4a0b-ad37-18f59a1152c5 req-9f09cecf-1a55-4643-84cb-948b12129f28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034589 Oct 11 20:39:12.444861 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3331/6615] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:39:12.680052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:12.680669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:12.687549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:12.688054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:12.688630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:12.689215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:12.689690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:12.690131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:12.704641 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 HTTP/1.1 Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '44c81b5d-84c7-408f-9233-e4c87866e401'} Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:39:12.706356 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:39:12.710959 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:39:12.710959 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:39:12.710959 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:39:12.710959 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:39:12.710959 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:39:12.710959 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:39:12.710959 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:39:12.710959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:39:12.710959 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-406dc492-146b-4ad1-b61b-91c078d5a20b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 404 len: 111 microversion: 2.1 time: 0.032975 Oct 11 20:39:12.710959 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3285/6616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:12 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:39:12.726394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:12.727281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:12.733634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:12.734217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:12.734829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:12.735594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:12.736124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:12.736623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:12.751240 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 HTTP/1.1 Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '44c81b5d-84c7-408f-9233-e4c87866e401'} Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:39:12.752963 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:39:12.756851 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:39:12.756851 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:39:12.756851 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:39:12.756851 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:39:12.756851 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:39:12.756851 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:39:12.756851 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:39:12.756851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:39:12.756851 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4ce0b51f-2203-4b94-9f6e-0b8aa9738455 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 404 len: 111 microversion: 2.1 time: 0.033662 Oct 11 20:39:12.756851 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3332/6617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:12 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:39:12.805852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1815941886", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "4726f166-4133-4359-bc50-3edb25c6edd3"}], "security_groups": [{"name": "tempest-securitygroup--1093113557"}], "key_name": "tempest-keypair-1593808265", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:12.912734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] validate_networks() for [('4726f166-4133-4359-bc50-3edb25c6edd3', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:39:13.353772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:39:13.354345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:39:13.354896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:39:13.355330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:39:13.355766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:39:13.365525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:13.366063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:13.366539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:13.367292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:13.367769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:13.368212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:13.386239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:39:13.392664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for user 12e7db2ab50d458583122a6bbba08426 and project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:39:13.405578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:39:13.408634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:39:13.457093 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b828f5d0-b044-4c2c-869b-03354a587348 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.656206 Oct 11 20:39:13.457751 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3286/6618] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:39:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:39:13.469736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-589a5cbe-648c-4d86-bddb-388417aabbc7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:13.470356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-589a5cbe-648c-4d86-bddb-388417aabbc7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:13.529353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-589a5cbe-648c-4d86-bddb-388417aabbc7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:13.536362 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-589a5cbe-648c-4d86-bddb-388417aabbc7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1239 microversion: 2.1 time: 0.070413 Oct 11 20:39:13.536930 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3333/6619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:13 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:14.561474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3ddeff82-6770-4f78-aacc-07609ea12be1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:14.563005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3ddeff82-6770-4f78-aacc-07609ea12be1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:14.571056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ddeff82-6770-4f78-aacc-07609ea12be1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:14.571567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ddeff82-6770-4f78-aacc-07609ea12be1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:14.572021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ddeff82-6770-4f78-aacc-07609ea12be1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:14.572734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ddeff82-6770-4f78-aacc-07609ea12be1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:14.573373 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ddeff82-6770-4f78-aacc-07609ea12be1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:14.573839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ddeff82-6770-4f78-aacc-07609ea12be1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:14.655321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3ddeff82-6770-4f78-aacc-07609ea12be1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:14.663521 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3ddeff82-6770-4f78-aacc-07609ea12be1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1309 microversion: 2.1 time: 0.106781 Oct 11 20:39:14.664331 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3287/6620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:14 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:15.688099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7bebfe23-c67d-4627-b4cf-7019675f18a0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:15.688731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7bebfe23-c67d-4627-b4cf-7019675f18a0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:15.697650 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bebfe23-c67d-4627-b4cf-7019675f18a0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:15.698142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bebfe23-c67d-4627-b4cf-7019675f18a0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:15.698601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bebfe23-c67d-4627-b4cf-7019675f18a0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:15.699297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bebfe23-c67d-4627-b4cf-7019675f18a0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:15.699752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bebfe23-c67d-4627-b4cf-7019675f18a0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:15.700173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bebfe23-c67d-4627-b4cf-7019675f18a0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:15.897319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7bebfe23-c67d-4627-b4cf-7019675f18a0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:15.905127 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7bebfe23-c67d-4627-b4cf-7019675f18a0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1365 microversion: 2.1 time: 0.221043 Oct 11 20:39:15.905701 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3334/6621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:15 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:15.991573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b3a6563c-b711-4d5a-8c8d-e69d02e46a28 req-32ebd5b4-29c6-4351-bbb0-8828664a3934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e608cd-9001-47f3-9469-8c156c9dc5b3", "tag": "451b3e6b-30e1-4f9d-86a0-e52118f7dc8b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:16.002548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b3a6563c-b711-4d5a-8c8d-e69d02e46a28 req-32ebd5b4-29c6-4351-bbb0-8828664a3934 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:16.003046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b3a6563c-b711-4d5a-8c8d-e69d02e46a28 req-32ebd5b4-29c6-4351-bbb0-8828664a3934 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:16.003492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b3a6563c-b711-4d5a-8c8d-e69d02e46a28 req-32ebd5b4-29c6-4351-bbb0-8828664a3934 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:16.015594 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b3a6563c-b711-4d5a-8c8d-e69d02e46a28 req-32ebd5b4-29c6-4351-bbb0-8828664a3934 service nova] Creating event network-changed:451b3e6b-30e1-4f9d-86a0-e52118f7dc8b for instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 on n-h2-860864-3 Oct 11 20:39:16.020602 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b3a6563c-b711-4d5a-8c8d-e69d02e46a28 req-32ebd5b4-29c6-4351-bbb0-8828664a3934 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033410 Oct 11 20:39:16.021212 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3288/6622] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:39:16.929245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9fc781d1-0455-4e58-9248-3c1d2dcb1121 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:16.929874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9fc781d1-0455-4e58-9248-3c1d2dcb1121 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:16.937125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fc781d1-0455-4e58-9248-3c1d2dcb1121 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:16.937615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fc781d1-0455-4e58-9248-3c1d2dcb1121 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:16.938051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fc781d1-0455-4e58-9248-3c1d2dcb1121 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:16.938769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fc781d1-0455-4e58-9248-3c1d2dcb1121 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:16.939221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fc781d1-0455-4e58-9248-3c1d2dcb1121 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:16.939641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fc781d1-0455-4e58-9248-3c1d2dcb1121 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:17.076087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9fc781d1-0455-4e58-9248-3c1d2dcb1121 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:17.083978 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9fc781d1-0455-4e58-9248-3c1d2dcb1121 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1365 microversion: 2.1 time: 0.158818 Oct 11 20:39:17.085192 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3335/6623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:16 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:18.109608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-10297c04-021b-4e8e-8bcb-dcfc09c92e85 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:18.110332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-10297c04-021b-4e8e-8bcb-dcfc09c92e85 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:18.117367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10297c04-021b-4e8e-8bcb-dcfc09c92e85 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:18.117870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10297c04-021b-4e8e-8bcb-dcfc09c92e85 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:18.118325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10297c04-021b-4e8e-8bcb-dcfc09c92e85 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:18.119064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10297c04-021b-4e8e-8bcb-dcfc09c92e85 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:18.119541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10297c04-021b-4e8e-8bcb-dcfc09c92e85 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:18.119986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-10297c04-021b-4e8e-8bcb-dcfc09c92e85 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:18.250097 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-10297c04-021b-4e8e-8bcb-dcfc09c92e85 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:18.258014 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-10297c04-021b-4e8e-8bcb-dcfc09c92e85 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1365 microversion: 2.1 time: 0.153661 Oct 11 20:39:18.258609 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3289/6624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:18 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:19.281328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5446ce80-a8a9-477e-ab3e-01530da77a07 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:19.281945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5446ce80-a8a9-477e-ab3e-01530da77a07 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:19.284871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:19.290517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5446ce80-a8a9-477e-ab3e-01530da77a07 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:19.291028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5446ce80-a8a9-477e-ab3e-01530da77a07 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:19.291470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5446ce80-a8a9-477e-ab3e-01530da77a07 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:19.292364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5446ce80-a8a9-477e-ab3e-01530da77a07 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:19.292833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5446ce80-a8a9-477e-ab3e-01530da77a07 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:19.293269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5446ce80-a8a9-477e-ab3e-01530da77a07 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:19.425613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5446ce80-a8a9-477e-ab3e-01530da77a07 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:19.433552 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5446ce80-a8a9-477e-ab3e-01530da77a07 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1365 microversion: 2.1 time: 0.156126 Oct 11 20:39:19.434141 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3336/6625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:19 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:20.457427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-57758310-7310-4c11-8aa5-df62b620fcdb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:20.458064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-57758310-7310-4c11-8aa5-df62b620fcdb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:20.461503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:20.467643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57758310-7310-4c11-8aa5-df62b620fcdb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:20.468133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57758310-7310-4c11-8aa5-df62b620fcdb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:20.468586 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57758310-7310-4c11-8aa5-df62b620fcdb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:20.469293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57758310-7310-4c11-8aa5-df62b620fcdb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:20.469827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57758310-7310-4c11-8aa5-df62b620fcdb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:20.470202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-57758310-7310-4c11-8aa5-df62b620fcdb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:20.601685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-57758310-7310-4c11-8aa5-df62b620fcdb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:20.609386 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-57758310-7310-4c11-8aa5-df62b620fcdb tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1365 microversion: 2.1 time: 0.155949 Oct 11 20:39:20.609961 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3290/6626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:20 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:20.733780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c1cd7b1e-f027-40bf-a024-3bbac8ecdf32 req-e13371ff-6ae4-497d-a592-fa56cd106f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e608cd-9001-47f3-9469-8c156c9dc5b3", "name": "network-vif-plugged", "status": "completed", "tag": "451b3e6b-30e1-4f9d-86a0-e52118f7dc8b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:20.746722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c1cd7b1e-f027-40bf-a024-3bbac8ecdf32 req-e13371ff-6ae4-497d-a592-fa56cd106f9b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:20.747206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c1cd7b1e-f027-40bf-a024-3bbac8ecdf32 req-e13371ff-6ae4-497d-a592-fa56cd106f9b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:20.747635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c1cd7b1e-f027-40bf-a024-3bbac8ecdf32 req-e13371ff-6ae4-497d-a592-fa56cd106f9b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:20.759544 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c1cd7b1e-f027-40bf-a024-3bbac8ecdf32 req-e13371ff-6ae4-497d-a592-fa56cd106f9b service nova] Creating event network-vif-plugged:451b3e6b-30e1-4f9d-86a0-e52118f7dc8b for instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 on n-h2-860864-3 Oct 11 20:39:20.764533 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c1cd7b1e-f027-40bf-a024-3bbac8ecdf32 req-e13371ff-6ae4-497d-a592-fa56cd106f9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 Oct 11 20:39:20.765128 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3337/6627] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:39:21.633824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2ef6d8ad-300c-4169-90c9-9d6bee983826 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:21.634470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2ef6d8ad-300c-4169-90c9-9d6bee983826 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:21.641383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ef6d8ad-300c-4169-90c9-9d6bee983826 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:21.641880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ef6d8ad-300c-4169-90c9-9d6bee983826 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:21.642334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ef6d8ad-300c-4169-90c9-9d6bee983826 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:21.643069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ef6d8ad-300c-4169-90c9-9d6bee983826 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:21.643540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ef6d8ad-300c-4169-90c9-9d6bee983826 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:21.643974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2ef6d8ad-300c-4169-90c9-9d6bee983826 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:21.777736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2ef6d8ad-300c-4169-90c9-9d6bee983826 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:21.785450 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2ef6d8ad-300c-4169-90c9-9d6bee983826 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1365 microversion: 2.1 time: 0.156081 Oct 11 20:39:21.786031 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3291/6628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:21 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:39:22.810730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e291dd35-e9c1-472e-8ad8-6ea643c5c56b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:22.811361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e291dd35-e9c1-472e-8ad8-6ea643c5c56b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:22.818602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e291dd35-e9c1-472e-8ad8-6ea643c5c56b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:22.819767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e291dd35-e9c1-472e-8ad8-6ea643c5c56b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:22.820212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e291dd35-e9c1-472e-8ad8-6ea643c5c56b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:22.820911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e291dd35-e9c1-472e-8ad8-6ea643c5c56b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:22.821375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e291dd35-e9c1-472e-8ad8-6ea643c5c56b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:22.821806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e291dd35-e9c1-472e-8ad8-6ea643c5c56b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:22.953849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e291dd35-e9c1-472e-8ad8-6ea643c5c56b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:22.961917 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e291dd35-e9c1-472e-8ad8-6ea643c5c56b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1551 microversion: 2.1 time: 0.155582 Oct 11 20:39:22.962489 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3338/6629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:22 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:39:22.985349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6042c469-6c2c-4821-a92f-5d987b4a7074 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:22.985845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6042c469-6c2c-4821-a92f-5d987b4a7074 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:22.993262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6042c469-6c2c-4821-a92f-5d987b4a7074 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:22.993756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6042c469-6c2c-4821-a92f-5d987b4a7074 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:22.994200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6042c469-6c2c-4821-a92f-5d987b4a7074 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:22.994925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6042c469-6c2c-4821-a92f-5d987b4a7074 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:22.995415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6042c469-6c2c-4821-a92f-5d987b4a7074 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:22.995850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6042c469-6c2c-4821-a92f-5d987b4a7074 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:23.077819 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6042c469-6c2c-4821-a92f-5d987b4a7074 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096224 Oct 11 20:39:23.078486 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3292/6630] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:39:22 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:39:24.343184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-65d16be6-f24d-4304-829e-72feaea8d8af req-9b62d9ff-5651-4537-b107-e81ef752b492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e608cd-9001-47f3-9469-8c156c9dc5b3", "tag": "451b3e6b-30e1-4f9d-86a0-e52118f7dc8b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:24.348101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:24.354997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-65d16be6-f24d-4304-829e-72feaea8d8af req-9b62d9ff-5651-4537-b107-e81ef752b492 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:24.355486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-65d16be6-f24d-4304-829e-72feaea8d8af req-9b62d9ff-5651-4537-b107-e81ef752b492 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:24.355919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-65d16be6-f24d-4304-829e-72feaea8d8af req-9b62d9ff-5651-4537-b107-e81ef752b492 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:24.368525 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-65d16be6-f24d-4304-829e-72feaea8d8af req-9b62d9ff-5651-4537-b107-e81ef752b492 service nova] Creating event network-changed:451b3e6b-30e1-4f9d-86a0-e52118f7dc8b for instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 on n-h2-860864-3 Oct 11 20:39:24.374055 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-65d16be6-f24d-4304-829e-72feaea8d8af req-9b62d9ff-5651-4537-b107-e81ef752b492 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034278 Oct 11 20:39:24.374702 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3339/6631] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:39:59.499186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:59.500007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:59.502381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=5 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:59.503063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=47 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:59.504332 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:39:59.504522 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 20:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3/action (ip 10.222.0.27) !!! Oct 11 20:39:59.509682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:39:59.511973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:59.522372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:59.522903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:59.523356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:59.525003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:59.525480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:59.525928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:59.555536 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:59.561079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Old instance type m1.heat2, new instance type m1.heat {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:39:59.567621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:39:59.568056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:39:59.568548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:39:59.568968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:39:59.569394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:39:59.637307 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bd00212c-6527-471b-ae55-46c186d87bfc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3/action" status: 202 len: 0 microversion: 2.1 time: 0.138788 Oct 11 20:39:59.637943 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3293/6632] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:39:59 2022] POST /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:39:59.646666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1939902d-14da-4766-bfc8-17d0330e06d6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:39:59.647375 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1939902d-14da-4766-bfc8-17d0330e06d6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:39:59.650991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=7 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:59.651419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=38,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:39:59.652336 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:39:59.652453 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 (ip 10.222.0.27) !!! Oct 11 20:39:59.660235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1939902d-14da-4766-bfc8-17d0330e06d6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:59.660812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1939902d-14da-4766-bfc8-17d0330e06d6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:59.661245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1939902d-14da-4766-bfc8-17d0330e06d6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:59.661997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1939902d-14da-4766-bfc8-17d0330e06d6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:39:59.662546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1939902d-14da-4766-bfc8-17d0330e06d6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:39:59.663003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1939902d-14da-4766-bfc8-17d0330e06d6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:39:59.832497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1939902d-14da-4766-bfc8-17d0330e06d6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:39:59.841833 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1939902d-14da-4766-bfc8-17d0330e06d6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1678 microversion: 2.1 time: 0.199586 Oct 11 20:39:59.842409 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3340/6633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:39:59 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:00.865593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a722b314-e05a-42ed-97c6-b792c3b0ce6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:00.866215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a722b314-e05a-42ed-97c6-b792c3b0ce6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:00.872359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a722b314-e05a-42ed-97c6-b792c3b0ce6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:00.872851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a722b314-e05a-42ed-97c6-b792c3b0ce6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:00.873303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a722b314-e05a-42ed-97c6-b792c3b0ce6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:00.873986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a722b314-e05a-42ed-97c6-b792c3b0ce6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:00.874448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a722b314-e05a-42ed-97c6-b792c3b0ce6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:00.874907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a722b314-e05a-42ed-97c6-b792c3b0ce6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:01.088529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a722b314-e05a-42ed-97c6-b792c3b0ce6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:01.096276 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a722b314-e05a-42ed-97c6-b792c3b0ce6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1678 microversion: 2.1 time: 0.235508 Oct 11 20:40:01.096856 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3294/6634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:00 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:02.121477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c7c77cd-1c88-448d-9ed9-468cb4a6fa6d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:02.122087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4c7c77cd-1c88-448d-9ed9-468cb4a6fa6d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:02.129173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c7c77cd-1c88-448d-9ed9-468cb4a6fa6d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:02.129655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c7c77cd-1c88-448d-9ed9-468cb4a6fa6d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:02.130095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c7c77cd-1c88-448d-9ed9-468cb4a6fa6d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:02.130812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c7c77cd-1c88-448d-9ed9-468cb4a6fa6d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:02.131267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c7c77cd-1c88-448d-9ed9-468cb4a6fa6d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:02.131687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c7c77cd-1c88-448d-9ed9-468cb4a6fa6d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:02.258422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4c7c77cd-1c88-448d-9ed9-468cb4a6fa6d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:02.266171 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4c7c77cd-1c88-448d-9ed9-468cb4a6fa6d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1683 microversion: 2.1 time: 0.149311 Oct 11 20:40:02.266765 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3341/6635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:02 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:03.289533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67c5a93f-56e6-40ee-9930-067ed127def6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:03.290300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-67c5a93f-56e6-40ee-9930-067ed127def6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:03.297186 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67c5a93f-56e6-40ee-9930-067ed127def6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:03.297685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67c5a93f-56e6-40ee-9930-067ed127def6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:03.298156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67c5a93f-56e6-40ee-9930-067ed127def6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:03.298893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67c5a93f-56e6-40ee-9930-067ed127def6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:03.299363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67c5a93f-56e6-40ee-9930-067ed127def6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:03.299800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67c5a93f-56e6-40ee-9930-067ed127def6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:03.435150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-67c5a93f-56e6-40ee-9930-067ed127def6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:03.442948 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-67c5a93f-56e6-40ee-9930-067ed127def6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1683 microversion: 2.1 time: 0.157317 Oct 11 20:40:03.443527 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3295/6636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:03 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:04.467541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-86c83c1d-7536-4051-8862-6b9ba13b3b40 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:04.468156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-86c83c1d-7536-4051-8862-6b9ba13b3b40 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:04.475065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86c83c1d-7536-4051-8862-6b9ba13b3b40 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:04.475544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86c83c1d-7536-4051-8862-6b9ba13b3b40 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:04.475974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86c83c1d-7536-4051-8862-6b9ba13b3b40 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:04.476654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86c83c1d-7536-4051-8862-6b9ba13b3b40 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:04.477151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86c83c1d-7536-4051-8862-6b9ba13b3b40 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:04.477574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-86c83c1d-7536-4051-8862-6b9ba13b3b40 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:04.609335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-86c83c1d-7536-4051-8862-6b9ba13b3b40 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:04.617140 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-86c83c1d-7536-4051-8862-6b9ba13b3b40 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1683 microversion: 2.1 time: 0.153661 Oct 11 20:40:04.618252 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3342/6637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:04 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:05.641708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5a762169-fc59-43fe-91a1-ab18758b2234 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:05.642331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5a762169-fc59-43fe-91a1-ab18758b2234 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:05.649233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a762169-fc59-43fe-91a1-ab18758b2234 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:05.649728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a762169-fc59-43fe-91a1-ab18758b2234 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:05.650180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a762169-fc59-43fe-91a1-ab18758b2234 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:05.650956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a762169-fc59-43fe-91a1-ab18758b2234 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:05.651432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a762169-fc59-43fe-91a1-ab18758b2234 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:05.651876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a762169-fc59-43fe-91a1-ab18758b2234 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:05.784903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5a762169-fc59-43fe-91a1-ab18758b2234 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:05.792784 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5a762169-fc59-43fe-91a1-ab18758b2234 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1683 microversion: 2.1 time: 0.155027 Oct 11 20:40:05.793360 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3296/6638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:05 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:06.816097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-04c17721-a253-41d6-b15a-36957f5be0d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:06.816753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-04c17721-a253-41d6-b15a-36957f5be0d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:06.824644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04c17721-a253-41d6-b15a-36957f5be0d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:06.825169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04c17721-a253-41d6-b15a-36957f5be0d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:06.825653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04c17721-a253-41d6-b15a-36957f5be0d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:06.826959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04c17721-a253-41d6-b15a-36957f5be0d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:06.827424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04c17721-a253-41d6-b15a-36957f5be0d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:06.827860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-04c17721-a253-41d6-b15a-36957f5be0d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:06.957815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-04c17721-a253-41d6-b15a-36957f5be0d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:06.966296 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-04c17721-a253-41d6-b15a-36957f5be0d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1683 microversion: 2.1 time: 0.154206 Oct 11 20:40:06.967090 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3343/6639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:06 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:07.990012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f6ad1126-e496-4eca-bf19-b44bac7e1751 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:07.990662 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f6ad1126-e496-4eca-bf19-b44bac7e1751 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:07.997307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6ad1126-e496-4eca-bf19-b44bac7e1751 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:07.997812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6ad1126-e496-4eca-bf19-b44bac7e1751 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:07.998266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6ad1126-e496-4eca-bf19-b44bac7e1751 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:07.999031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6ad1126-e496-4eca-bf19-b44bac7e1751 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:07.999498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6ad1126-e496-4eca-bf19-b44bac7e1751 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:07.999939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f6ad1126-e496-4eca-bf19-b44bac7e1751 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:08.127508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f6ad1126-e496-4eca-bf19-b44bac7e1751 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:08.135773 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f6ad1126-e496-4eca-bf19-b44bac7e1751 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1683 microversion: 2.1 time: 0.149942 Oct 11 20:40:08.136357 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3297/6640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:07 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:09.159050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1405637-4082-4346-8aca-7e0b367edf16 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:09.159674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1405637-4082-4346-8aca-7e0b367edf16 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:09.166847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1405637-4082-4346-8aca-7e0b367edf16 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:09.167343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1405637-4082-4346-8aca-7e0b367edf16 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:09.167786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1405637-4082-4346-8aca-7e0b367edf16 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:09.168484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1405637-4082-4346-8aca-7e0b367edf16 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:09.168953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1405637-4082-4346-8aca-7e0b367edf16 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:09.169388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1405637-4082-4346-8aca-7e0b367edf16 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:09.358178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f1405637-4082-4346-8aca-7e0b367edf16 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:09.365882 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1405637-4082-4346-8aca-7e0b367edf16 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1683 microversion: 2.1 time: 0.210743 Oct 11 20:40:09.366443 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3344/6641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:09 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:10.389684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-45f084f0-44e1-4c5a-9019-598895cf8a5a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:10.390241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-45f084f0-44e1-4c5a-9019-598895cf8a5a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:10.397291 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45f084f0-44e1-4c5a-9019-598895cf8a5a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:10.398016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45f084f0-44e1-4c5a-9019-598895cf8a5a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:10.398542 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45f084f0-44e1-4c5a-9019-598895cf8a5a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:10.399713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45f084f0-44e1-4c5a-9019-598895cf8a5a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:10.400221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45f084f0-44e1-4c5a-9019-598895cf8a5a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:10.400633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-45f084f0-44e1-4c5a-9019-598895cf8a5a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:10.566803 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-45f084f0-44e1-4c5a-9019-598895cf8a5a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:10.576491 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-45f084f0-44e1-4c5a-9019-598895cf8a5a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1683 microversion: 2.1 time: 0.190461 Oct 11 20:40:10.577105 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3298/6642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:10 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:11.600942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-440b8f7f-2a6d-4cb0-bcb4-79d8221ad856 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:11.601559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-440b8f7f-2a6d-4cb0-bcb4-79d8221ad856 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:11.608610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-440b8f7f-2a6d-4cb0-bcb4-79d8221ad856 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:11.609101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-440b8f7f-2a6d-4cb0-bcb4-79d8221ad856 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:11.609545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-440b8f7f-2a6d-4cb0-bcb4-79d8221ad856 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:11.610241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-440b8f7f-2a6d-4cb0-bcb4-79d8221ad856 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:11.610733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-440b8f7f-2a6d-4cb0-bcb4-79d8221ad856 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:11.611164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-440b8f7f-2a6d-4cb0-bcb4-79d8221ad856 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:11.826884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-440b8f7f-2a6d-4cb0-bcb4-79d8221ad856 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:11.834671 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-440b8f7f-2a6d-4cb0-bcb4-79d8221ad856 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1683 microversion: 2.1 time: 0.237641 Oct 11 20:40:11.835243 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3345/6643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:11 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1683 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:12.857439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c2fdc845-1b4b-4468-ba09-3605ae125421 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:12.857964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c2fdc845-1b4b-4468-ba09-3605ae125421 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:12.864833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2fdc845-1b4b-4468-ba09-3605ae125421 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:12.865330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2fdc845-1b4b-4468-ba09-3605ae125421 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:12.865779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2fdc845-1b4b-4468-ba09-3605ae125421 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:12.866471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2fdc845-1b4b-4468-ba09-3605ae125421 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:12.866959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2fdc845-1b4b-4468-ba09-3605ae125421 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:12.867883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c2fdc845-1b4b-4468-ba09-3605ae125421 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:13.080210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c2fdc845-1b4b-4468-ba09-3605ae125421 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:13.088118 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c2fdc845-1b4b-4468-ba09-3605ae125421 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1683 microversion: 2.1 time: 0.234695 Oct 11 20:40:13.088693 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3299/6644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:12 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1683 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:13.881903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-340ed344-47e9-401b-933b-971c44bfd68e req-b2201374-64df-4b2d-ad75-8bd2c48f4875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e608cd-9001-47f3-9469-8c156c9dc5b3", "name": "network-vif-unplugged", "status": "completed", "tag": "451b3e6b-30e1-4f9d-86a0-e52118f7dc8b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:40:13.893002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-340ed344-47e9-401b-933b-971c44bfd68e req-b2201374-64df-4b2d-ad75-8bd2c48f4875 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:13.893482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-340ed344-47e9-401b-933b-971c44bfd68e req-b2201374-64df-4b2d-ad75-8bd2c48f4875 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:13.893913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-340ed344-47e9-401b-933b-971c44bfd68e req-b2201374-64df-4b2d-ad75-8bd2c48f4875 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:13.906133 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-340ed344-47e9-401b-933b-971c44bfd68e req-b2201374-64df-4b2d-ad75-8bd2c48f4875 service nova] Creating event network-vif-unplugged:451b3e6b-30e1-4f9d-86a0-e52118f7dc8b for instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 on n-h1-860864-3 Oct 11 20:40:13.911566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-340ed344-47e9-401b-933b-971c44bfd68e req-b2201374-64df-4b2d-ad75-8bd2c48f4875 service nova] Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:40:13.923673 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-340ed344-47e9-401b-933b-971c44bfd68e req-b2201374-64df-4b2d-ad75-8bd2c48f4875 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045722 Oct 11 20:40:13.924285 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3346/6645] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:40:14.111738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3f122c53-bc19-4b6c-815b-a2199b8c689d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:14.112357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3f122c53-bc19-4b6c-815b-a2199b8c689d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:14.120385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f122c53-bc19-4b6c-815b-a2199b8c689d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:14.121070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f122c53-bc19-4b6c-815b-a2199b8c689d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:14.121517 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f122c53-bc19-4b6c-815b-a2199b8c689d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:14.122283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f122c53-bc19-4b6c-815b-a2199b8c689d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:14.122733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f122c53-bc19-4b6c-815b-a2199b8c689d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:14.123173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3f122c53-bc19-4b6c-815b-a2199b8c689d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:14.335209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3f122c53-bc19-4b6c-815b-a2199b8c689d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:14.343607 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3f122c53-bc19-4b6c-815b-a2199b8c689d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1682 microversion: 2.1 time: 0.235848 Oct 11 20:40:14.344182 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3300/6646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:14 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:15.369875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c65550a-e2ea-4ca0-977d-d77abc23427b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:15.370485 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c65550a-e2ea-4ca0-977d-d77abc23427b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:15.376700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c65550a-e2ea-4ca0-977d-d77abc23427b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:15.377180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c65550a-e2ea-4ca0-977d-d77abc23427b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:15.377614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c65550a-e2ea-4ca0-977d-d77abc23427b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:15.378296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c65550a-e2ea-4ca0-977d-d77abc23427b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:15.378781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c65550a-e2ea-4ca0-977d-d77abc23427b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:15.379202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c65550a-e2ea-4ca0-977d-d77abc23427b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:15.513255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1c65550a-e2ea-4ca0-977d-d77abc23427b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:15.521110 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c65550a-e2ea-4ca0-977d-d77abc23427b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1680 microversion: 2.1 time: 0.156920 Oct 11 20:40:15.521682 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3347/6647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:15 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:15.959597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c7b2a9fe-6bbb-41fc-9e7b-38ad4baab8d6 req-0c341dfa-c990-4ceb-9db5-3d73d625b0be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e608cd-9001-47f3-9469-8c156c9dc5b3", "tag": "451b3e6b-30e1-4f9d-86a0-e52118f7dc8b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:40:15.970888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c7b2a9fe-6bbb-41fc-9e7b-38ad4baab8d6 req-0c341dfa-c990-4ceb-9db5-3d73d625b0be service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:15.971383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c7b2a9fe-6bbb-41fc-9e7b-38ad4baab8d6 req-0c341dfa-c990-4ceb-9db5-3d73d625b0be service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:15.971828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c7b2a9fe-6bbb-41fc-9e7b-38ad4baab8d6 req-0c341dfa-c990-4ceb-9db5-3d73d625b0be service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:15.984454 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c7b2a9fe-6bbb-41fc-9e7b-38ad4baab8d6 req-0c341dfa-c990-4ceb-9db5-3d73d625b0be service nova] Creating event network-changed:451b3e6b-30e1-4f9d-86a0-e52118f7dc8b for instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 on n-h1-860864-3 Oct 11 20:40:15.989731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-c7b2a9fe-6bbb-41fc-9e7b-38ad4baab8d6 req-0c341dfa-c990-4ceb-9db5-3d73d625b0be service nova] Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:40:16.000796 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c7b2a9fe-6bbb-41fc-9e7b-38ad4baab8d6 req-0c341dfa-c990-4ceb-9db5-3d73d625b0be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044968 Oct 11 20:40:16.001388 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3301/6648] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:40:16.545246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e3f6272b-a725-48ef-a57c-3913f6615f11 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:16.545863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e3f6272b-a725-48ef-a57c-3913f6615f11 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:16.553269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3f6272b-a725-48ef-a57c-3913f6615f11 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:16.553823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3f6272b-a725-48ef-a57c-3913f6615f11 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:16.554349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3f6272b-a725-48ef-a57c-3913f6615f11 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:16.555718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3f6272b-a725-48ef-a57c-3913f6615f11 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:16.556193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3f6272b-a725-48ef-a57c-3913f6615f11 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:16.556620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e3f6272b-a725-48ef-a57c-3913f6615f11 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:16.862285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e3f6272b-a725-48ef-a57c-3913f6615f11 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:16.870801 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e3f6272b-a725-48ef-a57c-3913f6615f11 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1677 microversion: 2.1 time: 0.329370 Oct 11 20:40:16.880469 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3348/6649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:16 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1677 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:16.894470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:40:16.895154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:16.902499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:16.903029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:16.903488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:16.904205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:16.904681 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:16.905126 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:16.943663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:16.944156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:16.944605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:16.946010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:16.946487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:16.946973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:16.970481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:40:16.975732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for user 12e7db2ab50d458583122a6bbba08426 and project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:40:17.081270 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ecc59204-79e5-4654-bbb9-3d7d870b202a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3/action" status: 202 len: 0 microversion: 2.1 time: 0.190885 Oct 11 20:40:17.081882 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3302/6650] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:40:16 2022] POST /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:40:17.090665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-833443ea-b58b-40c3-9a0b-7c8f109846aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:17.091281 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-833443ea-b58b-40c3-9a0b-7c8f109846aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:17.098344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-833443ea-b58b-40c3-9a0b-7c8f109846aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:17.099170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-833443ea-b58b-40c3-9a0b-7c8f109846aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:17.099740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-833443ea-b58b-40c3-9a0b-7c8f109846aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:17.100680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-833443ea-b58b-40c3-9a0b-7c8f109846aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:17.101169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-833443ea-b58b-40c3-9a0b-7c8f109846aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:17.101656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-833443ea-b58b-40c3-9a0b-7c8f109846aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:17.379033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-833443ea-b58b-40c3-9a0b-7c8f109846aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:17.386944 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-833443ea-b58b-40c3-9a0b-7c8f109846aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1676 microversion: 2.1 time: 0.300805 Oct 11 20:40:17.387862 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3349/6651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:17 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1676 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:18.413021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d8a872c-cf90-4168-acfc-bc1fcae817f4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:18.413732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0d8a872c-cf90-4168-acfc-bc1fcae817f4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:18.421589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8a872c-cf90-4168-acfc-bc1fcae817f4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:18.422081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8a872c-cf90-4168-acfc-bc1fcae817f4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:18.422558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8a872c-cf90-4168-acfc-bc1fcae817f4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:18.423243 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8a872c-cf90-4168-acfc-bc1fcae817f4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:18.423706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8a872c-cf90-4168-acfc-bc1fcae817f4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:18.424140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8a872c-cf90-4168-acfc-bc1fcae817f4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:18.554383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0d8a872c-cf90-4168-acfc-bc1fcae817f4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:18.562183 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0d8a872c-cf90-4168-acfc-bc1fcae817f4 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1676 microversion: 2.1 time: 0.154428 Oct 11 20:40:18.562785 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3303/6652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:18 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:19.585757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-358b2111-b041-42a5-b8b0-491ff06eac2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:19.586329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-358b2111-b041-42a5-b8b0-491ff06eac2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:19.593745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-358b2111-b041-42a5-b8b0-491ff06eac2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:19.594235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-358b2111-b041-42a5-b8b0-491ff06eac2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:19.594702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-358b2111-b041-42a5-b8b0-491ff06eac2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:19.595393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-358b2111-b041-42a5-b8b0-491ff06eac2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:19.595844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-358b2111-b041-42a5-b8b0-491ff06eac2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:19.596261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-358b2111-b041-42a5-b8b0-491ff06eac2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:19.738943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-358b2111-b041-42a5-b8b0-491ff06eac2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:19.747852 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-358b2111-b041-42a5-b8b0-491ff06eac2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1676 microversion: 2.1 time: 0.166164 Oct 11 20:40:19.748653 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3350/6653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:19 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:40:20.676774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c89b5d58-b7be-41dc-8d21-272a5a978d3f req-1ea57010-7e22-4ea6-854a-261c1d23d6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e608cd-9001-47f3-9469-8c156c9dc5b3", "tag": "451b3e6b-30e1-4f9d-86a0-e52118f7dc8b"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:40:20.699966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c89b5d58-b7be-41dc-8d21-272a5a978d3f req-1ea57010-7e22-4ea6-854a-261c1d23d6ee service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:20.700583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c89b5d58-b7be-41dc-8d21-272a5a978d3f req-1ea57010-7e22-4ea6-854a-261c1d23d6ee service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:20.701344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c89b5d58-b7be-41dc-8d21-272a5a978d3f req-1ea57010-7e22-4ea6-854a-261c1d23d6ee service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:20.716158 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c89b5d58-b7be-41dc-8d21-272a5a978d3f req-1ea57010-7e22-4ea6-854a-261c1d23d6ee service nova] Creating event network-changed:451b3e6b-30e1-4f9d-86a0-e52118f7dc8b for instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 on n-h2-860864-3 Oct 11 20:40:20.722121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-c89b5d58-b7be-41dc-8d21-272a5a978d3f req-1ea57010-7e22-4ea6-854a-261c1d23d6ee service nova] Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:40:20.733417 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c89b5d58-b7be-41dc-8d21-272a5a978d3f req-1ea57010-7e22-4ea6-854a-261c1d23d6ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060332 Oct 11 20:40:20.734734 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3304/6654] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:40:20.771551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10ab7a49-a4ec-4319-a0c3-2ca71afda3ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:20.772269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10ab7a49-a4ec-4319-a0c3-2ca71afda3ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:20.779955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ab7a49-a4ec-4319-a0c3-2ca71afda3ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:20.780457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ab7a49-a4ec-4319-a0c3-2ca71afda3ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:20.780899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ab7a49-a4ec-4319-a0c3-2ca71afda3ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:20.781608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ab7a49-a4ec-4319-a0c3-2ca71afda3ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:20.782096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ab7a49-a4ec-4319-a0c3-2ca71afda3ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:20.782545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10ab7a49-a4ec-4319-a0c3-2ca71afda3ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:21.117881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-10ab7a49-a4ec-4319-a0c3-2ca71afda3ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:21.126286 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10ab7a49-a4ec-4319-a0c3-2ca71afda3ed tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1676 microversion: 2.1 time: 0.358539 Oct 11 20:40:21.126923 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3351/6655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:20 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1676 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:22.152501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d519cc9f-b50f-4f51-a007-bd6fbe72ba5e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:22.153218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d519cc9f-b50f-4f51-a007-bd6fbe72ba5e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:22.159457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d519cc9f-b50f-4f51-a007-bd6fbe72ba5e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:22.159960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d519cc9f-b50f-4f51-a007-bd6fbe72ba5e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:22.160412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d519cc9f-b50f-4f51-a007-bd6fbe72ba5e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:22.161110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d519cc9f-b50f-4f51-a007-bd6fbe72ba5e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:22.161578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d519cc9f-b50f-4f51-a007-bd6fbe72ba5e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:22.162016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d519cc9f-b50f-4f51-a007-bd6fbe72ba5e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:22.293380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d519cc9f-b50f-4f51-a007-bd6fbe72ba5e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:22.296922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:40:22.301927 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d519cc9f-b50f-4f51-a007-bd6fbe72ba5e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1676 microversion: 2.1 time: 0.155463 Oct 11 20:40:22.302494 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3305/6656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:22 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:23.325839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a1149e4-5e14-4857-b267-94a212b19036 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:23.326766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0a1149e4-5e14-4857-b267-94a212b19036 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:23.335981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a1149e4-5e14-4857-b267-94a212b19036 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:23.336503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a1149e4-5e14-4857-b267-94a212b19036 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:23.337018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a1149e4-5e14-4857-b267-94a212b19036 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:23.337856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a1149e4-5e14-4857-b267-94a212b19036 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:23.338318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a1149e4-5e14-4857-b267-94a212b19036 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:23.338774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a1149e4-5e14-4857-b267-94a212b19036 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:23.471914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0a1149e4-5e14-4857-b267-94a212b19036 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:23.479805 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a1149e4-5e14-4857-b267-94a212b19036 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1669 microversion: 2.1 time: 0.158680 Oct 11 20:40:23.480371 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3352/6657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:23 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:23.503294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6de994c9-7376-4827-bb9c-c1bf1607bded tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:23.503944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6de994c9-7376-4827-bb9c-c1bf1607bded tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:23.512579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6de994c9-7376-4827-bb9c-c1bf1607bded tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:23.513012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6de994c9-7376-4827-bb9c-c1bf1607bded tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:23.513463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6de994c9-7376-4827-bb9c-c1bf1607bded tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:23.514164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6de994c9-7376-4827-bb9c-c1bf1607bded tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:23.514669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6de994c9-7376-4827-bb9c-c1bf1607bded tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:23.515112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6de994c9-7376-4827-bb9c-c1bf1607bded tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:23.647610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6de994c9-7376-4827-bb9c-c1bf1607bded tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:23.656190 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6de994c9-7376-4827-bb9c-c1bf1607bded tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1669 microversion: 2.1 time: 0.157395 Oct 11 20:40:23.656785 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3306/6658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:23 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:23.678686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5d0b27ba-10d0-4e4b-b311-00a1475dc5df tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:23.679319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5d0b27ba-10d0-4e4b-b311-00a1475dc5df tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:23.685462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d0b27ba-10d0-4e4b-b311-00a1475dc5df tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:23.685946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d0b27ba-10d0-4e4b-b311-00a1475dc5df tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:23.686380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d0b27ba-10d0-4e4b-b311-00a1475dc5df tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:23.687086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d0b27ba-10d0-4e4b-b311-00a1475dc5df tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:23.687538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d0b27ba-10d0-4e4b-b311-00a1475dc5df tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:23.687958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5d0b27ba-10d0-4e4b-b311-00a1475dc5df tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:23.816111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5d0b27ba-10d0-4e4b-b311-00a1475dc5df tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:23.824683 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5d0b27ba-10d0-4e4b-b311-00a1475dc5df tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1669 microversion: 2.1 time: 0.149862 Oct 11 20:40:23.825360 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3353/6659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:23 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:23.847666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6fb64c09-00f1-4320-8e96-c641f5594361 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:23.848175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6fb64c09-00f1-4320-8e96-c641f5594361 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:23.854295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fb64c09-00f1-4320-8e96-c641f5594361 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:23.854820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fb64c09-00f1-4320-8e96-c641f5594361 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:23.855274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fb64c09-00f1-4320-8e96-c641f5594361 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:23.855968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fb64c09-00f1-4320-8e96-c641f5594361 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:23.856430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fb64c09-00f1-4320-8e96-c641f5594361 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:23.856861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6fb64c09-00f1-4320-8e96-c641f5594361 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:23.882227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6fb64c09-00f1-4320-8e96-c641f5594361 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:40:23.966024 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6fb64c09-00f1-4320-8e96-c641f5594361 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 204 len: 0 microversion: 2.1 time: 0.121603 Oct 11 20:40:23.966758 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3307/6660] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:40:23 2022] DELETE /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:40:23.975053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d5ab6a5e-c098-4998-a57b-422074acbd30 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:23.975802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d5ab6a5e-c098-4998-a57b-422074acbd30 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:23.982814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ab6a5e-c098-4998-a57b-422074acbd30 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:23.983402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ab6a5e-c098-4998-a57b-422074acbd30 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:23.983926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ab6a5e-c098-4998-a57b-422074acbd30 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:23.984693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ab6a5e-c098-4998-a57b-422074acbd30 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:23.985259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ab6a5e-c098-4998-a57b-422074acbd30 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:23.985936 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5ab6a5e-c098-4998-a57b-422074acbd30 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:24.122263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d5ab6a5e-c098-4998-a57b-422074acbd30 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:24.130153 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d5ab6a5e-c098-4998-a57b-422074acbd30 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1675 microversion: 2.1 time: 0.159059 Oct 11 20:40:24.130769 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3354/6661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:23 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:40:25.154095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e76fddc0-c849-45ff-8e67-894ff51ec06e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:25.154844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e76fddc0-c849-45ff-8e67-894ff51ec06e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:25.161745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e76fddc0-c849-45ff-8e67-894ff51ec06e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:25.162247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e76fddc0-c849-45ff-8e67-894ff51ec06e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:25.162723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e76fddc0-c849-45ff-8e67-894ff51ec06e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:25.163431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e76fddc0-c849-45ff-8e67-894ff51ec06e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:25.163895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e76fddc0-c849-45ff-8e67-894ff51ec06e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:25.164327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e76fddc0-c849-45ff-8e67-894ff51ec06e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:25.733414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e76fddc0-c849-45ff-8e67-894ff51ec06e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:25.741803 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e76fddc0-c849-45ff-8e67-894ff51ec06e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1675 microversion: 2.1 time: 0.592063 Oct 11 20:40:25.742381 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3308/6662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:25 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1675 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:26.383262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-941d4be4-1046-4538-b9aa-625056774622 req-3951ce44-c40d-4a07-883e-81f58db4d3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e608cd-9001-47f3-9469-8c156c9dc5b3", "name": "network-vif-deleted", "tag": "451b3e6b-30e1-4f9d-86a0-e52118f7dc8b"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:40:26.397569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-941d4be4-1046-4538-b9aa-625056774622 req-3951ce44-c40d-4a07-883e-81f58db4d3d4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:26.398143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-941d4be4-1046-4538-b9aa-625056774622 req-3951ce44-c40d-4a07-883e-81f58db4d3d4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:26.398671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-941d4be4-1046-4538-b9aa-625056774622 req-3951ce44-c40d-4a07-883e-81f58db4d3d4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:26.416792 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-941d4be4-1046-4538-b9aa-625056774622 req-3951ce44-c40d-4a07-883e-81f58db4d3d4 service nova] Creating event network-vif-deleted:451b3e6b-30e1-4f9d-86a0-e52118f7dc8b for instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 on n-h2-860864-3 Oct 11 20:40:26.423079 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-941d4be4-1046-4538-b9aa-625056774622 req-3951ce44-c40d-4a07-883e-81f58db4d3d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043498 Oct 11 20:40:26.423765 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3355/6663] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:40:26.765761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:26.766391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:26.773317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:26.773822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:26.774922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:26.775999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:26.776477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:26.776917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:26.813503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:26.814398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:26.814971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:26.815445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lazy-loading 'fault' on Instance uuid 58e608cd-9001-47f3-9469-8c156c9dc5b3 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:40:26.862728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:26.872058 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6c0081db-f0f5-4b0c-9215-7c9445ced5f1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 200 len: 1329 microversion: 2.1 time: 0.110012 Oct 11 20:40:26.873060 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3309/6664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:26 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 1329 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:27.897698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:27.898372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:27.905428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:27.905893 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:27.906325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:27.907036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:27.907489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:27.907909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:27.921737 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 HTTP/1.1 Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '58e608cd-9001-47f3-9469-8c156c9dc5b3'} Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:40:27.923381 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:40:27.927808 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:40:27.927808 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:40:27.927808 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:40:27.927808 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:40:27.927808 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:40:27.927808 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:40:27.927808 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:40:27.927808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:40:27.927808 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a2ba2207-824f-437b-9ebf-f09adeff613b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 404 len: 111 microversion: 2.1 time: 0.031592 Oct 11 20:40:27.927808 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3356/6665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:27 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:40:27.940508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:27.941138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:27.943203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:40:27.950458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:27.951239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:27.951692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:27.952397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:27.952867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:27.953306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:27.966997 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 HTTP/1.1 Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '58e608cd-9001-47f3-9469-8c156c9dc5b3'} Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:40:27.968634 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:40:27.972995 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:40:27.972995 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:40:27.972995 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:40:27.972995 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:40:27.972995 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:40:27.972995 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:40:27.972995 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:40:27.972995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:40:27.972995 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-60547575-dce5-4f86-8a49-f7c59f439d38 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 404 len: 111 microversion: 2.1 time: 0.033485 Oct 11 20:40:27.972995 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3310/6666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:27 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:40:28.019733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-637302640", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "4726f166-4133-4359-bc50-3edb25c6edd3"}], "security_groups": [{"name": "tempest-securitygroup--1093113557"}], "key_name": "tempest-keypair-1593808265", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:40:28.127376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] validate_networks() for [('4726f166-4133-4359-bc50-3edb25c6edd3', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:40:28.544210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:40:28.544633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:40:28.545131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:40:28.545538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:40:28.545945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:40:28.554695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:28.555177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:28.556146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:28.556863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:28.557313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:28.557735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:28.574716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:40:28.580362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for user 12e7db2ab50d458583122a6bbba08426 and project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:40:28.592537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:40:28.594845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:40:28.642211 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4148f792-b5b9-48b1-91e2-a21a13cf79fa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.626318 Oct 11 20:40:28.642901 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3357/6667] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:40:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:40:28.654509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-87f0e331-c639-4d55-adec-b8e5562d5c06 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:28.655152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-87f0e331-c639-4d55-adec-b8e5562d5c06 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:28.712993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-87f0e331-c639-4d55-adec-b8e5562d5c06 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:28.721398 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-87f0e331-c639-4d55-adec-b8e5562d5c06 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1238 microversion: 2.1 time: 0.070996 Oct 11 20:40:28.722046 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3311/6668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:28 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:29.746187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a4c2749d-3b5b-477b-8428-e85911a0a3d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:29.747024 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a4c2749d-3b5b-477b-8428-e85911a0a3d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:29.750096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:40:29.763087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4c2749d-3b5b-477b-8428-e85911a0a3d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:29.763589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4c2749d-3b5b-477b-8428-e85911a0a3d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:29.764246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4c2749d-3b5b-477b-8428-e85911a0a3d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:29.765180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4c2749d-3b5b-477b-8428-e85911a0a3d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:29.765718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4c2749d-3b5b-477b-8428-e85911a0a3d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:29.766282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a4c2749d-3b5b-477b-8428-e85911a0a3d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:29.770626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=95 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:40:29.841633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a4c2749d-3b5b-477b-8428-e85911a0a3d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:29.849522 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a4c2749d-3b5b-477b-8428-e85911a0a3d1 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1296 microversion: 2.1 time: 0.108071 Oct 11 20:40:29.850112 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3358/6669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:29 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:30.873785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2f846ce1-ce9f-48b4-8577-ba197ff3b2d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:30.874417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2f846ce1-ce9f-48b4-8577-ba197ff3b2d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:30.877196 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:40:30.882903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f846ce1-ce9f-48b4-8577-ba197ff3b2d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:30.883412 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f846ce1-ce9f-48b4-8577-ba197ff3b2d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:30.883864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f846ce1-ce9f-48b4-8577-ba197ff3b2d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:30.884578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f846ce1-ce9f-48b4-8577-ba197ff3b2d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:30.885857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f846ce1-ce9f-48b4-8577-ba197ff3b2d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:30.886471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2f846ce1-ce9f-48b4-8577-ba197ff3b2d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:31.076942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2f846ce1-ce9f-48b4-8577-ba197ff3b2d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:31.085565 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2f846ce1-ce9f-48b4-8577-ba197ff3b2d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1364 microversion: 2.1 time: 0.215585 Oct 11 20:40:31.086304 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3312/6670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:30 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:31.232183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-0853e10e-63cb-44a3-9728-41c23e559c81 req-92f8f327-7172-4f45-9615-3e0fb11dccfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4abf728-d926-4136-aab3-dcedc931e636", "tag": "e25bbf63-cb2e-4056-ae12-6a7c8e354426"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:40:31.241857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0853e10e-63cb-44a3-9728-41c23e559c81 req-92f8f327-7172-4f45-9615-3e0fb11dccfe service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:31.242412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0853e10e-63cb-44a3-9728-41c23e559c81 req-92f8f327-7172-4f45-9615-3e0fb11dccfe service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:31.243833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0853e10e-63cb-44a3-9728-41c23e559c81 req-92f8f327-7172-4f45-9615-3e0fb11dccfe service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:31.255110 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-0853e10e-63cb-44a3-9728-41c23e559c81 req-92f8f327-7172-4f45-9615-3e0fb11dccfe service nova] Creating event network-changed:e25bbf63-cb2e-4056-ae12-6a7c8e354426 for instance c4abf728-d926-4136-aab3-dcedc931e636 on n-h1-860864-3 Oct 11 20:40:31.260708 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-0853e10e-63cb-44a3-9728-41c23e559c81 req-92f8f327-7172-4f45-9615-3e0fb11dccfe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086204 Oct 11 20:40:31.261311 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3359/6671] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:40:32.109937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c432ce4f-5235-432b-bc5f-cb2f0c803906 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:32.110594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c432ce4f-5235-432b-bc5f-cb2f0c803906 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:32.117672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c432ce4f-5235-432b-bc5f-cb2f0c803906 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:32.118238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c432ce4f-5235-432b-bc5f-cb2f0c803906 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:32.118751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c432ce4f-5235-432b-bc5f-cb2f0c803906 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:32.119452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c432ce4f-5235-432b-bc5f-cb2f0c803906 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:32.119935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c432ce4f-5235-432b-bc5f-cb2f0c803906 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:32.120350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c432ce4f-5235-432b-bc5f-cb2f0c803906 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:32.250553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c432ce4f-5235-432b-bc5f-cb2f0c803906 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:32.258135 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c432ce4f-5235-432b-bc5f-cb2f0c803906 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1364 microversion: 2.1 time: 0.152192 Oct 11 20:40:32.259225 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3313/6672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:32 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:33.281818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a1ac5e4e-a269-45ce-9a7a-6de7386f60f0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:33.282516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a1ac5e4e-a269-45ce-9a7a-6de7386f60f0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:33.290136 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1ac5e4e-a269-45ce-9a7a-6de7386f60f0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:33.290716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1ac5e4e-a269-45ce-9a7a-6de7386f60f0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:33.291154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1ac5e4e-a269-45ce-9a7a-6de7386f60f0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:33.292194 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1ac5e4e-a269-45ce-9a7a-6de7386f60f0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:33.292653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1ac5e4e-a269-45ce-9a7a-6de7386f60f0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:33.293077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a1ac5e4e-a269-45ce-9a7a-6de7386f60f0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:33.426465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a1ac5e4e-a269-45ce-9a7a-6de7386f60f0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:33.435132 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a1ac5e4e-a269-45ce-9a7a-6de7386f60f0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1364 microversion: 2.1 time: 0.157574 Oct 11 20:40:33.435703 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3360/6673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:33 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:34.459815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-12ee869c-c6b5-4a70-a7ad-7833d498ce9c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:34.460444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-12ee869c-c6b5-4a70-a7ad-7833d498ce9c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:34.468136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12ee869c-c6b5-4a70-a7ad-7833d498ce9c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:34.468630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12ee869c-c6b5-4a70-a7ad-7833d498ce9c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:34.469078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12ee869c-c6b5-4a70-a7ad-7833d498ce9c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:34.469784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12ee869c-c6b5-4a70-a7ad-7833d498ce9c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:34.470253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12ee869c-c6b5-4a70-a7ad-7833d498ce9c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:34.470716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12ee869c-c6b5-4a70-a7ad-7833d498ce9c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:34.599261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-12ee869c-c6b5-4a70-a7ad-7833d498ce9c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:34.607629 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-12ee869c-c6b5-4a70-a7ad-7833d498ce9c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1364 microversion: 2.1 time: 0.151719 Oct 11 20:40:34.608214 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3314/6674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:34 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:35.631266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-82037b82-8d0e-46b7-b6aa-85b3d347ddec tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:35.631887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-82037b82-8d0e-46b7-b6aa-85b3d347ddec tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:35.638906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82037b82-8d0e-46b7-b6aa-85b3d347ddec tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:35.639419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82037b82-8d0e-46b7-b6aa-85b3d347ddec tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:35.639842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82037b82-8d0e-46b7-b6aa-85b3d347ddec tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:35.640536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82037b82-8d0e-46b7-b6aa-85b3d347ddec tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:35.640997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82037b82-8d0e-46b7-b6aa-85b3d347ddec tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:35.641427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82037b82-8d0e-46b7-b6aa-85b3d347ddec tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:35.768546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82037b82-8d0e-46b7-b6aa-85b3d347ddec tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:35.777327 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-82037b82-8d0e-46b7-b6aa-85b3d347ddec tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1364 microversion: 2.1 time: 0.150073 Oct 11 20:40:35.777900 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3361/6675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:35 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:36.801305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e3bfc79-64dd-43e4-9427-6edd66459afc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:36.802075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e3bfc79-64dd-43e4-9427-6edd66459afc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:36.812179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e3bfc79-64dd-43e4-9427-6edd66459afc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:36.812775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e3bfc79-64dd-43e4-9427-6edd66459afc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:36.813251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e3bfc79-64dd-43e4-9427-6edd66459afc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:36.814218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e3bfc79-64dd-43e4-9427-6edd66459afc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:36.814744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e3bfc79-64dd-43e4-9427-6edd66459afc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:36.815190 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e3bfc79-64dd-43e4-9427-6edd66459afc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:36.932202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-530e531f-b5a0-49e2-b970-6e73f07bb740 req-95815b4c-ff15-4cb8-b98b-cbbeaf9f4969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4abf728-d926-4136-aab3-dcedc931e636", "name": "network-vif-plugged", "status": "completed", "tag": "e25bbf63-cb2e-4056-ae12-6a7c8e354426"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:40:36.942725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-530e531f-b5a0-49e2-b970-6e73f07bb740 req-95815b4c-ff15-4cb8-b98b-cbbeaf9f4969 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:36.943217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-530e531f-b5a0-49e2-b970-6e73f07bb740 req-95815b4c-ff15-4cb8-b98b-cbbeaf9f4969 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:36.943800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-530e531f-b5a0-49e2-b970-6e73f07bb740 req-95815b4c-ff15-4cb8-b98b-cbbeaf9f4969 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:36.955865 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-530e531f-b5a0-49e2-b970-6e73f07bb740 req-95815b4c-ff15-4cb8-b98b-cbbeaf9f4969 service nova] Creating event network-vif-plugged:e25bbf63-cb2e-4056-ae12-6a7c8e354426 for instance c4abf728-d926-4136-aab3-dcedc931e636 on n-h1-860864-3 Oct 11 20:40:36.956215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e3bfc79-64dd-43e4-9427-6edd66459afc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:36.962717 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-530e531f-b5a0-49e2-b970-6e73f07bb740 req-95815b4c-ff15-4cb8-b98b-cbbeaf9f4969 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034280 Oct 11 20:40:36.963990 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3362/6676] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:40:36.965527 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e3bfc79-64dd-43e4-9427-6edd66459afc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1364 microversion: 2.1 time: 0.168111 Oct 11 20:40:36.966572 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3315/6677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:36 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:37.990260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-009d543b-00f5-4ca2-bfec-33c26b830983 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:37.990996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-009d543b-00f5-4ca2-bfec-33c26b830983 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:37.997831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-009d543b-00f5-4ca2-bfec-33c26b830983 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:37.998325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-009d543b-00f5-4ca2-bfec-33c26b830983 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:37.998792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-009d543b-00f5-4ca2-bfec-33c26b830983 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:37.999484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-009d543b-00f5-4ca2-bfec-33c26b830983 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:37.999949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-009d543b-00f5-4ca2-bfec-33c26b830983 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:38.000399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-009d543b-00f5-4ca2-bfec-33c26b830983 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:38.147874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-009d543b-00f5-4ca2-bfec-33c26b830983 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:38.156714 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-009d543b-00f5-4ca2-bfec-33c26b830983 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1364 microversion: 2.1 time: 0.171559 Oct 11 20:40:38.157510 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3363/6678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:37 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:39.181953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4ab2cad6-1235-493b-967b-8e1d8163b692 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:39.183011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4ab2cad6-1235-493b-967b-8e1d8163b692 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:39.186137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:40:39.191874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab2cad6-1235-493b-967b-8e1d8163b692 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:39.192377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab2cad6-1235-493b-967b-8e1d8163b692 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:39.192829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab2cad6-1235-493b-967b-8e1d8163b692 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:39.193527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab2cad6-1235-493b-967b-8e1d8163b692 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:39.193993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab2cad6-1235-493b-967b-8e1d8163b692 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:39.194458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4ab2cad6-1235-493b-967b-8e1d8163b692 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:39.322073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4ab2cad6-1235-493b-967b-8e1d8163b692 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:40:39.330071 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4ab2cad6-1235-493b-967b-8e1d8163b692 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1550 microversion: 2.1 time: 0.152702 Oct 11 20:40:39.330724 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3316/6679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:40:39 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:40:39.353810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-67292ede-7a81-4659-8f2b-abd7928fda72 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:40:39.354325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-67292ede-7a81-4659-8f2b-abd7928fda72 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:40:39.356405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:40:39.357079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:40:39.363852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67292ede-7a81-4659-8f2b-abd7928fda72 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:39.364345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67292ede-7a81-4659-8f2b-abd7928fda72 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:39.364790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67292ede-7a81-4659-8f2b-abd7928fda72 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:39.365490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67292ede-7a81-4659-8f2b-abd7928fda72 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:39.365950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67292ede-7a81-4659-8f2b-abd7928fda72 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:39.366379 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-67292ede-7a81-4659-8f2b-abd7928fda72 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:39.444524 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-67292ede-7a81-4659-8f2b-abd7928fda72 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095353 Oct 11 20:40:39.445127 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3364/6680] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:40:39 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:40:40.366588 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-6f9224cd-d2a8-4040-a3ab-0f79d71a9be4 req-f86b23a0-7b65-4369-b73d-2103f1250641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4abf728-d926-4136-aab3-dcedc931e636", "tag": "e25bbf63-cb2e-4056-ae12-6a7c8e354426"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:40:40.377717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6f9224cd-d2a8-4040-a3ab-0f79d71a9be4 req-f86b23a0-7b65-4369-b73d-2103f1250641 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:40:40.378208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6f9224cd-d2a8-4040-a3ab-0f79d71a9be4 req-f86b23a0-7b65-4369-b73d-2103f1250641 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:40:40.378721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-6f9224cd-d2a8-4040-a3ab-0f79d71a9be4 req-f86b23a0-7b65-4369-b73d-2103f1250641 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:40:40.389921 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-6f9224cd-d2a8-4040-a3ab-0f79d71a9be4 req-f86b23a0-7b65-4369-b73d-2103f1250641 service nova] Creating event network-changed:e25bbf63-cb2e-4056-ae12-6a7c8e354426 for instance c4abf728-d926-4136-aab3-dcedc931e636 on n-h1-860864-3 Oct 11 20:40:40.394932 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-6f9224cd-d2a8-4040-a3ab-0f79d71a9be4 req-f86b23a0-7b65-4369-b73d-2103f1250641 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032089 Oct 11 20:40:40.395536 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3317/6681] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:41:16.620998 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=13 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:16.621906 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=31 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:16.625800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a3579f82-3d0c-4498-98f3-0e09dab8c2a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:16.626365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a3579f82-3d0c-4498-98f3-0e09dab8c2a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:16.633100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3579f82-3d0c-4498-98f3-0e09dab8c2a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:16.633587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3579f82-3d0c-4498-98f3-0e09dab8c2a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:16.634026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3579f82-3d0c-4498-98f3-0e09dab8c2a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:16.634773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3579f82-3d0c-4498-98f3-0e09dab8c2a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:16.635233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3579f82-3d0c-4498-98f3-0e09dab8c2a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:16.635662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3579f82-3d0c-4498-98f3-0e09dab8c2a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:16.769237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a3579f82-3d0c-4498-98f3-0e09dab8c2a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:16.777595 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a3579f82-3d0c-4498-98f3-0e09dab8c2a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1668 microversion: 2.1 time: 0.158794 Oct 11 20:41:16.778170 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3365/6682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:16 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:16.798871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=11 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:16.799633 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:16.803918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7a94dcd4-cca3-400e-8605-e047c54c8558 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "212d5e91-348a-444c-94b7-16ed110859bb"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:41:16.806340 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7a94dcd4-cca3-400e-8605-e047c54c8558 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:16.815273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a94dcd4-cca3-400e-8605-e047c54c8558 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:16.815771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a94dcd4-cca3-400e-8605-e047c54c8558 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:16.816222 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a94dcd4-cca3-400e-8605-e047c54c8558 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:16.816932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a94dcd4-cca3-400e-8605-e047c54c8558 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:16.817405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a94dcd4-cca3-400e-8605-e047c54c8558 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:16.817847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7a94dcd4-cca3-400e-8605-e047c54c8558 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:17.049833 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7a94dcd4-cca3-400e-8605-e047c54c8558 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252932 Oct 11 20:41:17.050446 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3318/6683] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:41:16 2022] POST /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:41:27.765440 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:41:27.767700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:27.770468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:27.771167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:27.777554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:27.778047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:27.778490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:27.779214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:27.779672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:27.780099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:27.812369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:27.818753 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Old instance type m1.heat2, new instance type m1.heat {{(pid=126956) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:41:27.826277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:41:27.826991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:41:27.827464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:41:27.827876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:41:27.828283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:41:27.892336 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c1d1ba65-e00f-4361-be3c-b833baad25b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/action" status: 202 len: 0 microversion: 2.1 time: 0.130448 Oct 11 20:41:27.892960 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3366/6684] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:41:27 2022] POST /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:41:27.899709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:27.900493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:27.905907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-699e4742-d060-4e01-92cc-873af6d0ba0f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:27.906645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-699e4742-d060-4e01-92cc-873af6d0ba0f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:27.914076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-699e4742-d060-4e01-92cc-873af6d0ba0f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:27.914712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-699e4742-d060-4e01-92cc-873af6d0ba0f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:27.915229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-699e4742-d060-4e01-92cc-873af6d0ba0f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:27.916059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-699e4742-d060-4e01-92cc-873af6d0ba0f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:27.917396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-699e4742-d060-4e01-92cc-873af6d0ba0f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:27.917915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-699e4742-d060-4e01-92cc-873af6d0ba0f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:28.077976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-699e4742-d060-4e01-92cc-873af6d0ba0f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:28.087612 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-699e4742-d060-4e01-92cc-873af6d0ba0f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1723 microversion: 2.1 time: 0.190205 Oct 11 20:41:28.088202 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3319/6685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:27 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:41:29.111072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a769d461-8dd9-4279-be5f-9d794e138174 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:29.111820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a769d461-8dd9-4279-be5f-9d794e138174 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:29.120125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a769d461-8dd9-4279-be5f-9d794e138174 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:29.120697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a769d461-8dd9-4279-be5f-9d794e138174 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:29.121143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a769d461-8dd9-4279-be5f-9d794e138174 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:29.121846 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a769d461-8dd9-4279-be5f-9d794e138174 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:29.122309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a769d461-8dd9-4279-be5f-9d794e138174 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:29.122763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a769d461-8dd9-4279-be5f-9d794e138174 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:29.331653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a769d461-8dd9-4279-be5f-9d794e138174 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:29.343506 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a769d461-8dd9-4279-be5f-9d794e138174 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1723 microversion: 2.1 time: 0.236514 Oct 11 20:41:29.344306 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3367/6686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:29 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:30.366392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d36c0d2b-3154-4891-9743-67d4b07273a2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:30.367052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d36c0d2b-3154-4891-9743-67d4b07273a2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:30.374447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d36c0d2b-3154-4891-9743-67d4b07273a2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:30.374971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d36c0d2b-3154-4891-9743-67d4b07273a2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:30.375417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d36c0d2b-3154-4891-9743-67d4b07273a2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:30.376111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d36c0d2b-3154-4891-9743-67d4b07273a2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:30.376573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d36c0d2b-3154-4891-9743-67d4b07273a2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:30.377007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d36c0d2b-3154-4891-9743-67d4b07273a2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:30.511651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d36c0d2b-3154-4891-9743-67d4b07273a2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:30.520040 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d36c0d2b-3154-4891-9743-67d4b07273a2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.157569 Oct 11 20:41:30.520640 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3320/6687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:30 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:31.543919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e791d839-0eb9-4a96-86b2-222c8fbe34c3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:31.544510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e791d839-0eb9-4a96-86b2-222c8fbe34c3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:31.552639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e791d839-0eb9-4a96-86b2-222c8fbe34c3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:31.553125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e791d839-0eb9-4a96-86b2-222c8fbe34c3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:31.553559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e791d839-0eb9-4a96-86b2-222c8fbe34c3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:31.554272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e791d839-0eb9-4a96-86b2-222c8fbe34c3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:31.554758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e791d839-0eb9-4a96-86b2-222c8fbe34c3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:31.555178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e791d839-0eb9-4a96-86b2-222c8fbe34c3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:31.685200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e791d839-0eb9-4a96-86b2-222c8fbe34c3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:31.693475 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e791d839-0eb9-4a96-86b2-222c8fbe34c3 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.153697 Oct 11 20:41:31.694039 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3368/6688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:31 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:32.719408 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a07606b-48da-49a2-bc3d-c1d13c9ede99 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:32.719961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9a07606b-48da-49a2-bc3d-c1d13c9ede99 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:32.726853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a07606b-48da-49a2-bc3d-c1d13c9ede99 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:32.727362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a07606b-48da-49a2-bc3d-c1d13c9ede99 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:32.727817 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a07606b-48da-49a2-bc3d-c1d13c9ede99 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:32.728519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a07606b-48da-49a2-bc3d-c1d13c9ede99 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:32.728991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a07606b-48da-49a2-bc3d-c1d13c9ede99 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:32.729431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9a07606b-48da-49a2-bc3d-c1d13c9ede99 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:32.858625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9a07606b-48da-49a2-bc3d-c1d13c9ede99 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:32.867021 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a07606b-48da-49a2-bc3d-c1d13c9ede99 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.151732 Oct 11 20:41:32.867595 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3321/6689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:32 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:33.891251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-088b262f-8a5f-4ba6-8b40-b3ae421c22dc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:33.891873 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-088b262f-8a5f-4ba6-8b40-b3ae421c22dc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:33.898752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-088b262f-8a5f-4ba6-8b40-b3ae421c22dc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:33.899242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-088b262f-8a5f-4ba6-8b40-b3ae421c22dc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:33.899679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-088b262f-8a5f-4ba6-8b40-b3ae421c22dc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:33.900368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-088b262f-8a5f-4ba6-8b40-b3ae421c22dc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:33.900825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-088b262f-8a5f-4ba6-8b40-b3ae421c22dc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:33.901682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-088b262f-8a5f-4ba6-8b40-b3ae421c22dc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:34.036810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-088b262f-8a5f-4ba6-8b40-b3ae421c22dc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:34.045026 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-088b262f-8a5f-4ba6-8b40-b3ae421c22dc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.157686 Oct 11 20:41:34.045621 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3369/6690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:33 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:35.068907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7d7b03b8-0b2d-4259-86b5-2fb5f29f9d6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:35.069566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7d7b03b8-0b2d-4259-86b5-2fb5f29f9d6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:35.076955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d7b03b8-0b2d-4259-86b5-2fb5f29f9d6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:35.077455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d7b03b8-0b2d-4259-86b5-2fb5f29f9d6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:35.077905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d7b03b8-0b2d-4259-86b5-2fb5f29f9d6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:35.078645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d7b03b8-0b2d-4259-86b5-2fb5f29f9d6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:35.079118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d7b03b8-0b2d-4259-86b5-2fb5f29f9d6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:35.079555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7d7b03b8-0b2d-4259-86b5-2fb5f29f9d6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:35.207618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7d7b03b8-0b2d-4259-86b5-2fb5f29f9d6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:35.216462 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7d7b03b8-0b2d-4259-86b5-2fb5f29f9d6c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.151420 Oct 11 20:41:35.217038 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3322/6691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:35 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:36.240833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8e6ee87e-21b5-4ee9-b173-1e8314f4d03d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:36.241426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8e6ee87e-21b5-4ee9-b173-1e8314f4d03d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:36.248742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e6ee87e-21b5-4ee9-b173-1e8314f4d03d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:36.249214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e6ee87e-21b5-4ee9-b173-1e8314f4d03d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:36.249642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e6ee87e-21b5-4ee9-b173-1e8314f4d03d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:36.250319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e6ee87e-21b5-4ee9-b173-1e8314f4d03d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:36.250792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e6ee87e-21b5-4ee9-b173-1e8314f4d03d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:36.251304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e6ee87e-21b5-4ee9-b173-1e8314f4d03d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:36.383460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e6ee87e-21b5-4ee9-b173-1e8314f4d03d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:36.391802 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8e6ee87e-21b5-4ee9-b173-1e8314f4d03d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.154891 Oct 11 20:41:36.392370 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3370/6692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:36 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:37.415620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3efd3fbc-d2e1-48f4-8c9d-a43c9e0a8e42 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:37.416173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3efd3fbc-d2e1-48f4-8c9d-a43c9e0a8e42 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:37.423004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3efd3fbc-d2e1-48f4-8c9d-a43c9e0a8e42 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:37.423535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3efd3fbc-d2e1-48f4-8c9d-a43c9e0a8e42 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:37.423988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3efd3fbc-d2e1-48f4-8c9d-a43c9e0a8e42 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:37.424692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3efd3fbc-d2e1-48f4-8c9d-a43c9e0a8e42 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:37.425155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3efd3fbc-d2e1-48f4-8c9d-a43c9e0a8e42 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:37.425592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3efd3fbc-d2e1-48f4-8c9d-a43c9e0a8e42 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:37.553974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3efd3fbc-d2e1-48f4-8c9d-a43c9e0a8e42 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:37.563422 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3efd3fbc-d2e1-48f4-8c9d-a43c9e0a8e42 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.151969 Oct 11 20:41:37.564006 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3323/6693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:37 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:38.588787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-98345762-4d18-4e52-9cff-c0c3cc2d19a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:38.589406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-98345762-4d18-4e52-9cff-c0c3cc2d19a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:38.596421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98345762-4d18-4e52-9cff-c0c3cc2d19a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:38.596910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98345762-4d18-4e52-9cff-c0c3cc2d19a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:38.597380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98345762-4d18-4e52-9cff-c0c3cc2d19a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:38.598066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98345762-4d18-4e52-9cff-c0c3cc2d19a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:38.598518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98345762-4d18-4e52-9cff-c0c3cc2d19a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:38.598970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-98345762-4d18-4e52-9cff-c0c3cc2d19a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:38.725665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-98345762-4d18-4e52-9cff-c0c3cc2d19a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:38.734438 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-98345762-4d18-4e52-9cff-c0c3cc2d19a8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.150115 Oct 11 20:41:38.735050 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3371/6694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:38 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:39.757202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-376edaf6-2504-41e0-9401-3fdf8f4e06c7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:39.757830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-376edaf6-2504-41e0-9401-3fdf8f4e06c7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:39.766132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-376edaf6-2504-41e0-9401-3fdf8f4e06c7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:39.766658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-376edaf6-2504-41e0-9401-3fdf8f4e06c7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:39.767113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-376edaf6-2504-41e0-9401-3fdf8f4e06c7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:39.767818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-376edaf6-2504-41e0-9401-3fdf8f4e06c7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:39.768288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-376edaf6-2504-41e0-9401-3fdf8f4e06c7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:39.768727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-376edaf6-2504-41e0-9401-3fdf8f4e06c7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:39.901653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-376edaf6-2504-41e0-9401-3fdf8f4e06c7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:39.910079 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-376edaf6-2504-41e0-9401-3fdf8f4e06c7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.156750 Oct 11 20:41:39.910718 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3324/6695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:39 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:40.936820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8520f34c-4abf-4532-bfac-141164fffb6a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:40.937942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8520f34c-4abf-4532-bfac-141164fffb6a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:40.951996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8520f34c-4abf-4532-bfac-141164fffb6a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:40.952817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8520f34c-4abf-4532-bfac-141164fffb6a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:40.953575 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8520f34c-4abf-4532-bfac-141164fffb6a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:40.954804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8520f34c-4abf-4532-bfac-141164fffb6a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:40.955632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8520f34c-4abf-4532-bfac-141164fffb6a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:40.956420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8520f34c-4abf-4532-bfac-141164fffb6a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:41.086232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8520f34c-4abf-4532-bfac-141164fffb6a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:41.095282 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8520f34c-4abf-4532-bfac-141164fffb6a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.166053 Oct 11 20:41:41.095858 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3372/6696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:40 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:42.118899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-caae21f3-8c7c-4176-96dd-d2207dbadbe9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:42.119546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-caae21f3-8c7c-4176-96dd-d2207dbadbe9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:42.126447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caae21f3-8c7c-4176-96dd-d2207dbadbe9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:42.126981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caae21f3-8c7c-4176-96dd-d2207dbadbe9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:42.127438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caae21f3-8c7c-4176-96dd-d2207dbadbe9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:42.128143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caae21f3-8c7c-4176-96dd-d2207dbadbe9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:42.128617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caae21f3-8c7c-4176-96dd-d2207dbadbe9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:42.129062 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caae21f3-8c7c-4176-96dd-d2207dbadbe9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:42.260902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-caae21f3-8c7c-4176-96dd-d2207dbadbe9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:42.269217 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-caae21f3-8c7c-4176-96dd-d2207dbadbe9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.154333 Oct 11 20:41:42.269801 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3325/6697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:42 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:43.292871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a6eb4f0d-20c0-47c0-8906-407065abb0ae tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:43.293491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a6eb4f0d-20c0-47c0-8906-407065abb0ae tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:43.300076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6eb4f0d-20c0-47c0-8906-407065abb0ae tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:43.300570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6eb4f0d-20c0-47c0-8906-407065abb0ae tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:43.301014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6eb4f0d-20c0-47c0-8906-407065abb0ae tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:43.301709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6eb4f0d-20c0-47c0-8906-407065abb0ae tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:43.302172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6eb4f0d-20c0-47c0-8906-407065abb0ae tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:43.302631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a6eb4f0d-20c0-47c0-8906-407065abb0ae tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:43.430730 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a6eb4f0d-20c0-47c0-8906-407065abb0ae tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:43.439631 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a6eb4f0d-20c0-47c0-8906-407065abb0ae tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.151010 Oct 11 20:41:43.440205 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3373/6698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:43 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:41:44.463704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6bc8f27c-0b04-43b2-a8f9-ca29a488006a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:44.464425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6bc8f27c-0b04-43b2-a8f9-ca29a488006a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:44.471289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc8f27c-0b04-43b2-a8f9-ca29a488006a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:44.471784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc8f27c-0b04-43b2-a8f9-ca29a488006a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:44.472232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc8f27c-0b04-43b2-a8f9-ca29a488006a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:44.472956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc8f27c-0b04-43b2-a8f9-ca29a488006a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:44.473424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc8f27c-0b04-43b2-a8f9-ca29a488006a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:44.473858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6bc8f27c-0b04-43b2-a8f9-ca29a488006a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:44.608757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6bc8f27c-0b04-43b2-a8f9-ca29a488006a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:44.616903 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6bc8f27c-0b04-43b2-a8f9-ca29a488006a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.157441 Oct 11 20:41:44.617479 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3326/6699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:44 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:45.641399 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-82bbd74c-d230-4d34-9867-58616bafffaa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:45.642330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-82bbd74c-d230-4d34-9867-58616bafffaa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:45.648979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82bbd74c-d230-4d34-9867-58616bafffaa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:45.649459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82bbd74c-d230-4d34-9867-58616bafffaa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:45.649887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82bbd74c-d230-4d34-9867-58616bafffaa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:45.650593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82bbd74c-d230-4d34-9867-58616bafffaa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:45.651808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82bbd74c-d230-4d34-9867-58616bafffaa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:45.652256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-82bbd74c-d230-4d34-9867-58616bafffaa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:45.782115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-82bbd74c-d230-4d34-9867-58616bafffaa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:45.790334 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-82bbd74c-d230-4d34-9867-58616bafffaa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.152857 Oct 11 20:41:45.790933 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3374/6700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:45 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:46.814102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-caa2e243-cf35-4c23-bbc2-b5fe8f4bb702 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:46.814701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-caa2e243-cf35-4c23-bbc2-b5fe8f4bb702 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:46.821683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa2e243-cf35-4c23-bbc2-b5fe8f4bb702 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:46.822187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa2e243-cf35-4c23-bbc2-b5fe8f4bb702 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:46.822664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa2e243-cf35-4c23-bbc2-b5fe8f4bb702 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:46.824321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa2e243-cf35-4c23-bbc2-b5fe8f4bb702 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:46.824793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa2e243-cf35-4c23-bbc2-b5fe8f4bb702 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:46.825230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-caa2e243-cf35-4c23-bbc2-b5fe8f4bb702 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:46.962688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-caa2e243-cf35-4c23-bbc2-b5fe8f4bb702 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:46.971843 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-caa2e243-cf35-4c23-bbc2-b5fe8f4bb702 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.161737 Oct 11 20:41:46.972644 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3327/6701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:46 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:47.996477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0bdb40de-e297-4caf-9904-7a2c72644581 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:47.997238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0bdb40de-e297-4caf-9904-7a2c72644581 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:48.004000 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bdb40de-e297-4caf-9904-7a2c72644581 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:48.004486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bdb40de-e297-4caf-9904-7a2c72644581 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:48.004923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bdb40de-e297-4caf-9904-7a2c72644581 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:48.005647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bdb40de-e297-4caf-9904-7a2c72644581 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:48.006104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bdb40de-e297-4caf-9904-7a2c72644581 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:48.006546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0bdb40de-e297-4caf-9904-7a2c72644581 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:48.143464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0bdb40de-e297-4caf-9904-7a2c72644581 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:48.151830 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0bdb40de-e297-4caf-9904-7a2c72644581 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1728 microversion: 2.1 time: 0.159851 Oct 11 20:41:48.152404 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3375/6702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:47 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:49.173972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ca2a4e57-5c74-42fe-8422-db21b14c5bc2 req-2b56d1f1-aea8-40d4-a22d-d75d71d0712d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4abf728-d926-4136-aab3-dcedc931e636", "name": "network-vif-unplugged", "status": "completed", "tag": "e25bbf63-cb2e-4056-ae12-6a7c8e354426"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:41:49.175323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-959c8810-979d-42f3-a1fc-35fef2eb04e7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:49.175958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-959c8810-979d-42f3-a1fc-35fef2eb04e7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:49.183377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-959c8810-979d-42f3-a1fc-35fef2eb04e7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:49.184012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-959c8810-979d-42f3-a1fc-35fef2eb04e7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:49.184466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-959c8810-979d-42f3-a1fc-35fef2eb04e7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:49.184981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ca2a4e57-5c74-42fe-8422-db21b14c5bc2 req-2b56d1f1-aea8-40d4-a22d-d75d71d0712d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:49.185185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-959c8810-979d-42f3-a1fc-35fef2eb04e7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:49.185453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ca2a4e57-5c74-42fe-8422-db21b14c5bc2 req-2b56d1f1-aea8-40d4-a22d-d75d71d0712d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:49.185609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-959c8810-979d-42f3-a1fc-35fef2eb04e7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:49.185952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ca2a4e57-5c74-42fe-8422-db21b14c5bc2 req-2b56d1f1-aea8-40d4-a22d-d75d71d0712d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:49.186079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-959c8810-979d-42f3-a1fc-35fef2eb04e7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:49.200142 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ca2a4e57-5c74-42fe-8422-db21b14c5bc2 req-2b56d1f1-aea8-40d4-a22d-d75d71d0712d service nova] Creating event network-vif-unplugged:e25bbf63-cb2e-4056-ae12-6a7c8e354426 for instance c4abf728-d926-4136-aab3-dcedc931e636 on n-h2-860864-3 Oct 11 20:41:49.206574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-ca2a4e57-5c74-42fe-8422-db21b14c5bc2 req-2b56d1f1-aea8-40d4-a22d-d75d71d0712d service nova] Instance c4abf728-d926-4136-aab3-dcedc931e636 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:41:49.218163 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ca2a4e57-5c74-42fe-8422-db21b14c5bc2 req-2b56d1f1-aea8-40d4-a22d-d75d71d0712d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047984 Oct 11 20:41:49.218865 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3328/6703] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:41:49.483358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-959c8810-979d-42f3-a1fc-35fef2eb04e7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:49.492159 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-959c8810-979d-42f3-a1fc-35fef2eb04e7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1727 microversion: 2.1 time: 0.320657 Oct 11 20:41:49.493429 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3376/6704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:49 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1727 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:41:50.519983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9f9c7c88-7153-4c6b-93fe-83615fcb0059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:50.521248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9f9c7c88-7153-4c6b-93fe-83615fcb0059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:50.529818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f9c7c88-7153-4c6b-93fe-83615fcb0059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:50.530364 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f9c7c88-7153-4c6b-93fe-83615fcb0059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:50.530847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f9c7c88-7153-4c6b-93fe-83615fcb0059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:50.531573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f9c7c88-7153-4c6b-93fe-83615fcb0059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:50.532218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f9c7c88-7153-4c6b-93fe-83615fcb0059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:50.532665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9f9c7c88-7153-4c6b-93fe-83615fcb0059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:50.672671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9f9c7c88-7153-4c6b-93fe-83615fcb0059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:50.681078 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9f9c7c88-7153-4c6b-93fe-83615fcb0059 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.167559 Oct 11 20:41:50.681654 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3329/6705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:50 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:51.257040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4ca4a778-5940-485a-b774-2ab33540239f req-a4a17a96-e208-4d99-94b7-a9e5d03c04c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4abf728-d926-4136-aab3-dcedc931e636", "tag": "e25bbf63-cb2e-4056-ae12-6a7c8e354426"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:41:51.268409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4ca4a778-5940-485a-b774-2ab33540239f req-a4a17a96-e208-4d99-94b7-a9e5d03c04c3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:51.268889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4ca4a778-5940-485a-b774-2ab33540239f req-a4a17a96-e208-4d99-94b7-a9e5d03c04c3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:51.269323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4ca4a778-5940-485a-b774-2ab33540239f req-a4a17a96-e208-4d99-94b7-a9e5d03c04c3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:51.281441 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4ca4a778-5940-485a-b774-2ab33540239f req-a4a17a96-e208-4d99-94b7-a9e5d03c04c3 service nova] Creating event network-changed:e25bbf63-cb2e-4056-ae12-6a7c8e354426 for instance c4abf728-d926-4136-aab3-dcedc931e636 on n-h2-860864-3 Oct 11 20:41:51.286909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-4ca4a778-5940-485a-b774-2ab33540239f req-a4a17a96-e208-4d99-94b7-a9e5d03c04c3 service nova] Instance c4abf728-d926-4136-aab3-dcedc931e636 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:41:51.298799 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4ca4a778-5940-485a-b774-2ab33540239f req-a4a17a96-e208-4d99-94b7-a9e5d03c04c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045373 Oct 11 20:41:51.299352 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3377/6706] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:41:51.705419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3894626b-5374-4063-97e3-dae16de1007f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:51.706145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3894626b-5374-4063-97e3-dae16de1007f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:51.714249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3894626b-5374-4063-97e3-dae16de1007f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:51.715370 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3894626b-5374-4063-97e3-dae16de1007f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:51.716002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3894626b-5374-4063-97e3-dae16de1007f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:51.716793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3894626b-5374-4063-97e3-dae16de1007f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:51.717339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3894626b-5374-4063-97e3-dae16de1007f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:51.717868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3894626b-5374-4063-97e3-dae16de1007f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:52.402054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3894626b-5374-4063-97e3-dae16de1007f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:52.412481 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3894626b-5374-4063-97e3-dae16de1007f tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.711419 Oct 11 20:41:52.413645 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3330/6707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:51 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:53.438418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a77a4ac5-58a2-4dc9-bb00-49ff6665761b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:53.439176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a77a4ac5-58a2-4dc9-bb00-49ff6665761b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:53.445453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a77a4ac5-58a2-4dc9-bb00-49ff6665761b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:53.445953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a77a4ac5-58a2-4dc9-bb00-49ff6665761b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:53.446395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a77a4ac5-58a2-4dc9-bb00-49ff6665761b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:53.447126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a77a4ac5-58a2-4dc9-bb00-49ff6665761b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:53.447590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a77a4ac5-58a2-4dc9-bb00-49ff6665761b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:53.448017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a77a4ac5-58a2-4dc9-bb00-49ff6665761b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:53.588741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a77a4ac5-58a2-4dc9-bb00-49ff6665761b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:53.598766 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a77a4ac5-58a2-4dc9-bb00-49ff6665761b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.165483 Oct 11 20:41:53.599387 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3378/6708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:53 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:54.622614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-631cc3e5-7cef-48ec-b7e8-0dd27832506a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:54.623522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-631cc3e5-7cef-48ec-b7e8-0dd27832506a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:54.630366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-631cc3e5-7cef-48ec-b7e8-0dd27832506a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:54.630898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-631cc3e5-7cef-48ec-b7e8-0dd27832506a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:54.631354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-631cc3e5-7cef-48ec-b7e8-0dd27832506a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:54.632064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-631cc3e5-7cef-48ec-b7e8-0dd27832506a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:54.632529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-631cc3e5-7cef-48ec-b7e8-0dd27832506a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:54.632959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-631cc3e5-7cef-48ec-b7e8-0dd27832506a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:54.771218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-631cc3e5-7cef-48ec-b7e8-0dd27832506a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:54.779978 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-631cc3e5-7cef-48ec-b7e8-0dd27832506a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.161417 Oct 11 20:41:54.780567 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3331/6709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:54 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:55.804811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7b0d5aef-4831-43e3-8cb4-31ad87b0326b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:55.805431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7b0d5aef-4831-43e3-8cb4-31ad87b0326b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:55.813167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0d5aef-4831-43e3-8cb4-31ad87b0326b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:55.813655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0d5aef-4831-43e3-8cb4-31ad87b0326b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:55.814093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0d5aef-4831-43e3-8cb4-31ad87b0326b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:55.814818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0d5aef-4831-43e3-8cb4-31ad87b0326b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:55.815275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0d5aef-4831-43e3-8cb4-31ad87b0326b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:55.815699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7b0d5aef-4831-43e3-8cb4-31ad87b0326b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:55.944744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7b0d5aef-4831-43e3-8cb4-31ad87b0326b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:55.953420 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7b0d5aef-4831-43e3-8cb4-31ad87b0326b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.152582 Oct 11 20:41:55.954000 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3379/6710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:55 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:56.976734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51106b3b-9779-41c2-89ca-14e35008dcb2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:56.977362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51106b3b-9779-41c2-89ca-14e35008dcb2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:56.985374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51106b3b-9779-41c2-89ca-14e35008dcb2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:56.985875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51106b3b-9779-41c2-89ca-14e35008dcb2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:56.986328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51106b3b-9779-41c2-89ca-14e35008dcb2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:56.987057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51106b3b-9779-41c2-89ca-14e35008dcb2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:56.987525 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51106b3b-9779-41c2-89ca-14e35008dcb2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:56.987964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51106b3b-9779-41c2-89ca-14e35008dcb2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:57.125345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-51106b3b-9779-41c2-89ca-14e35008dcb2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:57.133560 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51106b3b-9779-41c2-89ca-14e35008dcb2 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.160769 Oct 11 20:41:57.134160 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3332/6711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:56 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:58.157842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e193abb-b991-4046-938e-02edc0cb5967 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:58.158455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e193abb-b991-4046-938e-02edc0cb5967 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:58.161226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=33 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:58.166787 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e193abb-b991-4046-938e-02edc0cb5967 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:58.167275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e193abb-b991-4046-938e-02edc0cb5967 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:58.167709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e193abb-b991-4046-938e-02edc0cb5967 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:58.168390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e193abb-b991-4046-938e-02edc0cb5967 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:58.168850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e193abb-b991-4046-938e-02edc0cb5967 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:58.169269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e193abb-b991-4046-938e-02edc0cb5967 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:58.171992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:58.300006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e193abb-b991-4046-938e-02edc0cb5967 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:58.308125 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e193abb-b991-4046-938e-02edc0cb5967 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.154844 Oct 11 20:41:58.308694 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3380/6712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:58 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:41:59.332447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-935e420f-b912-4fc6-8ab8-262757346468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:41:59.333000 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-935e420f-b912-4fc6-8ab8-262757346468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:41:59.335856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=29 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:59.341595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-935e420f-b912-4fc6-8ab8-262757346468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:59.342098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-935e420f-b912-4fc6-8ab8-262757346468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:59.342585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-935e420f-b912-4fc6-8ab8-262757346468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:59.343297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-935e420f-b912-4fc6-8ab8-262757346468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:41:59.343771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-935e420f-b912-4fc6-8ab8-262757346468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:41:59.344211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-935e420f-b912-4fc6-8ab8-262757346468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:41:59.348349 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=83 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:41:59.478468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-935e420f-b912-4fc6-8ab8-262757346468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:41:59.486720 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-935e420f-b912-4fc6-8ab8-262757346468 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.158255 Oct 11 20:41:59.487295 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3333/6713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:41:59 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:00.510171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-765d5c2d-44d6-42a7-ae8b-223b67fe314b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:00.510819 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-765d5c2d-44d6-42a7-ae8b-223b67fe314b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:00.518325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-765d5c2d-44d6-42a7-ae8b-223b67fe314b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:00.518845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-765d5c2d-44d6-42a7-ae8b-223b67fe314b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:00.519283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-765d5c2d-44d6-42a7-ae8b-223b67fe314b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:00.519965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-765d5c2d-44d6-42a7-ae8b-223b67fe314b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:00.520418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-765d5c2d-44d6-42a7-ae8b-223b67fe314b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:00.520841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-765d5c2d-44d6-42a7-ae8b-223b67fe314b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:00.654435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-765d5c2d-44d6-42a7-ae8b-223b67fe314b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:00.662600 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-765d5c2d-44d6-42a7-ae8b-223b67fe314b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.156302 Oct 11 20:42:00.663173 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3381/6714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:00 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:42:01.685978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b8ac665-9c11-4bf7-bae0-e8a2216e9835 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:01.686618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3b8ac665-9c11-4bf7-bae0-e8a2216e9835 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:01.693524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b8ac665-9c11-4bf7-bae0-e8a2216e9835 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:01.694020 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b8ac665-9c11-4bf7-bae0-e8a2216e9835 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:01.694471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b8ac665-9c11-4bf7-bae0-e8a2216e9835 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:01.695256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b8ac665-9c11-4bf7-bae0-e8a2216e9835 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:01.695724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b8ac665-9c11-4bf7-bae0-e8a2216e9835 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:01.696158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3b8ac665-9c11-4bf7-bae0-e8a2216e9835 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:01.827324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3b8ac665-9c11-4bf7-bae0-e8a2216e9835 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:01.835858 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b8ac665-9c11-4bf7-bae0-e8a2216e9835 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.153744 Oct 11 20:42:01.836435 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3334/6715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:01 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:02.859718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ad5c736a-a092-4af9-9782-c5e06d4a2176 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:02.860326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ad5c736a-a092-4af9-9782-c5e06d4a2176 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:02.867242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad5c736a-a092-4af9-9782-c5e06d4a2176 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:02.867708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad5c736a-a092-4af9-9782-c5e06d4a2176 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:02.868141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad5c736a-a092-4af9-9782-c5e06d4a2176 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:02.868826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad5c736a-a092-4af9-9782-c5e06d4a2176 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:02.869305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad5c736a-a092-4af9-9782-c5e06d4a2176 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:02.869727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ad5c736a-a092-4af9-9782-c5e06d4a2176 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:03.010922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ad5c736a-a092-4af9-9782-c5e06d4a2176 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:03.019354 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ad5c736a-a092-4af9-9782-c5e06d4a2176 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1725 microversion: 2.1 time: 0.164111 Oct 11 20:42:03.019951 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3382/6716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:02 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:04.045081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d4d7b2ce-41c2-4014-bf7e-ecba8cfa3186 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:04.045714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d4d7b2ce-41c2-4014-bf7e-ecba8cfa3186 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:04.052742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4d7b2ce-41c2-4014-bf7e-ecba8cfa3186 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:04.053246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4d7b2ce-41c2-4014-bf7e-ecba8cfa3186 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:04.053706 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4d7b2ce-41c2-4014-bf7e-ecba8cfa3186 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:04.054417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4d7b2ce-41c2-4014-bf7e-ecba8cfa3186 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:04.054923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4d7b2ce-41c2-4014-bf7e-ecba8cfa3186 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:04.055365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d4d7b2ce-41c2-4014-bf7e-ecba8cfa3186 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:04.184935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d4d7b2ce-41c2-4014-bf7e-ecba8cfa3186 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:04.193266 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d4d7b2ce-41c2-4014-bf7e-ecba8cfa3186 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1722 microversion: 2.1 time: 0.152602 Oct 11 20:42:04.193847 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3335/6717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:04 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:04.217398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:42:04.217960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:04.224687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:04.225165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:04.225598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:04.226276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:04.226791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:04.227219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:04.263584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:04.264052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:04.264486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:04.265201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:04.265648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:04.266071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:04.289158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:42:04.294387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Getting quotas for user 12e7db2ab50d458583122a6bbba08426 and project b52c54fe81544f05bb58bc292d2f1401. Resources: {'cores', 'ram'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:42:04.395743 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-340f2183-fd0f-4a37-afc5-bab21ccc4b5b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "POST /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/action" status: 202 len: 0 microversion: 2.1 time: 0.182723 Oct 11 20:42:04.396265 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3383/6718] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:42:04 2022] POST /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:42:04.404558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-47e922d2-9370-418d-a2b0-5ca91dd8b8a6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:04.405192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-47e922d2-9370-418d-a2b0-5ca91dd8b8a6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:04.411988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e922d2-9370-418d-a2b0-5ca91dd8b8a6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:04.412506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e922d2-9370-418d-a2b0-5ca91dd8b8a6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:04.412968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e922d2-9370-418d-a2b0-5ca91dd8b8a6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:04.413691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e922d2-9370-418d-a2b0-5ca91dd8b8a6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:04.414170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e922d2-9370-418d-a2b0-5ca91dd8b8a6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:04.414642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-47e922d2-9370-418d-a2b0-5ca91dd8b8a6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:04.613347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-47e922d2-9370-418d-a2b0-5ca91dd8b8a6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:04.622911 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-47e922d2-9370-418d-a2b0-5ca91dd8b8a6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.222280 Oct 11 20:42:04.623502 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3336/6719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:04 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:05.645396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-133d227b-d170-4d2d-846c-7e1f490e9e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:05.646287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-133d227b-d170-4d2d-846c-7e1f490e9e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:05.651458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ab68371a-5d10-4651-8fe1-84f1680b21db req-6407b7a3-e9f4-42a4-91ac-bb4fc704ed41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4abf728-d926-4136-aab3-dcedc931e636", "name": "network-vif-plugged", "status": "completed", "tag": "e25bbf63-cb2e-4056-ae12-6a7c8e354426"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:42:05.653752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133d227b-d170-4d2d-846c-7e1f490e9e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:05.654336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133d227b-d170-4d2d-846c-7e1f490e9e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:05.654890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133d227b-d170-4d2d-846c-7e1f490e9e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:05.655676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133d227b-d170-4d2d-846c-7e1f490e9e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:05.656230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133d227b-d170-4d2d-846c-7e1f490e9e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:05.656770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-133d227b-d170-4d2d-846c-7e1f490e9e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:05.662196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ab68371a-5d10-4651-8fe1-84f1680b21db req-6407b7a3-e9f4-42a4-91ac-bb4fc704ed41 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:05.662712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ab68371a-5d10-4651-8fe1-84f1680b21db req-6407b7a3-e9f4-42a4-91ac-bb4fc704ed41 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:05.663159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ab68371a-5d10-4651-8fe1-84f1680b21db req-6407b7a3-e9f4-42a4-91ac-bb4fc704ed41 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:05.674571 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ab68371a-5d10-4651-8fe1-84f1680b21db req-6407b7a3-e9f4-42a4-91ac-bb4fc704ed41 service nova] Creating event network-vif-plugged:e25bbf63-cb2e-4056-ae12-6a7c8e354426 for instance c4abf728-d926-4136-aab3-dcedc931e636 on n-h2-860864-3 Oct 11 20:42:05.679855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-ab68371a-5d10-4651-8fe1-84f1680b21db req-6407b7a3-e9f4-42a4-91ac-bb4fc704ed41 service nova] Instance c4abf728-d926-4136-aab3-dcedc931e636 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-3', 'n-h1-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:42:05.691527 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ab68371a-5d10-4651-8fe1-84f1680b21db req-6407b7a3-e9f4-42a4-91ac-bb4fc704ed41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094820 Oct 11 20:42:05.692006 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3384/6720] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:42:05.795103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-133d227b-d170-4d2d-846c-7e1f490e9e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:05.803404 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-133d227b-d170-4d2d-846c-7e1f490e9e75 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.162040 Oct 11 20:42:05.803980 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3337/6721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:05 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:42:06.830165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dfae037c-b4f9-4ca9-98a6-5da6e5c07f81 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:06.830953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dfae037c-b4f9-4ca9-98a6-5da6e5c07f81 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:06.837138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfae037c-b4f9-4ca9-98a6-5da6e5c07f81 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:06.837636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfae037c-b4f9-4ca9-98a6-5da6e5c07f81 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:06.838100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfae037c-b4f9-4ca9-98a6-5da6e5c07f81 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:06.838836 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfae037c-b4f9-4ca9-98a6-5da6e5c07f81 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:06.839293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfae037c-b4f9-4ca9-98a6-5da6e5c07f81 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:06.839720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfae037c-b4f9-4ca9-98a6-5da6e5c07f81 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:06.990713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dfae037c-b4f9-4ca9-98a6-5da6e5c07f81 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:07.000425 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dfae037c-b4f9-4ca9-98a6-5da6e5c07f81 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.176498 Oct 11 20:42:07.001015 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3385/6722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:06 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:42:08.025192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e8f4e9f0-daa5-4213-a223-d4528e1bec88 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:08.025829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e8f4e9f0-daa5-4213-a223-d4528e1bec88 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:08.032751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8f4e9f0-daa5-4213-a223-d4528e1bec88 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:08.033258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8f4e9f0-daa5-4213-a223-d4528e1bec88 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:08.033729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8f4e9f0-daa5-4213-a223-d4528e1bec88 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:08.034441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8f4e9f0-daa5-4213-a223-d4528e1bec88 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:08.034942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8f4e9f0-daa5-4213-a223-d4528e1bec88 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:08.035384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8f4e9f0-daa5-4213-a223-d4528e1bec88 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:08.173177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e8f4e9f0-daa5-4213-a223-d4528e1bec88 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:08.181542 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e8f4e9f0-daa5-4213-a223-d4528e1bec88 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.160654 Oct 11 20:42:08.182127 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3338/6723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:08 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:09.205772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e28b17a2-37c3-4c33-aa3d-175fc21456c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:09.206396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e28b17a2-37c3-4c33-aa3d-175fc21456c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:09.213349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28b17a2-37c3-4c33-aa3d-175fc21456c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:09.213845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28b17a2-37c3-4c33-aa3d-175fc21456c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:09.214289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28b17a2-37c3-4c33-aa3d-175fc21456c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:09.215120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28b17a2-37c3-4c33-aa3d-175fc21456c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:09.215591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28b17a2-37c3-4c33-aa3d-175fc21456c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:09.216023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e28b17a2-37c3-4c33-aa3d-175fc21456c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:09.452360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e28b17a2-37c3-4c33-aa3d-175fc21456c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:09.460599 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e28b17a2-37c3-4c33-aa3d-175fc21456c8 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.259137 Oct 11 20:42:09.461191 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3386/6724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:09 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:09.596457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-769914db-8613-4890-a410-efc49eb0123e req-086e0033-e851-47bd-bcd4-3c85a5931d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4abf728-d926-4136-aab3-dcedc931e636", "name": "network-vif-unplugged", "status": "completed", "tag": "e25bbf63-cb2e-4056-ae12-6a7c8e354426"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:42:09.608483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-769914db-8613-4890-a410-efc49eb0123e req-086e0033-e851-47bd-bcd4-3c85a5931d30 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:09.608986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-769914db-8613-4890-a410-efc49eb0123e req-086e0033-e851-47bd-bcd4-3c85a5931d30 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:09.609442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-769914db-8613-4890-a410-efc49eb0123e req-086e0033-e851-47bd-bcd4-3c85a5931d30 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:09.621389 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-769914db-8613-4890-a410-efc49eb0123e req-086e0033-e851-47bd-bcd4-3c85a5931d30 service nova] Creating event network-vif-unplugged:e25bbf63-cb2e-4056-ae12-6a7c8e354426 for instance c4abf728-d926-4136-aab3-dcedc931e636 on n-h1-860864-3 Oct 11 20:42:09.627362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-769914db-8613-4890-a410-efc49eb0123e req-086e0033-e851-47bd-bcd4-3c85a5931d30 service nova] Instance c4abf728-d926-4136-aab3-dcedc931e636 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:42:09.639182 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-769914db-8613-4890-a410-efc49eb0123e req-086e0033-e851-47bd-bcd4-3c85a5931d30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045794 Oct 11 20:42:09.639749 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3339/6725] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:42:10.485529 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cb4ed3fa-e3c1-4a2f-b283-7acf092942de tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:10.486144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cb4ed3fa-e3c1-4a2f-b283-7acf092942de tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:10.492931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb4ed3fa-e3c1-4a2f-b283-7acf092942de tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:10.493414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb4ed3fa-e3c1-4a2f-b283-7acf092942de tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:10.493845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb4ed3fa-e3c1-4a2f-b283-7acf092942de tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:10.494561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb4ed3fa-e3c1-4a2f-b283-7acf092942de tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:10.495037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb4ed3fa-e3c1-4a2f-b283-7acf092942de tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:10.495455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cb4ed3fa-e3c1-4a2f-b283-7acf092942de tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:10.638857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cb4ed3fa-e3c1-4a2f-b283-7acf092942de tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:10.647556 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cb4ed3fa-e3c1-4a2f-b283-7acf092942de tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.166777 Oct 11 20:42:10.648146 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3387/6726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:10 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:11.673237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2bd94dbd-932f-4bcf-8c4f-55ce69e19f90 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:11.674182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2bd94dbd-932f-4bcf-8c4f-55ce69e19f90 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:11.679295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3f66796f-81bf-41b4-9c72-16b3c61170dc req-e815b822-d45d-43db-affd-a9b71738273e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4abf728-d926-4136-aab3-dcedc931e636", "tag": "e25bbf63-cb2e-4056-ae12-6a7c8e354426"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:42:11.683013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2bd94dbd-932f-4bcf-8c4f-55ce69e19f90 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:11.683531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2bd94dbd-932f-4bcf-8c4f-55ce69e19f90 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:11.683985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2bd94dbd-932f-4bcf-8c4f-55ce69e19f90 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:11.684699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2bd94dbd-932f-4bcf-8c4f-55ce69e19f90 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:11.685521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2bd94dbd-932f-4bcf-8c4f-55ce69e19f90 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:11.686033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2bd94dbd-932f-4bcf-8c4f-55ce69e19f90 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:11.690487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3f66796f-81bf-41b4-9c72-16b3c61170dc req-e815b822-d45d-43db-affd-a9b71738273e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:11.691003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3f66796f-81bf-41b4-9c72-16b3c61170dc req-e815b822-d45d-43db-affd-a9b71738273e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:11.691435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3f66796f-81bf-41b4-9c72-16b3c61170dc req-e815b822-d45d-43db-affd-a9b71738273e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:11.707241 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3f66796f-81bf-41b4-9c72-16b3c61170dc req-e815b822-d45d-43db-affd-a9b71738273e service nova] Creating event network-changed:e25bbf63-cb2e-4056-ae12-6a7c8e354426 for instance c4abf728-d926-4136-aab3-dcedc931e636 on n-h1-860864-3 Oct 11 20:42:11.714490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-3f66796f-81bf-41b4-9c72-16b3c61170dc req-e815b822-d45d-43db-affd-a9b71738273e service nova] Instance c4abf728-d926-4136-aab3-dcedc931e636 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:42:11.726510 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3f66796f-81bf-41b4-9c72-16b3c61170dc req-e815b822-d45d-43db-affd-a9b71738273e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050784 Oct 11 20:42:11.727493 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3388/6727] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:42:12.020395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2bd94dbd-932f-4bcf-8c4f-55ce69e19f90 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:12.028828 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2bd94dbd-932f-4bcf-8c4f-55ce69e19f90 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.361535 Oct 11 20:42:12.030178 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3340/6728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:11 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:13.061989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0cf535d1-5d00-4405-999c-3e140a066827 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:13.063553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0cf535d1-5d00-4405-999c-3e140a066827 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:13.074065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf535d1-5d00-4405-999c-3e140a066827 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:13.074675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf535d1-5d00-4405-999c-3e140a066827 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:13.075189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf535d1-5d00-4405-999c-3e140a066827 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:13.076908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf535d1-5d00-4405-999c-3e140a066827 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:13.077619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf535d1-5d00-4405-999c-3e140a066827 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:13.078118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0cf535d1-5d00-4405-999c-3e140a066827 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:13.211128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0cf535d1-5d00-4405-999c-3e140a066827 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:13.219560 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0cf535d1-5d00-4405-999c-3e140a066827 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.169926 Oct 11 20:42:13.220135 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3389/6729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:13 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:14.243630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b620beb-9edc-44cc-ac4b-1b3092403b74 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:14.244264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9b620beb-9edc-44cc-ac4b-1b3092403b74 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:14.252864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b620beb-9edc-44cc-ac4b-1b3092403b74 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:14.253384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b620beb-9edc-44cc-ac4b-1b3092403b74 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:14.253833 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b620beb-9edc-44cc-ac4b-1b3092403b74 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:14.254574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b620beb-9edc-44cc-ac4b-1b3092403b74 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:14.255047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b620beb-9edc-44cc-ac4b-1b3092403b74 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:14.255485 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b620beb-9edc-44cc-ac4b-1b3092403b74 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:14.396810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9b620beb-9edc-44cc-ac4b-1b3092403b74 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:14.405721 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9b620beb-9edc-44cc-ac4b-1b3092403b74 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.166111 Oct 11 20:42:14.406292 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3341/6730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:14 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:15.429367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b1ad8bad-41b0-4fe4-a732-b0cdf3b6cc33 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:15.429979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b1ad8bad-41b0-4fe4-a732-b0cdf3b6cc33 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:15.432607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:15.438170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1ad8bad-41b0-4fe4-a732-b0cdf3b6cc33 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:15.438674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1ad8bad-41b0-4fe4-a732-b0cdf3b6cc33 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:15.439107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1ad8bad-41b0-4fe4-a732-b0cdf3b6cc33 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:15.439794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1ad8bad-41b0-4fe4-a732-b0cdf3b6cc33 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:15.440251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1ad8bad-41b0-4fe4-a732-b0cdf3b6cc33 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:15.440672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b1ad8bad-41b0-4fe4-a732-b0cdf3b6cc33 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:15.572905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b1ad8bad-41b0-4fe4-a732-b0cdf3b6cc33 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:15.581800 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b1ad8bad-41b0-4fe4-a732-b0cdf3b6cc33 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.156349 Oct 11 20:42:15.582373 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3390/6731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:15 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:16.605303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9c39bd8-3094-4198-a2a1-b15eca889e09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:16.605929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b9c39bd8-3094-4198-a2a1-b15eca889e09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:16.613354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9c39bd8-3094-4198-a2a1-b15eca889e09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:16.613850 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9c39bd8-3094-4198-a2a1-b15eca889e09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:16.614299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9c39bd8-3094-4198-a2a1-b15eca889e09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:16.615018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9c39bd8-3094-4198-a2a1-b15eca889e09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:16.615484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9c39bd8-3094-4198-a2a1-b15eca889e09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:16.615917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9c39bd8-3094-4198-a2a1-b15eca889e09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:16.744228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b9c39bd8-3094-4198-a2a1-b15eca889e09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:16.753164 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b9c39bd8-3094-4198-a2a1-b15eca889e09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.151844 Oct 11 20:42:16.753739 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3342/6732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:16 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:17.776513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-adc14c65-8639-4800-a33e-0d7ea11c89fc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:17.777123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-adc14c65-8639-4800-a33e-0d7ea11c89fc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:17.784423 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-adc14c65-8639-4800-a33e-0d7ea11c89fc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:17.784909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-adc14c65-8639-4800-a33e-0d7ea11c89fc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:17.785349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-adc14c65-8639-4800-a33e-0d7ea11c89fc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:17.786030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-adc14c65-8639-4800-a33e-0d7ea11c89fc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:17.786488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-adc14c65-8639-4800-a33e-0d7ea11c89fc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:17.786940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-adc14c65-8639-4800-a33e-0d7ea11c89fc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:17.922784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-adc14c65-8639-4800-a33e-0d7ea11c89fc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:17.930975 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-adc14c65-8639-4800-a33e-0d7ea11c89fc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.158342 Oct 11 20:42:17.931543 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3391/6733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:17 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:18.955535 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d667d7bc-1122-4823-aacf-2efc0af37336 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:18.956170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d667d7bc-1122-4823-aacf-2efc0af37336 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:18.963212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d667d7bc-1122-4823-aacf-2efc0af37336 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:18.963716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d667d7bc-1122-4823-aacf-2efc0af37336 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:18.964171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d667d7bc-1122-4823-aacf-2efc0af37336 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:18.964883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d667d7bc-1122-4823-aacf-2efc0af37336 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:18.965358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d667d7bc-1122-4823-aacf-2efc0af37336 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:18.965805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d667d7bc-1122-4823-aacf-2efc0af37336 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:19.095151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d667d7bc-1122-4823-aacf-2efc0af37336 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:19.103388 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d667d7bc-1122-4823-aacf-2efc0af37336 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.152733 Oct 11 20:42:19.103963 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3343/6734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:18 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:20.126996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cfab4ac9-103d-4c63-b3bc-14df9c4682f6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:20.127609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cfab4ac9-103d-4c63-b3bc-14df9c4682f6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:20.134987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfab4ac9-103d-4c63-b3bc-14df9c4682f6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:20.135470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfab4ac9-103d-4c63-b3bc-14df9c4682f6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:20.135905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfab4ac9-103d-4c63-b3bc-14df9c4682f6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:20.136585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfab4ac9-103d-4c63-b3bc-14df9c4682f6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:20.137038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfab4ac9-103d-4c63-b3bc-14df9c4682f6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:20.137458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cfab4ac9-103d-4c63-b3bc-14df9c4682f6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:20.272236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cfab4ac9-103d-4c63-b3bc-14df9c4682f6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:20.280550 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cfab4ac9-103d-4c63-b3bc-14df9c4682f6 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.158428 Oct 11 20:42:20.281334 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3392/6735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:20 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:21.304622 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-adf19a9e-9504-49c7-811d-9a375d08d8d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:21.305255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-adf19a9e-9504-49c7-811d-9a375d08d8d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:21.312924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adf19a9e-9504-49c7-811d-9a375d08d8d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:21.313428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adf19a9e-9504-49c7-811d-9a375d08d8d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:21.313887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adf19a9e-9504-49c7-811d-9a375d08d8d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:21.314617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adf19a9e-9504-49c7-811d-9a375d08d8d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:21.315098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adf19a9e-9504-49c7-811d-9a375d08d8d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:21.315541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-adf19a9e-9504-49c7-811d-9a375d08d8d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:21.442509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-adf19a9e-9504-49c7-811d-9a375d08d8d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:21.451430 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-adf19a9e-9504-49c7-811d-9a375d08d8d7 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1721 microversion: 2.1 time: 0.150768 Oct 11 20:42:21.452297 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3344/6736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:21 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:22.475230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6240d198-6243-485d-b7d5-0d6c0d36b331 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:22.475849 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6240d198-6243-485d-b7d5-0d6c0d36b331 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:22.483283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6240d198-6243-485d-b7d5-0d6c0d36b331 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:22.483773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6240d198-6243-485d-b7d5-0d6c0d36b331 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:22.484559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6240d198-6243-485d-b7d5-0d6c0d36b331 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:22.485273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6240d198-6243-485d-b7d5-0d6c0d36b331 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:22.485737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6240d198-6243-485d-b7d5-0d6c0d36b331 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:22.486165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6240d198-6243-485d-b7d5-0d6c0d36b331 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:22.618175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6240d198-6243-485d-b7d5-0d6c0d36b331 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:22.627650 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6240d198-6243-485d-b7d5-0d6c0d36b331 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1714 microversion: 2.1 time: 0.156360 Oct 11 20:42:22.628223 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3393/6737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:22 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:22.650900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a95c66d9-c9ad-45c0-94c9-b02f8ede579a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:22.651522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a95c66d9-c9ad-45c0-94c9-b02f8ede579a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:22.658605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95c66d9-c9ad-45c0-94c9-b02f8ede579a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:22.659103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95c66d9-c9ad-45c0-94c9-b02f8ede579a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:22.659548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95c66d9-c9ad-45c0-94c9-b02f8ede579a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:22.660244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95c66d9-c9ad-45c0-94c9-b02f8ede579a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:22.660745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95c66d9-c9ad-45c0-94c9-b02f8ede579a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:22.661180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a95c66d9-c9ad-45c0-94c9-b02f8ede579a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:22.795853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a95c66d9-c9ad-45c0-94c9-b02f8ede579a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:22.804523 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a95c66d9-c9ad-45c0-94c9-b02f8ede579a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1714 microversion: 2.1 time: 0.157589 Oct 11 20:42:22.805108 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3345/6738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:22 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:22.827328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d217bc6e-ff09-43b2-8ecc-143753d3651b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:22.827943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d217bc6e-ff09-43b2-8ecc-143753d3651b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:22.833842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d217bc6e-ff09-43b2-8ecc-143753d3651b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:22.834326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d217bc6e-ff09-43b2-8ecc-143753d3651b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:22.834792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d217bc6e-ff09-43b2-8ecc-143753d3651b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:22.835483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d217bc6e-ff09-43b2-8ecc-143753d3651b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:22.835940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d217bc6e-ff09-43b2-8ecc-143753d3651b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:22.836365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d217bc6e-ff09-43b2-8ecc-143753d3651b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:22.851509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:22.971468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d217bc6e-ff09-43b2-8ecc-143753d3651b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:22.979623 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d217bc6e-ff09-43b2-8ecc-143753d3651b tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1714 microversion: 2.1 time: 0.156607 Oct 11 20:42:22.980194 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3394/6739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:22 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:23.003264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c0af0165-4598-40fc-9221-ce53ae5e6809 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:23.003710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c0af0165-4598-40fc-9221-ce53ae5e6809 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:23.009727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0af0165-4598-40fc-9221-ce53ae5e6809 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:23.010228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0af0165-4598-40fc-9221-ce53ae5e6809 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:23.010708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0af0165-4598-40fc-9221-ce53ae5e6809 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:23.011415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0af0165-4598-40fc-9221-ce53ae5e6809 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:23.011887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0af0165-4598-40fc-9221-ce53ae5e6809 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:23.012338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c0af0165-4598-40fc-9221-ce53ae5e6809 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:23.037148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c0af0165-4598-40fc-9221-ce53ae5e6809 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:42:23.115673 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c0af0165-4598-40fc-9221-ce53ae5e6809 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 204 len: 0 microversion: 2.1 time: 0.116112 Oct 11 20:42:23.116455 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3346/6740] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:42:22 2022] DELETE /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:42:23.126746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4481ec0b-5877-4698-a13b-a5dea88c1cdc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:23.127353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4481ec0b-5877-4698-a13b-a5dea88c1cdc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:23.133242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4481ec0b-5877-4698-a13b-a5dea88c1cdc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:23.133717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4481ec0b-5877-4698-a13b-a5dea88c1cdc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:23.134145 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4481ec0b-5877-4698-a13b-a5dea88c1cdc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:23.134925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4481ec0b-5877-4698-a13b-a5dea88c1cdc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:23.135376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4481ec0b-5877-4698-a13b-a5dea88c1cdc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:23.135795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4481ec0b-5877-4698-a13b-a5dea88c1cdc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:23.270272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4481ec0b-5877-4698-a13b-a5dea88c1cdc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:23.278897 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4481ec0b-5877-4698-a13b-a5dea88c1cdc tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1720 microversion: 2.1 time: 0.157686 Oct 11 20:42:23.279249 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3395/6741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:23 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:24.303774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2c06f6e2-2164-44a5-bef5-9b00a3315cbe tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:24.304492 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2c06f6e2-2164-44a5-bef5-9b00a3315cbe tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:24.311912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c06f6e2-2164-44a5-bef5-9b00a3315cbe tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:24.312414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c06f6e2-2164-44a5-bef5-9b00a3315cbe tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:24.312869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c06f6e2-2164-44a5-bef5-9b00a3315cbe tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:24.313565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c06f6e2-2164-44a5-bef5-9b00a3315cbe tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:24.314035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c06f6e2-2164-44a5-bef5-9b00a3315cbe tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:24.314481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c06f6e2-2164-44a5-bef5-9b00a3315cbe tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:24.450482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2c06f6e2-2164-44a5-bef5-9b00a3315cbe tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:24.459427 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2c06f6e2-2164-44a5-bef5-9b00a3315cbe tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1720 microversion: 2.1 time: 0.159920 Oct 11 20:42:24.460009 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3347/6742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:24 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:25.475539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-89b2169f-aceb-48e8-8a57-9c7374770cad req-a348ca29-1c82-4b23-95fb-f356f0e3deca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4abf728-d926-4136-aab3-dcedc931e636", "name": "network-vif-deleted", "tag": "e25bbf63-cb2e-4056-ae12-6a7c8e354426"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:42:25.486471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8bd8a158-c0c2-42c3-97ad-83ad207ee8b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:25.487976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8bd8a158-c0c2-42c3-97ad-83ad207ee8b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:25.494875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bd8a158-c0c2-42c3-97ad-83ad207ee8b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:25.495479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bd8a158-c0c2-42c3-97ad-83ad207ee8b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:25.495964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-89b2169f-aceb-48e8-8a57-9c7374770cad req-a348ca29-1c82-4b23-95fb-f356f0e3deca service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:25.496160 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bd8a158-c0c2-42c3-97ad-83ad207ee8b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:25.497044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bd8a158-c0c2-42c3-97ad-83ad207ee8b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:25.498150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-89b2169f-aceb-48e8-8a57-9c7374770cad req-a348ca29-1c82-4b23-95fb-f356f0e3deca service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:25.498327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bd8a158-c0c2-42c3-97ad-83ad207ee8b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:25.498954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8bd8a158-c0c2-42c3-97ad-83ad207ee8b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:25.499085 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-89b2169f-aceb-48e8-8a57-9c7374770cad req-a348ca29-1c82-4b23-95fb-f356f0e3deca service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:25.514694 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-89b2169f-aceb-48e8-8a57-9c7374770cad req-a348ca29-1c82-4b23-95fb-f356f0e3deca service nova] Creating event network-vif-deleted:e25bbf63-cb2e-4056-ae12-6a7c8e354426 for instance c4abf728-d926-4136-aab3-dcedc931e636 on n-h1-860864-3 Oct 11 20:42:25.517733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:25.520850 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-89b2169f-aceb-48e8-8a57-9c7374770cad req-a348ca29-1c82-4b23-95fb-f356f0e3deca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049000 Oct 11 20:42:25.522181 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3396/6743] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:42:25.578686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8bd8a158-c0c2-42c3-97ad-83ad207ee8b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:25.588194 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8bd8a158-c0c2-42c3-97ad-83ad207ee8b9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1652 microversion: 2.1 time: 0.106526 Oct 11 20:42:25.589025 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3348/6744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:25 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1652 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:42:26.614250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c0ee0a8-f89b-4bd0-9032-feb85cdcc11a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:26.614928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4c0ee0a8-f89b-4bd0-9032-feb85cdcc11a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:26.621297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c0ee0a8-f89b-4bd0-9032-feb85cdcc11a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:26.621740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c0ee0a8-f89b-4bd0-9032-feb85cdcc11a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:26.622178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c0ee0a8-f89b-4bd0-9032-feb85cdcc11a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:26.623453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c0ee0a8-f89b-4bd0-9032-feb85cdcc11a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:26.623942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c0ee0a8-f89b-4bd0-9032-feb85cdcc11a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:26.624490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c0ee0a8-f89b-4bd0-9032-feb85cdcc11a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:26.693943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4c0ee0a8-f89b-4bd0-9032-feb85cdcc11a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:26.703550 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4c0ee0a8-f89b-4bd0-9032-feb85cdcc11a tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1369 microversion: 2.1 time: 0.094710 Oct 11 20:42:26.704118 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3397/6745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:26 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:27.727357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a66a4a45-08d9-4f9f-b775-646f35cb801e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:27.727976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a66a4a45-08d9-4f9f-b775-646f35cb801e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:27.737674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a66a4a45-08d9-4f9f-b775-646f35cb801e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:27.738175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a66a4a45-08d9-4f9f-b775-646f35cb801e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:27.738655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a66a4a45-08d9-4f9f-b775-646f35cb801e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:27.739366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a66a4a45-08d9-4f9f-b775-646f35cb801e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:27.739835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a66a4a45-08d9-4f9f-b775-646f35cb801e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:27.740270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a66a4a45-08d9-4f9f-b775-646f35cb801e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:27.806367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a66a4a45-08d9-4f9f-b775-646f35cb801e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:27.815761 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a66a4a45-08d9-4f9f-b775-646f35cb801e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1369 microversion: 2.1 time: 0.092288 Oct 11 20:42:27.816392 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3349/6746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:27 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:28.844115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c750e7fc-a7fd-46d1-91fd-9fb13e34ddc9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:28.844683 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c750e7fc-a7fd-46d1-91fd-9fb13e34ddc9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:28.847808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:28.853118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c750e7fc-a7fd-46d1-91fd-9fb13e34ddc9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:28.853604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c750e7fc-a7fd-46d1-91fd-9fb13e34ddc9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:28.854049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c750e7fc-a7fd-46d1-91fd-9fb13e34ddc9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:28.854783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c750e7fc-a7fd-46d1-91fd-9fb13e34ddc9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:28.855238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c750e7fc-a7fd-46d1-91fd-9fb13e34ddc9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:28.855664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c750e7fc-a7fd-46d1-91fd-9fb13e34ddc9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:28.924220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c750e7fc-a7fd-46d1-91fd-9fb13e34ddc9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e7db2ab50d458583122a6bbba08426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52c54fe81544f05bb58bc292d2f1401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:28.932548 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c750e7fc-a7fd-46d1-91fd-9fb13e34ddc9 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 200 len: 1369 microversion: 2.1 time: 0.093097 Oct 11 20:42:28.933118 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3398/6747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:28 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:29.957109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:29.957733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:29.960596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:29.966994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:29.967155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:29.967639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:29.968394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:29.968868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:29.969309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:29.983004 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 HTTP/1.1 Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'c4abf728-d926-4136-aab3-dcedc931e636'} Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:29.984673 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:29.989381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:29.989381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:29.989381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:29.989381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:42:29.989381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:42:29.989381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:29.989381 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:29.989381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:42:29.989381 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-df66fac4-c0a3-42cb-8779-62e6a3a79bfd tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 404 len: 111 microversion: 2.1 time: 0.032940 Oct 11 20:42:29.989381 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3350/6748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:29 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:42:30.048309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:30.050492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:30.057502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:30.057995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:30.058434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:30.059163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:30.059623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:30.060609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:30.073340 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/os-volume_attachments HTTP/1.1 Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': 'c4abf728-d926-4136-aab3-dcedc931e636'} Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:42:30.075070 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ab2f929b-0a7d-4cd8-89fa-e63ff7a02d09 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033959 Oct 11 20:42:30.080044 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3399/6749] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:42:30 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:42:33.399219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:33.399760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:33.406816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.407313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.407765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.408459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.408926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.409555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.424326 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 HTTP/1.1 Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'c4abf728-d926-4136-aab3-dcedc931e636'} Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:42:33.425863 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cdae0474-d647-4bb5-8db3-1c19d204f029 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 404 len: 111 microversion: 2.1 time: 0.031965 Oct 11 20:42:33.430723 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3351/6750] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:42:33 2022] DELETE /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:42:33.436368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:33.436990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: c4abf728-d926-4136-aab3-dcedc931e636] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:33.444205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.444710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.445159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.445892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.446357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.446818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.463076 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 HTTP/1.1 Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': 'c4abf728-d926-4136-aab3-dcedc931e636'} Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.464699 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.471043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.471043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.471043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.471043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:42:33.471043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:42:33.471043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. Oct 11 20:42:33.471043 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.471043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance c4abf728-d926-4136-aab3-dcedc931e636 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:42:33.471043 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9951d15c-1f63-4c64-a12f-e6958fd0ef2c tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636" status: 404 len: 111 microversion: 2.1 time: 0.034196 Oct 11 20:42:33.471043 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3400/6751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:33 2022] GET /compute/v2.1/servers/c4abf728-d926-4136-aab3-dcedc931e636 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:42:33.476858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:33.477473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:33.484273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.484867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.485386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.486168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.486763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.487269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.514899 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 HTTP/1.1 Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '58e608cd-9001-47f3-9469-8c156c9dc5b3'} Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:42:33.516534 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2b22f7b2-dbfb-4db8-8068-3e70a571d839 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 404 len: 111 microversion: 2.1 time: 0.045192 Oct 11 20:42:33.520466 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3352/6752] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:42:33 2022] DELETE /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:42:33.527459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:33.528088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 58e608cd-9001-47f3-9469-8c156c9dc5b3] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:33.534132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.534666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.535231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.535932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.536394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.536825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.550462 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 HTTP/1.1 Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '58e608cd-9001-47f3-9469-8c156c9dc5b3'} Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.552025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.556426 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.556426 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.556426 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.556426 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:42:33.556426 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:42:33.556426 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. Oct 11 20:42:33.556426 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.556426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 58e608cd-9001-47f3-9469-8c156c9dc5b3 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:42:33.556426 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c095612e-231c-4133-8368-585051bd70d5 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3" status: 404 len: 111 microversion: 2.1 time: 0.030060 Oct 11 20:42:33.556426 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3401/6753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:33 2022] GET /compute/v2.1/servers/58e608cd-9001-47f3-9469-8c156c9dc5b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:42:33.562999 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:33.563519 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:33.569434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.569935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.570390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.571147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.571619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.572060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.586579 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 HTTP/1.1 Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '44c81b5d-84c7-408f-9233-e4c87866e401'} Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:42:33.588152 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aece805e-7c8f-488e-bc0a-8ff58ea957b0 tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "DELETE /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 404 len: 111 microversion: 2.1 time: 0.031327 Oct 11 20:42:33.592212 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3353/6754] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:42:33 2022] DELETE /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:42:33.598361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:33.599007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 44c81b5d-84c7-408f-9233-e4c87866e401] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:33.605163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.605652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.606091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.607576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.608041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.608473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.622421 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 HTTP/1.1 Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '44c81b5d-84c7-408f-9233-e4c87866e401'} Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.624225 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.631914 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.631914 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.631914 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.631914 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:42:33.631914 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:42:33.631914 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. Oct 11 20:42:33.631914 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.631914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 44c81b5d-84c7-408f-9233-e4c87866e401 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:42:33.631914 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6ffe8dbe-f42f-416d-a25e-de26028fb48e tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401" status: 404 len: 111 microversion: 2.1 time: 0.031109 Oct 11 20:42:33.631914 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3402/6755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:33 2022] GET /compute/v2.1/servers/44c81b5d-84c7-408f-9233-e4c87866e401 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:42:33.634157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:33.634707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:33.641479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.641988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.642453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.643206 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.643683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.644129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.658147 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 HTTP/1.1 Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '94404510-de6c-4111-9f62-1903df7d2aa9'} Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:42:33.659767 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b415499c-e5d5-4dc2-bc1d-a35f8f5192ea tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "DELETE /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 404 len: 111 microversion: 2.1 time: 0.030875 Oct 11 20:42:33.663780 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3354/6756] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:42:33 2022] DELETE /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 20:42:33.670790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:33.671627 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] [instance: 94404510-de6c-4111-9f62-1903df7d2aa9] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:33.677686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.678272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.678822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.679595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:33.680129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:33.680631 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:33.694564 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] HTTP exception thrown: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Request method failure captured: Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 HTTP/1.1 Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdPhm2YhHIFpqJbwYADOmqNcr8YJXP4LJQl7FNALLIQ6ZZisjDpCmrezkU9uvEkSdVHcCx11iYMwLuNvjAiWWgHTEXMgTU-vTN6w2F_kHa4xEbwiuV60xPvFHvJIxXIE7xubflW7jPRasN_Mt9Hoy3FCikzjQT7ieGxcQnvS7vJXsiQ Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b52c54fe81544f05bb58bc292d2f1401", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b52c54fe81544f05bb58bc292d2f1401"}]}] Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: b52c54fe81544f05bb58bc292d2f1401 Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServerActionsTestJSON-1245294876 Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 12e7db2ab50d458583122a6bbba08426 Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServerActionsTestJSON-1245294876-project Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '94404510-de6c-4111-9f62-1903df7d2aa9'} Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:42:33.696264 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.701253 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:42:33.701253 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:42:33.701253 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:42:33.701253 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:42:33.701253 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:42:33.701253 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. Oct 11 20:42:33.701253 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:42:33.701253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Returning 404 to user: Instance 94404510-de6c-4111-9f62-1903df7d2aa9 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:42:33.701253 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6d4be2e-90b9-4d21-a22b-547b68cd69aa tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9" status: 404 len: 111 microversion: 2.1 time: 0.031422 Oct 11 20:42:33.702496 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3403/6757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:33 2022] GET /compute/v2.1/servers/94404510-de6c-4111-9f62-1903df7d2aa9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:42:33.707458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-72d81300-eb38-4575-9e85-adb373698c2d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] Calling method '.version_select at 0x7f83c72c2700>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:33.731842 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-72d81300-eb38-4575-9e85-adb373698c2d tempest-ServerActionsTestJSON-1245294876 tempest-ServerActionsTestJSON-1245294876-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593808265" status: 202 len: 0 microversion: 2.1 time: 0.028064 Oct 11 20:42:33.732515 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3355/6758] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 11 20:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593808265 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:42:43.353834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089374206", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "6fa9e50d-e2ab-486b-9820-c94d9a720151"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:42:43.410391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] validate_networks() for [('6fa9e50d-e2ab-486b-9820-c94d9a720151', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:42:43.685812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=33 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:43.885472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:42:43.885892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:42:43.886364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:42:43.886794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:42:43.887211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:42:43.899261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:43.899749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:43.900183 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:43.900907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:43.901371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:43.901786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:43.919032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Getting quotas for project 96f386f43b854c19881a9f3bfe380cea. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:42:43.924472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Getting quotas for user 0d0859d6c7034d29bd052a501f7c8331 and project 96f386f43b854c19881a9f3bfe380cea. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:42:43.937817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:42:43.940198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:42:43.985389 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-241c4fcb-2192-406a-9d51-794b8907b4b3 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747650 Oct 11 20:42:43.986011 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3404/6759] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:42:43.995159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=19 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:43.995853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:44.000446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fd344f51-2d3b-47e2-a4da-ac41bcbbbd15 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:44.001089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fd344f51-2d3b-47e2-a4da-ac41bcbbbd15 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:44.061871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fd344f51-2d3b-47e2-a4da-ac41bcbbbd15 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:44.071502 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fd344f51-2d3b-47e2-a4da-ac41bcbbbd15 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1217 microversion: 2.1 time: 0.078267 Oct 11 20:42:44.083240 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3356/6760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:43 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:42:45.096822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd2adbfd-d198-469b-8e46-7a3ce58b6245 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:45.098038 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bd2adbfd-d198-469b-8e46-7a3ce58b6245 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:45.104471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2adbfd-d198-469b-8e46-7a3ce58b6245 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:45.104976 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2adbfd-d198-469b-8e46-7a3ce58b6245 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:45.105412 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2adbfd-d198-469b-8e46-7a3ce58b6245 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:45.106863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2adbfd-d198-469b-8e46-7a3ce58b6245 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:45.108002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2adbfd-d198-469b-8e46-7a3ce58b6245 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:45.108605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2adbfd-d198-469b-8e46-7a3ce58b6245 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:45.219365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bd2adbfd-d198-469b-8e46-7a3ce58b6245 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:45.228488 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bd2adbfd-d198-469b-8e46-7a3ce58b6245 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1287 microversion: 2.1 time: 0.136453 Oct 11 20:42:45.229172 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3405/6761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:45 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:46.253983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca9525c7-7714-4f53-b759-225588639571 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:46.254639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca9525c7-7714-4f53-b759-225588639571 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:46.261810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9525c7-7714-4f53-b759-225588639571 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:46.263003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9525c7-7714-4f53-b759-225588639571 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:46.263484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9525c7-7714-4f53-b759-225588639571 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:46.264212 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9525c7-7714-4f53-b759-225588639571 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:46.264745 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9525c7-7714-4f53-b759-225588639571 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:46.265172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca9525c7-7714-4f53-b759-225588639571 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:46.475602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca9525c7-7714-4f53-b759-225588639571 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:46.483988 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca9525c7-7714-4f53-b759-225588639571 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1317 microversion: 2.1 time: 0.234015 Oct 11 20:42:46.484582 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3357/6762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:46 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:46.583337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-45cab3e3-8602-40bf-95df-c1755e52907c req-78d18720-6973-4951-8d21-6c9f01264dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092b121d-2947-466a-b603-74a8d23c0f9e", "tag": "e2561438-36fb-44b3-9049-c8fb26f26772"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:42:46.599186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-45cab3e3-8602-40bf-95df-c1755e52907c req-78d18720-6973-4951-8d21-6c9f01264dd0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:46.599679 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-45cab3e3-8602-40bf-95df-c1755e52907c req-78d18720-6973-4951-8d21-6c9f01264dd0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:46.600123 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-45cab3e3-8602-40bf-95df-c1755e52907c req-78d18720-6973-4951-8d21-6c9f01264dd0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:46.616164 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-45cab3e3-8602-40bf-95df-c1755e52907c req-78d18720-6973-4951-8d21-6c9f01264dd0 service nova] Creating event network-changed:e2561438-36fb-44b3-9049-c8fb26f26772 for instance 092b121d-2947-466a-b603-74a8d23c0f9e on n-h2-860864-3 Oct 11 20:42:46.624491 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-45cab3e3-8602-40bf-95df-c1755e52907c req-78d18720-6973-4951-8d21-6c9f01264dd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044661 Oct 11 20:42:46.625723 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3406/6763] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:42:47.508607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32178378-0820-4362-9017-ad456251fb6d tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:47.509232 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-32178378-0820-4362-9017-ad456251fb6d tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:47.516773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32178378-0820-4362-9017-ad456251fb6d tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:47.517268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32178378-0820-4362-9017-ad456251fb6d tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:47.517715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32178378-0820-4362-9017-ad456251fb6d tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:47.518414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32178378-0820-4362-9017-ad456251fb6d tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:47.518962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32178378-0820-4362-9017-ad456251fb6d tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:47.519400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32178378-0820-4362-9017-ad456251fb6d tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:47.660354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-32178378-0820-4362-9017-ad456251fb6d tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:47.668066 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-32178378-0820-4362-9017-ad456251fb6d tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1317 microversion: 2.1 time: 0.163456 Oct 11 20:42:47.668666 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3358/6764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:47 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:48.693309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7f6242a7-2016-4286-9f9e-bb6903337787 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:48.694012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7f6242a7-2016-4286-9f9e-bb6903337787 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:48.700179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f6242a7-2016-4286-9f9e-bb6903337787 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:48.700691 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f6242a7-2016-4286-9f9e-bb6903337787 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:48.701301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f6242a7-2016-4286-9f9e-bb6903337787 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:48.702261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f6242a7-2016-4286-9f9e-bb6903337787 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:48.702750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f6242a7-2016-4286-9f9e-bb6903337787 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:48.703282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f6242a7-2016-4286-9f9e-bb6903337787 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:48.833426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7f6242a7-2016-4286-9f9e-bb6903337787 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:48.842236 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7f6242a7-2016-4286-9f9e-bb6903337787 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1317 microversion: 2.1 time: 0.153081 Oct 11 20:42:48.842860 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3407/6765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:48 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:49.865338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-738ef090-7dd8-4e49-9ea7-eed3237496de tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:49.866075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-738ef090-7dd8-4e49-9ea7-eed3237496de tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:49.874921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-738ef090-7dd8-4e49-9ea7-eed3237496de tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:49.875418 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-738ef090-7dd8-4e49-9ea7-eed3237496de tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:49.875878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-738ef090-7dd8-4e49-9ea7-eed3237496de tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:49.876605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-738ef090-7dd8-4e49-9ea7-eed3237496de tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:49.877124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-738ef090-7dd8-4e49-9ea7-eed3237496de tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:49.877551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-738ef090-7dd8-4e49-9ea7-eed3237496de tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:50.007795 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-738ef090-7dd8-4e49-9ea7-eed3237496de tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:50.016624 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-738ef090-7dd8-4e49-9ea7-eed3237496de tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1317 microversion: 2.1 time: 0.155187 Oct 11 20:42:50.017208 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3359/6766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:49 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:51.040271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-50ec0334-a844-4bdd-adec-c5f7ee553877 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:51.040897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-50ec0334-a844-4bdd-adec-c5f7ee553877 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:51.048383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ec0334-a844-4bdd-adec-c5f7ee553877 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:51.048875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ec0334-a844-4bdd-adec-c5f7ee553877 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:51.049317 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ec0334-a844-4bdd-adec-c5f7ee553877 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:51.050010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ec0334-a844-4bdd-adec-c5f7ee553877 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:51.050472 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ec0334-a844-4bdd-adec-c5f7ee553877 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:51.050939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-50ec0334-a844-4bdd-adec-c5f7ee553877 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:51.181867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-50ec0334-a844-4bdd-adec-c5f7ee553877 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:51.190211 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-50ec0334-a844-4bdd-adec-c5f7ee553877 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1317 microversion: 2.1 time: 0.153889 Oct 11 20:42:51.190814 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3408/6767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:51 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:51.700874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-994ad6c3-f534-4ee2-9846-5664b7adfa59 req-eb4cff7c-614e-41f7-9182-66a8b9adbcda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092b121d-2947-466a-b603-74a8d23c0f9e", "name": "network-vif-plugged", "status": "completed", "tag": "e2561438-36fb-44b3-9049-c8fb26f26772"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:42:51.711693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-994ad6c3-f534-4ee2-9846-5664b7adfa59 req-eb4cff7c-614e-41f7-9182-66a8b9adbcda service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:51.712228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-994ad6c3-f534-4ee2-9846-5664b7adfa59 req-eb4cff7c-614e-41f7-9182-66a8b9adbcda service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:51.712705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-994ad6c3-f534-4ee2-9846-5664b7adfa59 req-eb4cff7c-614e-41f7-9182-66a8b9adbcda service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:51.724338 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-994ad6c3-f534-4ee2-9846-5664b7adfa59 req-eb4cff7c-614e-41f7-9182-66a8b9adbcda service nova] Creating event network-vif-plugged:e2561438-36fb-44b3-9049-c8fb26f26772 for instance 092b121d-2947-466a-b603-74a8d23c0f9e on n-h2-860864-3 Oct 11 20:42:51.729418 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-994ad6c3-f534-4ee2-9846-5664b7adfa59 req-eb4cff7c-614e-41f7-9182-66a8b9adbcda service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032270 Oct 11 20:42:51.730094 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3360/6768] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:42:52.213398 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bf11ded0-e7e4-4601-b122-e051cf416e60 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:52.214016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bf11ded0-e7e4-4601-b122-e051cf416e60 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:52.222220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf11ded0-e7e4-4601-b122-e051cf416e60 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:52.222750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf11ded0-e7e4-4601-b122-e051cf416e60 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:52.223192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf11ded0-e7e4-4601-b122-e051cf416e60 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:52.223884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf11ded0-e7e4-4601-b122-e051cf416e60 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:52.224563 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf11ded0-e7e4-4601-b122-e051cf416e60 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:52.224996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf11ded0-e7e4-4601-b122-e051cf416e60 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:52.356751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bf11ded0-e7e4-4601-b122-e051cf416e60 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:52.364314 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bf11ded0-e7e4-4601-b122-e051cf416e60 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1317 microversion: 2.1 time: 0.154993 Oct 11 20:42:52.364887 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3409/6769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:52 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:53.389014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-058cf325-e9af-4397-b12a-7ef820cef25b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:53.389724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-058cf325-e9af-4397-b12a-7ef820cef25b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:53.396479 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-058cf325-e9af-4397-b12a-7ef820cef25b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:53.396976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-058cf325-e9af-4397-b12a-7ef820cef25b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:53.397419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-058cf325-e9af-4397-b12a-7ef820cef25b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:53.398149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-058cf325-e9af-4397-b12a-7ef820cef25b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:53.398638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-058cf325-e9af-4397-b12a-7ef820cef25b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:53.399076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-058cf325-e9af-4397-b12a-7ef820cef25b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:53.527886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-058cf325-e9af-4397-b12a-7ef820cef25b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:53.536091 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-058cf325-e9af-4397-b12a-7ef820cef25b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1506 microversion: 2.1 time: 0.152189 Oct 11 20:42:53.536677 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3361/6770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:53 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:53.596830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-960762539", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "6fa9e50d-e2ab-486b-9820-c94d9a720151"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:42:53.649436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] validate_networks() for [('6fa9e50d-e2ab-486b-9820-c94d9a720151', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:42:53.909715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:53.931516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:54.018197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:42:54.018649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:42:54.019121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:42:54.019536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:42:54.019945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:42:54.028980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:54.029464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:54.029897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:54.030643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:54.031100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:54.032025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:54.048550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Getting quotas for project 96f386f43b854c19881a9f3bfe380cea. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:42:54.053721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Getting quotas for user 0d0859d6c7034d29bd052a501f7c8331 and project 96f386f43b854c19881a9f3bfe380cea. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:42:54.066444 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:42:54.068775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:42:54.114141 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7d44fdb7-55c1-4743-b340-dfdd028af4e5 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521071 Oct 11 20:42:54.114843 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3410/6771] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:42:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:42:54.126893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a9ba42d8-5e63-4e50-aa0f-117cb5846475 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:54.127511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a9ba42d8-5e63-4e50-aa0f-117cb5846475 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:54.129687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:42:54.182778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a9ba42d8-5e63-4e50-aa0f-117cb5846475 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:54.190008 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a9ba42d8-5e63-4e50-aa0f-117cb5846475 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1216 microversion: 2.1 time: 0.067771 Oct 11 20:42:54.190618 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3362/6772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:54 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:55.214250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-796b1369-9c8d-48df-833a-23e136896292 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:55.216192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-796b1369-9c8d-48df-833a-23e136896292 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:55.227865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-796b1369-9c8d-48df-833a-23e136896292 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:55.228615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-796b1369-9c8d-48df-833a-23e136896292 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:55.229174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-796b1369-9c8d-48df-833a-23e136896292 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:55.229962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-796b1369-9c8d-48df-833a-23e136896292 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:55.231019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-796b1369-9c8d-48df-833a-23e136896292 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:55.232092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-796b1369-9c8d-48df-833a-23e136896292 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:55.325144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-796b1369-9c8d-48df-833a-23e136896292 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:55.333810 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-796b1369-9c8d-48df-833a-23e136896292 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1274 microversion: 2.1 time: 0.124361 Oct 11 20:42:55.334427 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3411/6773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:55 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:56.357355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bab58469-9378-436d-a91d-1af04d299ba0 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:56.357977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bab58469-9378-436d-a91d-1af04d299ba0 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:56.366165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bab58469-9378-436d-a91d-1af04d299ba0 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:56.366696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bab58469-9378-436d-a91d-1af04d299ba0 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:56.367149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bab58469-9378-436d-a91d-1af04d299ba0 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:56.367854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bab58469-9378-436d-a91d-1af04d299ba0 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:56.368321 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bab58469-9378-436d-a91d-1af04d299ba0 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:56.368754 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bab58469-9378-436d-a91d-1af04d299ba0 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:56.564150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-12b3dd04-c827-44f2-8ee2-240b85769a43 req-1d53153e-2115-4cb6-aade-139b4743719c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da872db-1432-4eed-8990-9ba1baa69985", "tag": "fc105139-60fd-4c5b-a9d7-ae7f1279b4be"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:42:56.576474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-12b3dd04-c827-44f2-8ee2-240b85769a43 req-1d53153e-2115-4cb6-aade-139b4743719c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:56.577393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-12b3dd04-c827-44f2-8ee2-240b85769a43 req-1d53153e-2115-4cb6-aade-139b4743719c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:56.577827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-12b3dd04-c827-44f2-8ee2-240b85769a43 req-1d53153e-2115-4cb6-aade-139b4743719c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:56.582775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bab58469-9378-436d-a91d-1af04d299ba0 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:56.592984 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-12b3dd04-c827-44f2-8ee2-240b85769a43 req-1d53153e-2115-4cb6-aade-139b4743719c service nova] Creating event network-changed:fc105139-60fd-4c5b-a9d7-ae7f1279b4be for instance 1da872db-1432-4eed-8990-9ba1baa69985 on n-h1-860864-3 Oct 11 20:42:56.598880 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bab58469-9378-436d-a91d-1af04d299ba0 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1316 microversion: 2.1 time: 0.245365 Oct 11 20:42:56.599078 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-12b3dd04-c827-44f2-8ee2-240b85769a43 req-1d53153e-2115-4cb6-aade-139b4743719c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039393 Oct 11 20:42:56.600034 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3412/6774] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:42:56.603446 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3363/6775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:56 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:57.621834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c6c052b8-2b30-47a5-8d73-5195b7e11404 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:57.622661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c6c052b8-2b30-47a5-8d73-5195b7e11404 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:57.630470 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6c052b8-2b30-47a5-8d73-5195b7e11404 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:57.630922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6c052b8-2b30-47a5-8d73-5195b7e11404 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:57.631359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6c052b8-2b30-47a5-8d73-5195b7e11404 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:57.632043 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6c052b8-2b30-47a5-8d73-5195b7e11404 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:57.632500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6c052b8-2b30-47a5-8d73-5195b7e11404 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:57.632918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c6c052b8-2b30-47a5-8d73-5195b7e11404 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:57.828666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c6c052b8-2b30-47a5-8d73-5195b7e11404 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:57.837461 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c6c052b8-2b30-47a5-8d73-5195b7e11404 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1316 microversion: 2.1 time: 0.219809 Oct 11 20:42:57.838046 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3413/6776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:57 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:42:58.861811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5ac05ac8-521c-4ad7-90df-802195514658 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:42:58.862448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5ac05ac8-521c-4ad7-90df-802195514658 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:42:58.869362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac05ac8-521c-4ad7-90df-802195514658 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:58.869886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac05ac8-521c-4ad7-90df-802195514658 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:58.870336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac05ac8-521c-4ad7-90df-802195514658 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:58.871054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac05ac8-521c-4ad7-90df-802195514658 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:42:58.871523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac05ac8-521c-4ad7-90df-802195514658 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:42:58.871957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ac05ac8-521c-4ad7-90df-802195514658 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:42:59.001710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5ac05ac8-521c-4ad7-90df-802195514658 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:42:59.009481 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5ac05ac8-521c-4ad7-90df-802195514658 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1316 microversion: 2.1 time: 0.153022 Oct 11 20:42:59.010059 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3364/6777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:42:58 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:00.033138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6ba10de-74df-4930-ba62-ad24f930125b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:00.033689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6ba10de-74df-4930-ba62-ad24f930125b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:00.036497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:00.041953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ba10de-74df-4930-ba62-ad24f930125b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:00.042445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ba10de-74df-4930-ba62-ad24f930125b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:00.042916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ba10de-74df-4930-ba62-ad24f930125b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:00.043611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ba10de-74df-4930-ba62-ad24f930125b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:00.044072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ba10de-74df-4930-ba62-ad24f930125b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:00.044502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6ba10de-74df-4930-ba62-ad24f930125b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:00.176737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f6ba10de-74df-4930-ba62-ad24f930125b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:00.184420 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6ba10de-74df-4930-ba62-ad24f930125b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1316 microversion: 2.1 time: 0.155548 Oct 11 20:43:00.184991 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3414/6778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:00 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:01.208505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7380e303-fd4f-46bf-b5bd-1296683171b9 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:01.209187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7380e303-fd4f-46bf-b5bd-1296683171b9 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:01.216163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7380e303-fd4f-46bf-b5bd-1296683171b9 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:01.216658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7380e303-fd4f-46bf-b5bd-1296683171b9 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:01.217104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7380e303-fd4f-46bf-b5bd-1296683171b9 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:01.217799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7380e303-fd4f-46bf-b5bd-1296683171b9 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:01.218266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7380e303-fd4f-46bf-b5bd-1296683171b9 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:01.219520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7380e303-fd4f-46bf-b5bd-1296683171b9 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:01.349806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7380e303-fd4f-46bf-b5bd-1296683171b9 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:01.359262 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7380e303-fd4f-46bf-b5bd-1296683171b9 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1316 microversion: 2.1 time: 0.154694 Oct 11 20:43:01.359941 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3365/6779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:01 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:01.508376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2850d984-a2b9-4576-a885-85118fcb8d4d req-c0c7ebb5-8275-4d0b-be96-ab4b1db52e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da872db-1432-4eed-8990-9ba1baa69985", "name": "network-vif-plugged", "status": "completed", "tag": "fc105139-60fd-4c5b-a9d7-ae7f1279b4be"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:01.519996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2850d984-a2b9-4576-a885-85118fcb8d4d req-c0c7ebb5-8275-4d0b-be96-ab4b1db52e3d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:01.520497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2850d984-a2b9-4576-a885-85118fcb8d4d req-c0c7ebb5-8275-4d0b-be96-ab4b1db52e3d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:01.520927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2850d984-a2b9-4576-a885-85118fcb8d4d req-c0c7ebb5-8275-4d0b-be96-ab4b1db52e3d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:01.532297 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2850d984-a2b9-4576-a885-85118fcb8d4d req-c0c7ebb5-8275-4d0b-be96-ab4b1db52e3d service nova] Creating event network-vif-plugged:fc105139-60fd-4c5b-a9d7-ae7f1279b4be for instance 1da872db-1432-4eed-8990-9ba1baa69985 on n-h1-860864-3 Oct 11 20:43:01.537269 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2850d984-a2b9-4576-a885-85118fcb8d4d req-c0c7ebb5-8275-4d0b-be96-ab4b1db52e3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Oct 11 20:43:01.537869 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3415/6780] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:43:02.382192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-663b6040-745f-4ea7-a6b2-7bed19850c50 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:02.382761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-663b6040-745f-4ea7-a6b2-7bed19850c50 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:02.389564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-663b6040-745f-4ea7-a6b2-7bed19850c50 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:02.390060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-663b6040-745f-4ea7-a6b2-7bed19850c50 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:02.390510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-663b6040-745f-4ea7-a6b2-7bed19850c50 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:02.391237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-663b6040-745f-4ea7-a6b2-7bed19850c50 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:02.391702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-663b6040-745f-4ea7-a6b2-7bed19850c50 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:02.392137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-663b6040-745f-4ea7-a6b2-7bed19850c50 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:02.527077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-663b6040-745f-4ea7-a6b2-7bed19850c50 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:02.535602 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-663b6040-745f-4ea7-a6b2-7bed19850c50 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1316 microversion: 2.1 time: 0.157377 Oct 11 20:43:02.536183 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3366/6781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:02 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:03.560471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-59e83e6e-cf8b-4f6a-871c-24cffd20c87e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:03.561211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-59e83e6e-cf8b-4f6a-871c-24cffd20c87e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:03.568119 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59e83e6e-cf8b-4f6a-871c-24cffd20c87e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:03.568608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59e83e6e-cf8b-4f6a-871c-24cffd20c87e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:03.569052 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59e83e6e-cf8b-4f6a-871c-24cffd20c87e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:03.569738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59e83e6e-cf8b-4f6a-871c-24cffd20c87e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:03.570200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59e83e6e-cf8b-4f6a-871c-24cffd20c87e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:03.570653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-59e83e6e-cf8b-4f6a-871c-24cffd20c87e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:03.700292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-59e83e6e-cf8b-4f6a-871c-24cffd20c87e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:03.709252 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-59e83e6e-cf8b-4f6a-871c-24cffd20c87e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1505 microversion: 2.1 time: 0.153887 Oct 11 20:43:03.709828 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3416/6782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:03 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:03.731400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0c2a9ea7-cb50-441d-ad48-6e7b07c6948e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:03.731911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0c2a9ea7-cb50-441d-ad48-6e7b07c6948e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:03.739244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c2a9ea7-cb50-441d-ad48-6e7b07c6948e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:03.739744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c2a9ea7-cb50-441d-ad48-6e7b07c6948e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:03.740197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c2a9ea7-cb50-441d-ad48-6e7b07c6948e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:03.740901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c2a9ea7-cb50-441d-ad48-6e7b07c6948e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:03.741367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c2a9ea7-cb50-441d-ad48-6e7b07c6948e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:03.741806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0c2a9ea7-cb50-441d-ad48-6e7b07c6948e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:03.768448 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0c2a9ea7-cb50-441d-ad48-6e7b07c6948e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:43:03.841965 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0c2a9ea7-cb50-441d-ad48-6e7b07c6948e tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 204 len: 0 microversion: 2.1 time: 0.114028 Oct 11 20:43:03.842601 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3367/6783] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:43:03 2022] DELETE /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:43:03.851337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9e4482c0-f0e8-4add-ab08-b4d63ae41733 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:03.851948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9e4482c0-f0e8-4add-ab08-b4d63ae41733 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:03.857989 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4482c0-f0e8-4add-ab08-b4d63ae41733 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:03.858468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4482c0-f0e8-4add-ab08-b4d63ae41733 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:03.858934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4482c0-f0e8-4add-ab08-b4d63ae41733 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:03.859680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4482c0-f0e8-4add-ab08-b4d63ae41733 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:03.860122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4482c0-f0e8-4add-ab08-b4d63ae41733 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:03.860541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9e4482c0-f0e8-4add-ab08-b4d63ae41733 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:03.993474 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9e4482c0-f0e8-4add-ab08-b4d63ae41733 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:04.002030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9e4482c0-f0e8-4add-ab08-b4d63ae41733 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1511 microversion: 2.1 time: 0.154657 Oct 11 20:43:04.002628 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3417/6784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:03 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:05.025983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9c062560-c79d-4904-9d98-9b2ecf57e578 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:05.026724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9c062560-c79d-4904-9d98-9b2ecf57e578 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:05.028705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:05.039655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c062560-c79d-4904-9d98-9b2ecf57e578 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:05.040237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c062560-c79d-4904-9d98-9b2ecf57e578 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:05.040700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c062560-c79d-4904-9d98-9b2ecf57e578 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:05.041551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c062560-c79d-4904-9d98-9b2ecf57e578 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:05.042021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c062560-c79d-4904-9d98-9b2ecf57e578 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:05.042456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9c062560-c79d-4904-9d98-9b2ecf57e578 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:05.265164 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9c062560-c79d-4904-9d98-9b2ecf57e578 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:05.273839 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9c062560-c79d-4904-9d98-9b2ecf57e578 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 200 len: 1511 microversion: 2.1 time: 0.252269 Oct 11 20:43:05.274441 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3368/6785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:05 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:05.599124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-d3230a1e-3b52-4cc8-836e-55b70b7d7c53 req-e7c32268-1829-4ac7-8f96-e5fbc6a28f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da872db-1432-4eed-8990-9ba1baa69985", "name": "network-vif-deleted", "tag": "fc105139-60fd-4c5b-a9d7-ae7f1279b4be"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:05.613669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:05.615341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:05.619864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d3230a1e-3b52-4cc8-836e-55b70b7d7c53 req-e7c32268-1829-4ac7-8f96-e5fbc6a28f1b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:05.620978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d3230a1e-3b52-4cc8-836e-55b70b7d7c53 req-e7c32268-1829-4ac7-8f96-e5fbc6a28f1b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:05.621709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-d3230a1e-3b52-4cc8-836e-55b70b7d7c53 req-e7c32268-1829-4ac7-8f96-e5fbc6a28f1b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:05.639719 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-d3230a1e-3b52-4cc8-836e-55b70b7d7c53 req-e7c32268-1829-4ac7-8f96-e5fbc6a28f1b service nova] Creating event network-vif-deleted:fc105139-60fd-4c5b-a9d7-ae7f1279b4be for instance 1da872db-1432-4eed-8990-9ba1baa69985 on n-h1-860864-3 Oct 11 20:43:05.646427 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-d3230a1e-3b52-4cc8-836e-55b70b7d7c53 req-e7c32268-1829-4ac7-8f96-e5fbc6a28f1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051174 Oct 11 20:43:05.647098 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3418/6786] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:43:06.296730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:06.297352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:06.303625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.304120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.304575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.305271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.305748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.306184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.319674 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] HTTP exception thrown: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Request method failure captured: Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 HTTP/1.1 Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdVC7cfSooJhbNVUnDyFAo2XfLFK-Sj6Qml3VG9Pjqfk-JU-24YYIDpdF3JBK2AxWbGvFyYdE0lud4hYJe6-O-bNs5Sf8AczIWGcEw4nNBH9uusZ81pO0R2XJNSqQ-v3MDFFvZGuXfqySKUeXeKJtCuBxJXTDMQ6a66xRiSDmT3r8Aw Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96f386f43b854c19881a9f3bfe380cea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}] Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 0d0859d6c7034d29bd052a501f7c8331 Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '1da872db-1432-4eed-8990-9ba1baa69985'} Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:06.321343 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.326099 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:06.326099 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:06.326099 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:06.326099 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:43:06.326099 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:43:06.326099 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:06.326099 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.326099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Returning 404 to user: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:43:06.326099 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0d8732cd-ee9d-4b2e-9558-36e7f082bff1 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 404 len: 111 microversion: 2.1 time: 0.030204 Oct 11 20:43:06.326099 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3369/6787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:06 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:43:06.333203 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d222d98a-3e6e-4899-b122-64340e8c0f83 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:06.333898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d222d98a-3e6e-4899-b122-64340e8c0f83 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:06.340006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d222d98a-3e6e-4899-b122-64340e8c0f83 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.340486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d222d98a-3e6e-4899-b122-64340e8c0f83 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.340985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d222d98a-3e6e-4899-b122-64340e8c0f83 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.341666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d222d98a-3e6e-4899-b122-64340e8c0f83 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.342117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d222d98a-3e6e-4899-b122-64340e8c0f83 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.342589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d222d98a-3e6e-4899-b122-64340e8c0f83 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.475163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d222d98a-3e6e-4899-b122-64340e8c0f83 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:06.482760 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d222d98a-3e6e-4899-b122-64340e8c0f83 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1506 microversion: 2.1 time: 0.153843 Oct 11 20:43:06.483348 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3419/6788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:06 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:06.505219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-01adf602-8f0f-40ad-aa50-51de7534caa7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:06.507598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-01adf602-8f0f-40ad-aa50-51de7534caa7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 6635807a-712a-474f-b89c-f2957cf949a2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:06.513050 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-01adf602-8f0f-40ad-aa50-51de7534caa7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] HTTP exception thrown: Instance 6635807a-712a-474f-b89c-f2957cf949a2 could not be found. Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-01adf602-8f0f-40ad-aa50-51de7534caa7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Request method failure captured: Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/6635807a-712a-474f-b89c-f2957cf949a2/action HTTP/1.1 Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 32 Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdVC7cfSooJhbNVUnDyFAo2XfLFK-Sj6Qml3VG9Pjqfk-JU-24YYIDpdF3JBK2AxWbGvFyYdE0lud4hYJe6-O-bNs5Sf8AczIWGcEw4nNBH9uusZ81pO0R2XJNSqQ-v3MDFFvZGuXfqySKUeXeKJtCuBxJXTDMQ6a66xRiSDmT3r8Aw Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96f386f43b854c19881a9f3bfe380cea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}] Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 0d0859d6c7034d29bd052a501f7c8331 Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: {"resize": {"flavorRef": "452"}} Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 6635807a-712a-474f-b89c-f2957cf949a2 could not be found. Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '6635807a-712a-474f-b89c-f2957cf949a2', 'body': {'resize': {'flavorRef': '452'}}} Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6635807a-712a-474f-b89c-f2957cf949a2 could not be found. Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:43:06.514636 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6635807a-712a-474f-b89c-f2957cf949a2 could not be found. Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6635807a-712a-474f-b89c-f2957cf949a2 could not be found. Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-01adf602-8f0f-40ad-aa50-51de7534caa7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Returning 404 to user: Instance 6635807a-712a-474f-b89c-f2957cf949a2 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-01adf602-8f0f-40ad-aa50-51de7534caa7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "POST /compute/v2.1/servers/6635807a-712a-474f-b89c-f2957cf949a2/action" status: 404 len: 111 microversion: 2.1 time: 0.015389 Oct 11 20:43:06.519211 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3370/6789] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:43:06 2022] POST /compute/v2.1/servers/6635807a-712a-474f-b89c-f2957cf949a2/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:43:06.525102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2a6c17f7-5169-441a-af53-8f9e55a75f4a tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:06.525720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2a6c17f7-5169-441a-af53-8f9e55a75f4a tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:06.532391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a6c17f7-5169-441a-af53-8f9e55a75f4a tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.532874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a6c17f7-5169-441a-af53-8f9e55a75f4a tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.533312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a6c17f7-5169-441a-af53-8f9e55a75f4a tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.533996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a6c17f7-5169-441a-af53-8f9e55a75f4a tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.534454 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a6c17f7-5169-441a-af53-8f9e55a75f4a tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.534905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2a6c17f7-5169-441a-af53-8f9e55a75f4a tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.667676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2a6c17f7-5169-441a-af53-8f9e55a75f4a tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:06.676099 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2a6c17f7-5169-441a-af53-8f9e55a75f4a tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1506 microversion: 2.1 time: 0.154732 Oct 11 20:43:06.676610 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3420/6790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:06 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:43:06.698807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e923ff74-ccf9-4a30-9dca-8de98ec9fd27 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:06.699439 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e923ff74-ccf9-4a30-9dca-8de98ec9fd27 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:06.706684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e923ff74-ccf9-4a30-9dca-8de98ec9fd27 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.707195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e923ff74-ccf9-4a30-9dca-8de98ec9fd27 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.707652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e923ff74-ccf9-4a30-9dca-8de98ec9fd27 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.708358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e923ff74-ccf9-4a30-9dca-8de98ec9fd27 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.708835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e923ff74-ccf9-4a30-9dca-8de98ec9fd27 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.709281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e923ff74-ccf9-4a30-9dca-8de98ec9fd27 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.836715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e923ff74-ccf9-4a30-9dca-8de98ec9fd27 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:06.844956 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e923ff74-ccf9-4a30-9dca-8de98ec9fd27 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1506 microversion: 2.1 time: 0.149995 Oct 11 20:43:06.850222 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3371/6791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:06 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:06.868265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "8010f9bb-d91c-41b4-baa2-198a4eb6ff85"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:06.870560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:06.876552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.877047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.877488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.878178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.878664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.879099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.907321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:06.912434 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] HTTP exception thrown: Flavor 8010f9bb-d91c-41b4-baa2-198a4eb6ff85 could not be found. Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Request method failure captured: Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: request: POST /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e/action HTTP/1.1 Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 65 Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdVC7cfSooJhbNVUnDyFAo2XfLFK-Sj6Qml3VG9Pjqfk-JU-24YYIDpdF3JBK2AxWbGvFyYdE0lud4hYJe6-O-bNs5Sf8AczIWGcEw4nNBH9uusZ81pO0R2XJNSqQ-v3MDFFvZGuXfqySKUeXeKJtCuBxJXTDMQ6a66xRiSDmT3r8Aw Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96f386f43b854c19881a9f3bfe380cea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}] Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 0d0859d6c7034d29bd052a501f7c8331 Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: {"resize": {"flavorRef": "8010f9bb-d91c-41b4-baa2-198a4eb6ff85"}} Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: exception: Flavor 8010f9bb-d91c-41b4-baa2-198a4eb6ff85 could not be found. Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '092b121d-2947-466a-b603-74a8d23c0f9e', 'body': {'resize': {'flavorRef': '8010f9bb-d91c-41b4-baa2-198a4eb6ff85'}}} Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:43:06.922572 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8010f9bb-d91c-41b4-baa2-198a4eb6ff85 could not be found. Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 8010f9bb-d91c-41b4-baa2-198a4eb6ff85 could not be found. Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8010f9bb-d91c-41b4-baa2-198a4eb6ff85 could not be found. Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Returning 400 to user: Flavor 8010f9bb-d91c-41b4-baa2-198a4eb6ff85 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-711933ae-6adb-48d7-9c4e-4fc18e80ec34 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "POST /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e/action" status: 400 len: 107 microversion: 2.1 time: 0.059562 Oct 11 20:43:06.926876 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3421/6792] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:43:06 2022] POST /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e/action => generated 107 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:43:06.932867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-effc3a1e-3687-4bc3-b45c-02a1a615c747 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:06.933497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-effc3a1e-3687-4bc3-b45c-02a1a615c747 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:06.939768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effc3a1e-3687-4bc3-b45c-02a1a615c747 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.940274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effc3a1e-3687-4bc3-b45c-02a1a615c747 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.940733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effc3a1e-3687-4bc3-b45c-02a1a615c747 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:06.941449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effc3a1e-3687-4bc3-b45c-02a1a615c747 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:06.941923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effc3a1e-3687-4bc3-b45c-02a1a615c747 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:06.942372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-effc3a1e-3687-4bc3-b45c-02a1a615c747 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.073793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-effc3a1e-3687-4bc3-b45c-02a1a615c747 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:07.082814 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-effc3a1e-3687-4bc3-b45c-02a1a615c747 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1506 microversion: 2.1 time: 0.153872 Oct 11 20:43:07.083396 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3372/6793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:06 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:07.107017 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b71316f1-d146-4ba6-afda-e4de7c48743b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:07.107657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b71316f1-d146-4ba6-afda-e4de7c48743b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:07.113532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b71316f1-d146-4ba6-afda-e4de7c48743b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.114025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b71316f1-d146-4ba6-afda-e4de7c48743b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.114469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b71316f1-d146-4ba6-afda-e4de7c48743b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.115184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b71316f1-d146-4ba6-afda-e4de7c48743b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.115643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b71316f1-d146-4ba6-afda-e4de7c48743b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.116080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b71316f1-d146-4ba6-afda-e4de7c48743b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.246227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b71316f1-d146-4ba6-afda-e4de7c48743b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:07.254462 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b71316f1-d146-4ba6-afda-e4de7c48743b tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1506 microversion: 2.1 time: 0.151291 Oct 11 20:43:07.255055 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3422/6794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:07 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:07.277194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aa0411ae-ee75-49a1-b8a5-bd90266d5da4 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aa0411ae-ee75-49a1-b8a5-bd90266d5da4 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Request method failure captured: Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: request: POST /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e/action HTTP/1.1 Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 29 Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdVC7cfSooJhbNVUnDyFAo2XfLFK-Sj6Qml3VG9Pjqfk-JU-24YYIDpdF3JBK2AxWbGvFyYdE0lud4hYJe6-O-bNs5Sf8AczIWGcEw4nNBH9uusZ81pO0R2XJNSqQ-v3MDFFvZGuXfqySKUeXeKJtCuBxJXTDMQ6a66xRiSDmT3r8Aw Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96f386f43b854c19881a9f3bfe380cea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}] Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 0d0859d6c7034d29bd052a501f7c8331 Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: {"resize": {"flavorRef": ""}} Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '092b121d-2947-466a-b603-74a8d23c0f9e', 'body': {'resize': {'flavorRef': ''}}} Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise error Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi '' Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.281503 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-aa0411ae-ee75-49a1-b8a5-bd90266d5da4 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-aa0411ae-ee75-49a1-b8a5-bd90266d5da4 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "POST /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e/action" status: 400 len: 113 microversion: 2.1 time: 0.009609 Oct 11 20:43:07.286281 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3373/6795] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:43:07 2022] POST /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 20:43:07.291585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-401f76d3-93c0-4885-bac4-58b5671ed8f6 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:07.292205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-401f76d3-93c0-4885-bac4-58b5671ed8f6 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:07.298364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401f76d3-93c0-4885-bac4-58b5671ed8f6 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.298899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401f76d3-93c0-4885-bac4-58b5671ed8f6 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.299349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401f76d3-93c0-4885-bac4-58b5671ed8f6 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.300045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401f76d3-93c0-4885-bac4-58b5671ed8f6 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.300624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401f76d3-93c0-4885-bac4-58b5671ed8f6 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.301062 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-401f76d3-93c0-4885-bac4-58b5671ed8f6 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.432318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-401f76d3-93c0-4885-bac4-58b5671ed8f6 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:07.440613 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-401f76d3-93c0-4885-bac4-58b5671ed8f6 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1506 microversion: 2.1 time: 0.152826 Oct 11 20:43:07.441180 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3423/6796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:07 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:07.467578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:07.468077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:07.475245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.475744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.476194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.476917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.477401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.477826 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.490729 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] HTTP exception thrown: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Request method failure captured: Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 HTTP/1.1 Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdVC7cfSooJhbNVUnDyFAo2XfLFK-Sj6Qml3VG9Pjqfk-JU-24YYIDpdF3JBK2AxWbGvFyYdE0lud4hYJe6-O-bNs5Sf8AczIWGcEw4nNBH9uusZ81pO0R2XJNSqQ-v3MDFFvZGuXfqySKUeXeKJtCuBxJXTDMQ6a66xRiSDmT3r8Aw Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96f386f43b854c19881a9f3bfe380cea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}] Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 0d0859d6c7034d29bd052a501f7c8331 Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '1da872db-1432-4eed-8990-9ba1baa69985'} Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:43:07.492306 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Returning 404 to user: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0a034463-78af-440e-909d-8bf8eccbd0fa tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 404 len: 111 microversion: 2.1 time: 0.030894 Oct 11 20:43:07.496369 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3374/6797] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:43:07 2022] DELETE /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:43:07.502712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:07.503323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 1da872db-1432-4eed-8990-9ba1baa69985] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:07.509225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.509707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.510138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.510842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.511300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.511719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.525525 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] HTTP exception thrown: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Request method failure captured: Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 HTTP/1.1 Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdVC7cfSooJhbNVUnDyFAo2XfLFK-Sj6Qml3VG9Pjqfk-JU-24YYIDpdF3JBK2AxWbGvFyYdE0lud4hYJe6-O-bNs5Sf8AczIWGcEw4nNBH9uusZ81pO0R2XJNSqQ-v3MDFFvZGuXfqySKUeXeKJtCuBxJXTDMQ6a66xRiSDmT3r8Aw Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96f386f43b854c19881a9f3bfe380cea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}] Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 0d0859d6c7034d29bd052a501f7c8331 Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '1da872db-1432-4eed-8990-9ba1baa69985'} Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:07.527063 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.531596 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:07.531596 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:07.531596 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:07.531596 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:43:07.531596 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:43:07.531596 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. Oct 11 20:43:07.531596 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:07.531596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Returning 404 to user: Instance 1da872db-1432-4eed-8990-9ba1baa69985 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:43:07.531596 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5a6c89cf-8763-4b4e-a482-91f1a3cc9b2f tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985" status: 404 len: 111 microversion: 2.1 time: 0.030182 Oct 11 20:43:07.531596 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3424/6798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:07 2022] GET /compute/v2.1/servers/1da872db-1432-4eed-8990-9ba1baa69985 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:43:07.537398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-69d49cfc-09e3-4384-a6d0-cd0cfe74a518 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:07.537985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-69d49cfc-09e3-4384-a6d0-cd0cfe74a518 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:07.543941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d49cfc-09e3-4384-a6d0-cd0cfe74a518 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.544444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d49cfc-09e3-4384-a6d0-cd0cfe74a518 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.544898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d49cfc-09e3-4384-a6d0-cd0cfe74a518 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.545603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d49cfc-09e3-4384-a6d0-cd0cfe74a518 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.546076 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d49cfc-09e3-4384-a6d0-cd0cfe74a518 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.546820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-69d49cfc-09e3-4384-a6d0-cd0cfe74a518 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.572851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-69d49cfc-09e3-4384-a6d0-cd0cfe74a518 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:43:07.607008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:07.654218 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-69d49cfc-09e3-4384-a6d0-cd0cfe74a518 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "DELETE /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 204 len: 0 microversion: 2.1 time: 0.120152 Oct 11 20:43:07.654848 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3375/6799] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:43:07 2022] DELETE /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:43:07.663589 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bac24ddf-47f3-4524-af85-0c7a4f66103c tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:07.664202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bac24ddf-47f3-4524-af85-0c7a4f66103c tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:07.671110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bac24ddf-47f3-4524-af85-0c7a4f66103c tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.671707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bac24ddf-47f3-4524-af85-0c7a4f66103c tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.672056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bac24ddf-47f3-4524-af85-0c7a4f66103c tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.672738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bac24ddf-47f3-4524-af85-0c7a4f66103c tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:07.673189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bac24ddf-47f3-4524-af85-0c7a4f66103c tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:07.673617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bac24ddf-47f3-4524-af85-0c7a4f66103c tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:07.693069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=100 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:07.808299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bac24ddf-47f3-4524-af85-0c7a4f66103c tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:07.816983 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bac24ddf-47f3-4524-af85-0c7a4f66103c tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1512 microversion: 2.1 time: 0.157631 Oct 11 20:43:07.817560 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3425/6800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:07 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:43:08.842400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-efddf64a-a348-4ad5-b885-dd795ea53311 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:08.843103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-efddf64a-a348-4ad5-b885-dd795ea53311 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:08.850059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efddf64a-a348-4ad5-b885-dd795ea53311 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:08.850597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efddf64a-a348-4ad5-b885-dd795ea53311 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:08.851068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efddf64a-a348-4ad5-b885-dd795ea53311 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:08.851777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efddf64a-a348-4ad5-b885-dd795ea53311 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:08.852251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efddf64a-a348-4ad5-b885-dd795ea53311 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:08.852694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-efddf64a-a348-4ad5-b885-dd795ea53311 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:08.985069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-efddf64a-a348-4ad5-b885-dd795ea53311 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:08.992947 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-efddf64a-a348-4ad5-b885-dd795ea53311 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1512 microversion: 2.1 time: 0.154955 Oct 11 20:43:08.993520 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3376/6801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:08 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:09.610974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ab64b4db-a664-4987-909b-3f412c9183ba req-0a280651-61af-4413-b0fc-da131ad3f9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092b121d-2947-466a-b603-74a8d23c0f9e", "name": "network-vif-deleted", "tag": "e2561438-36fb-44b3-9049-c8fb26f26772"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:09.628962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ab64b4db-a664-4987-909b-3f412c9183ba req-0a280651-61af-4413-b0fc-da131ad3f9a0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:09.629357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ab64b4db-a664-4987-909b-3f412c9183ba req-0a280651-61af-4413-b0fc-da131ad3f9a0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:09.629793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ab64b4db-a664-4987-909b-3f412c9183ba req-0a280651-61af-4413-b0fc-da131ad3f9a0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:09.642037 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ab64b4db-a664-4987-909b-3f412c9183ba req-0a280651-61af-4413-b0fc-da131ad3f9a0 service nova] Creating event network-vif-deleted:e2561438-36fb-44b3-9049-c8fb26f26772 for instance 092b121d-2947-466a-b603-74a8d23c0f9e on n-h2-860864-3 Oct 11 20:43:09.647240 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ab64b4db-a664-4987-909b-3f412c9183ba req-0a280651-61af-4413-b0fc-da131ad3f9a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040976 Oct 11 20:43:09.648008 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3426/6802] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:43:10.017251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:10.017906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:10.024894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:10.025404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:10.025848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:10.026574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:10.027043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:10.027476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:10.063309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:10.063848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:10.064302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:10.064772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lazy-loading 'fault' on Instance uuid 092b121d-2947-466a-b603-74a8d23c0f9e {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:43:10.113783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0859d6c7034d29bd052a501f7c8331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f386f43b854c19881a9f3bfe380cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:10.121550 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-945d8dd9-33e5-4a34-8d1b-c6e4a03bbcb7 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 200 len: 1307 microversion: 2.1 time: 0.108428 Oct 11 20:43:10.122134 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3377/6803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:10 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:11.147012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:11.147720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] [instance: 092b121d-2947-466a-b603-74a8d23c0f9e] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:11.153938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:11.154431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:11.154897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:11.155591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:11.156055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:11.156482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:11.169847 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] HTTP exception thrown: Instance 092b121d-2947-466a-b603-74a8d23c0f9e could not be found. Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Request method failure captured: Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e HTTP/1.1 Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdVC7cfSooJhbNVUnDyFAo2XfLFK-Sj6Qml3VG9Pjqfk-JU-24YYIDpdF3JBK2AxWbGvFyYdE0lud4hYJe6-O-bNs5Sf8AczIWGcEw4nNBH9uusZ81pO0R2XJNSqQ-v3MDFFvZGuXfqySKUeXeKJtCuBxJXTDMQ6a66xRiSDmT3r8Aw Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_96f386f43b854c19881a9f3bfe380cea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/96f386f43b854c19881a9f3bfe380cea"}]}] Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 96f386f43b854c19881a9f3bfe380cea Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942941054 Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 0d0859d6c7034d29bd052a501f7c8331 Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-ServersNegativeTestJSON-942941054-project Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 092b121d-2947-466a-b603-74a8d23c0f9e could not be found. Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '092b121d-2947-466a-b603-74a8d23c0f9e'} Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 092b121d-2947-466a-b603-74a8d23c0f9e could not be found. Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 092b121d-2947-466a-b603-74a8d23c0f9e could not be found. Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:43:11.171520 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:11.176296 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:43:11.176296 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:43:11.176296 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:43:11.176296 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:43:11.176296 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:43:11.176296 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 092b121d-2947-466a-b603-74a8d23c0f9e could not be found. Oct 11 20:43:11.176296 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:43:11.176296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] Returning 404 to user: Instance 092b121d-2947-466a-b603-74a8d23c0f9e could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:43:11.176296 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1ba62f51-900a-4ec9-af65-23ad6e41e8e8 tempest-ServersNegativeTestJSON-942941054 tempest-ServersNegativeTestJSON-942941054-project] 10.222.0.27 "GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e" status: 404 len: 111 microversion: 2.1 time: 0.031024 Oct 11 20:43:11.176296 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3427/6804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:11 2022] GET /compute/v2.1/servers/092b121d-2947-466a-b603-74a8d23c0f9e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:43:41.690469 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:43:41.691097 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 20:43:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.27) !!! Oct 11 20:43:41.691954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:41.692988 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:41.866982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-464ec778-bf2a-4d71-9121-aa75d0a37bb8 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Action: 'create', calling method: .version_select at 0x7f83c71dc4c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-994723970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+C/rRPh+SUH1qX9IBGwzXcpPXimRE8bkGxZom5X+ekTPYa95N/PpFHMCsrwtN0wBrqKfoCbYUUEKwzQfOgnufm3o2X6cb0tHYlIxYnT+n72f54KSk/WB9kxlPaANPyyw=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:41.884707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-464ec778-bf2a-4d71-9121-aa75d0a37bb8 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:43:41.891016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-464ec778-bf2a-4d71-9121-aa75d0a37bb8 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for user 714195a3e8964de2a4e0e7bbe222f584 and project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:43:41.919858 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-464ec778-bf2a-4d71-9121-aa75d0a37bb8 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.235934 Oct 11 20:43:41.924500 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3378/6805] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:43:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:43:41.978749 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:43:41.979842 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:43:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 11 20:43:41.982023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=29 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:41.982993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:41.988658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2083342552", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-994723970", "networks": [{"uuid": "7fabbc3c-ce5d-4abd-810b-3e69b9bd6c58"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:42.063004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] validate_networks() for [('7fabbc3c-ce5d-4abd-810b-3e69b9bd6c58', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:43:42.814866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:43:42.815304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:43:42.815783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:43:42.816264 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:43:42.816863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:43:42.825831 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:42.826387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:42.827133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:42.828484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:42.828950 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:42.829381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:42.846193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:43:42.851554 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for user 714195a3e8964de2a4e0e7bbe222f584 and project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:43:42.863935 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:43:42.866303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:43:42.915871 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2d6fa694-3cd1-4e54-8167-b7d52211fd0b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939015 Oct 11 20:43:42.923086 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3428/6806] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:43:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:43:42.931146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c5d6ba79-080e-41a7-9063-2229b437f799 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:42.932337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c5d6ba79-080e-41a7-9063-2229b437f799 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:42.988491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c5d6ba79-080e-41a7-9063-2229b437f799 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:42.996453 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c5d6ba79-080e-41a7-9063-2229b437f799 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1262 microversion: 2.1 time: 0.072111 Oct 11 20:43:42.997025 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3379/6807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:42 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:44.020016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c25e3b52-d22c-4488-9eea-01ab78ba3815 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:44.020634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c25e3b52-d22c-4488-9eea-01ab78ba3815 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:44.027695 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c25e3b52-d22c-4488-9eea-01ab78ba3815 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:44.028109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c25e3b52-d22c-4488-9eea-01ab78ba3815 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:44.028549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c25e3b52-d22c-4488-9eea-01ab78ba3815 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:44.029245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c25e3b52-d22c-4488-9eea-01ab78ba3815 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:44.029699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c25e3b52-d22c-4488-9eea-01ab78ba3815 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:44.030744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c25e3b52-d22c-4488-9eea-01ab78ba3815 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:44.142208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c25e3b52-d22c-4488-9eea-01ab78ba3815 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:44.150763 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c25e3b52-d22c-4488-9eea-01ab78ba3815 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1332 microversion: 2.1 time: 0.134835 Oct 11 20:43:44.151340 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3429/6808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:44 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1332 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:45.174123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-48a06f47-be7b-4c15-acb1-2cc0eedfa0af tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:45.175280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-48a06f47-be7b-4c15-acb1-2cc0eedfa0af tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:45.182713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48a06f47-be7b-4c15-acb1-2cc0eedfa0af tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:45.183490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48a06f47-be7b-4c15-acb1-2cc0eedfa0af tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:45.184116 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48a06f47-be7b-4c15-acb1-2cc0eedfa0af tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:45.185150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48a06f47-be7b-4c15-acb1-2cc0eedfa0af tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:45.186067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48a06f47-be7b-4c15-acb1-2cc0eedfa0af tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:45.186643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-48a06f47-be7b-4c15-acb1-2cc0eedfa0af tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:45.419272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-48a06f47-be7b-4c15-acb1-2cc0eedfa0af tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:45.428499 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-48a06f47-be7b-4c15-acb1-2cc0eedfa0af tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1362 microversion: 2.1 time: 0.258980 Oct 11 20:43:45.429326 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3380/6809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:45 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:43:45.539100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-266c27dd-5d64-485b-ba30-21581547e92b req-645175f8-3e71-445f-9393-20a27225f869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01093b68-c901-48de-9597-f80113c67ba6", "tag": "f541d389-622b-4916-9ff1-7a53f86abbf6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:45.567037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-266c27dd-5d64-485b-ba30-21581547e92b req-645175f8-3e71-445f-9393-20a27225f869 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:45.567888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-266c27dd-5d64-485b-ba30-21581547e92b req-645175f8-3e71-445f-9393-20a27225f869 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:45.568542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-266c27dd-5d64-485b-ba30-21581547e92b req-645175f8-3e71-445f-9393-20a27225f869 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:45.582379 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-266c27dd-5d64-485b-ba30-21581547e92b req-645175f8-3e71-445f-9393-20a27225f869 service nova] Creating event network-changed:f541d389-622b-4916-9ff1-7a53f86abbf6 for instance 01093b68-c901-48de-9597-f80113c67ba6 on n-h1-860864-3 Oct 11 20:43:45.588356 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-266c27dd-5d64-485b-ba30-21581547e92b req-645175f8-3e71-445f-9393-20a27225f869 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054416 Oct 11 20:43:45.589250 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3430/6810] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:43:46.451712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ecad140-7def-46df-aff5-35e8359c8d0c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:46.453394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1ecad140-7def-46df-aff5-35e8359c8d0c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:46.460297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ecad140-7def-46df-aff5-35e8359c8d0c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:46.460818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ecad140-7def-46df-aff5-35e8359c8d0c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:46.461264 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ecad140-7def-46df-aff5-35e8359c8d0c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:46.461956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ecad140-7def-46df-aff5-35e8359c8d0c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:46.462421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ecad140-7def-46df-aff5-35e8359c8d0c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:46.462989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ecad140-7def-46df-aff5-35e8359c8d0c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:46.595518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1ecad140-7def-46df-aff5-35e8359c8d0c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:46.603255 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1ecad140-7def-46df-aff5-35e8359c8d0c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1362 microversion: 2.1 time: 0.155511 Oct 11 20:43:46.603838 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3381/6811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:46 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:47.626653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1078d0f-0b78-495e-9d80-d6e6511d2f1c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:47.627353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e1078d0f-0b78-495e-9d80-d6e6511d2f1c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:47.634621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1078d0f-0b78-495e-9d80-d6e6511d2f1c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:47.635107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1078d0f-0b78-495e-9d80-d6e6511d2f1c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:47.635542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1078d0f-0b78-495e-9d80-d6e6511d2f1c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:47.636236 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1078d0f-0b78-495e-9d80-d6e6511d2f1c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:47.636685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1078d0f-0b78-495e-9d80-d6e6511d2f1c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:47.637105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1078d0f-0b78-495e-9d80-d6e6511d2f1c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:47.768677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e1078d0f-0b78-495e-9d80-d6e6511d2f1c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:47.776501 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e1078d0f-0b78-495e-9d80-d6e6511d2f1c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1362 microversion: 2.1 time: 0.154869 Oct 11 20:43:47.777069 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3431/6812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:47 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:48.800175 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e4a1b1d0-51f3-4a82-8f0b-6829fa34dcac tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:48.800802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e4a1b1d0-51f3-4a82-8f0b-6829fa34dcac tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:48.807923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4a1b1d0-51f3-4a82-8f0b-6829fa34dcac tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:48.808266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4a1b1d0-51f3-4a82-8f0b-6829fa34dcac tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:48.808712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4a1b1d0-51f3-4a82-8f0b-6829fa34dcac tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:48.809415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4a1b1d0-51f3-4a82-8f0b-6829fa34dcac tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:48.809883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4a1b1d0-51f3-4a82-8f0b-6829fa34dcac tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:48.810316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e4a1b1d0-51f3-4a82-8f0b-6829fa34dcac tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:48.942564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e4a1b1d0-51f3-4a82-8f0b-6829fa34dcac tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:48.950507 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e4a1b1d0-51f3-4a82-8f0b-6829fa34dcac tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1362 microversion: 2.1 time: 0.154846 Oct 11 20:43:48.951104 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3382/6813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:48 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:49.739026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-68db7a16-1cc0-4316-a2e7-8919ab92a79e req-2fc19f3c-0273-41d5-bf24-aac212030dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01093b68-c901-48de-9597-f80113c67ba6", "name": "network-vif-plugged", "status": "completed", "tag": "f541d389-622b-4916-9ff1-7a53f86abbf6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:49.751434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-68db7a16-1cc0-4316-a2e7-8919ab92a79e req-2fc19f3c-0273-41d5-bf24-aac212030dec service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:49.752779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-68db7a16-1cc0-4316-a2e7-8919ab92a79e req-2fc19f3c-0273-41d5-bf24-aac212030dec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:49.753222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-68db7a16-1cc0-4316-a2e7-8919ab92a79e req-2fc19f3c-0273-41d5-bf24-aac212030dec service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:49.765242 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-68db7a16-1cc0-4316-a2e7-8919ab92a79e req-2fc19f3c-0273-41d5-bf24-aac212030dec service nova] Creating event network-vif-plugged:f541d389-622b-4916-9ff1-7a53f86abbf6 for instance 01093b68-c901-48de-9597-f80113c67ba6 on n-h1-860864-3 Oct 11 20:43:49.770501 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-68db7a16-1cc0-4316-a2e7-8919ab92a79e req-2fc19f3c-0273-41d5-bf24-aac212030dec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035264 Oct 11 20:43:49.771129 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3432/6814] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:43:49.974027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-77eee587-3b75-4264-a90a-4261e5ead98e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:49.974674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-77eee587-3b75-4264-a90a-4261e5ead98e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:49.981417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-77eee587-3b75-4264-a90a-4261e5ead98e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:49.981911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-77eee587-3b75-4264-a90a-4261e5ead98e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:49.982356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-77eee587-3b75-4264-a90a-4261e5ead98e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:49.983664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-77eee587-3b75-4264-a90a-4261e5ead98e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:49.984179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-77eee587-3b75-4264-a90a-4261e5ead98e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:49.984639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-77eee587-3b75-4264-a90a-4261e5ead98e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:50.113458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-77eee587-3b75-4264-a90a-4261e5ead98e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:50.121357 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-77eee587-3b75-4264-a90a-4261e5ead98e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1362 microversion: 2.1 time: 0.151113 Oct 11 20:43:50.121866 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3383/6815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:49 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:51.144456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0ac4d7d0-8cd7-4686-88cb-8e67a8849e37 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:51.145956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0ac4d7d0-8cd7-4686-88cb-8e67a8849e37 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:51.152946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4d7d0-8cd7-4686-88cb-8e67a8849e37 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:51.153427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4d7d0-8cd7-4686-88cb-8e67a8849e37 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:51.153857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4d7d0-8cd7-4686-88cb-8e67a8849e37 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:51.154555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4d7d0-8cd7-4686-88cb-8e67a8849e37 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:51.155156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4d7d0-8cd7-4686-88cb-8e67a8849e37 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:51.155632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0ac4d7d0-8cd7-4686-88cb-8e67a8849e37 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:51.287536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0ac4d7d0-8cd7-4686-88cb-8e67a8849e37 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:51.295201 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0ac4d7d0-8cd7-4686-88cb-8e67a8849e37 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1554 microversion: 2.1 time: 0.155061 Oct 11 20:43:51.296331 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3433/6816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:51 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:51.318258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b314f16c-a67b-4eb5-b42e-9968e23e6553 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:43:51.318910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b314f16c-a67b-4eb5-b42e-9968e23e6553 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:51.325733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b314f16c-a67b-4eb5-b42e-9968e23e6553 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:51.326229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b314f16c-a67b-4eb5-b42e-9968e23e6553 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:51.326726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b314f16c-a67b-4eb5-b42e-9968e23e6553 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:51.328022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b314f16c-a67b-4eb5-b42e-9968e23e6553 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:51.328553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b314f16c-a67b-4eb5-b42e-9968e23e6553 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:51.328938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b314f16c-a67b-4eb5-b42e-9968e23e6553 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:51.460315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b314f16c-a67b-4eb5-b42e-9968e23e6553 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:43:51.468313 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b314f16c-a67b-4eb5-b42e-9968e23e6553 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1554 microversion: 2.1 time: 0.153685 Oct 11 20:43:51.468890 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3384/6817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:43:51 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:43:53.111206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3e0f061c-2006-4362-9149-b9571e2a7e94 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2da467c9-5160-4f03-a7ea-138edc0682ba"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:43:53.113504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3e0f061c-2006-4362-9149-b9571e2a7e94 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:43:53.116304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:53.116968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:43:53.122703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e0f061c-2006-4362-9149-b9571e2a7e94 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:53.123185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e0f061c-2006-4362-9149-b9571e2a7e94 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:53.123617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e0f061c-2006-4362-9149-b9571e2a7e94 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:53.124305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e0f061c-2006-4362-9149-b9571e2a7e94 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:43:53.124754 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e0f061c-2006-4362-9149-b9571e2a7e94 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:43:53.125174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e0f061c-2006-4362-9149-b9571e2a7e94 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:43:53.366497 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3e0f061c-2006-4362-9149-b9571e2a7e94 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "POST /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258835 Oct 11 20:43:53.367146 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3434/6818] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:43:53 2022] POST /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:04.087576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-40aed6a5-5759-489c-86ee-fb50f230a546 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:04.088083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-40aed6a5-5759-489c-86ee-fb50f230a546 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:04.090934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:04.091756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:04.092306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=30 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:04.099254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40aed6a5-5759-489c-86ee-fb50f230a546 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:04.099779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40aed6a5-5759-489c-86ee-fb50f230a546 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:04.100302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40aed6a5-5759-489c-86ee-fb50f230a546 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:04.104671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40aed6a5-5759-489c-86ee-fb50f230a546 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:04.105157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40aed6a5-5759-489c-86ee-fb50f230a546 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:04.105606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40aed6a5-5759-489c-86ee-fb50f230a546 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:04.185537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-40aed6a5-5759-489c-86ee-fb50f230a546 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lazy-loading 'services' on Instance uuid 01093b68-c901-48de-9597-f80113c67ba6 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:44:04.256843 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-40aed6a5-5759-489c-86ee-fb50f230a546 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments/2da467c9-5160-4f03-a7ea-138edc0682ba" status: 202 len: 0 microversion: 2.1 time: 0.173105 Oct 11 20:44:04.257438 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3385/6819] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:44:04 2022] DELETE /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments/2da467c9-5160-4f03-a7ea-138edc0682ba => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:44:04.268101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fbbb4505-3333-4963-a667-4986d383b81c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:04.270491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fbbb4505-3333-4963-a667-4986d383b81c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:04.273826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:04.274992 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:04.288658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbbb4505-3333-4963-a667-4986d383b81c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:04.289167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbbb4505-3333-4963-a667-4986d383b81c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:04.289614 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbbb4505-3333-4963-a667-4986d383b81c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:04.290327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbbb4505-3333-4963-a667-4986d383b81c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:04.290814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbbb4505-3333-4963-a667-4986d383b81c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:04.291248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fbbb4505-3333-4963-a667-4986d383b81c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:04.326492 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fbbb4505-3333-4963-a667-4986d383b81c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063816 Oct 11 20:44:04.327351 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3435/6820] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:04 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:05.341034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-14e7393a-ca5b-4ccf-a01b-d763cdd6dc75 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:05.343369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-14e7393a-ca5b-4ccf-a01b-d763cdd6dc75 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:05.350386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14e7393a-ca5b-4ccf-a01b-d763cdd6dc75 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:05.350919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14e7393a-ca5b-4ccf-a01b-d763cdd6dc75 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:05.351366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14e7393a-ca5b-4ccf-a01b-d763cdd6dc75 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:05.352068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14e7393a-ca5b-4ccf-a01b-d763cdd6dc75 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:05.352541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14e7393a-ca5b-4ccf-a01b-d763cdd6dc75 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:05.352979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-14e7393a-ca5b-4ccf-a01b-d763cdd6dc75 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:05.383970 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-14e7393a-ca5b-4ccf-a01b-d763cdd6dc75 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048139 Oct 11 20:44:05.384545 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3386/6821] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:05 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:06.396984 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b7550c0c-727d-4e93-bf7b-6e4e00cd88e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:06.399078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b7550c0c-727d-4e93-bf7b-6e4e00cd88e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:06.405977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7550c0c-727d-4e93-bf7b-6e4e00cd88e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:06.406463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7550c0c-727d-4e93-bf7b-6e4e00cd88e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:06.406958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7550c0c-727d-4e93-bf7b-6e4e00cd88e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:06.408301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7550c0c-727d-4e93-bf7b-6e4e00cd88e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:06.408758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7550c0c-727d-4e93-bf7b-6e4e00cd88e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:06.409185 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b7550c0c-727d-4e93-bf7b-6e4e00cd88e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:06.439541 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b7550c0c-727d-4e93-bf7b-6e4e00cd88e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046642 Oct 11 20:44:06.440106 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3436/6822] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:06 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:07.452594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5d319f6e-2378-4a48-b82c-3db6310f141e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:07.454889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5d319f6e-2378-4a48-b82c-3db6310f141e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:07.460919 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d319f6e-2378-4a48-b82c-3db6310f141e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:07.461413 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d319f6e-2378-4a48-b82c-3db6310f141e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:07.461860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d319f6e-2378-4a48-b82c-3db6310f141e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:07.462582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d319f6e-2378-4a48-b82c-3db6310f141e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:07.463051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d319f6e-2378-4a48-b82c-3db6310f141e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:07.463486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d319f6e-2378-4a48-b82c-3db6310f141e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:07.494402 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5d319f6e-2378-4a48-b82c-3db6310f141e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046245 Oct 11 20:44:07.494999 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3387/6823] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:07 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:08.509298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-45a62225-0d75-4bd7-a2aa-fdc364dfad85 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:08.511830 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-45a62225-0d75-4bd7-a2aa-fdc364dfad85 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:08.519153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45a62225-0d75-4bd7-a2aa-fdc364dfad85 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:08.519638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45a62225-0d75-4bd7-a2aa-fdc364dfad85 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:08.520075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45a62225-0d75-4bd7-a2aa-fdc364dfad85 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:08.520991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45a62225-0d75-4bd7-a2aa-fdc364dfad85 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:08.521446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45a62225-0d75-4bd7-a2aa-fdc364dfad85 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:08.521869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-45a62225-0d75-4bd7-a2aa-fdc364dfad85 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:08.554493 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-45a62225-0d75-4bd7-a2aa-fdc364dfad85 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050077 Oct 11 20:44:08.555296 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3437/6824] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:08 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:09.567284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-32dd1803-64b5-4ec2-bace-440b1f3ed822 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:09.569509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-32dd1803-64b5-4ec2-bace-440b1f3ed822 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:09.576325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32dd1803-64b5-4ec2-bace-440b1f3ed822 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:09.576819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32dd1803-64b5-4ec2-bace-440b1f3ed822 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:09.577516 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32dd1803-64b5-4ec2-bace-440b1f3ed822 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:09.578210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32dd1803-64b5-4ec2-bace-440b1f3ed822 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:09.578711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32dd1803-64b5-4ec2-bace-440b1f3ed822 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:09.579157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-32dd1803-64b5-4ec2-bace-440b1f3ed822 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:09.608357 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-32dd1803-64b5-4ec2-bace-440b1f3ed822 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045214 Oct 11 20:44:09.608911 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3388/6825] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:09 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:44:09.620216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:09.620705 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:09.627794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:09.628288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:09.628728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:09.629425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:09.629883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:09.630308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:09.707775 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] HTTP exception thrown: Instance 01093b68-c901-48de-9597-f80113c67ba6 is not attached to volume 2da467c9-5160-4f03-a7ea-138edc0682ba Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Request method failure captured: Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments/2da467c9-5160-4f03-a7ea-138edc0682ba HTTP/1.1 Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdV4dbpYxQO4po1Ei6sLv3S5V8c49t2C1rkddjIvr8Z40Rx-amezOau8nSm3xUlbBv0YtRGvFuqR3Gfyw0ef3q3jxEdhPn9XCy9AA5d56YRO1cziEmd7OH6_Cjd9OhtvczBHM9pyng_sqg3mGYGK0FPpAuAD6LiYqgmUQ1o3zF2I0gY Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa05e8b202d947eaa3c3f3b8a2801b55", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}] Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 714195a3e8964de2a4e0e7bbe222f584 Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 01093b68-c901-48de-9597-f80113c67ba6 is not attached to volume 2da467c9-5160-4f03-a7ea-138edc0682ba Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': '01093b68-c901-48de-9597-f80113c67ba6', 'id': '2da467c9-5160-4f03-a7ea-138edc0682ba'} Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2da467c9-5160-4f03-a7ea-138edc0682ba. Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01093b68-c901-48de-9597-f80113c67ba6 is not attached to volume 2da467c9-5160-4f03-a7ea-138edc0682ba Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:44:09.718934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:44:09.723867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:44:09.723867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:44:09.723867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01093b68-c901-48de-9597-f80113c67ba6 is not attached to volume 2da467c9-5160-4f03-a7ea-138edc0682ba Oct 11 20:44:09.723867 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:44:09.723867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Returning 404 to user: Instance 01093b68-c901-48de-9597-f80113c67ba6 is not attached to volume 2da467c9-5160-4f03-a7ea-138edc0682ba {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:44:09.723867 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1fd0b4ef-25ae-497d-a13b-4632ff3ace7d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments/2da467c9-5160-4f03-a7ea-138edc0682ba" status: 404 len: 154 microversion: 2.1 time: 0.104311 Oct 11 20:44:09.723867 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3438/6826] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:44:09 2022] DELETE /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6/os-volume_attachments/2da467c9-5160-4f03-a7ea-138edc0682ba => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:44:13.064429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b1a8ed7-803b-498a-b35f-eab07230fe13 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:13.065011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7b1a8ed7-803b-498a-b35f-eab07230fe13 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:13.072091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b1a8ed7-803b-498a-b35f-eab07230fe13 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:13.072597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b1a8ed7-803b-498a-b35f-eab07230fe13 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:13.073044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b1a8ed7-803b-498a-b35f-eab07230fe13 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:13.073781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b1a8ed7-803b-498a-b35f-eab07230fe13 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:13.074280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b1a8ed7-803b-498a-b35f-eab07230fe13 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:13.074730 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b1a8ed7-803b-498a-b35f-eab07230fe13 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:13.102336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7b1a8ed7-803b-498a-b35f-eab07230fe13 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:44:13.180046 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7b1a8ed7-803b-498a-b35f-eab07230fe13 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 204 len: 0 microversion: 2.1 time: 0.119776 Oct 11 20:44:13.180792 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3389/6827] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:44:13 2022] DELETE /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:44:13.190069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8f2188fe-8591-42d1-a4cf-1abbd483b51f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:13.190841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8f2188fe-8591-42d1-a4cf-1abbd483b51f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:13.197847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f2188fe-8591-42d1-a4cf-1abbd483b51f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:13.198330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f2188fe-8591-42d1-a4cf-1abbd483b51f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:13.198798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f2188fe-8591-42d1-a4cf-1abbd483b51f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:13.199480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f2188fe-8591-42d1-a4cf-1abbd483b51f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:13.199931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f2188fe-8591-42d1-a4cf-1abbd483b51f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:13.200349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f2188fe-8591-42d1-a4cf-1abbd483b51f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:13.334501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8f2188fe-8591-42d1-a4cf-1abbd483b51f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:13.342282 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8f2188fe-8591-42d1-a4cf-1abbd483b51f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1560 microversion: 2.1 time: 0.156992 Oct 11 20:44:13.342879 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3439/6828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:13 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:14.366920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-74312484-70a1-4c42-a784-f9f865fb694d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:14.367558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-74312484-70a1-4c42-a784-f9f865fb694d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:14.374449 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74312484-70a1-4c42-a784-f9f865fb694d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:14.374978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74312484-70a1-4c42-a784-f9f865fb694d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:14.375426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74312484-70a1-4c42-a784-f9f865fb694d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:14.376422 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74312484-70a1-4c42-a784-f9f865fb694d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:14.376887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74312484-70a1-4c42-a784-f9f865fb694d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:14.377327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74312484-70a1-4c42-a784-f9f865fb694d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:14.511530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-74312484-70a1-4c42-a784-f9f865fb694d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:14.520501 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-74312484-70a1-4c42-a784-f9f865fb694d tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1560 microversion: 2.1 time: 0.158060 Oct 11 20:44:14.521071 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3390/6829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:14 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:15.139448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6323d59e-31bc-4079-b050-485a9d0a6d11 req-fbf07c17-7c28-468b-9975-93f6237f6460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01093b68-c901-48de-9597-f80113c67ba6", "name": "network-vif-deleted", "tag": "f541d389-622b-4916-9ff1-7a53f86abbf6"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:15.151172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6323d59e-31bc-4079-b050-485a9d0a6d11 req-fbf07c17-7c28-468b-9975-93f6237f6460 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:15.151653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6323d59e-31bc-4079-b050-485a9d0a6d11 req-fbf07c17-7c28-468b-9975-93f6237f6460 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:15.152083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6323d59e-31bc-4079-b050-485a9d0a6d11 req-fbf07c17-7c28-468b-9975-93f6237f6460 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:15.164729 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6323d59e-31bc-4079-b050-485a9d0a6d11 req-fbf07c17-7c28-468b-9975-93f6237f6460 service nova] Creating event network-vif-deleted:f541d389-622b-4916-9ff1-7a53f86abbf6 for instance 01093b68-c901-48de-9597-f80113c67ba6 on n-h1-860864-3 Oct 11 20:44:15.170251 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6323d59e-31bc-4079-b050-485a9d0a6d11 req-fbf07c17-7c28-468b-9975-93f6237f6460 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034450 Oct 11 20:44:15.171135 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3440/6830] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:15.544882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:15.545534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:15.553197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:15.553776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:15.554235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:15.554983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:15.555456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:15.555890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:15.587530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:15.588024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:15.588472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:15.588934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lazy-loading 'fault' on Instance uuid 01093b68-c901-48de-9597-f80113c67ba6 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:44:15.631159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:15.638315 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d0122234-a3dc-4df6-8e6e-5394f6f728d5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 200 len: 1352 microversion: 2.1 time: 0.097412 Oct 11 20:44:15.638949 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3391/6831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:15 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:16.663780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:16.664508 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 01093b68-c901-48de-9597-f80113c67ba6] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:16.670710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:16.671202 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:16.671639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:16.672328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:16.672838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:16.673287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:16.686417 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] HTTP exception thrown: Instance 01093b68-c901-48de-9597-f80113c67ba6 could not be found. Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Request method failure captured: Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 HTTP/1.1 Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdV4dbpYxQO4po1Ei6sLv3S5V8c49t2C1rkddjIvr8Z40Rx-amezOau8nSm3xUlbBv0YtRGvFuqR3Gfyw0ef3q3jxEdhPn9XCy9AA5d56YRO1cziEmd7OH6_Cjd9OhtvczBHM9pyng_sqg3mGYGK0FPpAuAD6LiYqgmUQ1o3zF2I0gY Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa05e8b202d947eaa3c3f3b8a2801b55", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}] Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 714195a3e8964de2a4e0e7bbe222f584 Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 01093b68-c901-48de-9597-f80113c67ba6 could not be found. Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '01093b68-c901-48de-9597-f80113c67ba6'} Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01093b68-c901-48de-9597-f80113c67ba6 could not be found. Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01093b68-c901-48de-9597-f80113c67ba6 could not be found. Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:44:16.688066 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01093b68-c901-48de-9597-f80113c67ba6 could not be found. Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Returning 404 to user: Instance 01093b68-c901-48de-9597-f80113c67ba6 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-da5947f4-8bfb-4818-b808-a05874bcd613 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6" status: 404 len: 111 microversion: 2.1 time: 0.031110 Oct 11 20:44:16.693011 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3441/6832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:16 2022] GET /compute/v2.1/servers/01093b68-c901-48de-9597-f80113c67ba6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:44:16.698338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c3dc08fc-cb77-4a45-9e0f-bc7d9608b90f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '.version_select at 0x7f83c46c3a60>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:16.720176 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c3dc08fc-cb77-4a45-9e0f-bc7d9608b90f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-994723970" status: 202 len: 0 microversion: 2.1 time: 0.024734 Oct 11 20:44:16.720871 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3392/6833] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:44:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-994723970 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 20:44:16.737796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-63cbe5fd-0342-4002-9aef-491dab72784e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Action: 'create', calling method: .version_select at 0x7f83c710d820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-166130851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPw3EgTaT0TxevXFvySsbFCN+qSFJNrsk9Ts4QhaozLOdulk1JAowUSr0go6ZeXRqm/95XIsWsYJz4A5qOK7zlWbejPbqqQ0+qAIDGwNOlHfWTHuKw36qpVLT5lNhCrP1A=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:16.753080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-63cbe5fd-0342-4002-9aef-491dab72784e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:44:16.758823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-63cbe5fd-0342-4002-9aef-491dab72784e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for user 714195a3e8964de2a4e0e7bbe222f584 and project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:44:16.788091 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-63cbe5fd-0342-4002-9aef-491dab72784e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.054207 Oct 11 20:44:16.788688 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3442/6834] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:44:16 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:16.838905 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-539975705", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-166130851", "networks": [{"uuid": "7fabbc3c-ce5d-4abd-810b-3e69b9bd6c58"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:16.893520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] validate_networks() for [('7fabbc3c-ce5d-4abd-810b-3e69b9bd6c58', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:44:17.382283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:44:17.382767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:44:17.383265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:44:17.383694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:44:17.384127 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:44:17.393916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:17.394414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:17.394900 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:17.395650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:17.396124 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:17.396574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:17.416782 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:44:17.422493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for user 714195a3e8964de2a4e0e7bbe222f584 and project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:44:17.435066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:44:17.437419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:44:17.487453 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-67481ff9-53ad-469c-8463-69d0fb82e341 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652472 Oct 11 20:44:17.488190 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3393/6835] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:44:17.499304 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-da95f32c-9351-4eb6-a56b-b6763eb49b5c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:17.499917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-da95f32c-9351-4eb6-a56b-b6763eb49b5c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:17.555609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-da95f32c-9351-4eb6-a56b-b6763eb49b5c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:17.562818 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-da95f32c-9351-4eb6-a56b-b6763eb49b5c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1261 microversion: 2.1 time: 0.067352 Oct 11 20:44:17.563915 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3443/6836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:17 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1261 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:18.585478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-27bca91e-5332-4abc-8fee-2bdd7b50e5a2 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:18.586330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-27bca91e-5332-4abc-8fee-2bdd7b50e5a2 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:18.593666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27bca91e-5332-4abc-8fee-2bdd7b50e5a2 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:18.594985 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27bca91e-5332-4abc-8fee-2bdd7b50e5a2 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:18.595561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27bca91e-5332-4abc-8fee-2bdd7b50e5a2 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:18.596390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27bca91e-5332-4abc-8fee-2bdd7b50e5a2 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:18.596966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27bca91e-5332-4abc-8fee-2bdd7b50e5a2 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:18.597512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27bca91e-5332-4abc-8fee-2bdd7b50e5a2 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:18.675117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-27bca91e-5332-4abc-8fee-2bdd7b50e5a2 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:18.683485 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-27bca91e-5332-4abc-8fee-2bdd7b50e5a2 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1321 microversion: 2.1 time: 0.101953 Oct 11 20:44:18.684256 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3394/6837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:18 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1321 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:19.708051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-729ac506-5ca6-41a2-b5a0-bb8e2c218c1b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:19.708667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-729ac506-5ca6-41a2-b5a0-bb8e2c218c1b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:19.715353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729ac506-5ca6-41a2-b5a0-bb8e2c218c1b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:19.715837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729ac506-5ca6-41a2-b5a0-bb8e2c218c1b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:19.716270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729ac506-5ca6-41a2-b5a0-bb8e2c218c1b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:19.717012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729ac506-5ca6-41a2-b5a0-bb8e2c218c1b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:19.717473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729ac506-5ca6-41a2-b5a0-bb8e2c218c1b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:19.718031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-729ac506-5ca6-41a2-b5a0-bb8e2c218c1b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:19.913797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-729ac506-5ca6-41a2-b5a0-bb8e2c218c1b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:19.923861 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-729ac506-5ca6-41a2-b5a0-bb8e2c218c1b tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1361 microversion: 2.1 time: 0.219299 Oct 11 20:44:19.924554 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3444/6838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:19 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:20.014665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5ce6efaa-e9a8-44fc-af64-3f5d8a8322b8 req-2c9ccbf1-7778-4b25-974c-42c6adfc434f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba457e39-d54d-484f-8391-da4a1f8a117f", "tag": "078646db-ddcd-472d-961d-c914bb8499ae"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:20.030393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ce6efaa-e9a8-44fc-af64-3f5d8a8322b8 req-2c9ccbf1-7778-4b25-974c-42c6adfc434f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:20.031032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ce6efaa-e9a8-44fc-af64-3f5d8a8322b8 req-2c9ccbf1-7778-4b25-974c-42c6adfc434f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:20.031555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5ce6efaa-e9a8-44fc-af64-3f5d8a8322b8 req-2c9ccbf1-7778-4b25-974c-42c6adfc434f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:20.043869 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5ce6efaa-e9a8-44fc-af64-3f5d8a8322b8 req-2c9ccbf1-7778-4b25-974c-42c6adfc434f service nova] Creating event network-changed:078646db-ddcd-472d-961d-c914bb8499ae for instance ba457e39-d54d-484f-8391-da4a1f8a117f on n-h2-860864-3 Oct 11 20:44:20.049860 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5ce6efaa-e9a8-44fc-af64-3f5d8a8322b8 req-2c9ccbf1-7778-4b25-974c-42c6adfc434f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038943 Oct 11 20:44:20.050732 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3395/6839] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:20.947632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6e7dde58-47fc-4a9a-bb5f-f56e71aae516 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:20.948267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6e7dde58-47fc-4a9a-bb5f-f56e71aae516 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:20.955886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e7dde58-47fc-4a9a-bb5f-f56e71aae516 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:20.956374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e7dde58-47fc-4a9a-bb5f-f56e71aae516 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:20.956815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e7dde58-47fc-4a9a-bb5f-f56e71aae516 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:20.957504 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e7dde58-47fc-4a9a-bb5f-f56e71aae516 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:20.957960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e7dde58-47fc-4a9a-bb5f-f56e71aae516 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:20.958385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6e7dde58-47fc-4a9a-bb5f-f56e71aae516 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:21.085788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6e7dde58-47fc-4a9a-bb5f-f56e71aae516 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:21.093428 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6e7dde58-47fc-4a9a-bb5f-f56e71aae516 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1361 microversion: 2.1 time: 0.149734 Oct 11 20:44:21.093999 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3445/6840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:20 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:22.118766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e07c3b67-33b6-4a65-853b-e6a4696718e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:22.119490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e07c3b67-33b6-4a65-853b-e6a4696718e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:22.126444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e07c3b67-33b6-4a65-853b-e6a4696718e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:22.127055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e07c3b67-33b6-4a65-853b-e6a4696718e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:22.127450 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e07c3b67-33b6-4a65-853b-e6a4696718e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:22.128170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e07c3b67-33b6-4a65-853b-e6a4696718e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:22.128648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e07c3b67-33b6-4a65-853b-e6a4696718e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:22.129093 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e07c3b67-33b6-4a65-853b-e6a4696718e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:22.262089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e07c3b67-33b6-4a65-853b-e6a4696718e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:22.269934 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e07c3b67-33b6-4a65-853b-e6a4696718e5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1361 microversion: 2.1 time: 0.156340 Oct 11 20:44:22.270647 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3396/6841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:22 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:23.293198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c5d8a6a3-3313-47b9-8f9c-859ac796688c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:23.293813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c5d8a6a3-3313-47b9-8f9c-859ac796688c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:23.300822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5d8a6a3-3313-47b9-8f9c-859ac796688c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:23.301356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5d8a6a3-3313-47b9-8f9c-859ac796688c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:23.301741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5d8a6a3-3313-47b9-8f9c-859ac796688c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:23.302432 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5d8a6a3-3313-47b9-8f9c-859ac796688c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:23.302916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5d8a6a3-3313-47b9-8f9c-859ac796688c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:23.303346 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c5d8a6a3-3313-47b9-8f9c-859ac796688c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:23.435779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c5d8a6a3-3313-47b9-8f9c-859ac796688c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:23.444278 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c5d8a6a3-3313-47b9-8f9c-859ac796688c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1361 microversion: 2.1 time: 0.154960 Oct 11 20:44:23.444865 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3446/6842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:23 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:24.128632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-9aef7789-0d00-4425-a6b7-05b7c4e1aacf req-81f655e9-0784-4774-a637-3128b3a414ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba457e39-d54d-484f-8391-da4a1f8a117f", "name": "network-vif-plugged", "status": "completed", "tag": "078646db-ddcd-472d-961d-c914bb8499ae"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:24.141562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9aef7789-0d00-4425-a6b7-05b7c4e1aacf req-81f655e9-0784-4774-a637-3128b3a414ee service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:24.143059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9aef7789-0d00-4425-a6b7-05b7c4e1aacf req-81f655e9-0784-4774-a637-3128b3a414ee service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:24.143457 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-9aef7789-0d00-4425-a6b7-05b7c4e1aacf req-81f655e9-0784-4774-a637-3128b3a414ee service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:24.155197 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-9aef7789-0d00-4425-a6b7-05b7c4e1aacf req-81f655e9-0784-4774-a637-3128b3a414ee service nova] Creating event network-vif-plugged:078646db-ddcd-472d-961d-c914bb8499ae for instance ba457e39-d54d-484f-8391-da4a1f8a117f on n-h2-860864-3 Oct 11 20:44:24.161062 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-9aef7789-0d00-4425-a6b7-05b7c4e1aacf req-81f655e9-0784-4774-a637-3128b3a414ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036699 Oct 11 20:44:24.161597 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3397/6843] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:44:24.467074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b2a78ca2-5976-491f-90a9-95c8ceb4b767 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:24.467812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b2a78ca2-5976-491f-90a9-95c8ceb4b767 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:24.475468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2a78ca2-5976-491f-90a9-95c8ceb4b767 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:24.475963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2a78ca2-5976-491f-90a9-95c8ceb4b767 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:24.476404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2a78ca2-5976-491f-90a9-95c8ceb4b767 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:24.477130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2a78ca2-5976-491f-90a9-95c8ceb4b767 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:24.477621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2a78ca2-5976-491f-90a9-95c8ceb4b767 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:24.478049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b2a78ca2-5976-491f-90a9-95c8ceb4b767 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:24.613523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b2a78ca2-5976-491f-90a9-95c8ceb4b767 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:24.621374 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b2a78ca2-5976-491f-90a9-95c8ceb4b767 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1361 microversion: 2.1 time: 0.158165 Oct 11 20:44:24.621945 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3447/6844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:24 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:25.645773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ab72e17e-d865-4b70-8249-782aafacf171 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:25.646488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ab72e17e-d865-4b70-8249-782aafacf171 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:25.652722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab72e17e-d865-4b70-8249-782aafacf171 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:25.653221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab72e17e-d865-4b70-8249-782aafacf171 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:25.653676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab72e17e-d865-4b70-8249-782aafacf171 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:25.654388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab72e17e-d865-4b70-8249-782aafacf171 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:25.654871 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab72e17e-d865-4b70-8249-782aafacf171 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:25.655310 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ab72e17e-d865-4b70-8249-782aafacf171 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:25.789598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ab72e17e-d865-4b70-8249-782aafacf171 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:25.797467 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ab72e17e-d865-4b70-8249-782aafacf171 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1554 microversion: 2.1 time: 0.157387 Oct 11 20:44:25.798050 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3398/6845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:25 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:25.821009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b0e3ef87-e545-4096-83ba-be94cfda6c98 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:25.821623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b0e3ef87-e545-4096-83ba-be94cfda6c98 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:25.829057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e3ef87-e545-4096-83ba-be94cfda6c98 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:25.829547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e3ef87-e545-4096-83ba-be94cfda6c98 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:25.830493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e3ef87-e545-4096-83ba-be94cfda6c98 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:25.831214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e3ef87-e545-4096-83ba-be94cfda6c98 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:25.831674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e3ef87-e545-4096-83ba-be94cfda6c98 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:25.832097 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b0e3ef87-e545-4096-83ba-be94cfda6c98 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:25.962858 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b0e3ef87-e545-4096-83ba-be94cfda6c98 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:25.971126 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b0e3ef87-e545-4096-83ba-be94cfda6c98 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1554 microversion: 2.1 time: 0.153308 Oct 11 20:44:25.971694 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3448/6846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:25 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:27.460867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4f493740-d5e6-4d1b-bf65-019d409dd40a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "582b6bd6-b443-4285-a274-236ba26836fa"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:27.463220 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4f493740-d5e6-4d1b-bf65-019d409dd40a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:27.465997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:27.466820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:27.473149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f493740-d5e6-4d1b-bf65-019d409dd40a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:27.473643 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f493740-d5e6-4d1b-bf65-019d409dd40a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:27.474090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f493740-d5e6-4d1b-bf65-019d409dd40a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:27.474824 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f493740-d5e6-4d1b-bf65-019d409dd40a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:27.475290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f493740-d5e6-4d1b-bf65-019d409dd40a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:27.475728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f493740-d5e6-4d1b-bf65-019d409dd40a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:27.712316 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4f493740-d5e6-4d1b-bf65-019d409dd40a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "POST /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255208 Oct 11 20:44:27.712960 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3399/6847] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:44:27 2022] POST /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:38.421609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aad5cdcc-d868-4d46-a974-43fa41002393 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:38.422171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aad5cdcc-d868-4d46-a974-43fa41002393 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:38.425574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:38.426348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:38.427258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=64 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:38.434232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aad5cdcc-d868-4d46-a974-43fa41002393 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:38.434766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aad5cdcc-d868-4d46-a974-43fa41002393 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:38.435208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aad5cdcc-d868-4d46-a974-43fa41002393 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:38.435907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aad5cdcc-d868-4d46-a974-43fa41002393 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:38.436361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aad5cdcc-d868-4d46-a974-43fa41002393 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:38.436789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aad5cdcc-d868-4d46-a974-43fa41002393 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:38.517345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-aad5cdcc-d868-4d46-a974-43fa41002393 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lazy-loading 'services' on Instance uuid ba457e39-d54d-484f-8391-da4a1f8a117f {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:44:38.589861 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aad5cdcc-d868-4d46-a974-43fa41002393 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments/582b6bd6-b443-4285-a274-236ba26836fa" status: 202 len: 0 microversion: 2.1 time: 0.172523 Oct 11 20:44:38.590452 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3449/6848] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:44:38 2022] DELETE /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments/582b6bd6-b443-4285-a274-236ba26836fa => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:44:38.599391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a5f519b3-58ad-4d1b-857c-cd6bc7f846a1 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:38.601763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a5f519b3-58ad-4d1b-857c-cd6bc7f846a1 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:38.604443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:38.605318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:44:38.611445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a5f519b3-58ad-4d1b-857c-cd6bc7f846a1 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:38.612436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a5f519b3-58ad-4d1b-857c-cd6bc7f846a1 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:38.612436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a5f519b3-58ad-4d1b-857c-cd6bc7f846a1 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:38.613125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a5f519b3-58ad-4d1b-857c-cd6bc7f846a1 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:38.613593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a5f519b3-58ad-4d1b-857c-cd6bc7f846a1 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:38.614032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a5f519b3-58ad-4d1b-857c-cd6bc7f846a1 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:38.649032 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a5f519b3-58ad-4d1b-857c-cd6bc7f846a1 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054082 Oct 11 20:44:38.649616 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3400/6849] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:38 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:39.663050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4553f4f5-0360-4e7b-a6bc-8387905619ba tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:39.665370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4553f4f5-0360-4e7b-a6bc-8387905619ba tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:39.671593 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4553f4f5-0360-4e7b-a6bc-8387905619ba tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:39.672079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4553f4f5-0360-4e7b-a6bc-8387905619ba tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:39.672509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4553f4f5-0360-4e7b-a6bc-8387905619ba tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:39.673540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4553f4f5-0360-4e7b-a6bc-8387905619ba tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:39.673776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4553f4f5-0360-4e7b-a6bc-8387905619ba tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:39.674195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4553f4f5-0360-4e7b-a6bc-8387905619ba tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:39.705295 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4553f4f5-0360-4e7b-a6bc-8387905619ba tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046932 Oct 11 20:44:39.705846 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3450/6850] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:39 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:40.717839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-943a71bd-8623-42fe-9bb2-7b5c5f563850 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:40.720043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-943a71bd-8623-42fe-9bb2-7b5c5f563850 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:40.726923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943a71bd-8623-42fe-9bb2-7b5c5f563850 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:40.727426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943a71bd-8623-42fe-9bb2-7b5c5f563850 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:40.727884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943a71bd-8623-42fe-9bb2-7b5c5f563850 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:40.728590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943a71bd-8623-42fe-9bb2-7b5c5f563850 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:40.729056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943a71bd-8623-42fe-9bb2-7b5c5f563850 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:40.729490 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-943a71bd-8623-42fe-9bb2-7b5c5f563850 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:40.760688 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-943a71bd-8623-42fe-9bb2-7b5c5f563850 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046848 Oct 11 20:44:40.761257 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3401/6851] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:40 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:44:41.774420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b4769193-cbe4-4095-b961-17141c47c64c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:41.776848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b4769193-cbe4-4095-b961-17141c47c64c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:41.784186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4769193-cbe4-4095-b961-17141c47c64c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:41.784676 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4769193-cbe4-4095-b961-17141c47c64c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:41.785115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4769193-cbe4-4095-b961-17141c47c64c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:41.785816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4769193-cbe4-4095-b961-17141c47c64c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:41.786427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4769193-cbe4-4095-b961-17141c47c64c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:41.786882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b4769193-cbe4-4095-b961-17141c47c64c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:41.816933 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b4769193-cbe4-4095-b961-17141c47c64c tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046554 Oct 11 20:44:41.817505 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3451/6852] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:41 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:44:42.830294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7e738683-9eed-49c1-a5e0-20d902d4b387 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:42.832507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7e738683-9eed-49c1-a5e0-20d902d4b387 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:42.839430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e738683-9eed-49c1-a5e0-20d902d4b387 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:42.839934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e738683-9eed-49c1-a5e0-20d902d4b387 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:42.840390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e738683-9eed-49c1-a5e0-20d902d4b387 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:42.841098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e738683-9eed-49c1-a5e0-20d902d4b387 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:42.841567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e738683-9eed-49c1-a5e0-20d902d4b387 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:42.842011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7e738683-9eed-49c1-a5e0-20d902d4b387 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:42.872397 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7e738683-9eed-49c1-a5e0-20d902d4b387 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046927 Oct 11 20:44:42.872967 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3402/6853] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:42 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:43.885206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f9c8ec76-4b3e-4301-ad84-5ed091b6bdf7 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:43.887566 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f9c8ec76-4b3e-4301-ad84-5ed091b6bdf7 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:43.894414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9c8ec76-4b3e-4301-ad84-5ed091b6bdf7 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:43.894929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9c8ec76-4b3e-4301-ad84-5ed091b6bdf7 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:43.895360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9c8ec76-4b3e-4301-ad84-5ed091b6bdf7 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:43.896041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9c8ec76-4b3e-4301-ad84-5ed091b6bdf7 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:43.896489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9c8ec76-4b3e-4301-ad84-5ed091b6bdf7 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:43.896905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f9c8ec76-4b3e-4301-ad84-5ed091b6bdf7 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:43.925772 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f9c8ec76-4b3e-4301-ad84-5ed091b6bdf7 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044724 Oct 11 20:44:43.926332 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3452/6854] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:44:43 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:44:43.937113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:43.937627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:43.945565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:43.946066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:43.946533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:43.947244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:43.947714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:43.948153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:44.025420 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] HTTP exception thrown: Instance ba457e39-d54d-484f-8391-da4a1f8a117f is not attached to volume 582b6bd6-b443-4285-a274-236ba26836fa Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Request method failure captured: Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments/582b6bd6-b443-4285-a274-236ba26836fa HTTP/1.1 Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdV4dbpYxQO4po1Ei6sLv3S5V8c49t2C1rkddjIvr8Z40Rx-amezOau8nSm3xUlbBv0YtRGvFuqR3Gfyw0ef3q3jxEdhPn9XCy9AA5d56YRO1cziEmd7OH6_Cjd9OhtvczBHM9pyng_sqg3mGYGK0FPpAuAD6LiYqgmUQ1o3zF2I0gY Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa05e8b202d947eaa3c3f3b8a2801b55", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}] Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 714195a3e8964de2a4e0e7bbe222f584 Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ba457e39-d54d-484f-8391-da4a1f8a117f is not attached to volume 582b6bd6-b443-4285-a274-236ba26836fa Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'server_id': 'ba457e39-d54d-484f-8391-da4a1f8a117f', 'id': '582b6bd6-b443-4285-a274-236ba26836fa'} Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 582b6bd6-b443-4285-a274-236ba26836fa. Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba457e39-d54d-484f-8391-da4a1f8a117f is not attached to volume 582b6bd6-b443-4285-a274-236ba26836fa Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:44:44.027406 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:44:44.031814 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:44:44.031814 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:44:44.031814 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba457e39-d54d-484f-8391-da4a1f8a117f is not attached to volume 582b6bd6-b443-4285-a274-236ba26836fa Oct 11 20:44:44.031814 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:44:44.031814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Returning 404 to user: Instance ba457e39-d54d-484f-8391-da4a1f8a117f is not attached to volume 582b6bd6-b443-4285-a274-236ba26836fa {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:44:44.031814 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-667f4a4a-fbaa-4142-bf54-f170ce6cc491 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments/582b6bd6-b443-4285-a274-236ba26836fa" status: 404 len: 154 microversion: 2.1 time: 0.095843 Oct 11 20:44:44.031814 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3403/6855] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:44:43 2022] DELETE /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f/os-volume_attachments/582b6bd6-b443-4285-a274-236ba26836fa => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:44:47.381909 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-02a6d325-89d9-4820-bc61-7c200e2be7cb tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:47.382416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-02a6d325-89d9-4820-bc61-7c200e2be7cb tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:47.388965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a6d325-89d9-4820-bc61-7c200e2be7cb tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:47.389453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a6d325-89d9-4820-bc61-7c200e2be7cb tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:47.389890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a6d325-89d9-4820-bc61-7c200e2be7cb tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:47.390620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a6d325-89d9-4820-bc61-7c200e2be7cb tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:47.391088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a6d325-89d9-4820-bc61-7c200e2be7cb tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:47.391532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-02a6d325-89d9-4820-bc61-7c200e2be7cb tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:47.417802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-02a6d325-89d9-4820-bc61-7c200e2be7cb tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:44:47.497543 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-02a6d325-89d9-4820-bc61-7c200e2be7cb tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 204 len: 0 microversion: 2.1 time: 0.119191 Oct 11 20:44:47.498346 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3453/6856] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:44:47 2022] DELETE /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:44:47.508034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-04a8edad-388e-4bbc-9fd7-48369f18b0d9 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:47.508767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-04a8edad-388e-4bbc-9fd7-48369f18b0d9 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:47.519607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a8edad-388e-4bbc-9fd7-48369f18b0d9 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:47.520228 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a8edad-388e-4bbc-9fd7-48369f18b0d9 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:47.520818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a8edad-388e-4bbc-9fd7-48369f18b0d9 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:47.521786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a8edad-388e-4bbc-9fd7-48369f18b0d9 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:47.522268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a8edad-388e-4bbc-9fd7-48369f18b0d9 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:47.522746 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a8edad-388e-4bbc-9fd7-48369f18b0d9 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:47.655452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-04a8edad-388e-4bbc-9fd7-48369f18b0d9 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:47.663548 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-04a8edad-388e-4bbc-9fd7-48369f18b0d9 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1560 microversion: 2.1 time: 0.159643 Oct 11 20:44:47.664155 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3404/6857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:47 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:48.687980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9588f572-f016-424a-9e75-11a483e50063 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:48.689198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9588f572-f016-424a-9e75-11a483e50063 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:48.696459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9588f572-f016-424a-9e75-11a483e50063 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:48.696938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9588f572-f016-424a-9e75-11a483e50063 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:48.697371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9588f572-f016-424a-9e75-11a483e50063 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:48.698053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9588f572-f016-424a-9e75-11a483e50063 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:48.698500 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9588f572-f016-424a-9e75-11a483e50063 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:48.698941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9588f572-f016-424a-9e75-11a483e50063 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:48.827847 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9588f572-f016-424a-9e75-11a483e50063 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:48.836081 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9588f572-f016-424a-9e75-11a483e50063 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1560 microversion: 2.1 time: 0.152384 Oct 11 20:44:48.836653 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3454/6858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:48 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:49.519786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f77d3af7-bcff-4e75-acf5-208a7dd16728 req-13fc200c-d4fe-4c9a-b1ba-99ff79a964ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba457e39-d54d-484f-8391-da4a1f8a117f", "name": "network-vif-deleted", "tag": "078646db-ddcd-472d-961d-c914bb8499ae"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:49.531624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f77d3af7-bcff-4e75-acf5-208a7dd16728 req-13fc200c-d4fe-4c9a-b1ba-99ff79a964ba service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:49.532698 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f77d3af7-bcff-4e75-acf5-208a7dd16728 req-13fc200c-d4fe-4c9a-b1ba-99ff79a964ba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:49.533461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f77d3af7-bcff-4e75-acf5-208a7dd16728 req-13fc200c-d4fe-4c9a-b1ba-99ff79a964ba service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:49.546101 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f77d3af7-bcff-4e75-acf5-208a7dd16728 req-13fc200c-d4fe-4c9a-b1ba-99ff79a964ba service nova] Creating event network-vif-deleted:078646db-ddcd-472d-961d-c914bb8499ae for instance ba457e39-d54d-484f-8391-da4a1f8a117f on n-h2-860864-3 Oct 11 20:44:49.551768 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f77d3af7-bcff-4e75-acf5-208a7dd16728 req-13fc200c-d4fe-4c9a-b1ba-99ff79a964ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035912 Oct 11 20:44:49.552397 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3405/6859] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:49.859735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:49.860363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:49.867242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:49.867725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:49.868158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:49.868835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:49.869282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:49.869700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:49.904143 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:49.904657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:49.905090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:49.905535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lazy-loading 'fault' on Instance uuid ba457e39-d54d-484f-8391-da4a1f8a117f {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:44:49.952675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:49.961515 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ae5d2798-a046-4676-8f7e-85f1c462f907 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 200 len: 1351 microversion: 2.1 time: 0.105754 Oct 11 20:44:49.962095 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3455/6860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:49 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:50.986963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:50.987699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: ba457e39-d54d-484f-8391-da4a1f8a117f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:50.993924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:50.994423 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:50.994907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:50.995617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:50.996094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:50.996538 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:51.009962 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] HTTP exception thrown: Instance ba457e39-d54d-484f-8391-da4a1f8a117f could not be found. Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Request method failure captured: Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f HTTP/1.1 Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdV4dbpYxQO4po1Ei6sLv3S5V8c49t2C1rkddjIvr8Z40Rx-amezOau8nSm3xUlbBv0YtRGvFuqR3Gfyw0ef3q3jxEdhPn9XCy9AA5d56YRO1cziEmd7OH6_Cjd9OhtvczBHM9pyng_sqg3mGYGK0FPpAuAD6LiYqgmUQ1o3zF2I0gY Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa05e8b202d947eaa3c3f3b8a2801b55", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}] Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 714195a3e8964de2a4e0e7bbe222f584 Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ba457e39-d54d-484f-8391-da4a1f8a117f could not be found. Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ba457e39-d54d-484f-8391-da4a1f8a117f'} Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba457e39-d54d-484f-8391-da4a1f8a117f could not be found. Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba457e39-d54d-484f-8391-da4a1f8a117f could not be found. Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:44:51.011621 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba457e39-d54d-484f-8391-da4a1f8a117f could not be found. Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Returning 404 to user: Instance ba457e39-d54d-484f-8391-da4a1f8a117f could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d97f5f7c-f87c-48a9-8d9b-58ba35634dcf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f" status: 404 len: 111 microversion: 2.1 time: 0.031910 Oct 11 20:44:51.016319 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3406/6861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:50 2022] GET /compute/v2.1/servers/ba457e39-d54d-484f-8391-da4a1f8a117f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:44:51.021715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-99a48424-7b1e-4d24-8747-660f11c031fd tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '.version_select at 0x7f83cc2c5670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:51.041722 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-99a48424-7b1e-4d24-8747-660f11c031fd tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-166130851" status: 202 len: 0 microversion: 2.1 time: 0.023756 Oct 11 20:44:51.042216 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3456/6862] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:44:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-166130851 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:44:51.060060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9cea777a-9509-4f24-8d47-ab4af5706f87 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Action: 'create', calling method: .version_select at 0x7f83c72e39d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-416132440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3nWq2LiS5xMAsNwPwSbwVNhvjBmkZc6Io3k6+YR7flc6eQnB6HZoRMxOQl2M1o78BDJMopQhRQ4hsfhdeBK8O2qQHOj1Xjshkpme6d7eNHi1oXf7VJQf6i8nY4O3MxMA=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:51.075670 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9cea777a-9509-4f24-8d47-ab4af5706f87 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:44:51.081713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9cea777a-9509-4f24-8d47-ab4af5706f87 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for user 714195a3e8964de2a4e0e7bbe222f584 and project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:44:51.104610 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9cea777a-9509-4f24-8d47-ab4af5706f87 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048582 Oct 11 20:44:51.105201 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3407/6863] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:44:51 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:51.156493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1863533067", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-416132440", "networks": [{"uuid": "7fabbc3c-ce5d-4abd-810b-3e69b9bd6c58"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:51.208928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] validate_networks() for [('7fabbc3c-ce5d-4abd-810b-3e69b9bd6c58', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:44:51.578959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:44:51.579520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:44:51.580094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:44:51.580502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:44:51.580910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:44:51.589677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:51.590151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:51.590605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:51.591320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:51.591768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:51.592189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:51.609023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:44:51.614224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Getting quotas for user 714195a3e8964de2a4e0e7bbe222f584 and project aa05e8b202d947eaa3c3f3b8a2801b55. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:44:51.626971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:44:51.629263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:44:51.675327 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f6552c41-5550-4ae9-8508-2267d7152214 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522738 Oct 11 20:44:51.676181 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3457/6864] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:44:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:44:51.687334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3537355f-5c2d-4422-8cdf-22af226907c6 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:51.687966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3537355f-5c2d-4422-8cdf-22af226907c6 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:51.746865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3537355f-5c2d-4422-8cdf-22af226907c6 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:51.755967 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3537355f-5c2d-4422-8cdf-22af226907c6 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1262 microversion: 2.1 time: 0.072655 Oct 11 20:44:51.757150 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3408/6865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:51 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:52.782773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cced5947-4522-46de-ab83-88421c274f7f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:52.784488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cced5947-4522-46de-ab83-88421c274f7f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:52.793326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cced5947-4522-46de-ab83-88421c274f7f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:52.793892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cced5947-4522-46de-ab83-88421c274f7f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:52.794407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cced5947-4522-46de-ab83-88421c274f7f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:52.795206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cced5947-4522-46de-ab83-88421c274f7f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:52.796064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cced5947-4522-46de-ab83-88421c274f7f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:52.796798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cced5947-4522-46de-ab83-88421c274f7f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:52.871031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cced5947-4522-46de-ab83-88421c274f7f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:52.880185 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cced5947-4522-46de-ab83-88421c274f7f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1322 microversion: 2.1 time: 0.102781 Oct 11 20:44:52.881015 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3458/6866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:52 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1322 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:53.904922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a15cec4f-7426-4793-8149-90f6b5d22e06 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:53.905641 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a15cec4f-7426-4793-8149-90f6b5d22e06 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:53.921002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a15cec4f-7426-4793-8149-90f6b5d22e06 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:53.921605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a15cec4f-7426-4793-8149-90f6b5d22e06 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:53.921951 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a15cec4f-7426-4793-8149-90f6b5d22e06 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:53.923463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a15cec4f-7426-4793-8149-90f6b5d22e06 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:53.923954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a15cec4f-7426-4793-8149-90f6b5d22e06 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:53.924406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a15cec4f-7426-4793-8149-90f6b5d22e06 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:54.116496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a15cec4f-7426-4793-8149-90f6b5d22e06 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:54.124327 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a15cec4f-7426-4793-8149-90f6b5d22e06 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1362 microversion: 2.1 time: 0.223583 Oct 11 20:44:54.124915 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3409/6867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:53 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:54.194434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-cc0e47af-afce-435d-b4ef-10d858b1b12e req-5cd786c8-425f-4566-9338-f163b423dd16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0701e6e0-817b-4e3c-a7f1-247e3cf7f29c", "tag": "1ead4590-2bad-4530-9e8a-a5e86fd02bed"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:54.207690 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cc0e47af-afce-435d-b4ef-10d858b1b12e req-5cd786c8-425f-4566-9338-f163b423dd16 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:54.208449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cc0e47af-afce-435d-b4ef-10d858b1b12e req-5cd786c8-425f-4566-9338-f163b423dd16 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:54.208611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cc0e47af-afce-435d-b4ef-10d858b1b12e req-5cd786c8-425f-4566-9338-f163b423dd16 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:54.220643 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-cc0e47af-afce-435d-b4ef-10d858b1b12e req-5cd786c8-425f-4566-9338-f163b423dd16 service nova] Creating event network-changed:1ead4590-2bad-4530-9e8a-a5e86fd02bed for instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c on n-h1-860864-3 Oct 11 20:44:54.226125 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-cc0e47af-afce-435d-b4ef-10d858b1b12e req-5cd786c8-425f-4566-9338-f163b423dd16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035405 Oct 11 20:44:54.226937 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3459/6868] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:44:55.148467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9ef5fda2-f42e-45ed-b825-af30b4516ed5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:55.149092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9ef5fda2-f42e-45ed-b825-af30b4516ed5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:55.156007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ef5fda2-f42e-45ed-b825-af30b4516ed5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:55.156505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ef5fda2-f42e-45ed-b825-af30b4516ed5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:55.156958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ef5fda2-f42e-45ed-b825-af30b4516ed5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:55.158181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ef5fda2-f42e-45ed-b825-af30b4516ed5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:55.158683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ef5fda2-f42e-45ed-b825-af30b4516ed5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:55.159121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9ef5fda2-f42e-45ed-b825-af30b4516ed5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:55.290812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9ef5fda2-f42e-45ed-b825-af30b4516ed5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:55.298796 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9ef5fda2-f42e-45ed-b825-af30b4516ed5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1362 microversion: 2.1 time: 0.154089 Oct 11 20:44:55.299389 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3410/6869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:55 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:56.323741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4f3243b0-4ca8-40ca-ab00-b60f1dc57f68 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:56.324442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4f3243b0-4ca8-40ca-ab00-b60f1dc57f68 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:56.331743 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3243b0-4ca8-40ca-ab00-b60f1dc57f68 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:56.332157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3243b0-4ca8-40ca-ab00-b60f1dc57f68 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:56.332590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3243b0-4ca8-40ca-ab00-b60f1dc57f68 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:56.333269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3243b0-4ca8-40ca-ab00-b60f1dc57f68 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:56.333720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3243b0-4ca8-40ca-ab00-b60f1dc57f68 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:56.334139 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4f3243b0-4ca8-40ca-ab00-b60f1dc57f68 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:56.466272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4f3243b0-4ca8-40ca-ab00-b60f1dc57f68 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:56.474775 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4f3243b0-4ca8-40ca-ab00-b60f1dc57f68 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1362 microversion: 2.1 time: 0.156255 Oct 11 20:44:56.475358 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3460/6870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:56 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:57.497273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b9bddbaf-fb51-47a7-b99e-fddec8d03bae tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:57.497903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b9bddbaf-fb51-47a7-b99e-fddec8d03bae tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:57.504932 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9bddbaf-fb51-47a7-b99e-fddec8d03bae tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:57.505446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9bddbaf-fb51-47a7-b99e-fddec8d03bae tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:57.505906 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9bddbaf-fb51-47a7-b99e-fddec8d03bae tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:57.506642 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9bddbaf-fb51-47a7-b99e-fddec8d03bae tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:57.507121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9bddbaf-fb51-47a7-b99e-fddec8d03bae tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:57.507567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b9bddbaf-fb51-47a7-b99e-fddec8d03bae tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:57.634468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b9bddbaf-fb51-47a7-b99e-fddec8d03bae tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:57.642358 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b9bddbaf-fb51-47a7-b99e-fddec8d03bae tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1362 microversion: 2.1 time: 0.148995 Oct 11 20:44:57.642970 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3411/6871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:57 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:58.070767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-b2034b6a-3362-4eff-ad4e-ccbfc74df372 req-ee85a7e9-a35d-4f8e-ae83-042d5c44a85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0701e6e0-817b-4e3c-a7f1-247e3cf7f29c", "name": "network-vif-plugged", "status": "completed", "tag": "1ead4590-2bad-4530-9e8a-a5e86fd02bed"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:44:58.082403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b2034b6a-3362-4eff-ad4e-ccbfc74df372 req-ee85a7e9-a35d-4f8e-ae83-042d5c44a85b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:58.082993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b2034b6a-3362-4eff-ad4e-ccbfc74df372 req-ee85a7e9-a35d-4f8e-ae83-042d5c44a85b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:58.083435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-b2034b6a-3362-4eff-ad4e-ccbfc74df372 req-ee85a7e9-a35d-4f8e-ae83-042d5c44a85b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:58.095753 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-b2034b6a-3362-4eff-ad4e-ccbfc74df372 req-ee85a7e9-a35d-4f8e-ae83-042d5c44a85b service nova] Creating event network-vif-plugged:1ead4590-2bad-4530-9e8a-a5e86fd02bed for instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c on n-h1-860864-3 Oct 11 20:44:58.100030 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-b2034b6a-3362-4eff-ad4e-ccbfc74df372 req-ee85a7e9-a35d-4f8e-ae83-042d5c44a85b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033097 Oct 11 20:44:58.100625 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3461/6872] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:44:58.665368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c3eb8780-3515-4f0f-857a-1191bcc7aecf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:58.666029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c3eb8780-3515-4f0f-857a-1191bcc7aecf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:58.673521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3eb8780-3515-4f0f-857a-1191bcc7aecf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:58.674026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3eb8780-3515-4f0f-857a-1191bcc7aecf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:58.674484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3eb8780-3515-4f0f-857a-1191bcc7aecf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:58.675217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3eb8780-3515-4f0f-857a-1191bcc7aecf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:58.675692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3eb8780-3515-4f0f-857a-1191bcc7aecf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:58.676138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c3eb8780-3515-4f0f-857a-1191bcc7aecf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:58.809080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c3eb8780-3515-4f0f-857a-1191bcc7aecf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:58.817613 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c3eb8780-3515-4f0f-857a-1191bcc7aecf tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1362 microversion: 2.1 time: 0.156182 Oct 11 20:44:58.818199 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3412/6873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:58 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:44:59.842613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7d9a5e41-cb42-4a5c-ac63-fd89d8221642 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:44:59.843316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d9a5e41-cb42-4a5c-ac63-fd89d8221642 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:44:59.849771 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d9a5e41-cb42-4a5c-ac63-fd89d8221642 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:59.850282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d9a5e41-cb42-4a5c-ac63-fd89d8221642 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:59.850752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d9a5e41-cb42-4a5c-ac63-fd89d8221642 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:59.851435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d9a5e41-cb42-4a5c-ac63-fd89d8221642 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:44:59.851888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d9a5e41-cb42-4a5c-ac63-fd89d8221642 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:44:59.852311 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d9a5e41-cb42-4a5c-ac63-fd89d8221642 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:44:59.987383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7d9a5e41-cb42-4a5c-ac63-fd89d8221642 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:44:59.995075 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7d9a5e41-cb42-4a5c-ac63-fd89d8221642 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1555 microversion: 2.1 time: 0.157664 Oct 11 20:44:59.995647 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3462/6874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:44:59 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:45:00.018742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b5bb8b3c-ce03-4e37-a22f-70cbfb3dcfd4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:00.019374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b5bb8b3c-ce03-4e37-a22f-70cbfb3dcfd4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:00.026229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5bb8b3c-ce03-4e37-a22f-70cbfb3dcfd4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:00.026766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5bb8b3c-ce03-4e37-a22f-70cbfb3dcfd4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:00.027224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5bb8b3c-ce03-4e37-a22f-70cbfb3dcfd4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:00.027935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5bb8b3c-ce03-4e37-a22f-70cbfb3dcfd4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:00.028411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5bb8b3c-ce03-4e37-a22f-70cbfb3dcfd4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:00.028857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b5bb8b3c-ce03-4e37-a22f-70cbfb3dcfd4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:00.158255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b5bb8b3c-ce03-4e37-a22f-70cbfb3dcfd4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:45:00.166026 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b5bb8b3c-ce03-4e37-a22f-70cbfb3dcfd4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1555 microversion: 2.1 time: 0.151872 Oct 11 20:45:00.166628 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3413/6875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:00 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:45:01.655256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce5eb3c4-395d-4215-8997-03396d142f46 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cddada97-a6a8-4bfd-90c1-6619e17f4929"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:45:01.657630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ce5eb3c4-395d-4215-8997-03396d142f46 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:01.660480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:01.661154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:01.667651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5eb3c4-395d-4215-8997-03396d142f46 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:01.668142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5eb3c4-395d-4215-8997-03396d142f46 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:01.668583 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5eb3c4-395d-4215-8997-03396d142f46 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:01.669275 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5eb3c4-395d-4215-8997-03396d142f46 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:01.669731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5eb3c4-395d-4215-8997-03396d142f46 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:01.670157 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce5eb3c4-395d-4215-8997-03396d142f46 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:01.904831 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ce5eb3c4-395d-4215-8997-03396d142f46 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "POST /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253337 Oct 11 20:45:01.905512 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3463/6876] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:45:01 2022] POST /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:45:12.626288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-30abad87-eb0c-4f0c-91a1-549770d2927a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:12.626854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-30abad87-eb0c-4f0c-91a1-549770d2927a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:12.629050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:12.629920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:12.630605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=64 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:12.637008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30abad87-eb0c-4f0c-91a1-549770d2927a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:12.637506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30abad87-eb0c-4f0c-91a1-549770d2927a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:12.637956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30abad87-eb0c-4f0c-91a1-549770d2927a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:12.638686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30abad87-eb0c-4f0c-91a1-549770d2927a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:12.639157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30abad87-eb0c-4f0c-91a1-549770d2927a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:12.639597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-30abad87-eb0c-4f0c-91a1-549770d2927a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:12.718658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-30abad87-eb0c-4f0c-91a1-549770d2927a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lazy-loading 'services' on Instance uuid 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:45:12.790080 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-30abad87-eb0c-4f0c-91a1-549770d2927a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments/cddada97-a6a8-4bfd-90c1-6619e17f4929" status: 202 len: 0 microversion: 2.1 time: 0.167678 Oct 11 20:45:12.790698 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3414/6877] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:45:12 2022] DELETE /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments/cddada97-a6a8-4bfd-90c1-6619e17f4929 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:45:12.800755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2349aa1e-6715-4836-ac41-9ada0c25c765 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:12.803626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2349aa1e-6715-4836-ac41-9ada0c25c765 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:12.806864 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:12.807982 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:12.816648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2349aa1e-6715-4836-ac41-9ada0c25c765 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:12.817869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2349aa1e-6715-4836-ac41-9ada0c25c765 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:12.818609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2349aa1e-6715-4836-ac41-9ada0c25c765 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:12.819318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2349aa1e-6715-4836-ac41-9ada0c25c765 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:12.819850 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2349aa1e-6715-4836-ac41-9ada0c25c765 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:12.820544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2349aa1e-6715-4836-ac41-9ada0c25c765 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:12.857448 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2349aa1e-6715-4836-ac41-9ada0c25c765 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061559 Oct 11 20:45:12.858013 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3464/6878] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:45:12 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:45:13.871452 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-755305fb-b532-4533-8f9e-19d5070c0de5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:13.873938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-755305fb-b532-4533-8f9e-19d5070c0de5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:13.881943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755305fb-b532-4533-8f9e-19d5070c0de5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:13.882476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755305fb-b532-4533-8f9e-19d5070c0de5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:13.882961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755305fb-b532-4533-8f9e-19d5070c0de5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:13.883673 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755305fb-b532-4533-8f9e-19d5070c0de5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:13.884154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755305fb-b532-4533-8f9e-19d5070c0de5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:13.884658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-755305fb-b532-4533-8f9e-19d5070c0de5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:13.915856 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-755305fb-b532-4533-8f9e-19d5070c0de5 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048761 Oct 11 20:45:13.916441 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3415/6879] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:45:13 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:45:14.928841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0abb0d40-4dfc-4053-bc74-4007c285324a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:14.931051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0abb0d40-4dfc-4053-bc74-4007c285324a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:14.938163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0abb0d40-4dfc-4053-bc74-4007c285324a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:14.938689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0abb0d40-4dfc-4053-bc74-4007c285324a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:14.939126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0abb0d40-4dfc-4053-bc74-4007c285324a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:14.940845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0abb0d40-4dfc-4053-bc74-4007c285324a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:14.941312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0abb0d40-4dfc-4053-bc74-4007c285324a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:14.941739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0abb0d40-4dfc-4053-bc74-4007c285324a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:14.973585 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0abb0d40-4dfc-4053-bc74-4007c285324a tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049171 Oct 11 20:45:14.974158 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3465/6880] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:45:14 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:45:15.985737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2d585dbc-9081-4347-80e1-0b132bc9b570 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:15.988203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2d585dbc-9081-4347-80e1-0b132bc9b570 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:15.995225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d585dbc-9081-4347-80e1-0b132bc9b570 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:15.995724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d585dbc-9081-4347-80e1-0b132bc9b570 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:15.996167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d585dbc-9081-4347-80e1-0b132bc9b570 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:15.996859 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d585dbc-9081-4347-80e1-0b132bc9b570 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:15.997322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d585dbc-9081-4347-80e1-0b132bc9b570 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:15.997766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2d585dbc-9081-4347-80e1-0b132bc9b570 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:16.027700 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2d585dbc-9081-4347-80e1-0b132bc9b570 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Oct 11 20:45:16.028267 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3416/6881] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:45:15 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:45:17.039448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2fd3348e-731b-475d-b6fc-45037b4559b4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:17.041624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2fd3348e-731b-475d-b6fc-45037b4559b4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:17.048225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fd3348e-731b-475d-b6fc-45037b4559b4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:17.048644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fd3348e-731b-475d-b6fc-45037b4559b4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:17.049199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fd3348e-731b-475d-b6fc-45037b4559b4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:17.049921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fd3348e-731b-475d-b6fc-45037b4559b4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:17.050382 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fd3348e-731b-475d-b6fc-45037b4559b4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:17.050813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fd3348e-731b-475d-b6fc-45037b4559b4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:17.087442 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2fd3348e-731b-475d-b6fc-45037b4559b4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052070 Oct 11 20:45:17.088023 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3466/6882] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:45:17 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:45:18.100653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e539aa7e-12e7-4159-8a7b-2503611d93de tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:18.102851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e539aa7e-12e7-4159-8a7b-2503611d93de tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:18.109570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e539aa7e-12e7-4159-8a7b-2503611d93de tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:18.110064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e539aa7e-12e7-4159-8a7b-2503611d93de tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:18.110512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e539aa7e-12e7-4159-8a7b-2503611d93de tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:18.111230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e539aa7e-12e7-4159-8a7b-2503611d93de tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:18.111693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e539aa7e-12e7-4159-8a7b-2503611d93de tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:18.112125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e539aa7e-12e7-4159-8a7b-2503611d93de tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:18.140743 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e539aa7e-12e7-4159-8a7b-2503611d93de tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044821 Oct 11 20:45:18.141291 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3417/6883] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:45:18 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:45:18.152430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:18.152934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:18.159746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:18.160262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:18.161252 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:18.162118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:18.162599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:18.163025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:18.318291 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] HTTP exception thrown: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c is not attached to volume cddada97-a6a8-4bfd-90c1-6619e17f4929 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Request method failure captured: Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments/cddada97-a6a8-4bfd-90c1-6619e17f4929 HTTP/1.1 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdV4dbpYxQO4po1Ei6sLv3S5V8c49t2C1rkddjIvr8Z40Rx-amezOau8nSm3xUlbBv0YtRGvFuqR3Gfyw0ef3q3jxEdhPn9XCy9AA5d56YRO1cziEmd7OH6_Cjd9OhtvczBHM9pyng_sqg3mGYGK0FPpAuAD6LiYqgmUQ1o3zF2I0gY Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa05e8b202d947eaa3c3f3b8a2801b55", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}] Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 714195a3e8964de2a4e0e7bbe222f584 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c is not attached to volume cddada97-a6a8-4bfd-90c1-6619e17f4929 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': '0701e6e0-817b-4e3c-a7f1-247e3cf7f29c', 'id': 'cddada97-a6a8-4bfd-90c1-6619e17f4929'} Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cddada97-a6a8-4bfd-90c1-6619e17f4929. Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c is not attached to volume cddada97-a6a8-4bfd-90c1-6619e17f4929 Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:45:18.319934 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:45:18.324912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:45:18.324912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:45:18.324912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c is not attached to volume cddada97-a6a8-4bfd-90c1-6619e17f4929 Oct 11 20:45:18.324912 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:45:18.324912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Returning 404 to user: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c is not attached to volume cddada97-a6a8-4bfd-90c1-6619e17f4929 {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:45:18.324912 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc7392e3-4624-4713-bbd3-949d8fe27f99 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments/cddada97-a6a8-4bfd-90c1-6619e17f4929" status: 404 len: 154 microversion: 2.1 time: 0.173008 Oct 11 20:45:18.324912 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3467/6884] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:45:18 2022] DELETE /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c/os-volume_attachments/cddada97-a6a8-4bfd-90c1-6619e17f4929 => generated 154 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:45:21.670382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-cd2777e3-2210-4f5f-aed9-818b64a2eb2e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:21.671007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cd2777e3-2210-4f5f-aed9-818b64a2eb2e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:21.679205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd2777e3-2210-4f5f-aed9-818b64a2eb2e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:21.679738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd2777e3-2210-4f5f-aed9-818b64a2eb2e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:21.680351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd2777e3-2210-4f5f-aed9-818b64a2eb2e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:21.681383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd2777e3-2210-4f5f-aed9-818b64a2eb2e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:21.681873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd2777e3-2210-4f5f-aed9-818b64a2eb2e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:21.682343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-cd2777e3-2210-4f5f-aed9-818b64a2eb2e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:21.712139 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-cd2777e3-2210-4f5f-aed9-818b64a2eb2e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:45:22.081582 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-cd2777e3-2210-4f5f-aed9-818b64a2eb2e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 204 len: 0 microversion: 2.1 time: 0.414971 Oct 11 20:45:22.086491 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3418/6885] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:45:21 2022] DELETE /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:45:22.091657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f8d3d0f-da60-43a9-ab71-295131b10ec4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:22.092285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f8d3d0f-da60-43a9-ab71-295131b10ec4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:22.100898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f8d3d0f-da60-43a9-ab71-295131b10ec4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:22.101390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f8d3d0f-da60-43a9-ab71-295131b10ec4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:22.101833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f8d3d0f-da60-43a9-ab71-295131b10ec4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:22.102544 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f8d3d0f-da60-43a9-ab71-295131b10ec4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:22.103010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f8d3d0f-da60-43a9-ab71-295131b10ec4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:22.103443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2f8d3d0f-da60-43a9-ab71-295131b10ec4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:22.238557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f8d3d0f-da60-43a9-ab71-295131b10ec4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:45:22.246250 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f8d3d0f-da60-43a9-ab71-295131b10ec4 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1561 microversion: 2.1 time: 0.158621 Oct 11 20:45:22.246845 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3468/6886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:22 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:45:23.270776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d5794cc6-232b-4f22-91d5-79a1bfdf0983 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:23.271480 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d5794cc6-232b-4f22-91d5-79a1bfdf0983 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:23.281273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5794cc6-232b-4f22-91d5-79a1bfdf0983 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:23.281758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5794cc6-232b-4f22-91d5-79a1bfdf0983 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:23.282205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5794cc6-232b-4f22-91d5-79a1bfdf0983 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:23.282924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5794cc6-232b-4f22-91d5-79a1bfdf0983 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:23.283400 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5794cc6-232b-4f22-91d5-79a1bfdf0983 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:23.283835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5794cc6-232b-4f22-91d5-79a1bfdf0983 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:23.465169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d5794cc6-232b-4f22-91d5-79a1bfdf0983 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:45:23.473016 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d5794cc6-232b-4f22-91d5-79a1bfdf0983 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1561 microversion: 2.1 time: 0.206602 Oct 11 20:45:23.473648 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3419/6887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:23 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1561 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:45:24.087630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-54f2d614-d4b8-44f0-8780-9eab8f7177ef req-5009f1d0-10d0-4b66-955e-674d75f32fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0701e6e0-817b-4e3c-a7f1-247e3cf7f29c", "name": "network-vif-deleted", "tag": "1ead4590-2bad-4530-9e8a-a5e86fd02bed"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:45:24.104696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54f2d614-d4b8-44f0-8780-9eab8f7177ef req-5009f1d0-10d0-4b66-955e-674d75f32fa3 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:24.105415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54f2d614-d4b8-44f0-8780-9eab8f7177ef req-5009f1d0-10d0-4b66-955e-674d75f32fa3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:24.106629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54f2d614-d4b8-44f0-8780-9eab8f7177ef req-5009f1d0-10d0-4b66-955e-674d75f32fa3 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:24.122136 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-54f2d614-d4b8-44f0-8780-9eab8f7177ef req-5009f1d0-10d0-4b66-955e-674d75f32fa3 service nova] Creating event network-vif-deleted:1ead4590-2bad-4530-9e8a-a5e86fd02bed for instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c on n-h1-860864-3 Oct 11 20:45:24.128308 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-54f2d614-d4b8-44f0-8780-9eab8f7177ef req-5009f1d0-10d0-4b66-955e-674d75f32fa3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051253 Oct 11 20:45:24.129532 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3469/6888] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:45:24.498855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:24.499527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:24.509366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:24.510070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:24.510619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:24.519779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:24.522848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:24.523376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:24.559227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:24.559819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:24.560604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:24.561238 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lazy-loading 'fault' on Instance uuid 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:45:24.613337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714195a3e8964de2a4e0e7bbe222f584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa05e8b202d947eaa3c3f3b8a2801b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:45:24.622903 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bcee7125-11bc-452d-bcc4-3a630356136f tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 200 len: 1352 microversion: 2.1 time: 0.129334 Oct 11 20:45:24.623714 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3420/6889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:24 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 1352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:45:25.649250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:25.649965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] [instance: 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:25.657094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:25.657584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:25.658026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:25.658752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:25.659214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:25.659646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:25.675859 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] HTTP exception thrown: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c could not be found. Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Request method failure captured: Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c HTTP/1.1 Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdV4dbpYxQO4po1Ei6sLv3S5V8c49t2C1rkddjIvr8Z40Rx-amezOau8nSm3xUlbBv0YtRGvFuqR3Gfyw0ef3q3jxEdhPn9XCy9AA5d56YRO1cziEmd7OH6_Cjd9OhtvczBHM9pyng_sqg3mGYGK0FPpAuAD6LiYqgmUQ1o3zF2I0gY Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa05e8b202d947eaa3c3f3b8a2801b55", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa05e8b202d947eaa3c3f3b8a2801b55"}]}] Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: aa05e8b202d947eaa3c3f3b8a2801b55 Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1637884892 Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 714195a3e8964de2a4e0e7bbe222f584 Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestEncryptedCinderVolumes-1637884892-project Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c could not be found. Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '0701e6e0-817b-4e3c-a7f1-247e3cf7f29c'} Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c could not be found. Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c could not be found. Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:45:25.677501 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c could not be found. Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Returning 404 to user: Instance 0701e6e0-817b-4e3c-a7f1-247e3cf7f29c could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5c07c314-f9e6-40a7-a8c8-640247f3a79e tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c" status: 404 len: 111 microversion: 2.1 time: 0.034559 Oct 11 20:45:25.682284 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3470/6890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:25 2022] GET /compute/v2.1/servers/0701e6e0-817b-4e3c-a7f1-247e3cf7f29c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:45:25.687743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a9cef8b-9c79-4cb6-acd6-db4ae1f00a63 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] Calling method '.version_select at 0x7f83c46ff940>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:25.708811 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a9cef8b-9c79-4cb6-acd6-db4ae1f00a63 tempest-TestEncryptedCinderVolumes-1637884892 tempest-TestEncryptedCinderVolumes-1637884892-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-416132440" status: 202 len: 0 microversion: 2.1 time: 0.024601 Oct 11 20:45:25.709318 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3421/6891] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 11 20:45:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-416132440 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 20:45:52.709492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-063b8bac-6f57-4a77-b91c-efdec67b7da1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'create', calling method: .version_select at 0x7f83d0888ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1956338056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa+1CW3+eRQ82Tsoj2hrMoKdH7poFKlOyjuvGTmdH2Dem7VtUbkZpFuhQFMUUmIKpLrwCS0/MJUCrdatIBBDP5o8i+mpkV8riI0DUjJNN4zFgeZ154auz++1ZhR/IVhYw=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:45:52.715054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=14 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:52.715702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=34 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:52.727466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-063b8bac-6f57-4a77-b91c-efdec67b7da1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Getting quotas for project 556f7772059641f894f356c197fff449. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:45:52.732689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-063b8bac-6f57-4a77-b91c-efdec67b7da1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Getting quotas for user 884b1e8363c1469b841b15d270a78641 and project 556f7772059641f894f356c197fff449. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:45:52.756473 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-063b8bac-6f57-4a77-b91c-efdec67b7da1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051097 Oct 11 20:45:52.757260 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3471/6892] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:45:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:45:52.806272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:52.807073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:45:52.811255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1407988469", "imageRef": "1ffd5aae-c2df-4409-82bb-c9f4bcbe4a29", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1956338056", "networks": [{"uuid": "f2290512-ae2e-49e4-a349-c59b07511e33"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:45:52.870078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] validate_networks() for [('f2290512-ae2e-49e4-a349-c59b07511e33', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:45:53.245717 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:45:53.246149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:45:53.246691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:45:53.247111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:45:53.247531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:45:53.256863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:53.257355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:53.257799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:53.258548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:53.259017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:53.259455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:53.277193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Getting quotas for project 556f7772059641f894f356c197fff449. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:45:53.282377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Getting quotas for user 884b1e8363c1469b841b15d270a78641 and project 556f7772059641f894f356c197fff449. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:45:53.294735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:45:53.297005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1ffd5aae-c2df-4409-82bb-c9f4bcbe4a29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:45:53.345566 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ebf392ff-4da1-4e63-91b6-a682b44b3ed0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541252 Oct 11 20:45:53.346311 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3422/6893] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:45:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:45:53.357595 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2d0b0d0b-f12a-4abb-91d2-16d22688f802 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:53.358207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2d0b0d0b-f12a-4abb-91d2-16d22688f802 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:53.412977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2d0b0d0b-f12a-4abb-91d2-16d22688f802 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:45:53.419910 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2d0b0d0b-f12a-4abb-91d2-16d22688f802 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1259 microversion: 2.1 time: 0.066281 Oct 11 20:45:53.420506 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3472/6894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:53 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:45:54.445739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b7358dff-c180-4bb7-9802-952c65adcf89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:54.446786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b7358dff-c180-4bb7-9802-952c65adcf89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:54.454416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7358dff-c180-4bb7-9802-952c65adcf89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:54.455048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7358dff-c180-4bb7-9802-952c65adcf89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:54.455582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7358dff-c180-4bb7-9802-952c65adcf89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:54.456437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7358dff-c180-4bb7-9802-952c65adcf89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:54.457250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7358dff-c180-4bb7-9802-952c65adcf89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:54.457761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b7358dff-c180-4bb7-9802-952c65adcf89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:54.533102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b7358dff-c180-4bb7-9802-952c65adcf89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:45:54.544927 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b7358dff-c180-4bb7-9802-952c65adcf89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1317 microversion: 2.1 time: 0.103209 Oct 11 20:45:54.546220 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3423/6895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:54 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1317 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:45:55.570407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d5c98974-0bd4-4315-bfbf-3c15e883c180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:55.571254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d5c98974-0bd4-4315-bfbf-3c15e883c180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:55.580316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5c98974-0bd4-4315-bfbf-3c15e883c180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:55.580815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5c98974-0bd4-4315-bfbf-3c15e883c180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:55.581429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5c98974-0bd4-4315-bfbf-3c15e883c180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:55.582180 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5c98974-0bd4-4315-bfbf-3c15e883c180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:55.582663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5c98974-0bd4-4315-bfbf-3c15e883c180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:55.583130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d5c98974-0bd4-4315-bfbf-3c15e883c180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:55.730020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d5c98974-0bd4-4315-bfbf-3c15e883c180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:45:55.739159 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d5c98974-0bd4-4315-bfbf-3c15e883c180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.173497 Oct 11 20:45:55.739772 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3473/6896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:55 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:45:56.764889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-596913b8-4d2a-4c4b-be1b-4f09da88ef40 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:56.765523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-596913b8-4d2a-4c4b-be1b-4f09da88ef40 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:56.774007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-596913b8-4d2a-4c4b-be1b-4f09da88ef40 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:56.774511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-596913b8-4d2a-4c4b-be1b-4f09da88ef40 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:56.774990 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-596913b8-4d2a-4c4b-be1b-4f09da88ef40 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:56.775699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-596913b8-4d2a-4c4b-be1b-4f09da88ef40 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:56.776169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-596913b8-4d2a-4c4b-be1b-4f09da88ef40 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:56.776628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-596913b8-4d2a-4c4b-be1b-4f09da88ef40 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:56.930710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-596913b8-4d2a-4c4b-be1b-4f09da88ef40 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:45:56.939027 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-596913b8-4d2a-4c4b-be1b-4f09da88ef40 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.179318 Oct 11 20:45:56.940035 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3424/6897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:56 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:45:57.964116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61878e96-4d73-4034-a6b1-11823cfd08ac tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:57.964780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-61878e96-4d73-4034-a6b1-11823cfd08ac tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:57.971640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61878e96-4d73-4034-a6b1-11823cfd08ac tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:57.972959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61878e96-4d73-4034-a6b1-11823cfd08ac tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:57.973532 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61878e96-4d73-4034-a6b1-11823cfd08ac tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:57.974319 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61878e96-4d73-4034-a6b1-11823cfd08ac tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:57.974823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61878e96-4d73-4034-a6b1-11823cfd08ac tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:57.975269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61878e96-4d73-4034-a6b1-11823cfd08ac tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:58.116023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-61878e96-4d73-4034-a6b1-11823cfd08ac tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:45:58.126880 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-61878e96-4d73-4034-a6b1-11823cfd08ac tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.166550 Oct 11 20:45:58.135407 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3474/6898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:57 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:45:59.150802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3c1e603c-6010-4a05-afd8-a37e52ab4108 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:45:59.151624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3c1e603c-6010-4a05-afd8-a37e52ab4108 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:45:59.162811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c1e603c-6010-4a05-afd8-a37e52ab4108 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:59.163337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c1e603c-6010-4a05-afd8-a37e52ab4108 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:59.163781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c1e603c-6010-4a05-afd8-a37e52ab4108 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:59.164512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c1e603c-6010-4a05-afd8-a37e52ab4108 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:45:59.164987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c1e603c-6010-4a05-afd8-a37e52ab4108 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:45:59.165428 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3c1e603c-6010-4a05-afd8-a37e52ab4108 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:45:59.319945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3c1e603c-6010-4a05-afd8-a37e52ab4108 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:45:59.328472 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3c1e603c-6010-4a05-afd8-a37e52ab4108 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.181804 Oct 11 20:45:59.329316 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3425/6899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:45:59 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:00.353122 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6729990d-717b-4023-a273-4b3165cd31a7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:00.353764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6729990d-717b-4023-a273-4b3165cd31a7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:00.362498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6729990d-717b-4023-a273-4b3165cd31a7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:00.365596 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6729990d-717b-4023-a273-4b3165cd31a7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:00.366387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6729990d-717b-4023-a273-4b3165cd31a7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:00.368131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6729990d-717b-4023-a273-4b3165cd31a7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:00.368874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6729990d-717b-4023-a273-4b3165cd31a7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:00.369524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6729990d-717b-4023-a273-4b3165cd31a7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:00.532273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6729990d-717b-4023-a273-4b3165cd31a7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:00.541084 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6729990d-717b-4023-a273-4b3165cd31a7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.191819 Oct 11 20:46:00.541889 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3475/6900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:00 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:01.565170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-abf500da-5eda-4ab0-a0df-23d1f0475e05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:01.566129 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-abf500da-5eda-4ab0-a0df-23d1f0475e05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:01.574168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abf500da-5eda-4ab0-a0df-23d1f0475e05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:01.575056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abf500da-5eda-4ab0-a0df-23d1f0475e05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:01.575738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abf500da-5eda-4ab0-a0df-23d1f0475e05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:01.576684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abf500da-5eda-4ab0-a0df-23d1f0475e05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:01.577762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abf500da-5eda-4ab0-a0df-23d1f0475e05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:01.578430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abf500da-5eda-4ab0-a0df-23d1f0475e05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:01.714273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-abf500da-5eda-4ab0-a0df-23d1f0475e05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:01.722217 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-abf500da-5eda-4ab0-a0df-23d1f0475e05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.161412 Oct 11 20:46:01.722959 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3426/6901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:01 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:02.745258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d0b683f4-f7e2-45ca-aca7-64916306d770 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:02.745886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d0b683f4-f7e2-45ca-aca7-64916306d770 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:02.753045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b683f4-f7e2-45ca-aca7-64916306d770 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:02.753545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b683f4-f7e2-45ca-aca7-64916306d770 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:02.753993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b683f4-f7e2-45ca-aca7-64916306d770 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:02.755224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b683f4-f7e2-45ca-aca7-64916306d770 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:02.755844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b683f4-f7e2-45ca-aca7-64916306d770 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:02.756278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d0b683f4-f7e2-45ca-aca7-64916306d770 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:02.941967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d0b683f4-f7e2-45ca-aca7-64916306d770 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:02.949839 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d0b683f4-f7e2-45ca-aca7-64916306d770 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.208489 Oct 11 20:46:02.950414 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3476/6902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:02 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:03.154637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-52d9f998-2c8a-49e2-ba8e-c92db390ae77 req-2a56e6f3-fab8-451a-85e6-69c551169281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3212c0-68f8-4572-b210-ae34d6490f41", "tag": "fc7fac9c-234a-41a6-9d39-34a91d292045"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:46:03.165513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-52d9f998-2c8a-49e2-ba8e-c92db390ae77 req-2a56e6f3-fab8-451a-85e6-69c551169281 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:03.166016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-52d9f998-2c8a-49e2-ba8e-c92db390ae77 req-2a56e6f3-fab8-451a-85e6-69c551169281 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:03.166461 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-52d9f998-2c8a-49e2-ba8e-c92db390ae77 req-2a56e6f3-fab8-451a-85e6-69c551169281 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:03.178115 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-52d9f998-2c8a-49e2-ba8e-c92db390ae77 req-2a56e6f3-fab8-451a-85e6-69c551169281 service nova] Creating event network-changed:fc7fac9c-234a-41a6-9d39-34a91d292045 for instance ae3212c0-68f8-4572-b210-ae34d6490f41 on n-h1-860864-3 Oct 11 20:46:03.183144 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-52d9f998-2c8a-49e2-ba8e-c92db390ae77 req-2a56e6f3-fab8-451a-85e6-69c551169281 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160698 Oct 11 20:46:03.183747 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3427/6903] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:46:03.974581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e7b09125-1a31-40d5-9508-6fb2c4722255 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:03.975144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e7b09125-1a31-40d5-9508-6fb2c4722255 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:03.976987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:46:03.983141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7b09125-1a31-40d5-9508-6fb2c4722255 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:03.983623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7b09125-1a31-40d5-9508-6fb2c4722255 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:03.984059 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7b09125-1a31-40d5-9508-6fb2c4722255 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:03.984742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7b09125-1a31-40d5-9508-6fb2c4722255 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:03.985192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7b09125-1a31-40d5-9508-6fb2c4722255 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:03.985611 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e7b09125-1a31-40d5-9508-6fb2c4722255 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:04.119624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e7b09125-1a31-40d5-9508-6fb2c4722255 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:04.127216 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e7b09125-1a31-40d5-9508-6fb2c4722255 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.157357 Oct 11 20:46:04.127786 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3477/6904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:03 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:05.148096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:46:05.149025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:46:05.154188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53ba56b0-4125-4c4d-95a8-f2f24433f6bb tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:05.154952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-53ba56b0-4125-4c4d-95a8-f2f24433f6bb tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:05.162549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ba56b0-4125-4c4d-95a8-f2f24433f6bb tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:05.163064 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ba56b0-4125-4c4d-95a8-f2f24433f6bb tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:05.163526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ba56b0-4125-4c4d-95a8-f2f24433f6bb tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:05.164236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ba56b0-4125-4c4d-95a8-f2f24433f6bb tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:05.164712 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ba56b0-4125-4c4d-95a8-f2f24433f6bb tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:05.165154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ba56b0-4125-4c4d-95a8-f2f24433f6bb tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:05.295995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-53ba56b0-4125-4c4d-95a8-f2f24433f6bb tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:05.304376 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-53ba56b0-4125-4c4d-95a8-f2f24433f6bb tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.157243 Oct 11 20:46:05.304941 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3428/6905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:05 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:06.327807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-97230189-abfc-4671-a223-57a6688903c5 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:06.328471 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-97230189-abfc-4671-a223-57a6688903c5 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:06.335942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97230189-abfc-4671-a223-57a6688903c5 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:06.336427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97230189-abfc-4671-a223-57a6688903c5 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:06.336871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97230189-abfc-4671-a223-57a6688903c5 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:06.337561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97230189-abfc-4671-a223-57a6688903c5 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:06.338016 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97230189-abfc-4671-a223-57a6688903c5 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:06.338441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-97230189-abfc-4671-a223-57a6688903c5 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:06.474881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-97230189-abfc-4671-a223-57a6688903c5 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:06.483247 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-97230189-abfc-4671-a223-57a6688903c5 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.159604 Oct 11 20:46:06.484118 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3478/6906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:06 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:07.506058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-08f63b0a-f9fe-48f3-a2b3-b39262204576 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:07.506716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-08f63b0a-f9fe-48f3-a2b3-b39262204576 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:07.512934 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08f63b0a-f9fe-48f3-a2b3-b39262204576 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:07.513438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08f63b0a-f9fe-48f3-a2b3-b39262204576 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:07.513890 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08f63b0a-f9fe-48f3-a2b3-b39262204576 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:07.514630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08f63b0a-f9fe-48f3-a2b3-b39262204576 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:07.515109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08f63b0a-f9fe-48f3-a2b3-b39262204576 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:07.515550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-08f63b0a-f9fe-48f3-a2b3-b39262204576 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:07.645191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-08f63b0a-f9fe-48f3-a2b3-b39262204576 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:07.653095 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-08f63b0a-f9fe-48f3-a2b3-b39262204576 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.151715 Oct 11 20:46:07.653685 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3429/6907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:07 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:08.458457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-72a064de-afac-47ce-9998-505503d68169 req-7efdbb4c-5f1e-4e1c-8fea-bcb8be3931d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3212c0-68f8-4572-b210-ae34d6490f41", "name": "network-vif-plugged", "status": "completed", "tag": "fc7fac9c-234a-41a6-9d39-34a91d292045"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:46:08.469246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-72a064de-afac-47ce-9998-505503d68169 req-7efdbb4c-5f1e-4e1c-8fea-bcb8be3931d1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:08.469758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-72a064de-afac-47ce-9998-505503d68169 req-7efdbb4c-5f1e-4e1c-8fea-bcb8be3931d1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:08.470192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-72a064de-afac-47ce-9998-505503d68169 req-7efdbb4c-5f1e-4e1c-8fea-bcb8be3931d1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:08.482655 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-72a064de-afac-47ce-9998-505503d68169 req-7efdbb4c-5f1e-4e1c-8fea-bcb8be3931d1 service nova] Creating event network-vif-plugged:fc7fac9c-234a-41a6-9d39-34a91d292045 for instance ae3212c0-68f8-4572-b210-ae34d6490f41 on n-h1-860864-3 Oct 11 20:46:08.487577 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-72a064de-afac-47ce-9998-505503d68169 req-7efdbb4c-5f1e-4e1c-8fea-bcb8be3931d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033261 Oct 11 20:46:08.488214 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3479/6908] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:46:08.677727 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-43073e45-878a-415c-a85b-215f657ef197 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:08.678368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-43073e45-878a-415c-a85b-215f657ef197 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:08.685647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43073e45-878a-415c-a85b-215f657ef197 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:08.686157 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43073e45-878a-415c-a85b-215f657ef197 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:08.686635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43073e45-878a-415c-a85b-215f657ef197 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:08.687356 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43073e45-878a-415c-a85b-215f657ef197 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:08.687827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43073e45-878a-415c-a85b-215f657ef197 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:08.688266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-43073e45-878a-415c-a85b-215f657ef197 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:09.036992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-43073e45-878a-415c-a85b-215f657ef197 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:09.044940 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-43073e45-878a-415c-a85b-215f657ef197 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1359 microversion: 2.1 time: 0.371966 Oct 11 20:46:09.045530 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3430/6909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:08 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1359 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:10.070493 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e51a6874-95bc-47d2-8cc1-89b63eddbe3d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:10.071242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e51a6874-95bc-47d2-8cc1-89b63eddbe3d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:10.078772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e51a6874-95bc-47d2-8cc1-89b63eddbe3d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:10.079135 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e51a6874-95bc-47d2-8cc1-89b63eddbe3d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:10.079782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e51a6874-95bc-47d2-8cc1-89b63eddbe3d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:10.080591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e51a6874-95bc-47d2-8cc1-89b63eddbe3d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:10.081051 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e51a6874-95bc-47d2-8cc1-89b63eddbe3d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:10.081482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e51a6874-95bc-47d2-8cc1-89b63eddbe3d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:10.217552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e51a6874-95bc-47d2-8cc1-89b63eddbe3d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:10.225964 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e51a6874-95bc-47d2-8cc1-89b63eddbe3d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1549 microversion: 2.1 time: 0.161212 Oct 11 20:46:10.226541 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3480/6910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:10 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:10.248982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5b15584a-dc37-49e3-8b1b-b5b317962ab4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:10.249614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5b15584a-dc37-49e3-8b1b-b5b317962ab4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:10.256556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b15584a-dc37-49e3-8b1b-b5b317962ab4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:10.257058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b15584a-dc37-49e3-8b1b-b5b317962ab4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:10.257513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b15584a-dc37-49e3-8b1b-b5b317962ab4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:10.258219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b15584a-dc37-49e3-8b1b-b5b317962ab4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:10.258725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b15584a-dc37-49e3-8b1b-b5b317962ab4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:10.259170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5b15584a-dc37-49e3-8b1b-b5b317962ab4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:10.388962 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5b15584a-dc37-49e3-8b1b-b5b317962ab4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:10.396940 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5b15584a-dc37-49e3-8b1b-b5b317962ab4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1549 microversion: 2.1 time: 0.151800 Oct 11 20:46:10.397539 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3431/6911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:10 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:10.419050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:10.423674 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:10.424434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Searching by: {'deleted': False, 'project_id': '556f7772059641f894f356c197fff449'} {{(pid=126956) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 20:46:10.431105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:10.431601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:10.432013 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:10.432726 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:10.433175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:10.433598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:10.461791 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.multi_cell_list [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126956) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 20:46:10.489371 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7640eb60-4de7-414d-a7ec-6a7da23b438c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073996 Oct 11 20:46:10.489960 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3481/6912] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 20:46:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:46:10.501781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-eedcd532-18db-4cd7-ad4d-2a55558653d2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:10.502406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-eedcd532-18db-4cd7-ad4d-2a55558653d2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:10.508613 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eedcd532-18db-4cd7-ad4d-2a55558653d2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:10.509111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eedcd532-18db-4cd7-ad4d-2a55558653d2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:10.509565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eedcd532-18db-4cd7-ad4d-2a55558653d2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:10.510269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eedcd532-18db-4cd7-ad4d-2a55558653d2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:10.510768 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eedcd532-18db-4cd7-ad4d-2a55558653d2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:10.511207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-eedcd532-18db-4cd7-ad4d-2a55558653d2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:10.675883 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-eedcd532-18db-4cd7-ad4d-2a55558653d2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:10.684044 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-eedcd532-18db-4cd7-ad4d-2a55558653d2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1549 microversion: 2.1 time: 0.186167 Oct 11 20:46:10.684639 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3432/6913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:10 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1549 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:12.246250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fb3d9c1b-ffe3-4c65-8e54-bd26228bcaef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "708eadde-e9c6-44e2-ba4b-a8deb8a527ec"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:46:12.248694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fb3d9c1b-ffe3-4c65-8e54-bd26228bcaef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:12.255586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb3d9c1b-ffe3-4c65-8e54-bd26228bcaef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:12.256075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb3d9c1b-ffe3-4c65-8e54-bd26228bcaef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:12.256517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb3d9c1b-ffe3-4c65-8e54-bd26228bcaef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:12.257240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb3d9c1b-ffe3-4c65-8e54-bd26228bcaef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:12.257701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb3d9c1b-ffe3-4c65-8e54-bd26228bcaef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:12.258132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb3d9c1b-ffe3-4c65-8e54-bd26228bcaef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:12.495459 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fb3d9c1b-ffe3-4c65-8e54-bd26228bcaef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252989 Oct 11 20:46:12.496071 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3482/6914] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:46:12 2022] POST /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:46:25.546368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3fe759b8-8338-4186-9756-98c0d85bc21e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:25.547047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3fe759b8-8338-4186-9756-98c0d85bc21e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:25.549916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:46:25.551140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=58 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:46:25.557267 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe759b8-8338-4186-9756-98c0d85bc21e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:25.557766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe759b8-8338-4186-9756-98c0d85bc21e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:25.558215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe759b8-8338-4186-9756-98c0d85bc21e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:25.558935 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe759b8-8338-4186-9756-98c0d85bc21e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:25.559405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe759b8-8338-4186-9756-98c0d85bc21e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:25.559842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3fe759b8-8338-4186-9756-98c0d85bc21e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:25.688474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3fe759b8-8338-4186-9756-98c0d85bc21e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:25.696917 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3fe759b8-8338-4186-9756-98c0d85bc21e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1595 microversion: 2.1 time: 0.154383 Oct 11 20:46:25.697491 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3433/6915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:25 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:46:27.341172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:46:27.342299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:46:27.343187 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:46:27.408696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-be62be68-fe39-4449-a8b0-0f62e5607173 req-1d839f09-34e1-4d15-ae3a-d06de5b80cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3212c0-68f8-4572-b210-ae34d6490f41", "tag": "fc7fac9c-234a-41a6-9d39-34a91d292045"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:46:27.420497 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-be62be68-fe39-4449-a8b0-0f62e5607173 req-1d839f09-34e1-4d15-ae3a-d06de5b80cd2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:27.421480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-be62be68-fe39-4449-a8b0-0f62e5607173 req-1d839f09-34e1-4d15-ae3a-d06de5b80cd2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:27.421994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-be62be68-fe39-4449-a8b0-0f62e5607173 req-1d839f09-34e1-4d15-ae3a-d06de5b80cd2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:27.434343 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-be62be68-fe39-4449-a8b0-0f62e5607173 req-1d839f09-34e1-4d15-ae3a-d06de5b80cd2 service nova] Creating event network-changed:fc7fac9c-234a-41a6-9d39-34a91d292045 for instance ae3212c0-68f8-4572-b210-ae34d6490f41 on n-h1-860864-3 Oct 11 20:46:27.439846 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-be62be68-fe39-4449-a8b0-0f62e5607173 req-1d839f09-34e1-4d15-ae3a-d06de5b80cd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100456 Oct 11 20:46:27.440558 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3483/6916] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:46:28.421598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-27c24eef-8095-4d3c-91ee-9f59f95b9a3f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1222092738"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:46:28.422148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-27c24eef-8095-4d3c-91ee-9f59f95b9a3f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:28.431325 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c24eef-8095-4d3c-91ee-9f59f95b9a3f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:28.431870 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c24eef-8095-4d3c-91ee-9f59f95b9a3f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:28.432427 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c24eef-8095-4d3c-91ee-9f59f95b9a3f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:28.433625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c24eef-8095-4d3c-91ee-9f59f95b9a3f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:28.434107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c24eef-8095-4d3c-91ee-9f59f95b9a3f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:28.434593 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27c24eef-8095-4d3c-91ee-9f59f95b9a3f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:28.567138 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.network.security_group_api [None req-27c24eef-8095-4d3c-91ee-9f59f95b9a3f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Adding security group 38146958-9ba4-44a2-af61-6a4e49d8a7f6 to port fc7fac9c-234a-41a6-9d39-34a91d292045 Oct 11 20:46:28.877562 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-27c24eef-8095-4d3c-91ee-9f59f95b9a3f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/action" status: 202 len: 0 microversion: 2.1 time: 0.460026 Oct 11 20:46:28.879336 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3434/6917] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:46:28 2022] POST /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:46:28.888288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dfc71244-ab4b-47af-8ec3-42ce52869803 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:46:28.888990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dfc71244-ab4b-47af-8ec3-42ce52869803 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:46:28.897690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-764b40ab-20d1-4c55-9d33-1042801f07c6 req-d4f6ce23-8256-4e44-878a-814544ce9623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3212c0-68f8-4572-b210-ae34d6490f41", "tag": "fc7fac9c-234a-41a6-9d39-34a91d292045"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:46:28.905151 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfc71244-ab4b-47af-8ec3-42ce52869803 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:28.905870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfc71244-ab4b-47af-8ec3-42ce52869803 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:28.906392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfc71244-ab4b-47af-8ec3-42ce52869803 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:28.908755 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-764b40ab-20d1-4c55-9d33-1042801f07c6 req-d4f6ce23-8256-4e44-878a-814544ce9623 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:28.909065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfc71244-ab4b-47af-8ec3-42ce52869803 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:46:28.909690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-764b40ab-20d1-4c55-9d33-1042801f07c6 req-d4f6ce23-8256-4e44-878a-814544ce9623 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:28.909823 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfc71244-ab4b-47af-8ec3-42ce52869803 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:46:28.910671 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-764b40ab-20d1-4c55-9d33-1042801f07c6 req-d4f6ce23-8256-4e44-878a-814544ce9623 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:28.911600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dfc71244-ab4b-47af-8ec3-42ce52869803 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:46:28.923347 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-764b40ab-20d1-4c55-9d33-1042801f07c6 req-d4f6ce23-8256-4e44-878a-814544ce9623 service nova] Creating event network-changed:fc7fac9c-234a-41a6-9d39-34a91d292045 for instance ae3212c0-68f8-4572-b210-ae34d6490f41 on n-h1-860864-3 Oct 11 20:46:28.929487 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-764b40ab-20d1-4c55-9d33-1042801f07c6 req-d4f6ce23-8256-4e44-878a-814544ce9623 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038897 Oct 11 20:46:28.930960 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3435/6918] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:46:29.164195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-dfc71244-ab4b-47af-8ec3-42ce52869803 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:46:29.172732 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dfc71244-ab4b-47af-8ec3-42ce52869803 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1761 microversion: 2.1 time: 0.289540 Oct 11 20:46:29.186612 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3484/6919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:46:28 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1761 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:48:08.303397 n-d-860864-3 devstack@n-api.service[126955]: ERROR oslo.messaging._drivers.impl_rabbit [-] [40238a9c-3606-4385-94b6-ee4512c24920] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 20:48:08.304232 n-d-860864-3 devstack@n-api.service[126955]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0fc4d99-c6db-4dc7-baac-a9ae8040cf98] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 20:48:08.304821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:48:08.305583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=12 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:48:08.307988 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 20:48:08.308125 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 20:48:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/action (ip 10.222.0.27) !!! Oct 11 20:48:08.320365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d5be04bc-0aa2-4c80-bffa-f0d009909f5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:48:08.322680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d5be04bc-0aa2-4c80-bffa-f0d009909f5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:48:08.329775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5be04bc-0aa2-4c80-bffa-f0d009909f5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:08.330215 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5be04bc-0aa2-4c80-bffa-f0d009909f5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:08.330697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5be04bc-0aa2-4c80-bffa-f0d009909f5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:08.331398 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5be04bc-0aa2-4c80-bffa-f0d009909f5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:08.331869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5be04bc-0aa2-4c80-bffa-f0d009909f5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:08.332309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5be04bc-0aa2-4c80-bffa-f0d009909f5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:08.404099 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d5be04bc-0aa2-4c80-bffa-f0d009909f5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/action" status: 202 len: 0 microversion: 2.1 time: 0.103254 Oct 11 20:48:08.406560 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3436/6920] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:48:08 2022] POST /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:48:08.411869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:48:08.412763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:48:08.414185 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:48:08.414321 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:48:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 (ip 10.222.0.27) !!! Oct 11 20:48:08.420002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3829bcbd-35db-4f2e-ad9a-af623f950d0c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:48:08.420698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3829bcbd-35db-4f2e-ad9a-af623f950d0c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:48:08.433430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3829bcbd-35db-4f2e-ad9a-af623f950d0c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:08.433932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3829bcbd-35db-4f2e-ad9a-af623f950d0c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:08.434384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3829bcbd-35db-4f2e-ad9a-af623f950d0c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:08.435130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3829bcbd-35db-4f2e-ad9a-af623f950d0c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:08.435576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3829bcbd-35db-4f2e-ad9a-af623f950d0c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:08.436240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3829bcbd-35db-4f2e-ad9a-af623f950d0c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:08.670786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3829bcbd-35db-4f2e-ad9a-af623f950d0c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:48:08.679547 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3829bcbd-35db-4f2e-ad9a-af623f950d0c tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1763 microversion: 2.1 time: 0.270251 Oct 11 20:48:08.680018 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3485/6921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:48:08 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1763 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:48:09.708234 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0ad6e5d4-6529-45ab-be24-c178ef0e145b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:48:09.708952 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0ad6e5d4-6529-45ab-be24-c178ef0e145b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:48:09.721089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad6e5d4-6529-45ab-be24-c178ef0e145b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:09.721592 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad6e5d4-6529-45ab-be24-c178ef0e145b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:09.722049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad6e5d4-6529-45ab-be24-c178ef0e145b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:09.722773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad6e5d4-6529-45ab-be24-c178ef0e145b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:09.723251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad6e5d4-6529-45ab-be24-c178ef0e145b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:09.723685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0ad6e5d4-6529-45ab-be24-c178ef0e145b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:09.727021 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] [40238a9c-3606-4385-94b6-ee4512c24920] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44022. Oct 11 20:48:09.731524 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0fc4d99-c6db-4dc7-baac-a9ae8040cf98] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44024. Oct 11 20:48:09.870171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0ad6e5d4-6529-45ab-be24-c178ef0e145b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:48:09.878648 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0ad6e5d4-6529-45ab-be24-c178ef0e145b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1768 microversion: 2.1 time: 0.179245 Oct 11 20:48:09.879811 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3437/6922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:48:09 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1768 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:48:10.903314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-06c15311-f375-4a30-a596-fa827f4614be tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:48:10.903919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-06c15311-f375-4a30-a596-fa827f4614be tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:48:10.911072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06c15311-f375-4a30-a596-fa827f4614be tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:10.911537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06c15311-f375-4a30-a596-fa827f4614be tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:10.911973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06c15311-f375-4a30-a596-fa827f4614be tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:10.912655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06c15311-f375-4a30-a596-fa827f4614be tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:10.913103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06c15311-f375-4a30-a596-fa827f4614be tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:10.913522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-06c15311-f375-4a30-a596-fa827f4614be tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:11.056222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-06c15311-f375-4a30-a596-fa827f4614be tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:48:11.064499 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-06c15311-f375-4a30-a596-fa827f4614be tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1768 microversion: 2.1 time: 0.165049 Oct 11 20:48:11.065071 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3486/6923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:48:10 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1768 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:48:12.089781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-beaf64e4-6873-4f7b-952e-c7eed7f9fa05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:48:12.090424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-beaf64e4-6873-4f7b-952e-c7eed7f9fa05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:48:12.097378 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-beaf64e4-6873-4f7b-952e-c7eed7f9fa05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:12.097920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-beaf64e4-6873-4f7b-952e-c7eed7f9fa05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:12.098377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-beaf64e4-6873-4f7b-952e-c7eed7f9fa05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:12.099114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-beaf64e4-6873-4f7b-952e-c7eed7f9fa05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:12.099600 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-beaf64e4-6873-4f7b-952e-c7eed7f9fa05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:12.100044 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-beaf64e4-6873-4f7b-952e-c7eed7f9fa05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:12.248122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-beaf64e4-6873-4f7b-952e-c7eed7f9fa05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:48:12.257008 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-beaf64e4-6873-4f7b-952e-c7eed7f9fa05 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1768 microversion: 2.1 time: 0.171222 Oct 11 20:48:12.257584 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3438/6924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:48:12 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1768 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:48:13.280910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1a3ed323-0935-4470-ac98-c76034dde627 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:48:13.281459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1a3ed323-0935-4470-ac98-c76034dde627 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:48:13.288659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3ed323-0935-4470-ac98-c76034dde627 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:13.289141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3ed323-0935-4470-ac98-c76034dde627 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:13.289576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3ed323-0935-4470-ac98-c76034dde627 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:13.290260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3ed323-0935-4470-ac98-c76034dde627 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:13.290744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3ed323-0935-4470-ac98-c76034dde627 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:13.291164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1a3ed323-0935-4470-ac98-c76034dde627 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:13.432113 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1a3ed323-0935-4470-ac98-c76034dde627 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:48:13.441515 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1a3ed323-0935-4470-ac98-c76034dde627 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1768 microversion: 2.1 time: 0.164569 Oct 11 20:48:13.442764 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3487/6925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:48:13 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1768 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:48:14.466838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-790c755e-233f-41ae-88f2-11bee1792969 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:48:14.467465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-790c755e-233f-41ae-88f2-11bee1792969 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:48:14.474395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-790c755e-233f-41ae-88f2-11bee1792969 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:14.474928 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-790c755e-233f-41ae-88f2-11bee1792969 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:14.475384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-790c755e-233f-41ae-88f2-11bee1792969 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:14.476103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-790c755e-233f-41ae-88f2-11bee1792969 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:48:14.476573 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-790c755e-233f-41ae-88f2-11bee1792969 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:48:14.477012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-790c755e-233f-41ae-88f2-11bee1792969 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:48:14.702722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-790c755e-233f-41ae-88f2-11bee1792969 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:48:14.711753 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-790c755e-233f-41ae-88f2-11bee1792969 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1761 microversion: 2.1 time: 0.248894 Oct 11 20:48:14.712352 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3439/6926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:48:14 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1761 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:49:27.456237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:49:27.457090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=18 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:49:27.461216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-01a1e809-06d1-42bf-ae8a-5729f072d546 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1222092738"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:49:27.462238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-01a1e809-06d1-42bf-ae8a-5729f072d546 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:27.468853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01a1e809-06d1-42bf-ae8a-5729f072d546 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:27.469335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01a1e809-06d1-42bf-ae8a-5729f072d546 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:27.469764 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01a1e809-06d1-42bf-ae8a-5729f072d546 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:27.470442 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01a1e809-06d1-42bf-ae8a-5729f072d546 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:27.470923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01a1e809-06d1-42bf-ae8a-5729f072d546 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:27.471339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01a1e809-06d1-42bf-ae8a-5729f072d546 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:27.596138 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.network.security_group_api [None req-01a1e809-06d1-42bf-ae8a-5729f072d546 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Removing security group 38146958-9ba4-44a2-af61-6a4e49d8a7f6 from port fc7fac9c-234a-41a6-9d39-34a91d292045 Oct 11 20:49:27.896046 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-01a1e809-06d1-42bf-ae8a-5729f072d546 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/action" status: 202 len: 0 microversion: 2.1 time: 0.441580 Oct 11 20:49:27.896912 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3488/6927] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:49:27 2022] POST /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:49:27.911546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-0956384c-c09e-457e-868e-988f3abe660c req-b617c159-c2fd-41ba-96fe-d8c5c13a4ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3212c0-68f8-4572-b210-ae34d6490f41", "tag": "fc7fac9c-234a-41a6-9d39-34a91d292045"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:49:27.922039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:49:27.923290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:49:27.926679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0956384c-c09e-457e-868e-988f3abe660c req-b617c159-c2fd-41ba-96fe-d8c5c13a4ab5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:27.927649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0956384c-c09e-457e-868e-988f3abe660c req-b617c159-c2fd-41ba-96fe-d8c5c13a4ab5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:27.928885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-0956384c-c09e-457e-868e-988f3abe660c req-b617c159-c2fd-41ba-96fe-d8c5c13a4ab5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:27.949624 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-0956384c-c09e-457e-868e-988f3abe660c req-b617c159-c2fd-41ba-96fe-d8c5c13a4ab5 service nova] Creating event network-changed:fc7fac9c-234a-41a6-9d39-34a91d292045 for instance ae3212c0-68f8-4572-b210-ae34d6490f41 on n-h1-860864-3 Oct 11 20:49:27.956585 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-0956384c-c09e-457e-868e-988f3abe660c req-b617c159-c2fd-41ba-96fe-d8c5c13a4ab5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050216 Oct 11 20:49:27.957493 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3440/6928] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:49:29.600711 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:29.601248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:29.607719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:29.608206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:29.608647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:29.609340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:29.609798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:29.610225 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:29.690996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lazy-loading 'services' on Instance uuid ae3212c0-68f8-4572-b210-ae34d6490f41 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:49:29.763351 n-d-860864-3 devstack@n-api.service[126956]: ERROR oslo.messaging._drivers.impl_rabbit [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [dccf9d6e-b913-4679-928f-8c80ff4ea830] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 20:49:29.976845 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-e7b31c98-11f0-495a-b168-b9e4278b496b req-299175dc-fc76-4950-8f07-ad3b5d3e481d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3212c0-68f8-4572-b210-ae34d6490f41", "tag": "fc7fac9c-234a-41a6-9d39-34a91d292045"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:49:29.987595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e7b31c98-11f0-495a-b168-b9e4278b496b req-299175dc-fc76-4950-8f07-ad3b5d3e481d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:29.988119 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e7b31c98-11f0-495a-b168-b9e4278b496b req-299175dc-fc76-4950-8f07-ad3b5d3e481d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:29.988562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-e7b31c98-11f0-495a-b168-b9e4278b496b req-299175dc-fc76-4950-8f07-ad3b5d3e481d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:30.000113 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-e7b31c98-11f0-495a-b168-b9e4278b496b req-299175dc-fc76-4950-8f07-ad3b5d3e481d service nova] Creating event network-changed:fc7fac9c-234a-41a6-9d39-34a91d292045 for instance ae3212c0-68f8-4572-b210-ae34d6490f41 on n-h1-860864-3 Oct 11 20:49:30.005026 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-e7b31c98-11f0-495a-b168-b9e4278b496b req-299175dc-fc76-4950-8f07-ad3b5d3e481d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033448 Oct 11 20:49:30.005615 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3441/6929] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:49:30.771115 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [dccf9d6e-b913-4679-928f-8c80ff4ea830] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44084. Oct 11 20:49:30.774676 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-10abceee-7884-4b37-9524-58090d0235ef tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments/708eadde-e9c6-44e2-ba4b-a8deb8a527ec" status: 202 len: 0 microversion: 2.1 time: 1.178795 Oct 11 20:49:30.775162 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3489/6930] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:49:29 2022] DELETE /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments/708eadde-e9c6-44e2-ba4b-a8deb8a527ec => generated 0 bytes in 1180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:49:30.785387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c6749882-3ddd-43a7-8e05-ae0b8aff9a70 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:30.787750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c6749882-3ddd-43a7-8e05-ae0b8aff9a70 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:30.796262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6749882-3ddd-43a7-8e05-ae0b8aff9a70 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:30.796776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6749882-3ddd-43a7-8e05-ae0b8aff9a70 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:30.797575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6749882-3ddd-43a7-8e05-ae0b8aff9a70 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:30.798300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6749882-3ddd-43a7-8e05-ae0b8aff9a70 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:30.798807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6749882-3ddd-43a7-8e05-ae0b8aff9a70 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:30.799250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6749882-3ddd-43a7-8e05-ae0b8aff9a70 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:30.834272 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c6749882-3ddd-43a7-8e05-ae0b8aff9a70 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054508 Oct 11 20:49:30.834872 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3442/6931] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:49:30 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:49:31.848610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9474faac-c778-4109-ba18-68c961f26db9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:31.851114 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9474faac-c778-4109-ba18-68c961f26db9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:31.860130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9474faac-c778-4109-ba18-68c961f26db9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:31.860625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9474faac-c778-4109-ba18-68c961f26db9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:31.861064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9474faac-c778-4109-ba18-68c961f26db9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:31.861767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9474faac-c778-4109-ba18-68c961f26db9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:31.862224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9474faac-c778-4109-ba18-68c961f26db9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:31.862677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9474faac-c778-4109-ba18-68c961f26db9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:31.893262 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9474faac-c778-4109-ba18-68c961f26db9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049869 Oct 11 20:49:31.893835 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3490/6932] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:49:31 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:49:32.906017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-85bb4b85-1193-4950-8ece-678d225ff290 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:32.908276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-85bb4b85-1193-4950-8ece-678d225ff290 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:32.915718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85bb4b85-1193-4950-8ece-678d225ff290 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:32.916218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85bb4b85-1193-4950-8ece-678d225ff290 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:32.916669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85bb4b85-1193-4950-8ece-678d225ff290 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:32.917374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85bb4b85-1193-4950-8ece-678d225ff290 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:32.917841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85bb4b85-1193-4950-8ece-678d225ff290 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:32.918280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-85bb4b85-1193-4950-8ece-678d225ff290 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:32.948790 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-85bb4b85-1193-4950-8ece-678d225ff290 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046790 Oct 11 20:49:32.949359 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3443/6933] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:49:32 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:49:33.961946 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1c8f6bb2-1a66-462b-b15a-4b3c8722da41 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:33.964328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1c8f6bb2-1a66-462b-b15a-4b3c8722da41 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:33.971121 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c8f6bb2-1a66-462b-b15a-4b3c8722da41 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:33.971587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c8f6bb2-1a66-462b-b15a-4b3c8722da41 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:33.972015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c8f6bb2-1a66-462b-b15a-4b3c8722da41 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:33.972693 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c8f6bb2-1a66-462b-b15a-4b3c8722da41 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:33.973141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c8f6bb2-1a66-462b-b15a-4b3c8722da41 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:33.973558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1c8f6bb2-1a66-462b-b15a-4b3c8722da41 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:34.004879 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1c8f6bb2-1a66-462b-b15a-4b3c8722da41 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047388 Oct 11 20:49:34.005434 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3491/6934] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:49:33 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:49:35.017709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-387797a7-eb56-400b-95f6-10b676f6a401 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:35.019948 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-387797a7-eb56-400b-95f6-10b676f6a401 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:35.027023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-387797a7-eb56-400b-95f6-10b676f6a401 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:35.027530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-387797a7-eb56-400b-95f6-10b676f6a401 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:35.027987 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-387797a7-eb56-400b-95f6-10b676f6a401 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:35.028699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-387797a7-eb56-400b-95f6-10b676f6a401 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:35.029172 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-387797a7-eb56-400b-95f6-10b676f6a401 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:35.029618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-387797a7-eb56-400b-95f6-10b676f6a401 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:35.062514 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-387797a7-eb56-400b-95f6-10b676f6a401 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048763 Oct 11 20:49:35.063135 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3444/6935] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:49:35 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:49:36.075526 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f4e495e5-7088-4e71-9345-140990f18ead tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:36.078101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f4e495e5-7088-4e71-9345-140990f18ead tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:36.085686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4e495e5-7088-4e71-9345-140990f18ead tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:36.086197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4e495e5-7088-4e71-9345-140990f18ead tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:36.087414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4e495e5-7088-4e71-9345-140990f18ead tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:36.088142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4e495e5-7088-4e71-9345-140990f18ead tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:36.088619 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4e495e5-7088-4e71-9345-140990f18ead tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:36.089044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f4e495e5-7088-4e71-9345-140990f18ead tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:36.117047 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f4e495e5-7088-4e71-9345-140990f18ead tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046444 Oct 11 20:49:36.117611 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3492/6936] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:49:36 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:49:36.128748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:36.129271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:36.137161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:36.137663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:36.138118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:36.138858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:36.139338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:36.139780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:36.215567 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] HTTP exception thrown: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 is not attached to volume 708eadde-e9c6-44e2-ba4b-a8deb8a527ec Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Request method failure captured: Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: request: DELETE /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments/708eadde-e9c6-44e2-ba4b-a8deb8a527ec HTTP/1.1 Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdXxPSoF-7PFWkUlPn0DB2b3JBm8dRTkXcnfKPdV3t_OuaTl6WtJC-beTbL_DA8YY-4tZBvhXo0O_Gbkew9TgjTzMY16kp1l8qXYg4aNjX1Gk4dvc5sDfdLyytKBL6zva2RswlQWNodFPOutbvat6X0JleUnxHRTIBgZca_zI8S5PsY Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 556f7772059641f894f356c197fff449 Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/556f7772059641f894f356c197fff449"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_556f7772059641f894f356c197fff449", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/556f7772059641f894f356c197fff449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/556f7772059641f894f356c197fff449"}]}] Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 556f7772059641f894f356c197fff449 Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestMinimumBasicScenario-1181580194-project Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 884b1e8363c1469b841b15d270a78641 Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestMinimumBasicScenario-1181580194-project Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 is not attached to volume 708eadde-e9c6-44e2-ba4b-a8deb8a527ec Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'server_id': 'ae3212c0-68f8-4572-b210-ae34d6490f41', 'id': '708eadde-e9c6-44e2-ba4b-a8deb8a527ec'} Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 708eadde-e9c6-44e2-ba4b-a8deb8a527ec. Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 is not attached to volume 708eadde-e9c6-44e2-ba4b-a8deb8a527ec Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:49:36.217211 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:49:36.221658 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:49:36.221658 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:49:36.221658 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 is not attached to volume 708eadde-e9c6-44e2-ba4b-a8deb8a527ec Oct 11 20:49:36.221658 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:49:36.221658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Returning 404 to user: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 is not attached to volume 708eadde-e9c6-44e2-ba4b-a8deb8a527ec {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:49:36.221658 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9d1ce896-ca8d-4056-aac5-18c4e8ec74cf tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments/708eadde-e9c6-44e2-ba4b-a8deb8a527ec" status: 404 len: 154 microversion: 2.1 time: 0.093991 Oct 11 20:49:36.221658 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3445/6937] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:49:36 2022] DELETE /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41/os-volume_attachments/708eadde-e9c6-44e2-ba4b-a8deb8a527ec => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:49:39.470953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a3c05f32-d418-4d5b-a9d0-92341249f655 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:39.471463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a3c05f32-d418-4d5b-a9d0-92341249f655 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:39.478358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3c05f32-d418-4d5b-a9d0-92341249f655 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:39.479520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3c05f32-d418-4d5b-a9d0-92341249f655 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:39.479953 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3c05f32-d418-4d5b-a9d0-92341249f655 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:39.480643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3c05f32-d418-4d5b-a9d0-92341249f655 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:39.481101 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3c05f32-d418-4d5b-a9d0-92341249f655 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:39.481524 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a3c05f32-d418-4d5b-a9d0-92341249f655 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:39.506662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a3c05f32-d418-4d5b-a9d0-92341249f655 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:49:39.595981 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a3c05f32-d418-4d5b-a9d0-92341249f655 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 204 len: 0 microversion: 2.1 time: 0.128465 Oct 11 20:49:39.599804 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3493/6938] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:49:39 2022] DELETE /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:49:39.606630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-460ed422-876f-4130-99a4-48a715c65c46 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:39.607272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-460ed422-876f-4130-99a4-48a715c65c46 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:39.617629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-460ed422-876f-4130-99a4-48a715c65c46 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:39.618137 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-460ed422-876f-4130-99a4-48a715c65c46 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:39.618644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-460ed422-876f-4130-99a4-48a715c65c46 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:39.620149 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-460ed422-876f-4130-99a4-48a715c65c46 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:39.620715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-460ed422-876f-4130-99a4-48a715c65c46 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:39.621163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-460ed422-876f-4130-99a4-48a715c65c46 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:39.754218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-460ed422-876f-4130-99a4-48a715c65c46 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:49:39.762963 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-460ed422-876f-4130-99a4-48a715c65c46 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1555 microversion: 2.1 time: 0.161472 Oct 11 20:49:39.763549 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3446/6939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:49:39 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:49:40.786904 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-68667309-5fe6-4aa4-876a-05a8b1429180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:40.787546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-68667309-5fe6-4aa4-876a-05a8b1429180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:40.794871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68667309-5fe6-4aa4-876a-05a8b1429180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:40.795362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68667309-5fe6-4aa4-876a-05a8b1429180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:40.795796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68667309-5fe6-4aa4-876a-05a8b1429180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:40.796486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68667309-5fe6-4aa4-876a-05a8b1429180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:40.796937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68667309-5fe6-4aa4-876a-05a8b1429180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:40.797359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-68667309-5fe6-4aa4-876a-05a8b1429180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:40.926006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-68667309-5fe6-4aa4-876a-05a8b1429180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:49:40.933695 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-68667309-5fe6-4aa4-876a-05a8b1429180 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1555 microversion: 2.1 time: 0.151153 Oct 11 20:49:40.934261 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3494/6940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:49:40 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:49:41.614732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ad971942-7c87-4849-8683-8dc774292390 req-ac883167-823c-497f-bda7-e9e83715ec38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3212c0-68f8-4572-b210-ae34d6490f41", "name": "network-vif-deleted", "tag": "fc7fac9c-234a-41a6-9d39-34a91d292045"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:49:41.626811 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ad971942-7c87-4849-8683-8dc774292390 req-ac883167-823c-497f-bda7-e9e83715ec38 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:41.627313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ad971942-7c87-4849-8683-8dc774292390 req-ac883167-823c-497f-bda7-e9e83715ec38 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:41.627858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ad971942-7c87-4849-8683-8dc774292390 req-ac883167-823c-497f-bda7-e9e83715ec38 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:41.640395 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ad971942-7c87-4849-8683-8dc774292390 req-ac883167-823c-497f-bda7-e9e83715ec38 service nova] Creating event network-vif-deleted:fc7fac9c-234a-41a6-9d39-34a91d292045 for instance ae3212c0-68f8-4572-b210-ae34d6490f41 on n-h1-860864-3 Oct 11 20:49:41.645363 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ad971942-7c87-4849-8683-8dc774292390 req-ac883167-823c-497f-bda7-e9e83715ec38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034661 Oct 11 20:49:41.645962 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3447/6941] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:49:41.957494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:41.958115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:41.965719 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:41.966218 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:41.966961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:41.967769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:41.968299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:41.968809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:42.004197 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:42.005066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:42.005502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:42.005951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lazy-loading 'fault' on Instance uuid ae3212c0-68f8-4572-b210-ae34d6490f41 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:49:42.052301 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:49:42.061309 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3078ede1-6b5b-40d8-b0b1-b35c4b6941c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 200 len: 1349 microversion: 2.1 time: 0.107698 Oct 11 20:49:42.061893 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3495/6942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:49:41 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 1349 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:49:43.086892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:43.088192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: ae3212c0-68f8-4572-b210-ae34d6490f41] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:43.094620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:43.095133 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:43.095605 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:43.096313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:43.096791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:43.097241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:43.111232 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] HTTP exception thrown: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 could not be found. Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Request method failure captured: Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 HTTP/1.1 Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdXxPSoF-7PFWkUlPn0DB2b3JBm8dRTkXcnfKPdV3t_OuaTl6WtJC-beTbL_DA8YY-4tZBvhXo0O_Gbkew9TgjTzMY16kp1l8qXYg4aNjX1Gk4dvc5sDfdLyytKBL6zva2RswlQWNodFPOutbvat6X0JleUnxHRTIBgZca_zI8S5PsY Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 556f7772059641f894f356c197fff449 Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/556f7772059641f894f356c197fff449"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_556f7772059641f894f356c197fff449", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/556f7772059641f894f356c197fff449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/556f7772059641f894f356c197fff449"}]}] Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 556f7772059641f894f356c197fff449 Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestMinimumBasicScenario-1181580194-project Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 884b1e8363c1469b841b15d270a78641 Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestMinimumBasicScenario-1181580194-project Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 could not be found. Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'ae3212c0-68f8-4572-b210-ae34d6490f41'} Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 could not be found. Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 could not be found. Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:49:43.112910 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:49:43.117307 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:49:43.117307 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:49:43.117307 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:49:43.117307 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:49:43.117307 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:49:43.117307 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 could not be found. Oct 11 20:49:43.117307 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:49:43.117307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Returning 404 to user: Instance ae3212c0-68f8-4572-b210-ae34d6490f41 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:49:43.117307 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c1d9be5f-2270-424a-8462-c82bd866d11d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41" status: 404 len: 111 microversion: 2.1 time: 0.032612 Oct 11 20:49:43.117307 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3448/6943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:49:43 2022] GET /compute/v2.1/servers/ae3212c0-68f8-4572-b210-ae34d6490f41 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:49:43.123283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-398125a6-7ab0-4cb6-96cf-1ae33b812c56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '.version_select at 0x7f83c7560790>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:43.127773 n-d-860864-3 devstack@n-api.service[126956]: ERROR oslo.messaging._drivers.impl_rabbit [None req-398125a6-7ab0-4cb6-96cf-1ae33b812c56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [8d58c018-a73f-42ee-8a85-4de918e633e3] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 20:49:44.135036 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [None req-398125a6-7ab0-4cb6-96cf-1ae33b812c56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [8d58c018-a73f-42ee-8a85-4de918e633e3] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44126. Oct 11 20:49:44.155144 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-398125a6-7ab0-4cb6-96cf-1ae33b812c56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1956338056" status: 202 len: 0 microversion: 2.1 time: 1.035837 Oct 11 20:49:44.155752 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3496/6944] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 11 20:49:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1956338056 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:49:53.354487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e467a371-045d-4e50-8551-e6de7e13ccfe tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'create', calling method: .version_select at 0x7f83c47178b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-60603532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFHDSDVbj+x2DG8sCVrnCB9R4YSKKjZd2mWmRnfWEfg8RIuClmqwJRYj/RcaHg+QHhJOcnKOxpY3gi6vP/Hn9kdx7gFMu+O0WiNAygVHVE47CiBOFUnlaqlHRSkS5ZcoA=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:49:53.360961 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:49:53.361097 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 20:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.27) !!! Oct 11 20:49:53.362943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=18 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:49:53.363720 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=38 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:49:53.382664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-e467a371-045d-4e50-8551-e6de7e13ccfe tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Getting quotas for project 556f7772059641f894f356c197fff449. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:49:53.387796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-e467a371-045d-4e50-8551-e6de7e13ccfe tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Getting quotas for user 884b1e8363c1469b841b15d270a78641 and project 556f7772059641f894f356c197fff449. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:49:53.413561 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e467a371-045d-4e50-8551-e6de7e13ccfe tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.064245 Oct 11 20:49:53.414161 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3449/6945] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:49:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:49:53.465124 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:49:53.469326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-655190992", "imageRef": "66437a51-d2e3-4c72-93bf-c7f1e7979b32", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-60603532", "networks": [{"uuid": "f2290512-ae2e-49e4-a349-c59b07511e33"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:49:53.521671 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] validate_networks() for [('f2290512-ae2e-49e4-a349-c59b07511e33', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:49:53.942872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:49:53.943302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:49:53.943781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:49:53.944196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:49:53.944615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:49:53.954055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:53.954564 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:53.955009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:53.955746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:53.956208 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:53.956641 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:53.973172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Getting quotas for project 556f7772059641f894f356c197fff449. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:49:53.978910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Getting quotas for user 884b1e8363c1469b841b15d270a78641 and project 556f7772059641f894f356c197fff449. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:49:53.991102 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:49:53.993339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66437a51-d2e3-4c72-93bf-c7f1e7979b32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:49:54.039151 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5dd8bfb2-3e3d-4168-8329-9185e68baa01 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576981 Oct 11 20:49:54.039979 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3497/6946] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:49:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:49:54.051692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-01c59092-a2ab-43ac-9bfb-bff2e29fb24a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:54.052337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-01c59092-a2ab-43ac-9bfb-bff2e29fb24a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:54.126553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-01c59092-a2ab-43ac-9bfb-bff2e29fb24a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:49:54.133613 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-01c59092-a2ab-43ac-9bfb-bff2e29fb24a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1256 microversion: 2.1 time: 0.086046 Oct 11 20:49:54.134381 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3450/6947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:49:54 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1256 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:49:55.157602 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ba6ef7f-4a3d-4dec-bb4e-17e32c25f5ea tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:55.158383 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ba6ef7f-4a3d-4dec-bb4e-17e32c25f5ea tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:55.166153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba6ef7f-4a3d-4dec-bb4e-17e32c25f5ea tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:55.166478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba6ef7f-4a3d-4dec-bb4e-17e32c25f5ea tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:55.167146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba6ef7f-4a3d-4dec-bb4e-17e32c25f5ea tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:55.167958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba6ef7f-4a3d-4dec-bb4e-17e32c25f5ea tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:55.168518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba6ef7f-4a3d-4dec-bb4e-17e32c25f5ea tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:55.169610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ba6ef7f-4a3d-4dec-bb4e-17e32c25f5ea tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:55.276438 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7ba6ef7f-4a3d-4dec-bb4e-17e32c25f5ea tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:49:55.287324 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ba6ef7f-4a3d-4dec-bb4e-17e32c25f5ea tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1326 microversion: 2.1 time: 0.134766 Oct 11 20:49:55.287937 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3498/6948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:49:55 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1326 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:49:56.311151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2591748e-8a67-4139-9e3d-8f96aa9a4a6a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:56.311778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2591748e-8a67-4139-9e3d-8f96aa9a4a6a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:56.318960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2591748e-8a67-4139-9e3d-8f96aa9a4a6a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:56.319699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2591748e-8a67-4139-9e3d-8f96aa9a4a6a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:56.319955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2591748e-8a67-4139-9e3d-8f96aa9a4a6a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:56.320667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2591748e-8a67-4139-9e3d-8f96aa9a4a6a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:56.321143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2591748e-8a67-4139-9e3d-8f96aa9a4a6a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:56.322203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2591748e-8a67-4139-9e3d-8f96aa9a4a6a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:56.466318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2591748e-8a67-4139-9e3d-8f96aa9a4a6a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:49:56.485494 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2591748e-8a67-4139-9e3d-8f96aa9a4a6a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.178376 Oct 11 20:49:56.500367 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3451/6949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:49:56 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:49:57.511957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87730a75-fe76-4c63-9957-6297a6a3ae5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:57.513774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-87730a75-fe76-4c63-9957-6297a6a3ae5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:57.516807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:49:57.522340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87730a75-fe76-4c63-9957-6297a6a3ae5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:57.522952 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87730a75-fe76-4c63-9957-6297a6a3ae5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:57.523594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87730a75-fe76-4c63-9957-6297a6a3ae5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:57.524363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87730a75-fe76-4c63-9957-6297a6a3ae5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:57.524907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87730a75-fe76-4c63-9957-6297a6a3ae5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:57.525741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87730a75-fe76-4c63-9957-6297a6a3ae5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:57.674867 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-87730a75-fe76-4c63-9957-6297a6a3ae5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:49:57.683300 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87730a75-fe76-4c63-9957-6297a6a3ae5b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.175807 Oct 11 20:49:57.684452 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3499/6950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:49:57 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:49:58.708594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1658a7e7-5c65-4982-bae8-304f03857702 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:58.709224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1658a7e7-5c65-4982-bae8-304f03857702 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:58.719557 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1658a7e7-5c65-4982-bae8-304f03857702 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:58.720374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1658a7e7-5c65-4982-bae8-304f03857702 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:58.720855 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1658a7e7-5c65-4982-bae8-304f03857702 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:58.721777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1658a7e7-5c65-4982-bae8-304f03857702 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:58.722262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1658a7e7-5c65-4982-bae8-304f03857702 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:58.722753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1658a7e7-5c65-4982-bae8-304f03857702 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:58.869575 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1658a7e7-5c65-4982-bae8-304f03857702 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:49:58.878693 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1658a7e7-5c65-4982-bae8-304f03857702 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.173604 Oct 11 20:49:58.894354 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3452/6951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:49:58 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:49:59.907657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-589f3833-2190-4152-b3e9-d2a47aae41f0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:49:59.908363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-589f3833-2190-4152-b3e9-d2a47aae41f0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:49:59.915351 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-589f3833-2190-4152-b3e9-d2a47aae41f0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:59.916478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-589f3833-2190-4152-b3e9-d2a47aae41f0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:59.916941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-589f3833-2190-4152-b3e9-d2a47aae41f0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:49:59.917811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-589f3833-2190-4152-b3e9-d2a47aae41f0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:49:59.918273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-589f3833-2190-4152-b3e9-d2a47aae41f0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:49:59.918796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-589f3833-2190-4152-b3e9-d2a47aae41f0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:00.068937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-589f3833-2190-4152-b3e9-d2a47aae41f0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:00.079606 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-589f3833-2190-4152-b3e9-d2a47aae41f0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.174688 Oct 11 20:50:00.079606 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3500/6952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:49:59 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:01.106035 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a0785e99-c809-41be-9327-34cc0b996d9d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:01.106884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a0785e99-c809-41be-9327-34cc0b996d9d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:01.115008 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0785e99-c809-41be-9327-34cc0b996d9d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:01.115651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0785e99-c809-41be-9327-34cc0b996d9d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:01.116101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0785e99-c809-41be-9327-34cc0b996d9d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:01.116822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0785e99-c809-41be-9327-34cc0b996d9d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:01.117289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0785e99-c809-41be-9327-34cc0b996d9d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:01.117729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a0785e99-c809-41be-9327-34cc0b996d9d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:01.263874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a0785e99-c809-41be-9327-34cc0b996d9d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:01.272176 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a0785e99-c809-41be-9327-34cc0b996d9d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.171399 Oct 11 20:50:01.279958 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3453/6953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:01 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:02.295518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-70efdeb0-4744-447d-9318-c24130ba2bb4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:02.296230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-70efdeb0-4744-447d-9318-c24130ba2bb4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:02.303170 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70efdeb0-4744-447d-9318-c24130ba2bb4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:02.303653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70efdeb0-4744-447d-9318-c24130ba2bb4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:02.304089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70efdeb0-4744-447d-9318-c24130ba2bb4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:02.304775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70efdeb0-4744-447d-9318-c24130ba2bb4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:02.305229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70efdeb0-4744-447d-9318-c24130ba2bb4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:02.305654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-70efdeb0-4744-447d-9318-c24130ba2bb4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:02.443424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-70efdeb0-4744-447d-9318-c24130ba2bb4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:02.453081 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-70efdeb0-4744-447d-9318-c24130ba2bb4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.161393 Oct 11 20:50:02.453661 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3501/6954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:02 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:03.476726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b8f10f7d-422c-478d-9e63-b7deced30d42 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:03.477354 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b8f10f7d-422c-478d-9e63-b7deced30d42 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:03.485256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8f10f7d-422c-478d-9e63-b7deced30d42 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:03.485758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8f10f7d-422c-478d-9e63-b7deced30d42 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:03.486211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8f10f7d-422c-478d-9e63-b7deced30d42 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:03.486959 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8f10f7d-422c-478d-9e63-b7deced30d42 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:03.487426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8f10f7d-422c-478d-9e63-b7deced30d42 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:03.487862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b8f10f7d-422c-478d-9e63-b7deced30d42 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:03.526416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-c0bde92a-9995-409e-b10c-6d858b329d99 req-ee6472a5-fe39-4869-a020-80908dec000f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a4cf05-2be9-497e-8f84-4ff88542263f", "tag": "317598a8-29d3-4688-b7e9-60570fabd595"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:50:03.548752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c0bde92a-9995-409e-b10c-6d858b329d99 req-ee6472a5-fe39-4869-a020-80908dec000f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:03.549428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c0bde92a-9995-409e-b10c-6d858b329d99 req-ee6472a5-fe39-4869-a020-80908dec000f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:03.549963 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-c0bde92a-9995-409e-b10c-6d858b329d99 req-ee6472a5-fe39-4869-a020-80908dec000f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:03.562663 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-c0bde92a-9995-409e-b10c-6d858b329d99 req-ee6472a5-fe39-4869-a020-80908dec000f service nova] Creating event network-changed:317598a8-29d3-4688-b7e9-60570fabd595 for instance 43a4cf05-2be9-497e-8f84-4ff88542263f on n-h2-860864-3 Oct 11 20:50:03.567962 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-c0bde92a-9995-409e-b10c-6d858b329d99 req-ee6472a5-fe39-4869-a020-80908dec000f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046289 Oct 11 20:50:03.569112 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3502/6955] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:50:03.766242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b8f10f7d-422c-478d-9e63-b7deced30d42 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:03.773907 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b8f10f7d-422c-478d-9e63-b7deced30d42 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.301109 Oct 11 20:50:03.774503 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3454/6956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:03 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:04.798487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-076e5798-390a-4a8f-afbb-6657eddc85ed tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:04.799192 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-076e5798-390a-4a8f-afbb-6657eddc85ed tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:04.801158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:04.801820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:04.809091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-076e5798-390a-4a8f-afbb-6657eddc85ed tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:04.809579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-076e5798-390a-4a8f-afbb-6657eddc85ed tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:04.810018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-076e5798-390a-4a8f-afbb-6657eddc85ed tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:04.810752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-076e5798-390a-4a8f-afbb-6657eddc85ed tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:04.811210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-076e5798-390a-4a8f-afbb-6657eddc85ed tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:04.811636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-076e5798-390a-4a8f-afbb-6657eddc85ed tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:05.030425 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-076e5798-390a-4a8f-afbb-6657eddc85ed tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:05.038108 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-076e5798-390a-4a8f-afbb-6657eddc85ed tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.243778 Oct 11 20:50:05.038711 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3503/6957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:04 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:06.061559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-04a13fe3-d610-417e-b7ac-90a4a1c39fd4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:06.062192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-04a13fe3-d610-417e-b7ac-90a4a1c39fd4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:06.064111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:06.071049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a13fe3-d610-417e-b7ac-90a4a1c39fd4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:06.071559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a13fe3-d610-417e-b7ac-90a4a1c39fd4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:06.073135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a13fe3-d610-417e-b7ac-90a4a1c39fd4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:06.073861 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a13fe3-d610-417e-b7ac-90a4a1c39fd4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:06.074394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a13fe3-d610-417e-b7ac-90a4a1c39fd4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:06.074875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-04a13fe3-d610-417e-b7ac-90a4a1c39fd4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:06.232305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-04a13fe3-d610-417e-b7ac-90a4a1c39fd4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:06.242606 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-04a13fe3-d610-417e-b7ac-90a4a1c39fd4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.184892 Oct 11 20:50:06.243199 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3455/6958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:06 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:07.272076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e0d6c6a7-3168-4a83-ab8d-f05954cedd32 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:07.272694 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e0d6c6a7-3168-4a83-ab8d-f05954cedd32 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:07.280696 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d6c6a7-3168-4a83-ab8d-f05954cedd32 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:07.281184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d6c6a7-3168-4a83-ab8d-f05954cedd32 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:07.281623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d6c6a7-3168-4a83-ab8d-f05954cedd32 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:07.282310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d6c6a7-3168-4a83-ab8d-f05954cedd32 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:07.282798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d6c6a7-3168-4a83-ab8d-f05954cedd32 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:07.283228 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e0d6c6a7-3168-4a83-ab8d-f05954cedd32 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:07.414944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e0d6c6a7-3168-4a83-ab8d-f05954cedd32 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:07.423299 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e0d6c6a7-3168-4a83-ab8d-f05954cedd32 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.155125 Oct 11 20:50:07.423875 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3504/6959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:07 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:08.447812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-114136eb-9b09-4a9c-821d-290cc0d86c6f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:08.448473 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-114136eb-9b09-4a9c-821d-290cc0d86c6f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:08.455653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114136eb-9b09-4a9c-821d-290cc0d86c6f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:08.456162 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114136eb-9b09-4a9c-821d-290cc0d86c6f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:08.456620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114136eb-9b09-4a9c-821d-290cc0d86c6f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:08.457330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114136eb-9b09-4a9c-821d-290cc0d86c6f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:08.457806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114136eb-9b09-4a9c-821d-290cc0d86c6f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:08.458249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-114136eb-9b09-4a9c-821d-290cc0d86c6f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:08.589037 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-114136eb-9b09-4a9c-821d-290cc0d86c6f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:08.596770 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-114136eb-9b09-4a9c-821d-290cc0d86c6f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.153979 Oct 11 20:50:08.597341 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3456/6960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:08 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:09.545075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-938ae1c3-bf6b-40de-9f5a-3b1f57cb0677 req-cb38f01e-c6b5-4abe-8f0b-effa70bb163d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a4cf05-2be9-497e-8f84-4ff88542263f", "name": "network-vif-plugged", "status": "completed", "tag": "317598a8-29d3-4688-b7e9-60570fabd595"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:50:09.557342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-938ae1c3-bf6b-40de-9f5a-3b1f57cb0677 req-cb38f01e-c6b5-4abe-8f0b-effa70bb163d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:09.557837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-938ae1c3-bf6b-40de-9f5a-3b1f57cb0677 req-cb38f01e-c6b5-4abe-8f0b-effa70bb163d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:09.558271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-938ae1c3-bf6b-40de-9f5a-3b1f57cb0677 req-cb38f01e-c6b5-4abe-8f0b-effa70bb163d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:09.572690 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-938ae1c3-bf6b-40de-9f5a-3b1f57cb0677 req-cb38f01e-c6b5-4abe-8f0b-effa70bb163d service nova] Creating event network-vif-plugged:317598a8-29d3-4688-b7e9-60570fabd595 for instance 43a4cf05-2be9-497e-8f84-4ff88542263f on n-h2-860864-3 Oct 11 20:50:09.577869 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-938ae1c3-bf6b-40de-9f5a-3b1f57cb0677 req-cb38f01e-c6b5-4abe-8f0b-effa70bb163d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091332 Oct 11 20:50:09.578475 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3505/6961] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:50:09.620598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4c1278e3-5285-40d5-8f96-597f049b0962 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:09.621237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4c1278e3-5285-40d5-8f96-597f049b0962 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:09.628537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c1278e3-5285-40d5-8f96-597f049b0962 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:09.629068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c1278e3-5285-40d5-8f96-597f049b0962 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:09.629534 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c1278e3-5285-40d5-8f96-597f049b0962 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:09.630257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c1278e3-5285-40d5-8f96-597f049b0962 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:09.630767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c1278e3-5285-40d5-8f96-597f049b0962 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:09.631217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4c1278e3-5285-40d5-8f96-597f049b0962 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:09.797568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4c1278e3-5285-40d5-8f96-597f049b0962 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:09.805383 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4c1278e3-5285-40d5-8f96-597f049b0962 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.189810 Oct 11 20:50:09.806045 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3457/6962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:09 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:10.830176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-01aeed52-8168-4e7b-86ac-dbacf03181e4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:10.830917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-01aeed52-8168-4e7b-86ac-dbacf03181e4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:10.837714 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeed52-8168-4e7b-86ac-dbacf03181e4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:10.838206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeed52-8168-4e7b-86ac-dbacf03181e4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:10.838670 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeed52-8168-4e7b-86ac-dbacf03181e4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:10.839359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeed52-8168-4e7b-86ac-dbacf03181e4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:10.839813 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeed52-8168-4e7b-86ac-dbacf03181e4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:10.840240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01aeed52-8168-4e7b-86ac-dbacf03181e4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:10.975367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-01aeed52-8168-4e7b-86ac-dbacf03181e4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:10.983819 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-01aeed52-8168-4e7b-86ac-dbacf03181e4 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1356 microversion: 2.1 time: 0.159000 Oct 11 20:50:10.984399 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3506/6963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:10 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:12.006674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c391c5eb-d371-47bc-9d94-6c2f50b88c22 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:12.007301 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c391c5eb-d371-47bc-9d94-6c2f50b88c22 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:12.014227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c391c5eb-d371-47bc-9d94-6c2f50b88c22 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:12.014758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c391c5eb-d371-47bc-9d94-6c2f50b88c22 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:12.015216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c391c5eb-d371-47bc-9d94-6c2f50b88c22 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:12.015920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c391c5eb-d371-47bc-9d94-6c2f50b88c22 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:12.016389 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c391c5eb-d371-47bc-9d94-6c2f50b88c22 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:12.016830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c391c5eb-d371-47bc-9d94-6c2f50b88c22 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:12.143946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c391c5eb-d371-47bc-9d94-6c2f50b88c22 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:12.152586 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c391c5eb-d371-47bc-9d94-6c2f50b88c22 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1546 microversion: 2.1 time: 0.149930 Oct 11 20:50:12.153175 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3458/6964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:12 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:12.175318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-260a1f73-99fa-49f3-ac83-9edf1c15fdae tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:12.175939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-260a1f73-99fa-49f3-ac83-9edf1c15fdae tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:12.182881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-260a1f73-99fa-49f3-ac83-9edf1c15fdae tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:12.183371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-260a1f73-99fa-49f3-ac83-9edf1c15fdae tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:12.183812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-260a1f73-99fa-49f3-ac83-9edf1c15fdae tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:12.184503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-260a1f73-99fa-49f3-ac83-9edf1c15fdae tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:12.184961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-260a1f73-99fa-49f3-ac83-9edf1c15fdae tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:12.185387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-260a1f73-99fa-49f3-ac83-9edf1c15fdae tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:12.647167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-260a1f73-99fa-49f3-ac83-9edf1c15fdae tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:12.656047 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-260a1f73-99fa-49f3-ac83-9edf1c15fdae tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1546 microversion: 2.1 time: 0.484581 Oct 11 20:50:12.656622 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3507/6965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:12 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1546 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:12.678597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:12.683769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:12.684553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Searching by: {'deleted': False, 'project_id': '556f7772059641f894f356c197fff449'} {{(pid=126955) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 20:50:12.689940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:12.690435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:12.690949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:12.691683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:12.692152 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:12.692591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:12.717852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.multi_cell_list [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126955) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 20:50:12.744854 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-34c6a4e8-fcfc-4e9d-8837-72134dc05378 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070148 Oct 11 20:50:12.745437 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3459/6966] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 11 20:50:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:50:12.757023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e6bd58f6-b752-41f7-bcb6-440c08f8d439 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:12.757634 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e6bd58f6-b752-41f7-bcb6-440c08f8d439 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:12.764331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bd58f6-b752-41f7-bcb6-440c08f8d439 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:12.764811 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bd58f6-b752-41f7-bcb6-440c08f8d439 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:12.765243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bd58f6-b752-41f7-bcb6-440c08f8d439 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:12.765922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bd58f6-b752-41f7-bcb6-440c08f8d439 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:12.766372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bd58f6-b752-41f7-bcb6-440c08f8d439 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:12.766822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e6bd58f6-b752-41f7-bcb6-440c08f8d439 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:12.818897 n-d-860864-3 devstack@n-api.service[126956]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a5a86ca3-3b5a-42ce-a8df-39c5a0ccf7c8] AMQP server on 10.222.0.27:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Oct 11 20:50:12.892355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e6bd58f6-b752-41f7-bcb6-440c08f8d439 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:12.900202 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e6bd58f6-b752-41f7-bcb6-440c08f8d439 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1546 microversion: 2.1 time: 0.146949 Oct 11 20:50:12.900717 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3508/6967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:12 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:14.417994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4d2dd328-b060-438e-b4f4-4a073032ac5f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23ebe224-f409-4b2a-bf75-ae41ba798edd"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:50:14.420384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4d2dd328-b060-438e-b4f4-4a073032ac5f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:14.427328 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d2dd328-b060-438e-b4f4-4a073032ac5f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:14.427829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d2dd328-b060-438e-b4f4-4a073032ac5f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:14.428278 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d2dd328-b060-438e-b4f4-4a073032ac5f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:14.428977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d2dd328-b060-438e-b4f4-4a073032ac5f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:14.429445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d2dd328-b060-438e-b4f4-4a073032ac5f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:14.429880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4d2dd328-b060-438e-b4f4-4a073032ac5f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:14.670866 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4d2dd328-b060-438e-b4f4-4a073032ac5f tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257436 Oct 11 20:50:14.671509 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3460/6968] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 11 20:50:14 2022] POST /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:50:25.455520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-49f722e2-6050-447c-b7fe-d631efb6dc89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:25.456134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-49f722e2-6050-447c-b7fe-d631efb6dc89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:25.458812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=19 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:25.459610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=60 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:25.466870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49f722e2-6050-447c-b7fe-d631efb6dc89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:25.467359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49f722e2-6050-447c-b7fe-d631efb6dc89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:25.467799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49f722e2-6050-447c-b7fe-d631efb6dc89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:25.468502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49f722e2-6050-447c-b7fe-d631efb6dc89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:25.468959 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49f722e2-6050-447c-b7fe-d631efb6dc89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:25.469384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49f722e2-6050-447c-b7fe-d631efb6dc89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:25.475988 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] [a5a86ca3-3b5a-42ce-a8df-39c5a0ccf7c8] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44358. Oct 11 20:50:25.651586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49f722e2-6050-447c-b7fe-d631efb6dc89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:25.659717 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-49f722e2-6050-447c-b7fe-d631efb6dc89 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1592 microversion: 2.1 time: 0.208441 Oct 11 20:50:25.660296 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3509/6969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:25 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1592 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:27.230772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-dabf5891-0eab-4209-92e3-f82883a1318a req-0b0f1487-78d3-41e9-85b2-02ddc01605d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a4cf05-2be9-497e-8f84-4ff88542263f", "tag": "317598a8-29d3-4688-b7e9-60570fabd595"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:50:27.241556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:27.242489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:27.243635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:27.246898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dabf5891-0eab-4209-92e3-f82883a1318a req-0b0f1487-78d3-41e9-85b2-02ddc01605d7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:27.247627 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dabf5891-0eab-4209-92e3-f82883a1318a req-0b0f1487-78d3-41e9-85b2-02ddc01605d7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:27.248085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-dabf5891-0eab-4209-92e3-f82883a1318a req-0b0f1487-78d3-41e9-85b2-02ddc01605d7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:27.263417 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-dabf5891-0eab-4209-92e3-f82883a1318a req-0b0f1487-78d3-41e9-85b2-02ddc01605d7 service nova] Creating event network-changed:317598a8-29d3-4688-b7e9-60570fabd595 for instance 43a4cf05-2be9-497e-8f84-4ff88542263f on n-h2-860864-3 Oct 11 20:50:27.269241 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-dabf5891-0eab-4209-92e3-f82883a1318a req-0b0f1487-78d3-41e9-85b2-02ddc01605d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043534 Oct 11 20:50:27.270182 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3461/6970] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:50:28.226402 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f41d67b1-7ddc-4202-b235-c4f9e3b63a56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1914461639"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:50:28.227032 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f41d67b1-7ddc-4202-b235-c4f9e3b63a56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:28.234226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f41d67b1-7ddc-4202-b235-c4f9e3b63a56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:28.234759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f41d67b1-7ddc-4202-b235-c4f9e3b63a56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:28.235201 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f41d67b1-7ddc-4202-b235-c4f9e3b63a56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:28.235900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f41d67b1-7ddc-4202-b235-c4f9e3b63a56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:28.236358 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f41d67b1-7ddc-4202-b235-c4f9e3b63a56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:28.236783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f41d67b1-7ddc-4202-b235-c4f9e3b63a56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:28.373495 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.network.security_group_api [None req-f41d67b1-7ddc-4202-b235-c4f9e3b63a56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Adding security group bdb10a47-ee28-4878-9495-6ee7b200714e to port 317598a8-29d3-4688-b7e9-60570fabd595 Oct 11 20:50:28.691215 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f41d67b1-7ddc-4202-b235-c4f9e3b63a56 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/action" status: 202 len: 0 microversion: 2.1 time: 0.465395 Oct 11 20:50:28.691215 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3510/6971] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:50:28 2022] POST /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:50:28.698165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0417c210-c11c-4b85-a5f4-57bd26dfb343 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:28.699150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0417c210-c11c-4b85-a5f4-57bd26dfb343 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:28.706916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0417c210-c11c-4b85-a5f4-57bd26dfb343 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:28.707438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0417c210-c11c-4b85-a5f4-57bd26dfb343 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:28.708010 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0417c210-c11c-4b85-a5f4-57bd26dfb343 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:28.708788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0417c210-c11c-4b85-a5f4-57bd26dfb343 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:28.709797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0417c210-c11c-4b85-a5f4-57bd26dfb343 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:28.711065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0417c210-c11c-4b85-a5f4-57bd26dfb343 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:28.929401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0417c210-c11c-4b85-a5f4-57bd26dfb343 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:28.938859 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0417c210-c11c-4b85-a5f4-57bd26dfb343 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1758 microversion: 2.1 time: 0.245760 Oct 11 20:50:28.939687 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3462/6972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:28 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1758 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:29.285624 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3688c01e-b3d4-49a0-8909-7424c049d642 req-03a1a9d3-5099-468a-89bc-dcbc587567a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a4cf05-2be9-497e-8f84-4ff88542263f", "tag": "317598a8-29d3-4688-b7e9-60570fabd595"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:50:29.296456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3688c01e-b3d4-49a0-8909-7424c049d642 req-03a1a9d3-5099-468a-89bc-dcbc587567a7 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:29.296937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3688c01e-b3d4-49a0-8909-7424c049d642 req-03a1a9d3-5099-468a-89bc-dcbc587567a7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:29.297365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3688c01e-b3d4-49a0-8909-7424c049d642 req-03a1a9d3-5099-468a-89bc-dcbc587567a7 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:29.309626 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3688c01e-b3d4-49a0-8909-7424c049d642 req-03a1a9d3-5099-468a-89bc-dcbc587567a7 service nova] Creating event network-changed:317598a8-29d3-4688-b7e9-60570fabd595 for instance 43a4cf05-2be9-497e-8f84-4ff88542263f on n-h2-860864-3 Oct 11 20:50:29.316981 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3688c01e-b3d4-49a0-8909-7424c049d642 req-03a1a9d3-5099-468a-89bc-dcbc587567a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035864 Oct 11 20:50:29.318572 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3511/6973] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:50:44.707656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:44.708419 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=8 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:44.753246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93e9d1cb-df06-4bda-aa90-79e9698899a9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:50:44.755576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-93e9d1cb-df06-4bda-aa90-79e9698899a9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:44.762194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93e9d1cb-df06-4bda-aa90-79e9698899a9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:44.762736 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93e9d1cb-df06-4bda-aa90-79e9698899a9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:44.763188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93e9d1cb-df06-4bda-aa90-79e9698899a9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:44.763884 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93e9d1cb-df06-4bda-aa90-79e9698899a9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:44.764353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93e9d1cb-df06-4bda-aa90-79e9698899a9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:44.764787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93e9d1cb-df06-4bda-aa90-79e9698899a9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:44.835993 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93e9d1cb-df06-4bda-aa90-79e9698899a9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/action" status: 202 len: 0 microversion: 2.1 time: 0.133505 Oct 11 20:50:44.836632 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3463/6974] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:50:44 2022] POST /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:50:44.846222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-997578d6-9a47-4c34-bb0b-975384894833 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:44.846958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-997578d6-9a47-4c34-bb0b-975384894833 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:44.849757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:44.850431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=12 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:50:44.855939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-997578d6-9a47-4c34-bb0b-975384894833 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:44.856426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-997578d6-9a47-4c34-bb0b-975384894833 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:44.856889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-997578d6-9a47-4c34-bb0b-975384894833 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:44.857621 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-997578d6-9a47-4c34-bb0b-975384894833 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:44.858030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-997578d6-9a47-4c34-bb0b-975384894833 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:44.858464 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-997578d6-9a47-4c34-bb0b-975384894833 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:45.097914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-997578d6-9a47-4c34-bb0b-975384894833 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:45.107397 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-997578d6-9a47-4c34-bb0b-975384894833 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1750 microversion: 2.1 time: 0.265483 Oct 11 20:50:45.108237 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3512/6975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:44 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1750 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:46.132345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6e5af0e9-c696-4871-a6d4-794bf6aaf32b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:46.133078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6e5af0e9-c696-4871-a6d4-794bf6aaf32b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:46.140130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e5af0e9-c696-4871-a6d4-794bf6aaf32b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:46.140639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e5af0e9-c696-4871-a6d4-794bf6aaf32b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:46.141096 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e5af0e9-c696-4871-a6d4-794bf6aaf32b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:46.141809 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e5af0e9-c696-4871-a6d4-794bf6aaf32b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:46.142289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e5af0e9-c696-4871-a6d4-794bf6aaf32b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:46.142766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e5af0e9-c696-4871-a6d4-794bf6aaf32b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:46.284577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6e5af0e9-c696-4871-a6d4-794bf6aaf32b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:46.293087 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6e5af0e9-c696-4871-a6d4-794bf6aaf32b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1755 microversion: 2.1 time: 0.166003 Oct 11 20:50:46.293658 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3464/6976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:46 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:47.317313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-83975bc6-6d11-47b9-83f3-1370561ca456 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:47.317933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-83975bc6-6d11-47b9-83f3-1370561ca456 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:47.325169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83975bc6-6d11-47b9-83f3-1370561ca456 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:47.325654 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83975bc6-6d11-47b9-83f3-1370561ca456 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:47.326359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83975bc6-6d11-47b9-83f3-1370561ca456 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:47.327104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83975bc6-6d11-47b9-83f3-1370561ca456 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:47.327606 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83975bc6-6d11-47b9-83f3-1370561ca456 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:47.327983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-83975bc6-6d11-47b9-83f3-1370561ca456 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:47.474829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-83975bc6-6d11-47b9-83f3-1370561ca456 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:47.483148 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-83975bc6-6d11-47b9-83f3-1370561ca456 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1755 microversion: 2.1 time: 0.169900 Oct 11 20:50:47.483719 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3513/6977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:47 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:48.506463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4b5b82b4-9150-464d-a792-c2b753126be9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:48.507130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4b5b82b4-9150-464d-a792-c2b753126be9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:48.514753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b5b82b4-9150-464d-a792-c2b753126be9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:48.515259 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b5b82b4-9150-464d-a792-c2b753126be9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:48.515714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b5b82b4-9150-464d-a792-c2b753126be9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:48.516431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b5b82b4-9150-464d-a792-c2b753126be9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:48.516907 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b5b82b4-9150-464d-a792-c2b753126be9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:48.517348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4b5b82b4-9150-464d-a792-c2b753126be9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:48.659902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4b5b82b4-9150-464d-a792-c2b753126be9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:48.668159 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4b5b82b4-9150-464d-a792-c2b753126be9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1755 microversion: 2.1 time: 0.165705 Oct 11 20:50:48.668734 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3465/6978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:48 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:49.691854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d09772db-5bc8-49d4-99c1-9ce922931288 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:49.692458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d09772db-5bc8-49d4-99c1-9ce922931288 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:49.700054 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d09772db-5bc8-49d4-99c1-9ce922931288 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:49.700536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d09772db-5bc8-49d4-99c1-9ce922931288 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:49.701215 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d09772db-5bc8-49d4-99c1-9ce922931288 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:49.701896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d09772db-5bc8-49d4-99c1-9ce922931288 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:49.702343 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d09772db-5bc8-49d4-99c1-9ce922931288 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:49.702788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d09772db-5bc8-49d4-99c1-9ce922931288 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:49.843484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d09772db-5bc8-49d4-99c1-9ce922931288 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:49.851553 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d09772db-5bc8-49d4-99c1-9ce922931288 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1755 microversion: 2.1 time: 0.163599 Oct 11 20:50:49.852122 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3514/6979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:49 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:50.876672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1878a091-2b03-479f-b664-c4ce5714be55 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:50.877314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1878a091-2b03-479f-b664-c4ce5714be55 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:50.884083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878a091-2b03-479f-b664-c4ce5714be55 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:50.884582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878a091-2b03-479f-b664-c4ce5714be55 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:50.885775 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878a091-2b03-479f-b664-c4ce5714be55 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:50.886360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878a091-2b03-479f-b664-c4ce5714be55 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:50.886851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878a091-2b03-479f-b664-c4ce5714be55 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:50.887289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1878a091-2b03-479f-b664-c4ce5714be55 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:51.036758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1878a091-2b03-479f-b664-c4ce5714be55 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:51.045699 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1878a091-2b03-479f-b664-c4ce5714be55 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1755 microversion: 2.1 time: 0.173014 Oct 11 20:50:51.046290 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3466/6980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:50 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:52.069297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c8dc02ac-b1c0-4040-bb03-c8050c25194b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:52.069911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c8dc02ac-b1c0-4040-bb03-c8050c25194b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:52.077144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8dc02ac-b1c0-4040-bb03-c8050c25194b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:52.077633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8dc02ac-b1c0-4040-bb03-c8050c25194b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:52.078496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8dc02ac-b1c0-4040-bb03-c8050c25194b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:52.078775 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8dc02ac-b1c0-4040-bb03-c8050c25194b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:52.079230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8dc02ac-b1c0-4040-bb03-c8050c25194b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:52.079655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c8dc02ac-b1c0-4040-bb03-c8050c25194b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:52.218855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c8dc02ac-b1c0-4040-bb03-c8050c25194b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:52.227099 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c8dc02ac-b1c0-4040-bb03-c8050c25194b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1755 microversion: 2.1 time: 0.161808 Oct 11 20:50:52.227676 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3515/6981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:52 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:53.250584 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f2c10965-25e2-41b6-a191-ff09c8cc27c2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:53.251174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f2c10965-25e2-41b6-a191-ff09c8cc27c2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:53.258077 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2c10965-25e2-41b6-a191-ff09c8cc27c2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:53.258604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2c10965-25e2-41b6-a191-ff09c8cc27c2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:53.259118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2c10965-25e2-41b6-a191-ff09c8cc27c2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:53.259810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2c10965-25e2-41b6-a191-ff09c8cc27c2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:53.260281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2c10965-25e2-41b6-a191-ff09c8cc27c2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:53.260725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f2c10965-25e2-41b6-a191-ff09c8cc27c2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:53.406942 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f2c10965-25e2-41b6-a191-ff09c8cc27c2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:53.415347 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f2c10965-25e2-41b6-a191-ff09c8cc27c2 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1755 microversion: 2.1 time: 0.169462 Oct 11 20:50:53.415932 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3467/6982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:53 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:54.439494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a9e6526a-88d4-4bbb-b8c2-93f916cbcbf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:54.440109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a9e6526a-88d4-4bbb-b8c2-93f916cbcbf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:54.447169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9e6526a-88d4-4bbb-b8c2-93f916cbcbf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:54.447782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9e6526a-88d4-4bbb-b8c2-93f916cbcbf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:54.448258 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9e6526a-88d4-4bbb-b8c2-93f916cbcbf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:54.449029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9e6526a-88d4-4bbb-b8c2-93f916cbcbf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:54.449598 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9e6526a-88d4-4bbb-b8c2-93f916cbcbf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:54.450134 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a9e6526a-88d4-4bbb-b8c2-93f916cbcbf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:54.592765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a9e6526a-88d4-4bbb-b8c2-93f916cbcbf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:54.601143 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a9e6526a-88d4-4bbb-b8c2-93f916cbcbf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1755 microversion: 2.1 time: 0.165542 Oct 11 20:50:54.601717 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3516/6983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:54 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:55.624579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-087ed46e-4fad-450a-9955-d04e753c779d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:55.625213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-087ed46e-4fad-450a-9955-d04e753c779d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:55.632903 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-087ed46e-4fad-450a-9955-d04e753c779d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:55.633522 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-087ed46e-4fad-450a-9955-d04e753c779d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:55.634079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-087ed46e-4fad-450a-9955-d04e753c779d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:55.634943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-087ed46e-4fad-450a-9955-d04e753c779d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:55.635520 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-087ed46e-4fad-450a-9955-d04e753c779d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:55.636136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-087ed46e-4fad-450a-9955-d04e753c779d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:55.783080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-087ed46e-4fad-450a-9955-d04e753c779d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:55.791423 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-087ed46e-4fad-450a-9955-d04e753c779d tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1755 microversion: 2.1 time: 0.170967 Oct 11 20:50:55.792004 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3468/6984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:55 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:50:56.815259 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-702e3154-9e2c-41b2-9f63-c46cfc71a810 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:50:56.815875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-702e3154-9e2c-41b2-9f63-c46cfc71a810 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:50:56.822716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-702e3154-9e2c-41b2-9f63-c46cfc71a810 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:56.823200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-702e3154-9e2c-41b2-9f63-c46cfc71a810 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:56.823636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-702e3154-9e2c-41b2-9f63-c46cfc71a810 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:56.824320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-702e3154-9e2c-41b2-9f63-c46cfc71a810 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:50:56.825424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-702e3154-9e2c-41b2-9f63-c46cfc71a810 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:50:56.825886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-702e3154-9e2c-41b2-9f63-c46cfc71a810 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:50:56.967558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-702e3154-9e2c-41b2-9f63-c46cfc71a810 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:50:56.975752 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-702e3154-9e2c-41b2-9f63-c46cfc71a810 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1758 microversion: 2.1 time: 0.164369 Oct 11 20:50:56.976323 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3517/6985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:50:56 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:51:29.373774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-574beab4-4f34-4ccd-bd25-5577d9e3ac43 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1914461639"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:51:29.374324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-574beab4-4f34-4ccd-bd25-5577d9e3ac43 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:29.376568 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=12 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:51:29.377386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:51:29.383017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-574beab4-4f34-4ccd-bd25-5577d9e3ac43 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:29.383523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-574beab4-4f34-4ccd-bd25-5577d9e3ac43 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:29.383986 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-574beab4-4f34-4ccd-bd25-5577d9e3ac43 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:29.384695 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-574beab4-4f34-4ccd-bd25-5577d9e3ac43 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:29.385169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-574beab4-4f34-4ccd-bd25-5577d9e3ac43 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:29.385615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-574beab4-4f34-4ccd-bd25-5577d9e3ac43 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:29.844930 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.network.security_group_api [None req-574beab4-4f34-4ccd-bd25-5577d9e3ac43 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Removing security group bdb10a47-ee28-4878-9495-6ee7b200714e from port 317598a8-29d3-4688-b7e9-60570fabd595 Oct 11 20:51:30.144176 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-574beab4-4f34-4ccd-bd25-5577d9e3ac43 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "POST /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/action" status: 202 len: 0 microversion: 2.1 time: 0.774789 Oct 11 20:51:30.148039 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3469/6986] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:51:29 2022] POST /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/action => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:51:30.157814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=12 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:51:30.158928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=36 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:51:30.214287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-4240f7d9-8a70-4613-a58c-12cec1dd8836 req-04b70502-83fa-45d1-bcdc-0d4b273f2382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a4cf05-2be9-497e-8f84-4ff88542263f", "tag": "317598a8-29d3-4688-b7e9-60570fabd595"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:51:30.225072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4240f7d9-8a70-4613-a58c-12cec1dd8836 req-04b70502-83fa-45d1-bcdc-0d4b273f2382 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:30.225559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4240f7d9-8a70-4613-a58c-12cec1dd8836 req-04b70502-83fa-45d1-bcdc-0d4b273f2382 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:30.226171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-4240f7d9-8a70-4613-a58c-12cec1dd8836 req-04b70502-83fa-45d1-bcdc-0d4b273f2382 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:30.239478 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-4240f7d9-8a70-4613-a58c-12cec1dd8836 req-04b70502-83fa-45d1-bcdc-0d4b273f2382 service nova] Creating event network-changed:317598a8-29d3-4688-b7e9-60570fabd595 for instance 43a4cf05-2be9-497e-8f84-4ff88542263f on n-h2-860864-3 Oct 11 20:51:30.244870 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-4240f7d9-8a70-4613-a58c-12cec1dd8836 req-04b70502-83fa-45d1-bcdc-0d4b273f2382 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092550 Oct 11 20:51:30.245796 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3518/6987] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:51:31.504140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-19d44f9d-10b1-4f8a-a0e9-a4d6bbae7ef1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:31.504742 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-19d44f9d-10b1-4f8a-a0e9-a4d6bbae7ef1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:31.513286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d44f9d-10b1-4f8a-a0e9-a4d6bbae7ef1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:31.513798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d44f9d-10b1-4f8a-a0e9-a4d6bbae7ef1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:31.514350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d44f9d-10b1-4f8a-a0e9-a4d6bbae7ef1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:31.515312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d44f9d-10b1-4f8a-a0e9-a4d6bbae7ef1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:31.515794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d44f9d-10b1-4f8a-a0e9-a4d6bbae7ef1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:31.516248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19d44f9d-10b1-4f8a-a0e9-a4d6bbae7ef1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:31.560266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-09db5033-5043-46f1-9968-bf4e095bc469 req-b6581fcd-7735-46cb-9b7d-d0b167c1e82f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a4cf05-2be9-497e-8f84-4ff88542263f", "tag": "317598a8-29d3-4688-b7e9-60570fabd595"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:51:31.570776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-09db5033-5043-46f1-9968-bf4e095bc469 req-b6581fcd-7735-46cb-9b7d-d0b167c1e82f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:31.571385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-09db5033-5043-46f1-9968-bf4e095bc469 req-b6581fcd-7735-46cb-9b7d-d0b167c1e82f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:31.572053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-09db5033-5043-46f1-9968-bf4e095bc469 req-b6581fcd-7735-46cb-9b7d-d0b167c1e82f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:31.583481 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-09db5033-5043-46f1-9968-bf4e095bc469 req-b6581fcd-7735-46cb-9b7d-d0b167c1e82f service nova] Creating event network-changed:317598a8-29d3-4688-b7e9-60570fabd595 for instance 43a4cf05-2be9-497e-8f84-4ff88542263f on n-h2-860864-3 Oct 11 20:51:31.588658 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-09db5033-5043-46f1-9968-bf4e095bc469 req-b6581fcd-7735-46cb-9b7d-d0b167c1e82f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086000 Oct 11 20:51:31.589821 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3519/6988] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:51:31.605019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-19d44f9d-10b1-4f8a-a0e9-a4d6bbae7ef1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lazy-loading 'services' on Instance uuid 43a4cf05-2be9-497e-8f84-4ff88542263f {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:51:31.685803 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-19d44f9d-10b1-4f8a-a0e9-a4d6bbae7ef1 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "DELETE /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments/23ebe224-f409-4b2a-bf75-ae41ba798edd" status: 202 len: 0 microversion: 2.1 time: 0.185985 Oct 11 20:51:31.686427 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3470/6989] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:51:31 2022] DELETE /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments/23ebe224-f409-4b2a-bf75-ae41ba798edd => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:51:31.697737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bd2a7bb0-c526-406f-8a68-582a98bfb99a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:31.700615 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bd2a7bb0-c526-406f-8a68-582a98bfb99a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:31.718029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2a7bb0-c526-406f-8a68-582a98bfb99a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:31.718857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2a7bb0-c526-406f-8a68-582a98bfb99a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:31.719295 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2a7bb0-c526-406f-8a68-582a98bfb99a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:31.720190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2a7bb0-c526-406f-8a68-582a98bfb99a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:31.720644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2a7bb0-c526-406f-8a68-582a98bfb99a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:31.721076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bd2a7bb0-c526-406f-8a68-582a98bfb99a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:31.755368 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bd2a7bb0-c526-406f-8a68-582a98bfb99a tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064116 Oct 11 20:51:31.760923 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3520/6990] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:51:31 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:51:32.770766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5acd244b-94fa-43b9-a160-ba215b8ca20b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:32.773171 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5acd244b-94fa-43b9-a160-ba215b8ca20b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:32.780312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5acd244b-94fa-43b9-a160-ba215b8ca20b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:32.780821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5acd244b-94fa-43b9-a160-ba215b8ca20b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:32.781280 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5acd244b-94fa-43b9-a160-ba215b8ca20b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:32.781996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5acd244b-94fa-43b9-a160-ba215b8ca20b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:32.782470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5acd244b-94fa-43b9-a160-ba215b8ca20b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:32.782940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5acd244b-94fa-43b9-a160-ba215b8ca20b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:32.814325 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5acd244b-94fa-43b9-a160-ba215b8ca20b tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048748 Oct 11 20:51:32.814928 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3471/6991] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:51:32 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:51:33.827653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-748af524-4632-450f-9d1f-4a12eb7aaef0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:33.829812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-748af524-4632-450f-9d1f-4a12eb7aaef0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:33.841356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-748af524-4632-450f-9d1f-4a12eb7aaef0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:33.841852 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-748af524-4632-450f-9d1f-4a12eb7aaef0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:33.842293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-748af524-4632-450f-9d1f-4a12eb7aaef0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:33.843023 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-748af524-4632-450f-9d1f-4a12eb7aaef0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:33.843487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-748af524-4632-450f-9d1f-4a12eb7aaef0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:33.843916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-748af524-4632-450f-9d1f-4a12eb7aaef0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:33.873319 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-748af524-4632-450f-9d1f-4a12eb7aaef0 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050305 Oct 11 20:51:33.873931 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3521/6992] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:51:33 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:51:34.885696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-946ef505-a75b-4948-9412-62a272b29fc3 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:34.888435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-946ef505-a75b-4948-9412-62a272b29fc3 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:34.898908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-946ef505-a75b-4948-9412-62a272b29fc3 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:34.899434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-946ef505-a75b-4948-9412-62a272b29fc3 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:34.899879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-946ef505-a75b-4948-9412-62a272b29fc3 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:34.900590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-946ef505-a75b-4948-9412-62a272b29fc3 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:34.901059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-946ef505-a75b-4948-9412-62a272b29fc3 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:34.901502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-946ef505-a75b-4948-9412-62a272b29fc3 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:34.930656 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-946ef505-a75b-4948-9412-62a272b29fc3 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049099 Oct 11 20:51:34.931231 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3472/6993] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:51:34 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:51:35.944503 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ef497b50-7e7e-4ea2-96d8-6dcbdbfcb1f7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:35.946733 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ef497b50-7e7e-4ea2-96d8-6dcbdbfcb1f7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:35.954449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef497b50-7e7e-4ea2-96d8-6dcbdbfcb1f7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:35.954969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef497b50-7e7e-4ea2-96d8-6dcbdbfcb1f7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:35.955486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef497b50-7e7e-4ea2-96d8-6dcbdbfcb1f7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:35.956188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef497b50-7e7e-4ea2-96d8-6dcbdbfcb1f7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:35.956649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef497b50-7e7e-4ea2-96d8-6dcbdbfcb1f7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:35.957075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ef497b50-7e7e-4ea2-96d8-6dcbdbfcb1f7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:35.987434 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ef497b50-7e7e-4ea2-96d8-6dcbdbfcb1f7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046885 Oct 11 20:51:35.988013 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3522/6994] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:51:35 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:51:36.999966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3992b60b-8abc-4897-8125-2d6533eed09e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:37.002188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3992b60b-8abc-4897-8125-2d6533eed09e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:37.009105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3992b60b-8abc-4897-8125-2d6533eed09e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:37.009617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3992b60b-8abc-4897-8125-2d6533eed09e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:37.010080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3992b60b-8abc-4897-8125-2d6533eed09e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:37.010818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3992b60b-8abc-4897-8125-2d6533eed09e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:37.011330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3992b60b-8abc-4897-8125-2d6533eed09e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:37.012344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3992b60b-8abc-4897-8125-2d6533eed09e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:37.041786 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3992b60b-8abc-4897-8125-2d6533eed09e tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045872 Oct 11 20:51:37.042347 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3473/6995] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 11 20:51:36 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 20:51:37.053057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:37.053553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:37.060558 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:37.061048 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:37.061483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:37.062171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:37.062649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:37.063072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:37.143469 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] HTTP exception thrown: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f is not attached to volume 23ebe224-f409-4b2a-bf75-ae41ba798edd Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Request method failure captured: Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: request: DELETE /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments/23ebe224-f409-4b2a-bf75-ae41ba798edd HTTP/1.1 Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdXxPSoF-7PFWkUlPn0DB2b3JBm8dRTkXcnfKPdV3t_OuaTl6WtJC-beTbL_DA8YY-4tZBvhXo0O_Gbkew9TgjTzMY16kp1l8qXYg4aNjX1Gk4dvc5sDfdLyytKBL6zva2RswlQWNodFPOutbvat6X0JleUnxHRTIBgZca_zI8S5PsY Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 556f7772059641f894f356c197fff449 Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/556f7772059641f894f356c197fff449"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_556f7772059641f894f356c197fff449", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/556f7772059641f894f356c197fff449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/556f7772059641f894f356c197fff449"}]}] Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 556f7772059641f894f356c197fff449 Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestMinimumBasicScenario-1181580194-project Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 884b1e8363c1469b841b15d270a78641 Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestMinimumBasicScenario-1181580194-project Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f is not attached to volume 23ebe224-f409-4b2a-bf75-ae41ba798edd Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'server_id': '43a4cf05-2be9-497e-8f84-4ff88542263f', 'id': '23ebe224-f409-4b2a-bf75-ae41ba798edd'} Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 23ebe224-f409-4b2a-bf75-ae41ba798edd. Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f is not attached to volume 23ebe224-f409-4b2a-bf75-ae41ba798edd Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:51:37.152966 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:51:37.157786 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:51:37.157786 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:51:37.157786 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f is not attached to volume 23ebe224-f409-4b2a-bf75-ae41ba798edd Oct 11 20:51:37.157786 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:51:37.157786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Returning 404 to user: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f is not attached to volume 23ebe224-f409-4b2a-bf75-ae41ba798edd {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:51:37.157786 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e1847017-2551-47fd-bfac-632529a31e20 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "DELETE /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments/23ebe224-f409-4b2a-bf75-ae41ba798edd" status: 404 len: 154 microversion: 2.1 time: 0.105369 Oct 11 20:51:37.157786 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3523/6996] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 11 20:51:37 2022] DELETE /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f/os-volume_attachments/23ebe224-f409-4b2a-bf75-ae41ba798edd => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:51:40.408478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2c759dd9-b186-4511-aea1-8836430fe177 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:40.408991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2c759dd9-b186-4511-aea1-8836430fe177 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:40.415248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c759dd9-b186-4511-aea1-8836430fe177 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:40.415743 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c759dd9-b186-4511-aea1-8836430fe177 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:40.416191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c759dd9-b186-4511-aea1-8836430fe177 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:40.416889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c759dd9-b186-4511-aea1-8836430fe177 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:40.417353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c759dd9-b186-4511-aea1-8836430fe177 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:40.417789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2c759dd9-b186-4511-aea1-8836430fe177 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:40.442992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2c759dd9-b186-4511-aea1-8836430fe177 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:51:40.525479 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2c759dd9-b186-4511-aea1-8836430fe177 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "DELETE /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 204 len: 0 microversion: 2.1 time: 0.120673 Oct 11 20:51:40.526299 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3474/6997] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:51:40 2022] DELETE /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:51:40.534429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7bc1b8a0-4040-4ea8-9015-aa6e934af8c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:40.535083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7bc1b8a0-4040-4ea8-9015-aa6e934af8c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:40.542486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bc1b8a0-4040-4ea8-9015-aa6e934af8c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:40.543591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bc1b8a0-4040-4ea8-9015-aa6e934af8c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:40.544117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bc1b8a0-4040-4ea8-9015-aa6e934af8c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:40.544797 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bc1b8a0-4040-4ea8-9015-aa6e934af8c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:40.545251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bc1b8a0-4040-4ea8-9015-aa6e934af8c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:40.545666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7bc1b8a0-4040-4ea8-9015-aa6e934af8c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:40.677230 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7bc1b8a0-4040-4ea8-9015-aa6e934af8c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:51:40.686244 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7bc1b8a0-4040-4ea8-9015-aa6e934af8c7 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1552 microversion: 2.1 time: 0.155645 Oct 11 20:51:40.686856 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3524/6998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:51:40 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:51:41.710387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8015ad75-03bd-415f-a25b-92c81fa0dcf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:41.711142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8015ad75-03bd-415f-a25b-92c81fa0dcf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:41.718779 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8015ad75-03bd-415f-a25b-92c81fa0dcf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:41.719290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8015ad75-03bd-415f-a25b-92c81fa0dcf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:41.719748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8015ad75-03bd-415f-a25b-92c81fa0dcf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:41.720463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8015ad75-03bd-415f-a25b-92c81fa0dcf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:41.720943 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8015ad75-03bd-415f-a25b-92c81fa0dcf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:41.721392 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8015ad75-03bd-415f-a25b-92c81fa0dcf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:41.852708 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8015ad75-03bd-415f-a25b-92c81fa0dcf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:51:41.861367 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8015ad75-03bd-415f-a25b-92c81fa0dcf9 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1552 microversion: 2.1 time: 0.155300 Oct 11 20:51:41.861956 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3475/6999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:51:41 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:51:42.626325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ac0db79e-ef9c-4b2c-bbdf-88b17c0ceb2e req-97165670-5004-40e1-9e74-558ecde06401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a4cf05-2be9-497e-8f84-4ff88542263f", "name": "network-vif-deleted", "tag": "317598a8-29d3-4688-b7e9-60570fabd595"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:51:42.640120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ac0db79e-ef9c-4b2c-bbdf-88b17c0ceb2e req-97165670-5004-40e1-9e74-558ecde06401 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:42.640520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ac0db79e-ef9c-4b2c-bbdf-88b17c0ceb2e req-97165670-5004-40e1-9e74-558ecde06401 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:42.641253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ac0db79e-ef9c-4b2c-bbdf-88b17c0ceb2e req-97165670-5004-40e1-9e74-558ecde06401 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:42.653105 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ac0db79e-ef9c-4b2c-bbdf-88b17c0ceb2e req-97165670-5004-40e1-9e74-558ecde06401 service nova] Creating event network-vif-deleted:317598a8-29d3-4688-b7e9-60570fabd595 for instance 43a4cf05-2be9-497e-8f84-4ff88542263f on n-h2-860864-3 Oct 11 20:51:42.657979 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ac0db79e-ef9c-4b2c-bbdf-88b17c0ceb2e req-97165670-5004-40e1-9e74-558ecde06401 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035662 Oct 11 20:51:42.658600 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3525/7000] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:51:42.885003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:42.885604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:42.892913 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:42.893281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:42.893741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:42.894467 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:42.894964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:42.895411 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:42.928606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:42.929105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:42.929558 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:42.930029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lazy-loading 'fault' on Instance uuid 43a4cf05-2be9-497e-8f84-4ff88542263f {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:51:42.973009 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b1e8363c1469b841b15d270a78641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556f7772059641f894f356c197fff449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:51:42.990851 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-239ba307-66f6-4e6b-9393-48c062060e57 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 200 len: 1346 microversion: 2.1 time: 0.109710 Oct 11 20:51:42.992182 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3476/7001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:51:42 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 1346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:51:44.016406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:44.017116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] [instance: 43a4cf05-2be9-497e-8f84-4ff88542263f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:44.023331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:44.023818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:44.024256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:44.024941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:44.025397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:44.025822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:44.039651 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] HTTP exception thrown: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f could not be found. Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Request method failure captured: Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f HTTP/1.1 Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdXxPSoF-7PFWkUlPn0DB2b3JBm8dRTkXcnfKPdV3t_OuaTl6WtJC-beTbL_DA8YY-4tZBvhXo0O_Gbkew9TgjTzMY16kp1l8qXYg4aNjX1Gk4dvc5sDfdLyytKBL6zva2RswlQWNodFPOutbvat6X0JleUnxHRTIBgZca_zI8S5PsY Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 556f7772059641f894f356c197fff449 Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/556f7772059641f894f356c197fff449"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_556f7772059641f894f356c197fff449", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/556f7772059641f894f356c197fff449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/556f7772059641f894f356c197fff449"}]}] Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 556f7772059641f894f356c197fff449 Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1181580194 Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestMinimumBasicScenario-1181580194-project Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 884b1e8363c1469b841b15d270a78641 Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestMinimumBasicScenario-1181580194-project Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f could not be found. Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '43a4cf05-2be9-497e-8f84-4ff88542263f'} Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f could not be found. Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f could not be found. Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:51:44.041242 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:51:44.046569 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:51:44.046569 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:51:44.046569 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:51:44.046569 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:51:44.046569 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:51:44.046569 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f could not be found. Oct 11 20:51:44.046569 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:51:44.046569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Returning 404 to user: Instance 43a4cf05-2be9-497e-8f84-4ff88542263f could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:51:44.046569 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4c6d0549-41d6-41a0-bc32-0b97fad4af14 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f" status: 404 len: 111 microversion: 2.1 time: 0.031333 Oct 11 20:51:44.046569 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3526/7002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:51:44 2022] GET /compute/v2.1/servers/43a4cf05-2be9-497e-8f84-4ff88542263f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:51:44.052005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3b8f7e13-bc88-4431-ac61-73cfba957745 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] Calling method '.version_select at 0x7f83c46f8040>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:44.071992 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3b8f7e13-bc88-4431-ac61-73cfba957745 tempest-TestMinimumBasicScenario-1181580194 tempest-TestMinimumBasicScenario-1181580194-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-60603532" status: 202 len: 0 microversion: 2.1 time: 0.023694 Oct 11 20:51:44.072571 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3477/7003] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 11 20:51:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-60603532 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:51:53.012934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f33eac93-6724-4055-bb7e-72dafbddf6e4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'create', calling method: .version_select at 0x7f83c70b4430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-90863441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInHEeYPiAJn9V3dOCXG7SgOZbvYkcOfwjUXVYmpQjCbGfPrZsyiUqubN8s5ODFDUi7UzN75iYLGoimTsd8NUREwT8qICWVHjw4ZAY+YcNpiHtmQxaiLTbhIYqAamoBUyw=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:51:53.028886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f33eac93-6724-4055-bb7e-72dafbddf6e4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for project 693353fd79c44f7096de98d129f5a4d5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:51:53.034833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-f33eac93-6724-4055-bb7e-72dafbddf6e4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for user 6bd83b65d6f74f318789f72489360ae0 and project 693353fd79c44f7096de98d129f5a4d5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:51:53.060058 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f33eac93-6724-4055-bb7e-72dafbddf6e4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.212646 Oct 11 20:51:53.060658 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3527/7004] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:51:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:51:58.801376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:51:58.802146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:51:58.806749 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1272043844", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "78607c27-8e80-4ab2-a1a0-6578e197ef6b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-90863441", "security_groups": [{"name": "tempest-secgroup-smoke-1170599401"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:51:58.922551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] validate_networks() for [('78607c27-8e80-4ab2-a1a0-6578e197ef6b', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:51:59.436261 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:51:59.436993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:51:59.437590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:51:59.438095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:51:59.438680 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:51:59.451290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:59.451894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:59.453216 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:59.454169 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:51:59.454831 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:51:59.455437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:51:59.476813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for project 693353fd79c44f7096de98d129f5a4d5. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:51:59.486145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for user 6bd83b65d6f74f318789f72489360ae0 and project 693353fd79c44f7096de98d129f5a4d5. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:51:59.501703 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:51:59.504188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:51:59.563840 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4a9b9f01-552e-4311-acb6-0f6dab7e75e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764524 Oct 11 20:51:59.564696 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3478/7005] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:51:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:51:59.578400 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff905d81-5601-4337-9f8d-fe4de5f425a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:51:59.579179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ff905d81-5601-4337-9f8d-fe4de5f425a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:51:59.594603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=38 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:51:59.655322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ff905d81-5601-4337-9f8d-fe4de5f425a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:51:59.666232 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff905d81-5601-4337-9f8d-fe4de5f425a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1265 microversion: 2.1 time: 0.093611 Oct 11 20:51:59.667566 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3528/7006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:51:59 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:00.694224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c6fb18df-8193-4b1d-8400-5f692612f480 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:00.694972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c6fb18df-8193-4b1d-8400-5f692612f480 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:00.765027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c6fb18df-8193-4b1d-8400-5f692612f480 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:00.772880 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c6fb18df-8193-4b1d-8400-5f692612f480 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1265 microversion: 2.1 time: 0.084277 Oct 11 20:52:00.773553 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3479/7007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:00 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:01.796452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-49d3b05e-f80d-43c2-afb0-dc0f567f414e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:01.797070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-49d3b05e-f80d-43c2-afb0-dc0f567f414e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:01.800491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:52:01.866755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49d3b05e-f80d-43c2-afb0-dc0f567f414e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:01.875560 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-49d3b05e-f80d-43c2-afb0-dc0f567f414e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1265 microversion: 2.1 time: 0.083455 Oct 11 20:52:01.876186 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3529/7008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:01 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:02.900091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-96a31e1a-8afe-4e11-832b-f435156a5d67 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:02.900714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-96a31e1a-8afe-4e11-832b-f435156a5d67 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:02.954350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-96a31e1a-8afe-4e11-832b-f435156a5d67 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:02.961319 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-96a31e1a-8afe-4e11-832b-f435156a5d67 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1265 microversion: 2.1 time: 0.065185 Oct 11 20:52:02.961893 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3480/7009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:02 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1265 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:03.984249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cdeca9dc-bebf-4270-af40-671eb2c9a087 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:03.984853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cdeca9dc-bebf-4270-af40-671eb2c9a087 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:03.991793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdeca9dc-bebf-4270-af40-671eb2c9a087 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:03.992276 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdeca9dc-bebf-4270-af40-671eb2c9a087 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:03.992710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdeca9dc-bebf-4270-af40-671eb2c9a087 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:03.993389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdeca9dc-bebf-4270-af40-671eb2c9a087 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:03.993837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdeca9dc-bebf-4270-af40-671eb2c9a087 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:03.994255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cdeca9dc-bebf-4270-af40-671eb2c9a087 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:04.057162 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cdeca9dc-bebf-4270-af40-671eb2c9a087 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:04.065451 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cdeca9dc-bebf-4270-af40-671eb2c9a087 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1269 microversion: 2.1 time: 0.085639 Oct 11 20:52:04.066037 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3530/7010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:03 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:05.088612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7c0a772c-35a8-4fca-93bd-094953c5f44d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:05.090054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7c0a772c-35a8-4fca-93bd-094953c5f44d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:05.098051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c0a772c-35a8-4fca-93bd-094953c5f44d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:05.098589 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c0a772c-35a8-4fca-93bd-094953c5f44d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:05.099057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c0a772c-35a8-4fca-93bd-094953c5f44d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:05.099783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c0a772c-35a8-4fca-93bd-094953c5f44d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:05.100262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c0a772c-35a8-4fca-93bd-094953c5f44d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:05.100711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7c0a772c-35a8-4fca-93bd-094953c5f44d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:05.178019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7c0a772c-35a8-4fca-93bd-094953c5f44d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:05.186716 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7c0a772c-35a8-4fca-93bd-094953c5f44d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1323 microversion: 2.1 time: 0.101993 Oct 11 20:52:05.187649 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3481/7011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:05 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1323 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:06.212415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fcb26ef9-0a62-4eb5-9f63-e2a2dfa56d23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:06.213060 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fcb26ef9-0a62-4eb5-9f63-e2a2dfa56d23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:06.220968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcb26ef9-0a62-4eb5-9f63-e2a2dfa56d23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:06.221461 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcb26ef9-0a62-4eb5-9f63-e2a2dfa56d23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:06.221897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcb26ef9-0a62-4eb5-9f63-e2a2dfa56d23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:06.222618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcb26ef9-0a62-4eb5-9f63-e2a2dfa56d23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:06.223074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcb26ef9-0a62-4eb5-9f63-e2a2dfa56d23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:06.223502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fcb26ef9-0a62-4eb5-9f63-e2a2dfa56d23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:06.441927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fcb26ef9-0a62-4eb5-9f63-e2a2dfa56d23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:06.450013 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fcb26ef9-0a62-4eb5-9f63-e2a2dfa56d23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1391 microversion: 2.1 time: 0.241446 Oct 11 20:52:06.450478 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3531/7012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:06 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:06.580914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-95e877bf-4956-4f6e-b270-823e68efedeb req-8ad21908-23d0-4186-afa4-0d7ff47c1486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455bf99e-5147-42a3-bc99-faa94ee51333", "tag": "2db851d3-559d-400b-b098-297856a43bb1"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:52:06.594929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-95e877bf-4956-4f6e-b270-823e68efedeb req-8ad21908-23d0-4186-afa4-0d7ff47c1486 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:06.594929 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-95e877bf-4956-4f6e-b270-823e68efedeb req-8ad21908-23d0-4186-afa4-0d7ff47c1486 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:06.595251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-95e877bf-4956-4f6e-b270-823e68efedeb req-8ad21908-23d0-4186-afa4-0d7ff47c1486 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:06.608606 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-95e877bf-4956-4f6e-b270-823e68efedeb req-8ad21908-23d0-4186-afa4-0d7ff47c1486 service nova] Creating event network-changed:2db851d3-559d-400b-b098-297856a43bb1 for instance 455bf99e-5147-42a3-bc99-faa94ee51333 on n-h1-860864-3 Oct 11 20:52:06.613677 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-95e877bf-4956-4f6e-b270-823e68efedeb req-8ad21908-23d0-4186-afa4-0d7ff47c1486 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039382 Oct 11 20:52:06.615051 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3482/7013] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:52:07.474604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b51b972f-08ca-412d-bf42-2a1ab98dc730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:07.475213 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b51b972f-08ca-412d-bf42-2a1ab98dc730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:07.482372 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51b972f-08ca-412d-bf42-2a1ab98dc730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:07.482886 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51b972f-08ca-412d-bf42-2a1ab98dc730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:07.483322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51b972f-08ca-412d-bf42-2a1ab98dc730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:07.483999 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51b972f-08ca-412d-bf42-2a1ab98dc730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:07.484451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51b972f-08ca-412d-bf42-2a1ab98dc730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:07.484872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b51b972f-08ca-412d-bf42-2a1ab98dc730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:07.614067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b51b972f-08ca-412d-bf42-2a1ab98dc730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:07.621704 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b51b972f-08ca-412d-bf42-2a1ab98dc730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1391 microversion: 2.1 time: 0.151053 Oct 11 20:52:07.622279 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3532/7014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:07 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:08.645306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8176fd8d-b52f-46b5-b1a7-b8cf3c092038 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:08.646026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8176fd8d-b52f-46b5-b1a7-b8cf3c092038 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:08.653748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8176fd8d-b52f-46b5-b1a7-b8cf3c092038 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:08.654254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8176fd8d-b52f-46b5-b1a7-b8cf3c092038 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:08.654761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8176fd8d-b52f-46b5-b1a7-b8cf3c092038 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:08.655478 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8176fd8d-b52f-46b5-b1a7-b8cf3c092038 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:08.655953 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8176fd8d-b52f-46b5-b1a7-b8cf3c092038 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:08.656395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8176fd8d-b52f-46b5-b1a7-b8cf3c092038 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:08.794417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8176fd8d-b52f-46b5-b1a7-b8cf3c092038 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:08.802303 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8176fd8d-b52f-46b5-b1a7-b8cf3c092038 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1391 microversion: 2.1 time: 0.161262 Oct 11 20:52:08.802925 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3483/7015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:08 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:09.826626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-80534cb5-3ba5-4488-9d44-c55619f219f9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:09.827219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-80534cb5-3ba5-4488-9d44-c55619f219f9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:09.834026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80534cb5-3ba5-4488-9d44-c55619f219f9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:09.834509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80534cb5-3ba5-4488-9d44-c55619f219f9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:09.834969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80534cb5-3ba5-4488-9d44-c55619f219f9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:09.835669 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80534cb5-3ba5-4488-9d44-c55619f219f9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:09.836095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80534cb5-3ba5-4488-9d44-c55619f219f9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:09.836515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-80534cb5-3ba5-4488-9d44-c55619f219f9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:09.968267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-80534cb5-3ba5-4488-9d44-c55619f219f9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:09.975882 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-80534cb5-3ba5-4488-9d44-c55619f219f9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1391 microversion: 2.1 time: 0.154177 Oct 11 20:52:09.976458 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3533/7016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:09 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:10.460571 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-eedb40b1-1f7c-4b81-8407-308cf6c8c10b req-41c2177a-1e00-494f-9318-53021998651e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455bf99e-5147-42a3-bc99-faa94ee51333", "name": "network-vif-plugged", "status": "completed", "tag": "2db851d3-559d-400b-b098-297856a43bb1"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:52:10.466549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:52:10.472623 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-eedb40b1-1f7c-4b81-8407-308cf6c8c10b req-41c2177a-1e00-494f-9318-53021998651e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:10.473136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-eedb40b1-1f7c-4b81-8407-308cf6c8c10b req-41c2177a-1e00-494f-9318-53021998651e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:10.473576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-eedb40b1-1f7c-4b81-8407-308cf6c8c10b req-41c2177a-1e00-494f-9318-53021998651e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:10.486036 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-eedb40b1-1f7c-4b81-8407-308cf6c8c10b req-41c2177a-1e00-494f-9318-53021998651e service nova] Creating event network-vif-plugged:2db851d3-559d-400b-b098-297856a43bb1 for instance 455bf99e-5147-42a3-bc99-faa94ee51333 on n-h1-860864-3 Oct 11 20:52:10.491139 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-eedb40b1-1f7c-4b81-8407-308cf6c8c10b req-41c2177a-1e00-494f-9318-53021998651e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034718 Oct 11 20:52:10.491743 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3484/7017] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:52:10.998429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5da3d955-2043-4228-90b4-37f76d0bb46f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:10.999071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5da3d955-2043-4228-90b4-37f76d0bb46f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:11.005857 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5da3d955-2043-4228-90b4-37f76d0bb46f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:11.006340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5da3d955-2043-4228-90b4-37f76d0bb46f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:11.006809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5da3d955-2043-4228-90b4-37f76d0bb46f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:11.007498 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5da3d955-2043-4228-90b4-37f76d0bb46f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:11.007954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5da3d955-2043-4228-90b4-37f76d0bb46f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:11.008378 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5da3d955-2043-4228-90b4-37f76d0bb46f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:11.141339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5da3d955-2043-4228-90b4-37f76d0bb46f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:11.149062 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5da3d955-2043-4228-90b4-37f76d0bb46f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1391 microversion: 2.1 time: 0.154666 Oct 11 20:52:11.149563 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3534/7018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:10 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:12.174377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dedb1a70-be62-4782-a945-f972a20b9bcd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:12.175122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dedb1a70-be62-4782-a945-f972a20b9bcd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:12.181556 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dedb1a70-be62-4782-a945-f972a20b9bcd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:12.182058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dedb1a70-be62-4782-a945-f972a20b9bcd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:12.183155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dedb1a70-be62-4782-a945-f972a20b9bcd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:12.183853 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dedb1a70-be62-4782-a945-f972a20b9bcd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:12.184317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dedb1a70-be62-4782-a945-f972a20b9bcd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:12.184762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dedb1a70-be62-4782-a945-f972a20b9bcd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:12.314877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dedb1a70-be62-4782-a945-f972a20b9bcd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:12.322710 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dedb1a70-be62-4782-a945-f972a20b9bcd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1561 microversion: 2.1 time: 0.153402 Oct 11 20:52:12.323485 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3485/7019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:12 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:12.345562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61073b45-920c-4619-bf20-471941d0af14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:12.346179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-61073b45-920c-4619-bf20-471941d0af14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:12.348063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=8 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:52:12.354100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61073b45-920c-4619-bf20-471941d0af14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:12.355144 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61073b45-920c-4619-bf20-471941d0af14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:12.355585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61073b45-920c-4619-bf20-471941d0af14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:12.356267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61073b45-920c-4619-bf20-471941d0af14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:12.356731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61073b45-920c-4619-bf20-471941d0af14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:12.357156 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61073b45-920c-4619-bf20-471941d0af14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:12.490947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-61073b45-920c-4619-bf20-471941d0af14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:12.499058 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-61073b45-920c-4619-bf20-471941d0af14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1561 microversion: 2.1 time: 0.157447 Oct 11 20:52:12.499633 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3535/7020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:12 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:14.074439 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-af1fa3a0-65e9-4fbb-8f88-e453cbb35359 req-097d5a4b-11e1-453c-a327-cff5d88fee0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455bf99e-5147-42a3-bc99-faa94ee51333", "tag": "2db851d3-559d-400b-b098-297856a43bb1"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:52:14.081376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-7b162f5b-fcfb-411b-bbb2-643d62ac4879 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:14.082018 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-7b162f5b-fcfb-411b-bbb2-643d62ac4879 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:14.084235 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=10 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:52:14.093780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b162f5b-fcfb-411b-bbb2-643d62ac4879 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:14.094067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-af1fa3a0-65e9-4fbb-8f88-e453cbb35359 req-097d5a4b-11e1-453c-a327-cff5d88fee0e service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:14.094303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b162f5b-fcfb-411b-bbb2-643d62ac4879 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:14.094594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-af1fa3a0-65e9-4fbb-8f88-e453cbb35359 req-097d5a4b-11e1-453c-a327-cff5d88fee0e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:14.094796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b162f5b-fcfb-411b-bbb2-643d62ac4879 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:14.095031 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-af1fa3a0-65e9-4fbb-8f88-e453cbb35359 req-097d5a4b-11e1-453c-a327-cff5d88fee0e service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:14.095550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b162f5b-fcfb-411b-bbb2-643d62ac4879 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:14.096005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b162f5b-fcfb-411b-bbb2-643d62ac4879 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:14.096456 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-7b162f5b-fcfb-411b-bbb2-643d62ac4879 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:14.107227 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-af1fa3a0-65e9-4fbb-8f88-e453cbb35359 req-097d5a4b-11e1-453c-a327-cff5d88fee0e service nova] Creating event network-changed:2db851d3-559d-400b-b098-297856a43bb1 for instance 455bf99e-5147-42a3-bc99-faa94ee51333 on n-h1-860864-3 Oct 11 20:52:14.112517 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-af1fa3a0-65e9-4fbb-8f88-e453cbb35359 req-097d5a4b-11e1-453c-a327-cff5d88fee0e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042433 Oct 11 20:52:14.114684 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3536/7021] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:52:14.320966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-7b162f5b-fcfb-411b-bbb2-643d62ac4879 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:14.330059 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-7b162f5b-fcfb-411b-bbb2-643d62ac4879 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1561 microversion: 2.1 time: 0.262582 Oct 11 20:52:14.330671 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3486/7022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:14 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1561 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:37.651494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=17 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:52:37.652652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=38 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:52:37.657153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2328dfbe-67fc-456d-9466-9d6409a53ae2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:52:37.659405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2328dfbe-67fc-456d-9466-9d6409a53ae2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:37.666216 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2328dfbe-67fc-456d-9466-9d6409a53ae2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:37.666731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2328dfbe-67fc-456d-9466-9d6409a53ae2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:37.667158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2328dfbe-67fc-456d-9466-9d6409a53ae2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:37.668352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2328dfbe-67fc-456d-9466-9d6409a53ae2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:37.668804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2328dfbe-67fc-456d-9466-9d6409a53ae2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:37.669221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2328dfbe-67fc-456d-9466-9d6409a53ae2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:37.728995 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2328dfbe-67fc-456d-9466-9d6409a53ae2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333/action" status: 200 len: 24569 microversion: 2.1 time: 0.079501 Oct 11 20:52:37.729649 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3537/7023] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:52:37 2022] POST /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333/action => generated 24569 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:52:48.760255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2cb99191-3f8a-472e-8271-3125e91b6e69 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:52:48.760816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2cb99191-3f8a-472e-8271-3125e91b6e69 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:48.763377 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:52:48.764115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=30 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:52:48.770487 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cb99191-3f8a-472e-8271-3125e91b6e69 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:48.771014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cb99191-3f8a-472e-8271-3125e91b6e69 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:48.771472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cb99191-3f8a-472e-8271-3125e91b6e69 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:48.772185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cb99191-3f8a-472e-8271-3125e91b6e69 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:48.772664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cb99191-3f8a-472e-8271-3125e91b6e69 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:48.773109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cb99191-3f8a-472e-8271-3125e91b6e69 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:48.842283 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2cb99191-3f8a-472e-8271-3125e91b6e69 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333/action" status: 202 len: 0 microversion: 2.1 time: 0.086231 Oct 11 20:52:48.845982 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3487/7024] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:52:48 2022] POST /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:52:48.854255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e2f72b11-be88-4b9b-999a-6ace609e372c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:48.855037 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e2f72b11-be88-4b9b-999a-6ace609e372c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:48.857897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:52:48.858703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:52:48.865657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f72b11-be88-4b9b-999a-6ace609e372c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:48.866142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f72b11-be88-4b9b-999a-6ace609e372c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:48.866633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f72b11-be88-4b9b-999a-6ace609e372c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:48.867848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f72b11-be88-4b9b-999a-6ace609e372c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:48.868467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f72b11-be88-4b9b-999a-6ace609e372c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:48.868898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e2f72b11-be88-4b9b-999a-6ace609e372c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:49.008334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e2f72b11-be88-4b9b-999a-6ace609e372c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:49.017468 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e2f72b11-be88-4b9b-999a-6ace609e372c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1684 microversion: 2.1 time: 0.167635 Oct 11 20:52:49.017984 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3538/7025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:48 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:50.044045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-27912969-febf-4a99-88fd-9e5e30fa080f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:50.044783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-27912969-febf-4a99-88fd-9e5e30fa080f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:50.051036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27912969-febf-4a99-88fd-9e5e30fa080f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:50.051539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27912969-febf-4a99-88fd-9e5e30fa080f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:50.051993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27912969-febf-4a99-88fd-9e5e30fa080f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:50.052707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27912969-febf-4a99-88fd-9e5e30fa080f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:50.053187 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27912969-febf-4a99-88fd-9e5e30fa080f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:50.053631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-27912969-febf-4a99-88fd-9e5e30fa080f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:50.183168 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-27912969-febf-4a99-88fd-9e5e30fa080f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:50.190967 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-27912969-febf-4a99-88fd-9e5e30fa080f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1664 microversion: 2.1 time: 0.152917 Oct 11 20:52:50.191545 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3488/7026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:50 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:51.287434 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3fef142-d72b-4662-a613-87c8cad26f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:52:51.289610 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3fef142-d72b-4662-a613-87c8cad26f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:51.297255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3fef142-d72b-4662-a613-87c8cad26f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:51.297738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3fef142-d72b-4662-a613-87c8cad26f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:51.298174 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3fef142-d72b-4662-a613-87c8cad26f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:51.298897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3fef142-d72b-4662-a613-87c8cad26f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:51.299354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3fef142-d72b-4662-a613-87c8cad26f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:51.299779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3fef142-d72b-4662-a613-87c8cad26f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:51.355067 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3fef142-d72b-4662-a613-87c8cad26f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333/action" status: 200 len: 32639 microversion: 2.1 time: 0.071190 Oct 11 20:52:51.355653 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3539/7027] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:52:51 2022] POST /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333/action => generated 32639 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:52:51.367239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-51bd3f2f-bbc7-4130-951f-08a201e0bcaf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:52:51.367805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-51bd3f2f-bbc7-4130-951f-08a201e0bcaf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:51.375316 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bd3f2f-bbc7-4130-951f-08a201e0bcaf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:51.375827 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bd3f2f-bbc7-4130-951f-08a201e0bcaf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:51.376287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bd3f2f-bbc7-4130-951f-08a201e0bcaf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:51.377002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bd3f2f-bbc7-4130-951f-08a201e0bcaf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:51.377477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bd3f2f-bbc7-4130-951f-08a201e0bcaf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:51.377958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-51bd3f2f-bbc7-4130-951f-08a201e0bcaf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:51.441948 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-51bd3f2f-bbc7-4130-951f-08a201e0bcaf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333/action" status: 202 len: 0 microversion: 2.1 time: 0.078485 Oct 11 20:52:51.442617 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3489/7028] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:52:51 2022] POST /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:52:51.452087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-56879574-d7a6-4fad-9550-9f6b5afdaa0a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:51.452780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-56879574-d7a6-4fad-9550-9f6b5afdaa0a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:51.460072 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56879574-d7a6-4fad-9550-9f6b5afdaa0a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:51.460557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56879574-d7a6-4fad-9550-9f6b5afdaa0a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:51.461100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56879574-d7a6-4fad-9550-9f6b5afdaa0a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:51.461843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56879574-d7a6-4fad-9550-9f6b5afdaa0a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:51.462299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56879574-d7a6-4fad-9550-9f6b5afdaa0a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:51.462839 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-56879574-d7a6-4fad-9550-9f6b5afdaa0a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:51.929299 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-56879574-d7a6-4fad-9550-9f6b5afdaa0a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:51.937246 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-56879574-d7a6-4fad-9550-9f6b5afdaa0a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1671 microversion: 2.1 time: 0.490204 Oct 11 20:52:51.937817 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3540/7029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:51 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1671 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:52.965332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f19a8a41-e5f0-4d7e-b8d9-768a4540e5b5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:52.966048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f19a8a41-e5f0-4d7e-b8d9-768a4540e5b5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:52.972404 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f19a8a41-e5f0-4d7e-b8d9-768a4540e5b5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:52.972914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f19a8a41-e5f0-4d7e-b8d9-768a4540e5b5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:52.973371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f19a8a41-e5f0-4d7e-b8d9-768a4540e5b5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:52.974090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f19a8a41-e5f0-4d7e-b8d9-768a4540e5b5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:52.974585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f19a8a41-e5f0-4d7e-b8d9-768a4540e5b5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:52.975034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f19a8a41-e5f0-4d7e-b8d9-768a4540e5b5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:53.106469 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f19a8a41-e5f0-4d7e-b8d9-768a4540e5b5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:53.114425 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f19a8a41-e5f0-4d7e-b8d9-768a4540e5b5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1679 microversion: 2.1 time: 0.156188 Oct 11 20:52:53.115021 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3490/7030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:52 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:53.210003 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e98151ef-3890-434f-ba82-82909eda17a7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:52:53.212217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e98151ef-3890-434f-ba82-82909eda17a7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:53.220026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e98151ef-3890-434f-ba82-82909eda17a7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:53.220449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e98151ef-3890-434f-ba82-82909eda17a7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:53.220884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e98151ef-3890-434f-ba82-82909eda17a7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:53.221570 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e98151ef-3890-434f-ba82-82909eda17a7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:53.222025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e98151ef-3890-434f-ba82-82909eda17a7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:53.222447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e98151ef-3890-434f-ba82-82909eda17a7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:53.274326 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e98151ef-3890-434f-ba82-82909eda17a7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333/action" status: 200 len: 38478 microversion: 2.1 time: 0.068089 Oct 11 20:52:53.275246 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3541/7031] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:52:53 2022] POST /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333/action => generated 38478 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:52:54.256888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-734d8fa2-c245-44ec-92dc-c96f8e9aa39a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:54.257399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-734d8fa2-c245-44ec-92dc-c96f8e9aa39a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:54.259673 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f48b179f-20f9-406d-8a52-155579a561c4 req-0d840617-777a-4b83-933f-426052fdc1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455bf99e-5147-42a3-bc99-faa94ee51333", "tag": "2db851d3-559d-400b-b098-297856a43bb1"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:52:54.264763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-734d8fa2-c245-44ec-92dc-c96f8e9aa39a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:54.265273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-734d8fa2-c245-44ec-92dc-c96f8e9aa39a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:54.265726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-734d8fa2-c245-44ec-92dc-c96f8e9aa39a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:54.266444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-734d8fa2-c245-44ec-92dc-c96f8e9aa39a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:54.267146 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-734d8fa2-c245-44ec-92dc-c96f8e9aa39a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:54.267785 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-734d8fa2-c245-44ec-92dc-c96f8e9aa39a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:54.271283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f48b179f-20f9-406d-8a52-155579a561c4 req-0d840617-777a-4b83-933f-426052fdc1b6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:54.272028 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f48b179f-20f9-406d-8a52-155579a561c4 req-0d840617-777a-4b83-933f-426052fdc1b6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:54.272271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f48b179f-20f9-406d-8a52-155579a561c4 req-0d840617-777a-4b83-933f-426052fdc1b6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:54.284753 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f48b179f-20f9-406d-8a52-155579a561c4 req-0d840617-777a-4b83-933f-426052fdc1b6 service nova] Creating event network-changed:2db851d3-559d-400b-b098-297856a43bb1 for instance 455bf99e-5147-42a3-bc99-faa94ee51333 on n-h1-860864-3 Oct 11 20:52:54.289706 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f48b179f-20f9-406d-8a52-155579a561c4 req-0d840617-777a-4b83-933f-426052fdc1b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034185 Oct 11 20:52:54.290732 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3542/7032] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:52:54.295434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-734d8fa2-c245-44ec-92dc-c96f8e9aa39a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:52:54.379404 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-734d8fa2-c245-44ec-92dc-c96f8e9aa39a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "DELETE /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 204 len: 0 microversion: 2.1 time: 0.126415 Oct 11 20:52:54.383192 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3491/7033] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:52:54 2022] DELETE /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:52:54.389079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a775524a-1e6d-4080-a101-50c08ac3f750 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:54.389784 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a775524a-1e6d-4080-a101-50c08ac3f750 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:54.396345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a775524a-1e6d-4080-a101-50c08ac3f750 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:54.396941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a775524a-1e6d-4080-a101-50c08ac3f750 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:54.397647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a775524a-1e6d-4080-a101-50c08ac3f750 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:54.398446 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a775524a-1e6d-4080-a101-50c08ac3f750 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:54.399158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a775524a-1e6d-4080-a101-50c08ac3f750 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:54.399580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a775524a-1e6d-4080-a101-50c08ac3f750 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:54.560385 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a775524a-1e6d-4080-a101-50c08ac3f750 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:54.568488 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a775524a-1e6d-4080-a101-50c08ac3f750 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1685 microversion: 2.1 time: 0.183956 Oct 11 20:52:54.569066 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3543/7034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:54 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:52:55.594858 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a51d815b-fb12-4498-bb54-4c8cd83e519f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:55.595705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a51d815b-fb12-4498-bb54-4c8cd83e519f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:55.603366 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a51d815b-fb12-4498-bb54-4c8cd83e519f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:55.603970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a51d815b-fb12-4498-bb54-4c8cd83e519f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:55.604429 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a51d815b-fb12-4498-bb54-4c8cd83e519f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:55.605644 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a51d815b-fb12-4498-bb54-4c8cd83e519f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:55.606122 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a51d815b-fb12-4498-bb54-4c8cd83e519f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:55.606747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a51d815b-fb12-4498-bb54-4c8cd83e519f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:55.768269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a51d815b-fb12-4498-bb54-4c8cd83e519f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:55.776212 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a51d815b-fb12-4498-bb54-4c8cd83e519f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1685 microversion: 2.1 time: 0.186244 Oct 11 20:52:55.777558 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3492/7035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:55 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1685 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:56.365289 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-92a32292-b2c7-4c68-8920-e2ce3ea8dfc3 req-027c5218-858c-47fa-816d-8a9a24d03963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455bf99e-5147-42a3-bc99-faa94ee51333", "name": "network-vif-deleted", "tag": "2db851d3-559d-400b-b098-297856a43bb1"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:52:56.378809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-92a32292-b2c7-4c68-8920-e2ce3ea8dfc3 req-027c5218-858c-47fa-816d-8a9a24d03963 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:56.379298 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-92a32292-b2c7-4c68-8920-e2ce3ea8dfc3 req-027c5218-858c-47fa-816d-8a9a24d03963 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:56.379735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-92a32292-b2c7-4c68-8920-e2ce3ea8dfc3 req-027c5218-858c-47fa-816d-8a9a24d03963 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:56.390852 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-92a32292-b2c7-4c68-8920-e2ce3ea8dfc3 req-027c5218-858c-47fa-816d-8a9a24d03963 service nova] Creating event network-vif-deleted:2db851d3-559d-400b-b098-297856a43bb1 for instance 455bf99e-5147-42a3-bc99-faa94ee51333 on n-h1-860864-3 Oct 11 20:52:56.395652 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-92a32292-b2c7-4c68-8920-e2ce3ea8dfc3 req-027c5218-858c-47fa-816d-8a9a24d03963 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034167 Oct 11 20:52:56.396256 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3544/7036] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:52:56.800777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:56.801502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:56.809329 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:56.810091 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:56.810683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:56.811649 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:56.812339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:56.812794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:56.853604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:56.854111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:56.854615 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:56.855150 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lazy-loading 'fault' on Instance uuid 455bf99e-5147-42a3-bc99-faa94ee51333 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:52:56.899193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:52:56.906917 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b87c95da-a65f-49be-ac44-cc802d0bb9bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 200 len: 1355 microversion: 2.1 time: 0.110064 Oct 11 20:52:56.907494 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3493/7037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:56 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 1355 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:52:57.932664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:52:57.933427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 455bf99e-5147-42a3-bc99-faa94ee51333] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:52:57.940555 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:57.941044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:57.941483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:57.942172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:52:57.942655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:52:57.943083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:52:57.957000 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] HTTP exception thrown: Instance 455bf99e-5147-42a3-bc99-faa94ee51333 could not be found. Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Request method failure captured: Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 HTTP/1.1 Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRddoIKtCVfSl774yn2xn7Qwnt599GHfMXalig3PUzq5omWaNff4YHi7MbpPV_fIPfUzLi7i1jjXXhgstitRfWU8K243zHcU7o-4P8OY-APzkTzDgxCpVfGU1KIczEjMXMUNg6ICKw71ZhYA7yZ8Jcfl4ZeENLZ5eO3t4F1eHqKBqftA Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 693353fd79c44f7096de98d129f5a4d5 Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/693353fd79c44f7096de98d129f5a4d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_693353fd79c44f7096de98d129f5a4d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/693353fd79c44f7096de98d129f5a4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/693353fd79c44f7096de98d129f5a4d5"}]}] Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 693353fd79c44f7096de98d129f5a4d5 Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestNetworkAdvancedServerOps-12473246-project Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 6bd83b65d6f74f318789f72489360ae0 Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestNetworkAdvancedServerOps-12473246-project Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 455bf99e-5147-42a3-bc99-faa94ee51333 could not be found. Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '455bf99e-5147-42a3-bc99-faa94ee51333'} Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455bf99e-5147-42a3-bc99-faa94ee51333 could not be found. Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455bf99e-5147-42a3-bc99-faa94ee51333 could not be found. Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:52:57.958689 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455bf99e-5147-42a3-bc99-faa94ee51333 could not be found. Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Returning 404 to user: Instance 455bf99e-5147-42a3-bc99-faa94ee51333 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b76bc04a-8990-4e4e-83d4-c1121ba5932c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333" status: 404 len: 111 microversion: 2.1 time: 0.032539 Oct 11 20:52:57.963751 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3545/7038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:52:57 2022] GET /compute/v2.1/servers/455bf99e-5147-42a3-bc99-faa94ee51333 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:53:01.268221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-231b4399-6d41-4306-b44b-4df6c2ea4b22 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '.version_select at 0x7f83c7370ca0>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:01.295659 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-231b4399-6d41-4306-b44b-4df6c2ea4b22 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-90863441" status: 202 len: 0 microversion: 2.1 time: 0.032242 Oct 11 20:53:01.296294 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3494/7039] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 11 20:53:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-90863441 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:53:01.327983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8b6253e6-90ed-4cd6-a937-e5df737ff98a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'create', calling method: .version_select at 0x7f83c70b4430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1584270116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBrC4nUWuN9xeHOK1N3GhC3n6/gpSjrE0o+jQh78M0qrutbzGquBNMLwxmhPhc8eOZT3qiu/0dht4Tx9ZX8je/IksnRCwv1JIHTcjmewS5OAodh7mMbZ73YoOe+bgKHqg=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:53:01.345462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8b6253e6-90ed-4cd6-a937-e5df737ff98a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for project 693353fd79c44f7096de98d129f5a4d5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:53:01.351675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8b6253e6-90ed-4cd6-a937-e5df737ff98a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for user 6bd83b65d6f74f318789f72489360ae0 and project 693353fd79c44f7096de98d129f5a4d5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:53:01.377147 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8b6253e6-90ed-4cd6-a937-e5df737ff98a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052901 Oct 11 20:53:01.377439 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3546/7040] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:53:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:53:06.970848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:06.975740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1310663493", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "9e64bad1-f7b6-4f6c-b3fa-8eb607aaaed8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1584270116", "security_groups": [{"name": "tempest-secgroup-smoke-2045692756"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:53:07.111071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] validate_networks() for [('9e64bad1-f7b6-4f6c-b3fa-8eb607aaaed8', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:53:07.530636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:53:07.531090 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:53:07.531617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:53:07.532067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:53:07.532499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:53:07.541559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:07.542065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:07.542537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:07.543814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:07.544323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:07.544885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:07.562920 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for project 693353fd79c44f7096de98d129f5a4d5. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:53:07.568181 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for user 6bd83b65d6f74f318789f72489360ae0 and project 693353fd79c44f7096de98d129f5a4d5. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:53:07.582174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:53:07.584580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:53:07.635376 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9624e024-04ce-4235-81ab-fcc653fce727 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.666345 Oct 11 20:53:07.642331 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3495/7041] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:53:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:53:07.648689 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-75eb5fde-eea0-42fe-aaa3-ed0ece5c0bdf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:07.649300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-75eb5fde-eea0-42fe-aaa3-ed0ece5c0bdf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:07.732172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-75eb5fde-eea0-42fe-aaa3-ed0ece5c0bdf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:07.739877 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-75eb5fde-eea0-42fe-aaa3-ed0ece5c0bdf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1267 microversion: 2.1 time: 0.096083 Oct 11 20:53:07.740628 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3547/7042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:07 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:08.765793 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4089d792-8b78-4f83-acc1-3771367602e9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:08.767251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4089d792-8b78-4f83-acc1-3771367602e9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:08.775170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4089d792-8b78-4f83-acc1-3771367602e9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:08.776085 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4089d792-8b78-4f83-acc1-3771367602e9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:08.777385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4089d792-8b78-4f83-acc1-3771367602e9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:08.779741 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4089d792-8b78-4f83-acc1-3771367602e9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:08.780491 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4089d792-8b78-4f83-acc1-3771367602e9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:08.781161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4089d792-8b78-4f83-acc1-3771367602e9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:08.852523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4089d792-8b78-4f83-acc1-3771367602e9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:08.861699 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4089d792-8b78-4f83-acc1-3771367602e9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1337 microversion: 2.1 time: 0.101530 Oct 11 20:53:08.862297 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3496/7043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:08 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:09.885481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e541fb97-c660-4c34-b329-ed92ceeb18b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:09.886012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e541fb97-c660-4c34-b329-ed92ceeb18b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:09.888594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=32 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:09.896254 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e541fb97-c660-4c34-b329-ed92ceeb18b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:09.896751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e541fb97-c660-4c34-b329-ed92ceeb18b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:09.897191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e541fb97-c660-4c34-b329-ed92ceeb18b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:09.897901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e541fb97-c660-4c34-b329-ed92ceeb18b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:09.898363 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e541fb97-c660-4c34-b329-ed92ceeb18b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:09.898815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e541fb97-c660-4c34-b329-ed92ceeb18b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:10.041409 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e541fb97-c660-4c34-b329-ed92ceeb18b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:10.050513 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e541fb97-c660-4c34-b329-ed92ceeb18b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1393 microversion: 2.1 time: 0.169024 Oct 11 20:53:10.051124 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3548/7044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:09 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:10.223599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-be08ce8f-c7a5-4ad4-ad05-ea8792696665 req-dd5ea940-f655-480e-9a55-6a7c5dee7c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbc1962-d1be-464c-a83b-b8cfc2c8de88", "tag": "a11f4aa1-d372-4a5b-a34b-a7d90c78b223"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:53:10.234549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-be08ce8f-c7a5-4ad4-ad05-ea8792696665 req-dd5ea940-f655-480e-9a55-6a7c5dee7c6c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:10.235056 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-be08ce8f-c7a5-4ad4-ad05-ea8792696665 req-dd5ea940-f655-480e-9a55-6a7c5dee7c6c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:10.235514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-be08ce8f-c7a5-4ad4-ad05-ea8792696665 req-dd5ea940-f655-480e-9a55-6a7c5dee7c6c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:10.247679 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-be08ce8f-c7a5-4ad4-ad05-ea8792696665 req-dd5ea940-f655-480e-9a55-6a7c5dee7c6c service nova] Creating event network-changed:a11f4aa1-d372-4a5b-a34b-a7d90c78b223 for instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 on n-h1-860864-3 Oct 11 20:53:10.256007 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-be08ce8f-c7a5-4ad4-ad05-ea8792696665 req-dd5ea940-f655-480e-9a55-6a7c5dee7c6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036314 Oct 11 20:53:10.257231 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3497/7045] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:53:11.073386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4c27b8ec-ab81-48e1-90fa-3016c7ab63ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:11.074005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4c27b8ec-ab81-48e1-90fa-3016c7ab63ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:11.082741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c27b8ec-ab81-48e1-90fa-3016c7ab63ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:11.083237 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c27b8ec-ab81-48e1-90fa-3016c7ab63ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:11.083682 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c27b8ec-ab81-48e1-90fa-3016c7ab63ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:11.084386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c27b8ec-ab81-48e1-90fa-3016c7ab63ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:11.084842 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c27b8ec-ab81-48e1-90fa-3016c7ab63ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:11.085265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4c27b8ec-ab81-48e1-90fa-3016c7ab63ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:11.220332 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4c27b8ec-ab81-48e1-90fa-3016c7ab63ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:11.228033 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4c27b8ec-ab81-48e1-90fa-3016c7ab63ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1393 microversion: 2.1 time: 0.158694 Oct 11 20:53:11.228611 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3549/7046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:11 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:12.251513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-347b76c8-5e90-469e-916e-cb65cb4a9ac1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:12.252231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-347b76c8-5e90-469e-916e-cb65cb4a9ac1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:12.259379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-347b76c8-5e90-469e-916e-cb65cb4a9ac1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:12.259878 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-347b76c8-5e90-469e-916e-cb65cb4a9ac1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:12.260327 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-347b76c8-5e90-469e-916e-cb65cb4a9ac1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:12.261025 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-347b76c8-5e90-469e-916e-cb65cb4a9ac1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:12.261489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-347b76c8-5e90-469e-916e-cb65cb4a9ac1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:12.261924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-347b76c8-5e90-469e-916e-cb65cb4a9ac1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:12.393055 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-347b76c8-5e90-469e-916e-cb65cb4a9ac1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:12.400740 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-347b76c8-5e90-469e-916e-cb65cb4a9ac1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1393 microversion: 2.1 time: 0.153499 Oct 11 20:53:12.401310 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3498/7047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:12 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:13.425274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-568566d0-c71e-4e97-a1f0-34f70e9d8c17 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:13.425882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-568566d0-c71e-4e97-a1f0-34f70e9d8c17 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:13.432773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568566d0-c71e-4e97-a1f0-34f70e9d8c17 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:13.433509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568566d0-c71e-4e97-a1f0-34f70e9d8c17 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:13.434562 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568566d0-c71e-4e97-a1f0-34f70e9d8c17 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:13.435256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568566d0-c71e-4e97-a1f0-34f70e9d8c17 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:13.435709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568566d0-c71e-4e97-a1f0-34f70e9d8c17 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:13.436130 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-568566d0-c71e-4e97-a1f0-34f70e9d8c17 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:13.566321 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-568566d0-c71e-4e97-a1f0-34f70e9d8c17 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:13.574022 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-568566d0-c71e-4e97-a1f0-34f70e9d8c17 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1393 microversion: 2.1 time: 0.152713 Oct 11 20:53:13.574607 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3550/7048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:13 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:14.597189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-11a2f287-9410-40cf-96b6-d70939a690b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:14.597849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-11a2f287-9410-40cf-96b6-d70939a690b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:14.604747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a2f287-9410-40cf-96b6-d70939a690b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:14.605252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a2f287-9410-40cf-96b6-d70939a690b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:14.606391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a2f287-9410-40cf-96b6-d70939a690b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:14.607281 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a2f287-9410-40cf-96b6-d70939a690b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:14.607759 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a2f287-9410-40cf-96b6-d70939a690b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:14.608199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-11a2f287-9410-40cf-96b6-d70939a690b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:14.745250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-2bf0c035-c04c-4a52-8949-72ad7f04ed74 req-cf5a1ddb-bc06-4990-89c1-8ce6200fb904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbc1962-d1be-464c-a83b-b8cfc2c8de88", "name": "network-vif-plugged", "status": "completed", "tag": "a11f4aa1-d372-4a5b-a34b-a7d90c78b223"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:53:14.749734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-11a2f287-9410-40cf-96b6-d70939a690b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:14.753724 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 20:53:14.754116 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 20:53:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 11 20:53:14.763537 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-11a2f287-9410-40cf-96b6-d70939a690b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1393 microversion: 2.1 time: 0.169150 Oct 11 20:53:14.764392 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3499/7049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:14 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:14.764541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2bf0c035-c04c-4a52-8949-72ad7f04ed74 req-cf5a1ddb-bc06-4990-89c1-8ce6200fb904 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:14.764913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2bf0c035-c04c-4a52-8949-72ad7f04ed74 req-cf5a1ddb-bc06-4990-89c1-8ce6200fb904 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:14.765523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-2bf0c035-c04c-4a52-8949-72ad7f04ed74 req-cf5a1ddb-bc06-4990-89c1-8ce6200fb904 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:14.777257 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-2bf0c035-c04c-4a52-8949-72ad7f04ed74 req-cf5a1ddb-bc06-4990-89c1-8ce6200fb904 service nova] Creating event network-vif-plugged:a11f4aa1-d372-4a5b-a34b-a7d90c78b223 for instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 on n-h1-860864-3 Oct 11 20:53:14.782926 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-2bf0c035-c04c-4a52-8949-72ad7f04ed74 req-cf5a1ddb-bc06-4990-89c1-8ce6200fb904 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042005 Oct 11 20:53:14.783455 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3551/7050] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:53:15.786352 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5a5201d6-1989-4162-ac9d-e78f9c01d1b4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:15.787026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5a5201d6-1989-4162-ac9d-e78f9c01d1b4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:15.794446 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a5201d6-1989-4162-ac9d-e78f9c01d1b4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:15.795193 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a5201d6-1989-4162-ac9d-e78f9c01d1b4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:15.796073 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a5201d6-1989-4162-ac9d-e78f9c01d1b4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:15.796864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a5201d6-1989-4162-ac9d-e78f9c01d1b4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:15.797346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a5201d6-1989-4162-ac9d-e78f9c01d1b4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:15.797796 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a5201d6-1989-4162-ac9d-e78f9c01d1b4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:15.932401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5a5201d6-1989-4162-ac9d-e78f9c01d1b4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:15.940449 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5a5201d6-1989-4162-ac9d-e78f9c01d1b4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1393 microversion: 2.1 time: 0.158036 Oct 11 20:53:15.941038 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3500/7051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:15 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:16.966045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e4bb58e5-0760-4ff5-b1ed-ba878fac0340 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:16.967482 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e4bb58e5-0760-4ff5-b1ed-ba878fac0340 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:16.973662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4bb58e5-0760-4ff5-b1ed-ba878fac0340 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:16.974150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4bb58e5-0760-4ff5-b1ed-ba878fac0340 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:16.974649 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4bb58e5-0760-4ff5-b1ed-ba878fac0340 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:16.975345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4bb58e5-0760-4ff5-b1ed-ba878fac0340 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:16.975808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4bb58e5-0760-4ff5-b1ed-ba878fac0340 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:16.976238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4bb58e5-0760-4ff5-b1ed-ba878fac0340 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:17.112861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e4bb58e5-0760-4ff5-b1ed-ba878fac0340 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:17.120676 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e4bb58e5-0760-4ff5-b1ed-ba878fac0340 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1565 microversion: 2.1 time: 0.159893 Oct 11 20:53:17.121258 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3552/7052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:16 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:53:17.143762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-58e0945f-d354-4ab9-9c90-6d3cea56e32e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:17.144399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-58e0945f-d354-4ab9-9c90-6d3cea56e32e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:17.151333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58e0945f-d354-4ab9-9c90-6d3cea56e32e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:17.152866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58e0945f-d354-4ab9-9c90-6d3cea56e32e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:17.153324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58e0945f-d354-4ab9-9c90-6d3cea56e32e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:17.154784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58e0945f-d354-4ab9-9c90-6d3cea56e32e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:17.155269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58e0945f-d354-4ab9-9c90-6d3cea56e32e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:17.155711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-58e0945f-d354-4ab9-9c90-6d3cea56e32e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:17.288983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-58e0945f-d354-4ab9-9c90-6d3cea56e32e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:17.298131 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-58e0945f-d354-4ab9-9c90-6d3cea56e32e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1565 microversion: 2.1 time: 0.157747 Oct 11 20:53:17.298746 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3501/7053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:17 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:19.189637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6fe8670f-5dc9-495b-8b68-6b65a5182181 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:19.190256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6fe8670f-5dc9-495b-8b68-6b65a5182181 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:19.192501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4778bbb5-660f-416f-93d0-af86aa9e1999 req-086fc715-df93-40e6-96f7-0f735881055b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbc1962-d1be-464c-a83b-b8cfc2c8de88", "tag": "a11f4aa1-d372-4a5b-a34b-a7d90c78b223"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:53:19.197142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:19.199342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:19.202972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe8670f-5dc9-495b-8b68-6b65a5182181 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:19.204205 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe8670f-5dc9-495b-8b68-6b65a5182181 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:19.205001 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe8670f-5dc9-495b-8b68-6b65a5182181 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:19.205375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:19.206142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe8670f-5dc9-495b-8b68-6b65a5182181 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:19.206994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:19.207292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe8670f-5dc9-495b-8b68-6b65a5182181 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:19.208186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6fe8670f-5dc9-495b-8b68-6b65a5182181 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:19.208902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:19.211440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4778bbb5-660f-416f-93d0-af86aa9e1999 req-086fc715-df93-40e6-96f7-0f735881055b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:19.212248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4778bbb5-660f-416f-93d0-af86aa9e1999 req-086fc715-df93-40e6-96f7-0f735881055b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:19.212965 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4778bbb5-660f-416f-93d0-af86aa9e1999 req-086fc715-df93-40e6-96f7-0f735881055b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:19.232204 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4778bbb5-660f-416f-93d0-af86aa9e1999 req-086fc715-df93-40e6-96f7-0f735881055b service nova] Creating event network-changed:a11f4aa1-d372-4a5b-a34b-a7d90c78b223 for instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 on n-h1-860864-3 Oct 11 20:53:19.240281 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4778bbb5-660f-416f-93d0-af86aa9e1999 req-086fc715-df93-40e6-96f7-0f735881055b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051931 Oct 11 20:53:19.241646 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3502/7054] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:53:19.398975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6fe8670f-5dc9-495b-8b68-6b65a5182181 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:19.407798 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6fe8670f-5dc9-495b-8b68-6b65a5182181 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1565 microversion: 2.1 time: 0.223470 Oct 11 20:53:19.422606 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3553/7055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:19 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:40.658071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=36 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:40.662341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1da30067-4478-46ac-a628-a1e6e0f61130 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:53:40.664654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1da30067-4478-46ac-a628-a1e6e0f61130 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:40.672761 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da30067-4478-46ac-a628-a1e6e0f61130 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:40.673262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da30067-4478-46ac-a628-a1e6e0f61130 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:40.673710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da30067-4478-46ac-a628-a1e6e0f61130 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:40.674409 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da30067-4478-46ac-a628-a1e6e0f61130 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:40.674911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da30067-4478-46ac-a628-a1e6e0f61130 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:40.675350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1da30067-4478-46ac-a628-a1e6e0f61130 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:40.725999 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1da30067-4478-46ac-a628-a1e6e0f61130 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88/action" status: 200 len: 24572 microversion: 2.1 time: 0.069709 Oct 11 20:53:40.726671 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3503/7056] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:53:40 2022] POST /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88/action => generated 24572 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:53:51.669581 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0e1e73ad-532a-4469-bcee-cbf1deb79011 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:53:51.671794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0e1e73ad-532a-4469-bcee-cbf1deb79011 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:51.674099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:51.674769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=32 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:51.680996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e1e73ad-532a-4469-bcee-cbf1deb79011 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:51.681488 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e1e73ad-532a-4469-bcee-cbf1deb79011 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:51.681927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e1e73ad-532a-4469-bcee-cbf1deb79011 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:51.682656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e1e73ad-532a-4469-bcee-cbf1deb79011 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:51.683120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e1e73ad-532a-4469-bcee-cbf1deb79011 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:51.683546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e1e73ad-532a-4469-bcee-cbf1deb79011 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:51.757057 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0e1e73ad-532a-4469-bcee-cbf1deb79011 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88/action" status: 202 len: 0 microversion: 2.1 time: 0.091873 Oct 11 20:53:51.757715 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3554/7057] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:53:51 2022] POST /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:53:51.767023 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0e8fb9bb-55fa-479a-8581-82d4d6fb251a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:51.767753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0e8fb9bb-55fa-479a-8581-82d4d6fb251a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:51.770738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:51.771533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:53:51.779945 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9bb-55fa-479a-8581-82d4d6fb251a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:51.780451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9bb-55fa-479a-8581-82d4d6fb251a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:51.780912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9bb-55fa-479a-8581-82d4d6fb251a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:51.781631 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9bb-55fa-479a-8581-82d4d6fb251a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:51.782101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9bb-55fa-479a-8581-82d4d6fb251a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:51.782563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9bb-55fa-479a-8581-82d4d6fb251a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:51.922179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0e8fb9bb-55fa-479a-8581-82d4d6fb251a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:51.929973 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0e8fb9bb-55fa-479a-8581-82d4d6fb251a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1675 microversion: 2.1 time: 0.167652 Oct 11 20:53:51.930893 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3504/7058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:51 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:52.957050 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-90b6cb3b-1d6c-4538-99c1-8d9ef9ac16c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:52.957750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-90b6cb3b-1d6c-4538-99c1-8d9ef9ac16c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:52.963993 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90b6cb3b-1d6c-4538-99c1-8d9ef9ac16c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:52.964481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90b6cb3b-1d6c-4538-99c1-8d9ef9ac16c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:52.964919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90b6cb3b-1d6c-4538-99c1-8d9ef9ac16c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:52.966150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90b6cb3b-1d6c-4538-99c1-8d9ef9ac16c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:52.966645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90b6cb3b-1d6c-4538-99c1-8d9ef9ac16c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:52.967086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-90b6cb3b-1d6c-4538-99c1-8d9ef9ac16c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:53.102700 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-90b6cb3b-1d6c-4538-99c1-8d9ef9ac16c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:53.110881 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-90b6cb3b-1d6c-4538-99c1-8d9ef9ac16c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.158882 Oct 11 20:53:53.111449 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3555/7059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:52 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:54.134630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4abd0914-372e-4109-a22d-ffea41366866 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:54.135254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4abd0914-372e-4109-a22d-ffea41366866 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:54.142445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4abd0914-372e-4109-a22d-ffea41366866 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:54.143005 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4abd0914-372e-4109-a22d-ffea41366866 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:54.143458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4abd0914-372e-4109-a22d-ffea41366866 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:54.144156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4abd0914-372e-4109-a22d-ffea41366866 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:54.144624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4abd0914-372e-4109-a22d-ffea41366866 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:54.145061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4abd0914-372e-4109-a22d-ffea41366866 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:54.280229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4abd0914-372e-4109-a22d-ffea41366866 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:54.288011 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4abd0914-372e-4109-a22d-ffea41366866 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.157355 Oct 11 20:53:54.288577 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3505/7060] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:54 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:55.312684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4603a64b-6f20-4499-91cb-d7e6f3a6f0c5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:55.313277 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4603a64b-6f20-4499-91cb-d7e6f3a6f0c5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:55.320265 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4603a64b-6f20-4499-91cb-d7e6f3a6f0c5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:55.320748 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4603a64b-6f20-4499-91cb-d7e6f3a6f0c5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:55.321190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4603a64b-6f20-4499-91cb-d7e6f3a6f0c5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:55.321875 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4603a64b-6f20-4499-91cb-d7e6f3a6f0c5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:55.322328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4603a64b-6f20-4499-91cb-d7e6f3a6f0c5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:55.322783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4603a64b-6f20-4499-91cb-d7e6f3a6f0c5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:55.453974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4603a64b-6f20-4499-91cb-d7e6f3a6f0c5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:55.461777 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4603a64b-6f20-4499-91cb-d7e6f3a6f0c5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.153313 Oct 11 20:53:55.462398 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3556/7061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:55 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:56.485954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-79163360-8f3b-4d5a-8844-262540421bd3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:56.486632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-79163360-8f3b-4d5a-8844-262540421bd3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:56.493474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79163360-8f3b-4d5a-8844-262540421bd3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:56.493973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79163360-8f3b-4d5a-8844-262540421bd3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:56.494425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79163360-8f3b-4d5a-8844-262540421bd3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:56.495159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79163360-8f3b-4d5a-8844-262540421bd3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:56.495629 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79163360-8f3b-4d5a-8844-262540421bd3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:56.496066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79163360-8f3b-4d5a-8844-262540421bd3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:56.633315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79163360-8f3b-4d5a-8844-262540421bd3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:56.641402 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-79163360-8f3b-4d5a-8844-262540421bd3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.160065 Oct 11 20:53:56.641974 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3506/7062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:56 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:57.665538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-321255eb-3e7e-4f6d-8611-b6897dd3cccd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:57.666142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-321255eb-3e7e-4f6d-8611-b6897dd3cccd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:57.673309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-321255eb-3e7e-4f6d-8611-b6897dd3cccd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:57.673789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-321255eb-3e7e-4f6d-8611-b6897dd3cccd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:57.674223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-321255eb-3e7e-4f6d-8611-b6897dd3cccd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:57.674931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-321255eb-3e7e-4f6d-8611-b6897dd3cccd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:57.675386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-321255eb-3e7e-4f6d-8611-b6897dd3cccd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:57.675806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-321255eb-3e7e-4f6d-8611-b6897dd3cccd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:57.805891 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-321255eb-3e7e-4f6d-8611-b6897dd3cccd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:57.814220 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-321255eb-3e7e-4f6d-8611-b6897dd3cccd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.152605 Oct 11 20:53:57.814830 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3557/7063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:57 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:53:58.838307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1780be26-7730-4cf2-8ea7-5bb3f06d892c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:53:58.838941 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1780be26-7730-4cf2-8ea7-5bb3f06d892c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:53:58.846048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1780be26-7730-4cf2-8ea7-5bb3f06d892c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:58.846567 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1780be26-7730-4cf2-8ea7-5bb3f06d892c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:58.847024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1780be26-7730-4cf2-8ea7-5bb3f06d892c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:58.847724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1780be26-7730-4cf2-8ea7-5bb3f06d892c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:53:58.848191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1780be26-7730-4cf2-8ea7-5bb3f06d892c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:53:58.848628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1780be26-7730-4cf2-8ea7-5bb3f06d892c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:53:58.978610 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1780be26-7730-4cf2-8ea7-5bb3f06d892c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:53:58.986550 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1780be26-7730-4cf2-8ea7-5bb3f06d892c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.152176 Oct 11 20:53:58.987130 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3507/7064] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:53:58 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:00.013181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9c167002-b6ae-49eb-9b4d-292b4243acf4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:00.013855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9c167002-b6ae-49eb-9b4d-292b4243acf4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:00.020712 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c167002-b6ae-49eb-9b4d-292b4243acf4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:00.021200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c167002-b6ae-49eb-9b4d-292b4243acf4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:00.021637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c167002-b6ae-49eb-9b4d-292b4243acf4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:00.022322 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c167002-b6ae-49eb-9b4d-292b4243acf4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:00.022810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c167002-b6ae-49eb-9b4d-292b4243acf4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:00.023235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9c167002-b6ae-49eb-9b4d-292b4243acf4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:00.157232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9c167002-b6ae-49eb-9b4d-292b4243acf4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:00.164988 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9c167002-b6ae-49eb-9b4d-292b4243acf4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.156395 Oct 11 20:54:00.165556 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3558/7065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:00 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:01.191210 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1d2c93c3-3691-4c94-8b63-74f3a8284f83 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:01.191834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1d2c93c3-3691-4c94-8b63-74f3a8284f83 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:01.198765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d2c93c3-3691-4c94-8b63-74f3a8284f83 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:01.199272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d2c93c3-3691-4c94-8b63-74f3a8284f83 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:01.200030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d2c93c3-3691-4c94-8b63-74f3a8284f83 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:01.200812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d2c93c3-3691-4c94-8b63-74f3a8284f83 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:01.201288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d2c93c3-3691-4c94-8b63-74f3a8284f83 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:01.201735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1d2c93c3-3691-4c94-8b63-74f3a8284f83 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:01.337783 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1d2c93c3-3691-4c94-8b63-74f3a8284f83 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:01.350563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1d2c93c3-3691-4c94-8b63-74f3a8284f83 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.162929 Oct 11 20:54:01.351636 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3508/7066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:01 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:02.375882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-aa9b4b7b-6ad4-43ac-a0a8-719082f287c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:02.376455 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-aa9b4b7b-6ad4-43ac-a0a8-719082f287c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:02.383428 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9b4b7b-6ad4-43ac-a0a8-719082f287c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:02.383916 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9b4b7b-6ad4-43ac-a0a8-719082f287c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:02.384349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9b4b7b-6ad4-43ac-a0a8-719082f287c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:02.385033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9b4b7b-6ad4-43ac-a0a8-719082f287c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:02.385486 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9b4b7b-6ad4-43ac-a0a8-719082f287c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:02.385903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-aa9b4b7b-6ad4-43ac-a0a8-719082f287c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:02.524510 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-aa9b4b7b-6ad4-43ac-a0a8-719082f287c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:02.533349 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-aa9b4b7b-6ad4-43ac-a0a8-719082f287c3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.162108 Oct 11 20:54:02.533952 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3559/7067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:02 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:03.557071 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1ebf806b-71b7-478e-beef-e3f972b817ab tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:03.557700 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1ebf806b-71b7-478e-beef-e3f972b817ab tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:03.565501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebf806b-71b7-478e-beef-e3f972b817ab tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:03.566006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebf806b-71b7-478e-beef-e3f972b817ab tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:03.566500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebf806b-71b7-478e-beef-e3f972b817ab tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:03.567233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebf806b-71b7-478e-beef-e3f972b817ab tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:03.567737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebf806b-71b7-478e-beef-e3f972b817ab tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:03.568184 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1ebf806b-71b7-478e-beef-e3f972b817ab tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:03.698617 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1ebf806b-71b7-478e-beef-e3f972b817ab tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:03.706927 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1ebf806b-71b7-478e-beef-e3f972b817ab tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.153871 Oct 11 20:54:03.707511 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3509/7068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:03 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:04.729651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-608e8905-6710-4084-b9bd-456d77d083af tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:04.730261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-608e8905-6710-4084-b9bd-456d77d083af tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:04.737094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-608e8905-6710-4084-b9bd-456d77d083af tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:04.737578 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-608e8905-6710-4084-b9bd-456d77d083af tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:04.738009 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-608e8905-6710-4084-b9bd-456d77d083af tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:04.738792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-608e8905-6710-4084-b9bd-456d77d083af tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:04.739245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-608e8905-6710-4084-b9bd-456d77d083af tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:04.739664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-608e8905-6710-4084-b9bd-456d77d083af tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:04.874345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-608e8905-6710-4084-b9bd-456d77d083af tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:04.882078 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-608e8905-6710-4084-b9bd-456d77d083af tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.156249 Oct 11 20:54:04.882680 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3560/7069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:04 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:54:05.907691 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ee9746cb-c417-4197-95c4-430769f97fc2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:05.908369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ee9746cb-c417-4197-95c4-430769f97fc2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:05.916576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9746cb-c417-4197-95c4-430769f97fc2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:05.917390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9746cb-c417-4197-95c4-430769f97fc2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:05.917926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9746cb-c417-4197-95c4-430769f97fc2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:05.918931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9746cb-c417-4197-95c4-430769f97fc2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:05.919416 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9746cb-c417-4197-95c4-430769f97fc2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:05.919857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ee9746cb-c417-4197-95c4-430769f97fc2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:06.067362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ee9746cb-c417-4197-95c4-430769f97fc2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:06.077809 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ee9746cb-c417-4197-95c4-430769f97fc2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.175073 Oct 11 20:54:06.078407 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3510/7070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:05 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:07.105882 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7fc96645-dfd4-4e66-afdd-1c01af7d2191 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:07.106519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7fc96645-dfd4-4e66-afdd-1c01af7d2191 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:07.113685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fc96645-dfd4-4e66-afdd-1c01af7d2191 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:07.114173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fc96645-dfd4-4e66-afdd-1c01af7d2191 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:07.114639 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fc96645-dfd4-4e66-afdd-1c01af7d2191 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:07.115324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fc96645-dfd4-4e66-afdd-1c01af7d2191 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:07.115805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fc96645-dfd4-4e66-afdd-1c01af7d2191 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:07.116245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7fc96645-dfd4-4e66-afdd-1c01af7d2191 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:07.246574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7fc96645-dfd4-4e66-afdd-1c01af7d2191 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:07.254922 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7fc96645-dfd4-4e66-afdd-1c01af7d2191 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1680 microversion: 2.1 time: 0.152939 Oct 11 20:54:07.255489 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3561/7071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:07 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:08.279142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8eaa9e65-1a08-4c09-bd11-8ad65d3bf4d0 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:08.280495 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8eaa9e65-1a08-4c09-bd11-8ad65d3bf4d0 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:08.287789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8eaa9e65-1a08-4c09-bd11-8ad65d3bf4d0 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:08.288294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8eaa9e65-1a08-4c09-bd11-8ad65d3bf4d0 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:08.288750 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8eaa9e65-1a08-4c09-bd11-8ad65d3bf4d0 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:08.289463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8eaa9e65-1a08-4c09-bd11-8ad65d3bf4d0 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:08.289938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8eaa9e65-1a08-4c09-bd11-8ad65d3bf4d0 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:08.290382 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8eaa9e65-1a08-4c09-bd11-8ad65d3bf4d0 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:08.424874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8eaa9e65-1a08-4c09-bd11-8ad65d3bf4d0 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:08.433006 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8eaa9e65-1a08-4c09-bd11-8ad65d3bf4d0 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1683 microversion: 2.1 time: 0.157831 Oct 11 20:54:08.433584 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3511/7072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:08 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:34.629685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-749bc627-1463-4e9a-971b-d2e0b7573cbf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:54:34.631918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-749bc627-1463-4e9a-971b-d2e0b7573cbf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:34.634377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=16 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:54:34.635057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:54:34.641376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-749bc627-1463-4e9a-971b-d2e0b7573cbf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:34.641863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-749bc627-1463-4e9a-971b-d2e0b7573cbf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:34.642326 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-749bc627-1463-4e9a-971b-d2e0b7573cbf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:34.643045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-749bc627-1463-4e9a-971b-d2e0b7573cbf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:34.643496 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-749bc627-1463-4e9a-971b-d2e0b7573cbf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:34.643942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-749bc627-1463-4e9a-971b-d2e0b7573cbf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:34.701660 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-749bc627-1463-4e9a-971b-d2e0b7573cbf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88/action" status: 200 len: 68940 microversion: 2.1 time: 0.075690 Oct 11 20:54:34.702330 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3562/7073] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:54:34 2022] POST /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88/action => generated 68940 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:54:42.023801 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-35cd0113-3e80-4066-8b87-254e4a8b5dcb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:42.024363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35cd0113-3e80-4066-8b87-254e4a8b5dcb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:42.026465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-53f7648c-b967-460b-97ac-c3eff3164041 req-5415b046-c901-4c48-ad0b-671d11887cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbc1962-d1be-464c-a83b-b8cfc2c8de88", "tag": "a11f4aa1-d372-4a5b-a34b-a7d90c78b223"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:54:42.026937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=16 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:54:42.027866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=48 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:54:42.035425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cd0113-3e80-4066-8b87-254e4a8b5dcb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:42.036189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cd0113-3e80-4066-8b87-254e4a8b5dcb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:42.036379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cd0113-3e80-4066-8b87-254e4a8b5dcb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:42.037101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cd0113-3e80-4066-8b87-254e4a8b5dcb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:42.037561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cd0113-3e80-4066-8b87-254e4a8b5dcb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:42.038198 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-35cd0113-3e80-4066-8b87-254e4a8b5dcb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:42.038541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-53f7648c-b967-460b-97ac-c3eff3164041 req-5415b046-c901-4c48-ad0b-671d11887cdc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:42.039029 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-53f7648c-b967-460b-97ac-c3eff3164041 req-5415b046-c901-4c48-ad0b-671d11887cdc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:42.039680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-53f7648c-b967-460b-97ac-c3eff3164041 req-5415b046-c901-4c48-ad0b-671d11887cdc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:42.051838 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-53f7648c-b967-460b-97ac-c3eff3164041 req-5415b046-c901-4c48-ad0b-671d11887cdc service nova] Creating event network-changed:a11f4aa1-d372-4a5b-a34b-a7d90c78b223 for instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 on n-h1-860864-3 Oct 11 20:54:42.062757 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-53f7648c-b967-460b-97ac-c3eff3164041 req-5415b046-c901-4c48-ad0b-671d11887cdc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040309 Oct 11 20:54:42.063694 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3563/7074] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:54:42.069317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-35cd0113-3e80-4066-8b87-254e4a8b5dcb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:54:42.158515 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-35cd0113-3e80-4066-8b87-254e4a8b5dcb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 204 len: 0 microversion: 2.1 time: 0.138431 Oct 11 20:54:42.159537 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3512/7075] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:54:42 2022] DELETE /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:54:42.169173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fb54132d-fe38-4494-9227-d27f25350d3c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:42.170040 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fb54132d-fe38-4494-9227-d27f25350d3c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:42.176429 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb54132d-fe38-4494-9227-d27f25350d3c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:42.176926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb54132d-fe38-4494-9227-d27f25350d3c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:42.177366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb54132d-fe38-4494-9227-d27f25350d3c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:42.178081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb54132d-fe38-4494-9227-d27f25350d3c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:42.178560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb54132d-fe38-4494-9227-d27f25350d3c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:42.179061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fb54132d-fe38-4494-9227-d27f25350d3c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:42.319723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fb54132d-fe38-4494-9227-d27f25350d3c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:42.328767 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fb54132d-fe38-4494-9227-d27f25350d3c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1689 microversion: 2.1 time: 0.164834 Oct 11 20:54:42.329346 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3564/7076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:42 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:43.353521 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0b4bea2c-c5cf-40f9-b6c4-566d5ec135b9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:43.354255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0b4bea2c-c5cf-40f9-b6c4-566d5ec135b9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:43.362555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b4bea2c-c5cf-40f9-b6c4-566d5ec135b9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:43.363078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b4bea2c-c5cf-40f9-b6c4-566d5ec135b9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:43.363540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b4bea2c-c5cf-40f9-b6c4-566d5ec135b9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:43.364255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b4bea2c-c5cf-40f9-b6c4-566d5ec135b9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:43.365007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b4bea2c-c5cf-40f9-b6c4-566d5ec135b9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:43.365197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0b4bea2c-c5cf-40f9-b6c4-566d5ec135b9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:43.505659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0b4bea2c-c5cf-40f9-b6c4-566d5ec135b9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:43.513877 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0b4bea2c-c5cf-40f9-b6c4-566d5ec135b9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 200 len: 1689 microversion: 2.1 time: 0.164724 Oct 11 20:54:43.514461 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3513/7077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:43 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:44.066092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-97645744-cbd0-4415-9b5d-5f8d9c828ab1 req-7eb365d4-abb4-44db-ac04-0f542598ce8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbc1962-d1be-464c-a83b-b8cfc2c8de88", "name": "network-vif-deleted", "tag": "a11f4aa1-d372-4a5b-a34b-a7d90c78b223"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:54:44.079800 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-97645744-cbd0-4415-9b5d-5f8d9c828ab1 req-7eb365d4-abb4-44db-ac04-0f542598ce8f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:44.080286 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-97645744-cbd0-4415-9b5d-5f8d9c828ab1 req-7eb365d4-abb4-44db-ac04-0f542598ce8f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:44.080717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-97645744-cbd0-4415-9b5d-5f8d9c828ab1 req-7eb365d4-abb4-44db-ac04-0f542598ce8f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:44.094753 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-97645744-cbd0-4415-9b5d-5f8d9c828ab1 req-7eb365d4-abb4-44db-ac04-0f542598ce8f service nova] Creating event network-vif-deleted:a11f4aa1-d372-4a5b-a34b-a7d90c78b223 for instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 on n-h1-860864-3 Oct 11 20:54:44.099761 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-97645744-cbd0-4415-9b5d-5f8d9c828ab1 req-7eb365d4-abb4-44db-ac04-0f542598ce8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037375 Oct 11 20:54:44.100355 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3565/7078] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:54:44.537514 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:44.538144 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: fbbc1962-d1be-464c-a83b-b8cfc2c8de88] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:44.545798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:44.546299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:44.546774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:44.548050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:44.548528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:44.548970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:44.568488 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] HTTP exception thrown: Instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 could not be found. Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Request method failure captured: Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 HTTP/1.1 Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRddoIKtCVfSl774yn2xn7Qwnt599GHfMXalig3PUzq5omWaNff4YHi7MbpPV_fIPfUzLi7i1jjXXhgstitRfWU8K243zHcU7o-4P8OY-APzkTzDgxCpVfGU1KIczEjMXMUNg6ICKw71ZhYA7yZ8Jcfl4ZeENLZ5eO3t4F1eHqKBqftA Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 693353fd79c44f7096de98d129f5a4d5 Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/693353fd79c44f7096de98d129f5a4d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_693353fd79c44f7096de98d129f5a4d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/693353fd79c44f7096de98d129f5a4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/693353fd79c44f7096de98d129f5a4d5"}]}] Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 693353fd79c44f7096de98d129f5a4d5 Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestNetworkAdvancedServerOps-12473246-project Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 6bd83b65d6f74f318789f72489360ae0 Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestNetworkAdvancedServerOps-12473246-project Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 could not be found. Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': 'fbbc1962-d1be-464c-a83b-b8cfc2c8de88'} Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 could not be found. Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 could not be found. Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:54:44.570834 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 could not be found. Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Returning 404 to user: Instance fbbc1962-d1be-464c-a83b-b8cfc2c8de88 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d6b897d2-f112-4b01-99cc-cdc2153c5150 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88" status: 404 len: 111 microversion: 2.1 time: 0.038854 Oct 11 20:54:44.575876 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3514/7079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:44 2022] GET /compute/v2.1/servers/fbbc1962-d1be-464c-a83b-b8cfc2c8de88 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:54:47.884590 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-195e92e2-e6a7-4a76-8608-5c8fad69e895 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '.version_select at 0x7f83c70e1e50>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:47.911118 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-195e92e2-e6a7-4a76-8608-5c8fad69e895 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1584270116" status: 202 len: 0 microversion: 2.1 time: 0.031048 Oct 11 20:54:47.911718 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3566/7080] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Oct 11 20:54:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1584270116 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:54:47.938828 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a9060a6f-a02f-4f41-9fe4-4757539f702a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'create', calling method: .version_select at 0x7f83cc1ff430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1854891432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP44BjvXKH41rTJKR2HUPR94sPTe9K2oW3YEzAqKbzZDVRq5k216HeOvNevkaC6AVBXzIWpFT/3vT/K8WcfifKPWPkdWo1Sjmpni78OZGac5gvNfRX4jeAM4fzKBKDWUHA=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:54:47.955967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a9060a6f-a02f-4f41-9fe4-4757539f702a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for project 693353fd79c44f7096de98d129f5a4d5. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:54:47.961940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-a9060a6f-a02f-4f41-9fe4-4757539f702a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for user 6bd83b65d6f74f318789f72489360ae0 and project 693353fd79c44f7096de98d129f5a4d5. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:54:47.989100 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a9060a6f-a02f-4f41-9fe4-4757539f702a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054116 Oct 11 20:54:47.989701 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3515/7081] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:54:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:54:53.413019 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1471177866", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "db64a121-33f2-4a9e-82d0-c936c4f828df"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1854891432", "security_groups": [{"name": "tempest-secgroup-smoke-1116911993"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:54:53.571369 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] validate_networks() for [('db64a121-33f2-4a9e-82d0-c936c4f828df', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:54:54.051084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:54:54.054193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:54:54.055004 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:54:54.055551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:54:54.057512 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:54:54.078931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:54.079632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:54.080531 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:54.082129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:54.082768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:54.083364 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:54.097196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=14 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:54:54.119824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for project 693353fd79c44f7096de98d129f5a4d5. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:54:54.128717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for user 6bd83b65d6f74f318789f72489360ae0 and project 693353fd79c44f7096de98d129f5a4d5. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:54:54.150605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:54:54.153981 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:54:54.220444 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-89f2130f-1978-4469-8258-faa1dd6cb7bc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811212 Oct 11 20:54:54.221484 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3567/7082] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:54:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:54:54.237532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dc7e0141-dbb7-4fde-b968-15e251edf7ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:54.238230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dc7e0141-dbb7-4fde-b968-15e251edf7ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:54.326330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dc7e0141-dbb7-4fde-b968-15e251edf7ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:54.341576 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dc7e0141-dbb7-4fde-b968-15e251edf7ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1267 microversion: 2.1 time: 0.112882 Oct 11 20:54:54.342565 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3516/7083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:54 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:55.366829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-49a9e941-2895-4878-8150-2f6a4ecaa352 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:55.369537 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-49a9e941-2895-4878-8150-2f6a4ecaa352 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:55.378427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49a9e941-2895-4878-8150-2f6a4ecaa352 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:55.380956 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49a9e941-2895-4878-8150-2f6a4ecaa352 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:55.381933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49a9e941-2895-4878-8150-2f6a4ecaa352 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:55.383083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49a9e941-2895-4878-8150-2f6a4ecaa352 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:55.383995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49a9e941-2895-4878-8150-2f6a4ecaa352 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:55.384767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-49a9e941-2895-4878-8150-2f6a4ecaa352 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:55.483178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-49a9e941-2895-4878-8150-2f6a4ecaa352 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:55.498672 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-49a9e941-2895-4878-8150-2f6a4ecaa352 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1337 microversion: 2.1 time: 0.137064 Oct 11 20:54:55.499546 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3568/7084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:55 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1337 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:56.523455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-12130b90-9513-4c21-bb83-9c8d39e7e84c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:56.524188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-12130b90-9513-4c21-bb83-9c8d39e7e84c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:56.530463 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:54:56.534266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12130b90-9513-4c21-bb83-9c8d39e7e84c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:56.534910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12130b90-9513-4c21-bb83-9c8d39e7e84c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:56.535619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12130b90-9513-4c21-bb83-9c8d39e7e84c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:56.536424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12130b90-9513-4c21-bb83-9c8d39e7e84c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:56.537108 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12130b90-9513-4c21-bb83-9c8d39e7e84c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:56.538021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-12130b90-9513-4c21-bb83-9c8d39e7e84c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:57.138874 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-12130b90-9513-4c21-bb83-9c8d39e7e84c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:57.146678 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-12130b90-9513-4c21-bb83-9c8d39e7e84c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1393 microversion: 2.1 time: 0.627122 Oct 11 20:54:57.147274 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3517/7085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:56 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1393 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:57.317175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a6f9730e-45ed-4d87-9383-4caca93d5168 req-e2764103-e790-46ee-b46c-e86fcd5a4bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281a2ea4-9751-4433-82f3-e41cabb186d5", "tag": "1e70afb5-bfc4-470b-a99a-9494fc375e1a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:54:57.336840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a6f9730e-45ed-4d87-9383-4caca93d5168 req-e2764103-e790-46ee-b46c-e86fcd5a4bbc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:57.337323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a6f9730e-45ed-4d87-9383-4caca93d5168 req-e2764103-e790-46ee-b46c-e86fcd5a4bbc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:57.337755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a6f9730e-45ed-4d87-9383-4caca93d5168 req-e2764103-e790-46ee-b46c-e86fcd5a4bbc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:57.351229 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a6f9730e-45ed-4d87-9383-4caca93d5168 req-e2764103-e790-46ee-b46c-e86fcd5a4bbc service nova] Creating event network-changed:1e70afb5-bfc4-470b-a99a-9494fc375e1a for instance 281a2ea4-9751-4433-82f3-e41cabb186d5 on n-h2-860864-3 Oct 11 20:54:57.357006 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a6f9730e-45ed-4d87-9383-4caca93d5168 req-e2764103-e790-46ee-b46c-e86fcd5a4bbc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043666 Oct 11 20:54:57.357608 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3569/7086] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:54:58.170807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-03f5d634-8e15-4801-b41a-2743f5d535b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:58.171434 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-03f5d634-8e15-4801-b41a-2743f5d535b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:58.178324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03f5d634-8e15-4801-b41a-2743f5d535b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:58.178867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03f5d634-8e15-4801-b41a-2743f5d535b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:58.179322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03f5d634-8e15-4801-b41a-2743f5d535b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:58.180019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03f5d634-8e15-4801-b41a-2743f5d535b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:58.180486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03f5d634-8e15-4801-b41a-2743f5d535b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:58.180922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-03f5d634-8e15-4801-b41a-2743f5d535b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:58.313397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-03f5d634-8e15-4801-b41a-2743f5d535b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:58.321072 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-03f5d634-8e15-4801-b41a-2743f5d535b6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1393 microversion: 2.1 time: 0.154272 Oct 11 20:54:58.321647 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3518/7087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:58 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:54:59.346068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b87665e6-2311-4233-bfc8-923f7ff08d32 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:54:59.346768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b87665e6-2311-4233-bfc8-923f7ff08d32 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:54:59.353100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b87665e6-2311-4233-bfc8-923f7ff08d32 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:59.353584 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b87665e6-2311-4233-bfc8-923f7ff08d32 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:59.354014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b87665e6-2311-4233-bfc8-923f7ff08d32 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:59.354735 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b87665e6-2311-4233-bfc8-923f7ff08d32 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:54:59.355727 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b87665e6-2311-4233-bfc8-923f7ff08d32 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:54:59.356395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b87665e6-2311-4233-bfc8-923f7ff08d32 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:54:59.498278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b87665e6-2311-4233-bfc8-923f7ff08d32 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:54:59.505937 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b87665e6-2311-4233-bfc8-923f7ff08d32 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1393 microversion: 2.1 time: 0.164960 Oct 11 20:54:59.506774 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3570/7088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:54:59 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:00.529053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8ece3bcf-1120-4e16-94ed-2b75845aafe8 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:00.529684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8ece3bcf-1120-4e16-94ed-2b75845aafe8 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:00.536577 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ece3bcf-1120-4e16-94ed-2b75845aafe8 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:00.537088 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ece3bcf-1120-4e16-94ed-2b75845aafe8 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:00.537546 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ece3bcf-1120-4e16-94ed-2b75845aafe8 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:00.538268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ece3bcf-1120-4e16-94ed-2b75845aafe8 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:00.538769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ece3bcf-1120-4e16-94ed-2b75845aafe8 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:00.539219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8ece3bcf-1120-4e16-94ed-2b75845aafe8 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:00.672917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8ece3bcf-1120-4e16-94ed-2b75845aafe8 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:00.681276 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8ece3bcf-1120-4e16-94ed-2b75845aafe8 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1393 microversion: 2.1 time: 0.156211 Oct 11 20:55:00.682042 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3519/7089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:00 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:01.705710 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5fbaf045-4542-469e-8080-0b2dfa9e4f7c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:01.706341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5fbaf045-4542-469e-8080-0b2dfa9e4f7c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:01.713163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fbaf045-4542-469e-8080-0b2dfa9e4f7c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:01.713646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fbaf045-4542-469e-8080-0b2dfa9e4f7c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:01.714073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fbaf045-4542-469e-8080-0b2dfa9e4f7c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:01.714854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fbaf045-4542-469e-8080-0b2dfa9e4f7c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:01.715297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fbaf045-4542-469e-8080-0b2dfa9e4f7c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:01.715716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5fbaf045-4542-469e-8080-0b2dfa9e4f7c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:01.851047 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5fbaf045-4542-469e-8080-0b2dfa9e4f7c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:01.859005 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5fbaf045-4542-469e-8080-0b2dfa9e4f7c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1393 microversion: 2.1 time: 0.157179 Oct 11 20:55:01.859571 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3571/7090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:01 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:02.816199 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-c3957a77-c493-4c5c-b2e1-2fa92dc685f8 req-87949cb2-b0c9-4efa-8de7-b643730874ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281a2ea4-9751-4433-82f3-e41cabb186d5", "name": "network-vif-plugged", "status": "completed", "tag": "1e70afb5-bfc4-470b-a99a-9494fc375e1a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:55:02.828058 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c3957a77-c493-4c5c-b2e1-2fa92dc685f8 req-87949cb2-b0c9-4efa-8de7-b643730874ff service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:02.828645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c3957a77-c493-4c5c-b2e1-2fa92dc685f8 req-87949cb2-b0c9-4efa-8de7-b643730874ff service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:02.829205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-c3957a77-c493-4c5c-b2e1-2fa92dc685f8 req-87949cb2-b0c9-4efa-8de7-b643730874ff service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:02.841810 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-c3957a77-c493-4c5c-b2e1-2fa92dc685f8 req-87949cb2-b0c9-4efa-8de7-b643730874ff service nova] Creating event network-vif-plugged:1e70afb5-bfc4-470b-a99a-9494fc375e1a for instance 281a2ea4-9751-4433-82f3-e41cabb186d5 on n-h2-860864-3 Oct 11 20:55:02.846897 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-c3957a77-c493-4c5c-b2e1-2fa92dc685f8 req-87949cb2-b0c9-4efa-8de7-b643730874ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034520 Oct 11 20:55:02.847688 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3520/7091] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:55:02.882687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c196738e-962a-46a2-a148-79bfaf01c5ae tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:02.883966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c196738e-962a-46a2-a148-79bfaf01c5ae tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:02.897974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c196738e-962a-46a2-a148-79bfaf01c5ae tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:02.898460 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c196738e-962a-46a2-a148-79bfaf01c5ae tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:02.898918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c196738e-962a-46a2-a148-79bfaf01c5ae tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:02.899643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c196738e-962a-46a2-a148-79bfaf01c5ae tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:02.900093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c196738e-962a-46a2-a148-79bfaf01c5ae tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:02.900513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c196738e-962a-46a2-a148-79bfaf01c5ae tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:03.093356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c196738e-962a-46a2-a148-79bfaf01c5ae tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:03.101367 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c196738e-962a-46a2-a148-79bfaf01c5ae tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1393 microversion: 2.1 time: 0.223668 Oct 11 20:55:03.101948 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3572/7092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:02 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1393 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:04.126455 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-23bce8b0-2cc7-457e-87e0-cf8211a72f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:04.127548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-23bce8b0-2cc7-457e-87e0-cf8211a72f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:04.138104 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23bce8b0-2cc7-457e-87e0-cf8211a72f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:04.138637 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23bce8b0-2cc7-457e-87e0-cf8211a72f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:04.139099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23bce8b0-2cc7-457e-87e0-cf8211a72f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:04.139816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23bce8b0-2cc7-457e-87e0-cf8211a72f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:04.140284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23bce8b0-2cc7-457e-87e0-cf8211a72f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:04.140722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-23bce8b0-2cc7-457e-87e0-cf8211a72f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:04.277069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-23bce8b0-2cc7-457e-87e0-cf8211a72f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:04.284787 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-23bce8b0-2cc7-457e-87e0-cf8211a72f43 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1564 microversion: 2.1 time: 0.164463 Oct 11 20:55:04.285361 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3521/7093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:04 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:04.307507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4759262c-a0b6-43cf-897b-3984ec23dfe4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:04.308657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4759262c-a0b6-43cf-897b-3984ec23dfe4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:04.311538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:55:04.312388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:55:04.317983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4759262c-a0b6-43cf-897b-3984ec23dfe4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:04.318463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4759262c-a0b6-43cf-897b-3984ec23dfe4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:04.318939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4759262c-a0b6-43cf-897b-3984ec23dfe4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:04.319604 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4759262c-a0b6-43cf-897b-3984ec23dfe4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:04.320079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4759262c-a0b6-43cf-897b-3984ec23dfe4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:04.320499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4759262c-a0b6-43cf-897b-3984ec23dfe4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:04.452519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4759262c-a0b6-43cf-897b-3984ec23dfe4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:04.460313 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4759262c-a0b6-43cf-897b-3984ec23dfe4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1564 microversion: 2.1 time: 0.156705 Oct 11 20:55:04.460882 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3573/7094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:04 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:06.025001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1e646495-6660-4147-9d9f-827cdecc0fd6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:06.031507 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ca50ffb9-7b71-4c13-8299-58642f3100f5 req-b2c1412a-e8e3-4e7f-acd0-dfc5aa3e2ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281a2ea4-9751-4433-82f3-e41cabb186d5", "tag": "1e70afb5-bfc4-470b-a99a-9494fc375e1a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:55:06.035178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1e646495-6660-4147-9d9f-827cdecc0fd6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:06.038374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:55:06.043991 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e646495-6660-4147-9d9f-827cdecc0fd6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:06.044506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e646495-6660-4147-9d9f-827cdecc0fd6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:06.044992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e646495-6660-4147-9d9f-827cdecc0fd6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:06.045722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e646495-6660-4147-9d9f-827cdecc0fd6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:06.046202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e646495-6660-4147-9d9f-827cdecc0fd6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:06.048489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:55:06.050121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1e646495-6660-4147-9d9f-827cdecc0fd6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:06.054115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ca50ffb9-7b71-4c13-8299-58642f3100f5 req-b2c1412a-e8e3-4e7f-acd0-dfc5aa3e2ce6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:06.054626 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ca50ffb9-7b71-4c13-8299-58642f3100f5 req-b2c1412a-e8e3-4e7f-acd0-dfc5aa3e2ce6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:06.055061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ca50ffb9-7b71-4c13-8299-58642f3100f5 req-b2c1412a-e8e3-4e7f-acd0-dfc5aa3e2ce6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:06.086091 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ca50ffb9-7b71-4c13-8299-58642f3100f5 req-b2c1412a-e8e3-4e7f-acd0-dfc5aa3e2ce6 service nova] Creating event network-changed:1e70afb5-bfc4-470b-a99a-9494fc375e1a for instance 281a2ea4-9751-4433-82f3-e41cabb186d5 on n-h2-860864-3 Oct 11 20:55:06.091863 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ca50ffb9-7b71-4c13-8299-58642f3100f5 req-b2c1412a-e8e3-4e7f-acd0-dfc5aa3e2ce6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065011 Oct 11 20:55:06.092484 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3574/7095] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:55:06.307012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e646495-6660-4147-9d9f-827cdecc0fd6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:06.315396 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1e646495-6660-4147-9d9f-827cdecc0fd6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1564 microversion: 2.1 time: 0.294271 Oct 11 20:55:06.316178 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3522/7096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:06 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1564 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:29.562751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=36 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:55:29.563490 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:55:29.567786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-29d395c2-e1e0-4838-95b9-effd11994dd9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:55:29.570092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-29d395c2-e1e0-4838-95b9-effd11994dd9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:29.577401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29d395c2-e1e0-4838-95b9-effd11994dd9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:29.577884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29d395c2-e1e0-4838-95b9-effd11994dd9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:29.578315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29d395c2-e1e0-4838-95b9-effd11994dd9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:29.579020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29d395c2-e1e0-4838-95b9-effd11994dd9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:29.579473 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29d395c2-e1e0-4838-95b9-effd11994dd9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:29.579894 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-29d395c2-e1e0-4838-95b9-effd11994dd9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:29.630062 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-29d395c2-e1e0-4838-95b9-effd11994dd9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5/action" status: 200 len: 24570 microversion: 2.1 time: 0.069141 Oct 11 20:55:29.630685 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3575/7097] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:55:29 2022] POST /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5/action => generated 24570 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 20:55:35.977095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:55:35.979609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:35.981606 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:55:35.982350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=32 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:55:35.988752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:35.989266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:35.989725 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:35.990438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:35.990939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:35.991385 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:36.032387 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:36.038420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Old instance type m1.heat2, new instance type m1.heat {{(pid=126955) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 20:55:36.045066 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:55:36.045497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:55:36.045979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:55:36.046399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:55:36.046851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:55:36.111559 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6ee467aa-6b24-4ad4-acb5-f0b354a533a6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5/action" status: 202 len: 0 microversion: 2.1 time: 0.138775 Oct 11 20:55:36.112212 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3523/7098] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:55:35 2022] POST /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:55:36.121098 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-37f77dd4-2ecf-4674-924c-b5db0774cd14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:36.121887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-37f77dd4-2ecf-4674-924c-b5db0774cd14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:36.129221 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37f77dd4-2ecf-4674-924c-b5db0774cd14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:36.129708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37f77dd4-2ecf-4674-924c-b5db0774cd14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:36.130152 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37f77dd4-2ecf-4674-924c-b5db0774cd14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:36.130883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37f77dd4-2ecf-4674-924c-b5db0774cd14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:36.131338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37f77dd4-2ecf-4674-924c-b5db0774cd14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:36.131763 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37f77dd4-2ecf-4674-924c-b5db0774cd14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:36.390166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-37f77dd4-2ecf-4674-924c-b5db0774cd14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:36.398374 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-37f77dd4-2ecf-4674-924c-b5db0774cd14 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1691 microversion: 2.1 time: 0.281777 Oct 11 20:55:36.399087 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3576/7099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:36 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1691 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:37.424911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-deca8be8-7035-49c3-b764-6fd5a8a17b86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:37.425540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-deca8be8-7035-49c3-b764-6fd5a8a17b86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:37.432650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-deca8be8-7035-49c3-b764-6fd5a8a17b86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:37.433154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-deca8be8-7035-49c3-b764-6fd5a8a17b86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:37.434219 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-deca8be8-7035-49c3-b764-6fd5a8a17b86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:37.435013 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-deca8be8-7035-49c3-b764-6fd5a8a17b86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:37.435486 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-deca8be8-7035-49c3-b764-6fd5a8a17b86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:37.435923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-deca8be8-7035-49c3-b764-6fd5a8a17b86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:37.614716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-deca8be8-7035-49c3-b764-6fd5a8a17b86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:37.623014 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-deca8be8-7035-49c3-b764-6fd5a8a17b86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1691 microversion: 2.1 time: 0.202843 Oct 11 20:55:37.623589 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3524/7100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:37 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1691 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:38.646306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b75d577f-a69b-4704-a2cf-57c8e57a50b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:38.646944 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b75d577f-a69b-4704-a2cf-57c8e57a50b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:38.654793 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75d577f-a69b-4704-a2cf-57c8e57a50b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:38.655284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75d577f-a69b-4704-a2cf-57c8e57a50b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:38.655728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75d577f-a69b-4704-a2cf-57c8e57a50b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:38.656415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75d577f-a69b-4704-a2cf-57c8e57a50b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:38.656871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75d577f-a69b-4704-a2cf-57c8e57a50b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:38.657296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b75d577f-a69b-4704-a2cf-57c8e57a50b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:38.784441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b75d577f-a69b-4704-a2cf-57c8e57a50b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:38.792082 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b75d577f-a69b-4704-a2cf-57c8e57a50b3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1691 microversion: 2.1 time: 0.149677 Oct 11 20:55:38.793272 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3577/7101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:38 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:39.816468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ec15c6ef-6dd3-4f96-a337-1a8ac506c869 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:39.817102 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ec15c6ef-6dd3-4f96-a337-1a8ac506c869 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:39.823351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec15c6ef-6dd3-4f96-a337-1a8ac506c869 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:39.825078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec15c6ef-6dd3-4f96-a337-1a8ac506c869 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:39.825544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec15c6ef-6dd3-4f96-a337-1a8ac506c869 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:39.826263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec15c6ef-6dd3-4f96-a337-1a8ac506c869 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:39.826776 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec15c6ef-6dd3-4f96-a337-1a8ac506c869 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:39.827225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ec15c6ef-6dd3-4f96-a337-1a8ac506c869 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:39.956464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ec15c6ef-6dd3-4f96-a337-1a8ac506c869 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:39.964254 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ec15c6ef-6dd3-4f96-a337-1a8ac506c869 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1691 microversion: 2.1 time: 0.151866 Oct 11 20:55:39.965077 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3525/7102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:39 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:40.987765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-165a8b7c-eee3-4c96-ad80-ad567432ae11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:40.988539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-165a8b7c-eee3-4c96-ad80-ad567432ae11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:40.995492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-165a8b7c-eee3-4c96-ad80-ad567432ae11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:40.995978 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-165a8b7c-eee3-4c96-ad80-ad567432ae11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:40.996421 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-165a8b7c-eee3-4c96-ad80-ad567432ae11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:40.997118 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-165a8b7c-eee3-4c96-ad80-ad567432ae11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:40.997577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-165a8b7c-eee3-4c96-ad80-ad567432ae11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:40.998006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-165a8b7c-eee3-4c96-ad80-ad567432ae11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:41.216127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-165a8b7c-eee3-4c96-ad80-ad567432ae11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:41.223808 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-165a8b7c-eee3-4c96-ad80-ad567432ae11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1691 microversion: 2.1 time: 0.239936 Oct 11 20:55:41.224886 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3578/7103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:40 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:42.247307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-64cb056c-6954-4273-872c-a425338eebb2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:42.247970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-64cb056c-6954-4273-872c-a425338eebb2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:42.254926 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64cb056c-6954-4273-872c-a425338eebb2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:42.255426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64cb056c-6954-4273-872c-a425338eebb2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:42.255875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64cb056c-6954-4273-872c-a425338eebb2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:42.256576 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64cb056c-6954-4273-872c-a425338eebb2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:42.257043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64cb056c-6954-4273-872c-a425338eebb2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:42.257482 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-64cb056c-6954-4273-872c-a425338eebb2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:42.391372 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-64cb056c-6954-4273-872c-a425338eebb2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:42.399247 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-64cb056c-6954-4273-872c-a425338eebb2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.155974 Oct 11 20:55:42.399824 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3526/7104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:42 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:43.424086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce20dd40-8e1f-4537-88d2-0a4a45372333 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:43.424706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ce20dd40-8e1f-4537-88d2-0a4a45372333 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:43.431608 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce20dd40-8e1f-4537-88d2-0a4a45372333 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:43.432099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce20dd40-8e1f-4537-88d2-0a4a45372333 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:43.432540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce20dd40-8e1f-4537-88d2-0a4a45372333 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:43.433231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce20dd40-8e1f-4537-88d2-0a4a45372333 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:43.434354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce20dd40-8e1f-4537-88d2-0a4a45372333 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:43.434855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce20dd40-8e1f-4537-88d2-0a4a45372333 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:43.569164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ce20dd40-8e1f-4537-88d2-0a4a45372333 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:43.577117 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ce20dd40-8e1f-4537-88d2-0a4a45372333 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.157060 Oct 11 20:55:43.577686 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3579/7105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:43 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:44.600867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-da7699b2-b6ce-4d73-bd23-54400bd0d577 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:44.601511 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-da7699b2-b6ce-4d73-bd23-54400bd0d577 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:44.609004 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da7699b2-b6ce-4d73-bd23-54400bd0d577 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:44.609513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da7699b2-b6ce-4d73-bd23-54400bd0d577 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:44.609972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da7699b2-b6ce-4d73-bd23-54400bd0d577 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:44.610721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da7699b2-b6ce-4d73-bd23-54400bd0d577 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:44.611213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da7699b2-b6ce-4d73-bd23-54400bd0d577 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:44.611664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da7699b2-b6ce-4d73-bd23-54400bd0d577 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:44.743805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-da7699b2-b6ce-4d73-bd23-54400bd0d577 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:44.752466 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-da7699b2-b6ce-4d73-bd23-54400bd0d577 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.155683 Oct 11 20:55:44.753042 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3527/7106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:44 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:45.775729 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cd73f4fb-d9d3-4300-91ec-564360f18730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:45.776353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cd73f4fb-d9d3-4300-91ec-564360f18730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:45.783546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cd73f4fb-d9d3-4300-91ec-564360f18730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:45.784030 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cd73f4fb-d9d3-4300-91ec-564360f18730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:45.784467 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cd73f4fb-d9d3-4300-91ec-564360f18730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:45.785149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cd73f4fb-d9d3-4300-91ec-564360f18730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:45.785601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cd73f4fb-d9d3-4300-91ec-564360f18730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:45.786020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cd73f4fb-d9d3-4300-91ec-564360f18730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:45.913099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cd73f4fb-d9d3-4300-91ec-564360f18730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:45.921181 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cd73f4fb-d9d3-4300-91ec-564360f18730 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.149376 Oct 11 20:55:45.921753 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3580/7107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:45 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:46.945734 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2cc133fd-5ece-4af9-931a-32a495d980d6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:46.946379 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2cc133fd-5ece-4af9-931a-32a495d980d6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:46.954330 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cc133fd-5ece-4af9-931a-32a495d980d6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:46.954880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cc133fd-5ece-4af9-931a-32a495d980d6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:46.955345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cc133fd-5ece-4af9-931a-32a495d980d6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:46.956057 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cc133fd-5ece-4af9-931a-32a495d980d6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:46.956543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cc133fd-5ece-4af9-931a-32a495d980d6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:46.956992 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2cc133fd-5ece-4af9-931a-32a495d980d6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:47.426443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2cc133fd-5ece-4af9-931a-32a495d980d6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:47.435108 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2cc133fd-5ece-4af9-931a-32a495d980d6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.493459 Oct 11 20:55:47.435692 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3528/7108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:46 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:55:48.459625 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b77e789d-2397-48ae-9e5d-fb35692737d2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:48.460274 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b77e789d-2397-48ae-9e5d-fb35692737d2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:48.468548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b77e789d-2397-48ae-9e5d-fb35692737d2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:48.469055 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b77e789d-2397-48ae-9e5d-fb35692737d2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:48.469499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b77e789d-2397-48ae-9e5d-fb35692737d2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:48.470263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b77e789d-2397-48ae-9e5d-fb35692737d2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:48.470820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b77e789d-2397-48ae-9e5d-fb35692737d2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:48.471302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b77e789d-2397-48ae-9e5d-fb35692737d2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:48.604774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b77e789d-2397-48ae-9e5d-fb35692737d2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:48.612724 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b77e789d-2397-48ae-9e5d-fb35692737d2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.157035 Oct 11 20:55:48.613306 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3581/7109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:48 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:49.636506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1bd4c29c-b5e9-4fd8-9065-c08d29ba5b18 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:49.637105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1bd4c29c-b5e9-4fd8-9065-c08d29ba5b18 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:49.643993 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bd4c29c-b5e9-4fd8-9065-c08d29ba5b18 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:49.644501 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bd4c29c-b5e9-4fd8-9065-c08d29ba5b18 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:49.644955 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bd4c29c-b5e9-4fd8-9065-c08d29ba5b18 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:49.645668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bd4c29c-b5e9-4fd8-9065-c08d29ba5b18 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:49.646142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bd4c29c-b5e9-4fd8-9065-c08d29ba5b18 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:49.646612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1bd4c29c-b5e9-4fd8-9065-c08d29ba5b18 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:49.782132 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1bd4c29c-b5e9-4fd8-9065-c08d29ba5b18 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:49.789934 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1bd4c29c-b5e9-4fd8-9065-c08d29ba5b18 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.157525 Oct 11 20:55:49.790513 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3529/7110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:49 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:50.814413 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e4d931e3-0c02-43c7-b24b-a6ec076e2905 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:50.815056 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e4d931e3-0c02-43c7-b24b-a6ec076e2905 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:50.821985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4d931e3-0c02-43c7-b24b-a6ec076e2905 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:50.822459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4d931e3-0c02-43c7-b24b-a6ec076e2905 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:50.822918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4d931e3-0c02-43c7-b24b-a6ec076e2905 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:50.823594 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4d931e3-0c02-43c7-b24b-a6ec076e2905 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:50.824403 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4d931e3-0c02-43c7-b24b-a6ec076e2905 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:50.824860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e4d931e3-0c02-43c7-b24b-a6ec076e2905 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:50.952987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e4d931e3-0c02-43c7-b24b-a6ec076e2905 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:50.960651 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e4d931e3-0c02-43c7-b24b-a6ec076e2905 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.150087 Oct 11 20:55:50.961213 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3582/7111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:50 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:51.984975 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ce62e7c4-6f04-4e20-bca4-11c0eea17c7d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:51.985612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ce62e7c4-6f04-4e20-bca4-11c0eea17c7d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:51.992697 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce62e7c4-6f04-4e20-bca4-11c0eea17c7d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:51.993208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce62e7c4-6f04-4e20-bca4-11c0eea17c7d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:51.993674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce62e7c4-6f04-4e20-bca4-11c0eea17c7d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:51.994388 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce62e7c4-6f04-4e20-bca4-11c0eea17c7d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:51.994899 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce62e7c4-6f04-4e20-bca4-11c0eea17c7d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:51.995348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ce62e7c4-6f04-4e20-bca4-11c0eea17c7d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:52.129561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ce62e7c4-6f04-4e20-bca4-11c0eea17c7d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:52.137999 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ce62e7c4-6f04-4e20-bca4-11c0eea17c7d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.157655 Oct 11 20:55:52.138598 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3530/7112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:51 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:53.161263 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1ef64111-6e61-4d0e-8f55-52d490573ab4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:53.161871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1ef64111-6e61-4d0e-8f55-52d490573ab4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:53.169306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ef64111-6e61-4d0e-8f55-52d490573ab4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:53.169817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ef64111-6e61-4d0e-8f55-52d490573ab4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:53.170250 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ef64111-6e61-4d0e-8f55-52d490573ab4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:53.170960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ef64111-6e61-4d0e-8f55-52d490573ab4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:53.171411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ef64111-6e61-4d0e-8f55-52d490573ab4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:53.171829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1ef64111-6e61-4d0e-8f55-52d490573ab4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:53.300167 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1ef64111-6e61-4d0e-8f55-52d490573ab4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:53.307882 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1ef64111-6e61-4d0e-8f55-52d490573ab4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.150497 Oct 11 20:55:53.309502 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3583/7113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:53 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:54.331805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-228c96bd-d142-4a29-9f49-88891fdf7fa4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:54.332345 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-228c96bd-d142-4a29-9f49-88891fdf7fa4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:54.339966 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-228c96bd-d142-4a29-9f49-88891fdf7fa4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:54.340526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-228c96bd-d142-4a29-9f49-88891fdf7fa4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:54.341006 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-228c96bd-d142-4a29-9f49-88891fdf7fa4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:54.341744 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-228c96bd-d142-4a29-9f49-88891fdf7fa4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:54.342207 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-228c96bd-d142-4a29-9f49-88891fdf7fa4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:54.342689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-228c96bd-d142-4a29-9f49-88891fdf7fa4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:54.477856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-228c96bd-d142-4a29-9f49-88891fdf7fa4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:54.486437 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-228c96bd-d142-4a29-9f49-88891fdf7fa4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.158721 Oct 11 20:55:54.487046 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3531/7114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:54 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:55.509885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d4724efc-a259-4b0e-8a12-d46017d14b4d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:55.510518 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d4724efc-a259-4b0e-8a12-d46017d14b4d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:55.517945 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4724efc-a259-4b0e-8a12-d46017d14b4d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:55.518435 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4724efc-a259-4b0e-8a12-d46017d14b4d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:55.518977 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4724efc-a259-4b0e-8a12-d46017d14b4d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:55.519663 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4724efc-a259-4b0e-8a12-d46017d14b4d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:55.520117 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4724efc-a259-4b0e-8a12-d46017d14b4d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:55.520541 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4724efc-a259-4b0e-8a12-d46017d14b4d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:55.658637 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d4724efc-a259-4b0e-8a12-d46017d14b4d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:55.666272 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d4724efc-a259-4b0e-8a12-d46017d14b4d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.160296 Oct 11 20:55:55.666880 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3584/7115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:55 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:56.690244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-20296fcd-4ab4-416f-b3d6-eea553facd3d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:56.690914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-20296fcd-4ab4-416f-b3d6-eea553facd3d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:56.697841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20296fcd-4ab4-416f-b3d6-eea553facd3d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:56.698365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20296fcd-4ab4-416f-b3d6-eea553facd3d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:56.699468 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20296fcd-4ab4-416f-b3d6-eea553facd3d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:56.700188 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20296fcd-4ab4-416f-b3d6-eea553facd3d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:56.700666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20296fcd-4ab4-416f-b3d6-eea553facd3d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:56.701117 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-20296fcd-4ab4-416f-b3d6-eea553facd3d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:56.835436 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-20296fcd-4ab4-416f-b3d6-eea553facd3d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:56.843577 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-20296fcd-4ab4-416f-b3d6-eea553facd3d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.157324 Oct 11 20:55:56.844162 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3532/7116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:56 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:57.867377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b500efe9-b13a-4eb4-9229-2e279e4727a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:57.868012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b500efe9-b13a-4eb4-9229-2e279e4727a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:57.875732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b500efe9-b13a-4eb4-9229-2e279e4727a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:57.876210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b500efe9-b13a-4eb4-9229-2e279e4727a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:57.876646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b500efe9-b13a-4eb4-9229-2e279e4727a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:57.877327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b500efe9-b13a-4eb4-9229-2e279e4727a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:57.877780 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b500efe9-b13a-4eb4-9229-2e279e4727a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:57.878200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b500efe9-b13a-4eb4-9229-2e279e4727a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:58.013709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b500efe9-b13a-4eb4-9229-2e279e4727a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:58.021330 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b500efe9-b13a-4eb4-9229-2e279e4727a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1696 microversion: 2.1 time: 0.157864 Oct 11 20:55:58.021905 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3585/7117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:57 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:55:58.618686 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-85888900-1991-45d1-8f47-154612bd801c req-74bc01f0-9587-4da0-a05d-74a72ce077fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281a2ea4-9751-4433-82f3-e41cabb186d5", "name": "network-vif-unplugged", "status": "completed", "tag": "1e70afb5-bfc4-470b-a99a-9494fc375e1a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:55:58.630343 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-85888900-1991-45d1-8f47-154612bd801c req-74bc01f0-9587-4da0-a05d-74a72ce077fa service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:58.630902 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-85888900-1991-45d1-8f47-154612bd801c req-74bc01f0-9587-4da0-a05d-74a72ce077fa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:58.631375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-85888900-1991-45d1-8f47-154612bd801c req-74bc01f0-9587-4da0-a05d-74a72ce077fa service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:58.644438 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-85888900-1991-45d1-8f47-154612bd801c req-74bc01f0-9587-4da0-a05d-74a72ce077fa service nova] Creating event network-vif-unplugged:1e70afb5-bfc4-470b-a99a-9494fc375e1a for instance 281a2ea4-9751-4433-82f3-e41cabb186d5 on n-h1-860864-3 Oct 11 20:55:58.649918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [req-85888900-1991-45d1-8f47-154612bd801c req-74bc01f0-9587-4da0-a05d-74a72ce077fa service nova] Instance 281a2ea4-9751-4433-82f3-e41cabb186d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126955) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:55:58.661137 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-85888900-1991-45d1-8f47-154612bd801c req-74bc01f0-9587-4da0-a05d-74a72ce077fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046180 Oct 11 20:55:58.661758 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3533/7118] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:55:59.045796 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-69bbb7a3-b126-4471-a0df-b2e83c61a654 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:55:59.046368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-69bbb7a3-b126-4471-a0df-b2e83c61a654 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:55:59.053511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69bbb7a3-b126-4471-a0df-b2e83c61a654 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:59.054005 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69bbb7a3-b126-4471-a0df-b2e83c61a654 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:59.054447 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69bbb7a3-b126-4471-a0df-b2e83c61a654 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:59.055355 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69bbb7a3-b126-4471-a0df-b2e83c61a654 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:55:59.055820 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69bbb7a3-b126-4471-a0df-b2e83c61a654 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:55:59.056248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-69bbb7a3-b126-4471-a0df-b2e83c61a654 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:55:59.302182 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-69bbb7a3-b126-4471-a0df-b2e83c61a654 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:55:59.310176 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-69bbb7a3-b126-4471-a0df-b2e83c61a654 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1695 microversion: 2.1 time: 0.269038 Oct 11 20:55:59.310832 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3586/7119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:55:59 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1695 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:00.337360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e8fbb144-0f78-4cb8-990a-731f37194f5d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:00.338011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e8fbb144-0f78-4cb8-990a-731f37194f5d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:00.344565 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8fbb144-0f78-4cb8-990a-731f37194f5d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:00.345069 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8fbb144-0f78-4cb8-990a-731f37194f5d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:00.345547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8fbb144-0f78-4cb8-990a-731f37194f5d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:00.346308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8fbb144-0f78-4cb8-990a-731f37194f5d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:00.346808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8fbb144-0f78-4cb8-990a-731f37194f5d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:00.347258 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e8fbb144-0f78-4cb8-990a-731f37194f5d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:00.479950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e8fbb144-0f78-4cb8-990a-731f37194f5d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:00.488457 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e8fbb144-0f78-4cb8-990a-731f37194f5d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1693 microversion: 2.1 time: 0.156428 Oct 11 20:56:00.489036 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3534/7120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:00 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:00.695008 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-6cf61b5f-94df-447e-84ab-99cc72a6860b req-e53b9e09-7f6d-4739-a833-3bacc3a257dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281a2ea4-9751-4433-82f3-e41cabb186d5", "tag": "1e70afb5-bfc4-470b-a99a-9494fc375e1a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:56:00.700870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=25 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:00.706628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6cf61b5f-94df-447e-84ab-99cc72a6860b req-e53b9e09-7f6d-4739-a833-3bacc3a257dd service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:00.707104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6cf61b5f-94df-447e-84ab-99cc72a6860b req-e53b9e09-7f6d-4739-a833-3bacc3a257dd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:00.707528 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-6cf61b5f-94df-447e-84ab-99cc72a6860b req-e53b9e09-7f6d-4739-a833-3bacc3a257dd service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:00.711198 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=71 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:00.721957 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-6cf61b5f-94df-447e-84ab-99cc72a6860b req-e53b9e09-7f6d-4739-a833-3bacc3a257dd service nova] Creating event network-changed:1e70afb5-bfc4-470b-a99a-9494fc375e1a for instance 281a2ea4-9751-4433-82f3-e41cabb186d5 on n-h1-860864-3 Oct 11 20:56:00.727126 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [req-6cf61b5f-94df-447e-84ab-99cc72a6860b req-e53b9e09-7f6d-4739-a833-3bacc3a257dd service nova] Instance 281a2ea4-9751-4433-82f3-e41cabb186d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-3', 'n-h2-860864-3'} {{(pid=126956) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 20:56:00.738746 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-6cf61b5f-94df-447e-84ab-99cc72a6860b req-e53b9e09-7f6d-4739-a833-3bacc3a257dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047354 Oct 11 20:56:00.739406 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3587/7121] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:56:01.513856 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-da26df04-3079-410e-ae87-cd8de91e1d8d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:01.514632 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-da26df04-3079-410e-ae87-cd8de91e1d8d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:01.521585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da26df04-3079-410e-ae87-cd8de91e1d8d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:01.522094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da26df04-3079-410e-ae87-cd8de91e1d8d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:01.522607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da26df04-3079-410e-ae87-cd8de91e1d8d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:01.523334 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da26df04-3079-410e-ae87-cd8de91e1d8d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:01.523807 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da26df04-3079-410e-ae87-cd8de91e1d8d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:01.524248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-da26df04-3079-410e-ae87-cd8de91e1d8d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:01.749260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-da26df04-3079-410e-ae87-cd8de91e1d8d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:01.757216 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-da26df04-3079-410e-ae87-cd8de91e1d8d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1690 microversion: 2.1 time: 0.247868 Oct 11 20:56:01.757837 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3535/7122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:01 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1690 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:01.782039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-921a52d5-3696-402d-928f-26f65b6718a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:56:01.782699 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-921a52d5-3696-402d-928f-26f65b6718a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:01.788804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-921a52d5-3696-402d-928f-26f65b6718a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:01.789293 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-921a52d5-3696-402d-928f-26f65b6718a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:01.789736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-921a52d5-3696-402d-928f-26f65b6718a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:01.790422 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-921a52d5-3696-402d-928f-26f65b6718a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:01.790914 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-921a52d5-3696-402d-928f-26f65b6718a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:01.791344 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-921a52d5-3696-402d-928f-26f65b6718a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:01.850289 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-921a52d5-3696-402d-928f-26f65b6718a1 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5/action" status: 204 len: 0 microversion: 2.1 time: 0.073496 Oct 11 20:56:01.850893 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3588/7123] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:56:01 2022] POST /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:56:01.859386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e1f3ab57-3d5a-4f7d-bb8d-a9b6845c5e86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:01.860024 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e1f3ab57-3d5a-4f7d-bb8d-a9b6845c5e86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:01.866014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f3ab57-3d5a-4f7d-bb8d-a9b6845c5e86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:01.866628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f3ab57-3d5a-4f7d-bb8d-a9b6845c5e86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:01.867094 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f3ab57-3d5a-4f7d-bb8d-a9b6845c5e86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:01.867818 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f3ab57-3d5a-4f7d-bb8d-a9b6845c5e86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:01.868295 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f3ab57-3d5a-4f7d-bb8d-a9b6845c5e86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:01.868738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e1f3ab57-3d5a-4f7d-bb8d-a9b6845c5e86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:02.084608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e1f3ab57-3d5a-4f7d-bb8d-a9b6845c5e86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:02.093371 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e1f3ab57-3d5a-4f7d-bb8d-a9b6845c5e86 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1690 microversion: 2.1 time: 0.238169 Oct 11 20:56:02.093964 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3536/7124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:01 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1690 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:02.117262 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7aa4a245-63c4-4250-a0b8-1215bc08c949 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:02.117919 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7aa4a245-63c4-4250-a0b8-1215bc08c949 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:02.125002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa4a245-63c4-4250-a0b8-1215bc08c949 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:02.125487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa4a245-63c4-4250-a0b8-1215bc08c949 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:02.125923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa4a245-63c4-4250-a0b8-1215bc08c949 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:02.126642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa4a245-63c4-4250-a0b8-1215bc08c949 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:02.127094 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa4a245-63c4-4250-a0b8-1215bc08c949 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:02.127513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7aa4a245-63c4-4250-a0b8-1215bc08c949 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:02.330874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7aa4a245-63c4-4250-a0b8-1215bc08c949 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:02.338515 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7aa4a245-63c4-4250-a0b8-1215bc08c949 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1690 microversion: 2.1 time: 0.225712 Oct 11 20:56:02.339107 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3589/7125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:02 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:03.362792 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ca1c9db3-70f7-4ca0-86a4-54942ecb9cfb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:03.363425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ca1c9db3-70f7-4ca0-86a4-54942ecb9cfb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:03.370054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca1c9db3-70f7-4ca0-86a4-54942ecb9cfb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:03.370609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca1c9db3-70f7-4ca0-86a4-54942ecb9cfb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:03.371087 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca1c9db3-70f7-4ca0-86a4-54942ecb9cfb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:03.371805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca1c9db3-70f7-4ca0-86a4-54942ecb9cfb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:03.372282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca1c9db3-70f7-4ca0-86a4-54942ecb9cfb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:03.372728 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ca1c9db3-70f7-4ca0-86a4-54942ecb9cfb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:03.510016 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ca1c9db3-70f7-4ca0-86a4-54942ecb9cfb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:03.518040 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ca1c9db3-70f7-4ca0-86a4-54942ecb9cfb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1682 microversion: 2.1 time: 0.159220 Oct 11 20:56:03.518651 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3537/7126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:03 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:05.435033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-e3d904ae-5810-4af0-9640-db5f7f31374f req-292c7661-fdf0-44d9-9d12-1cd58a128b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281a2ea4-9751-4433-82f3-e41cabb186d5", "name": "network-vif-plugged", "status": "completed", "tag": "1e70afb5-bfc4-470b-a99a-9494fc375e1a"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:56:05.445411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e3d904ae-5810-4af0-9640-db5f7f31374f req-292c7661-fdf0-44d9-9d12-1cd58a128b8a service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:05.445996 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e3d904ae-5810-4af0-9640-db5f7f31374f req-292c7661-fdf0-44d9-9d12-1cd58a128b8a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:05.446324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-e3d904ae-5810-4af0-9640-db5f7f31374f req-292c7661-fdf0-44d9-9d12-1cd58a128b8a service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:05.458104 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-e3d904ae-5810-4af0-9640-db5f7f31374f req-292c7661-fdf0-44d9-9d12-1cd58a128b8a service nova] Creating event network-vif-plugged:1e70afb5-bfc4-470b-a99a-9494fc375e1a for instance 281a2ea4-9751-4433-82f3-e41cabb186d5 on n-h1-860864-3 Oct 11 20:56:05.463096 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-e3d904ae-5810-4af0-9640-db5f7f31374f req-292c7661-fdf0-44d9-9d12-1cd58a128b8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086990 Oct 11 20:56:05.463710 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3590/7127] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:56:27.706937 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-263594fc-13e3-4dd7-8cce-912997803baa tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:56:27.709165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-263594fc-13e3-4dd7-8cce-912997803baa tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:27.712773 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=34 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:27.713447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:27.717788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-263594fc-13e3-4dd7-8cce-912997803baa tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:27.718293 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-263594fc-13e3-4dd7-8cce-912997803baa tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:27.718794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-263594fc-13e3-4dd7-8cce-912997803baa tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:27.719508 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-263594fc-13e3-4dd7-8cce-912997803baa tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:27.719983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-263594fc-13e3-4dd7-8cce-912997803baa tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:27.720426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-263594fc-13e3-4dd7-8cce-912997803baa tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:27.777070 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-263594fc-13e3-4dd7-8cce-912997803baa tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5/action" status: 200 len: 24577 microversion: 2.1 time: 0.074000 Oct 11 20:56:27.777984 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3538/7128] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:56:27 2022] POST /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5/action => generated 24577 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:56:35.215617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=7 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:35.216759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:35.222910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fd3fabfa-526e-4b74-ae73-908c3815dc98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:35.223511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fd3fabfa-526e-4b74-ae73-908c3815dc98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:35.232325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd3fabfa-526e-4b74-ae73-908c3815dc98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:35.233307 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd3fabfa-526e-4b74-ae73-908c3815dc98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:35.233925 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd3fabfa-526e-4b74-ae73-908c3815dc98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:35.234880 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd3fabfa-526e-4b74-ae73-908c3815dc98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:35.235492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd3fabfa-526e-4b74-ae73-908c3815dc98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:35.236150 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fd3fabfa-526e-4b74-ae73-908c3815dc98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:35.273361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fd3fabfa-526e-4b74-ae73-908c3815dc98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:56:35.286442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-4246727c-cfbf-460a-a899-8d70d880be78 req-e3403662-8091-46d4-abd2-ba18114ec2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281a2ea4-9751-4433-82f3-e41cabb186d5", "tag": "1e70afb5-bfc4-470b-a99a-9494fc375e1a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:56:35.297458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4246727c-cfbf-460a-a899-8d70d880be78 req-e3403662-8091-46d4-abd2-ba18114ec2a2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:35.297971 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4246727c-cfbf-460a-a899-8d70d880be78 req-e3403662-8091-46d4-abd2-ba18114ec2a2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:35.298424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-4246727c-cfbf-460a-a899-8d70d880be78 req-e3403662-8091-46d4-abd2-ba18114ec2a2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:35.312198 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-4246727c-cfbf-460a-a899-8d70d880be78 req-e3403662-8091-46d4-abd2-ba18114ec2a2 service nova] Creating event network-changed:1e70afb5-bfc4-470b-a99a-9494fc375e1a for instance 281a2ea4-9751-4433-82f3-e41cabb186d5 on n-h1-860864-3 Oct 11 20:56:35.317898 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-4246727c-cfbf-460a-a899-8d70d880be78 req-e3403662-8091-46d4-abd2-ba18114ec2a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101448 Oct 11 20:56:35.318826 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3539/7129] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:56:35.362578 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fd3fabfa-526e-4b74-ae73-908c3815dc98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "DELETE /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 204 len: 0 microversion: 2.1 time: 0.145778 Oct 11 20:56:35.365183 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3591/7130] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:56:35 2022] DELETE /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:56:35.378836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5380d6e0-52d3-47cc-b554-3b3593fdea4a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:35.379791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5380d6e0-52d3-47cc-b554-3b3593fdea4a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:35.387733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5380d6e0-52d3-47cc-b554-3b3593fdea4a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:35.388251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5380d6e0-52d3-47cc-b554-3b3593fdea4a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:35.388804 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5380d6e0-52d3-47cc-b554-3b3593fdea4a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:35.390183 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5380d6e0-52d3-47cc-b554-3b3593fdea4a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:35.390716 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5380d6e0-52d3-47cc-b554-3b3593fdea4a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:35.391167 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5380d6e0-52d3-47cc-b554-3b3593fdea4a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:35.533957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5380d6e0-52d3-47cc-b554-3b3593fdea4a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:35.541975 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5380d6e0-52d3-47cc-b554-3b3593fdea4a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1688 microversion: 2.1 time: 0.172228 Oct 11 20:56:35.542672 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3540/7131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:35 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:36.566961 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8c35f43c-ce59-4538-97e2-de41fc7839c7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:36.567668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8c35f43c-ce59-4538-97e2-de41fc7839c7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:36.576272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c35f43c-ce59-4538-97e2-de41fc7839c7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:36.577270 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c35f43c-ce59-4538-97e2-de41fc7839c7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:36.577713 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c35f43c-ce59-4538-97e2-de41fc7839c7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:36.578433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c35f43c-ce59-4538-97e2-de41fc7839c7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:36.578911 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c35f43c-ce59-4538-97e2-de41fc7839c7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:36.579335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8c35f43c-ce59-4538-97e2-de41fc7839c7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:36.794514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8c35f43c-ce59-4538-97e2-de41fc7839c7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:36.803070 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8c35f43c-ce59-4538-97e2-de41fc7839c7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 200 len: 1688 microversion: 2.1 time: 0.240188 Oct 11 20:56:36.803581 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3592/7132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:36 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 1688 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:37.171705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-7f6b76a1-c19f-414c-89d6-1610784965af req-816e55cf-5da7-4a42-9b21-228d1ec9dc69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281a2ea4-9751-4433-82f3-e41cabb186d5", "name": "network-vif-deleted", "tag": "1e70afb5-bfc4-470b-a99a-9494fc375e1a"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:56:37.182060 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7f6b76a1-c19f-414c-89d6-1610784965af req-816e55cf-5da7-4a42-9b21-228d1ec9dc69 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:37.182579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7f6b76a1-c19f-414c-89d6-1610784965af req-816e55cf-5da7-4a42-9b21-228d1ec9dc69 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:37.183026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-7f6b76a1-c19f-414c-89d6-1610784965af req-816e55cf-5da7-4a42-9b21-228d1ec9dc69 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:37.193977 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-7f6b76a1-c19f-414c-89d6-1610784965af req-816e55cf-5da7-4a42-9b21-228d1ec9dc69 service nova] Creating event network-vif-deleted:1e70afb5-bfc4-470b-a99a-9494fc375e1a for instance 281a2ea4-9751-4433-82f3-e41cabb186d5 on n-h1-860864-3 Oct 11 20:56:37.199025 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-7f6b76a1-c19f-414c-89d6-1610784965af req-816e55cf-5da7-4a42-9b21-228d1ec9dc69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091969 Oct 11 20:56:37.199622 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3541/7133] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:56:37.828111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:37.828921 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 281a2ea4-9751-4433-82f3-e41cabb186d5] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:37.835585 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:37.836071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:37.836511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:37.837207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:37.837662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:37.838084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:37.851286 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] HTTP exception thrown: Instance 281a2ea4-9751-4433-82f3-e41cabb186d5 could not be found. Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Request method failure captured: Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 HTTP/1.1 Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRddoIKtCVfSl774yn2xn7Qwnt599GHfMXalig3PUzq5omWaNff4YHi7MbpPV_fIPfUzLi7i1jjXXhgstitRfWU8K243zHcU7o-4P8OY-APzkTzDgxCpVfGU1KIczEjMXMUNg6ICKw71ZhYA7yZ8Jcfl4ZeENLZ5eO3t4F1eHqKBqftA Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 693353fd79c44f7096de98d129f5a4d5 Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/693353fd79c44f7096de98d129f5a4d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_693353fd79c44f7096de98d129f5a4d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/693353fd79c44f7096de98d129f5a4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/693353fd79c44f7096de98d129f5a4d5"}]}] Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 693353fd79c44f7096de98d129f5a4d5 Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestNetworkAdvancedServerOps-12473246-project Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: 6bd83b65d6f74f318789f72489360ae0 Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestNetworkAdvancedServerOps-12473246-project Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 281a2ea4-9751-4433-82f3-e41cabb186d5 could not be found. Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '281a2ea4-9751-4433-82f3-e41cabb186d5'} Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281a2ea4-9751-4433-82f3-e41cabb186d5 could not be found. Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281a2ea4-9751-4433-82f3-e41cabb186d5 could not be found. Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:56:37.852899 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281a2ea4-9751-4433-82f3-e41cabb186d5 could not be found. Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Returning 404 to user: Instance 281a2ea4-9751-4433-82f3-e41cabb186d5 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5120eed1-19b2-4bfd-b4dc-4422b3ca955f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5" status: 404 len: 111 microversion: 2.1 time: 0.031011 Oct 11 20:56:37.858199 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3593/7134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:37 2022] GET /compute/v2.1/servers/281a2ea4-9751-4433-82f3-e41cabb186d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:56:40.880393 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-24a5f095-80bd-4189-83fa-eb030d717245 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '.version_select at 0x7f83c6fc9310>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:40.902771 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-24a5f095-80bd-4189-83fa-eb030d717245 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1854891432" status: 202 len: 0 microversion: 2.1 time: 0.027526 Oct 11 20:56:40.903672 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3542/7135] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Oct 11 20:56:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1854891432 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:56:40.933294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-09d9704b-7b6e-4f62-afd0-899937eab220 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'create', calling method: .version_select at 0x7f83cca8a8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1152499287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG5nhjRmnWqeKcx2TPlCevD10fzwLNAEfxR7xz1M7RtQ+CZpC2LeqOCMNDl/P3PPExq2xax1ukZ3M8sMmlkjuL98ZxwHx1q2UTatVxPafDpQJJfnuWFwgrWXE3RcXZN4g=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:56:40.959226 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-09d9704b-7b6e-4f62-afd0-899937eab220 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for project 693353fd79c44f7096de98d129f5a4d5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:56:40.964494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-09d9704b-7b6e-4f62-afd0-899937eab220 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for user 6bd83b65d6f74f318789f72489360ae0 and project 693353fd79c44f7096de98d129f5a4d5. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:56:40.987979 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-09d9704b-7b6e-4f62-afd0-899937eab220 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058531 Oct 11 20:56:40.988618 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3594/7136] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:56:40 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:56:46.617636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1151402055", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "340587ad-5204-463f-b9d4-f09c41019e4a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1152499287", "security_groups": [{"name": "tempest-secgroup-smoke-1905496386"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:56:46.750471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] validate_networks() for [('340587ad-5204-463f-b9d4-f09c41019e4a', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:56:47.152895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:56:47.153331 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:56:47.153823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:56:47.154394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:56:47.154849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:56:47.164289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:47.165011 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:47.165466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:47.166203 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:47.166705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:47.167145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:47.188375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for project 693353fd79c44f7096de98d129f5a4d5. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:56:47.194223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for user 6bd83b65d6f74f318789f72489360ae0 and project 693353fd79c44f7096de98d129f5a4d5. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:56:47.208362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:56:47.210877 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:56:47.260491 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3a1cf950-7b6d-4145-a748-2917f3a3643e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.647308 Oct 11 20:56:47.262675 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3543/7137] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:56:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:56:47.274824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c314bbc9-3337-4e9b-88fb-a44babe37000 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:47.275469 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c314bbc9-3337-4e9b-88fb-a44babe37000 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:47.330827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c314bbc9-3337-4e9b-88fb-a44babe37000 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:47.338378 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c314bbc9-3337-4e9b-88fb-a44babe37000 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1267 microversion: 2.1 time: 0.068570 Oct 11 20:56:47.338996 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3595/7138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:47 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1267 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:48.364595 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-021f1a47-9904-41f4-9b98-35c2e6049f23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:48.365598 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-021f1a47-9904-41f4-9b98-35c2e6049f23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:48.373431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021f1a47-9904-41f4-9b98-35c2e6049f23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:48.374383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021f1a47-9904-41f4-9b98-35c2e6049f23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:48.375363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021f1a47-9904-41f4-9b98-35c2e6049f23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:48.376484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021f1a47-9904-41f4-9b98-35c2e6049f23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:48.378332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021f1a47-9904-41f4-9b98-35c2e6049f23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:48.379324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-021f1a47-9904-41f4-9b98-35c2e6049f23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:48.454566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-021f1a47-9904-41f4-9b98-35c2e6049f23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:48.463322 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-021f1a47-9904-41f4-9b98-35c2e6049f23 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1337 microversion: 2.1 time: 0.105124 Oct 11 20:56:48.463911 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3544/7139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:48 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1337 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:49.492046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-746b8181-12e8-4f0f-9354-4ac1085df558 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:49.492664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-746b8181-12e8-4f0f-9354-4ac1085df558 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:49.496010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:49.503388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746b8181-12e8-4f0f-9354-4ac1085df558 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:49.504549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746b8181-12e8-4f0f-9354-4ac1085df558 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:49.505100 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746b8181-12e8-4f0f-9354-4ac1085df558 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:49.505960 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746b8181-12e8-4f0f-9354-4ac1085df558 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:49.506427 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746b8181-12e8-4f0f-9354-4ac1085df558 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:49.506883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-746b8181-12e8-4f0f-9354-4ac1085df558 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:49.677012 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-746b8181-12e8-4f0f-9354-4ac1085df558 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:49.689403 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-746b8181-12e8-4f0f-9354-4ac1085df558 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1393 microversion: 2.1 time: 0.201820 Oct 11 20:56:49.690546 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3596/7140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:49 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1393 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:49.840790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-90eaacad-7f7d-4c3b-a62b-88f8a5187558 req-f5be3036-c23d-4834-91c3-82eeadce9a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e0adce-550d-45f3-9ecc-5e13d2258c5b", "tag": "60297cde-b5b7-4e89-89ac-36089e81acbc"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:56:49.853159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-90eaacad-7f7d-4c3b-a62b-88f8a5187558 req-f5be3036-c23d-4834-91c3-82eeadce9a9f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:49.853770 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-90eaacad-7f7d-4c3b-a62b-88f8a5187558 req-f5be3036-c23d-4834-91c3-82eeadce9a9f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:49.854303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-90eaacad-7f7d-4c3b-a62b-88f8a5187558 req-f5be3036-c23d-4834-91c3-82eeadce9a9f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:49.866755 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-90eaacad-7f7d-4c3b-a62b-88f8a5187558 req-f5be3036-c23d-4834-91c3-82eeadce9a9f service nova] Creating event network-changed:60297cde-b5b7-4e89-89ac-36089e81acbc for instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b on n-h1-860864-3 Oct 11 20:56:49.871939 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-90eaacad-7f7d-4c3b-a62b-88f8a5187558 req-f5be3036-c23d-4834-91c3-82eeadce9a9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035207 Oct 11 20:56:49.872912 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3545/7141] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:56:50.713207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-df59e97d-6403-4869-a79f-c48b89eb5b7f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:50.713817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-df59e97d-6403-4869-a79f-c48b89eb5b7f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:50.721725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df59e97d-6403-4869-a79f-c48b89eb5b7f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:50.722209 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df59e97d-6403-4869-a79f-c48b89eb5b7f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:50.722685 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df59e97d-6403-4869-a79f-c48b89eb5b7f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:50.723371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df59e97d-6403-4869-a79f-c48b89eb5b7f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:50.723826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df59e97d-6403-4869-a79f-c48b89eb5b7f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:50.724249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df59e97d-6403-4869-a79f-c48b89eb5b7f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:50.854878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-df59e97d-6403-4869-a79f-c48b89eb5b7f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:50.862491 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-df59e97d-6403-4869-a79f-c48b89eb5b7f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1393 microversion: 2.1 time: 0.153259 Oct 11 20:56:50.863093 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3597/7142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:50 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:51.886758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06170375-6b8d-4e3e-bfc7-732334dff432 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:51.887405 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-06170375-6b8d-4e3e-bfc7-732334dff432 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:51.894324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06170375-6b8d-4e3e-bfc7-732334dff432 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:51.894887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06170375-6b8d-4e3e-bfc7-732334dff432 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:51.895344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06170375-6b8d-4e3e-bfc7-732334dff432 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:51.896051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06170375-6b8d-4e3e-bfc7-732334dff432 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:51.896528 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06170375-6b8d-4e3e-bfc7-732334dff432 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:51.896972 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06170375-6b8d-4e3e-bfc7-732334dff432 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:52.027669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-06170375-6b8d-4e3e-bfc7-732334dff432 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:52.036120 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-06170375-6b8d-4e3e-bfc7-732334dff432 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1393 microversion: 2.1 time: 0.154614 Oct 11 20:56:52.036701 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3546/7143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:51 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:53.106755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe31510d-2b0b-4eb2-8aa4-3dda04598a98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:53.107411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fe31510d-2b0b-4eb2-8aa4-3dda04598a98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:53.113341 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe31510d-2b0b-4eb2-8aa4-3dda04598a98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:53.113835 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe31510d-2b0b-4eb2-8aa4-3dda04598a98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:53.114290 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe31510d-2b0b-4eb2-8aa4-3dda04598a98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:53.115006 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe31510d-2b0b-4eb2-8aa4-3dda04598a98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:53.115456 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe31510d-2b0b-4eb2-8aa4-3dda04598a98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:53.115881 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe31510d-2b0b-4eb2-8aa4-3dda04598a98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:53.250426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe31510d-2b0b-4eb2-8aa4-3dda04598a98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:53.258121 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fe31510d-2b0b-4eb2-8aa4-3dda04598a98 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1393 microversion: 2.1 time: 0.201992 Oct 11 20:56:53.258649 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3598/7144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:53 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1393 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:54.281910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d0540b10-a6fa-4b77-9325-4f5d4d292d9f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:54.282574 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d0540b10-a6fa-4b77-9325-4f5d4d292d9f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:54.289420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0540b10-a6fa-4b77-9325-4f5d4d292d9f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:54.289917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0540b10-a6fa-4b77-9325-4f5d4d292d9f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:54.290367 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0540b10-a6fa-4b77-9325-4f5d4d292d9f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:54.291111 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0540b10-a6fa-4b77-9325-4f5d4d292d9f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:54.291559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0540b10-a6fa-4b77-9325-4f5d4d292d9f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:54.291996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d0540b10-a6fa-4b77-9325-4f5d4d292d9f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:54.424299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d0540b10-a6fa-4b77-9325-4f5d4d292d9f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:54.432065 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d0540b10-a6fa-4b77-9325-4f5d4d292d9f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1393 microversion: 2.1 time: 0.154832 Oct 11 20:56:54.432640 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3547/7145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:54 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:55.455782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-af5b32dc-304a-476e-821a-06ca316ad0d7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:55.456401 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-af5b32dc-304a-476e-821a-06ca316ad0d7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:55.463255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af5b32dc-304a-476e-821a-06ca316ad0d7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:55.463746 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af5b32dc-304a-476e-821a-06ca316ad0d7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:55.464204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af5b32dc-304a-476e-821a-06ca316ad0d7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:55.464899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af5b32dc-304a-476e-821a-06ca316ad0d7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:55.465354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af5b32dc-304a-476e-821a-06ca316ad0d7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:55.465781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-af5b32dc-304a-476e-821a-06ca316ad0d7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:55.606715 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-af5b32dc-304a-476e-821a-06ca316ad0d7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:55.614816 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-af5b32dc-304a-476e-821a-06ca316ad0d7 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1393 microversion: 2.1 time: 0.163576 Oct 11 20:56:55.615453 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3599/7146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:55 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:55.675227 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-44b279e8-4899-4871-b062-e3a2c28b7f9e req-fccd2690-40ea-4937-ac11-e50d292fb204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e0adce-550d-45f3-9ecc-5e13d2258c5b", "name": "network-vif-plugged", "status": "completed", "tag": "60297cde-b5b7-4e89-89ac-36089e81acbc"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:56:55.686344 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-44b279e8-4899-4871-b062-e3a2c28b7f9e req-fccd2690-40ea-4937-ac11-e50d292fb204 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:55.687043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-44b279e8-4899-4871-b062-e3a2c28b7f9e req-fccd2690-40ea-4937-ac11-e50d292fb204 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:55.687502 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-44b279e8-4899-4871-b062-e3a2c28b7f9e req-fccd2690-40ea-4937-ac11-e50d292fb204 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:55.699472 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-44b279e8-4899-4871-b062-e3a2c28b7f9e req-fccd2690-40ea-4937-ac11-e50d292fb204 service nova] Creating event network-vif-plugged:60297cde-b5b7-4e89-89ac-36089e81acbc for instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b on n-h1-860864-3 Oct 11 20:56:55.705048 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-44b279e8-4899-4871-b062-e3a2c28b7f9e req-fccd2690-40ea-4937-ac11-e50d292fb204 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033767 Oct 11 20:56:55.705656 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3548/7147] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 20:56:56.637255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-37b8f780-2d31-45a5-9c45-77aad7c29704 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:56.637865 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-37b8f780-2d31-45a5-9c45-77aad7c29704 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:56.644628 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37b8f780-2d31-45a5-9c45-77aad7c29704 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:56.645110 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37b8f780-2d31-45a5-9c45-77aad7c29704 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:56.645542 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37b8f780-2d31-45a5-9c45-77aad7c29704 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:56.646219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37b8f780-2d31-45a5-9c45-77aad7c29704 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:56.646707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37b8f780-2d31-45a5-9c45-77aad7c29704 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:56.647129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-37b8f780-2d31-45a5-9c45-77aad7c29704 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:56.777217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-37b8f780-2d31-45a5-9c45-77aad7c29704 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:56.785494 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-37b8f780-2d31-45a5-9c45-77aad7c29704 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1393 microversion: 2.1 time: 0.152027 Oct 11 20:56:56.786069 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3600/7148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:56 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:57.807283 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:57.808098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:57.813121 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dd2cc2d0-0f06-4a99-9f02-69fc4073afc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:57.813844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dd2cc2d0-0f06-4a99-9f02-69fc4073afc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:57.815694 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:57.823263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd2cc2d0-0f06-4a99-9f02-69fc4073afc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:57.824021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd2cc2d0-0f06-4a99-9f02-69fc4073afc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:57.824477 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd2cc2d0-0f06-4a99-9f02-69fc4073afc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:57.825189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd2cc2d0-0f06-4a99-9f02-69fc4073afc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:57.825666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd2cc2d0-0f06-4a99-9f02-69fc4073afc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:57.826772 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd2cc2d0-0f06-4a99-9f02-69fc4073afc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:57.831458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=39 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:57.964361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dd2cc2d0-0f06-4a99-9f02-69fc4073afc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:57.972230 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dd2cc2d0-0f06-4a99-9f02-69fc4073afc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1564 microversion: 2.1 time: 0.166784 Oct 11 20:56:57.972807 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3549/7149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:57 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:56:57.994707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-07185ce8-a659-4463-bb13-270f7b0c6cc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:56:57.995314 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-07185ce8-a659-4463-bb13-270f7b0c6cc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:56:57.997193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:56:58.003908 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07185ce8-a659-4463-bb13-270f7b0c6cc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:58.004393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07185ce8-a659-4463-bb13-270f7b0c6cc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:58.004826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07185ce8-a659-4463-bb13-270f7b0c6cc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:58.005509 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07185ce8-a659-4463-bb13-270f7b0c6cc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:56:58.005958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07185ce8-a659-4463-bb13-270f7b0c6cc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:56:58.006374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-07185ce8-a659-4463-bb13-270f7b0c6cc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:56:58.142513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-07185ce8-a659-4463-bb13-270f7b0c6cc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:56:58.150333 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-07185ce8-a659-4463-bb13-270f7b0c6cc4 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1564 microversion: 2.1 time: 0.159479 Oct 11 20:56:58.150952 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3601/7150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:56:57 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:00.094653 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-0d387d52-b21f-4f89-be35-0222a9aa7899 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:00.095287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-0d387d52-b21f-4f89-be35-0222a9aa7899 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:00.096983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ba87c896-40d7-4a15-af16-2b1b42564103 req-3232f0ae-6790-4c25-93b0-029d05b6ca5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e0adce-550d-45f3-9ecc-5e13d2258c5b", "tag": "60297cde-b5b7-4e89-89ac-36089e81acbc"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:57:00.102361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d387d52-b21f-4f89-be35-0222a9aa7899 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:00.102896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d387d52-b21f-4f89-be35-0222a9aa7899 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:00.103351 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d387d52-b21f-4f89-be35-0222a9aa7899 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:00.104256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d387d52-b21f-4f89-be35-0222a9aa7899 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:00.104724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d387d52-b21f-4f89-be35-0222a9aa7899 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:00.105375 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-0d387d52-b21f-4f89-be35-0222a9aa7899 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:00.108757 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ba87c896-40d7-4a15-af16-2b1b42564103 req-3232f0ae-6790-4c25-93b0-029d05b6ca5d service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:00.109320 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ba87c896-40d7-4a15-af16-2b1b42564103 req-3232f0ae-6790-4c25-93b0-029d05b6ca5d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:00.109815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ba87c896-40d7-4a15-af16-2b1b42564103 req-3232f0ae-6790-4c25-93b0-029d05b6ca5d service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:00.121479 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ba87c896-40d7-4a15-af16-2b1b42564103 req-3232f0ae-6790-4c25-93b0-029d05b6ca5d service nova] Creating event network-changed:60297cde-b5b7-4e89-89ac-36089e81acbc for instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b on n-h1-860864-3 Oct 11 20:57:00.126716 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ba87c896-40d7-4a15-af16-2b1b42564103 req-3232f0ae-6790-4c25-93b0-029d05b6ca5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033438 Oct 11 20:57:00.127588 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3602/7151] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:57:00.250021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-0d387d52-b21f-4f89-be35-0222a9aa7899 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:00.258865 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-0d387d52-b21f-4f89-be35-0222a9aa7899 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1564 microversion: 2.1 time: 0.168412 Oct 11 20:57:00.259747 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3550/7152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:00 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:21.503644 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:57:21.504395 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=38 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:57:21.508901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-87a5ae05-85b4-45d2-8e65-72a49356f8ee tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:57:21.511684 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-87a5ae05-85b4-45d2-8e65-72a49356f8ee tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:21.520088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87a5ae05-85b4-45d2-8e65-72a49356f8ee tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:21.520603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87a5ae05-85b4-45d2-8e65-72a49356f8ee tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:21.521039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87a5ae05-85b4-45d2-8e65-72a49356f8ee tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:21.521994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87a5ae05-85b4-45d2-8e65-72a49356f8ee tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:21.522453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87a5ae05-85b4-45d2-8e65-72a49356f8ee tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:21.522934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-87a5ae05-85b4-45d2-8e65-72a49356f8ee tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:21.575377 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-87a5ae05-85b4-45d2-8e65-72a49356f8ee tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b/action" status: 200 len: 24573 microversion: 2.1 time: 0.073569 Oct 11 20:57:21.576365 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3603/7153] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:57:21 2022] POST /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b/action => generated 24573 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:57:32.619399 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b2da0384-6ca6-4388-825b-64d15c19aa72 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:57:32.621625 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=3 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:57:32.622432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=11 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:57:32.629029 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2da0384-6ca6-4388-825b-64d15c19aa72 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:32.629526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2da0384-6ca6-4388-825b-64d15c19aa72 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:32.629974 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b2da0384-6ca6-4388-825b-64d15c19aa72 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:32.651867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b2da0384-6ca6-4388-825b-64d15c19aa72 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Going to try to stop instance {{(pid=126955) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 20:57:32.693388 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b2da0384-6ca6-4388-825b-64d15c19aa72 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b/action" status: 202 len: 0 microversion: 2.1 time: 0.078013 Oct 11 20:57:32.693994 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3551/7154] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:57:32 2022] POST /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:57:32.703404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-234115fd-e129-479a-875d-61b9e23c820c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:32.704248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-234115fd-e129-479a-875d-61b9e23c820c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:32.707284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:57:32.708231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:57:32.714366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234115fd-e129-479a-875d-61b9e23c820c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:32.714934 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234115fd-e129-479a-875d-61b9e23c820c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:32.715463 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234115fd-e129-479a-875d-61b9e23c820c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:32.716246 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234115fd-e129-479a-875d-61b9e23c820c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:32.716732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234115fd-e129-479a-875d-61b9e23c820c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:32.717297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-234115fd-e129-479a-875d-61b9e23c820c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:32.850912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-234115fd-e129-479a-875d-61b9e23c820c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:32.859821 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-234115fd-e129-479a-875d-61b9e23c820c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.161156 Oct 11 20:57:32.860385 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3604/7155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:32 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:33.884777 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3ecc65ff-927c-450a-9aee-03f91bc6e1c2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:33.885489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3ecc65ff-927c-450a-9aee-03f91bc6e1c2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:33.891814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ecc65ff-927c-450a-9aee-03f91bc6e1c2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:33.892312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ecc65ff-927c-450a-9aee-03f91bc6e1c2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:33.892758 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ecc65ff-927c-450a-9aee-03f91bc6e1c2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:33.893451 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ecc65ff-927c-450a-9aee-03f91bc6e1c2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:33.893923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ecc65ff-927c-450a-9aee-03f91bc6e1c2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:33.894360 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ecc65ff-927c-450a-9aee-03f91bc6e1c2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:34.025314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3ecc65ff-927c-450a-9aee-03f91bc6e1c2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:34.033596 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3ecc65ff-927c-450a-9aee-03f91bc6e1c2 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.154039 Oct 11 20:57:34.034170 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3552/7156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:33 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:35.056749 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-201a3766-ec9c-4708-97e6-153aa194d54d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:35.057359 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-201a3766-ec9c-4708-97e6-153aa194d54d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:35.065127 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a3766-ec9c-4708-97e6-153aa194d54d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:35.065612 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a3766-ec9c-4708-97e6-153aa194d54d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:35.066046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a3766-ec9c-4708-97e6-153aa194d54d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:35.066761 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a3766-ec9c-4708-97e6-153aa194d54d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:35.067210 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a3766-ec9c-4708-97e6-153aa194d54d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:35.067630 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-201a3766-ec9c-4708-97e6-153aa194d54d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:35.202217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-201a3766-ec9c-4708-97e6-153aa194d54d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:35.210959 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-201a3766-ec9c-4708-97e6-153aa194d54d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.158096 Oct 11 20:57:35.211535 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3605/7157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:35 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:36.234938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-74e1da30-83ff-49ff-b860-024e78e3e9db tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:36.235590 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-74e1da30-83ff-49ff-b860-024e78e3e9db tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:36.242578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e1da30-83ff-49ff-b860-024e78e3e9db tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:36.243089 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e1da30-83ff-49ff-b860-024e78e3e9db tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:36.243549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e1da30-83ff-49ff-b860-024e78e3e9db tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:36.244256 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e1da30-83ff-49ff-b860-024e78e3e9db tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:36.244735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e1da30-83ff-49ff-b860-024e78e3e9db tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:36.245182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-74e1da30-83ff-49ff-b860-024e78e3e9db tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:36.376341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-74e1da30-83ff-49ff-b860-024e78e3e9db tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:36.384141 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-74e1da30-83ff-49ff-b860-024e78e3e9db tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.153813 Oct 11 20:57:36.384717 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3553/7158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:36 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:37.408752 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-550212e9-c951-4233-8c94-75afe374454c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:37.409366 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-550212e9-c951-4233-8c94-75afe374454c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:37.416186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-550212e9-c951-4233-8c94-75afe374454c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:37.416665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-550212e9-c951-4233-8c94-75afe374454c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:37.417099 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-550212e9-c951-4233-8c94-75afe374454c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:37.417786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-550212e9-c951-4233-8c94-75afe374454c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:37.418238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-550212e9-c951-4233-8c94-75afe374454c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:37.418701 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-550212e9-c951-4233-8c94-75afe374454c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:37.554249 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-550212e9-c951-4233-8c94-75afe374454c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:37.562175 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-550212e9-c951-4233-8c94-75afe374454c tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.157839 Oct 11 20:57:37.562821 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3606/7159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:37 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:38.586386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-94f9ef3c-ffcc-48eb-a8b2-8e1f983df8ca tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:38.587527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-94f9ef3c-ffcc-48eb-a8b2-8e1f983df8ca tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:38.595369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94f9ef3c-ffcc-48eb-a8b2-8e1f983df8ca tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:38.595868 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94f9ef3c-ffcc-48eb-a8b2-8e1f983df8ca tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:38.596420 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94f9ef3c-ffcc-48eb-a8b2-8e1f983df8ca tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:38.597135 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94f9ef3c-ffcc-48eb-a8b2-8e1f983df8ca tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:38.597607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94f9ef3c-ffcc-48eb-a8b2-8e1f983df8ca tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:38.598047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-94f9ef3c-ffcc-48eb-a8b2-8e1f983df8ca tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:38.728462 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-94f9ef3c-ffcc-48eb-a8b2-8e1f983df8ca tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:38.736382 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-94f9ef3c-ffcc-48eb-a8b2-8e1f983df8ca tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.154385 Oct 11 20:57:38.736962 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3554/7160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:38 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:39.759885 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-065a7df6-99be-40c9-8dbe-f74c18f11bf5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:39.760517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-065a7df6-99be-40c9-8dbe-f74c18f11bf5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:39.767622 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-065a7df6-99be-40c9-8dbe-f74c18f11bf5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:39.768096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-065a7df6-99be-40c9-8dbe-f74c18f11bf5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:39.768525 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-065a7df6-99be-40c9-8dbe-f74c18f11bf5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:39.769200 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-065a7df6-99be-40c9-8dbe-f74c18f11bf5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:39.769646 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-065a7df6-99be-40c9-8dbe-f74c18f11bf5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:39.770064 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-065a7df6-99be-40c9-8dbe-f74c18f11bf5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:39.899282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-065a7df6-99be-40c9-8dbe-f74c18f11bf5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:39.907543 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-065a7df6-99be-40c9-8dbe-f74c18f11bf5 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.151543 Oct 11 20:57:39.908119 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3607/7161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:39 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:40.931559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-abb32a15-34aa-4643-8b7c-83c9cf22e5fe tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:40.932197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-abb32a15-34aa-4643-8b7c-83c9cf22e5fe tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:40.938689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb32a15-34aa-4643-8b7c-83c9cf22e5fe tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:40.939192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb32a15-34aa-4643-8b7c-83c9cf22e5fe tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:40.939651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb32a15-34aa-4643-8b7c-83c9cf22e5fe tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:40.940355 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb32a15-34aa-4643-8b7c-83c9cf22e5fe tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:40.940829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb32a15-34aa-4643-8b7c-83c9cf22e5fe tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:40.941271 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-abb32a15-34aa-4643-8b7c-83c9cf22e5fe tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:41.075539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-abb32a15-34aa-4643-8b7c-83c9cf22e5fe tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:41.084361 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-abb32a15-34aa-4643-8b7c-83c9cf22e5fe tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.156902 Oct 11 20:57:41.084937 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3555/7162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:40 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:42.108410 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-fe6a8eb0-0720-479c-93a2-431acc9786bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:42.110007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-fe6a8eb0-0720-479c-93a2-431acc9786bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:42.119607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe6a8eb0-0720-479c-93a2-431acc9786bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:42.120088 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe6a8eb0-0720-479c-93a2-431acc9786bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:42.120516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe6a8eb0-0720-479c-93a2-431acc9786bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:42.121231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe6a8eb0-0720-479c-93a2-431acc9786bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:42.121677 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe6a8eb0-0720-479c-93a2-431acc9786bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:42.122096 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-fe6a8eb0-0720-479c-93a2-431acc9786bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:42.254779 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-fe6a8eb0-0720-479c-93a2-431acc9786bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:42.262415 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-fe6a8eb0-0720-479c-93a2-431acc9786bf tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.157927 Oct 11 20:57:42.263061 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3608/7163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:42 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:43.285668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b3b74fc4-6ab1-42b3-a950-a3d1ffd83420 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:43.286289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b3b74fc4-6ab1-42b3-a950-a3d1ffd83420 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:43.293359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3b74fc4-6ab1-42b3-a950-a3d1ffd83420 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:43.293857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3b74fc4-6ab1-42b3-a950-a3d1ffd83420 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:43.294309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3b74fc4-6ab1-42b3-a950-a3d1ffd83420 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:43.295051 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3b74fc4-6ab1-42b3-a950-a3d1ffd83420 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:43.295523 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3b74fc4-6ab1-42b3-a950-a3d1ffd83420 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:43.296464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3b74fc4-6ab1-42b3-a950-a3d1ffd83420 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:43.432554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b3b74fc4-6ab1-42b3-a950-a3d1ffd83420 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:43.440357 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b3b74fc4-6ab1-42b3-a950-a3d1ffd83420 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.158591 Oct 11 20:57:43.440944 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3556/7164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:43 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:44.463907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-01321a7e-1e9c-49c1-a74d-f0b3518bcfdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:44.464514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-01321a7e-1e9c-49c1-a74d-f0b3518bcfdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:44.471899 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01321a7e-1e9c-49c1-a74d-f0b3518bcfdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:44.472373 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01321a7e-1e9c-49c1-a74d-f0b3518bcfdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:44.472808 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01321a7e-1e9c-49c1-a74d-f0b3518bcfdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:44.473477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01321a7e-1e9c-49c1-a74d-f0b3518bcfdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:44.473929 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01321a7e-1e9c-49c1-a74d-f0b3518bcfdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:44.474347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-01321a7e-1e9c-49c1-a74d-f0b3518bcfdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:44.608932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-01321a7e-1e9c-49c1-a74d-f0b3518bcfdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:44.616570 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-01321a7e-1e9c-49c1-a74d-f0b3518bcfdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.156505 Oct 11 20:57:44.617120 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3609/7165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:44 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:45.640784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-fe511a78-ce62-47ba-bec6-fa4fa2783491 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:45.641350 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-fe511a78-ce62-47ba-bec6-fa4fa2783491 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:45.648274 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe511a78-ce62-47ba-bec6-fa4fa2783491 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:45.648771 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe511a78-ce62-47ba-bec6-fa4fa2783491 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:45.649221 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe511a78-ce62-47ba-bec6-fa4fa2783491 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:45.649917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe511a78-ce62-47ba-bec6-fa4fa2783491 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:45.650383 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe511a78-ce62-47ba-bec6-fa4fa2783491 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:45.650857 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-fe511a78-ce62-47ba-bec6-fa4fa2783491 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:45.785898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-fe511a78-ce62-47ba-bec6-fa4fa2783491 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:45.793767 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-fe511a78-ce62-47ba-bec6-fa4fa2783491 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.157518 Oct 11 20:57:45.794358 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3557/7166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:45 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:46.817798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f05657e9-a67b-43fa-a2bb-1ae6edc3d4bd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:46.818397 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f05657e9-a67b-43fa-a2bb-1ae6edc3d4bd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:46.825280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f05657e9-a67b-43fa-a2bb-1ae6edc3d4bd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:46.825759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f05657e9-a67b-43fa-a2bb-1ae6edc3d4bd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:46.826191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f05657e9-a67b-43fa-a2bb-1ae6edc3d4bd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:46.826902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f05657e9-a67b-43fa-a2bb-1ae6edc3d4bd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:46.827548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f05657e9-a67b-43fa-a2bb-1ae6edc3d4bd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:46.827966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f05657e9-a67b-43fa-a2bb-1ae6edc3d4bd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:46.958517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f05657e9-a67b-43fa-a2bb-1ae6edc3d4bd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:46.966133 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f05657e9-a67b-43fa-a2bb-1ae6edc3d4bd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1693 microversion: 2.1 time: 0.152270 Oct 11 20:57:46.966731 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3610/7167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:46 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:47.990007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-79b4da3e-fe4a-44a2-9b1d-d9714bcada6f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:47.990652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-79b4da3e-fe4a-44a2-9b1d-d9714bcada6f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:47.997531 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b4da3e-fe4a-44a2-9b1d-d9714bcada6f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:47.998040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b4da3e-fe4a-44a2-9b1d-d9714bcada6f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:47.998498 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b4da3e-fe4a-44a2-9b1d-d9714bcada6f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:47.999282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b4da3e-fe4a-44a2-9b1d-d9714bcada6f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:47.999763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b4da3e-fe4a-44a2-9b1d-d9714bcada6f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:48.000202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-79b4da3e-fe4a-44a2-9b1d-d9714bcada6f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:48.132381 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-79b4da3e-fe4a-44a2-9b1d-d9714bcada6f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:48.140258 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-79b4da3e-fe4a-44a2-9b1d-d9714bcada6f tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1670 microversion: 2.1 time: 0.154268 Oct 11 20:57:48.140829 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3558/7168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:47 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:49.237745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a59ccb7c-763f-4e12-9699-81e2570bdb29 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:57:49.239985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a59ccb7c-763f-4e12-9699-81e2570bdb29 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:49.246877 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ccb7c-763f-4e12-9699-81e2570bdb29 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:49.247357 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ccb7c-763f-4e12-9699-81e2570bdb29 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:49.247786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ccb7c-763f-4e12-9699-81e2570bdb29 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:49.248483 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ccb7c-763f-4e12-9699-81e2570bdb29 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:49.249502 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ccb7c-763f-4e12-9699-81e2570bdb29 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:49.249926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a59ccb7c-763f-4e12-9699-81e2570bdb29 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:49.301246 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a59ccb7c-763f-4e12-9699-81e2570bdb29 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b/action" status: 200 len: 38461 microversion: 2.1 time: 0.067760 Oct 11 20:57:49.301887 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3611/7169] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:57:49 2022] POST /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b/action => generated 38461 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:57:49.314415 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4939c45b-0b8a-456d-a85a-43a51d2d891e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:57:49.321938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4939c45b-0b8a-456d-a85a-43a51d2d891e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:49.322443 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4939c45b-0b8a-456d-a85a-43a51d2d891e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:49.322933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4939c45b-0b8a-456d-a85a-43a51d2d891e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:49.346667 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4939c45b-0b8a-456d-a85a-43a51d2d891e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Going to try to start instance {{(pid=126955) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 20:57:49.388011 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4939c45b-0b8a-456d-a85a-43a51d2d891e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b/action" status: 202 len: 0 microversion: 2.1 time: 0.077914 Oct 11 20:57:49.388616 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3559/7170] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:57:49 2022] POST /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:57:49.398081 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-61197ad2-cac5-44b1-920c-c8e1a4fc538b tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:49.398824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-61197ad2-cac5-44b1-920c-c8e1a4fc538b tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:49.407115 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61197ad2-cac5-44b1-920c-c8e1a4fc538b tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:49.407900 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61197ad2-cac5-44b1-920c-c8e1a4fc538b tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:49.408352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61197ad2-cac5-44b1-920c-c8e1a4fc538b tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:49.409058 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61197ad2-cac5-44b1-920c-c8e1a4fc538b tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:49.409522 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61197ad2-cac5-44b1-920c-c8e1a4fc538b tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:49.409954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-61197ad2-cac5-44b1-920c-c8e1a4fc538b tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:49.548560 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-61197ad2-cac5-44b1-920c-c8e1a4fc538b tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:49.556380 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-61197ad2-cac5-44b1-920c-c8e1a4fc538b tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1679 microversion: 2.1 time: 0.162502 Oct 11 20:57:49.557048 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3612/7171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:49 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:57:50.583798 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5407c0cc-dbe5-4563-b01f-fa89aee50a93 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:57:50.584431 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5407c0cc-dbe5-4563-b01f-fa89aee50a93 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:57:50.591031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5407c0cc-dbe5-4563-b01f-fa89aee50a93 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:50.591537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5407c0cc-dbe5-4563-b01f-fa89aee50a93 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:50.591997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5407c0cc-dbe5-4563-b01f-fa89aee50a93 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:50.593363 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5407c0cc-dbe5-4563-b01f-fa89aee50a93 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:57:50.593841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5407c0cc-dbe5-4563-b01f-fa89aee50a93 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:57:50.594287 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5407c0cc-dbe5-4563-b01f-fa89aee50a93 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:57:50.736050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5407c0cc-dbe5-4563-b01f-fa89aee50a93 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:57:50.743889 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5407c0cc-dbe5-4563-b01f-fa89aee50a93 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1683 microversion: 2.1 time: 0.165558 Oct 11 20:57:50.744460 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3560/7172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:57:50 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:16.940918 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-dc076f4e-cf80-4d95-be4a-21c548bb4665 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:58:16.943120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-dc076f4e-cf80-4d95-be4a-21c548bb4665 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:16.945722 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=18 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:58:16.946601 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=52 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:58:16.955347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc076f4e-cf80-4d95-be4a-21c548bb4665 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:16.955832 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc076f4e-cf80-4d95-be4a-21c548bb4665 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:16.956267 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc076f4e-cf80-4d95-be4a-21c548bb4665 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:16.956958 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc076f4e-cf80-4d95-be4a-21c548bb4665 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:16.957407 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc076f4e-cf80-4d95-be4a-21c548bb4665 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:16.957826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-dc076f4e-cf80-4d95-be4a-21c548bb4665 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:17.009670 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-dc076f4e-cf80-4d95-be4a-21c548bb4665 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b/action" status: 200 len: 63021 microversion: 2.1 time: 0.072708 Oct 11 20:58:17.010336 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3613/7173] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:58:16 2022] POST /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b/action => generated 63021 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:58:24.247816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-084944f4-67d0-4617-ab54-3f721eb21cdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:24.248982 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-084944f4-67d0-4617-ab54-3f721eb21cdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:24.251141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-54d5015d-3250-4961-93f0-36a35c30523b req-ee0b6671-f2ba-4dfa-a1be-0c075687d7ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e0adce-550d-45f3-9ecc-5e13d2258c5b", "tag": "60297cde-b5b7-4e89-89ac-36089e81acbc"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:58:24.255889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=20 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:58:24.257163 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:58:24.259638 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084944f4-67d0-4617-ab54-3f721eb21cdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:24.260384 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084944f4-67d0-4617-ab54-3f721eb21cdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:24.261047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084944f4-67d0-4617-ab54-3f721eb21cdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:24.262306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084944f4-67d0-4617-ab54-3f721eb21cdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:24.263012 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084944f4-67d0-4617-ab54-3f721eb21cdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:24.263752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-084944f4-67d0-4617-ab54-3f721eb21cdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:24.265022 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54d5015d-3250-4961-93f0-36a35c30523b req-ee0b6671-f2ba-4dfa-a1be-0c075687d7ac service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:24.265579 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54d5015d-3250-4961-93f0-36a35c30523b req-ee0b6671-f2ba-4dfa-a1be-0c075687d7ac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:24.266090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-54d5015d-3250-4961-93f0-36a35c30523b req-ee0b6671-f2ba-4dfa-a1be-0c075687d7ac service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:24.279827 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-54d5015d-3250-4961-93f0-36a35c30523b req-ee0b6671-f2ba-4dfa-a1be-0c075687d7ac service nova] Creating event network-changed:60297cde-b5b7-4e89-89ac-36089e81acbc for instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b on n-h1-860864-3 Oct 11 20:58:24.286046 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-54d5015d-3250-4961-93f0-36a35c30523b req-ee0b6671-f2ba-4dfa-a1be-0c075687d7ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039393 Oct 11 20:58:24.287357 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3614/7174] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:58:24.297645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-084944f4-67d0-4617-ab54-3f721eb21cdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:58:24.390429 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-084944f4-67d0-4617-ab54-3f721eb21cdd tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "DELETE /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 204 len: 0 microversion: 2.1 time: 0.146237 Oct 11 20:58:24.391280 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3561/7175] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:58:24 2022] DELETE /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:58:24.401220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-df54eca4-b411-4db7-adc0-11ed82cbf810 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:24.402296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-df54eca4-b411-4db7-adc0-11ed82cbf810 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:24.410426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df54eca4-b411-4db7-adc0-11ed82cbf810 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:24.411305 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df54eca4-b411-4db7-adc0-11ed82cbf810 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:24.411954 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df54eca4-b411-4db7-adc0-11ed82cbf810 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:24.412969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df54eca4-b411-4db7-adc0-11ed82cbf810 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:24.413661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df54eca4-b411-4db7-adc0-11ed82cbf810 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:24.414287 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-df54eca4-b411-4db7-adc0-11ed82cbf810 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:24.582758 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-df54eca4-b411-4db7-adc0-11ed82cbf810 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:24.593287 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-df54eca4-b411-4db7-adc0-11ed82cbf810 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1689 microversion: 2.1 time: 0.197195 Oct 11 20:58:24.606661 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3615/7176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:24 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1689 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:25.621659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6e6c5433-af21-4b51-88b1-10398a7c1b8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:25.622386 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6e6c5433-af21-4b51-88b1-10398a7c1b8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:25.629337 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e6c5433-af21-4b51-88b1-10398a7c1b8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:25.629839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e6c5433-af21-4b51-88b1-10398a7c1b8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:25.630297 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e6c5433-af21-4b51-88b1-10398a7c1b8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:25.631027 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e6c5433-af21-4b51-88b1-10398a7c1b8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:25.631530 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e6c5433-af21-4b51-88b1-10398a7c1b8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:25.631997 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6e6c5433-af21-4b51-88b1-10398a7c1b8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:25.775279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6e6c5433-af21-4b51-88b1-10398a7c1b8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:25.784380 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6e6c5433-af21-4b51-88b1-10398a7c1b8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 200 len: 1689 microversion: 2.1 time: 0.166982 Oct 11 20:58:25.784971 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3562/7177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:25 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:26.301702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ffa445af-3c3a-4255-9eb0-2eec455911c4 req-3d585ffb-bfb1-4867-bad5-338eac0d2912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e0adce-550d-45f3-9ecc-5e13d2258c5b", "name": "network-vif-deleted", "tag": "60297cde-b5b7-4e89-89ac-36089e81acbc"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:58:26.312549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ffa445af-3c3a-4255-9eb0-2eec455911c4 req-3d585ffb-bfb1-4867-bad5-338eac0d2912 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:26.313067 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ffa445af-3c3a-4255-9eb0-2eec455911c4 req-3d585ffb-bfb1-4867-bad5-338eac0d2912 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:26.313517 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ffa445af-3c3a-4255-9eb0-2eec455911c4 req-3d585ffb-bfb1-4867-bad5-338eac0d2912 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:26.325088 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ffa445af-3c3a-4255-9eb0-2eec455911c4 req-3d585ffb-bfb1-4867-bad5-338eac0d2912 service nova] Creating event network-vif-deleted:60297cde-b5b7-4e89-89ac-36089e81acbc for instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b on n-h1-860864-3 Oct 11 20:58:26.330028 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ffa445af-3c3a-4255-9eb0-2eec455911c4 req-3d585ffb-bfb1-4867-bad5-338eac0d2912 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032270 Oct 11 20:58:26.330638 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3616/7178] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:58:26.810657 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:26.811231 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 22e0adce-550d-45f3-9ecc-5e13d2258c5b] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:26.818154 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:26.818656 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:26.819112 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:26.819847 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:26.820320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:26.820763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:26.835233 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] HTTP exception thrown: Instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b could not be found. Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Request method failure captured: Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b HTTP/1.1 Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRddoIKtCVfSl774yn2xn7Qwnt599GHfMXalig3PUzq5omWaNff4YHi7MbpPV_fIPfUzLi7i1jjXXhgstitRfWU8K243zHcU7o-4P8OY-APzkTzDgxCpVfGU1KIczEjMXMUNg6ICKw71ZhYA7yZ8Jcfl4ZeENLZ5eO3t4F1eHqKBqftA Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 693353fd79c44f7096de98d129f5a4d5 Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/693353fd79c44f7096de98d129f5a4d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_693353fd79c44f7096de98d129f5a4d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/693353fd79c44f7096de98d129f5a4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/693353fd79c44f7096de98d129f5a4d5"}]}] Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 693353fd79c44f7096de98d129f5a4d5 Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestNetworkAdvancedServerOps-12473246-project Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 6bd83b65d6f74f318789f72489360ae0 Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestNetworkAdvancedServerOps-12473246-project Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b could not be found. Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '22e0adce-550d-45f3-9ecc-5e13d2258c5b'} Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b could not be found. Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b could not be found. Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:58:26.836925 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b could not be found. Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Returning 404 to user: Instance 22e0adce-550d-45f3-9ecc-5e13d2258c5b could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e5606e89-79d7-4c43-b438-96a4d0e29fe3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b" status: 404 len: 111 microversion: 2.1 time: 0.032187 Oct 11 20:58:26.842994 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3563/7179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:26 2022] GET /compute/v2.1/servers/22e0adce-550d-45f3-9ecc-5e13d2258c5b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:58:30.176172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d3d4c5e2-75f6-4999-929a-1ad8b3414c9a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '.version_select at 0x7f83c6ff8040>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:30.196729 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d3d4c5e2-75f6-4999-929a-1ad8b3414c9a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1152499287" status: 202 len: 0 microversion: 2.1 time: 0.025867 Oct 11 20:58:30.197315 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3617/7180] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Oct 11 20:58:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1152499287 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:58:30.229105 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-91e78346-eea6-4382-a420-e733f66bc908 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'create', calling method: .version_select at 0x7f83d0797790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-371890033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwFL3368MBx1UHVooK4vu8acZXURa5qT+7Px9nAmIoxYoIscIf4m97ayMRTpO6MweBMuK+aiqPbSSdN2fIu4XzpyH7Eh1feUrV6BXT03+0ECCGkGw2w4uO6XmRVe+k3qQ=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:58:30.246347 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-91e78346-eea6-4382-a420-e733f66bc908 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for project 693353fd79c44f7096de98d129f5a4d5. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:58:30.253841 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-91e78346-eea6-4382-a420-e733f66bc908 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for user 6bd83b65d6f74f318789f72489360ae0 and project 693353fd79c44f7096de98d129f5a4d5. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:58:30.278625 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-91e78346-eea6-4382-a420-e733f66bc908 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053369 Oct 11 20:58:30.279238 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3564/7181] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:58:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:58:35.734697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-762380061", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "networks": [{"uuid": "377b21bc-4a03-436f-8f55-531819d1047d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-371890033", "security_groups": [{"name": "tempest-secgroup-smoke-148518176"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:58:35.845837 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] validate_networks() for [('377b21bc-4a03-436f-8f55-531819d1047d', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:58:36.269337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:58:36.269897 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:58:36.270443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:58:36.270951 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:58:36.271436 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:58:36.287902 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:36.288659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:36.289955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:36.291065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:36.291707 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:36.292193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:36.312755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for project 693353fd79c44f7096de98d129f5a4d5. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:58:36.318799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Getting quotas for user 6bd83b65d6f74f318789f72489360ae0 and project 693353fd79c44f7096de98d129f5a4d5. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:58:36.333138 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:58:36.335642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:58:36.390961 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-52ce3c69-0dc1-4eb5-9540-ac1df6c20323 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.660792 Oct 11 20:58:36.392038 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3618/7182] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:58:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:58:36.407358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c24ae52b-db8e-491a-95e6-f2e625d7eeeb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:36.407989 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c24ae52b-db8e-491a-95e6-f2e625d7eeeb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:36.473551 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c24ae52b-db8e-491a-95e6-f2e625d7eeeb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:36.485808 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c24ae52b-db8e-491a-95e6-f2e625d7eeeb tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1265 microversion: 2.1 time: 0.085645 Oct 11 20:58:36.486762 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3565/7183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:36 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:37.511452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bca4f59c-2e2d-4600-ad56-ba0f42cda638 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:37.511980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bca4f59c-2e2d-4600-ad56-ba0f42cda638 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:37.521822 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bca4f59c-2e2d-4600-ad56-ba0f42cda638 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:37.522352 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bca4f59c-2e2d-4600-ad56-ba0f42cda638 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:37.523561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bca4f59c-2e2d-4600-ad56-ba0f42cda638 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:37.524411 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bca4f59c-2e2d-4600-ad56-ba0f42cda638 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:37.525090 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bca4f59c-2e2d-4600-ad56-ba0f42cda638 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:37.532279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bca4f59c-2e2d-4600-ad56-ba0f42cda638 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:37.651279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bca4f59c-2e2d-4600-ad56-ba0f42cda638 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:37.666172 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bca4f59c-2e2d-4600-ad56-ba0f42cda638 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1325 microversion: 2.1 time: 0.158093 Oct 11 20:58:37.668762 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3619/7184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:37 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:38.693763 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9b47e8fe-dacc-4d22-b0b7-2cb90ea62c8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:38.694417 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-9b47e8fe-dacc-4d22-b0b7-2cb90ea62c8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:38.696663 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:58:38.709875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b47e8fe-dacc-4d22-b0b7-2cb90ea62c8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:38.710635 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b47e8fe-dacc-4d22-b0b7-2cb90ea62c8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:38.711300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b47e8fe-dacc-4d22-b0b7-2cb90ea62c8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:38.712257 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b47e8fe-dacc-4d22-b0b7-2cb90ea62c8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:38.713030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b47e8fe-dacc-4d22-b0b7-2cb90ea62c8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:38.713614 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-9b47e8fe-dacc-4d22-b0b7-2cb90ea62c8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:38.956957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-9b47e8fe-dacc-4d22-b0b7-2cb90ea62c8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:38.966009 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9b47e8fe-dacc-4d22-b0b7-2cb90ea62c8e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1390 microversion: 2.1 time: 0.276460 Oct 11 20:58:38.967157 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3566/7185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:38 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1390 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:39.162233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f02af7f3-f5c0-4590-9542-2c8bba17c39d req-7f1af91f-dd50-4657-bdae-072c9b6f09fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b09be23-9246-4f3d-8b88-a60fec068818", "tag": "63786d19-cec2-40d1-b4a2-37cd918f887f"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:58:39.183744 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f02af7f3-f5c0-4590-9542-2c8bba17c39d req-7f1af91f-dd50-4657-bdae-072c9b6f09fc service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:39.183994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f02af7f3-f5c0-4590-9542-2c8bba17c39d req-7f1af91f-dd50-4657-bdae-072c9b6f09fc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:39.184426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f02af7f3-f5c0-4590-9542-2c8bba17c39d req-7f1af91f-dd50-4657-bdae-072c9b6f09fc service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:39.196461 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f02af7f3-f5c0-4590-9542-2c8bba17c39d req-7f1af91f-dd50-4657-bdae-072c9b6f09fc service nova] Creating event network-changed:63786d19-cec2-40d1-b4a2-37cd918f887f for instance 4b09be23-9246-4f3d-8b88-a60fec068818 on n-h2-860864-3 Oct 11 20:58:39.202539 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f02af7f3-f5c0-4590-9542-2c8bba17c39d req-7f1af91f-dd50-4657-bdae-072c9b6f09fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044794 Oct 11 20:58:39.203331 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3620/7186] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:58:39.992466 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c600f3c2-8f81-4fee-bf64-c01e709159e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:39.993092 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c600f3c2-8f81-4fee-bf64-c01e709159e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:39.999766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c600f3c2-8f81-4fee-bf64-c01e709159e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:40.000268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c600f3c2-8f81-4fee-bf64-c01e709159e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:40.000718 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c600f3c2-8f81-4fee-bf64-c01e709159e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:40.001424 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c600f3c2-8f81-4fee-bf64-c01e709159e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:40.001894 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c600f3c2-8f81-4fee-bf64-c01e709159e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:40.002332 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c600f3c2-8f81-4fee-bf64-c01e709159e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:40.133819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c600f3c2-8f81-4fee-bf64-c01e709159e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:40.141841 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c600f3c2-8f81-4fee-bf64-c01e709159e6 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1390 microversion: 2.1 time: 0.153573 Oct 11 20:58:40.142409 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3567/7187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:39 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:41.165027 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8e7b4f86-687b-4469-b21e-8cbd0be8760e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:41.165751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8e7b4f86-687b-4469-b21e-8cbd0be8760e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:41.172824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e7b4f86-687b-4469-b21e-8cbd0be8760e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:41.173297 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e7b4f86-687b-4469-b21e-8cbd0be8760e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:41.173728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e7b4f86-687b-4469-b21e-8cbd0be8760e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:41.174406 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e7b4f86-687b-4469-b21e-8cbd0be8760e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:41.174890 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e7b4f86-687b-4469-b21e-8cbd0be8760e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:41.175312 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e7b4f86-687b-4469-b21e-8cbd0be8760e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:41.304520 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e7b4f86-687b-4469-b21e-8cbd0be8760e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:41.312600 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8e7b4f86-687b-4469-b21e-8cbd0be8760e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1390 microversion: 2.1 time: 0.151771 Oct 11 20:58:41.313173 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3621/7188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:41 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:42.335930 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-be331482-4687-432b-8e1b-2e3d7009dabc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:42.336474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-be331482-4687-432b-8e1b-2e3d7009dabc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:42.344191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be331482-4687-432b-8e1b-2e3d7009dabc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:42.344705 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be331482-4687-432b-8e1b-2e3d7009dabc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:42.345159 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be331482-4687-432b-8e1b-2e3d7009dabc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:42.345867 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be331482-4687-432b-8e1b-2e3d7009dabc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:42.346341 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be331482-4687-432b-8e1b-2e3d7009dabc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:42.346819 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-be331482-4687-432b-8e1b-2e3d7009dabc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:42.481026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-be331482-4687-432b-8e1b-2e3d7009dabc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:42.489138 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-be331482-4687-432b-8e1b-2e3d7009dabc tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1390 microversion: 2.1 time: 0.157238 Oct 11 20:58:42.489708 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3568/7189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:42 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:43.511557 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-357ba566-b2b5-47e0-a721-a83a6303d529 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:43.512177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-357ba566-b2b5-47e0-a721-a83a6303d529 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:43.519709 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-357ba566-b2b5-47e0-a721-a83a6303d529 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:43.520196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-357ba566-b2b5-47e0-a721-a83a6303d529 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:43.520636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-357ba566-b2b5-47e0-a721-a83a6303d529 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:43.521330 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-357ba566-b2b5-47e0-a721-a83a6303d529 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:43.521788 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-357ba566-b2b5-47e0-a721-a83a6303d529 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:43.522214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-357ba566-b2b5-47e0-a721-a83a6303d529 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:43.662365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-357ba566-b2b5-47e0-a721-a83a6303d529 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:43.670151 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-357ba566-b2b5-47e0-a721-a83a6303d529 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1390 microversion: 2.1 time: 0.162516 Oct 11 20:58:43.670897 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3622/7190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:43 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:43.748339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-b5156d85-7d05-47e0-b550-7fb431213e96 req-6f5b9ed5-48b3-4dc9-ae46-6a4a0a323c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b09be23-9246-4f3d-8b88-a60fec068818", "name": "network-vif-plugged", "status": "completed", "tag": "63786d19-cec2-40d1-b4a2-37cd918f887f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:58:43.759582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b5156d85-7d05-47e0-b550-7fb431213e96 req-6f5b9ed5-48b3-4dc9-ae46-6a4a0a323c45 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:43.760053 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b5156d85-7d05-47e0-b550-7fb431213e96 req-6f5b9ed5-48b3-4dc9-ae46-6a4a0a323c45 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:43.760506 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-b5156d85-7d05-47e0-b550-7fb431213e96 req-6f5b9ed5-48b3-4dc9-ae46-6a4a0a323c45 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:43.771897 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-b5156d85-7d05-47e0-b550-7fb431213e96 req-6f5b9ed5-48b3-4dc9-ae46-6a4a0a323c45 service nova] Creating event network-vif-plugged:63786d19-cec2-40d1-b4a2-37cd918f887f for instance 4b09be23-9246-4f3d-8b88-a60fec068818 on n-h2-860864-3 Oct 11 20:58:43.776955 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-b5156d85-7d05-47e0-b550-7fb431213e96 req-6f5b9ed5-48b3-4dc9-ae46-6a4a0a323c45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032363 Oct 11 20:58:43.777554 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3569/7191] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:58:44.693922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b6581ff7-aca4-49e5-8724-e5369048fd05 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:44.694580 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b6581ff7-aca4-49e5-8724-e5369048fd05 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:44.702665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6581ff7-aca4-49e5-8724-e5369048fd05 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:44.703149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6581ff7-aca4-49e5-8724-e5369048fd05 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:44.703687 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6581ff7-aca4-49e5-8724-e5369048fd05 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:44.704519 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6581ff7-aca4-49e5-8724-e5369048fd05 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:44.705087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6581ff7-aca4-49e5-8724-e5369048fd05 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:44.705618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b6581ff7-aca4-49e5-8724-e5369048fd05 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:44.844086 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-b6581ff7-aca4-49e5-8724-e5369048fd05 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:44.851884 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b6581ff7-aca4-49e5-8724-e5369048fd05 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1390 microversion: 2.1 time: 0.161917 Oct 11 20:58:44.852473 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3623/7192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:44 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:45.876570 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1f4631da-a362-4e54-ae2c-7d18a82bd72d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:45.877324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1f4631da-a362-4e54-ae2c-7d18a82bd72d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:45.883607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f4631da-a362-4e54-ae2c-7d18a82bd72d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:45.884098 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f4631da-a362-4e54-ae2c-7d18a82bd72d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:45.884560 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f4631da-a362-4e54-ae2c-7d18a82bd72d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:45.885265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f4631da-a362-4e54-ae2c-7d18a82bd72d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:45.885737 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f4631da-a362-4e54-ae2c-7d18a82bd72d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:45.886178 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-1f4631da-a362-4e54-ae2c-7d18a82bd72d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:46.015888 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1f4631da-a362-4e54-ae2c-7d18a82bd72d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:46.023781 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1f4631da-a362-4e54-ae2c-7d18a82bd72d tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1562 microversion: 2.1 time: 0.152576 Oct 11 20:58:46.024630 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3570/7193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:45 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:46.047459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8d88e00f-157c-4ae2-a681-586461f31486 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:46.048077 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8d88e00f-157c-4ae2-a681-586461f31486 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:46.054703 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d88e00f-157c-4ae2-a681-586461f31486 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:46.055199 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d88e00f-157c-4ae2-a681-586461f31486 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:46.055642 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d88e00f-157c-4ae2-a681-586461f31486 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:46.056345 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d88e00f-157c-4ae2-a681-586461f31486 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:46.056807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d88e00f-157c-4ae2-a681-586461f31486 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:46.057233 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8d88e00f-157c-4ae2-a681-586461f31486 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:46.188222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8d88e00f-157c-4ae2-a681-586461f31486 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:46.195954 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8d88e00f-157c-4ae2-a681-586461f31486 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1562 microversion: 2.1 time: 0.153125 Oct 11 20:58:46.196553 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3624/7194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:46 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:58:47.776747 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-287e91fd-6004-475d-9131-80419748a360 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:58:47.777561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-287e91fd-6004-475d-9131-80419748a360 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:58:47.780335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-01522594-4eb8-463d-a459-2c15eb2e488b req-2cccdb11-d2f8-4348-a826-810e2fb3ab56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b09be23-9246-4f3d-8b88-a60fec068818", "tag": "63786d19-cec2-40d1-b4a2-37cd918f887f"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:58:47.783866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:58:47.785141 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:58:47.785853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:58:47.787213 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-287e91fd-6004-475d-9131-80419748a360 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:47.787380 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:58:47.788493 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-287e91fd-6004-475d-9131-80419748a360 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:47.789114 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-287e91fd-6004-475d-9131-80419748a360 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:47.790189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-287e91fd-6004-475d-9131-80419748a360 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:47.790968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-287e91fd-6004-475d-9131-80419748a360 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:47.791471 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-287e91fd-6004-475d-9131-80419748a360 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:47.791967 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-01522594-4eb8-463d-a459-2c15eb2e488b req-2cccdb11-d2f8-4348-a826-810e2fb3ab56 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:58:47.792448 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-01522594-4eb8-463d-a459-2c15eb2e488b req-2cccdb11-d2f8-4348-a826-810e2fb3ab56 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:58:47.792878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-01522594-4eb8-463d-a459-2c15eb2e488b req-2cccdb11-d2f8-4348-a826-810e2fb3ab56 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:58:47.799477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=49 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:58:47.806493 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-01522594-4eb8-463d-a459-2c15eb2e488b req-2cccdb11-d2f8-4348-a826-810e2fb3ab56 service nova] Creating event network-changed:63786d19-cec2-40d1-b4a2-37cd918f887f for instance 4b09be23-9246-4f3d-8b88-a60fec068818 on n-h2-860864-3 Oct 11 20:58:47.812854 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-01522594-4eb8-463d-a459-2c15eb2e488b req-2cccdb11-d2f8-4348-a826-810e2fb3ab56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038221 Oct 11 20:58:47.813463 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3625/7195] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:58:48.377202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-287e91fd-6004-475d-9131-80419748a360 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:58:48.385199 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-287e91fd-6004-475d-9131-80419748a360 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1562 microversion: 2.1 time: 0.612888 Oct 11 20:58:48.385839 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3571/7196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:58:47 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1562 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:09.627620 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:09.632340 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-b80e7d30-0d6e-4717-9ec6-c44987263b6a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:09.634623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-b80e7d30-0d6e-4717-9ec6-c44987263b6a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:09.643146 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80e7d30-0d6e-4717-9ec6-c44987263b6a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:09.643638 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80e7d30-0d6e-4717-9ec6-c44987263b6a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:09.644079 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80e7d30-0d6e-4717-9ec6-c44987263b6a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:09.644772 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80e7d30-0d6e-4717-9ec6-c44987263b6a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:09.645231 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80e7d30-0d6e-4717-9ec6-c44987263b6a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:09.645656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-b80e7d30-0d6e-4717-9ec6-c44987263b6a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:09.697811 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-b80e7d30-0d6e-4717-9ec6-c44987263b6a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818/action" status: 200 len: 24560 microversion: 2.1 time: 0.071723 Oct 11 20:59:09.698448 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3626/7197] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:59:09 2022] POST /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818/action => generated 24560 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:59:20.774753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-38097bc5-86b5-4be4-941d-44a5df61b36a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:20.775380 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-38097bc5-86b5-4be4-941d-44a5df61b36a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:20.777284 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:20.778145 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=32 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:20.784319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38097bc5-86b5-4be4-941d-44a5df61b36a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:20.784823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38097bc5-86b5-4be4-941d-44a5df61b36a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:20.785273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38097bc5-86b5-4be4-941d-44a5df61b36a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:20.785976 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38097bc5-86b5-4be4-941d-44a5df61b36a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:20.786447 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38097bc5-86b5-4be4-941d-44a5df61b36a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:20.786908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-38097bc5-86b5-4be4-941d-44a5df61b36a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:20.811406 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-38097bc5-86b5-4be4-941d-44a5df61b36a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lazy-loading 'flavor' on Instance uuid 4b09be23-9246-4f3d-8b88-a60fec068818 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:59:20.876063 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-38097bc5-86b5-4be4-941d-44a5df61b36a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818/action" status: 202 len: 0 microversion: 2.1 time: 0.105370 Oct 11 20:59:20.876718 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3572/7198] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:59:20 2022] POST /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:59:20.885665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0300aac3-1262-426f-8886-999e4167a890 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:20.886392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0300aac3-1262-426f-8886-999e4167a890 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:20.889698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:20.890339 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=4 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:20.895801 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0300aac3-1262-426f-8886-999e4167a890 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:20.896292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0300aac3-1262-426f-8886-999e4167a890 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:20.896723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0300aac3-1262-426f-8886-999e4167a890 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:20.897453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0300aac3-1262-426f-8886-999e4167a890 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:20.897915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0300aac3-1262-426f-8886-999e4167a890 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:20.898335 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0300aac3-1262-426f-8886-999e4167a890 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:21.036160 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0300aac3-1262-426f-8886-999e4167a890 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:21.043762 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0300aac3-1262-426f-8886-999e4167a890 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1689 microversion: 2.1 time: 0.162422 Oct 11 20:59:21.044352 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3627/7199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:20 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:22.069603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-39651d5d-78bd-48ce-b04e-d5a61d107853 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:22.070245 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-39651d5d-78bd-48ce-b04e-d5a61d107853 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:22.077242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39651d5d-78bd-48ce-b04e-d5a61d107853 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:22.077914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39651d5d-78bd-48ce-b04e-d5a61d107853 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:22.078230 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39651d5d-78bd-48ce-b04e-d5a61d107853 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:22.078983 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39651d5d-78bd-48ce-b04e-d5a61d107853 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:22.079460 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39651d5d-78bd-48ce-b04e-d5a61d107853 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:22.079904 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-39651d5d-78bd-48ce-b04e-d5a61d107853 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:22.212765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-39651d5d-78bd-48ce-b04e-d5a61d107853 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:22.221595 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-39651d5d-78bd-48ce-b04e-d5a61d107853 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1672 microversion: 2.1 time: 0.157265 Oct 11 20:59:22.222171 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3573/7200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:22 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:23.318111 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-16648cc3-b8f5-40c7-afa1-2dd57cfd847a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:23.320306 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-16648cc3-b8f5-40c7-afa1-2dd57cfd847a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:23.328603 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16648cc3-b8f5-40c7-afa1-2dd57cfd847a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:23.329112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16648cc3-b8f5-40c7-afa1-2dd57cfd847a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:23.329548 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16648cc3-b8f5-40c7-afa1-2dd57cfd847a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:23.330227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16648cc3-b8f5-40c7-afa1-2dd57cfd847a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:23.330702 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16648cc3-b8f5-40c7-afa1-2dd57cfd847a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:23.331129 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-16648cc3-b8f5-40c7-afa1-2dd57cfd847a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:23.381026 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-16648cc3-b8f5-40c7-afa1-2dd57cfd847a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818/action" status: 200 len: 38375 microversion: 2.1 time: 0.066624 Oct 11 20:59:23.381664 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3628/7201] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:59:23 2022] POST /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818/action => generated 38375 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:59:23.394070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-75306cb2-8e43-4d6f-97e1-da1635875e11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:23.394658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-75306cb2-8e43-4d6f-97e1-da1635875e11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:23.401539 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75306cb2-8e43-4d6f-97e1-da1635875e11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:23.402042 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75306cb2-8e43-4d6f-97e1-da1635875e11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:23.402500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75306cb2-8e43-4d6f-97e1-da1635875e11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:23.403237 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75306cb2-8e43-4d6f-97e1-da1635875e11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:23.404426 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75306cb2-8e43-4d6f-97e1-da1635875e11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:23.404911 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-75306cb2-8e43-4d6f-97e1-da1635875e11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:23.472651 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-75306cb2-8e43-4d6f-97e1-da1635875e11 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818/action" status: 202 len: 0 microversion: 2.1 time: 0.082307 Oct 11 20:59:23.473306 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3574/7202] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:59:23 2022] POST /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:59:23.482365 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e03ee334-53c8-4357-86fa-04f91ca25820 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:23.483106 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e03ee334-53c8-4357-86fa-04f91ca25820 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:23.490284 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e03ee334-53c8-4357-86fa-04f91ca25820 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:23.490759 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e03ee334-53c8-4357-86fa-04f91ca25820 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:23.491195 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e03ee334-53c8-4357-86fa-04f91ca25820 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:23.491955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e03ee334-53c8-4357-86fa-04f91ca25820 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:23.492420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e03ee334-53c8-4357-86fa-04f91ca25820 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:23.492838 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e03ee334-53c8-4357-86fa-04f91ca25820 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:23.722975 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e03ee334-53c8-4357-86fa-04f91ca25820 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:23.730553 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e03ee334-53c8-4357-86fa-04f91ca25820 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1678 microversion: 2.1 time: 0.252629 Oct 11 20:59:23.731127 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3629/7203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:23 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:24.755339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f63ca40f-32cc-432e-9694-31b8908651ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:24.756001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f63ca40f-32cc-432e-9694-31b8908651ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:24.762236 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f63ca40f-32cc-432e-9694-31b8908651ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:24.762808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f63ca40f-32cc-432e-9694-31b8908651ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:24.764001 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f63ca40f-32cc-432e-9694-31b8908651ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:24.764729 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f63ca40f-32cc-432e-9694-31b8908651ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:24.765277 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f63ca40f-32cc-432e-9694-31b8908651ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:24.765669 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f63ca40f-32cc-432e-9694-31b8908651ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:24.923701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f63ca40f-32cc-432e-9694-31b8908651ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:24.931794 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f63ca40f-32cc-432e-9694-31b8908651ea tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1678 microversion: 2.1 time: 0.181662 Oct 11 20:59:24.932605 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3575/7204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:24 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:25.956827 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d4e3f3c4-787e-4c14-845d-bc62222dc716 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:25.957377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d4e3f3c4-787e-4c14-845d-bc62222dc716 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:25.968131 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4e3f3c4-787e-4c14-845d-bc62222dc716 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:25.968640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4e3f3c4-787e-4c14-845d-bc62222dc716 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:25.969078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4e3f3c4-787e-4c14-845d-bc62222dc716 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:25.969910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4e3f3c4-787e-4c14-845d-bc62222dc716 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:25.970371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4e3f3c4-787e-4c14-845d-bc62222dc716 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:25.970826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d4e3f3c4-787e-4c14-845d-bc62222dc716 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:26.102389 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-d4e3f3c4-787e-4c14-845d-bc62222dc716 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:26.111192 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d4e3f3c4-787e-4c14-845d-bc62222dc716 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1681 microversion: 2.1 time: 0.158352 Oct 11 20:59:26.111772 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3630/7205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:25 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:26.206306 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-80fb812c-b0c2-4d31-b59c-79a9dcc82506 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:26.208672 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-80fb812c-b0c2-4d31-b59c-79a9dcc82506 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:26.215721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80fb812c-b0c2-4d31-b59c-79a9dcc82506 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:26.216223 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80fb812c-b0c2-4d31-b59c-79a9dcc82506 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:26.216676 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80fb812c-b0c2-4d31-b59c-79a9dcc82506 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:26.218003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80fb812c-b0c2-4d31-b59c-79a9dcc82506 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:26.218470 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80fb812c-b0c2-4d31-b59c-79a9dcc82506 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:26.218961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-80fb812c-b0c2-4d31-b59c-79a9dcc82506 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:26.259596 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-80fb812c-b0c2-4d31-b59c-79a9dcc82506 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "POST /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818/action" status: 200 len: 38375 microversion: 2.1 time: 0.057878 Oct 11 20:59:26.260377 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3576/7206] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 20:59:26 2022] POST /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818/action => generated 38375 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 20:59:27.237308 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-68ff99d5-0fe8-4c8b-b0b8-059f0e56ed76 req-52e3690a-625b-43e0-898d-292cc419bc20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b09be23-9246-4f3d-8b88-a60fec068818", "tag": "63786d19-cec2-40d1-b4a2-37cd918f887f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:27.237948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-66586047-4c2e-48a8-971c-ef5b0077ec01 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:27.238313 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-66586047-4c2e-48a8-971c-ef5b0077ec01 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:27.249684 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-68ff99d5-0fe8-4c8b-b0b8-059f0e56ed76 req-52e3690a-625b-43e0-898d-292cc419bc20 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:27.249932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66586047-4c2e-48a8-971c-ef5b0077ec01 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:27.250424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66586047-4c2e-48a8-971c-ef5b0077ec01 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:27.250603 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-68ff99d5-0fe8-4c8b-b0b8-059f0e56ed76 req-52e3690a-625b-43e0-898d-292cc419bc20 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:27.251078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-68ff99d5-0fe8-4c8b-b0b8-059f0e56ed76 req-52e3690a-625b-43e0-898d-292cc419bc20 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:27.251527 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66586047-4c2e-48a8-971c-ef5b0077ec01 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:27.252232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66586047-4c2e-48a8-971c-ef5b0077ec01 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:27.252688 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66586047-4c2e-48a8-971c-ef5b0077ec01 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:27.253103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-66586047-4c2e-48a8-971c-ef5b0077ec01 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:27.264726 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-68ff99d5-0fe8-4c8b-b0b8-059f0e56ed76 req-52e3690a-625b-43e0-898d-292cc419bc20 service nova] Creating event network-changed:63786d19-cec2-40d1-b4a2-37cd918f887f for instance 4b09be23-9246-4f3d-8b88-a60fec068818 on n-h2-860864-3 Oct 11 20:59:27.269963 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-68ff99d5-0fe8-4c8b-b0b8-059f0e56ed76 req-52e3690a-625b-43e0-898d-292cc419bc20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036738 Oct 11 20:59:27.271368 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3577/7207] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:59:27.290553 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-66586047-4c2e-48a8-971c-ef5b0077ec01 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 20:59:27.369215 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-66586047-4c2e-48a8-971c-ef5b0077ec01 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 204 len: 0 microversion: 2.1 time: 0.138585 Oct 11 20:59:27.369724 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3631/7208] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 20:59:27 2022] DELETE /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 20:59:27.378940 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-687821a1-bed3-489a-97e7-8c5a1d106145 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:27.379655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-687821a1-bed3-489a-97e7-8c5a1d106145 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:27.385882 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-687821a1-bed3-489a-97e7-8c5a1d106145 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:27.386376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-687821a1-bed3-489a-97e7-8c5a1d106145 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:27.386846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-687821a1-bed3-489a-97e7-8c5a1d106145 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:27.387547 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-687821a1-bed3-489a-97e7-8c5a1d106145 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:27.388014 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-687821a1-bed3-489a-97e7-8c5a1d106145 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:27.388444 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-687821a1-bed3-489a-97e7-8c5a1d106145 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:27.564141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-687821a1-bed3-489a-97e7-8c5a1d106145 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:27.571936 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-687821a1-bed3-489a-97e7-8c5a1d106145 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1687 microversion: 2.1 time: 0.197664 Oct 11 20:59:27.572772 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3578/7209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:27 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:28.598142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0e05b2ab-b9d4-4b79-82ce-4c037e61c73e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:28.598868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0e05b2ab-b9d4-4b79-82ce-4c037e61c73e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:28.605988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e05b2ab-b9d4-4b79-82ce-4c037e61c73e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:28.606466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e05b2ab-b9d4-4b79-82ce-4c037e61c73e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:28.606926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e05b2ab-b9d4-4b79-82ce-4c037e61c73e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:28.607706 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e05b2ab-b9d4-4b79-82ce-4c037e61c73e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:28.608158 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e05b2ab-b9d4-4b79-82ce-4c037e61c73e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:28.608574 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0e05b2ab-b9d4-4b79-82ce-4c037e61c73e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:28.792125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0e05b2ab-b9d4-4b79-82ce-4c037e61c73e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:28.799868 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0e05b2ab-b9d4-4b79-82ce-4c037e61c73e tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1687 microversion: 2.1 time: 0.205978 Oct 11 20:59:28.800455 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3632/7210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:28 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1687 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:59:29.427901 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-f244c317-f534-46c5-9d41-65a674142c9f req-ad44c4d5-cba7-4144-b757-abe00b105da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b09be23-9246-4f3d-8b88-a60fec068818", "name": "network-vif-deleted", "tag": "63786d19-cec2-40d1-b4a2-37cd918f887f"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:29.442552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f244c317-f534-46c5-9d41-65a674142c9f req-ad44c4d5-cba7-4144-b757-abe00b105da0 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:29.443046 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f244c317-f534-46c5-9d41-65a674142c9f req-ad44c4d5-cba7-4144-b757-abe00b105da0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:29.443794 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-f244c317-f534-46c5-9d41-65a674142c9f req-ad44c4d5-cba7-4144-b757-abe00b105da0 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:29.457829 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-f244c317-f534-46c5-9d41-65a674142c9f req-ad44c4d5-cba7-4144-b757-abe00b105da0 service nova] Creating event network-vif-deleted:63786d19-cec2-40d1-b4a2-37cd918f887f for instance 4b09be23-9246-4f3d-8b88-a60fec068818 on n-h2-860864-3 Oct 11 20:59:29.462802 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-f244c317-f534-46c5-9d41-65a674142c9f req-ad44c4d5-cba7-4144-b757-abe00b105da0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038737 Oct 11 20:59:29.464154 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3579/7211] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:59:29.824083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:29.824969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:29.832140 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:29.832648 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:29.833093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:29.833799 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:29.834257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:29.835142 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:29.875973 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:29.876468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:29.876943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:29.877419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lazy-loading 'fault' on Instance uuid 4b09be23-9246-4f3d-8b88-a60fec068818 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 20:59:29.918609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd83b65d6f74f318789f72489360ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693353fd79c44f7096de98d129f5a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:29.927177 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-072ccf36-784f-4d56-9bbe-413c823ddee3 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 200 len: 1355 microversion: 2.1 time: 0.107427 Oct 11 20:59:29.927746 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3633/7212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:29 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 20:59:30.953266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:30.953996 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] [instance: 4b09be23-9246-4f3d-8b88-a60fec068818] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:30.961313 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:30.961821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:30.962286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:30.963026 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:30.963510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:30.963960 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:30.977370 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] HTTP exception thrown: Instance 4b09be23-9246-4f3d-8b88-a60fec068818 could not be found. Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Request method failure captured: Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 HTTP/1.1 Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRddoIKtCVfSl774yn2xn7Qwnt599GHfMXalig3PUzq5omWaNff4YHi7MbpPV_fIPfUzLi7i1jjXXhgstitRfWU8K243zHcU7o-4P8OY-APzkTzDgxCpVfGU1KIczEjMXMUNg6ICKw71ZhYA7yZ8Jcfl4ZeENLZ5eO3t4F1eHqKBqftA Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 693353fd79c44f7096de98d129f5a4d5 Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/693353fd79c44f7096de98d129f5a4d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_693353fd79c44f7096de98d129f5a4d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/693353fd79c44f7096de98d129f5a4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/693353fd79c44f7096de98d129f5a4d5"}]}] Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 693353fd79c44f7096de98d129f5a4d5 Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-12473246 Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestNetworkAdvancedServerOps-12473246-project Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: 6bd83b65d6f74f318789f72489360ae0 Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestNetworkAdvancedServerOps-12473246-project Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 4b09be23-9246-4f3d-8b88-a60fec068818 could not be found. Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '4b09be23-9246-4f3d-8b88-a60fec068818'} Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b09be23-9246-4f3d-8b88-a60fec068818 could not be found. Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b09be23-9246-4f3d-8b88-a60fec068818 could not be found. Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:59:30.979075 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b09be23-9246-4f3d-8b88-a60fec068818 could not be found. Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Returning 404 to user: Instance 4b09be23-9246-4f3d-8b88-a60fec068818 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-90550d77-eca9-432f-8429-c67638bf14d9 tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818" status: 404 len: 111 microversion: 2.1 time: 0.032540 Oct 11 20:59:30.983916 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3580/7213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:30 2022] GET /compute/v2.1/servers/4b09be23-9246-4f3d-8b88-a60fec068818 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 20:59:34.378261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9f0911dd-49a4-4c16-a01b-f2259eebb71a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] Calling method '.version_select at 0x7f83c70fc310>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:34.399704 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9f0911dd-49a4-4c16-a01b-f2259eebb71a tempest-TestNetworkAdvancedServerOps-12473246 tempest-TestNetworkAdvancedServerOps-12473246-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-371890033" status: 202 len: 0 microversion: 2.1 time: 0.025237 Oct 11 20:59:34.403690 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3634/7214] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 11 20:59:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-371890033 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 20:59:45.244647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=18 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:45.245433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:45.476787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a45b8de-229e-4dee-b0fb-30b82a68e405 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Action: 'create', calling method: .version_select at 0x7f83d0721820>, body: {"keypair": {"name": "tempest-TestShelveInstance-5414775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwM0WzT+blNMyryB9Cs01fx6AlicEV+zt2qe1vOrArb1FbLyavHRSJhQpn+EBeoaucQJgYQF//yqVJP9KhNHSH8OcOFEcwuCK4uzVc6ohy1e/PobJhmh1epdi6fsv5Lkg=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:45.498118 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9a45b8de-229e-4dee-b0fb-30b82a68e405 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Getting quotas for project 80eacc78b786442e8c79ec2fd43b7f1b. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:59:45.506917 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9a45b8de-229e-4dee-b0fb-30b82a68e405 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Getting quotas for user fb01b4039873414cb0c642504ec975a5 and project 80eacc78b786442e8c79ec2fd43b7f1b. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:59:45.541671 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a45b8de-229e-4dee-b0fb-30b82a68e405 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.302579 Oct 11 20:59:45.542643 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3581/7215] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 20:59:45 2022] POST /compute/v2.1/os-keypairs => generated 394 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:59:46.553985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:46.554887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:46.558861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2006930197", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-5414775", "security_groups": [{"name": "tempest-secgroup-smoke-321507979"}], "networks": [{"uuid": "36d2cefc-5398-4ada-b7cc-d6b1ca9800e0"}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:46.671171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] validate_networks() for [('36d2cefc-5398-4ada-b7cc-d6b1ca9800e0', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 20:59:47.057785 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 20:59:47.058240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 20:59:47.058774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 20:59:47.059176 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 20:59:47.059591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 20:59:47.069327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:47.069812 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:47.070248 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:47.071018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:47.071480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:47.071907 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:47.090738 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Getting quotas for project 80eacc78b786442e8c79ec2fd43b7f1b. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 20:59:47.096404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Getting quotas for user fb01b4039873414cb0c642504ec975a5 and project 80eacc78b786442e8c79ec2fd43b7f1b. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 20:59:47.109854 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 20:59:47.112374 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 20:59:47.159581 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-492a459b-9e4e-4610-b7c3-a2d494f29f2e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.607286 Oct 11 20:59:47.160230 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3635/7216] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 20:59:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 20:59:47.173266 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-1e2f4b54-9802-4e39-8971-541db34479d1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:47.174080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-1e2f4b54-9802-4e39-8971-541db34479d1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:47.244045 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-1e2f4b54-9802-4e39-8971-541db34479d1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:47.253473 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-1e2f4b54-9802-4e39-8971-541db34479d1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1244 microversion: 2.1 time: 0.085627 Oct 11 20:59:47.254301 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3582/7217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:47 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:48.277300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1df48d7-b8a3-43b3-bd40-596680159452 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:48.278071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1df48d7-b8a3-43b3-bd40-596680159452 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:48.285768 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1df48d7-b8a3-43b3-bd40-596680159452 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:48.286255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1df48d7-b8a3-43b3-bd40-596680159452 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:48.286736 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1df48d7-b8a3-43b3-bd40-596680159452 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:48.287552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1df48d7-b8a3-43b3-bd40-596680159452 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:48.288191 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1df48d7-b8a3-43b3-bd40-596680159452 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:48.289269 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1df48d7-b8a3-43b3-bd40-596680159452 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:48.397075 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f1df48d7-b8a3-43b3-bd40-596680159452 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:48.410461 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1df48d7-b8a3-43b3-bd40-596680159452 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1304 microversion: 2.1 time: 0.137845 Oct 11 20:59:48.411433 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3636/7218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:48 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:49.435040 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-d5304fa4-c39d-4b47-902d-df7f7d54fd50 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:49.436041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-d5304fa4-c39d-4b47-902d-df7f7d54fd50 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:49.443849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5304fa4-c39d-4b47-902d-df7f7d54fd50 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:49.444358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5304fa4-c39d-4b47-902d-df7f7d54fd50 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:49.444813 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5304fa4-c39d-4b47-902d-df7f7d54fd50 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:49.445687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5304fa4-c39d-4b47-902d-df7f7d54fd50 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:49.446339 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5304fa4-c39d-4b47-902d-df7f7d54fd50 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:49.446765 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-d5304fa4-c39d-4b47-902d-df7f7d54fd50 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:49.674923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-d5304fa4-c39d-4b47-902d-df7f7d54fd50 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:49.684086 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-d5304fa4-c39d-4b47-902d-df7f7d54fd50 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1369 microversion: 2.1 time: 0.252795 Oct 11 20:59:49.685800 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3583/7219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:49 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1369 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:49.931851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-f8e6928b-42dd-403e-98b0-f9a6fc669e6b req-ca9fdfbf-329a-4023-9599-d2e7455d0e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a6da0ae-48d1-49c8-a62d-bea672976db2", "tag": "c6cc3bf6-3781-48c1-af4c-062096f6490d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:49.944207 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f8e6928b-42dd-403e-98b0-f9a6fc669e6b req-ca9fdfbf-329a-4023-9599-d2e7455d0e10 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:49.944708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f8e6928b-42dd-403e-98b0-f9a6fc669e6b req-ca9fdfbf-329a-4023-9599-d2e7455d0e10 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:49.945161 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-f8e6928b-42dd-403e-98b0-f9a6fc669e6b req-ca9fdfbf-329a-4023-9599-d2e7455d0e10 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:49.957096 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-f8e6928b-42dd-403e-98b0-f9a6fc669e6b req-ca9fdfbf-329a-4023-9599-d2e7455d0e10 service nova] Creating event network-changed:c6cc3bf6-3781-48c1-af4c-062096f6490d for instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 on n-h1-860864-3 Oct 11 20:59:49.961867 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-f8e6928b-42dd-403e-98b0-f9a6fc669e6b req-ca9fdfbf-329a-4023-9599-d2e7455d0e10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034162 Oct 11 20:59:49.962461 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3637/7220] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:59:50.709699 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bb0009e3-e089-42de-865c-ee6da71ae300 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:50.710369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bb0009e3-e089-42de-865c-ee6da71ae300 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:50.718302 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb0009e3-e089-42de-865c-ee6da71ae300 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:50.718820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb0009e3-e089-42de-865c-ee6da71ae300 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:50.719275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb0009e3-e089-42de-865c-ee6da71ae300 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:50.719973 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb0009e3-e089-42de-865c-ee6da71ae300 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:50.720441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb0009e3-e089-42de-865c-ee6da71ae300 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:50.720875 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bb0009e3-e089-42de-865c-ee6da71ae300 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:50.858950 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bb0009e3-e089-42de-865c-ee6da71ae300 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:50.866838 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bb0009e3-e089-42de-865c-ee6da71ae300 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1369 microversion: 2.1 time: 0.160975 Oct 11 20:59:50.867427 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3584/7221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:50 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:51.890716 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-21477d28-a5c7-4df4-85ef-91061c2a862f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:51.891308 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-21477d28-a5c7-4df4-85ef-91061c2a862f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:51.897420 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21477d28-a5c7-4df4-85ef-91061c2a862f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:51.897895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21477d28-a5c7-4df4-85ef-91061c2a862f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:51.898327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21477d28-a5c7-4df4-85ef-91061c2a862f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:51.899025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21477d28-a5c7-4df4-85ef-91061c2a862f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:51.899475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21477d28-a5c7-4df4-85ef-91061c2a862f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:51.899892 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-21477d28-a5c7-4df4-85ef-91061c2a862f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:52.032419 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-21477d28-a5c7-4df4-85ef-91061c2a862f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:52.040188 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-21477d28-a5c7-4df4-85ef-91061c2a862f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1369 microversion: 2.1 time: 0.154702 Oct 11 20:59:52.040760 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3638/7222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:51 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:53.063908 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-622a5c09-2915-4c5f-8122-bd8146c124c1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:53.064541 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-622a5c09-2915-4c5f-8122-bd8146c124c1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:53.071500 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622a5c09-2915-4c5f-8122-bd8146c124c1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:53.072007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622a5c09-2915-4c5f-8122-bd8146c124c1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:53.072464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622a5c09-2915-4c5f-8122-bd8146c124c1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:53.073437 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622a5c09-2915-4c5f-8122-bd8146c124c1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:53.073912 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622a5c09-2915-4c5f-8122-bd8146c124c1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:53.074359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-622a5c09-2915-4c5f-8122-bd8146c124c1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:53.206101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-622a5c09-2915-4c5f-8122-bd8146c124c1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:53.213964 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-622a5c09-2915-4c5f-8122-bd8146c124c1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1369 microversion: 2.1 time: 0.154588 Oct 11 20:59:53.214615 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3585/7223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:53 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:54.238189 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7a5e00ce-4a86-46b8-81c9-e7e2f0b50f35 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:54.238825 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7a5e00ce-4a86-46b8-81c9-e7e2f0b50f35 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:54.245723 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a5e00ce-4a86-46b8-81c9-e7e2f0b50f35 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:54.246175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a5e00ce-4a86-46b8-81c9-e7e2f0b50f35 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:54.246640 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a5e00ce-4a86-46b8-81c9-e7e2f0b50f35 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:54.247334 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a5e00ce-4a86-46b8-81c9-e7e2f0b50f35 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:54.247938 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a5e00ce-4a86-46b8-81c9-e7e2f0b50f35 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:54.248206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7a5e00ce-4a86-46b8-81c9-e7e2f0b50f35 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:54.386926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7a5e00ce-4a86-46b8-81c9-e7e2f0b50f35 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:54.395940 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7a5e00ce-4a86-46b8-81c9-e7e2f0b50f35 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1369 microversion: 2.1 time: 0.162972 Oct 11 20:59:54.396512 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3639/7224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:54 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:55.419247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ed3021a1-e472-4d57-9608-54c3428ee23b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:55.419780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ed3021a1-e472-4d57-9608-54c3428ee23b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:55.427555 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed3021a1-e472-4d57-9608-54c3428ee23b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:55.428054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed3021a1-e472-4d57-9608-54c3428ee23b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:55.428503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed3021a1-e472-4d57-9608-54c3428ee23b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:55.429233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed3021a1-e472-4d57-9608-54c3428ee23b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:55.429704 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed3021a1-e472-4d57-9608-54c3428ee23b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:55.430143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ed3021a1-e472-4d57-9608-54c3428ee23b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:55.567294 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ed3021a1-e472-4d57-9608-54c3428ee23b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:55.575293 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ed3021a1-e472-4d57-9608-54c3428ee23b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1369 microversion: 2.1 time: 0.160027 Oct 11 20:59:55.575884 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3586/7225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:55 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:56.435349 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-cdcc9657-988d-4f2e-9136-adbc979c442f req-7a8e6de4-40b5-42e2-b0a9-e4d75177fcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a6da0ae-48d1-49c8-a62d-bea672976db2", "name": "network-vif-plugged", "status": "completed", "tag": "c6cc3bf6-3781-48c1-af4c-062096f6490d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 20:59:56.447282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cdcc9657-988d-4f2e-9136-adbc979c442f req-7a8e6de4-40b5-42e2-b0a9-e4d75177fcb9 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:56.448859 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cdcc9657-988d-4f2e-9136-adbc979c442f req-7a8e6de4-40b5-42e2-b0a9-e4d75177fcb9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:56.449303 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-cdcc9657-988d-4f2e-9136-adbc979c442f req-7a8e6de4-40b5-42e2-b0a9-e4d75177fcb9 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:56.461156 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-cdcc9657-988d-4f2e-9136-adbc979c442f req-7a8e6de4-40b5-42e2-b0a9-e4d75177fcb9 service nova] Creating event network-vif-plugged:c6cc3bf6-3781-48c1-af4c-062096f6490d for instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 on n-h1-860864-3 Oct 11 20:59:56.466778 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-cdcc9657-988d-4f2e-9136-adbc979c442f req-7a8e6de4-40b5-42e2-b0a9-e4d75177fcb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035264 Oct 11 20:59:56.467382 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3640/7226] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 20:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 20:59:56.598275 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5ddaafe9-ea25-4aef-92ef-2370a08ffb47 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:56.598968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5ddaafe9-ea25-4aef-92ef-2370a08ffb47 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:56.606155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ddaafe9-ea25-4aef-92ef-2370a08ffb47 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:56.606707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ddaafe9-ea25-4aef-92ef-2370a08ffb47 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:56.607173 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ddaafe9-ea25-4aef-92ef-2370a08ffb47 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:56.607898 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ddaafe9-ea25-4aef-92ef-2370a08ffb47 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:56.608376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ddaafe9-ea25-4aef-92ef-2370a08ffb47 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:56.608825 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5ddaafe9-ea25-4aef-92ef-2370a08ffb47 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:57.058655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5ddaafe9-ea25-4aef-92ef-2370a08ffb47 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:57.067692 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5ddaafe9-ea25-4aef-92ef-2370a08ffb47 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1369 microversion: 2.1 time: 0.474040 Oct 11 20:59:57.068268 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3587/7227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:56 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1369 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:58.092206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6630f96b-f3a0-49a3-a2a9-32fc317c6687 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:58.092966 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6630f96b-f3a0-49a3-a2a9-32fc317c6687 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:58.095431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:58.096229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:58.105310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6630f96b-f3a0-49a3-a2a9-32fc317c6687 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:58.105826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6630f96b-f3a0-49a3-a2a9-32fc317c6687 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:58.106282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6630f96b-f3a0-49a3-a2a9-32fc317c6687 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:58.106994 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6630f96b-f3a0-49a3-a2a9-32fc317c6687 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:58.107449 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6630f96b-f3a0-49a3-a2a9-32fc317c6687 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:58.107871 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6630f96b-f3a0-49a3-a2a9-32fc317c6687 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:58.240451 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6630f96b-f3a0-49a3-a2a9-32fc317c6687 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:58.248311 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6630f96b-f3a0-49a3-a2a9-32fc317c6687 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1553 microversion: 2.1 time: 0.160387 Oct 11 20:59:58.248889 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3641/7228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:58 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 20:59:58.271147 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f33d026f-d7f4-41bf-b2f9-9ffb9a882a66 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 20:59:58.271780 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f33d026f-d7f4-41bf-b2f9-9ffb9a882a66 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 20:59:58.273639 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=6 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 20:59:58.279709 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f33d026f-d7f4-41bf-b2f9-9ffb9a882a66 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:58.280214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f33d026f-d7f4-41bf-b2f9-9ffb9a882a66 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:58.280668 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f33d026f-d7f4-41bf-b2f9-9ffb9a882a66 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:58.281438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f33d026f-d7f4-41bf-b2f9-9ffb9a882a66 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 20:59:58.281914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f33d026f-d7f4-41bf-b2f9-9ffb9a882a66 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 20:59:58.282357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f33d026f-d7f4-41bf-b2f9-9ffb9a882a66 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 20:59:58.414869 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f33d026f-d7f4-41bf-b2f9-9ffb9a882a66 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 20:59:58.423438 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f33d026f-d7f4-41bf-b2f9-9ffb9a882a66 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1553 microversion: 2.1 time: 0.156007 Oct 11 20:59:58.424043 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3588/7229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 20:59:58 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 21:00:00.081941 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-98552226-2ef9-4e89-b938-f5296cafea49 req-b510b090-8967-4a81-8828-5fe50fc5c74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a6da0ae-48d1-49c8-a62d-bea672976db2", "tag": "c6cc3bf6-3781-48c1-af4c-062096f6490d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:00:00.092939 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-98552226-2ef9-4e89-b938-f5296cafea49 req-b510b090-8967-4a81-8828-5fe50fc5c74f service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:00:00.093430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-98552226-2ef9-4e89-b938-f5296cafea49 req-b510b090-8967-4a81-8828-5fe50fc5c74f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:00:00.093898 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-98552226-2ef9-4e89-b938-f5296cafea49 req-b510b090-8967-4a81-8828-5fe50fc5c74f service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:00:00.105047 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-98552226-2ef9-4e89-b938-f5296cafea49 req-b510b090-8967-4a81-8828-5fe50fc5c74f service nova] Creating event network-changed:c6cc3bf6-3781-48c1-af4c-062096f6490d for instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 on n-h1-860864-3 Oct 11 21:00:00.110107 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-98552226-2ef9-4e89-b938-f5296cafea49 req-b510b090-8967-4a81-8828-5fe50fc5c74f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032849 Oct 11 21:00:00.110756 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3642/7230] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:01:57.419440 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 21:01:57.420011 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 21:01:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2/action (ip 10.222.0.27) !!! Oct 11 21:01:57.420790 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 21:01:57.420911 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 21:01:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2/action (ip 10.222.0.27) !!! Oct 11 21:01:57.421814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:01:57.422650 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=36 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:01:57.427050 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-67895d89-e615-417c-856c-ea7b65a11f06 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:01:57.427602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-67895d89-e615-417c-856c-ea7b65a11f06 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:01:57.436881 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67895d89-e615-417c-856c-ea7b65a11f06 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:01:57.437391 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67895d89-e615-417c-856c-ea7b65a11f06 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:01:57.437852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67895d89-e615-417c-856c-ea7b65a11f06 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:01:57.438661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67895d89-e615-417c-856c-ea7b65a11f06 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:01:57.439141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67895d89-e615-417c-856c-ea7b65a11f06 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:01:57.439583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-67895d89-e615-417c-856c-ea7b65a11f06 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:01:57.464918 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.objects.instance [None req-67895d89-e615-417c-856c-ea7b65a11f06 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lazy-loading 'flavor' on Instance uuid 6a6da0ae-48d1-49c8-a62d-bea672976db2 {{(pid=126955) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 21:01:57.820304 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-67895d89-e615-417c-856c-ea7b65a11f06 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "POST /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2/action" status: 202 len: 0 microversion: 2.1 time: 0.402893 Oct 11 21:01:57.821606 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3589/7231] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 21:01:57 2022] POST /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 21:01:57.828364 n-d-860864-3 devstack@n-api.service[126956]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a5a86ca3-3b5a-42ce-a8df-39c5a0ccf7c8] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 21:01:57.829392 n-d-860864-3 devstack@n-api.service[126956]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7a2e4673-78ea-41b9-93b9-8ec414db4940] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 21:01:57.830014 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:01:57.830807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=32 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:01:57.831596 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 21:01:57.831896 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 21:01:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 (ip 10.222.0.27) !!! Oct 11 21:01:57.839499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-5235d17f-e299-4c88-80fa-17f94988c58b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:01:57.840222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-5235d17f-e299-4c88-80fa-17f94988c58b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:01:57.850104 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5235d17f-e299-4c88-80fa-17f94988c58b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:01:57.850618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5235d17f-e299-4c88-80fa-17f94988c58b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:01:57.851061 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5235d17f-e299-4c88-80fa-17f94988c58b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:01:57.851781 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5235d17f-e299-4c88-80fa-17f94988c58b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:01:57.852577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5235d17f-e299-4c88-80fa-17f94988c58b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:01:57.852776 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-5235d17f-e299-4c88-80fa-17f94988c58b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:01:58.058901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-5235d17f-e299-4c88-80fa-17f94988c58b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:01:58.066765 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-5235d17f-e299-4c88-80fa-17f94988c58b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.240234 Oct 11 21:01:58.067346 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3643/7232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:01:57 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:01:59.092533 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93cb94f5-5aee-4397-9216-8b1bbd36d9fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:01:59.093250 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-93cb94f5-5aee-4397-9216-8b1bbd36d9fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:01:59.100425 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cb94f5-5aee-4397-9216-8b1bbd36d9fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:01:59.100922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cb94f5-5aee-4397-9216-8b1bbd36d9fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:01:59.101371 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cb94f5-5aee-4397-9216-8b1bbd36d9fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:01:59.102273 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cb94f5-5aee-4397-9216-8b1bbd36d9fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:01:59.102786 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cb94f5-5aee-4397-9216-8b1bbd36d9fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:01:59.103224 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cb94f5-5aee-4397-9216-8b1bbd36d9fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:01:59.232628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-93cb94f5-5aee-4397-9216-8b1bbd36d9fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:01:59.240380 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93cb94f5-5aee-4397-9216-8b1bbd36d9fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.153156 Oct 11 21:01:59.240949 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3590/7233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:01:59 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:00.264046 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2da74352-02e9-4de0-b58d-bb16256fa914 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:00.264652 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2da74352-02e9-4de0-b58d-bb16256fa914 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:00.275833 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2da74352-02e9-4de0-b58d-bb16256fa914 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:00.276325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2da74352-02e9-4de0-b58d-bb16256fa914 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:00.276766 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2da74352-02e9-4de0-b58d-bb16256fa914 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:00.277462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2da74352-02e9-4de0-b58d-bb16256fa914 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:00.277943 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2da74352-02e9-4de0-b58d-bb16256fa914 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:00.278371 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2da74352-02e9-4de0-b58d-bb16256fa914 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:00.297528 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] [a5a86ca3-3b5a-42ce-a8df-39c5a0ccf7c8] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45812. Oct 11 21:02:00.298247 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] [7a2e4673-78ea-41b9-93b9-8ec414db4940] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45814. Oct 11 21:02:00.415238 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2da74352-02e9-4de0-b58d-bb16256fa914 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:00.422978 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2da74352-02e9-4de0-b58d-bb16256fa914 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.162792 Oct 11 21:02:00.423570 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3644/7234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:00 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:01.446279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a14cd526-02ae-4a0a-b110-ab7e46e843d6 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:01.446939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a14cd526-02ae-4a0a-b110-ab7e46e843d6 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:01.454103 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a14cd526-02ae-4a0a-b110-ab7e46e843d6 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:01.454630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a14cd526-02ae-4a0a-b110-ab7e46e843d6 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:01.455086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a14cd526-02ae-4a0a-b110-ab7e46e843d6 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:01.455788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a14cd526-02ae-4a0a-b110-ab7e46e843d6 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:01.456254 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a14cd526-02ae-4a0a-b110-ab7e46e843d6 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:01.456690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a14cd526-02ae-4a0a-b110-ab7e46e843d6 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:01.592658 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a14cd526-02ae-4a0a-b110-ab7e46e843d6 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:01.600737 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a14cd526-02ae-4a0a-b110-ab7e46e843d6 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.158514 Oct 11 21:02:01.601350 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3591/7235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:01 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:02.623653 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9437b611-f998-4f53-9417-ea65fe7333cb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:02.624288 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9437b611-f998-4f53-9417-ea65fe7333cb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:02.631084 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9437b611-f998-4f53-9417-ea65fe7333cb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:02.631561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9437b611-f998-4f53-9417-ea65fe7333cb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:02.631990 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9437b611-f998-4f53-9417-ea65fe7333cb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:02.632666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9437b611-f998-4f53-9417-ea65fe7333cb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:02.633661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9437b611-f998-4f53-9417-ea65fe7333cb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:02.634116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9437b611-f998-4f53-9417-ea65fe7333cb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:02.764903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9437b611-f998-4f53-9417-ea65fe7333cb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:02.772579 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9437b611-f998-4f53-9417-ea65fe7333cb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.152891 Oct 11 21:02:02.773234 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3645/7236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:02 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:03.799194 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a8345b70-fb09-4e7b-8049-b0db7b6e2839 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:03.799781 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a8345b70-fb09-4e7b-8049-b0db7b6e2839 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:03.807248 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8345b70-fb09-4e7b-8049-b0db7b6e2839 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:03.807752 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8345b70-fb09-4e7b-8049-b0db7b6e2839 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:03.808209 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8345b70-fb09-4e7b-8049-b0db7b6e2839 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:03.808921 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8345b70-fb09-4e7b-8049-b0db7b6e2839 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:03.809394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8345b70-fb09-4e7b-8049-b0db7b6e2839 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:03.809838 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a8345b70-fb09-4e7b-8049-b0db7b6e2839 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:03.946583 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a8345b70-fb09-4e7b-8049-b0db7b6e2839 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:03.954814 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a8345b70-fb09-4e7b-8049-b0db7b6e2839 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.159619 Oct 11 21:02:03.955393 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3592/7237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:03 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:04.977855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-85aeef1a-0ef9-49ed-9f2c-39fb8c544cb9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:04.978466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-85aeef1a-0ef9-49ed-9f2c-39fb8c544cb9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:04.985396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85aeef1a-0ef9-49ed-9f2c-39fb8c544cb9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:04.985889 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85aeef1a-0ef9-49ed-9f2c-39fb8c544cb9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:04.986328 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85aeef1a-0ef9-49ed-9f2c-39fb8c544cb9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:04.987045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85aeef1a-0ef9-49ed-9f2c-39fb8c544cb9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:04.987534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85aeef1a-0ef9-49ed-9f2c-39fb8c544cb9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:04.987979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-85aeef1a-0ef9-49ed-9f2c-39fb8c544cb9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:05.117997 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-85aeef1a-0ef9-49ed-9f2c-39fb8c544cb9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:05.126572 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-85aeef1a-0ef9-49ed-9f2c-39fb8c544cb9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.152710 Oct 11 21:02:05.127148 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3646/7238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:04 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:06.150618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97bab019-6107-400d-a2af-5b0ef048455c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:06.151247 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97bab019-6107-400d-a2af-5b0ef048455c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:06.158674 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97bab019-6107-400d-a2af-5b0ef048455c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:06.159170 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97bab019-6107-400d-a2af-5b0ef048455c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:06.159618 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97bab019-6107-400d-a2af-5b0ef048455c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:06.160346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97bab019-6107-400d-a2af-5b0ef048455c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:06.160812 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97bab019-6107-400d-a2af-5b0ef048455c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:06.161246 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97bab019-6107-400d-a2af-5b0ef048455c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:06.293475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-97bab019-6107-400d-a2af-5b0ef048455c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:06.301333 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97bab019-6107-400d-a2af-5b0ef048455c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.154769 Oct 11 21:02:06.301910 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3593/7239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:06 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:07.325774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-47eaf83b-b7ae-49a5-b956-f17669342b17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:07.326387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-47eaf83b-b7ae-49a5-b956-f17669342b17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:07.333356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47eaf83b-b7ae-49a5-b956-f17669342b17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:07.333789 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47eaf83b-b7ae-49a5-b956-f17669342b17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:07.334232 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47eaf83b-b7ae-49a5-b956-f17669342b17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:07.334955 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47eaf83b-b7ae-49a5-b956-f17669342b17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:07.335418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47eaf83b-b7ae-49a5-b956-f17669342b17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:07.335845 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-47eaf83b-b7ae-49a5-b956-f17669342b17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:07.466153 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-47eaf83b-b7ae-49a5-b956-f17669342b17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:07.473856 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-47eaf83b-b7ae-49a5-b956-f17669342b17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.152902 Oct 11 21:02:07.474463 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3647/7240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:07 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:08.497800 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5d9a820f-c81e-4be0-ad73-0112c0a5e1e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:08.498441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5d9a820f-c81e-4be0-ad73-0112c0a5e1e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:08.506563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d9a820f-c81e-4be0-ad73-0112c0a5e1e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:08.507078 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d9a820f-c81e-4be0-ad73-0112c0a5e1e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:08.507537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d9a820f-c81e-4be0-ad73-0112c0a5e1e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:08.508252 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d9a820f-c81e-4be0-ad73-0112c0a5e1e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:08.508731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d9a820f-c81e-4be0-ad73-0112c0a5e1e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:08.509179 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5d9a820f-c81e-4be0-ad73-0112c0a5e1e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:08.639524 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5d9a820f-c81e-4be0-ad73-0112c0a5e1e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:08.647231 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5d9a820f-c81e-4be0-ad73-0112c0a5e1e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1698 microversion: 2.1 time: 0.154387 Oct 11 21:02:08.647805 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3594/7241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:08 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:09.672211 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-35150374-ce20-4ab3-a10d-84684769b021 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:09.672834 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-35150374-ce20-4ab3-a10d-84684769b021 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:09.679926 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35150374-ce20-4ab3-a10d-84684769b021 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:09.680418 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35150374-ce20-4ab3-a10d-84684769b021 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:09.680860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35150374-ce20-4ab3-a10d-84684769b021 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:09.681551 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35150374-ce20-4ab3-a10d-84684769b021 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:09.682007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35150374-ce20-4ab3-a10d-84684769b021 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:09.682433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-35150374-ce20-4ab3-a10d-84684769b021 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:09.815887 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-35150374-ce20-4ab3-a10d-84684769b021 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:09.823601 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-35150374-ce20-4ab3-a10d-84684769b021 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1698 microversion: 2.1 time: 0.155987 Oct 11 21:02:09.824782 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3648/7242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:09 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:10.848322 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-93cff986-335d-4f0c-bddc-eef4a2276ef5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:10.848947 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-93cff986-335d-4f0c-bddc-eef4a2276ef5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:10.856180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cff986-335d-4f0c-bddc-eef4a2276ef5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:10.857182 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cff986-335d-4f0c-bddc-eef4a2276ef5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:10.860707 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cff986-335d-4f0c-bddc-eef4a2276ef5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:10.861998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cff986-335d-4f0c-bddc-eef4a2276ef5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:10.862846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cff986-335d-4f0c-bddc-eef4a2276ef5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:10.863602 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-93cff986-335d-4f0c-bddc-eef4a2276ef5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:11.028484 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-93cff986-335d-4f0c-bddc-eef4a2276ef5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:11.038677 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-93cff986-335d-4f0c-bddc-eef4a2276ef5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1693 microversion: 2.1 time: 0.194012 Oct 11 21:02:11.039964 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3595/7243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:10 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:12.068039 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6df8adac-5840-4789-b708-283b29c76ed5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:12.068656 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6df8adac-5840-4789-b708-283b29c76ed5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:12.093613 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df8adac-5840-4789-b708-283b29c76ed5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:12.094415 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df8adac-5840-4789-b708-283b29c76ed5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:12.095569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df8adac-5840-4789-b708-283b29c76ed5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:12.096292 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df8adac-5840-4789-b708-283b29c76ed5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:12.096756 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df8adac-5840-4789-b708-283b29c76ed5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:12.097186 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6df8adac-5840-4789-b708-283b29c76ed5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:12.256928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6df8adac-5840-4789-b708-283b29c76ed5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:12.265063 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6df8adac-5840-4789-b708-283b29c76ed5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1693 microversion: 2.1 time: 0.200858 Oct 11 21:02:12.265717 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3649/7244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:12 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:13.113397 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-adbba5f5-f519-4ce4-b106-2ecd18e2356f req-18846ce5-b788-4806-a5b7-835fb845924c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a6da0ae-48d1-49c8-a62d-bea672976db2", "name": "network-vif-plugged", "status": "completed", "tag": "c6cc3bf6-3781-48c1-af4c-062096f6490d"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:02:13.129390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-adbba5f5-f519-4ce4-b106-2ecd18e2356f req-18846ce5-b788-4806-a5b7-835fb845924c service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:13.130710 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-adbba5f5-f519-4ce4-b106-2ecd18e2356f req-18846ce5-b788-4806-a5b7-835fb845924c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:13.131787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-adbba5f5-f519-4ce4-b106-2ecd18e2356f req-18846ce5-b788-4806-a5b7-835fb845924c service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:13.158490 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-adbba5f5-f519-4ce4-b106-2ecd18e2356f req-18846ce5-b788-4806-a5b7-835fb845924c service nova] Creating event network-vif-plugged:c6cc3bf6-3781-48c1-af4c-062096f6490d for instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 on n-h1-860864-3 Oct 11 21:02:13.170172 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-adbba5f5-f519-4ce4-b106-2ecd18e2356f req-18846ce5-b788-4806-a5b7-835fb845924c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153089 Oct 11 21:02:13.170854 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3596/7245] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:02:13.291492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce01944a-a818-4c9d-8629-4507d5f9fc71 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:13.293458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ce01944a-a818-4c9d-8629-4507d5f9fc71 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:13.301235 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce01944a-a818-4c9d-8629-4507d5f9fc71 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:13.302147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce01944a-a818-4c9d-8629-4507d5f9fc71 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:13.302617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce01944a-a818-4c9d-8629-4507d5f9fc71 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:13.308971 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce01944a-a818-4c9d-8629-4507d5f9fc71 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:13.310487 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce01944a-a818-4c9d-8629-4507d5f9fc71 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:13.311223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce01944a-a818-4c9d-8629-4507d5f9fc71 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:13.483318 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ce01944a-a818-4c9d-8629-4507d5f9fc71 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:13.491541 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ce01944a-a818-4c9d-8629-4507d5f9fc71 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1693 microversion: 2.1 time: 0.204349 Oct 11 21:02:13.492284 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3650/7246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:13 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1693 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:14.518787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5f84d630-da5b-4006-9ca1-19c002b590af tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:14.520489 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f84d630-da5b-4006-9ca1-19c002b590af tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:14.527829 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f84d630-da5b-4006-9ca1-19c002b590af tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:14.528503 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f84d630-da5b-4006-9ca1-19c002b590af tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:14.529034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f84d630-da5b-4006-9ca1-19c002b590af tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:14.532675 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f84d630-da5b-4006-9ca1-19c002b590af tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:14.533180 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f84d630-da5b-4006-9ca1-19c002b590af tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:14.533636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f84d630-da5b-4006-9ca1-19c002b590af tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:14.677510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5f84d630-da5b-4006-9ca1-19c002b590af tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:14.686776 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5f84d630-da5b-4006-9ca1-19c002b590af tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1693 microversion: 2.1 time: 0.173085 Oct 11 21:02:14.687362 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3597/7247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:14 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 21:02:15.710476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ce23e643-f65b-498a-b58c-6925e28cccb1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:15.711188 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ce23e643-f65b-498a-b58c-6925e28cccb1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:15.720105 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce23e643-f65b-498a-b58c-6925e28cccb1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:15.720970 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce23e643-f65b-498a-b58c-6925e28cccb1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:15.721431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce23e643-f65b-498a-b58c-6925e28cccb1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:15.722635 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce23e643-f65b-498a-b58c-6925e28cccb1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:15.723329 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce23e643-f65b-498a-b58c-6925e28cccb1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:15.723840 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ce23e643-f65b-498a-b58c-6925e28cccb1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:15.873874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ce23e643-f65b-498a-b58c-6925e28cccb1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:15.882484 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ce23e643-f65b-498a-b58c-6925e28cccb1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1693 microversion: 2.1 time: 0.175709 Oct 11 21:02:15.883136 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3651/7248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:15 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:16.908309 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-a10235d6-6082-41a3-aefe-2145ea5798d5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:16.909597 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-a10235d6-6082-41a3-aefe-2145ea5798d5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:16.918578 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a10235d6-6082-41a3-aefe-2145ea5798d5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:16.919233 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a10235d6-6082-41a3-aefe-2145ea5798d5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:16.919977 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a10235d6-6082-41a3-aefe-2145ea5798d5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:16.920852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a10235d6-6082-41a3-aefe-2145ea5798d5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:16.921438 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a10235d6-6082-41a3-aefe-2145ea5798d5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:16.922021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-a10235d6-6082-41a3-aefe-2145ea5798d5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:17.070849 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-a10235d6-6082-41a3-aefe-2145ea5798d5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:17.082951 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-a10235d6-6082-41a3-aefe-2145ea5798d5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1693 microversion: 2.1 time: 0.178282 Oct 11 21:02:17.084076 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3598/7249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:16 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:18.107807 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f1aef75a-2611-4ff6-89fd-c3fada948249 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:18.108414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f1aef75a-2611-4ff6-89fd-c3fada948249 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:18.115381 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aef75a-2611-4ff6-89fd-c3fada948249 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:18.116109 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aef75a-2611-4ff6-89fd-c3fada948249 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:18.116547 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aef75a-2611-4ff6-89fd-c3fada948249 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:18.117241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aef75a-2611-4ff6-89fd-c3fada948249 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:18.117905 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aef75a-2611-4ff6-89fd-c3fada948249 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:18.118552 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f1aef75a-2611-4ff6-89fd-c3fada948249 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:18.266491 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f1aef75a-2611-4ff6-89fd-c3fada948249 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:18.274468 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f1aef75a-2611-4ff6-89fd-c3fada948249 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1693 microversion: 2.1 time: 0.171109 Oct 11 21:02:18.276486 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3652/7250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:18 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:19.299895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-e7d22146-1c3c-4f34-9309-77d23f9d796c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:19.300842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-e7d22146-1c3c-4f34-9309-77d23f9d796c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:19.308572 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7d22146-1c3c-4f34-9309-77d23f9d796c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:19.309272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7d22146-1c3c-4f34-9309-77d23f9d796c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:19.309821 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7d22146-1c3c-4f34-9309-77d23f9d796c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:19.310778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7d22146-1c3c-4f34-9309-77d23f9d796c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:19.311268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7d22146-1c3c-4f34-9309-77d23f9d796c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:19.311723 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-e7d22146-1c3c-4f34-9309-77d23f9d796c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:19.459607 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-e7d22146-1c3c-4f34-9309-77d23f9d796c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:19.468302 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-e7d22146-1c3c-4f34-9309-77d23f9d796c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1693 microversion: 2.1 time: 0.172504 Oct 11 21:02:19.469114 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3599/7251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:19 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:20.492178 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba813b68-14e7-442f-ab55-1cf68d063e7d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:20.492802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba813b68-14e7-442f-ab55-1cf68d063e7d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:20.500342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba813b68-14e7-442f-ab55-1cf68d063e7d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:20.500862 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba813b68-14e7-442f-ab55-1cf68d063e7d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:20.501310 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba813b68-14e7-442f-ab55-1cf68d063e7d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:20.502010 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba813b68-14e7-442f-ab55-1cf68d063e7d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:20.502468 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba813b68-14e7-442f-ab55-1cf68d063e7d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:20.502917 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba813b68-14e7-442f-ab55-1cf68d063e7d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:21.006445 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba813b68-14e7-442f-ab55-1cf68d063e7d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:21.014774 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba813b68-14e7-442f-ab55-1cf68d063e7d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1675 microversion: 2.1 time: 0.526521 Oct 11 21:02:21.015334 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3653/7252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:20 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1675 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:22.039211 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-995a908a-7872-4806-a20b-59b29f5c7b11 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:22.039832 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-995a908a-7872-4806-a20b-59b29f5c7b11 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:22.048481 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-995a908a-7872-4806-a20b-59b29f5c7b11 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:22.049021 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-995a908a-7872-4806-a20b-59b29f5c7b11 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:22.049507 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-995a908a-7872-4806-a20b-59b29f5c7b11 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:22.050249 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-995a908a-7872-4806-a20b-59b29f5c7b11 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:22.050848 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-995a908a-7872-4806-a20b-59b29f5c7b11 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:22.051338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-995a908a-7872-4806-a20b-59b29f5c7b11 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:22.185430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-995a908a-7872-4806-a20b-59b29f5c7b11 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:22.193158 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-995a908a-7872-4806-a20b-59b29f5c7b11 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1675 microversion: 2.1 time: 0.157941 Oct 11 21:02:22.193735 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3600/7253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:22 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 21:02:23.217353 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-53988864-f36e-4dce-956a-0438d5563198 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:23.217968 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-53988864-f36e-4dce-956a-0438d5563198 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:23.225149 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53988864-f36e-4dce-956a-0438d5563198 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:23.225636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53988864-f36e-4dce-956a-0438d5563198 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:23.226073 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53988864-f36e-4dce-956a-0438d5563198 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:23.226782 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53988864-f36e-4dce-956a-0438d5563198 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:23.227241 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53988864-f36e-4dce-956a-0438d5563198 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:23.227662 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-53988864-f36e-4dce-956a-0438d5563198 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:23.359923 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-53988864-f36e-4dce-956a-0438d5563198 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:23.367625 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-53988864-f36e-4dce-956a-0438d5563198 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1618 microversion: 2.1 time: 0.154611 Oct 11 21:02:23.368234 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3654/7254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:23 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1618 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:23.391244 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-19f8aa6d-1ec7-4cba-95c5-2ad97b7a88fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:02:23.391889 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-19f8aa6d-1ec7-4cba-95c5-2ad97b7a88fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:23.398840 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19f8aa6d-1ec7-4cba-95c5-2ad97b7a88fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:23.399346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19f8aa6d-1ec7-4cba-95c5-2ad97b7a88fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:23.399805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19f8aa6d-1ec7-4cba-95c5-2ad97b7a88fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:23.400518 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19f8aa6d-1ec7-4cba-95c5-2ad97b7a88fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:23.400994 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19f8aa6d-1ec7-4cba-95c5-2ad97b7a88fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:23.401440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-19f8aa6d-1ec7-4cba-95c5-2ad97b7a88fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:23.485358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-19f8aa6d-1ec7-4cba-95c5-2ad97b7a88fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126955) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 21:02:23.554173 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-19f8aa6d-1ec7-4cba-95c5-2ad97b7a88fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "POST /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2/action" status: 202 len: 0 microversion: 2.1 time: 0.166863 Oct 11 21:02:23.554769 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3601/7255] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 21:02:23 2022] POST /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 21:02:23.563569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-a381f402-41ed-4213-9117-1e93b07a896b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:23.564179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-a381f402-41ed-4213-9117-1e93b07a896b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:23.570071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a381f402-41ed-4213-9117-1e93b07a896b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:23.570665 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a381f402-41ed-4213-9117-1e93b07a896b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:23.571181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a381f402-41ed-4213-9117-1e93b07a896b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:23.571872 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a381f402-41ed-4213-9117-1e93b07a896b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:23.572323 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a381f402-41ed-4213-9117-1e93b07a896b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:23.572740 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-a381f402-41ed-4213-9117-1e93b07a896b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:23.710302 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-a381f402-41ed-4213-9117-1e93b07a896b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:23.719203 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-a381f402-41ed-4213-9117-1e93b07a896b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1626 microversion: 2.1 time: 0.159453 Oct 11 21:02:23.719842 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3655/7256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:23 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1626 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:24.743981 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5bdacd49-aa86-4ca3-a97e-a305a2e079a0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:24.744553 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5bdacd49-aa86-4ca3-a97e-a305a2e079a0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:24.750756 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bdacd49-aa86-4ca3-a97e-a305a2e079a0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:24.751262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bdacd49-aa86-4ca3-a97e-a305a2e079a0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:24.751714 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bdacd49-aa86-4ca3-a97e-a305a2e079a0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:24.752421 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bdacd49-aa86-4ca3-a97e-a305a2e079a0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:24.752887 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bdacd49-aa86-4ca3-a97e-a305a2e079a0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:24.753323 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5bdacd49-aa86-4ca3-a97e-a305a2e079a0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:24.917200 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5bdacd49-aa86-4ca3-a97e-a305a2e079a0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:24.925694 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5bdacd49-aa86-4ca3-a97e-a305a2e079a0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.186505 Oct 11 21:02:24.926893 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3602/7257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:24 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:24.996227 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-0688d988-6c9d-40b5-a64b-3e9af60a4709 req-43e4053f-44b1-4f9c-ba1a-2b91df9c67a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a6da0ae-48d1-49c8-a62d-bea672976db2", "name": "network-vif-unplugged", "status": "completed", "tag": "c6cc3bf6-3781-48c1-af4c-062096f6490d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:02:25.006783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0688d988-6c9d-40b5-a64b-3e9af60a4709 req-43e4053f-44b1-4f9c-ba1a-2b91df9c67a6 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:25.007543 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0688d988-6c9d-40b5-a64b-3e9af60a4709 req-43e4053f-44b1-4f9c-ba1a-2b91df9c67a6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:25.008049 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0688d988-6c9d-40b5-a64b-3e9af60a4709 req-43e4053f-44b1-4f9c-ba1a-2b91df9c67a6 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:25.024633 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-0688d988-6c9d-40b5-a64b-3e9af60a4709 req-43e4053f-44b1-4f9c-ba1a-2b91df9c67a6 service nova] Creating event network-vif-unplugged:c6cc3bf6-3781-48c1-af4c-062096f6490d for instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 on n-h1-860864-3 Oct 11 21:02:25.029932 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-0688d988-6c9d-40b5-a64b-3e9af60a4709 req-43e4053f-44b1-4f9c-ba1a-2b91df9c67a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037752 Oct 11 21:02:25.033146 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3656/7258] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:02:25.950998 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-21246908-eacf-44ba-ace7-7c0dfd0aacc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:25.951645 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-21246908-eacf-44ba-ace7-7c0dfd0aacc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:25.960433 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21246908-eacf-44ba-ace7-7c0dfd0aacc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:25.961609 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21246908-eacf-44ba-ace7-7c0dfd0aacc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:25.962814 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21246908-eacf-44ba-ace7-7c0dfd0aacc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:25.964061 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21246908-eacf-44ba-ace7-7c0dfd0aacc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:25.966333 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21246908-eacf-44ba-ace7-7c0dfd0aacc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:25.967110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-21246908-eacf-44ba-ace7-7c0dfd0aacc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:25.974324 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:02:26.131582 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-21246908-eacf-44ba-ace7-7c0dfd0aacc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:26.140535 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-21246908-eacf-44ba-ace7-7c0dfd0aacc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.193854 Oct 11 21:02:26.141126 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3603/7259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:25 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:27.168078 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3d5b5024-7a30-46a1-9a5c-9827d51fa38d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:27.168912 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3d5b5024-7a30-46a1-9a5c-9827d51fa38d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:27.175750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d5b5024-7a30-46a1-9a5c-9827d51fa38d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:27.176253 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d5b5024-7a30-46a1-9a5c-9827d51fa38d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:27.176698 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d5b5024-7a30-46a1-9a5c-9827d51fa38d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:27.177405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d5b5024-7a30-46a1-9a5c-9827d51fa38d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:27.177868 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d5b5024-7a30-46a1-9a5c-9827d51fa38d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:27.178294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3d5b5024-7a30-46a1-9a5c-9827d51fa38d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:27.325629 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3d5b5024-7a30-46a1-9a5c-9827d51fa38d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:27.333695 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3d5b5024-7a30-46a1-9a5c-9827d51fa38d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.172273 Oct 11 21:02:27.334206 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3657/7260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:27 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:28.359153 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3549a8a7-6237-4fc7-93dc-c6128cfc6bd3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:28.360910 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3549a8a7-6237-4fc7-93dc-c6128cfc6bd3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:28.364591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:02:28.372748 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3549a8a7-6237-4fc7-93dc-c6128cfc6bd3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:28.373268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3549a8a7-6237-4fc7-93dc-c6128cfc6bd3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:28.373865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3549a8a7-6237-4fc7-93dc-c6128cfc6bd3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:28.374630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3549a8a7-6237-4fc7-93dc-c6128cfc6bd3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:28.375107 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3549a8a7-6237-4fc7-93dc-c6128cfc6bd3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:28.375552 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3549a8a7-6237-4fc7-93dc-c6128cfc6bd3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:28.523915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3549a8a7-6237-4fc7-93dc-c6128cfc6bd3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:28.531893 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3549a8a7-6237-4fc7-93dc-c6128cfc6bd3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.178347 Oct 11 21:02:28.532468 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3604/7261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:28 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:29.557063 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-00491e53-358a-4686-a53e-a4e889260705 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:29.557686 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-00491e53-358a-4686-a53e-a4e889260705 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:29.561190 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=31 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:02:29.566672 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00491e53-358a-4686-a53e-a4e889260705 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:29.567164 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00491e53-358a-4686-a53e-a4e889260705 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:29.567605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00491e53-358a-4686-a53e-a4e889260705 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:29.568300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00491e53-358a-4686-a53e-a4e889260705 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:29.568751 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00491e53-358a-4686-a53e-a4e889260705 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:29.569177 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-00491e53-358a-4686-a53e-a4e889260705 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:29.573309 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=87 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:02:29.728068 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-00491e53-358a-4686-a53e-a4e889260705 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:29.741094 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-00491e53-358a-4686-a53e-a4e889260705 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.187871 Oct 11 21:02:29.742484 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3658/7262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:29 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:30.765300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-262e5f08-a3d0-4759-a3b0-15cbdbae04e7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:30.765915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-262e5f08-a3d0-4759-a3b0-15cbdbae04e7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:30.773161 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-262e5f08-a3d0-4759-a3b0-15cbdbae04e7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:30.773580 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-262e5f08-a3d0-4759-a3b0-15cbdbae04e7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:30.774039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-262e5f08-a3d0-4759-a3b0-15cbdbae04e7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:30.774810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-262e5f08-a3d0-4759-a3b0-15cbdbae04e7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:30.775263 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-262e5f08-a3d0-4759-a3b0-15cbdbae04e7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:30.775702 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-262e5f08-a3d0-4759-a3b0-15cbdbae04e7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:30.927788 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-262e5f08-a3d0-4759-a3b0-15cbdbae04e7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:30.936174 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-262e5f08-a3d0-4759-a3b0-15cbdbae04e7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.175230 Oct 11 21:02:30.937145 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3605/7263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:30 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:31.962426 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-bf6ef61b-1eac-4378-ae02-6549af7d240b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:31.963087 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-bf6ef61b-1eac-4378-ae02-6549af7d240b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:31.970777 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf6ef61b-1eac-4378-ae02-6549af7d240b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:31.971266 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf6ef61b-1eac-4378-ae02-6549af7d240b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:31.971704 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf6ef61b-1eac-4378-ae02-6549af7d240b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:31.972404 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf6ef61b-1eac-4378-ae02-6549af7d240b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:31.972856 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf6ef61b-1eac-4378-ae02-6549af7d240b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:31.973278 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-bf6ef61b-1eac-4378-ae02-6549af7d240b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:32.124165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-bf6ef61b-1eac-4378-ae02-6549af7d240b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:32.134653 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-bf6ef61b-1eac-4378-ae02-6549af7d240b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.175149 Oct 11 21:02:32.134653 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3659/7264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:31 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:33.157967 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-bbda3381-6c52-4684-b528-85728bc5056a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:33.158820 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-bbda3381-6c52-4684-b528-85728bc5056a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:33.178311 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbda3381-6c52-4684-b528-85728bc5056a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:33.178891 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbda3381-6c52-4684-b528-85728bc5056a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:33.179346 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbda3381-6c52-4684-b528-85728bc5056a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:33.180142 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbda3381-6c52-4684-b528-85728bc5056a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:33.180591 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbda3381-6c52-4684-b528-85728bc5056a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:33.181032 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-bbda3381-6c52-4684-b528-85728bc5056a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:33.344059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-bbda3381-6c52-4684-b528-85728bc5056a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:33.353301 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-bbda3381-6c52-4684-b528-85728bc5056a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.199133 Oct 11 21:02:33.354095 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3606/7265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:33 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:34.378137 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7d3945f7-7efd-433c-87dc-22471032c1ae tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:34.378755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7d3945f7-7efd-433c-87dc-22471032c1ae tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:34.385443 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d3945f7-7efd-433c-87dc-22471032c1ae tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:34.386546 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d3945f7-7efd-433c-87dc-22471032c1ae tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:34.386995 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d3945f7-7efd-433c-87dc-22471032c1ae tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:34.387675 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d3945f7-7efd-433c-87dc-22471032c1ae tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:34.388125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d3945f7-7efd-433c-87dc-22471032c1ae tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:34.388545 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7d3945f7-7efd-433c-87dc-22471032c1ae tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:34.527599 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7d3945f7-7efd-433c-87dc-22471032c1ae tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:34.535459 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7d3945f7-7efd-433c-87dc-22471032c1ae tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.161277 Oct 11 21:02:34.536035 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3660/7266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:34 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:35.558810 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5f1dd4aa-ad72-4764-92a4-a20f7fd8d0fb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:35.559442 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5f1dd4aa-ad72-4764-92a4-a20f7fd8d0fb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:35.566407 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f1dd4aa-ad72-4764-92a4-a20f7fd8d0fb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:35.566957 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f1dd4aa-ad72-4764-92a4-a20f7fd8d0fb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:35.567414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f1dd4aa-ad72-4764-92a4-a20f7fd8d0fb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:35.568125 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f1dd4aa-ad72-4764-92a4-a20f7fd8d0fb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:35.568599 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f1dd4aa-ad72-4764-92a4-a20f7fd8d0fb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:35.569043 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5f1dd4aa-ad72-4764-92a4-a20f7fd8d0fb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:35.710664 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5f1dd4aa-ad72-4764-92a4-a20f7fd8d0fb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:35.718441 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5f1dd4aa-ad72-4764-92a4-a20f7fd8d0fb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.163686 Oct 11 21:02:35.719049 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3607/7267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:35 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:36.741316 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8f1a2fbc-1ef5-4cfb-9fef-88de10482765 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:36.742071 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8f1a2fbc-1ef5-4cfb-9fef-88de10482765 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:36.749536 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1a2fbc-1ef5-4cfb-9fef-88de10482765 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:36.750020 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1a2fbc-1ef5-4cfb-9fef-88de10482765 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:36.750458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1a2fbc-1ef5-4cfb-9fef-88de10482765 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:36.751222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1a2fbc-1ef5-4cfb-9fef-88de10482765 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:36.751931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1a2fbc-1ef5-4cfb-9fef-88de10482765 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:36.752535 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8f1a2fbc-1ef5-4cfb-9fef-88de10482765 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:36.891605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8f1a2fbc-1ef5-4cfb-9fef-88de10482765 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:36.899539 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8f1a2fbc-1ef5-4cfb-9fef-88de10482765 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1684 microversion: 2.1 time: 0.161999 Oct 11 21:02:36.900120 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3661/7268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:36 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:37.923123 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dd99bb7d-df72-4548-9cc0-47448d4122e9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:02:37.923760 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dd99bb7d-df72-4548-9cc0-47448d4122e9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:02:37.930696 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd99bb7d-df72-4548-9cc0-47448d4122e9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:37.931201 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd99bb7d-df72-4548-9cc0-47448d4122e9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:37.931655 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd99bb7d-df72-4548-9cc0-47448d4122e9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:37.932365 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd99bb7d-df72-4548-9cc0-47448d4122e9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:37.932842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd99bb7d-df72-4548-9cc0-47448d4122e9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:37.933864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dd99bb7d-df72-4548-9cc0-47448d4122e9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:38.064778 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dd99bb7d-df72-4548-9cc0-47448d4122e9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:02:38.073093 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dd99bb7d-df72-4548-9cc0-47448d4122e9 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1671 microversion: 2.1 time: 0.153849 Oct 11 21:02:38.074546 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3608/7269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:02:37 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:02:39.059242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-a16ff711-d842-4e9c-8a54-6cacd1922ba6 req-7aa3b67b-5f87-467f-8af4-1233a2b07159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a6da0ae-48d1-49c8-a62d-bea672976db2", "name": "network-vif-plugged", "status": "completed", "tag": "c6cc3bf6-3781-48c1-af4c-062096f6490d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:02:39.069879 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a16ff711-d842-4e9c-8a54-6cacd1922ba6 req-7aa3b67b-5f87-467f-8af4-1233a2b07159 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:02:39.070666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a16ff711-d842-4e9c-8a54-6cacd1922ba6 req-7aa3b67b-5f87-467f-8af4-1233a2b07159 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:02:39.071103 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-a16ff711-d842-4e9c-8a54-6cacd1922ba6 req-7aa3b67b-5f87-467f-8af4-1233a2b07159 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:02:39.083544 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-a16ff711-d842-4e9c-8a54-6cacd1922ba6 req-7aa3b67b-5f87-467f-8af4-1233a2b07159 service nova] Creating event network-vif-plugged:c6cc3bf6-3781-48c1-af4c-062096f6490d for instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 on n-h1-860864-3 Oct 11 21:02:39.088524 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-a16ff711-d842-4e9c-8a54-6cacd1922ba6 req-7aa3b67b-5f87-467f-8af4-1233a2b07159 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 Oct 11 21:02:39.089257 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3662/7270] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:03:50.635031 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=9 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:03:50.636192 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=34 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:03:50.637193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=9 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:03:50.637643 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 21:03:50.637747 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 21:03:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 (ip 10.222.0.27) !!! Oct 11 21:03:50.638229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=25 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:03:50.645690 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-97c514fb-e242-40cf-89da-e1337b442ec7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:03:50.647338 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97c514fb-e242-40cf-89da-e1337b442ec7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:03:50.657914 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97c514fb-e242-40cf-89da-e1337b442ec7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:03:50.658435 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97c514fb-e242-40cf-89da-e1337b442ec7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:03:50.658924 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97c514fb-e242-40cf-89da-e1337b442ec7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:03:50.659654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97c514fb-e242-40cf-89da-e1337b442ec7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:03:50.660136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97c514fb-e242-40cf-89da-e1337b442ec7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:03:50.660581 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-97c514fb-e242-40cf-89da-e1337b442ec7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:03:50.689683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-97c514fb-e242-40cf-89da-e1337b442ec7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Going to try to terminate instance {{(pid=126955) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 21:03:50.723983 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-0aaccd96-6de4-4203-9a1f-24402a5866b1 req-7f1deb71-97c6-452f-a94a-8cbc20148c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a6da0ae-48d1-49c8-a62d-bea672976db2", "tag": "c6cc3bf6-3781-48c1-af4c-062096f6490d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:03:50.738396 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0aaccd96-6de4-4203-9a1f-24402a5866b1 req-7f1deb71-97c6-452f-a94a-8cbc20148c47 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:03:50.739370 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0aaccd96-6de4-4203-9a1f-24402a5866b1 req-7f1deb71-97c6-452f-a94a-8cbc20148c47 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:03:50.739804 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-0aaccd96-6de4-4203-9a1f-24402a5866b1 req-7f1deb71-97c6-452f-a94a-8cbc20148c47 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:03:50.753048 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-0aaccd96-6de4-4203-9a1f-24402a5866b1 req-7f1deb71-97c6-452f-a94a-8cbc20148c47 service nova] Creating event network-changed:c6cc3bf6-3781-48c1-af4c-062096f6490d for instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 on n-h1-860864-3 Oct 11 21:03:50.760055 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-0aaccd96-6de4-4203-9a1f-24402a5866b1 req-7f1deb71-97c6-452f-a94a-8cbc20148c47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125421 Oct 11 21:03:50.760903 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3663/7271] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 21:03:50.777901 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-97c514fb-e242-40cf-89da-e1337b442ec7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 204 len: 0 microversion: 2.1 time: 0.145127 Oct 11 21:03:50.778900 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3609/7272] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 21:03:50 2022] DELETE /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 21:03:50.788025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-96ad5e0f-933c-40ae-bd3d-08c7aff5617c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:03:50.788721 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-96ad5e0f-933c-40ae-bd3d-08c7aff5617c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:03:50.795093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96ad5e0f-933c-40ae-bd3d-08c7aff5617c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:03:50.796360 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96ad5e0f-933c-40ae-bd3d-08c7aff5617c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:03:50.796817 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96ad5e0f-933c-40ae-bd3d-08c7aff5617c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:03:50.797489 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96ad5e0f-933c-40ae-bd3d-08c7aff5617c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:03:50.797942 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96ad5e0f-933c-40ae-bd3d-08c7aff5617c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:03:50.798361 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-96ad5e0f-933c-40ae-bd3d-08c7aff5617c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:03:50.937514 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-96ad5e0f-933c-40ae-bd3d-08c7aff5617c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:03:50.945637 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-96ad5e0f-933c-40ae-bd3d-08c7aff5617c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.161822 Oct 11 21:03:50.946337 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3664/7273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:03:50 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:03:51.970483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-615a9932-5af5-4fb0-ba94-cbe927391759 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:03:51.971229 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-615a9932-5af5-4fb0-ba94-cbe927391759 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:03:51.979130 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-615a9932-5af5-4fb0-ba94-cbe927391759 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:03:51.979634 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-615a9932-5af5-4fb0-ba94-cbe927391759 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:03:51.980113 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-615a9932-5af5-4fb0-ba94-cbe927391759 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:03:51.980823 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-615a9932-5af5-4fb0-ba94-cbe927391759 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:03:51.981288 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-615a9932-5af5-4fb0-ba94-cbe927391759 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:03:51.981724 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-615a9932-5af5-4fb0-ba94-cbe927391759 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:03:52.188964 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-615a9932-5af5-4fb0-ba94-cbe927391759 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:03:52.197279 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-615a9932-5af5-4fb0-ba94-cbe927391759 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 200 len: 1677 microversion: 2.1 time: 0.231680 Oct 11 21:03:52.198352 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3610/7274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:03:51 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:03:52.774962 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-ef6f873b-58c4-4b8d-8873-4929ea8e0b79 req-689a4933-0fe9-4908-bd12-9394c7ededc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a6da0ae-48d1-49c8-a62d-bea672976db2", "name": "network-vif-deleted", "tag": "c6cc3bf6-3781-48c1-af4c-062096f6490d"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:03:52.785949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ef6f873b-58c4-4b8d-8873-4929ea8e0b79 req-689a4933-0fe9-4908-bd12-9394c7ededc4 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:03:52.786433 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ef6f873b-58c4-4b8d-8873-4929ea8e0b79 req-689a4933-0fe9-4908-bd12-9394c7ededc4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:03:52.786895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-ef6f873b-58c4-4b8d-8873-4929ea8e0b79 req-689a4933-0fe9-4908-bd12-9394c7ededc4 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:03:52.799507 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-ef6f873b-58c4-4b8d-8873-4929ea8e0b79 req-689a4933-0fe9-4908-bd12-9394c7ededc4 service nova] Creating event network-vif-deleted:c6cc3bf6-3781-48c1-af4c-062096f6490d for instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 on n-h1-860864-3 Oct 11 21:03:52.804449 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-ef6f873b-58c4-4b8d-8873-4929ea8e0b79 req-689a4933-0fe9-4908-bd12-9394c7ededc4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033169 Oct 11 21:03:52.805069 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3665/7275] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:03:53.222661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:03:53.223292 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 6a6da0ae-48d1-49c8-a62d-bea672976db2] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:03:53.230143 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:03:53.230679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:03:53.231136 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:03:53.231842 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:03:53.232315 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:03:53.232789 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:03:53.250234 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.wsgi [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] HTTP exception thrown: Instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 could not be found. Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Request method failure captured: Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: request: GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 HTTP/1.1 Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: Accept: application/json Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: Accept-Encoding: identity Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: Connection: close Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: Content-Length: 0 Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: Content-Type: application/json Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: Host: 10.222.0.27 Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: Openstack-System-Scope: None Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: User-Agent: python-urllib3/1.26.12 Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Auth-Token: gAAAAABjRdk8o2MynUImqEKkdZpDrG_BHVgSRQi0zyexFD8-u3ARY1mZ2rIw7loeMIns0xO-zQRZJGNxKuiN1MU0u3mUKe4jlzTAjOKFbSsFudNp9vYaxSzF2FtrBsfsaTJvubYy0GP152s1DDfXGHZa5PIZlcCnx-XXXvqYei5qeWDOXqoALvI Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Id: None Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Domain-Name: None Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Identity-Status: Confirmed Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Is-Admin-Project: True Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Id: default Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Domain-Name: Default Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Id: 80eacc78b786442e8c79ec2fd43b7f1b Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Project-Name: tempest-TestShelveInstance-880441147 Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Role: member,reader Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Roles: member,reader Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80eacc78b786442e8c79ec2fd43b7f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80eacc78b786442e8c79ec2fd43b7f1b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80eacc78b786442e8c79ec2fd43b7f1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80eacc78b786442e8c79ec2fd43b7f1b"}]}] Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant: tempest-TestShelveInstance-880441147 Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Id: 80eacc78b786442e8c79ec2fd43b7f1b Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-Tenant-Name: tempest-TestShelveInstance-880441147 Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-User: tempest-TestShelveInstance-880441147-project Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Id: default Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-User-Domain-Name: Default Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-User-Id: fb01b4039873414cb0c642504ec975a5 Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: X-User-Name: tempest-TestShelveInstance-880441147-project Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: method: > Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: exception: Instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 could not be found. Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: action_args: {'id': '6a6da0ae-48d1-49c8-a62d-bea672976db2'} Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 could not be found. Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 could not be found. Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 21:03:53.251933 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 21:03:53.257286 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 21:03:53.257286 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 21:03:53.257286 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 21:03:53.257286 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 21:03:53.257286 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 21:03:53.257286 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 could not be found. Oct 11 21:03:53.257286 n-d-860864-3 devstack@n-api.service[126955]: ERROR nova.api.openstack.wsgi Oct 11 21:03:53.257286 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Returning 404 to user: Instance 6a6da0ae-48d1-49c8-a62d-bea672976db2 could not be found. {{(pid=126955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 21:03:53.257286 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-205e4442-c69d-4be5-9706-b12143539f1c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2" status: 404 len: 111 microversion: 2.1 time: 0.035866 Oct 11 21:03:53.257286 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3611/7276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:03:53 2022] GET /compute/v2.1/servers/6a6da0ae-48d1-49c8-a62d-bea672976db2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 21:03:53.413120 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d7ba46e0-c214-46d0-b86b-94f8faeb6f33 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '.version_select at 0x7f83c70fc670>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:03:53.436144 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d7ba46e0-c214-46d0-b86b-94f8faeb6f33 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-5414775" status: 202 len: 0 microversion: 2.1 time: 0.027192 Oct 11 21:03:53.436821 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3666/7277] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 11 21:03:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-5414775 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 21:03:53.459208 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-9a8d95fd-9196-492c-b40f-32c3c95e6e88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Action: 'create', calling method: .version_select at 0x7f83c75304c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-342558582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+v7uP4LsBBBOcR/Fo0Df2g+lGWeg+sA8cijGPUPlUcCa/pTRFje53fqKvvDPTgmtnAZGyK4eKnf85NAIUC0z9Fu/lSPPJjzTy6vs/CiXCxUhMKLkJgs5QR1vt5o2v2lA=="}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:03:53.475923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9a8d95fd-9196-492c-b40f-32c3c95e6e88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Getting quotas for project 80eacc78b786442e8c79ec2fd43b7f1b. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 21:03:53.481260 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-9a8d95fd-9196-492c-b40f-32c3c95e6e88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Getting quotas for user fb01b4039873414cb0c642504ec975a5 and project 80eacc78b786442e8c79ec2fd43b7f1b. Resources: {'key_pairs'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 21:03:53.509200 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-9a8d95fd-9196-492c-b40f-32c3c95e6e88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053918 Oct 11 21:03:53.509806 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3612/7278] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 21:03:53 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:04:09.668841 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=10 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:04:09.669664 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:04:09.674940 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-109038994", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-342558582", "security_groups": [{"name": "tempest-secgroup-smoke-10452738"}], "networks": [{"uuid": "36d2cefc-5398-4ada-b7cc-d6b1ca9800e0"}], "block_device_mapping_v2": [{"uuid": "58bc3951-71e6-427a-a92e-75c04ccfc79f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:04:09.789125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.network.neutron [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] validate_networks() for [('36d2cefc-5398-4ada-b7cc-d6b1ca9800e0', None, None, None, None, None)] {{(pid=126956) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 21:04:10.210476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Flavor limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 21:04:10.210927 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Image limits 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 21:04:10.211405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Flavor pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 21:04:10.211814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Image pref 0:0:0 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 21:04:10.212220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.virt.hardware [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126956) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 21:04:10.221587 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:10.222069 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:10.222499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:10.223243 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:10.223692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:10.224112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:10.240767 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Getting quotas for project 80eacc78b786442e8c79ec2fd43b7f1b. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 21:04:10.245815 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Getting quotas for user fb01b4039873414cb0c642504ec975a5 and project 80eacc78b786442e8c79ec2fd43b7f1b. Resources: {'cores', 'ram', 'instances'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 21:04:10.303457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Going to run 1 instances... {{(pid=126956) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 21:04:10.306095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='58bc3951-71e6-427a-a92e-75c04ccfc79f',volume_size=None,volume_type=None)] {{(pid=126956) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 21:04:10.437292 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8dfae506-3245-4ec1-86a8-c36ebb55b436 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.770195 Oct 11 21:04:10.437939 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3667/7279] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 21:04:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 21:04:10.447030 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:04:10.447802 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=4 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:04:10.448512 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:04:10.453459 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8962c9a4-7dfc-4f14-ba85-b5497742903f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:10.454083 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8962c9a4-7dfc-4f14-ba85-b5497742903f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:10.513101 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8962c9a4-7dfc-4f14-ba85-b5497742903f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:10.521504 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8962c9a4-7dfc-4f14-ba85-b5497742903f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1087 microversion: 2.1 time: 0.076351 Oct 11 21:04:10.522822 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3613/7280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:10 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:11.546091 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3865ba18-ca18-4188-94e1-34f1c321e4a4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:11.547133 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3865ba18-ca18-4188-94e1-34f1c321e4a4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:11.553494 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3865ba18-ca18-4188-94e1-34f1c321e4a4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:11.554002 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3865ba18-ca18-4188-94e1-34f1c321e4a4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:11.554657 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3865ba18-ca18-4188-94e1-34f1c321e4a4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:11.555171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3865ba18-ca18-4188-94e1-34f1c321e4a4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:11.555636 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3865ba18-ca18-4188-94e1-34f1c321e4a4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:11.556074 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3865ba18-ca18-4188-94e1-34f1c321e4a4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:11.629816 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3865ba18-ca18-4188-94e1-34f1c321e4a4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:11.639091 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3865ba18-ca18-4188-94e1-34f1c321e4a4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1203 microversion: 2.1 time: 0.097023 Oct 11 21:04:11.640224 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3668/7281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:11 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1203 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:12.666359 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2e9368e6-146a-4e97-a735-ee71fc0de53f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:12.672441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2e9368e6-146a-4e97-a735-ee71fc0de53f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:12.707711 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9368e6-146a-4e97-a735-ee71fc0de53f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:12.708732 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9368e6-146a-4e97-a735-ee71fc0de53f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:12.710151 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9368e6-146a-4e97-a735-ee71fc0de53f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:12.711862 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9368e6-146a-4e97-a735-ee71fc0de53f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:12.712636 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9368e6-146a-4e97-a735-ee71fc0de53f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:12.713269 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2e9368e6-146a-4e97-a735-ee71fc0de53f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:12.891165 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2e9368e6-146a-4e97-a735-ee71fc0de53f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:12.900020 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2e9368e6-146a-4e97-a735-ee71fc0de53f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1269 microversion: 2.1 time: 0.240745 Oct 11 21:04:12.910574 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3614/7282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:12 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1269 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:13.252356 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-807e45f7-2fd8-4555-8228-38c2a79ecef6 req-07298654-7bcb-4ec2-9d9f-3b92b027c269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c90433-8eed-461b-83da-276104c884f1", "tag": "38584388-c65d-46c1-835d-817413ef1e35"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:04:13.264076 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-807e45f7-2fd8-4555-8228-38c2a79ecef6 req-07298654-7bcb-4ec2-9d9f-3b92b027c269 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:13.265605 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-807e45f7-2fd8-4555-8228-38c2a79ecef6 req-07298654-7bcb-4ec2-9d9f-3b92b027c269 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:13.267166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-807e45f7-2fd8-4555-8228-38c2a79ecef6 req-07298654-7bcb-4ec2-9d9f-3b92b027c269 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:13.280743 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-807e45f7-2fd8-4555-8228-38c2a79ecef6 req-07298654-7bcb-4ec2-9d9f-3b92b027c269 service nova] Creating event network-changed:38584388-c65d-46c1-835d-817413ef1e35 for instance 05c90433-8eed-461b-83da-276104c884f1 on n-h2-860864-3 Oct 11 21:04:13.286443 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-807e45f7-2fd8-4555-8228-38c2a79ecef6 req-07298654-7bcb-4ec2-9d9f-3b92b027c269 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040593 Oct 11 21:04:13.287267 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3669/7283] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:04:13.924757 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-33bd4116-c7f4-4b78-a581-b47140855990 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:13.926041 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-33bd4116-c7f4-4b78-a581-b47140855990 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:13.933185 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33bd4116-c7f4-4b78-a581-b47140855990 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:13.933896 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33bd4116-c7f4-4b78-a581-b47140855990 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:13.934362 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33bd4116-c7f4-4b78-a581-b47140855990 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:13.935109 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33bd4116-c7f4-4b78-a581-b47140855990 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:13.935587 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33bd4116-c7f4-4b78-a581-b47140855990 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:13.936036 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-33bd4116-c7f4-4b78-a581-b47140855990 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:14.079063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-33bd4116-c7f4-4b78-a581-b47140855990 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:14.088029 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-33bd4116-c7f4-4b78-a581-b47140855990 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1269 microversion: 2.1 time: 0.167808 Oct 11 21:04:14.088871 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3615/7284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:13 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:15.113271 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-78c6f1be-380d-45b8-9cb8-22b6bedd46e3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:15.113972 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-78c6f1be-380d-45b8-9cb8-22b6bedd46e3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:15.120386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78c6f1be-380d-45b8-9cb8-22b6bedd46e3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:15.120863 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78c6f1be-380d-45b8-9cb8-22b6bedd46e3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:15.121294 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78c6f1be-380d-45b8-9cb8-22b6bedd46e3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:15.121979 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78c6f1be-380d-45b8-9cb8-22b6bedd46e3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:15.122430 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78c6f1be-380d-45b8-9cb8-22b6bedd46e3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:15.122870 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-78c6f1be-380d-45b8-9cb8-22b6bedd46e3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:15.275169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-78c6f1be-380d-45b8-9cb8-22b6bedd46e3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:15.283371 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-78c6f1be-380d-45b8-9cb8-22b6bedd46e3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1269 microversion: 2.1 time: 0.175359 Oct 11 21:04:15.283957 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3670/7285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:15 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1269 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 21:04:16.305441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-88477c47-227d-495c-af5c-60ed3364f191 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:16.306079 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-88477c47-227d-495c-af5c-60ed3364f191 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:16.313226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88477c47-227d-495c-af5c-60ed3364f191 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:16.313738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88477c47-227d-495c-af5c-60ed3364f191 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:16.314197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88477c47-227d-495c-af5c-60ed3364f191 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:16.314954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88477c47-227d-495c-af5c-60ed3364f191 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:16.315432 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88477c47-227d-495c-af5c-60ed3364f191 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:16.315885 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-88477c47-227d-495c-af5c-60ed3364f191 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:16.458440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-88477c47-227d-495c-af5c-60ed3364f191 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:16.466484 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-88477c47-227d-495c-af5c-60ed3364f191 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1269 microversion: 2.1 time: 0.165029 Oct 11 21:04:16.467074 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3616/7286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:16 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:17.490783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3e5ebdeb-2e4a-4d74-a622-caf919b0b663 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:17.491376 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3e5ebdeb-2e4a-4d74-a622-caf919b0b663 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:17.498173 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e5ebdeb-2e4a-4d74-a622-caf919b0b663 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:17.498692 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e5ebdeb-2e4a-4d74-a622-caf919b0b663 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:17.499196 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e5ebdeb-2e4a-4d74-a622-caf919b0b663 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:17.500082 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e5ebdeb-2e4a-4d74-a622-caf919b0b663 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:17.500540 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e5ebdeb-2e4a-4d74-a622-caf919b0b663 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:17.500969 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e5ebdeb-2e4a-4d74-a622-caf919b0b663 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:17.634377 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3e5ebdeb-2e4a-4d74-a622-caf919b0b663 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:17.642345 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3e5ebdeb-2e4a-4d74-a622-caf919b0b663 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1257 microversion: 2.1 time: 0.155483 Oct 11 21:04:17.642951 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3671/7287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:17 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:18.666554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8d245c53-8b58-4568-8048-dd12eb2f7c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:18.667156 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8d245c53-8b58-4568-8048-dd12eb2f7c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:18.674049 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d245c53-8b58-4568-8048-dd12eb2f7c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:18.674561 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d245c53-8b58-4568-8048-dd12eb2f7c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:18.675017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d245c53-8b58-4568-8048-dd12eb2f7c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:18.675721 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d245c53-8b58-4568-8048-dd12eb2f7c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:18.676189 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d245c53-8b58-4568-8048-dd12eb2f7c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:18.676628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8d245c53-8b58-4568-8048-dd12eb2f7c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:18.805963 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8d245c53-8b58-4568-8048-dd12eb2f7c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:18.813739 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8d245c53-8b58-4568-8048-dd12eb2f7c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1257 microversion: 2.1 time: 0.151111 Oct 11 21:04:18.814308 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3617/7288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:18 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1257 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:19.836394 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-4d837560-5b71-40e5-ac78-299ef3bd06b0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:19.836932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-4d837560-5b71-40e5-ac78-299ef3bd06b0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:19.843957 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d837560-5b71-40e5-ac78-299ef3bd06b0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:19.844492 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d837560-5b71-40e5-ac78-299ef3bd06b0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:19.844932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d837560-5b71-40e5-ac78-299ef3bd06b0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:19.845623 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d837560-5b71-40e5-ac78-299ef3bd06b0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:19.846080 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d837560-5b71-40e5-ac78-299ef3bd06b0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:19.846506 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-4d837560-5b71-40e5-ac78-299ef3bd06b0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:19.981260 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-4d837560-5b71-40e5-ac78-299ef3bd06b0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:19.989473 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-4d837560-5b71-40e5-ac78-299ef3bd06b0 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1257 microversion: 2.1 time: 0.157059 Oct 11 21:04:19.990064 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3672/7289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:19 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:21.013369 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-5a848b3d-00ff-496d-a1d0-4ab80ec888d4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:21.013995 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-5a848b3d-00ff-496d-a1d0-4ab80ec888d4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:21.017299 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell0:SELECT=2 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:04:21.022713 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a848b3d-00ff-496d-a1d0-4ab80ec888d4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:21.023155 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a848b3d-00ff-496d-a1d0-4ab80ec888d4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:21.023604 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a848b3d-00ff-496d-a1d0-4ab80ec888d4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:21.024305 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a848b3d-00ff-496d-a1d0-4ab80ec888d4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:21.024769 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a848b3d-00ff-496d-a1d0-4ab80ec888d4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:21.025205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-5a848b3d-00ff-496d-a1d0-4ab80ec888d4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:21.159612 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-5a848b3d-00ff-496d-a1d0-4ab80ec888d4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:21.167351 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-5a848b3d-00ff-496d-a1d0-4ab80ec888d4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1257 microversion: 2.1 time: 0.158021 Oct 11 21:04:21.167916 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3618/7290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:21 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:22.190300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9bd531fb-cad0-49f1-a6fd-8f0e802935fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:22.190932 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9bd531fb-cad0-49f1-a6fd-8f0e802935fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:22.193033 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=2 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:04:22.193783 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell0:SELECT=6 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:04:22.200760 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bd531fb-cad0-49f1-a6fd-8f0e802935fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:22.201495 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bd531fb-cad0-49f1-a6fd-8f0e802935fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:22.201931 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bd531fb-cad0-49f1-a6fd-8f0e802935fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:22.202647 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bd531fb-cad0-49f1-a6fd-8f0e802935fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:22.203991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bd531fb-cad0-49f1-a6fd-8f0e802935fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:22.204478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9bd531fb-cad0-49f1-a6fd-8f0e802935fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:22.333095 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9bd531fb-cad0-49f1-a6fd-8f0e802935fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:22.340784 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9bd531fb-cad0-49f1-a6fd-8f0e802935fc tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1257 microversion: 2.1 time: 0.155114 Oct 11 21:04:22.341410 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3673/7291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:22 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:23.365276 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-571c15c4-9f4d-41f2-b3a4-da3feeb98110 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:23.365863 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-571c15c4-9f4d-41f2-b3a4-da3feeb98110 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:23.372791 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-571c15c4-9f4d-41f2-b3a4-da3feeb98110 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:23.373304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-571c15c4-9f4d-41f2-b3a4-da3feeb98110 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:23.373767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-571c15c4-9f4d-41f2-b3a4-da3feeb98110 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:23.374483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-571c15c4-9f4d-41f2-b3a4-da3feeb98110 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:23.375022 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-571c15c4-9f4d-41f2-b3a4-da3feeb98110 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:23.375476 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-571c15c4-9f4d-41f2-b3a4-da3feeb98110 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:23.511624 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-571c15c4-9f4d-41f2-b3a4-da3feeb98110 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:23.519684 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-571c15c4-9f4d-41f2-b3a4-da3feeb98110 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1257 microversion: 2.1 time: 0.158382 Oct 11 21:04:23.520259 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3619/7292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:23 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:24.542965 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-1e8ec271-0c98-40f4-b718-cd74dd654c17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:24.543633 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-1e8ec271-0c98-40f4-b718-cd74dd654c17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:24.550616 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e8ec271-0c98-40f4-b718-cd74dd654c17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:24.551112 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e8ec271-0c98-40f4-b718-cd74dd654c17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:24.551559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e8ec271-0c98-40f4-b718-cd74dd654c17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:24.552261 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e8ec271-0c98-40f4-b718-cd74dd654c17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:24.552725 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e8ec271-0c98-40f4-b718-cd74dd654c17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:24.553155 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-1e8ec271-0c98-40f4-b718-cd74dd654c17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:24.685175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-1e8ec271-0c98-40f4-b718-cd74dd654c17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:24.693863 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-1e8ec271-0c98-40f4-b718-cd74dd654c17 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1257 microversion: 2.1 time: 0.154867 Oct 11 21:04:24.694649 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3674/7293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:24 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:25.717594 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2084f1ea-bd7f-4ded-86d6-3c12e47e1353 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:25.718225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2084f1ea-bd7f-4ded-86d6-3c12e47e1353 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:25.725563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2084f1ea-bd7f-4ded-86d6-3c12e47e1353 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:25.726068 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2084f1ea-bd7f-4ded-86d6-3c12e47e1353 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:25.726549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2084f1ea-bd7f-4ded-86d6-3c12e47e1353 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:25.727395 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2084f1ea-bd7f-4ded-86d6-3c12e47e1353 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:25.727866 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2084f1ea-bd7f-4ded-86d6-3c12e47e1353 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:25.728303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2084f1ea-bd7f-4ded-86d6-3c12e47e1353 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:25.864202 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2084f1ea-bd7f-4ded-86d6-3c12e47e1353 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:25.872106 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2084f1ea-bd7f-4ded-86d6-3c12e47e1353 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1257 microversion: 2.1 time: 0.158408 Oct 11 21:04:25.872699 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3620/7294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:25 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:26.895773 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2ea2de65-e92e-4897-bb74-868cbc8ede2d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:26.896416 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2ea2de65-e92e-4897-bb74-868cbc8ede2d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:26.903325 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ea2de65-e92e-4897-bb74-868cbc8ede2d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:26.903806 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ea2de65-e92e-4897-bb74-868cbc8ede2d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:26.904247 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ea2de65-e92e-4897-bb74-868cbc8ede2d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:26.904933 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ea2de65-e92e-4897-bb74-868cbc8ede2d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:26.905388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ea2de65-e92e-4897-bb74-868cbc8ede2d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:26.905810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2ea2de65-e92e-4897-bb74-868cbc8ede2d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:27.037204 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2ea2de65-e92e-4897-bb74-868cbc8ede2d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:27.045068 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2ea2de65-e92e-4897-bb74-868cbc8ede2d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1257 microversion: 2.1 time: 0.153249 Oct 11 21:04:27.045640 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3675/7295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:26 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:27.393253 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ab53c21c-5bbc-41a6-ad35-60d25edd0551 req-fb7969b8-578e-45ef-8298-7b31335b7a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c90433-8eed-461b-83da-276104c884f1", "name": "network-vif-plugged", "status": "completed", "tag": "38584388-c65d-46c1-835d-817413ef1e35"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:04:27.403830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab53c21c-5bbc-41a6-ad35-60d25edd0551 req-fb7969b8-578e-45ef-8298-7b31335b7a19 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:27.404564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab53c21c-5bbc-41a6-ad35-60d25edd0551 req-fb7969b8-578e-45ef-8298-7b31335b7a19 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:27.405017 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ab53c21c-5bbc-41a6-ad35-60d25edd0551 req-fb7969b8-578e-45ef-8298-7b31335b7a19 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:27.418170 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ab53c21c-5bbc-41a6-ad35-60d25edd0551 req-fb7969b8-578e-45ef-8298-7b31335b7a19 service nova] Creating event network-vif-plugged:38584388-c65d-46c1-835d-817413ef1e35 for instance 05c90433-8eed-461b-83da-276104c884f1 on n-h2-860864-3 Oct 11 21:04:27.423950 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ab53c21c-5bbc-41a6-ad35-60d25edd0551 req-fb7969b8-578e-45ef-8298-7b31335b7a19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035132 Oct 11 21:04:27.424761 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3621/7296] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:04:28.068708 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-510d4a96-1433-4407-a01d-ce5e3439a459 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:28.069327 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-510d4a96-1433-4407-a01d-ce5e3439a459 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:28.076534 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510d4a96-1433-4407-a01d-ce5e3439a459 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:28.077018 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510d4a96-1433-4407-a01d-ce5e3439a459 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:28.077458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510d4a96-1433-4407-a01d-ce5e3439a459 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:28.078331 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510d4a96-1433-4407-a01d-ce5e3439a459 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:28.078666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510d4a96-1433-4407-a01d-ce5e3439a459 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:28.079166 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-510d4a96-1433-4407-a01d-ce5e3439a459 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:28.215521 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-510d4a96-1433-4407-a01d-ce5e3439a459 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:28.223223 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-510d4a96-1433-4407-a01d-ce5e3439a459 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1257 microversion: 2.1 time: 0.158448 Oct 11 21:04:28.223805 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3676/7297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:28 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:29.248499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3ac6c7fc-1228-44df-82a0-518c1b46b63e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:29.249225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3ac6c7fc-1228-44df-82a0-518c1b46b63e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:29.255549 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac6c7fc-1228-44df-82a0-518c1b46b63e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:29.256052 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac6c7fc-1228-44df-82a0-518c1b46b63e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:29.256510 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac6c7fc-1228-44df-82a0-518c1b46b63e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:29.257217 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac6c7fc-1228-44df-82a0-518c1b46b63e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:29.257692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac6c7fc-1228-44df-82a0-518c1b46b63e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:29.258134 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3ac6c7fc-1228-44df-82a0-518c1b46b63e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:29.390357 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3ac6c7fc-1228-44df-82a0-518c1b46b63e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:29.398384 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3ac6c7fc-1228-44df-82a0-518c1b46b63e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1442 microversion: 2.1 time: 0.155010 Oct 11 21:04:29.399002 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3622/7298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:29 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:29.421184 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7f11282b-6514-4e31-8a0c-4b04c09f16a8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:04:29.421805 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7f11282b-6514-4e31-8a0c-4b04c09f16a8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:04:29.429159 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f11282b-6514-4e31-8a0c-4b04c09f16a8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:29.429645 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f11282b-6514-4e31-8a0c-4b04c09f16a8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:29.430083 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f11282b-6514-4e31-8a0c-4b04c09f16a8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:29.430798 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f11282b-6514-4e31-8a0c-4b04c09f16a8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:29.431256 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f11282b-6514-4e31-8a0c-4b04c09f16a8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:29.431678 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7f11282b-6514-4e31-8a0c-4b04c09f16a8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:29.561549 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7f11282b-6514-4e31-8a0c-4b04c09f16a8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:04:29.569879 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7f11282b-6514-4e31-8a0c-4b04c09f16a8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1442 microversion: 2.1 time: 0.152535 Oct 11 21:04:29.570448 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3677/7299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:04:29 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:04:31.124738 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-99d1f7be-9bcd-48c4-b7ce-d5e4c3fb62a7 req-52f74824-5920-4e72-a230-a9aebe8edfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c90433-8eed-461b-83da-276104c884f1", "tag": "38584388-c65d-46c1-835d-817413ef1e35"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:04:31.135205 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-99d1f7be-9bcd-48c4-b7ce-d5e4c3fb62a7 req-52f74824-5920-4e72-a230-a9aebe8edfe8 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:04:31.135701 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-99d1f7be-9bcd-48c4-b7ce-d5e4c3fb62a7 req-52f74824-5920-4e72-a230-a9aebe8edfe8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:04:31.136148 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-99d1f7be-9bcd-48c4-b7ce-d5e4c3fb62a7 req-52f74824-5920-4e72-a230-a9aebe8edfe8 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:04:31.147862 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-99d1f7be-9bcd-48c4-b7ce-d5e4c3fb62a7 req-52f74824-5920-4e72-a230-a9aebe8edfe8 service nova] Creating event network-changed:38584388-c65d-46c1-835d-817413ef1e35 for instance 05c90433-8eed-461b-83da-276104c884f1 on n-h2-860864-3 Oct 11 21:04:31.152909 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-99d1f7be-9bcd-48c4-b7ce-d5e4c3fb62a7 req-52f74824-5920-4e72-a230-a9aebe8edfe8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031868 Oct 11 21:04:31.153510 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3623/7300] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:06:26.549338 n-d-860864-3 devstack@n-api.service[126956]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7a2e4673-78ea-41b9-93b9-8ec414db4940] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 21:06:26.550233 n-d-860864-3 devstack@n-api.service[126956]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a5a86ca3-3b5a-42ce-a8df-39c5a0ccf7c8] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 21:06:26.551066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:06:26.551824 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=58 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:06:26.553262 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 21:06:26.553457 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 21:06:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1/action (ip 10.222.0.27) !!! Oct 11 21:06:26.554757 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 21:06:26.554906 n-d-860864-3 devstack@n-api.service[126956]: Tue Oct 11 21:06:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1/action (ip 10.222.0.27) !!! Oct 11 21:06:26.628922 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d53314cc-2451-42c6-a3a9-e7701a5a3db7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:06:26.629453 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d53314cc-2451-42c6-a3a9-e7701a5a3db7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:26.638745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d53314cc-2451-42c6-a3a9-e7701a5a3db7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:26.639234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d53314cc-2451-42c6-a3a9-e7701a5a3db7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:26.639666 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d53314cc-2451-42c6-a3a9-e7701a5a3db7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:26.640368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d53314cc-2451-42c6-a3a9-e7701a5a3db7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:26.640802 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d53314cc-2451-42c6-a3a9-e7701a5a3db7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:26.641220 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d53314cc-2451-42c6-a3a9-e7701a5a3db7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:26.663163 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.objects.instance [None req-d53314cc-2451-42c6-a3a9-e7701a5a3db7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lazy-loading 'flavor' on Instance uuid 05c90433-8eed-461b-83da-276104c884f1 {{(pid=126956) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 21:06:26.733363 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d53314cc-2451-42c6-a3a9-e7701a5a3db7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "POST /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1/action" status: 202 len: 0 microversion: 2.1 time: 0.185550 Oct 11 21:06:26.734087 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3678/7301] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 21:06:26 2022] POST /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 21:06:26.740484 n-d-860864-3 devstack@n-api.service[126955]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0fc4d99-c6db-4dc7-baac-a9ae8040cf98] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 21:06:26.741340 n-d-860864-3 devstack@n-api.service[126955]: ERROR oslo.messaging._drivers.impl_rabbit [-] [40238a9c-3606-4385-94b6-ee4512c24920] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 21:06:26.741961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=24 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:06:26.742895 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=52 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:06:26.744132 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 21:06:26.744264 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 21:06:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 (ip 10.222.0.27) !!! Oct 11 21:06:26.751961 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dff8740e-3718-40b2-9a72-51d937c9f6e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:26.752766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dff8740e-3718-40b2-9a72-51d937c9f6e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:26.761564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff8740e-3718-40b2-9a72-51d937c9f6e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:26.762080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff8740e-3718-40b2-9a72-51d937c9f6e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:26.762579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff8740e-3718-40b2-9a72-51d937c9f6e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:26.763312 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff8740e-3718-40b2-9a72-51d937c9f6e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:26.763790 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff8740e-3718-40b2-9a72-51d937c9f6e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:26.764239 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dff8740e-3718-40b2-9a72-51d937c9f6e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:26.901679 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dff8740e-3718-40b2-9a72-51d937c9f6e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:26.909506 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dff8740e-3718-40b2-9a72-51d937c9f6e1 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.170899 Oct 11 21:06:26.910079 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3624/7302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:26 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:27.937632 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ba14579b-8792-470d-82bc-8a0cfbfebcc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:27.938347 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ba14579b-8792-470d-82bc-8a0cfbfebcc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:27.946741 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba14579b-8792-470d-82bc-8a0cfbfebcc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:27.947229 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba14579b-8792-470d-82bc-8a0cfbfebcc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:27.947668 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba14579b-8792-470d-82bc-8a0cfbfebcc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:27.949092 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba14579b-8792-470d-82bc-8a0cfbfebcc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:27.949550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba14579b-8792-470d-82bc-8a0cfbfebcc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:27.949985 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ba14579b-8792-470d-82bc-8a0cfbfebcc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:27.974570 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] [a5a86ca3-3b5a-42ce-a8df-39c5a0ccf7c8] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46336. Oct 11 21:06:27.981219 n-d-860864-3 devstack@n-api.service[126956]: INFO oslo.messaging._drivers.impl_rabbit [-] [7a2e4673-78ea-41b9-93b9-8ec414db4940] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46334. Oct 11 21:06:28.089661 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ba14579b-8792-470d-82bc-8a0cfbfebcc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:28.097434 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ba14579b-8792-470d-82bc-8a0cfbfebcc4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.167885 Oct 11 21:06:28.098013 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3679/7303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:27 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:29.121054 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-89c176bb-7cce-434d-8105-c3b0c5b20fce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:29.121688 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-89c176bb-7cce-434d-8105-c3b0c5b20fce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:29.131039 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c176bb-7cce-434d-8105-c3b0c5b20fce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:29.131483 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c176bb-7cce-434d-8105-c3b0c5b20fce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:29.131938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c176bb-7cce-434d-8105-c3b0c5b20fce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:29.132648 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c176bb-7cce-434d-8105-c3b0c5b20fce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:29.133120 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c176bb-7cce-434d-8105-c3b0c5b20fce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:29.133564 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-89c176bb-7cce-434d-8105-c3b0c5b20fce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:29.140691 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0fc4d99-c6db-4dc7-baac-a9ae8040cf98] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46340. Oct 11 21:06:29.141441 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] [40238a9c-3606-4385-94b6-ee4512c24920] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46342. Oct 11 21:06:29.267174 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-89c176bb-7cce-434d-8105-c3b0c5b20fce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:29.275003 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-89c176bb-7cce-434d-8105-c3b0c5b20fce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.158603 Oct 11 21:06:29.275585 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3625/7304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:29 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:30.298928 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-7ad592f3-5271-45c2-8dd8-85fc342fe311 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:30.299539 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-7ad592f3-5271-45c2-8dd8-85fc342fe311 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:30.306362 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad592f3-5271-45c2-8dd8-85fc342fe311 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:30.306878 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad592f3-5271-45c2-8dd8-85fc342fe311 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:30.307462 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad592f3-5271-45c2-8dd8-85fc342fe311 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:30.308300 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad592f3-5271-45c2-8dd8-85fc342fe311 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:30.308750 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad592f3-5271-45c2-8dd8-85fc342fe311 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:30.309172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-7ad592f3-5271-45c2-8dd8-85fc342fe311 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:30.439041 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-7ad592f3-5271-45c2-8dd8-85fc342fe311 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:30.446765 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-7ad592f3-5271-45c2-8dd8-85fc342fe311 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.151726 Oct 11 21:06:30.447376 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3680/7305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:30 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:31.470797 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b52908d6-3bd2-4ace-b809-984d70b704b8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:31.471390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b52908d6-3bd2-4ace-b809-984d70b704b8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:31.478265 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b52908d6-3bd2-4ace-b809-984d70b704b8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:31.478799 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b52908d6-3bd2-4ace-b809-984d70b704b8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:31.480074 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b52908d6-3bd2-4ace-b809-984d70b704b8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:31.480784 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b52908d6-3bd2-4ace-b809-984d70b704b8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:31.481289 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b52908d6-3bd2-4ace-b809-984d70b704b8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:31.481733 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b52908d6-3bd2-4ace-b809-984d70b704b8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:31.614131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b52908d6-3bd2-4ace-b809-984d70b704b8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:31.622711 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b52908d6-3bd2-4ace-b809-984d70b704b8 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.155976 Oct 11 21:06:31.623306 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3626/7306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:31 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:32.646147 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-cbaa30fb-0505-411c-919f-6594b84c8433 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:32.646790 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-cbaa30fb-0505-411c-919f-6594b84c8433 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:32.654282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbaa30fb-0505-411c-919f-6594b84c8433 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:32.654792 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbaa30fb-0505-411c-919f-6594b84c8433 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:32.655255 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbaa30fb-0505-411c-919f-6594b84c8433 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:32.655937 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbaa30fb-0505-411c-919f-6594b84c8433 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:32.656390 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbaa30fb-0505-411c-919f-6594b84c8433 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:32.656809 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-cbaa30fb-0505-411c-919f-6594b84c8433 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:32.788283 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-cbaa30fb-0505-411c-919f-6594b84c8433 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:32.796121 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-cbaa30fb-0505-411c-919f-6594b84c8433 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.153953 Oct 11 21:06:32.796701 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3681/7307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:32 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:33.819047 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b3fadce1-478c-49f1-8954-7b976b7c487f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:33.819687 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b3fadce1-478c-49f1-8954-7b976b7c487f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:33.826978 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3fadce1-478c-49f1-8954-7b976b7c487f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:33.827497 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3fadce1-478c-49f1-8954-7b976b7c487f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:33.827956 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3fadce1-478c-49f1-8954-7b976b7c487f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:33.828665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3fadce1-478c-49f1-8954-7b976b7c487f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:33.829141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3fadce1-478c-49f1-8954-7b976b7c487f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:33.829619 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b3fadce1-478c-49f1-8954-7b976b7c487f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:33.960307 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-b3fadce1-478c-49f1-8954-7b976b7c487f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:33.968933 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b3fadce1-478c-49f1-8954-7b976b7c487f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.153867 Oct 11 21:06:33.969520 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3627/7308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:33 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:34.993388 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-c3be0983-48af-435e-90c1-77a41b2cc2fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:34.994007 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-c3be0983-48af-435e-90c1-77a41b2cc2fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:35.000915 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3be0983-48af-435e-90c1-77a41b2cc2fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:35.001405 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3be0983-48af-435e-90c1-77a41b2cc2fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:35.001848 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3be0983-48af-435e-90c1-77a41b2cc2fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:35.002571 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3be0983-48af-435e-90c1-77a41b2cc2fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:35.003036 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3be0983-48af-435e-90c1-77a41b2cc2fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:35.003465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-c3be0983-48af-435e-90c1-77a41b2cc2fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:35.140175 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-c3be0983-48af-435e-90c1-77a41b2cc2fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:35.147932 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-c3be0983-48af-435e-90c1-77a41b2cc2fa tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.158491 Oct 11 21:06:35.148499 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3682/7309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:34 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:36.171197 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2fd17d1b-c0ae-4fe3-ba49-61199de1313a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:36.171851 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2fd17d1b-c0ae-4fe3-ba49-61199de1313a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:36.178722 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd17d1b-c0ae-4fe3-ba49-61199de1313a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:36.179226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd17d1b-c0ae-4fe3-ba49-61199de1313a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:36.179677 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd17d1b-c0ae-4fe3-ba49-61199de1313a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:36.180374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd17d1b-c0ae-4fe3-ba49-61199de1313a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:36.180839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd17d1b-c0ae-4fe3-ba49-61199de1313a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:36.181272 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2fd17d1b-c0ae-4fe3-ba49-61199de1313a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:36.310544 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2fd17d1b-c0ae-4fe3-ba49-61199de1313a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:36.318661 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2fd17d1b-c0ae-4fe3-ba49-61199de1313a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.151296 Oct 11 21:06:36.319379 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3628/7310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:36 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:37.344116 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-38ea8a36-dda9-4eaa-a317-d96d7a579a65 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:37.349315 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-38ea8a36-dda9-4eaa-a317-d96d7a579a65 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:37.356745 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38ea8a36-dda9-4eaa-a317-d96d7a579a65 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:37.357234 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38ea8a36-dda9-4eaa-a317-d96d7a579a65 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:37.357667 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38ea8a36-dda9-4eaa-a317-d96d7a579a65 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:37.358393 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38ea8a36-dda9-4eaa-a317-d96d7a579a65 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:37.358869 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38ea8a36-dda9-4eaa-a317-d96d7a579a65 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:37.359285 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-38ea8a36-dda9-4eaa-a317-d96d7a579a65 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:37.496476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-38ea8a36-dda9-4eaa-a317-d96d7a579a65 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:37.504284 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-38ea8a36-dda9-4eaa-a317-d96d7a579a65 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.164191 Oct 11 21:06:37.504856 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3683/7311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:37 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:38.530070 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-ac336317-1fde-4521-a0dc-670fdf438653 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:38.530844 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-ac336317-1fde-4521-a0dc-670fdf438653 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:38.537880 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac336317-1fde-4521-a0dc-670fdf438653 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:38.538376 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac336317-1fde-4521-a0dc-670fdf438653 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:38.538864 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac336317-1fde-4521-a0dc-670fdf438653 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:38.539569 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac336317-1fde-4521-a0dc-670fdf438653 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:38.540034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac336317-1fde-4521-a0dc-670fdf438653 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:38.540474 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-ac336317-1fde-4521-a0dc-670fdf438653 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:38.674368 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-ac336317-1fde-4521-a0dc-670fdf438653 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:38.682166 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-ac336317-1fde-4521-a0dc-670fdf438653 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.156930 Oct 11 21:06:38.682812 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3629/7312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:38 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:39.706214 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6539e7b4-6e7a-44d4-ad3b-9971277a2f1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:39.706860 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6539e7b4-6e7a-44d4-ad3b-9971277a2f1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:39.713681 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6539e7b4-6e7a-44d4-ad3b-9971277a2f1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:39.714737 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6539e7b4-6e7a-44d4-ad3b-9971277a2f1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:39.715181 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6539e7b4-6e7a-44d4-ad3b-9971277a2f1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:39.715874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6539e7b4-6e7a-44d4-ad3b-9971277a2f1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:39.716337 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6539e7b4-6e7a-44d4-ad3b-9971277a2f1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:39.716769 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6539e7b4-6e7a-44d4-ad3b-9971277a2f1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:40.106568 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-6539e7b4-6e7a-44d4-ad3b-9971277a2f1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:40.114582 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6539e7b4-6e7a-44d4-ad3b-9971277a2f1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.412544 Oct 11 21:06:40.115155 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3684/7313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:39 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:41.138751 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-f0d1301e-a519-44c8-9a79-800a536ccf26 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:41.139396 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-f0d1301e-a519-44c8-9a79-800a536ccf26 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:41.146739 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0d1301e-a519-44c8-9a79-800a536ccf26 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:41.147255 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0d1301e-a519-44c8-9a79-800a536ccf26 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:41.147715 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0d1301e-a519-44c8-9a79-800a536ccf26 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:41.148440 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0d1301e-a519-44c8-9a79-800a536ccf26 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:41.148915 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0d1301e-a519-44c8-9a79-800a536ccf26 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:41.149361 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-f0d1301e-a519-44c8-9a79-800a536ccf26 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:41.291336 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-f0d1301e-a519-44c8-9a79-800a536ccf26 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:41.300592 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-f0d1301e-a519-44c8-9a79-800a536ccf26 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.166127 Oct 11 21:06:41.301760 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3630/7314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:41 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:42.327065 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e760f63e-4125-4f8c-91ad-7da4f1b25fb5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:42.327755 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e760f63e-4125-4f8c-91ad-7da4f1b25fb5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:42.334466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e760f63e-4125-4f8c-91ad-7da4f1b25fb5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:42.335053 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e760f63e-4125-4f8c-91ad-7da4f1b25fb5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:42.335499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e760f63e-4125-4f8c-91ad-7da4f1b25fb5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:42.336193 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e760f63e-4125-4f8c-91ad-7da4f1b25fb5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:42.336651 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e760f63e-4125-4f8c-91ad-7da4f1b25fb5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:42.337107 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e760f63e-4125-4f8c-91ad-7da4f1b25fb5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:42.468511 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e760f63e-4125-4f8c-91ad-7da4f1b25fb5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:42.476270 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e760f63e-4125-4f8c-91ad-7da4f1b25fb5 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1508 microversion: 2.1 time: 0.153874 Oct 11 21:06:42.476828 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3685/7315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:42 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:42.499034 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-53ab792c-8c73-4a73-83be-2383ae1c8199 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:06:42.499647 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-53ab792c-8c73-4a73-83be-2383ae1c8199 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:42.506559 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ab792c-8c73-4a73-83be-2383ae1c8199 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:42.507048 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ab792c-8c73-4a73-83be-2383ae1c8199 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:42.507496 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ab792c-8c73-4a73-83be-2383ae1c8199 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:42.508195 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ab792c-8c73-4a73-83be-2383ae1c8199 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:42.508659 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ab792c-8c73-4a73-83be-2383ae1c8199 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:42.509095 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-53ab792c-8c73-4a73-83be-2383ae1c8199 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:42.539665 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-53ab792c-8c73-4a73-83be-2383ae1c8199 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126955) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 21:06:42.606063 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-53ab792c-8c73-4a73-83be-2383ae1c8199 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "POST /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1/action" status: 202 len: 0 microversion: 2.1 time: 0.111043 Oct 11 21:06:42.606634 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3631/7316] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 11 21:06:42 2022] POST /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 21:06:42.614718 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3944eac8-5673-42dd-926f-197aae098aba tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:42.615338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3944eac8-5673-42dd-926f-197aae098aba tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:42.621559 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3944eac8-5673-42dd-926f-197aae098aba tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:42.622044 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3944eac8-5673-42dd-926f-197aae098aba tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:42.622481 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3944eac8-5673-42dd-926f-197aae098aba tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:42.623212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3944eac8-5673-42dd-926f-197aae098aba tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:42.624223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3944eac8-5673-42dd-926f-197aae098aba tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:42.624223 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3944eac8-5673-42dd-926f-197aae098aba tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:42.822251 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3944eac8-5673-42dd-926f-197aae098aba tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:42.831604 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3944eac8-5673-42dd-926f-197aae098aba tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1516 microversion: 2.1 time: 0.220684 Oct 11 21:06:42.832166 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3686/7317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:42 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:43.856815 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2553e86b-b841-4850-abed-729eaa7a9cce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:43.857458 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2553e86b-b841-4850-abed-729eaa7a9cce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:43.863774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2553e86b-b841-4850-abed-729eaa7a9cce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:43.864290 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2553e86b-b841-4850-abed-729eaa7a9cce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:43.864767 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2553e86b-b841-4850-abed-729eaa7a9cce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:43.865475 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2553e86b-b841-4850-abed-729eaa7a9cce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:43.865949 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2553e86b-b841-4850-abed-729eaa7a9cce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:43.866390 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2553e86b-b841-4850-abed-729eaa7a9cce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:44.008251 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2553e86b-b841-4850-abed-729eaa7a9cce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:44.016372 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2553e86b-b841-4850-abed-729eaa7a9cce tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1518 microversion: 2.1 time: 0.164542 Oct 11 21:06:44.016954 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3632/7318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:43 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:44.133093 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-66fa1ecf-f0a9-474e-8bd5-d02861514b71 req-cb68a496-0e0c-48d1-aac3-695db83f59e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c90433-8eed-461b-83da-276104c884f1", "name": "network-vif-unplugged", "status": "completed", "tag": "38584388-c65d-46c1-835d-817413ef1e35"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:06:44.147974 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-66fa1ecf-f0a9-474e-8bd5-d02861514b71 req-cb68a496-0e0c-48d1-aac3-695db83f59e1 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:44.148618 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-66fa1ecf-f0a9-474e-8bd5-d02861514b71 req-cb68a496-0e0c-48d1-aac3-695db83f59e1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:44.149165 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-66fa1ecf-f0a9-474e-8bd5-d02861514b71 req-cb68a496-0e0c-48d1-aac3-695db83f59e1 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:44.160795 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.compute.server_external_events [req-66fa1ecf-f0a9-474e-8bd5-d02861514b71 req-cb68a496-0e0c-48d1-aac3-695db83f59e1 service nova] Unable to find a host for instance 05c90433-8eed-461b-83da-276104c884f1. Dropping event network-vif-unplugged {{(pid=126956) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 21:06:44.161752 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-66fa1ecf-f0a9-474e-8bd5-d02861514b71 req-cb68a496-0e0c-48d1-aac3-695db83f59e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032667 Oct 11 21:06:44.162679 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3687/7319] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 21:06:45.040304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-2eddf5c0-3b95-474f-aa0a-8cec51cbb0d3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:45.040944 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-2eddf5c0-3b95-474f-aa0a-8cec51cbb0d3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:45.048513 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eddf5c0-3b95-474f-aa0a-8cec51cbb0d3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:45.049019 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eddf5c0-3b95-474f-aa0a-8cec51cbb0d3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:45.049472 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eddf5c0-3b95-474f-aa0a-8cec51cbb0d3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:45.050242 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eddf5c0-3b95-474f-aa0a-8cec51cbb0d3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:45.050774 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eddf5c0-3b95-474f-aa0a-8cec51cbb0d3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:45.051218 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-2eddf5c0-3b95-474f-aa0a-8cec51cbb0d3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:45.186879 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-2eddf5c0-3b95-474f-aa0a-8cec51cbb0d3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:45.194859 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-2eddf5c0-3b95-474f-aa0a-8cec51cbb0d3 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1518 microversion: 2.1 time: 0.158496 Oct 11 21:06:45.195450 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3633/7320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:45 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:46.220066 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ff6a330d-06a1-4a81-b6bc-84a654988a8b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:46.220826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ff6a330d-06a1-4a81-b6bc-84a654988a8b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:46.227884 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6a330d-06a1-4a81-b6bc-84a654988a8b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:46.228386 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6a330d-06a1-4a81-b6bc-84a654988a8b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:46.228829 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6a330d-06a1-4a81-b6bc-84a654988a8b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:46.229550 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6a330d-06a1-4a81-b6bc-84a654988a8b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:46.230015 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6a330d-06a1-4a81-b6bc-84a654988a8b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:46.230441 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ff6a330d-06a1-4a81-b6bc-84a654988a8b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:46.363414 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ff6a330d-06a1-4a81-b6bc-84a654988a8b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:46.371904 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ff6a330d-06a1-4a81-b6bc-84a654988a8b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1518 microversion: 2.1 time: 0.156160 Oct 11 21:06:46.372478 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3688/7321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:46 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:47.395550 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-939b15ee-1799-4c60-b29c-f269a867ff7f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:47.396131 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-939b15ee-1799-4c60-b29c-f269a867ff7f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:47.404099 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939b15ee-1799-4c60-b29c-f269a867ff7f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:47.404628 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939b15ee-1799-4c60-b29c-f269a867ff7f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:47.405081 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939b15ee-1799-4c60-b29c-f269a867ff7f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:47.405787 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939b15ee-1799-4c60-b29c-f269a867ff7f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:47.406279 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939b15ee-1799-4c60-b29c-f269a867ff7f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:47.406740 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-939b15ee-1799-4c60-b29c-f269a867ff7f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:47.543394 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-939b15ee-1799-4c60-b29c-f269a867ff7f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:47.551445 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-939b15ee-1799-4c60-b29c-f269a867ff7f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1518 microversion: 2.1 time: 0.159947 Oct 11 21:06:47.552032 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3634/7322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:47 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:48.576128 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-318eeb2c-0673-4275-bc01-d557de588618 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:48.576739 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-318eeb2c-0673-4275-bc01-d557de588618 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:48.583980 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318eeb2c-0673-4275-bc01-d557de588618 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:48.584476 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318eeb2c-0673-4275-bc01-d557de588618 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:48.584913 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318eeb2c-0673-4275-bc01-d557de588618 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:48.585600 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318eeb2c-0673-4275-bc01-d557de588618 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:48.586089 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318eeb2c-0673-4275-bc01-d557de588618 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:48.586516 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-318eeb2c-0673-4275-bc01-d557de588618 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:48.717387 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-318eeb2c-0673-4275-bc01-d557de588618 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:48.725347 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-318eeb2c-0673-4275-bc01-d557de588618 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.153347 Oct 11 21:06:48.725920 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3689/7323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:48 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:49.255543 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ec5bb991-0b8d-46d3-b761-948bfa607bb3 req-739efca1-b2ae-4075-bbd3-b4e40b42d7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c90433-8eed-461b-83da-276104c884f1", "tag": "38584388-c65d-46c1-835d-817413ef1e35"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:06:49.266585 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ec5bb991-0b8d-46d3-b761-948bfa607bb3 req-739efca1-b2ae-4075-bbd3-b4e40b42d7e2 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:49.267086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ec5bb991-0b8d-46d3-b761-948bfa607bb3 req-739efca1-b2ae-4075-bbd3-b4e40b42d7e2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:49.267529 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ec5bb991-0b8d-46d3-b761-948bfa607bb3 req-739efca1-b2ae-4075-bbd3-b4e40b42d7e2 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:49.278886 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ec5bb991-0b8d-46d3-b761-948bfa607bb3 req-739efca1-b2ae-4075-bbd3-b4e40b42d7e2 service nova] Creating event network-changed:38584388-c65d-46c1-835d-817413ef1e35 for instance 05c90433-8eed-461b-83da-276104c884f1 on n-h1-860864-3 Oct 11 21:06:49.284159 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ec5bb991-0b8d-46d3-b761-948bfa607bb3 req-739efca1-b2ae-4075-bbd3-b4e40b42d7e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032307 Oct 11 21:06:49.284770 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3635/7324] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 21:06:49.749475 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2fc2d3f7-39d5-420f-9fda-37b5f9d71e2a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:49.750070 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2fc2d3f7-39d5-420f-9fda-37b5f9d71e2a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:49.756786 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc2d3f7-39d5-420f-9fda-37b5f9d71e2a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:49.757280 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc2d3f7-39d5-420f-9fda-37b5f9d71e2a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:49.757724 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc2d3f7-39d5-420f-9fda-37b5f9d71e2a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:49.758424 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc2d3f7-39d5-420f-9fda-37b5f9d71e2a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:49.758910 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc2d3f7-39d5-420f-9fda-37b5f9d71e2a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:49.759338 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-2fc2d3f7-39d5-420f-9fda-37b5f9d71e2a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:49.896354 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2fc2d3f7-39d5-420f-9fda-37b5f9d71e2a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:49.904171 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2fc2d3f7-39d5-420f-9fda-37b5f9d71e2a tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.159274 Oct 11 21:06:49.904744 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3690/7325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:49 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:50.929226 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-6eaaec83-7962-4696-8620-d0a1bf9a4a4d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:50.929968 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-6eaaec83-7962-4696-8620-d0a1bf9a4a4d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:50.937158 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eaaec83-7962-4696-8620-d0a1bf9a4a4d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:50.937661 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eaaec83-7962-4696-8620-d0a1bf9a4a4d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:50.938115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eaaec83-7962-4696-8620-d0a1bf9a4a4d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:50.938846 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eaaec83-7962-4696-8620-d0a1bf9a4a4d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:50.939319 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eaaec83-7962-4696-8620-d0a1bf9a4a4d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:50.939762 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-6eaaec83-7962-4696-8620-d0a1bf9a4a4d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:51.071683 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-6eaaec83-7962-4696-8620-d0a1bf9a4a4d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:51.080563 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-6eaaec83-7962-4696-8620-d0a1bf9a4a4d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.156517 Oct 11 21:06:51.081141 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3636/7326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:50 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 21:06:52.103855 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-0a88396f-da9c-4aaf-a576-d2bab8fccaaf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:52.104988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-0a88396f-da9c-4aaf-a576-d2bab8fccaaf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:52.111895 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a88396f-da9c-4aaf-a576-d2bab8fccaaf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:52.112384 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a88396f-da9c-4aaf-a576-d2bab8fccaaf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:52.112818 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a88396f-da9c-4aaf-a576-d2bab8fccaaf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:52.113499 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a88396f-da9c-4aaf-a576-d2bab8fccaaf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:52.113949 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a88396f-da9c-4aaf-a576-d2bab8fccaaf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:52.114368 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-0a88396f-da9c-4aaf-a576-d2bab8fccaaf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:52.249561 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-0a88396f-da9c-4aaf-a576-d2bab8fccaaf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:52.257345 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-0a88396f-da9c-4aaf-a576-d2bab8fccaaf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.157373 Oct 11 21:06:52.257919 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3691/7327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:52 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:53.282282 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-06f2f3f4-e98e-49b6-afe7-0164ca71be8f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:53.282865 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-06f2f3f4-e98e-49b6-afe7-0164ca71be8f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:53.289692 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f2f3f4-e98e-49b6-afe7-0164ca71be8f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:53.290177 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f2f3f4-e98e-49b6-afe7-0164ca71be8f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:53.290651 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f2f3f4-e98e-49b6-afe7-0164ca71be8f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:53.291353 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f2f3f4-e98e-49b6-afe7-0164ca71be8f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:53.292414 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f2f3f4-e98e-49b6-afe7-0164ca71be8f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:53.292860 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-06f2f3f4-e98e-49b6-afe7-0164ca71be8f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:53.421830 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-06f2f3f4-e98e-49b6-afe7-0164ca71be8f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:53.429631 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-06f2f3f4-e98e-49b6-afe7-0164ca71be8f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.151402 Oct 11 21:06:53.430202 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3637/7328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:53 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 21:06:54.453577 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-f3a1dd4f-2191-47db-9856-5bccdf9c53cf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:54.454172 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-f3a1dd4f-2191-47db-9856-5bccdf9c53cf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:54.460947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3a1dd4f-2191-47db-9856-5bccdf9c53cf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:54.461431 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3a1dd4f-2191-47db-9856-5bccdf9c53cf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:54.461866 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3a1dd4f-2191-47db-9856-5bccdf9c53cf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:54.462576 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3a1dd4f-2191-47db-9856-5bccdf9c53cf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:54.463035 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3a1dd4f-2191-47db-9856-5bccdf9c53cf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:54.463458 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-f3a1dd4f-2191-47db-9856-5bccdf9c53cf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:54.595459 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-f3a1dd4f-2191-47db-9856-5bccdf9c53cf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:54.603169 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-f3a1dd4f-2191-47db-9856-5bccdf9c53cf tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.153735 Oct 11 21:06:54.603738 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3692/7329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:54 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:55.626922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c6bc6633-d33c-4af9-86fc-4ca4fe990b20 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:55.627563 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c6bc6633-d33c-4af9-86fc-4ca4fe990b20 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:55.634805 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bc6633-d33c-4af9-86fc-4ca4fe990b20 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:55.635303 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bc6633-d33c-4af9-86fc-4ca4fe990b20 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:55.635836 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bc6633-d33c-4af9-86fc-4ca4fe990b20 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:55.636630 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bc6633-d33c-4af9-86fc-4ca4fe990b20 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:55.637106 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bc6633-d33c-4af9-86fc-4ca4fe990b20 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:55.637540 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c6bc6633-d33c-4af9-86fc-4ca4fe990b20 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:55.773566 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c6bc6633-d33c-4af9-86fc-4ca4fe990b20 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:55.782041 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c6bc6633-d33c-4af9-86fc-4ca4fe990b20 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.159074 Oct 11 21:06:55.782663 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3638/7330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:55 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:56.806206 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-9fd062a1-a173-482d-84b2-cd089f444762 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:56.806861 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-9fd062a1-a173-482d-84b2-cd089f444762 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:56.810240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=31 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:06:56.815680 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fd062a1-a173-482d-84b2-cd089f444762 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:56.816169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fd062a1-a173-482d-84b2-cd089f444762 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:56.816607 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fd062a1-a173-482d-84b2-cd089f444762 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:56.817296 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fd062a1-a173-482d-84b2-cd089f444762 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:56.817747 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fd062a1-a173-482d-84b2-cd089f444762 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:56.818171 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-9fd062a1-a173-482d-84b2-cd089f444762 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:56.822045 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:06:56.957883 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-9fd062a1-a173-482d-84b2-cd089f444762 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:56.966339 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-9fd062a1-a173-482d-84b2-cd089f444762 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.164026 Oct 11 21:06:56.966940 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3693/7331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:56 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:57.990726 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-dcb4ef42-6fe8-4545-91b8-5a577e6867eb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:57.991348 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-dcb4ef42-6fe8-4545-91b8-5a577e6867eb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:57.994141 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:06:58.000003 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb4ef42-6fe8-4545-91b8-5a577e6867eb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:58.000499 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb4ef42-6fe8-4545-91b8-5a577e6867eb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:58.000946 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb4ef42-6fe8-4545-91b8-5a577e6867eb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:58.001640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb4ef42-6fe8-4545-91b8-5a577e6867eb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:58.002110 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb4ef42-6fe8-4545-91b8-5a577e6867eb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:58.002579 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-dcb4ef42-6fe8-4545-91b8-5a577e6867eb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:58.007028 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:06:58.187138 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-dcb4ef42-6fe8-4545-91b8-5a577e6867eb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:58.194948 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-dcb4ef42-6fe8-4545-91b8-5a577e6867eb tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.208153 Oct 11 21:06:58.195530 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3639/7332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:57 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:06:59.219888 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-8e80463b-a038-4fb7-a546-747572335449 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:06:59.220569 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-8e80463b-a038-4fb7-a546-747572335449 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:06:59.226732 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e80463b-a038-4fb7-a546-747572335449 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:59.227219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e80463b-a038-4fb7-a546-747572335449 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:59.227659 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e80463b-a038-4fb7-a546-747572335449 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:59.228348 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e80463b-a038-4fb7-a546-747572335449 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:06:59.228810 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e80463b-a038-4fb7-a546-747572335449 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:06:59.230324 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-8e80463b-a038-4fb7-a546-747572335449 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:06:59.403480 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-8e80463b-a038-4fb7-a546-747572335449 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:06:59.411186 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-8e80463b-a038-4fb7-a546-747572335449 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.195532 Oct 11 21:06:59.411762 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3694/7333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:06:59 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:07:00.434892 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-4f54cdc5-fb9a-49c4-8087-1f88f0e88e7e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:07:00.435554 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-4f54cdc5-fb9a-49c4-8087-1f88f0e88e7e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:07:00.441806 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f54cdc5-fb9a-49c4-8087-1f88f0e88e7e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:07:00.442317 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f54cdc5-fb9a-49c4-8087-1f88f0e88e7e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:07:00.442808 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f54cdc5-fb9a-49c4-8087-1f88f0e88e7e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:07:00.443526 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f54cdc5-fb9a-49c4-8087-1f88f0e88e7e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:07:00.444002 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f54cdc5-fb9a-49c4-8087-1f88f0e88e7e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:07:00.444445 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-4f54cdc5-fb9a-49c4-8087-1f88f0e88e7e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:07:00.519245 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-3baa9309-7810-4589-ab93-f55ee14712de req-8d61e505-c326-4008-9738-4ae8413aa143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c90433-8eed-461b-83da-276104c884f1", "name": "network-vif-plugged", "status": "completed", "tag": "38584388-c65d-46c1-835d-817413ef1e35"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:07:00.535212 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3baa9309-7810-4589-ab93-f55ee14712de req-8d61e505-c326-4008-9738-4ae8413aa143 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:07:00.535826 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3baa9309-7810-4589-ab93-f55ee14712de req-8d61e505-c326-4008-9738-4ae8413aa143 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:07:00.536728 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-3baa9309-7810-4589-ab93-f55ee14712de req-8d61e505-c326-4008-9738-4ae8413aa143 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:07:00.549734 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-3baa9309-7810-4589-ab93-f55ee14712de req-8d61e505-c326-4008-9738-4ae8413aa143 service nova] Creating event network-vif-plugged:38584388-c65d-46c1-835d-817413ef1e35 for instance 05c90433-8eed-461b-83da-276104c884f1 on n-h1-860864-3 Oct 11 21:07:00.555789 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-3baa9309-7810-4589-ab93-f55ee14712de req-8d61e505-c326-4008-9738-4ae8413aa143 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041097 Oct 11 21:07:00.557287 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3695/7334] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:07:00.580922 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-4f54cdc5-fb9a-49c4-8087-1f88f0e88e7e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:07:00.589512 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-4f54cdc5-fb9a-49c4-8087-1f88f0e88e7e tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.158676 Oct 11 21:07:00.590123 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3640/7335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:07:00 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:07:01.614903 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-e87c1c14-8281-4e29-9c4f-6a30cd7c361f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:07:01.615609 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-e87c1c14-8281-4e29-9c4f-6a30cd7c361f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:07:01.622742 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87c1c14-8281-4e29-9c4f-6a30cd7c361f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:07:01.623224 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87c1c14-8281-4e29-9c4f-6a30cd7c361f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:07:01.623658 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87c1c14-8281-4e29-9c4f-6a30cd7c361f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:07:01.624342 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87c1c14-8281-4e29-9c4f-6a30cd7c361f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:07:01.624794 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87c1c14-8281-4e29-9c4f-6a30cd7c361f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:07:01.625217 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-e87c1c14-8281-4e29-9c4f-6a30cd7c361f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:07:01.763697 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-e87c1c14-8281-4e29-9c4f-6a30cd7c361f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:07:01.771473 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-e87c1c14-8281-4e29-9c4f-6a30cd7c361f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1574 microversion: 2.1 time: 0.160862 Oct 11 21:07:01.772037 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3696/7336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:07:01 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:07:02.796065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-40e434d6-cf27-45b6-a426-2a450939b85c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:07:02.796689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-40e434d6-cf27-45b6-a426-2a450939b85c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:07:02.803854 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40e434d6-cf27-45b6-a426-2a450939b85c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:07:02.804358 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40e434d6-cf27-45b6-a426-2a450939b85c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:07:02.804835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40e434d6-cf27-45b6-a426-2a450939b85c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:07:02.805537 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40e434d6-cf27-45b6-a426-2a450939b85c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:07:02.806007 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40e434d6-cf27-45b6-a426-2a450939b85c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:07:02.806441 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-40e434d6-cf27-45b6-a426-2a450939b85c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:07:02.936241 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-40e434d6-cf27-45b6-a426-2a450939b85c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:07:02.944030 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-40e434d6-cf27-45b6-a426-2a450939b85c tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1561 microversion: 2.1 time: 0.152034 Oct 11 21:07:02.944608 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3641/7337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:07:02 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:08:19.268179 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=7 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:08:19.268987 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=19 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:08:19.274465 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-6344df88-f4c9-485a-92a9-a3cb9bd5be1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:19.275219 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6344df88-f4c9-485a-92a9-a3cb9bd5be1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:08:19.275548 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-2c9f317d-2387-484f-8194-a746d33a2882 req-3a9782d3-6bec-442b-85c4-f7e09d87269b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c90433-8eed-461b-83da-276104c884f1", "tag": "38584388-c65d-46c1-835d-817413ef1e35"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:08:19.280731 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=5 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:08:19.281464 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=17 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:08:19.281851 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6344df88-f4c9-485a-92a9-a3cb9bd5be1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:19.282272 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6344df88-f4c9-485a-92a9-a3cb9bd5be1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:19.282742 n-d-860864-3 devstack@n-api.service[126955]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 21:08:19.282896 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6344df88-f4c9-485a-92a9-a3cb9bd5be1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:19.283010 n-d-860864-3 devstack@n-api.service[126955]: Tue Oct 11 21:08:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 11 21:08:19.283478 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6344df88-f4c9-485a-92a9-a3cb9bd5be1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:19.284057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6344df88-f4c9-485a-92a9-a3cb9bd5be1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:19.284523 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-6344df88-f4c9-485a-92a9-a3cb9bd5be1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:19.299067 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2c9f317d-2387-484f-8194-a746d33a2882 req-3a9782d3-6bec-442b-85c4-f7e09d87269b service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:19.299923 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2c9f317d-2387-484f-8194-a746d33a2882 req-3a9782d3-6bec-442b-85c4-f7e09d87269b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:19.300562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-2c9f317d-2387-484f-8194-a746d33a2882 req-3a9782d3-6bec-442b-85c4-f7e09d87269b service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:19.313018 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-2c9f317d-2387-484f-8194-a746d33a2882 req-3a9782d3-6bec-442b-85c4-f7e09d87269b service nova] Creating event network-changed:38584388-c65d-46c1-835d-817413ef1e35 for instance 05c90433-8eed-461b-83da-276104c884f1 on n-h1-860864-3 Oct 11 21:08:19.317026 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-6344df88-f4c9-485a-92a9-a3cb9bd5be1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Going to try to terminate instance {{(pid=126956) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 21:08:19.318855 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-2c9f317d-2387-484f-8194-a746d33a2882 req-3a9782d3-6bec-442b-85c4-f7e09d87269b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049714 Oct 11 21:08:19.319902 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3642/7338] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 21:08:19.404482 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-6344df88-f4c9-485a-92a9-a3cb9bd5be1f tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 204 len: 0 microversion: 2.1 time: 0.137933 Oct 11 21:08:19.405415 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3697/7339] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 11 21:08:19 2022] DELETE /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 21:08:19.414893 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-3bfc11bf-563e-446c-85a1-ac7765591163 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:19.415616 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-3bfc11bf-563e-446c-85a1-ac7765591163 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:08:19.421979 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfc11bf-563e-446c-85a1-ac7765591163 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:19.422873 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfc11bf-563e-446c-85a1-ac7765591163 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:19.423596 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfc11bf-563e-446c-85a1-ac7765591163 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:19.424527 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfc11bf-563e-446c-85a1-ac7765591163 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:19.425176 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfc11bf-563e-446c-85a1-ac7765591163 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:19.425620 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-3bfc11bf-563e-446c-85a1-ac7765591163 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:19.575753 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-3bfc11bf-563e-446c-85a1-ac7765591163 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:08:19.584627 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-3bfc11bf-563e-446c-85a1-ac7765591163 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.174862 Oct 11 21:08:19.585223 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3643/7340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:08:19 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:08:20.609279 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-145de857-42af-4fb9-96cd-bc8a221b4b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:20.609988 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-145de857-42af-4fb9-96cd-bc8a221b4b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:08:20.617655 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-145de857-42af-4fb9-96cd-bc8a221b4b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:20.618132 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-145de857-42af-4fb9-96cd-bc8a221b4b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:20.618591 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-145de857-42af-4fb9-96cd-bc8a221b4b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:20.619282 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-145de857-42af-4fb9-96cd-bc8a221b4b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:20.619734 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-145de857-42af-4fb9-96cd-bc8a221b4b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:20.620154 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-145de857-42af-4fb9-96cd-bc8a221b4b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:20.752765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-145de857-42af-4fb9-96cd-bc8a221b4b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:08:20.760747 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-145de857-42af-4fb9-96cd-bc8a221b4b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1567 microversion: 2.1 time: 0.155753 Oct 11 21:08:20.761324 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3698/7341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:08:20 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:08:21.358886 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-ed152db7-a5b5-4d68-867a-3f9d0383a5b0 req-014bff84-176b-4bf1-8b3c-20f188893f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c90433-8eed-461b-83da-276104c884f1", "name": "network-vif-deleted", "tag": "38584388-c65d-46c1-835d-817413ef1e35"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:08:21.372693 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ed152db7-a5b5-4d68-867a-3f9d0383a5b0 req-014bff84-176b-4bf1-8b3c-20f188893f75 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:21.373191 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ed152db7-a5b5-4d68-867a-3f9d0383a5b0 req-014bff84-176b-4bf1-8b3c-20f188893f75 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:21.373640 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-ed152db7-a5b5-4d68-867a-3f9d0383a5b0 req-014bff84-176b-4bf1-8b3c-20f188893f75 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:21.386922 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-ed152db7-a5b5-4d68-867a-3f9d0383a5b0 req-014bff84-176b-4bf1-8b3c-20f188893f75 service nova] Creating event network-vif-deleted:38584388-c65d-46c1-835d-817413ef1e35 for instance 05c90433-8eed-461b-83da-276104c884f1 on n-h1-860864-3 Oct 11 21:08:21.392516 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-ed152db7-a5b5-4d68-867a-3f9d0383a5b0 req-014bff84-176b-4bf1-8b3c-20f188893f75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037673 Oct 11 21:08:21.393109 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3644/7342] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:08:21.787257 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-3e2ba3c7-1c7d-4c0b-8a2c-9e096059a79b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:21.788057 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-3e2ba3c7-1c7d-4c0b-8a2c-9e096059a79b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:08:21.795538 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e2ba3c7-1c7d-4c0b-8a2c-9e096059a79b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:21.796392 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e2ba3c7-1c7d-4c0b-8a2c-9e096059a79b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:21.796765 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e2ba3c7-1c7d-4c0b-8a2c-9e096059a79b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:21.797477 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e2ba3c7-1c7d-4c0b-8a2c-9e096059a79b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:21.798240 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e2ba3c7-1c7d-4c0b-8a2c-9e096059a79b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:21.798901 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-3e2ba3c7-1c7d-4c0b-8a2c-9e096059a79b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:21.874466 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-3e2ba3c7-1c7d-4c0b-8a2c-9e096059a79b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:08:21.885006 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-3e2ba3c7-1c7d-4c0b-8a2c-9e096059a79b tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1218 microversion: 2.1 time: 0.102278 Oct 11 21:08:21.885539 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3699/7343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:08:21 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:08:22.909430 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c162d895-4ee5-45e0-991c-49905fde89f7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:22.910816 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-c162d895-4ee5-45e0-991c-49905fde89f7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:08:22.918304 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c162d895-4ee5-45e0-991c-49905fde89f7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:22.918852 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c162d895-4ee5-45e0-991c-49905fde89f7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:22.919314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c162d895-4ee5-45e0-991c-49905fde89f7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:22.920033 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c162d895-4ee5-45e0-991c-49905fde89f7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:22.920509 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c162d895-4ee5-45e0-991c-49905fde89f7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:22.920954 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-c162d895-4ee5-45e0-991c-49905fde89f7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:22.988735 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-c162d895-4ee5-45e0-991c-49905fde89f7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:08:22.997418 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c162d895-4ee5-45e0-991c-49905fde89f7 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1218 microversion: 2.1 time: 0.092328 Oct 11 21:08:22.998005 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3645/7344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:08:22 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:08:24.021586 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-ac2a7914-5a40-400c-9652-ae89346eebd4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:24.022515 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-ac2a7914-5a40-400c-9652-ae89346eebd4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:08:24.030125 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac2a7914-5a40-400c-9652-ae89346eebd4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:24.031242 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac2a7914-5a40-400c-9652-ae89346eebd4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:24.031924 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac2a7914-5a40-400c-9652-ae89346eebd4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:24.033457 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac2a7914-5a40-400c-9652-ae89346eebd4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:24.034169 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac2a7914-5a40-400c-9652-ae89346eebd4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:24.034853 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-ac2a7914-5a40-400c-9652-ae89346eebd4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:24.107367 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-ac2a7914-5a40-400c-9652-ae89346eebd4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:08:24.116791 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-ac2a7914-5a40-400c-9652-ae89346eebd4 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1218 microversion: 2.1 time: 0.099819 Oct 11 21:08:24.130117 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3700/7345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:08:24 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:08:25.140214 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-8fda78ff-19d5-4134-a0d9-7813f2857b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:25.140839 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-8fda78ff-19d5-4134-a0d9-7813f2857b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:08:25.147822 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fda78ff-19d5-4134-a0d9-7813f2857b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:25.148318 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fda78ff-19d5-4134-a0d9-7813f2857b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:25.148766 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fda78ff-19d5-4134-a0d9-7813f2857b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:25.149465 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fda78ff-19d5-4134-a0d9-7813f2857b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:25.149939 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fda78ff-19d5-4134-a0d9-7813f2857b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:25.150374 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-8fda78ff-19d5-4134-a0d9-7813f2857b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:25.215140 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-8fda78ff-19d5-4134-a0d9-7813f2857b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb01b4039873414cb0c642504ec975a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80eacc78b786442e8c79ec2fd43b7f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:08:25.223056 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-8fda78ff-19d5-4134-a0d9-7813f2857b88 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 200 len: 1218 microversion: 2.1 time: 0.086772 Oct 11 21:08:25.224157 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3646/7346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:08:25 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:08:26.246774 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:26.247513 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] [instance: 05c90433-8eed-461b-83da-276104c884f1] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:08:26.254336 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:26.254964 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:26.255717 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:26.256814 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:26.257273 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:26.257720 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:26.271271 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.wsgi [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] HTTP exception thrown: Instance 05c90433-8eed-461b-83da-276104c884f1 could not be found. Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Request method failure captured: Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: request: GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 HTTP/1.1 Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: Accept: application/json Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: Accept-Encoding: identity Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: Connection: close Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: Content-Length: 0 Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: Content-Type: application/json Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: Host: 10.222.0.27 Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: Openstack-System-Scope: None Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: User-Agent: python-urllib3/1.26.12 Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Auth-Token: gAAAAABjRdk8o2MynUImqEKkdZpDrG_BHVgSRQi0zyexFD8-u3ARY1mZ2rIw7loeMIns0xO-zQRZJGNxKuiN1MU0u3mUKe4jlzTAjOKFbSsFudNp9vYaxSzF2FtrBsfsaTJvubYy0GP152s1DDfXGHZa5PIZlcCnx-XXXvqYei5qeWDOXqoALvI Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Id: None Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Domain-Name: None Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Identity-Status: Confirmed Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Is-Admin-Project: True Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Id: default Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Domain-Name: Default Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Id: 80eacc78b786442e8c79ec2fd43b7f1b Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Project-Name: tempest-TestShelveInstance-880441147 Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Role: member,reader Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Roles: member,reader Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80eacc78b786442e8c79ec2fd43b7f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80eacc78b786442e8c79ec2fd43b7f1b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80eacc78b786442e8c79ec2fd43b7f1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80eacc78b786442e8c79ec2fd43b7f1b"}]}] Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant: tempest-TestShelveInstance-880441147 Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Id: 80eacc78b786442e8c79ec2fd43b7f1b Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-Tenant-Name: tempest-TestShelveInstance-880441147 Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-User: tempest-TestShelveInstance-880441147-project Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Id: default Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Domain-Name: Default Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Id: fb01b4039873414cb0c642504ec975a5 Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: X-User-Name: tempest-TestShelveInstance-880441147-project Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: method: > Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: exception: Instance 05c90433-8eed-461b-83da-276104c884f1 could not be found. Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: action_args: {'id': '05c90433-8eed-461b-83da-276104c884f1'} Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c90433-8eed-461b-83da-276104c884f1 could not be found. Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c90433-8eed-461b-83da-276104c884f1 could not be found. Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 21:08:26.273025 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 21:08:26.279222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 21:08:26.279222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 21:08:26.279222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 21:08:26.279222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 21:08:26.279222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 21:08:26.279222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c90433-8eed-461b-83da-276104c884f1 could not be found. Oct 11 21:08:26.279222 n-d-860864-3 devstack@n-api.service[126956]: ERROR nova.api.openstack.wsgi Oct 11 21:08:26.279222 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Returning 404 to user: Instance 05c90433-8eed-461b-83da-276104c884f1 could not be found. {{(pid=126956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 21:08:26.279222 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-d551e67a-97bb-4c11-b172-cf509ad01c0d tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1" status: 404 len: 111 microversion: 2.1 time: 0.031542 Oct 11 21:08:26.279222 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3701/7347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:08:26 2022] GET /compute/v2.1/servers/05c90433-8eed-461b-83da-276104c884f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 21:08:26.759562 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-c935e774-fdec-4c2e-9f07-3acefb265b58 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] Calling method '.version_select at 0x7f83cc187940>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:26.789432 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-c935e774-fdec-4c2e-9f07-3acefb265b58 tempest-TestShelveInstance-880441147 tempest-TestShelveInstance-880441147-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-342558582" status: 202 len: 0 microversion: 2.1 time: 0.034159 Oct 11 21:08:26.790667 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3647/7348] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 11 21:08:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-342558582 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 21:08:44.280484 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:08:44.281731 n-d-860864-3 devstack@n-api.service[126956]: DEBUG dbcounter [-] [126956] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:08:44.502874 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-84d71ce8-3e45-4122-b3dd-b8ba9c5aafc6 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Action: 'create', calling method: .version_select at 0x7f83c72fc940>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1084888715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6CvnaGo7aHgyElqQNpAF+exGtHoQ/TJ5wU0p4SUxADNC8hsmKbuVD333BtK8RnseCERTRDgn3snEYw4MRIdENtgS+kkVRgMNcGuY7Ny3GsT4Bd/sEiroJuhhfucMQYNQ=="}} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:08:44.522391 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-84d71ce8-3e45-4122-b3dd-b8ba9c5aafc6 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Getting quotas for project 48ec0ce77ca241c198fdbe2d3374952b. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 21:08:44.527948 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.quota [None req-84d71ce8-3e45-4122-b3dd-b8ba9c5aafc6 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Getting quotas for user 14ce58abcca84861a59745c49a305ed2 and project 48ec0ce77ca241c198fdbe2d3374952b. Resources: {'key_pairs'} {{(pid=126956) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 21:08:44.558047 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-84d71ce8-3e45-4122-b3dd-b8ba9c5aafc6 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.282727 Oct 11 21:08:44.558722 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3702/7349] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 11 21:08:44 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:08:45.512080 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1240712349", "imageRef": "d10025cd-51f6-4b3b-a33d-5e8072e792b3", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1084888715", "security_groups": [{"name": "tempest-secgroup-smoke-1688505913"}], "networks": [{"uuid": "358ab8b4-d948-4406-a48e-86e8abb99040"}]}} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:08:45.522652 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_cell1:SELECT=22 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:08:45.523320 n-d-860864-3 devstack@n-api.service[126955]: DEBUG dbcounter [-] [126955] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=126955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 21:08:45.622270 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.network.neutron [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] validate_networks() for [('358ab8b4-d948-4406-a48e-86e8abb99040', None, None, None, None, None)] {{(pid=126955) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 21:08:46.126300 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Flavor limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 21:08:46.126958 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Image limits 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 21:08:46.127453 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Flavor pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 21:08:46.128065 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Image pref 0:0:0 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 21:08:46.128685 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.virt.hardware [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126955) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 21:08:46.138086 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:46.138626 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:46.139314 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:46.140059 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:46.140532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:46.140970 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:46.159682 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Getting quotas for project 48ec0ce77ca241c198fdbe2d3374952b. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 21:08:46.165488 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.quota [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Getting quotas for user 14ce58abcca84861a59745c49a305ed2 and project 48ec0ce77ca241c198fdbe2d3374952b. Resources: {'cores', 'ram', 'instances'} {{(pid=126955) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 21:08:46.178835 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Going to run 1 instances... {{(pid=126955) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 21:08:46.181225 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] [instance: a339b657-058c-4561-a080-72254a04fd4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d10025cd-51f6-4b3b-a33d-5e8072e792b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126955) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 21:08:46.228458 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-b89b6bcd-bdb0-4b40-9370-c44704f9a89d tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720564 Oct 11 21:08:46.229397 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3648/7350] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 11 21:08:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 21:08:46.241843 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [None req-2f06db7e-2f7e-4799-b15e-9c4041f9b85a tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Calling method '>' {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:46.242617 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.compute.api [None req-2f06db7e-2f7e-4799-b15e-9c4041f9b85a tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] [instance: a339b657-058c-4561-a080-72254a04fd4f] Fetching instance by UUID {{(pid=126956) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:08:46.313991 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.policy [None req-2f06db7e-2f7e-4799-b15e-9c4041f9b85a tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce58abcca84861a59745c49a305ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ec0ce77ca241c198fdbe2d3374952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126956) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:08:46.321920 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [None req-2f06db7e-2f7e-4799-b15e-9c4041f9b85a tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] 10.222.0.27 "GET /compute/v2.1/servers/a339b657-058c-4561-a080-72254a04fd4f" status: 200 len: 1249 microversion: 2.1 time: 0.085190 Oct 11 21:08:46.322516 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3703/7351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:08:46 2022] GET /compute/v2.1/servers/a339b657-058c-4561-a080-72254a04fd4f => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:08:47.347268 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [None req-def0d90d-4a24-453d-8ab1-1db31e9b5b13 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Calling method '>' {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 21:08:47.347931 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.compute.api [None req-def0d90d-4a24-453d-8ab1-1db31e9b5b13 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] [instance: a339b657-058c-4561-a080-72254a04fd4f] Fetching instance by UUID {{(pid=126955) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 21:08:47.356505 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-def0d90d-4a24-453d-8ab1-1db31e9b5b13 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:47.357063 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-def0d90d-4a24-453d-8ab1-1db31e9b5b13 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:47.357532 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-def0d90d-4a24-453d-8ab1-1db31e9b5b13 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:47.358262 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-def0d90d-4a24-453d-8ab1-1db31e9b5b13 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:47.358938 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-def0d90d-4a24-453d-8ab1-1db31e9b5b13 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:47.359401 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [None req-def0d90d-4a24-453d-8ab1-1db31e9b5b13 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:47.455666 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.policy [None req-def0d90d-4a24-453d-8ab1-1db31e9b5b13 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14ce58abcca84861a59745c49a305ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ec0ce77ca241c198fdbe2d3374952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126955) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 21:08:47.465476 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [None req-def0d90d-4a24-453d-8ab1-1db31e9b5b13 tempest-TestSnapshotPattern-1783734497 tempest-TestSnapshotPattern-1783734497-project] 10.222.0.27 "GET /compute/v2.1/servers/a339b657-058c-4561-a080-72254a04fd4f" status: 200 len: 1309 microversion: 2.1 time: 0.123486 Oct 11 21:08:47.466707 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3649/7352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 11 21:08:47 2022] GET /compute/v2.1/servers/a339b657-058c-4561-a080-72254a04fd4f => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 21:08:49.191643 n-d-860864-3 devstack@n-api.service[126956]: DEBUG nova.api.openstack.wsgi [req-fce92c0d-d063-470d-a046-76a9cbb4b8ba req-12aeeb79-a62c-4811-9569-152440208d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a339b657-058c-4561-a080-72254a04fd4f", "tag": "1757ef45-45a7-43b4-af38-b3af9f1e1890"}]} {{(pid=126956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:08:49.203947 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fce92c0d-d063-470d-a046-76a9cbb4b8ba req-12aeeb79-a62c-4811-9569-152440208d49 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:49.204844 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fce92c0d-d063-470d-a046-76a9cbb4b8ba req-12aeeb79-a62c-4811-9569-152440208d49 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:49.205452 n-d-860864-3 devstack@n-api.service[126956]: DEBUG oslo_concurrency.lockutils [req-fce92c0d-d063-470d-a046-76a9cbb4b8ba req-12aeeb79-a62c-4811-9569-152440208d49 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:49.225664 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.compute.server_external_events [req-fce92c0d-d063-470d-a046-76a9cbb4b8ba req-12aeeb79-a62c-4811-9569-152440208d49 service nova] Creating event network-changed:1757ef45-45a7-43b4-af38-b3af9f1e1890 for instance a339b657-058c-4561-a080-72254a04fd4f on n-h2-860864-3 Oct 11 21:08:49.231107 n-d-860864-3 devstack@n-api.service[126956]: INFO nova.api.openstack.requestlog [req-fce92c0d-d063-470d-a046-76a9cbb4b8ba req-12aeeb79-a62c-4811-9569-152440208d49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043460 Oct 11 21:08:49.232339 n-d-860864-3 devstack@n-api.service[126956]: [pid: 126956|app: 0|req: 3704/7353] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 21:08:54.871689 n-d-860864-3 devstack@n-api.service[126955]: DEBUG nova.api.openstack.wsgi [req-5c594b50-1a09-448a-bb81-34219d878a64 req-2aab58f5-2e40-4fff-ad90-3ccb357075b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a339b657-058c-4561-a080-72254a04fd4f", "name": "network-vif-plugged", "status": "completed", "tag": "1757ef45-45a7-43b4-af38-b3af9f1e1890"}]} {{(pid=126955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 21:08:54.881608 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5c594b50-1a09-448a-bb81-34219d878a64 req-2aab58f5-2e40-4fff-ad90-3ccb357075b5 service nova] Acquiring lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 21:08:54.882115 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5c594b50-1a09-448a-bb81-34219d878a64 req-2aab58f5-2e40-4fff-ad90-3ccb357075b5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 21:08:54.882654 n-d-860864-3 devstack@n-api.service[126955]: DEBUG oslo_concurrency.lockutils [req-5c594b50-1a09-448a-bb81-34219d878a64 req-2aab58f5-2e40-4fff-ad90-3ccb357075b5 service nova] Lock "3761bc1b-af0e-4a73-8d30-87f40644ce7a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 21:08:54.894023 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.compute.server_external_events [req-5c594b50-1a09-448a-bb81-34219d878a64 req-2aab58f5-2e40-4fff-ad90-3ccb357075b5 service nova] Creating event network-vif-plugged:1757ef45-45a7-43b4-af38-b3af9f1e1890 for instance a339b657-058c-4561-a080-72254a04fd4f on n-h2-860864-3 Oct 11 21:08:54.899999 n-d-860864-3 devstack@n-api.service[126955]: INFO nova.api.openstack.requestlog [req-5c594b50-1a09-448a-bb81-34219d878a64 req-2aab58f5-2e40-4fff-ad90-3ccb357075b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098266 Oct 11 21:08:54.900563 n-d-860864-3 devstack@n-api.service[126955]: [pid: 126955|app: 0|req: 3650/7354] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 11 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0)